00:00:00.001 Started by upstream project "autotest-nightly-lts" build number 2415 00:00:00.001 originally caused by: 00:00:00.001 Started by upstream project "nightly-trigger" build number 3676 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.142 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.144 The recommended git tool is: git 00:00:00.144 using credential 00000000-0000-0000-0000-000000000002 00:00:00.146 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.192 Fetching changes from the remote Git repository 00:00:00.195 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.245 Using shallow fetch with depth 1 00:00:00.245 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.245 > git --version # timeout=10 00:00:00.280 > git --version # 'git version 2.39.2' 00:00:00.280 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.309 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.309 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:05.806 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:05.821 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:05.834 Checking out Revision db4637e8b949f278f369ec13f70585206ccd9507 (FETCH_HEAD) 00:00:05.834 > git config core.sparsecheckout # timeout=10 00:00:05.844 > git read-tree -mu HEAD # timeout=10 00:00:05.863 > git checkout -f db4637e8b949f278f369ec13f70585206ccd9507 # timeout=5 00:00:05.887 Commit message: "jenkins/jjb-config: Add missing SPDK_TEST_NVME_INTERRUPT flag" 00:00:05.887 > git rev-list --no-walk db4637e8b949f278f369ec13f70585206ccd9507 # timeout=10 00:00:05.997 [Pipeline] Start of Pipeline 00:00:06.012 [Pipeline] library 00:00:06.014 Loading library shm_lib@master 00:00:06.014 Library shm_lib@master is cached. Copying from home. 00:00:06.033 [Pipeline] node 00:00:06.055 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:06.057 [Pipeline] { 00:00:06.067 [Pipeline] catchError 00:00:06.069 [Pipeline] { 00:00:06.084 [Pipeline] wrap 00:00:06.097 [Pipeline] { 00:00:06.106 [Pipeline] stage 00:00:06.108 [Pipeline] { (Prologue) 00:00:06.318 [Pipeline] sh 00:00:07.110 + logger -p user.info -t JENKINS-CI 00:00:07.139 [Pipeline] echo 00:00:07.141 Node: GP11 00:00:07.150 [Pipeline] sh 00:00:07.497 [Pipeline] setCustomBuildProperty 00:00:07.509 [Pipeline] echo 00:00:07.511 Cleanup processes 00:00:07.517 [Pipeline] sh 00:00:07.812 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.812 6657 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.826 [Pipeline] sh 00:00:08.136 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:08.136 ++ grep -v 'sudo pgrep' 00:00:08.136 ++ awk '{print $1}' 00:00:08.136 + sudo kill -9 00:00:08.136 + true 00:00:08.157 [Pipeline] cleanWs 00:00:08.171 [WS-CLEANUP] Deleting project workspace... 00:00:08.171 [WS-CLEANUP] Deferred wipeout is used... 00:00:08.186 [WS-CLEANUP] done 00:00:08.190 [Pipeline] setCustomBuildProperty 00:00:08.206 [Pipeline] sh 00:00:08.502 + sudo git config --global --replace-all safe.directory '*' 00:00:08.615 [Pipeline] httpRequest 00:00:10.614 [Pipeline] echo 00:00:10.616 Sorcerer 10.211.164.20 is alive 00:00:10.626 [Pipeline] retry 00:00:10.628 [Pipeline] { 00:00:10.643 [Pipeline] httpRequest 00:00:10.649 HttpMethod: GET 00:00:10.649 URL: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:10.651 Sending request to url: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:10.671 Response Code: HTTP/1.1 200 OK 00:00:10.671 Success: Status code 200 is in the accepted range: 200,404 00:00:10.672 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:16.165 [Pipeline] } 00:00:16.183 [Pipeline] // retry 00:00:16.191 [Pipeline] sh 00:00:16.489 + tar --no-same-owner -xf jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:16.510 [Pipeline] httpRequest 00:00:16.987 [Pipeline] echo 00:00:16.989 Sorcerer 10.211.164.20 is alive 00:00:16.999 [Pipeline] retry 00:00:17.002 [Pipeline] { 00:00:17.017 [Pipeline] httpRequest 00:00:17.022 HttpMethod: GET 00:00:17.023 URL: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:17.024 Sending request to url: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:17.048 Response Code: HTTP/1.1 200 OK 00:00:17.049 Success: Status code 200 is in the accepted range: 200,404 00:00:17.049 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:11.428 [Pipeline] } 00:01:11.451 [Pipeline] // retry 00:01:11.460 [Pipeline] sh 00:01:11.775 + tar --no-same-owner -xf spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:15.106 [Pipeline] sh 00:01:15.401 + git -C spdk log --oneline -n5 00:01:15.401 c13c99a5e test: Various fixes for Fedora40 00:01:15.401 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:01:15.401 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:01:15.401 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:01:15.401 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:01:15.415 [Pipeline] } 00:01:15.429 [Pipeline] // stage 00:01:15.438 [Pipeline] stage 00:01:15.440 [Pipeline] { (Prepare) 00:01:15.456 [Pipeline] writeFile 00:01:15.473 [Pipeline] sh 00:01:15.763 + logger -p user.info -t JENKINS-CI 00:01:15.779 [Pipeline] sh 00:01:16.070 + logger -p user.info -t JENKINS-CI 00:01:16.083 [Pipeline] sh 00:01:16.374 + cat autorun-spdk.conf 00:01:16.374 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:16.374 SPDK_TEST_NVMF=1 00:01:16.374 SPDK_TEST_NVME_CLI=1 00:01:16.374 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:16.374 SPDK_TEST_NVMF_NICS=e810 00:01:16.374 SPDK_RUN_UBSAN=1 00:01:16.374 NET_TYPE=phy 00:01:16.385 RUN_NIGHTLY=1 00:01:16.390 [Pipeline] readFile 00:01:16.461 [Pipeline] withEnv 00:01:16.464 [Pipeline] { 00:01:16.477 [Pipeline] sh 00:01:16.772 + set -ex 00:01:16.772 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:16.772 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:16.772 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:16.772 ++ SPDK_TEST_NVMF=1 00:01:16.772 ++ SPDK_TEST_NVME_CLI=1 00:01:16.772 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:16.772 ++ SPDK_TEST_NVMF_NICS=e810 00:01:16.772 ++ SPDK_RUN_UBSAN=1 00:01:16.772 ++ NET_TYPE=phy 00:01:16.772 ++ RUN_NIGHTLY=1 00:01:16.772 + case $SPDK_TEST_NVMF_NICS in 00:01:16.772 + DRIVERS=ice 00:01:16.772 + [[ tcp == \r\d\m\a ]] 00:01:16.772 + [[ -n ice ]] 00:01:16.772 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:16.772 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:20.085 rmmod: ERROR: Module irdma is not currently loaded 00:01:20.085 rmmod: ERROR: Module i40iw is not currently loaded 00:01:20.085 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:20.085 + true 00:01:20.085 + for D in $DRIVERS 00:01:20.085 + sudo modprobe ice 00:01:20.085 + exit 0 00:01:20.096 [Pipeline] } 00:01:20.111 [Pipeline] // withEnv 00:01:20.116 [Pipeline] } 00:01:20.132 [Pipeline] // stage 00:01:20.143 [Pipeline] catchError 00:01:20.144 [Pipeline] { 00:01:20.162 [Pipeline] timeout 00:01:20.162 Timeout set to expire in 1 hr 0 min 00:01:20.165 [Pipeline] { 00:01:20.183 [Pipeline] stage 00:01:20.185 [Pipeline] { (Tests) 00:01:20.198 [Pipeline] sh 00:01:20.490 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:20.490 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:20.490 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:20.490 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:20.490 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:20.490 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:20.490 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:20.490 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:20.490 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:20.490 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:20.490 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:01:20.490 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:20.490 + source /etc/os-release 00:01:20.490 ++ NAME='Fedora Linux' 00:01:20.490 ++ VERSION='39 (Cloud Edition)' 00:01:20.490 ++ ID=fedora 00:01:20.490 ++ VERSION_ID=39 00:01:20.490 ++ VERSION_CODENAME= 00:01:20.490 ++ PLATFORM_ID=platform:f39 00:01:20.490 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:01:20.490 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:20.490 ++ LOGO=fedora-logo-icon 00:01:20.490 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:01:20.490 ++ HOME_URL=https://fedoraproject.org/ 00:01:20.490 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:01:20.490 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:20.490 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:20.490 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:20.490 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:01:20.490 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:20.490 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:01:20.490 ++ SUPPORT_END=2024-11-12 00:01:20.490 ++ VARIANT='Cloud Edition' 00:01:20.490 ++ VARIANT_ID=cloud 00:01:20.490 + uname -a 00:01:20.490 Linux spdk-gp-11 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:01:20.490 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:21.428 Hugepages 00:01:21.428 node hugesize free / total 00:01:21.428 node0 1048576kB 0 / 0 00:01:21.428 node0 2048kB 0 / 0 00:01:21.428 node1 1048576kB 0 / 0 00:01:21.428 node1 2048kB 0 / 0 00:01:21.428 00:01:21.428 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:21.428 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:01:21.428 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:01:21.428 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:01:21.428 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:01:21.428 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:01:21.428 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:01:21.428 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:01:21.428 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:01:21.428 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:01:21.428 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:01:21.428 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:01:21.428 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:01:21.428 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:01:21.428 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:01:21.428 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:01:21.428 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:01:21.428 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:01:21.428 + rm -f /tmp/spdk-ld-path 00:01:21.428 + source autorun-spdk.conf 00:01:21.428 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:21.428 ++ SPDK_TEST_NVMF=1 00:01:21.428 ++ SPDK_TEST_NVME_CLI=1 00:01:21.428 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:21.428 ++ SPDK_TEST_NVMF_NICS=e810 00:01:21.428 ++ SPDK_RUN_UBSAN=1 00:01:21.428 ++ NET_TYPE=phy 00:01:21.428 ++ RUN_NIGHTLY=1 00:01:21.428 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:21.428 + [[ -n '' ]] 00:01:21.428 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:21.428 + for M in /var/spdk/build-*-manifest.txt 00:01:21.428 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:01:21.428 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:21.428 + for M in /var/spdk/build-*-manifest.txt 00:01:21.428 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:21.428 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:21.428 + for M in /var/spdk/build-*-manifest.txt 00:01:21.428 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:21.428 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:21.428 ++ uname 00:01:21.428 + [[ Linux == \L\i\n\u\x ]] 00:01:21.428 + sudo dmesg -T 00:01:21.428 + sudo dmesg --clear 00:01:21.686 + dmesg_pid=7326 00:01:21.686 + [[ Fedora Linux == FreeBSD ]] 00:01:21.686 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:21.686 + sudo dmesg -Tw 00:01:21.686 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:21.686 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:21.686 + [[ -x /usr/src/fio-static/fio ]] 00:01:21.686 + export FIO_BIN=/usr/src/fio-static/fio 00:01:21.686 + FIO_BIN=/usr/src/fio-static/fio 00:01:21.686 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:21.686 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:21.686 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:21.686 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:21.686 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:21.686 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:21.686 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:21.686 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:21.686 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:21.686 Test configuration: 00:01:21.686 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:21.686 SPDK_TEST_NVMF=1 00:01:21.686 SPDK_TEST_NVME_CLI=1 00:01:21.686 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:21.686 SPDK_TEST_NVMF_NICS=e810 00:01:21.686 SPDK_RUN_UBSAN=1 00:01:21.686 NET_TYPE=phy 00:01:21.686 RUN_NIGHTLY=1 18:49:42 -- common/autotest_common.sh@1689 -- $ [[ n == y ]] 00:01:21.686 18:49:42 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:21.686 18:49:42 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:21.686 18:49:42 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:21.686 18:49:42 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:21.686 18:49:42 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:21.686 18:49:42 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:21.686 18:49:42 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:21.686 18:49:42 -- paths/export.sh@5 -- $ export PATH 00:01:21.686 18:49:42 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:21.686 18:49:42 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:21.686 18:49:42 -- common/autobuild_common.sh@440 -- $ date +%s 00:01:21.686 18:49:42 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732816182.XXXXXX 00:01:21.687 18:49:42 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732816182.K6y65h 00:01:21.687 18:49:42 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:01:21.687 18:49:42 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:01:21.687 18:49:42 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:01:21.687 18:49:42 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:21.687 18:49:42 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:21.687 18:49:42 -- common/autobuild_common.sh@456 -- $ get_config_params 00:01:21.687 18:49:42 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:01:21.687 18:49:42 -- common/autotest_common.sh@10 -- $ set +x 00:01:21.687 18:49:42 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:01:21.687 18:49:42 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:21.687 18:49:42 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:21.687 18:49:42 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:21.687 18:49:42 -- spdk/autobuild.sh@16 -- $ date -u 00:01:21.687 Thu Nov 28 05:49:42 PM UTC 2024 00:01:21.687 18:49:42 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:21.687 LTS-67-gc13c99a5e 00:01:21.687 18:49:42 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:21.687 18:49:42 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:21.687 18:49:42 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:21.687 18:49:42 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:21.687 18:49:42 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:21.687 18:49:42 -- common/autotest_common.sh@10 -- $ set +x 00:01:21.687 ************************************ 00:01:21.687 START TEST ubsan 00:01:21.687 ************************************ 00:01:21.687 18:49:42 -- common/autotest_common.sh@1114 -- $ echo 'using ubsan' 00:01:21.687 using ubsan 00:01:21.687 00:01:21.687 real 0m0.000s 00:01:21.687 user 0m0.000s 00:01:21.687 sys 0m0.000s 00:01:21.687 18:49:42 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:01:21.687 18:49:42 -- common/autotest_common.sh@10 -- $ set +x 00:01:21.687 ************************************ 00:01:21.687 END TEST ubsan 00:01:21.687 ************************************ 00:01:21.687 18:49:42 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:01:21.687 18:49:42 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:01:21.687 18:49:42 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:01:21.687 18:49:42 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:01:21.687 18:49:42 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:01:21.687 18:49:42 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:01:21.687 18:49:42 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:01:21.687 18:49:42 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:01:21.687 18:49:42 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-shared 00:01:21.946 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:01:21.946 Using default DPDK in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:23.320 Using 'verbs' RDMA provider 00:01:36.119 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:01:46.118 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:01:46.118 Creating mk/config.mk...done. 00:01:46.118 Creating mk/cc.flags.mk...done. 00:01:46.118 Type 'make' to build. 00:01:46.118 18:50:06 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:01:46.118 18:50:06 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:46.118 18:50:06 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:46.118 18:50:06 -- common/autotest_common.sh@10 -- $ set +x 00:01:46.118 ************************************ 00:01:46.118 START TEST make 00:01:46.118 ************************************ 00:01:46.118 18:50:06 -- common/autotest_common.sh@1114 -- $ make -j48 00:01:46.118 make[1]: Nothing to be done for 'all'. 00:01:56.160 The Meson build system 00:01:56.160 Version: 1.5.0 00:01:56.160 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk 00:01:56.160 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp 00:01:56.160 Build type: native build 00:01:56.160 Program cat found: YES (/usr/bin/cat) 00:01:56.160 Project name: DPDK 00:01:56.160 Project version: 23.11.0 00:01:56.160 C compiler for the host machine: cc (gcc 13.3.1 "cc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:01:56.160 C linker for the host machine: cc ld.bfd 2.40-14 00:01:56.160 Host machine cpu family: x86_64 00:01:56.160 Host machine cpu: x86_64 00:01:56.160 Message: ## Building in Developer Mode ## 00:01:56.160 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:56.160 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:01:56.160 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:01:56.160 Program python3 found: YES (/usr/bin/python3) 00:01:56.160 Program cat found: YES (/usr/bin/cat) 00:01:56.160 Compiler for C supports arguments -march=native: YES 00:01:56.160 Checking for size of "void *" : 8 00:01:56.160 Checking for size of "void *" : 8 (cached) 00:01:56.160 Library m found: YES 00:01:56.160 Library numa found: YES 00:01:56.160 Has header "numaif.h" : YES 00:01:56.160 Library fdt found: NO 00:01:56.160 Library execinfo found: NO 00:01:56.160 Has header "execinfo.h" : YES 00:01:56.160 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:01:56.160 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:56.160 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:56.160 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:56.160 Run-time dependency openssl found: YES 3.1.1 00:01:56.160 Run-time dependency libpcap found: YES 1.10.4 00:01:56.160 Has header "pcap.h" with dependency libpcap: YES 00:01:56.160 Compiler for C supports arguments -Wcast-qual: YES 00:01:56.160 Compiler for C supports arguments -Wdeprecated: YES 00:01:56.160 Compiler for C supports arguments -Wformat: YES 00:01:56.160 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:56.160 Compiler for C supports arguments -Wformat-security: NO 00:01:56.160 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:56.160 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:56.160 Compiler for C supports arguments -Wnested-externs: YES 00:01:56.160 Compiler for C supports arguments -Wold-style-definition: YES 00:01:56.160 Compiler for C supports arguments -Wpointer-arith: YES 00:01:56.160 Compiler for C supports arguments -Wsign-compare: YES 00:01:56.160 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:56.160 Compiler for C supports arguments -Wundef: YES 00:01:56.160 Compiler for C supports arguments -Wwrite-strings: YES 00:01:56.160 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:56.160 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:56.160 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:56.160 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:56.160 Program objdump found: YES (/usr/bin/objdump) 00:01:56.160 Compiler for C supports arguments -mavx512f: YES 00:01:56.160 Checking if "AVX512 checking" compiles: YES 00:01:56.160 Fetching value of define "__SSE4_2__" : 1 00:01:56.160 Fetching value of define "__AES__" : 1 00:01:56.160 Fetching value of define "__AVX__" : 1 00:01:56.160 Fetching value of define "__AVX2__" : (undefined) 00:01:56.160 Fetching value of define "__AVX512BW__" : (undefined) 00:01:56.160 Fetching value of define "__AVX512CD__" : (undefined) 00:01:56.160 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:56.160 Fetching value of define "__AVX512F__" : (undefined) 00:01:56.160 Fetching value of define "__AVX512VL__" : (undefined) 00:01:56.160 Fetching value of define "__PCLMUL__" : 1 00:01:56.160 Fetching value of define "__RDRND__" : 1 00:01:56.160 Fetching value of define "__RDSEED__" : (undefined) 00:01:56.160 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:56.160 Fetching value of define "__znver1__" : (undefined) 00:01:56.160 Fetching value of define "__znver2__" : (undefined) 00:01:56.160 Fetching value of define "__znver3__" : (undefined) 00:01:56.160 Fetching value of define "__znver4__" : (undefined) 00:01:56.160 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:56.160 Message: lib/log: Defining dependency "log" 00:01:56.160 Message: lib/kvargs: Defining dependency "kvargs" 00:01:56.160 Message: lib/telemetry: Defining dependency "telemetry" 00:01:56.160 Checking for function "getentropy" : NO 00:01:56.160 Message: lib/eal: Defining dependency "eal" 00:01:56.160 Message: lib/ring: Defining dependency "ring" 00:01:56.160 Message: lib/rcu: Defining dependency "rcu" 00:01:56.160 Message: lib/mempool: Defining dependency "mempool" 00:01:56.160 Message: lib/mbuf: Defining dependency "mbuf" 00:01:56.160 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:56.160 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:56.160 Compiler for C supports arguments -mpclmul: YES 00:01:56.160 Compiler for C supports arguments -maes: YES 00:01:56.160 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:56.160 Compiler for C supports arguments -mavx512bw: YES 00:01:56.160 Compiler for C supports arguments -mavx512dq: YES 00:01:56.160 Compiler for C supports arguments -mavx512vl: YES 00:01:56.160 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:56.160 Compiler for C supports arguments -mavx2: YES 00:01:56.160 Compiler for C supports arguments -mavx: YES 00:01:56.160 Message: lib/net: Defining dependency "net" 00:01:56.160 Message: lib/meter: Defining dependency "meter" 00:01:56.160 Message: lib/ethdev: Defining dependency "ethdev" 00:01:56.160 Message: lib/pci: Defining dependency "pci" 00:01:56.160 Message: lib/cmdline: Defining dependency "cmdline" 00:01:56.160 Message: lib/hash: Defining dependency "hash" 00:01:56.160 Message: lib/timer: Defining dependency "timer" 00:01:56.160 Message: lib/compressdev: Defining dependency "compressdev" 00:01:56.160 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:56.160 Message: lib/dmadev: Defining dependency "dmadev" 00:01:56.160 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:56.160 Message: lib/power: Defining dependency "power" 00:01:56.160 Message: lib/reorder: Defining dependency "reorder" 00:01:56.160 Message: lib/security: Defining dependency "security" 00:01:56.160 Has header "linux/userfaultfd.h" : YES 00:01:56.160 Has header "linux/vduse.h" : YES 00:01:56.160 Message: lib/vhost: Defining dependency "vhost" 00:01:56.160 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:56.160 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:56.160 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:56.160 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:56.160 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:01:56.160 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:01:56.160 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:01:56.160 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:01:56.160 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:01:56.160 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:01:56.160 Program doxygen found: YES (/usr/local/bin/doxygen) 00:01:56.160 Configuring doxy-api-html.conf using configuration 00:01:56.160 Configuring doxy-api-man.conf using configuration 00:01:56.161 Program mandb found: YES (/usr/bin/mandb) 00:01:56.161 Program sphinx-build found: NO 00:01:56.161 Configuring rte_build_config.h using configuration 00:01:56.161 Message: 00:01:56.161 ================= 00:01:56.161 Applications Enabled 00:01:56.161 ================= 00:01:56.161 00:01:56.161 apps: 00:01:56.161 00:01:56.161 00:01:56.161 Message: 00:01:56.161 ================= 00:01:56.161 Libraries Enabled 00:01:56.161 ================= 00:01:56.161 00:01:56.161 libs: 00:01:56.161 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:56.161 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:01:56.161 cryptodev, dmadev, power, reorder, security, vhost, 00:01:56.161 00:01:56.161 Message: 00:01:56.161 =============== 00:01:56.161 Drivers Enabled 00:01:56.161 =============== 00:01:56.161 00:01:56.161 common: 00:01:56.161 00:01:56.161 bus: 00:01:56.161 pci, vdev, 00:01:56.161 mempool: 00:01:56.161 ring, 00:01:56.161 dma: 00:01:56.161 00:01:56.161 net: 00:01:56.161 00:01:56.161 crypto: 00:01:56.161 00:01:56.161 compress: 00:01:56.161 00:01:56.161 vdpa: 00:01:56.161 00:01:56.161 00:01:56.161 Message: 00:01:56.161 ================= 00:01:56.161 Content Skipped 00:01:56.161 ================= 00:01:56.161 00:01:56.161 apps: 00:01:56.161 dumpcap: explicitly disabled via build config 00:01:56.161 graph: explicitly disabled via build config 00:01:56.161 pdump: explicitly disabled via build config 00:01:56.161 proc-info: explicitly disabled via build config 00:01:56.161 test-acl: explicitly disabled via build config 00:01:56.161 test-bbdev: explicitly disabled via build config 00:01:56.161 test-cmdline: explicitly disabled via build config 00:01:56.161 test-compress-perf: explicitly disabled via build config 00:01:56.161 test-crypto-perf: explicitly disabled via build config 00:01:56.161 test-dma-perf: explicitly disabled via build config 00:01:56.161 test-eventdev: explicitly disabled via build config 00:01:56.161 test-fib: explicitly disabled via build config 00:01:56.161 test-flow-perf: explicitly disabled via build config 00:01:56.161 test-gpudev: explicitly disabled via build config 00:01:56.161 test-mldev: explicitly disabled via build config 00:01:56.161 test-pipeline: explicitly disabled via build config 00:01:56.161 test-pmd: explicitly disabled via build config 00:01:56.161 test-regex: explicitly disabled via build config 00:01:56.161 test-sad: explicitly disabled via build config 00:01:56.161 test-security-perf: explicitly disabled via build config 00:01:56.161 00:01:56.161 libs: 00:01:56.161 metrics: explicitly disabled via build config 00:01:56.161 acl: explicitly disabled via build config 00:01:56.161 bbdev: explicitly disabled via build config 00:01:56.161 bitratestats: explicitly disabled via build config 00:01:56.161 bpf: explicitly disabled via build config 00:01:56.161 cfgfile: explicitly disabled via build config 00:01:56.161 distributor: explicitly disabled via build config 00:01:56.161 efd: explicitly disabled via build config 00:01:56.161 eventdev: explicitly disabled via build config 00:01:56.161 dispatcher: explicitly disabled via build config 00:01:56.161 gpudev: explicitly disabled via build config 00:01:56.161 gro: explicitly disabled via build config 00:01:56.161 gso: explicitly disabled via build config 00:01:56.161 ip_frag: explicitly disabled via build config 00:01:56.161 jobstats: explicitly disabled via build config 00:01:56.161 latencystats: explicitly disabled via build config 00:01:56.161 lpm: explicitly disabled via build config 00:01:56.161 member: explicitly disabled via build config 00:01:56.161 pcapng: explicitly disabled via build config 00:01:56.161 rawdev: explicitly disabled via build config 00:01:56.161 regexdev: explicitly disabled via build config 00:01:56.161 mldev: explicitly disabled via build config 00:01:56.161 rib: explicitly disabled via build config 00:01:56.161 sched: explicitly disabled via build config 00:01:56.161 stack: explicitly disabled via build config 00:01:56.161 ipsec: explicitly disabled via build config 00:01:56.161 pdcp: explicitly disabled via build config 00:01:56.161 fib: explicitly disabled via build config 00:01:56.161 port: explicitly disabled via build config 00:01:56.161 pdump: explicitly disabled via build config 00:01:56.161 table: explicitly disabled via build config 00:01:56.161 pipeline: explicitly disabled via build config 00:01:56.161 graph: explicitly disabled via build config 00:01:56.161 node: explicitly disabled via build config 00:01:56.161 00:01:56.161 drivers: 00:01:56.161 common/cpt: not in enabled drivers build config 00:01:56.161 common/dpaax: not in enabled drivers build config 00:01:56.161 common/iavf: not in enabled drivers build config 00:01:56.161 common/idpf: not in enabled drivers build config 00:01:56.161 common/mvep: not in enabled drivers build config 00:01:56.161 common/octeontx: not in enabled drivers build config 00:01:56.161 bus/auxiliary: not in enabled drivers build config 00:01:56.161 bus/cdx: not in enabled drivers build config 00:01:56.161 bus/dpaa: not in enabled drivers build config 00:01:56.161 bus/fslmc: not in enabled drivers build config 00:01:56.161 bus/ifpga: not in enabled drivers build config 00:01:56.161 bus/platform: not in enabled drivers build config 00:01:56.161 bus/vmbus: not in enabled drivers build config 00:01:56.161 common/cnxk: not in enabled drivers build config 00:01:56.161 common/mlx5: not in enabled drivers build config 00:01:56.161 common/nfp: not in enabled drivers build config 00:01:56.161 common/qat: not in enabled drivers build config 00:01:56.161 common/sfc_efx: not in enabled drivers build config 00:01:56.161 mempool/bucket: not in enabled drivers build config 00:01:56.161 mempool/cnxk: not in enabled drivers build config 00:01:56.161 mempool/dpaa: not in enabled drivers build config 00:01:56.161 mempool/dpaa2: not in enabled drivers build config 00:01:56.161 mempool/octeontx: not in enabled drivers build config 00:01:56.161 mempool/stack: not in enabled drivers build config 00:01:56.161 dma/cnxk: not in enabled drivers build config 00:01:56.161 dma/dpaa: not in enabled drivers build config 00:01:56.161 dma/dpaa2: not in enabled drivers build config 00:01:56.161 dma/hisilicon: not in enabled drivers build config 00:01:56.161 dma/idxd: not in enabled drivers build config 00:01:56.161 dma/ioat: not in enabled drivers build config 00:01:56.161 dma/skeleton: not in enabled drivers build config 00:01:56.161 net/af_packet: not in enabled drivers build config 00:01:56.161 net/af_xdp: not in enabled drivers build config 00:01:56.161 net/ark: not in enabled drivers build config 00:01:56.161 net/atlantic: not in enabled drivers build config 00:01:56.161 net/avp: not in enabled drivers build config 00:01:56.161 net/axgbe: not in enabled drivers build config 00:01:56.161 net/bnx2x: not in enabled drivers build config 00:01:56.161 net/bnxt: not in enabled drivers build config 00:01:56.161 net/bonding: not in enabled drivers build config 00:01:56.161 net/cnxk: not in enabled drivers build config 00:01:56.161 net/cpfl: not in enabled drivers build config 00:01:56.161 net/cxgbe: not in enabled drivers build config 00:01:56.161 net/dpaa: not in enabled drivers build config 00:01:56.161 net/dpaa2: not in enabled drivers build config 00:01:56.161 net/e1000: not in enabled drivers build config 00:01:56.161 net/ena: not in enabled drivers build config 00:01:56.161 net/enetc: not in enabled drivers build config 00:01:56.161 net/enetfec: not in enabled drivers build config 00:01:56.161 net/enic: not in enabled drivers build config 00:01:56.161 net/failsafe: not in enabled drivers build config 00:01:56.161 net/fm10k: not in enabled drivers build config 00:01:56.161 net/gve: not in enabled drivers build config 00:01:56.161 net/hinic: not in enabled drivers build config 00:01:56.161 net/hns3: not in enabled drivers build config 00:01:56.161 net/i40e: not in enabled drivers build config 00:01:56.161 net/iavf: not in enabled drivers build config 00:01:56.161 net/ice: not in enabled drivers build config 00:01:56.161 net/idpf: not in enabled drivers build config 00:01:56.161 net/igc: not in enabled drivers build config 00:01:56.161 net/ionic: not in enabled drivers build config 00:01:56.161 net/ipn3ke: not in enabled drivers build config 00:01:56.161 net/ixgbe: not in enabled drivers build config 00:01:56.161 net/mana: not in enabled drivers build config 00:01:56.161 net/memif: not in enabled drivers build config 00:01:56.161 net/mlx4: not in enabled drivers build config 00:01:56.161 net/mlx5: not in enabled drivers build config 00:01:56.161 net/mvneta: not in enabled drivers build config 00:01:56.161 net/mvpp2: not in enabled drivers build config 00:01:56.161 net/netvsc: not in enabled drivers build config 00:01:56.161 net/nfb: not in enabled drivers build config 00:01:56.161 net/nfp: not in enabled drivers build config 00:01:56.161 net/ngbe: not in enabled drivers build config 00:01:56.161 net/null: not in enabled drivers build config 00:01:56.161 net/octeontx: not in enabled drivers build config 00:01:56.161 net/octeon_ep: not in enabled drivers build config 00:01:56.161 net/pcap: not in enabled drivers build config 00:01:56.161 net/pfe: not in enabled drivers build config 00:01:56.161 net/qede: not in enabled drivers build config 00:01:56.161 net/ring: not in enabled drivers build config 00:01:56.161 net/sfc: not in enabled drivers build config 00:01:56.161 net/softnic: not in enabled drivers build config 00:01:56.161 net/tap: not in enabled drivers build config 00:01:56.161 net/thunderx: not in enabled drivers build config 00:01:56.161 net/txgbe: not in enabled drivers build config 00:01:56.161 net/vdev_netvsc: not in enabled drivers build config 00:01:56.161 net/vhost: not in enabled drivers build config 00:01:56.161 net/virtio: not in enabled drivers build config 00:01:56.161 net/vmxnet3: not in enabled drivers build config 00:01:56.161 raw/*: missing internal dependency, "rawdev" 00:01:56.161 crypto/armv8: not in enabled drivers build config 00:01:56.161 crypto/bcmfs: not in enabled drivers build config 00:01:56.161 crypto/caam_jr: not in enabled drivers build config 00:01:56.161 crypto/ccp: not in enabled drivers build config 00:01:56.161 crypto/cnxk: not in enabled drivers build config 00:01:56.161 crypto/dpaa_sec: not in enabled drivers build config 00:01:56.162 crypto/dpaa2_sec: not in enabled drivers build config 00:01:56.162 crypto/ipsec_mb: not in enabled drivers build config 00:01:56.162 crypto/mlx5: not in enabled drivers build config 00:01:56.162 crypto/mvsam: not in enabled drivers build config 00:01:56.162 crypto/nitrox: not in enabled drivers build config 00:01:56.162 crypto/null: not in enabled drivers build config 00:01:56.162 crypto/octeontx: not in enabled drivers build config 00:01:56.162 crypto/openssl: not in enabled drivers build config 00:01:56.162 crypto/scheduler: not in enabled drivers build config 00:01:56.162 crypto/uadk: not in enabled drivers build config 00:01:56.162 crypto/virtio: not in enabled drivers build config 00:01:56.162 compress/isal: not in enabled drivers build config 00:01:56.162 compress/mlx5: not in enabled drivers build config 00:01:56.162 compress/octeontx: not in enabled drivers build config 00:01:56.162 compress/zlib: not in enabled drivers build config 00:01:56.162 regex/*: missing internal dependency, "regexdev" 00:01:56.162 ml/*: missing internal dependency, "mldev" 00:01:56.162 vdpa/ifc: not in enabled drivers build config 00:01:56.162 vdpa/mlx5: not in enabled drivers build config 00:01:56.162 vdpa/nfp: not in enabled drivers build config 00:01:56.162 vdpa/sfc: not in enabled drivers build config 00:01:56.162 event/*: missing internal dependency, "eventdev" 00:01:56.162 baseband/*: missing internal dependency, "bbdev" 00:01:56.162 gpu/*: missing internal dependency, "gpudev" 00:01:56.162 00:01:56.162 00:01:56.162 Build targets in project: 85 00:01:56.162 00:01:56.162 DPDK 23.11.0 00:01:56.162 00:01:56.162 User defined options 00:01:56.162 buildtype : debug 00:01:56.162 default_library : shared 00:01:56.162 libdir : lib 00:01:56.162 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:56.162 c_args : -fPIC -Werror -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds 00:01:56.162 c_link_args : 00:01:56.162 cpu_instruction_set: native 00:01:56.162 disable_apps : test-sad,test-acl,test-dma-perf,test-pipeline,test-compress-perf,test-fib,test-flow-perf,test-crypto-perf,test-bbdev,test-eventdev,pdump,test-mldev,test-cmdline,graph,test-security-perf,test-pmd,test,proc-info,test-regex,dumpcap,test-gpudev 00:01:56.162 disable_libs : port,sched,rib,node,ipsec,distributor,gro,eventdev,pdcp,acl,member,latencystats,efd,stack,regexdev,rawdev,bpf,metrics,gpudev,pipeline,pdump,table,fib,dispatcher,mldev,gso,cfgfile,bitratestats,ip_frag,graph,lpm,jobstats,pcapng,bbdev 00:01:56.162 enable_docs : false 00:01:56.162 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:01:56.162 enable_kmods : false 00:01:56.162 tests : false 00:01:56.162 00:01:56.162 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:56.162 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp' 00:01:56.162 [1/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:56.162 [2/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:56.162 [3/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:56.162 [4/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:56.162 [5/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:56.162 [6/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:56.162 [7/265] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:56.162 [8/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:56.162 [9/265] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:56.162 [10/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:56.162 [11/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:56.162 [12/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:56.162 [13/265] Linking static target lib/librte_kvargs.a 00:01:56.162 [14/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:56.162 [15/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:56.162 [16/265] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:56.162 [17/265] Linking static target lib/librte_log.a 00:01:56.162 [18/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:56.162 [19/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:56.424 [20/265] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:56.424 [21/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:56.687 [22/265] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:56.950 [23/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:56.950 [24/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:56.950 [25/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:56.950 [26/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:56.950 [27/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:56.950 [28/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:56.950 [29/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:56.950 [30/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:56.950 [31/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:56.950 [32/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:56.950 [33/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:56.950 [34/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:56.950 [35/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:56.950 [36/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:56.950 [37/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:56.950 [38/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:56.950 [39/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:56.950 [40/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:56.950 [41/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:56.950 [42/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:56.950 [43/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:56.950 [44/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:56.950 [45/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:57.220 [46/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:57.220 [47/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:57.220 [48/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:57.220 [49/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:57.220 [50/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:57.220 [51/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:57.220 [52/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:57.220 [53/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:57.220 [54/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:57.220 [55/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:57.220 [56/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:57.220 [57/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:57.220 [58/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:57.220 [59/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:57.220 [60/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:57.220 [61/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:57.220 [62/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:57.220 [63/265] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:57.220 [64/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:57.220 [65/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:57.220 [66/265] Linking static target lib/librte_telemetry.a 00:01:57.485 [67/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:57.485 [68/265] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:57.485 [69/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:57.485 [70/265] Linking static target lib/librte_pci.a 00:01:57.485 [71/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:57.485 [72/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:57.485 [73/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:57.485 [74/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:57.485 [75/265] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:57.485 [76/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:57.485 [77/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:57.485 [78/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:57.485 [79/265] Linking target lib/librte_log.so.24.0 00:01:57.485 [80/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:57.751 [81/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:57.751 [82/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:57.751 [83/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:57.751 [84/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:57.751 [85/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:57.751 [86/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:57.751 [87/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:57.751 [88/265] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:57.751 [89/265] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:58.017 [90/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:58.017 [91/265] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:58.017 [92/265] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.017 [93/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:58.017 [94/265] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:58.017 [95/265] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:58.017 [96/265] Linking target lib/librte_kvargs.so.24.0 00:01:58.017 [97/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:58.017 [98/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:58.017 [99/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:58.017 [100/265] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:58.017 [101/265] Linking static target lib/librte_meter.a 00:01:58.017 [102/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:58.017 [103/265] Linking static target lib/librte_eal.a 00:01:58.017 [104/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:58.017 [105/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:58.017 [106/265] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:58.017 [107/265] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:58.281 [108/265] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:58.281 [109/265] Linking static target lib/librte_ring.a 00:01:58.281 [110/265] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:58.281 [111/265] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:58.281 [112/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:58.281 [113/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:58.281 [114/265] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:58.281 [115/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:58.281 [116/265] Linking static target lib/librte_mempool.a 00:01:58.281 [117/265] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:58.281 [118/265] Linking static target lib/librte_rcu.a 00:01:58.281 [119/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:58.281 [120/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:58.281 [121/265] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.281 [122/265] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:58.281 [123/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:58.281 [124/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:58.281 [125/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:58.281 [126/265] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:58.281 [127/265] Linking target lib/librte_telemetry.so.24.0 00:01:58.551 [128/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:58.551 [129/265] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:58.551 [130/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:58.551 [131/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:58.551 [132/265] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.551 [133/265] Linking static target lib/librte_cmdline.a 00:01:58.551 [134/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:58.551 [135/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:58.551 [136/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:58.551 [137/265] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:58.551 [138/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:58.551 [139/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:58.551 [140/265] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.821 [141/265] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:58.821 [142/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:58.821 [143/265] Linking static target lib/librte_timer.a 00:01:58.821 [144/265] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:58.821 [145/265] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:58.821 [146/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:58.821 [147/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:58.821 [148/265] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:58.821 [149/265] Linking static target lib/librte_net.a 00:01:58.821 [150/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:58.821 [151/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:59.082 [152/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:59.082 [153/265] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:59.082 [154/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:59.082 [155/265] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:59.082 [156/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:59.082 [157/265] Linking static target lib/librte_dmadev.a 00:01:59.082 [158/265] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.082 [159/265] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.082 [160/265] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:59.082 [161/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:59.082 [162/265] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.341 [163/265] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:59.341 [164/265] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:59.341 [165/265] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:59.341 [166/265] Linking static target lib/librte_hash.a 00:01:59.341 [167/265] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:59.341 [168/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:59.341 [169/265] Linking static target lib/librte_compressdev.a 00:01:59.341 [170/265] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:59.341 [171/265] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:59.341 [172/265] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:59.341 [173/265] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:59.341 [174/265] Linking static target lib/librte_power.a 00:01:59.341 [175/265] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:59.341 [176/265] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:59.341 [177/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:59.341 [178/265] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.601 [179/265] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.601 [180/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:59.601 [181/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:59.601 [182/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:59.601 [183/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:59.601 [184/265] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:59.601 [185/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:59.601 [186/265] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:59.601 [187/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:59.601 [188/265] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:59.601 [189/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:59.601 [190/265] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:59.601 [191/265] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:59.601 [192/265] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.861 [193/265] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.861 [194/265] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:59.861 [195/265] Linking static target lib/librte_reorder.a 00:01:59.861 [196/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:59.861 [197/265] Linking static target lib/librte_mbuf.a 00:01:59.861 [198/265] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:59.861 [199/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:59.861 [200/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:59.861 [201/265] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:59.861 [202/265] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:59.861 [203/265] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:59.861 [204/265] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:59.861 [205/265] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:59.861 [206/265] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:59.861 [207/265] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:59.861 [208/265] Linking static target drivers/librte_mempool_ring.a 00:01:59.861 [209/265] Linking static target drivers/librte_bus_vdev.a 00:01:59.861 [210/265] Linking static target lib/librte_security.a 00:01:59.861 [211/265] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:59.861 [212/265] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:59.861 [213/265] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:59.861 [214/265] Linking static target drivers/librte_bus_pci.a 00:02:00.121 [215/265] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.121 [216/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:02:00.121 [217/265] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.121 [218/265] Linking static target lib/librte_cryptodev.a 00:02:00.121 [219/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:02:00.121 [220/265] Linking static target lib/librte_ethdev.a 00:02:00.381 [221/265] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.381 [222/265] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:02:00.381 [223/265] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:02:01.319 [224/265] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:02.699 [225/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:02:04.604 [226/265] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:02:04.604 [227/265] Linking target lib/librte_eal.so.24.0 00:02:04.604 [228/265] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:02:04.604 [229/265] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:02:04.604 [230/265] Linking target lib/librte_ring.so.24.0 00:02:04.604 [231/265] Linking target lib/librte_timer.so.24.0 00:02:04.604 [232/265] Linking target lib/librte_meter.so.24.0 00:02:04.604 [233/265] Linking target lib/librte_pci.so.24.0 00:02:04.604 [234/265] Linking target lib/librte_dmadev.so.24.0 00:02:04.604 [235/265] Linking target drivers/librte_bus_vdev.so.24.0 00:02:04.604 [236/265] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:02:04.604 [237/265] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:02:04.604 [238/265] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:02:04.604 [239/265] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:02:04.604 [240/265] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:02:04.604 [241/265] Linking target lib/librte_rcu.so.24.0 00:02:04.604 [242/265] Linking target lib/librte_mempool.so.24.0 00:02:04.604 [243/265] Linking target drivers/librte_bus_pci.so.24.0 00:02:04.863 [244/265] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:02:04.863 [245/265] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:02:04.863 [246/265] Linking target drivers/librte_mempool_ring.so.24.0 00:02:04.863 [247/265] Linking target lib/librte_mbuf.so.24.0 00:02:04.863 [248/265] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:02:04.863 [249/265] Linking target lib/librte_compressdev.so.24.0 00:02:04.863 [250/265] Linking target lib/librte_reorder.so.24.0 00:02:04.863 [251/265] Linking target lib/librte_net.so.24.0 00:02:04.863 [252/265] Linking target lib/librte_cryptodev.so.24.0 00:02:05.122 [253/265] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:02:05.122 [254/265] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:02:05.122 [255/265] Linking target lib/librte_hash.so.24.0 00:02:05.122 [256/265] Linking target lib/librte_security.so.24.0 00:02:05.122 [257/265] Linking target lib/librte_cmdline.so.24.0 00:02:05.122 [258/265] Linking target lib/librte_ethdev.so.24.0 00:02:05.122 [259/265] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:02:05.381 [260/265] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:02:05.381 [261/265] Linking target lib/librte_power.so.24.0 00:02:07.923 [262/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:02:07.924 [263/265] Linking static target lib/librte_vhost.a 00:02:09.309 [264/265] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:02:09.309 [265/265] Linking target lib/librte_vhost.so.24.0 00:02:09.309 INFO: autodetecting backend as ninja 00:02:09.309 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp -j 48 00:02:09.882 CC lib/log/log.o 00:02:09.882 CC lib/log/log_deprecated.o 00:02:09.882 CC lib/log/log_flags.o 00:02:09.882 CC lib/ut_mock/mock.o 00:02:09.882 CC lib/ut/ut.o 00:02:10.142 LIB libspdk_ut_mock.a 00:02:10.142 LIB libspdk_log.a 00:02:10.142 SO libspdk_ut_mock.so.5.0 00:02:10.142 LIB libspdk_ut.a 00:02:10.142 SO libspdk_ut.so.1.0 00:02:10.142 SO libspdk_log.so.6.1 00:02:10.142 SYMLINK libspdk_ut_mock.so 00:02:10.142 SYMLINK libspdk_ut.so 00:02:10.142 SYMLINK libspdk_log.so 00:02:10.401 CC lib/ioat/ioat.o 00:02:10.401 CXX lib/trace_parser/trace.o 00:02:10.401 CC lib/dma/dma.o 00:02:10.401 CC lib/util/base64.o 00:02:10.401 CC lib/util/bit_array.o 00:02:10.401 CC lib/util/cpuset.o 00:02:10.401 CC lib/util/crc16.o 00:02:10.401 CC lib/util/crc32.o 00:02:10.401 CC lib/util/crc32c.o 00:02:10.401 CC lib/util/crc32_ieee.o 00:02:10.401 CC lib/util/crc64.o 00:02:10.401 CC lib/util/dif.o 00:02:10.401 CC lib/util/fd.o 00:02:10.401 CC lib/util/file.o 00:02:10.401 CC lib/util/hexlify.o 00:02:10.401 CC lib/util/iov.o 00:02:10.401 CC lib/util/math.o 00:02:10.401 CC lib/util/pipe.o 00:02:10.401 CC lib/util/strerror_tls.o 00:02:10.401 CC lib/util/string.o 00:02:10.401 CC lib/util/uuid.o 00:02:10.401 CC lib/util/fd_group.o 00:02:10.401 CC lib/util/zipf.o 00:02:10.401 CC lib/util/xor.o 00:02:10.401 CC lib/vfio_user/host/vfio_user_pci.o 00:02:10.401 CC lib/vfio_user/host/vfio_user.o 00:02:10.660 LIB libspdk_dma.a 00:02:10.660 SO libspdk_dma.so.3.0 00:02:10.660 SYMLINK libspdk_dma.so 00:02:10.660 LIB libspdk_ioat.a 00:02:10.660 SO libspdk_ioat.so.6.0 00:02:10.660 LIB libspdk_vfio_user.a 00:02:10.660 SO libspdk_vfio_user.so.4.0 00:02:10.660 SYMLINK libspdk_ioat.so 00:02:10.660 SYMLINK libspdk_vfio_user.so 00:02:10.919 LIB libspdk_util.a 00:02:10.919 SO libspdk_util.so.8.0 00:02:11.180 SYMLINK libspdk_util.so 00:02:11.180 CC lib/conf/conf.o 00:02:11.180 CC lib/rdma/common.o 00:02:11.180 CC lib/rdma/rdma_verbs.o 00:02:11.180 CC lib/idxd/idxd.o 00:02:11.180 CC lib/vmd/vmd.o 00:02:11.180 CC lib/json/json_parse.o 00:02:11.180 CC lib/idxd/idxd_user.o 00:02:11.180 CC lib/env_dpdk/env.o 00:02:11.180 CC lib/json/json_util.o 00:02:11.180 CC lib/idxd/idxd_kernel.o 00:02:11.180 CC lib/vmd/led.o 00:02:11.180 CC lib/env_dpdk/memory.o 00:02:11.180 CC lib/json/json_write.o 00:02:11.180 CC lib/env_dpdk/pci.o 00:02:11.180 CC lib/env_dpdk/init.o 00:02:11.180 CC lib/env_dpdk/threads.o 00:02:11.180 CC lib/env_dpdk/pci_ioat.o 00:02:11.180 CC lib/env_dpdk/pci_virtio.o 00:02:11.180 CC lib/env_dpdk/pci_vmd.o 00:02:11.180 CC lib/env_dpdk/pci_idxd.o 00:02:11.180 CC lib/env_dpdk/pci_event.o 00:02:11.180 CC lib/env_dpdk/pci_dpdk.o 00:02:11.180 CC lib/env_dpdk/sigbus_handler.o 00:02:11.180 CC lib/env_dpdk/pci_dpdk_2207.o 00:02:11.180 CC lib/env_dpdk/pci_dpdk_2211.o 00:02:11.440 LIB libspdk_conf.a 00:02:11.440 SO libspdk_conf.so.5.0 00:02:11.440 SYMLINK libspdk_conf.so 00:02:11.440 LIB libspdk_rdma.a 00:02:11.440 SO libspdk_rdma.so.5.0 00:02:11.699 LIB libspdk_json.a 00:02:11.699 SO libspdk_json.so.5.1 00:02:11.699 SYMLINK libspdk_rdma.so 00:02:11.699 SYMLINK libspdk_json.so 00:02:11.699 CC lib/jsonrpc/jsonrpc_server.o 00:02:11.699 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:02:11.699 CC lib/jsonrpc/jsonrpc_client.o 00:02:11.699 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:02:11.699 LIB libspdk_idxd.a 00:02:11.699 SO libspdk_idxd.so.11.0 00:02:11.958 SYMLINK libspdk_idxd.so 00:02:11.958 LIB libspdk_vmd.a 00:02:11.958 SO libspdk_vmd.so.5.0 00:02:11.958 SYMLINK libspdk_vmd.so 00:02:11.958 LIB libspdk_jsonrpc.a 00:02:11.958 SO libspdk_jsonrpc.so.5.1 00:02:12.217 SYMLINK libspdk_jsonrpc.so 00:02:12.217 CC lib/rpc/rpc.o 00:02:12.217 LIB libspdk_trace_parser.a 00:02:12.217 SO libspdk_trace_parser.so.4.0 00:02:12.476 SYMLINK libspdk_trace_parser.so 00:02:12.476 LIB libspdk_rpc.a 00:02:12.476 SO libspdk_rpc.so.5.0 00:02:12.476 SYMLINK libspdk_rpc.so 00:02:12.476 CC lib/trace/trace.o 00:02:12.476 CC lib/trace/trace_flags.o 00:02:12.476 CC lib/trace/trace_rpc.o 00:02:12.476 CC lib/notify/notify.o 00:02:12.476 CC lib/sock/sock.o 00:02:12.476 CC lib/notify/notify_rpc.o 00:02:12.476 CC lib/sock/sock_rpc.o 00:02:12.738 LIB libspdk_notify.a 00:02:12.738 SO libspdk_notify.so.5.0 00:02:12.738 LIB libspdk_trace.a 00:02:12.738 SYMLINK libspdk_notify.so 00:02:12.738 SO libspdk_trace.so.9.0 00:02:12.997 SYMLINK libspdk_trace.so 00:02:12.997 LIB libspdk_sock.a 00:02:12.997 SO libspdk_sock.so.8.0 00:02:12.997 CC lib/thread/thread.o 00:02:12.997 CC lib/thread/iobuf.o 00:02:12.997 SYMLINK libspdk_sock.so 00:02:12.997 CC lib/nvme/nvme_ctrlr_cmd.o 00:02:12.997 CC lib/nvme/nvme_ctrlr.o 00:02:12.997 CC lib/nvme/nvme_fabric.o 00:02:12.997 CC lib/nvme/nvme_ns_cmd.o 00:02:12.997 CC lib/nvme/nvme_ns.o 00:02:12.997 CC lib/nvme/nvme_pcie_common.o 00:02:12.997 CC lib/nvme/nvme_pcie.o 00:02:12.997 CC lib/nvme/nvme_qpair.o 00:02:12.997 CC lib/nvme/nvme.o 00:02:12.997 CC lib/nvme/nvme_quirks.o 00:02:12.997 CC lib/nvme/nvme_transport.o 00:02:12.997 CC lib/nvme/nvme_discovery.o 00:02:12.997 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:02:13.256 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:02:13.256 CC lib/nvme/nvme_tcp.o 00:02:13.256 CC lib/nvme/nvme_opal.o 00:02:13.256 CC lib/nvme/nvme_io_msg.o 00:02:13.256 CC lib/nvme/nvme_poll_group.o 00:02:13.256 CC lib/nvme/nvme_zns.o 00:02:13.256 CC lib/nvme/nvme_cuse.o 00:02:13.256 CC lib/nvme/nvme_vfio_user.o 00:02:13.256 CC lib/nvme/nvme_rdma.o 00:02:13.256 LIB libspdk_env_dpdk.a 00:02:13.256 SO libspdk_env_dpdk.so.13.0 00:02:13.532 SYMLINK libspdk_env_dpdk.so 00:02:14.468 LIB libspdk_thread.a 00:02:14.727 SO libspdk_thread.so.9.0 00:02:14.727 SYMLINK libspdk_thread.so 00:02:14.727 CC lib/init/json_config.o 00:02:14.727 CC lib/init/subsystem.o 00:02:14.727 CC lib/blob/blobstore.o 00:02:14.727 CC lib/init/subsystem_rpc.o 00:02:14.727 CC lib/virtio/virtio.o 00:02:14.727 CC lib/blob/request.o 00:02:14.727 CC lib/init/rpc.o 00:02:14.727 CC lib/blob/zeroes.o 00:02:14.727 CC lib/virtio/virtio_vhost_user.o 00:02:14.727 CC lib/virtio/virtio_vfio_user.o 00:02:14.727 CC lib/blob/blob_bs_dev.o 00:02:14.727 CC lib/virtio/virtio_pci.o 00:02:14.727 CC lib/accel/accel.o 00:02:14.727 CC lib/accel/accel_rpc.o 00:02:14.727 CC lib/accel/accel_sw.o 00:02:14.986 LIB libspdk_init.a 00:02:14.986 SO libspdk_init.so.4.0 00:02:14.986 SYMLINK libspdk_init.so 00:02:15.244 LIB libspdk_virtio.a 00:02:15.244 SO libspdk_virtio.so.6.0 00:02:15.244 CC lib/event/app.o 00:02:15.244 SYMLINK libspdk_virtio.so 00:02:15.244 CC lib/event/reactor.o 00:02:15.244 CC lib/event/log_rpc.o 00:02:15.244 CC lib/event/app_rpc.o 00:02:15.244 CC lib/event/scheduler_static.o 00:02:15.502 LIB libspdk_nvme.a 00:02:15.502 SO libspdk_nvme.so.12.0 00:02:15.502 LIB libspdk_event.a 00:02:15.761 SO libspdk_event.so.12.0 00:02:15.761 SYMLINK libspdk_event.so 00:02:15.761 SYMLINK libspdk_nvme.so 00:02:15.761 LIB libspdk_accel.a 00:02:15.761 SO libspdk_accel.so.14.0 00:02:16.019 SYMLINK libspdk_accel.so 00:02:16.019 CC lib/bdev/bdev.o 00:02:16.019 CC lib/bdev/bdev_zone.o 00:02:16.019 CC lib/bdev/bdev_rpc.o 00:02:16.019 CC lib/bdev/part.o 00:02:16.019 CC lib/bdev/scsi_nvme.o 00:02:17.921 LIB libspdk_blob.a 00:02:17.921 SO libspdk_blob.so.10.1 00:02:17.921 SYMLINK libspdk_blob.so 00:02:17.921 CC lib/blobfs/blobfs.o 00:02:17.921 CC lib/blobfs/tree.o 00:02:17.921 CC lib/lvol/lvol.o 00:02:18.489 LIB libspdk_bdev.a 00:02:18.489 LIB libspdk_blobfs.a 00:02:18.489 SO libspdk_bdev.so.14.0 00:02:18.489 SO libspdk_blobfs.so.9.0 00:02:18.755 SYMLINK libspdk_blobfs.so 00:02:18.755 LIB libspdk_lvol.a 00:02:18.755 SYMLINK libspdk_bdev.so 00:02:18.755 SO libspdk_lvol.so.9.1 00:02:18.755 SYMLINK libspdk_lvol.so 00:02:18.755 CC lib/nvmf/ctrlr.o 00:02:18.755 CC lib/nbd/nbd.o 00:02:18.755 CC lib/nvmf/ctrlr_discovery.o 00:02:18.755 CC lib/ftl/ftl_core.o 00:02:18.755 CC lib/nbd/nbd_rpc.o 00:02:18.755 CC lib/scsi/dev.o 00:02:18.755 CC lib/nvmf/ctrlr_bdev.o 00:02:18.755 CC lib/ftl/ftl_init.o 00:02:18.755 CC lib/scsi/lun.o 00:02:18.755 CC lib/nvmf/subsystem.o 00:02:18.755 CC lib/ublk/ublk.o 00:02:18.755 CC lib/ftl/ftl_layout.o 00:02:18.755 CC lib/ublk/ublk_rpc.o 00:02:18.755 CC lib/scsi/port.o 00:02:18.755 CC lib/ftl/ftl_debug.o 00:02:18.755 CC lib/scsi/scsi.o 00:02:18.755 CC lib/ftl/ftl_io.o 00:02:18.755 CC lib/nvmf/nvmf.o 00:02:18.755 CC lib/scsi/scsi_bdev.o 00:02:18.755 CC lib/ftl/ftl_sb.o 00:02:18.755 CC lib/scsi/scsi_pr.o 00:02:18.755 CC lib/nvmf/nvmf_rpc.o 00:02:18.755 CC lib/scsi/scsi_rpc.o 00:02:18.755 CC lib/scsi/task.o 00:02:18.755 CC lib/ftl/ftl_l2p_flat.o 00:02:18.755 CC lib/ftl/ftl_l2p.o 00:02:18.755 CC lib/nvmf/transport.o 00:02:18.755 CC lib/nvmf/tcp.o 00:02:18.755 CC lib/ftl/ftl_nv_cache.o 00:02:18.755 CC lib/ftl/ftl_band.o 00:02:18.755 CC lib/nvmf/rdma.o 00:02:18.755 CC lib/ftl/ftl_writer.o 00:02:18.755 CC lib/ftl/ftl_band_ops.o 00:02:18.755 CC lib/ftl/ftl_rq.o 00:02:18.755 CC lib/ftl/ftl_reloc.o 00:02:18.755 CC lib/ftl/ftl_l2p_cache.o 00:02:18.755 CC lib/ftl/ftl_p2l.o 00:02:18.755 CC lib/ftl/mngt/ftl_mngt.o 00:02:18.755 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:02:18.755 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:02:18.755 CC lib/ftl/mngt/ftl_mngt_startup.o 00:02:18.755 CC lib/ftl/mngt/ftl_mngt_md.o 00:02:18.755 CC lib/ftl/mngt/ftl_mngt_misc.o 00:02:18.755 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:02:18.755 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:02:18.755 CC lib/ftl/mngt/ftl_mngt_band.o 00:02:18.755 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:02:18.755 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:02:19.023 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:02:19.023 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:02:19.023 CC lib/ftl/utils/ftl_conf.o 00:02:19.023 CC lib/ftl/utils/ftl_md.o 00:02:19.023 CC lib/ftl/utils/ftl_mempool.o 00:02:19.023 CC lib/ftl/utils/ftl_bitmap.o 00:02:19.023 CC lib/ftl/utils/ftl_property.o 00:02:19.283 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:02:19.283 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:02:19.283 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:02:19.283 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:02:19.283 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:02:19.283 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:02:19.283 CC lib/ftl/upgrade/ftl_sb_v3.o 00:02:19.283 CC lib/ftl/upgrade/ftl_sb_v5.o 00:02:19.283 CC lib/ftl/nvc/ftl_nvc_dev.o 00:02:19.283 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:02:19.283 CC lib/ftl/base/ftl_base_dev.o 00:02:19.283 CC lib/ftl/base/ftl_base_bdev.o 00:02:19.283 CC lib/ftl/ftl_trace.o 00:02:19.542 LIB libspdk_nbd.a 00:02:19.542 SO libspdk_nbd.so.6.0 00:02:19.542 SYMLINK libspdk_nbd.so 00:02:19.542 LIB libspdk_scsi.a 00:02:19.801 SO libspdk_scsi.so.8.0 00:02:19.801 LIB libspdk_ublk.a 00:02:19.801 SYMLINK libspdk_scsi.so 00:02:19.801 SO libspdk_ublk.so.2.0 00:02:19.801 SYMLINK libspdk_ublk.so 00:02:19.801 CC lib/iscsi/conn.o 00:02:19.801 CC lib/iscsi/init_grp.o 00:02:19.801 CC lib/vhost/vhost.o 00:02:19.801 CC lib/iscsi/iscsi.o 00:02:19.801 CC lib/vhost/vhost_rpc.o 00:02:19.802 CC lib/iscsi/md5.o 00:02:19.802 CC lib/vhost/vhost_scsi.o 00:02:19.802 CC lib/iscsi/param.o 00:02:19.802 CC lib/vhost/vhost_blk.o 00:02:19.802 CC lib/iscsi/portal_grp.o 00:02:19.802 CC lib/vhost/rte_vhost_user.o 00:02:19.802 CC lib/iscsi/tgt_node.o 00:02:19.802 CC lib/iscsi/iscsi_subsystem.o 00:02:19.802 CC lib/iscsi/iscsi_rpc.o 00:02:19.802 CC lib/iscsi/task.o 00:02:20.061 LIB libspdk_ftl.a 00:02:20.320 SO libspdk_ftl.so.8.0 00:02:20.579 SYMLINK libspdk_ftl.so 00:02:21.147 LIB libspdk_vhost.a 00:02:21.147 SO libspdk_vhost.so.7.1 00:02:21.147 LIB libspdk_nvmf.a 00:02:21.147 SYMLINK libspdk_vhost.so 00:02:21.147 SO libspdk_nvmf.so.17.0 00:02:21.407 LIB libspdk_iscsi.a 00:02:21.407 SO libspdk_iscsi.so.7.0 00:02:21.407 SYMLINK libspdk_nvmf.so 00:02:21.407 SYMLINK libspdk_iscsi.so 00:02:21.666 CC module/env_dpdk/env_dpdk_rpc.o 00:02:21.666 CC module/blob/bdev/blob_bdev.o 00:02:21.666 CC module/scheduler/dynamic/scheduler_dynamic.o 00:02:21.666 CC module/scheduler/gscheduler/gscheduler.o 00:02:21.666 CC module/accel/ioat/accel_ioat.o 00:02:21.666 CC module/accel/error/accel_error.o 00:02:21.666 CC module/accel/ioat/accel_ioat_rpc.o 00:02:21.666 CC module/sock/posix/posix.o 00:02:21.666 CC module/accel/dsa/accel_dsa.o 00:02:21.666 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:02:21.666 CC module/accel/dsa/accel_dsa_rpc.o 00:02:21.666 CC module/accel/error/accel_error_rpc.o 00:02:21.666 CC module/accel/iaa/accel_iaa.o 00:02:21.666 CC module/accel/iaa/accel_iaa_rpc.o 00:02:21.924 LIB libspdk_env_dpdk_rpc.a 00:02:21.924 SO libspdk_env_dpdk_rpc.so.5.0 00:02:21.924 SYMLINK libspdk_env_dpdk_rpc.so 00:02:21.924 LIB libspdk_scheduler_gscheduler.a 00:02:21.924 LIB libspdk_scheduler_dpdk_governor.a 00:02:21.924 SO libspdk_scheduler_gscheduler.so.3.0 00:02:21.924 SO libspdk_scheduler_dpdk_governor.so.3.0 00:02:21.924 LIB libspdk_accel_error.a 00:02:21.924 LIB libspdk_accel_ioat.a 00:02:21.924 LIB libspdk_scheduler_dynamic.a 00:02:21.924 LIB libspdk_accel_iaa.a 00:02:21.924 SO libspdk_accel_error.so.1.0 00:02:21.924 SO libspdk_scheduler_dynamic.so.3.0 00:02:21.924 SO libspdk_accel_ioat.so.5.0 00:02:21.924 SYMLINK libspdk_scheduler_gscheduler.so 00:02:21.924 SYMLINK libspdk_scheduler_dpdk_governor.so 00:02:21.924 SO libspdk_accel_iaa.so.2.0 00:02:21.924 LIB libspdk_accel_dsa.a 00:02:21.924 SYMLINK libspdk_scheduler_dynamic.so 00:02:21.924 SYMLINK libspdk_accel_error.so 00:02:21.924 SYMLINK libspdk_accel_ioat.so 00:02:21.924 LIB libspdk_blob_bdev.a 00:02:21.924 SO libspdk_accel_dsa.so.4.0 00:02:22.185 SYMLINK libspdk_accel_iaa.so 00:02:22.185 SO libspdk_blob_bdev.so.10.1 00:02:22.185 SYMLINK libspdk_accel_dsa.so 00:02:22.185 SYMLINK libspdk_blob_bdev.so 00:02:22.185 CC module/bdev/malloc/bdev_malloc.o 00:02:22.185 CC module/bdev/malloc/bdev_malloc_rpc.o 00:02:22.185 CC module/blobfs/bdev/blobfs_bdev.o 00:02:22.185 CC module/bdev/null/bdev_null.o 00:02:22.185 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:02:22.185 CC module/bdev/null/bdev_null_rpc.o 00:02:22.185 CC module/bdev/ftl/bdev_ftl.o 00:02:22.185 CC module/bdev/iscsi/bdev_iscsi.o 00:02:22.185 CC module/bdev/ftl/bdev_ftl_rpc.o 00:02:22.185 CC module/bdev/gpt/gpt.o 00:02:22.185 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:02:22.185 CC module/bdev/gpt/vbdev_gpt.o 00:02:22.185 CC module/bdev/aio/bdev_aio.o 00:02:22.185 CC module/bdev/aio/bdev_aio_rpc.o 00:02:22.185 CC module/bdev/delay/vbdev_delay.o 00:02:22.185 CC module/bdev/lvol/vbdev_lvol.o 00:02:22.185 CC module/bdev/delay/vbdev_delay_rpc.o 00:02:22.185 CC module/bdev/split/vbdev_split.o 00:02:22.185 CC module/bdev/passthru/vbdev_passthru.o 00:02:22.185 CC module/bdev/split/vbdev_split_rpc.o 00:02:22.185 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:02:22.185 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:02:22.185 CC module/bdev/virtio/bdev_virtio_scsi.o 00:02:22.185 CC module/bdev/error/vbdev_error.o 00:02:22.185 CC module/bdev/nvme/bdev_nvme.o 00:02:22.185 CC module/bdev/virtio/bdev_virtio_blk.o 00:02:22.185 CC module/bdev/raid/bdev_raid.o 00:02:22.185 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:02:22.185 CC module/bdev/zone_block/vbdev_zone_block.o 00:02:22.185 CC module/bdev/error/vbdev_error_rpc.o 00:02:22.185 CC module/bdev/raid/bdev_raid_rpc.o 00:02:22.185 CC module/bdev/virtio/bdev_virtio_rpc.o 00:02:22.185 CC module/bdev/nvme/bdev_nvme_rpc.o 00:02:22.185 CC module/bdev/raid/bdev_raid_sb.o 00:02:22.185 CC module/bdev/nvme/nvme_rpc.o 00:02:22.185 CC module/bdev/raid/raid0.o 00:02:22.185 CC module/bdev/nvme/bdev_mdns_client.o 00:02:22.185 CC module/bdev/nvme/vbdev_opal.o 00:02:22.185 CC module/bdev/raid/raid1.o 00:02:22.185 CC module/bdev/nvme/vbdev_opal_rpc.o 00:02:22.185 CC module/bdev/raid/concat.o 00:02:22.185 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:02:22.755 LIB libspdk_sock_posix.a 00:02:22.755 LIB libspdk_bdev_split.a 00:02:22.755 SO libspdk_sock_posix.so.5.0 00:02:22.755 LIB libspdk_blobfs_bdev.a 00:02:22.755 SO libspdk_bdev_split.so.5.0 00:02:22.755 SO libspdk_blobfs_bdev.so.5.0 00:02:22.755 SYMLINK libspdk_bdev_split.so 00:02:22.755 SYMLINK libspdk_blobfs_bdev.so 00:02:22.755 SYMLINK libspdk_sock_posix.so 00:02:22.755 LIB libspdk_bdev_null.a 00:02:22.755 SO libspdk_bdev_null.so.5.0 00:02:22.755 LIB libspdk_bdev_passthru.a 00:02:22.755 LIB libspdk_bdev_gpt.a 00:02:22.755 LIB libspdk_bdev_error.a 00:02:22.755 LIB libspdk_bdev_ftl.a 00:02:22.755 SO libspdk_bdev_passthru.so.5.0 00:02:22.755 SYMLINK libspdk_bdev_null.so 00:02:22.755 SO libspdk_bdev_gpt.so.5.0 00:02:22.755 SO libspdk_bdev_error.so.5.0 00:02:22.755 LIB libspdk_bdev_iscsi.a 00:02:22.755 SO libspdk_bdev_ftl.so.5.0 00:02:22.755 LIB libspdk_bdev_aio.a 00:02:22.755 SO libspdk_bdev_iscsi.so.5.0 00:02:22.755 SYMLINK libspdk_bdev_passthru.so 00:02:22.755 LIB libspdk_bdev_zone_block.a 00:02:22.755 SYMLINK libspdk_bdev_gpt.so 00:02:22.755 LIB libspdk_bdev_delay.a 00:02:22.755 SYMLINK libspdk_bdev_error.so 00:02:22.755 SO libspdk_bdev_aio.so.5.0 00:02:22.755 LIB libspdk_bdev_malloc.a 00:02:22.755 SYMLINK libspdk_bdev_ftl.so 00:02:22.755 SO libspdk_bdev_zone_block.so.5.0 00:02:23.015 SO libspdk_bdev_delay.so.5.0 00:02:23.015 SO libspdk_bdev_malloc.so.5.0 00:02:23.015 SYMLINK libspdk_bdev_iscsi.so 00:02:23.015 LIB libspdk_bdev_virtio.a 00:02:23.015 SYMLINK libspdk_bdev_aio.so 00:02:23.015 SYMLINK libspdk_bdev_zone_block.so 00:02:23.015 SO libspdk_bdev_virtio.so.5.0 00:02:23.015 SYMLINK libspdk_bdev_delay.so 00:02:23.015 SYMLINK libspdk_bdev_malloc.so 00:02:23.015 SYMLINK libspdk_bdev_virtio.so 00:02:23.015 LIB libspdk_bdev_lvol.a 00:02:23.015 SO libspdk_bdev_lvol.so.5.0 00:02:23.015 SYMLINK libspdk_bdev_lvol.so 00:02:23.274 LIB libspdk_bdev_raid.a 00:02:23.533 SO libspdk_bdev_raid.so.5.0 00:02:23.533 SYMLINK libspdk_bdev_raid.so 00:02:24.468 LIB libspdk_bdev_nvme.a 00:02:24.727 SO libspdk_bdev_nvme.so.6.0 00:02:24.727 SYMLINK libspdk_bdev_nvme.so 00:02:24.985 CC module/event/subsystems/sock/sock.o 00:02:24.985 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:02:24.985 CC module/event/subsystems/iobuf/iobuf.o 00:02:24.985 CC module/event/subsystems/vmd/vmd.o 00:02:24.985 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:02:24.985 CC module/event/subsystems/vmd/vmd_rpc.o 00:02:24.985 CC module/event/subsystems/scheduler/scheduler.o 00:02:24.985 LIB libspdk_event_sock.a 00:02:24.985 LIB libspdk_event_vhost_blk.a 00:02:24.985 LIB libspdk_event_scheduler.a 00:02:24.985 LIB libspdk_event_vmd.a 00:02:24.985 SO libspdk_event_sock.so.4.0 00:02:24.985 LIB libspdk_event_iobuf.a 00:02:24.985 SO libspdk_event_vhost_blk.so.2.0 00:02:24.985 SO libspdk_event_scheduler.so.3.0 00:02:24.985 SO libspdk_event_vmd.so.5.0 00:02:25.244 SO libspdk_event_iobuf.so.2.0 00:02:25.244 SYMLINK libspdk_event_sock.so 00:02:25.244 SYMLINK libspdk_event_vhost_blk.so 00:02:25.244 SYMLINK libspdk_event_scheduler.so 00:02:25.244 SYMLINK libspdk_event_vmd.so 00:02:25.244 SYMLINK libspdk_event_iobuf.so 00:02:25.244 CC module/event/subsystems/accel/accel.o 00:02:25.503 LIB libspdk_event_accel.a 00:02:25.503 SO libspdk_event_accel.so.5.0 00:02:25.503 SYMLINK libspdk_event_accel.so 00:02:25.763 CC module/event/subsystems/bdev/bdev.o 00:02:25.763 LIB libspdk_event_bdev.a 00:02:25.763 SO libspdk_event_bdev.so.5.0 00:02:25.763 SYMLINK libspdk_event_bdev.so 00:02:26.022 CC module/event/subsystems/scsi/scsi.o 00:02:26.022 CC module/event/subsystems/nbd/nbd.o 00:02:26.022 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:02:26.022 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:02:26.022 CC module/event/subsystems/ublk/ublk.o 00:02:26.022 LIB libspdk_event_nbd.a 00:02:26.022 LIB libspdk_event_ublk.a 00:02:26.022 LIB libspdk_event_scsi.a 00:02:26.023 SO libspdk_event_nbd.so.5.0 00:02:26.023 SO libspdk_event_ublk.so.2.0 00:02:26.282 SO libspdk_event_scsi.so.5.0 00:02:26.282 SYMLINK libspdk_event_nbd.so 00:02:26.282 SYMLINK libspdk_event_ublk.so 00:02:26.282 SYMLINK libspdk_event_scsi.so 00:02:26.282 LIB libspdk_event_nvmf.a 00:02:26.282 SO libspdk_event_nvmf.so.5.0 00:02:26.282 SYMLINK libspdk_event_nvmf.so 00:02:26.282 CC module/event/subsystems/iscsi/iscsi.o 00:02:26.282 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:02:26.540 LIB libspdk_event_vhost_scsi.a 00:02:26.540 LIB libspdk_event_iscsi.a 00:02:26.540 SO libspdk_event_vhost_scsi.so.2.0 00:02:26.540 SO libspdk_event_iscsi.so.5.0 00:02:26.540 SYMLINK libspdk_event_vhost_scsi.so 00:02:26.540 SYMLINK libspdk_event_iscsi.so 00:02:26.540 SO libspdk.so.5.0 00:02:26.540 SYMLINK libspdk.so 00:02:26.805 CC app/spdk_nvme_discover/discovery_aer.o 00:02:26.805 CC app/spdk_nvme_perf/perf.o 00:02:26.805 CC app/spdk_nvme_identify/identify.o 00:02:26.805 CC app/trace_record/trace_record.o 00:02:26.805 CC app/spdk_top/spdk_top.o 00:02:26.805 TEST_HEADER include/spdk/accel.h 00:02:26.805 CC test/rpc_client/rpc_client_test.o 00:02:26.805 CC app/spdk_lspci/spdk_lspci.o 00:02:26.805 CXX app/trace/trace.o 00:02:26.805 TEST_HEADER include/spdk/accel_module.h 00:02:26.805 TEST_HEADER include/spdk/assert.h 00:02:26.805 TEST_HEADER include/spdk/barrier.h 00:02:26.805 TEST_HEADER include/spdk/base64.h 00:02:26.805 TEST_HEADER include/spdk/bdev.h 00:02:26.805 TEST_HEADER include/spdk/bdev_module.h 00:02:26.805 TEST_HEADER include/spdk/bdev_zone.h 00:02:26.805 TEST_HEADER include/spdk/bit_array.h 00:02:26.805 TEST_HEADER include/spdk/bit_pool.h 00:02:26.805 TEST_HEADER include/spdk/blob_bdev.h 00:02:26.805 TEST_HEADER include/spdk/blobfs_bdev.h 00:02:26.805 TEST_HEADER include/spdk/blobfs.h 00:02:26.805 TEST_HEADER include/spdk/blob.h 00:02:26.805 TEST_HEADER include/spdk/conf.h 00:02:26.805 TEST_HEADER include/spdk/config.h 00:02:26.805 TEST_HEADER include/spdk/cpuset.h 00:02:26.805 TEST_HEADER include/spdk/crc16.h 00:02:26.805 TEST_HEADER include/spdk/crc32.h 00:02:26.805 CC app/spdk_dd/spdk_dd.o 00:02:26.805 CC examples/interrupt_tgt/interrupt_tgt.o 00:02:26.805 TEST_HEADER include/spdk/crc64.h 00:02:26.805 TEST_HEADER include/spdk/dif.h 00:02:26.805 TEST_HEADER include/spdk/dma.h 00:02:26.805 TEST_HEADER include/spdk/endian.h 00:02:26.805 CC app/nvmf_tgt/nvmf_main.o 00:02:26.805 CC app/iscsi_tgt/iscsi_tgt.o 00:02:26.805 TEST_HEADER include/spdk/env_dpdk.h 00:02:26.805 TEST_HEADER include/spdk/env.h 00:02:26.805 TEST_HEADER include/spdk/event.h 00:02:26.805 CC examples/nvme/cmb_copy/cmb_copy.o 00:02:26.805 CC examples/nvme/arbitration/arbitration.o 00:02:26.805 CC examples/nvme/hello_world/hello_world.o 00:02:26.805 TEST_HEADER include/spdk/fd_group.h 00:02:26.805 TEST_HEADER include/spdk/fd.h 00:02:26.805 CC examples/idxd/perf/perf.o 00:02:26.805 CC examples/vmd/led/led.o 00:02:26.805 CC examples/ioat/perf/perf.o 00:02:26.805 CC examples/nvme/nvme_manage/nvme_manage.o 00:02:26.805 CC examples/nvme/reconnect/reconnect.o 00:02:26.805 CC app/vhost/vhost.o 00:02:26.805 TEST_HEADER include/spdk/file.h 00:02:26.805 CC examples/vmd/lsvmd/lsvmd.o 00:02:26.805 CC test/app/jsoncat/jsoncat.o 00:02:26.805 CC examples/util/zipf/zipf.o 00:02:26.805 CC test/app/histogram_perf/histogram_perf.o 00:02:26.805 CC test/thread/poller_perf/poller_perf.o 00:02:26.805 CC examples/nvme/hotplug/hotplug.o 00:02:26.805 CC test/event/event_perf/event_perf.o 00:02:26.805 TEST_HEADER include/spdk/ftl.h 00:02:26.805 CC app/fio/nvme/fio_plugin.o 00:02:26.805 TEST_HEADER include/spdk/gpt_spec.h 00:02:26.805 TEST_HEADER include/spdk/hexlify.h 00:02:26.805 TEST_HEADER include/spdk/histogram_data.h 00:02:26.805 CC test/nvme/aer/aer.o 00:02:26.805 CC examples/nvme/abort/abort.o 00:02:26.805 CC examples/accel/perf/accel_perf.o 00:02:26.805 TEST_HEADER include/spdk/idxd.h 00:02:26.805 CC examples/sock/hello_world/hello_sock.o 00:02:26.805 TEST_HEADER include/spdk/idxd_spec.h 00:02:26.805 TEST_HEADER include/spdk/init.h 00:02:26.805 CC app/spdk_tgt/spdk_tgt.o 00:02:26.805 TEST_HEADER include/spdk/ioat.h 00:02:26.805 TEST_HEADER include/spdk/ioat_spec.h 00:02:26.805 TEST_HEADER include/spdk/iscsi_spec.h 00:02:26.805 TEST_HEADER include/spdk/json.h 00:02:26.805 TEST_HEADER include/spdk/jsonrpc.h 00:02:26.805 TEST_HEADER include/spdk/likely.h 00:02:26.805 CC examples/bdev/hello_world/hello_bdev.o 00:02:26.805 TEST_HEADER include/spdk/log.h 00:02:26.805 CC test/bdev/bdevio/bdevio.o 00:02:26.805 TEST_HEADER include/spdk/lvol.h 00:02:26.805 CC test/accel/dif/dif.o 00:02:26.805 CC examples/bdev/bdevperf/bdevperf.o 00:02:26.805 TEST_HEADER include/spdk/memory.h 00:02:27.073 TEST_HEADER include/spdk/mmio.h 00:02:27.073 TEST_HEADER include/spdk/nbd.h 00:02:27.073 CC examples/blob/hello_world/hello_blob.o 00:02:27.073 TEST_HEADER include/spdk/notify.h 00:02:27.073 CC examples/thread/thread/thread_ex.o 00:02:27.073 CC test/blobfs/mkfs/mkfs.o 00:02:27.073 TEST_HEADER include/spdk/nvme.h 00:02:27.073 TEST_HEADER include/spdk/nvme_intel.h 00:02:27.073 CC test/dma/test_dma/test_dma.o 00:02:27.073 CC test/app/bdev_svc/bdev_svc.o 00:02:27.073 TEST_HEADER include/spdk/nvme_ocssd.h 00:02:27.073 CC examples/nvmf/nvmf/nvmf.o 00:02:27.073 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:02:27.073 TEST_HEADER include/spdk/nvme_spec.h 00:02:27.073 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:02:27.073 TEST_HEADER include/spdk/nvme_zns.h 00:02:27.073 TEST_HEADER include/spdk/nvmf_cmd.h 00:02:27.073 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:02:27.073 TEST_HEADER include/spdk/nvmf.h 00:02:27.073 TEST_HEADER include/spdk/nvmf_spec.h 00:02:27.073 CC test/env/mem_callbacks/mem_callbacks.o 00:02:27.073 TEST_HEADER include/spdk/nvmf_transport.h 00:02:27.073 TEST_HEADER include/spdk/opal.h 00:02:27.073 CC test/lvol/esnap/esnap.o 00:02:27.073 TEST_HEADER include/spdk/opal_spec.h 00:02:27.073 TEST_HEADER include/spdk/pci_ids.h 00:02:27.073 TEST_HEADER include/spdk/pipe.h 00:02:27.073 TEST_HEADER include/spdk/queue.h 00:02:27.073 TEST_HEADER include/spdk/reduce.h 00:02:27.073 TEST_HEADER include/spdk/rpc.h 00:02:27.073 TEST_HEADER include/spdk/scheduler.h 00:02:27.073 TEST_HEADER include/spdk/scsi.h 00:02:27.073 TEST_HEADER include/spdk/scsi_spec.h 00:02:27.073 TEST_HEADER include/spdk/sock.h 00:02:27.073 TEST_HEADER include/spdk/stdinc.h 00:02:27.073 TEST_HEADER include/spdk/string.h 00:02:27.073 TEST_HEADER include/spdk/thread.h 00:02:27.073 TEST_HEADER include/spdk/trace.h 00:02:27.073 LINK spdk_lspci 00:02:27.073 TEST_HEADER include/spdk/trace_parser.h 00:02:27.073 TEST_HEADER include/spdk/tree.h 00:02:27.073 TEST_HEADER include/spdk/ublk.h 00:02:27.073 TEST_HEADER include/spdk/util.h 00:02:27.073 TEST_HEADER include/spdk/uuid.h 00:02:27.073 TEST_HEADER include/spdk/version.h 00:02:27.073 TEST_HEADER include/spdk/vfio_user_pci.h 00:02:27.073 TEST_HEADER include/spdk/vfio_user_spec.h 00:02:27.073 TEST_HEADER include/spdk/vhost.h 00:02:27.073 TEST_HEADER include/spdk/vmd.h 00:02:27.073 TEST_HEADER include/spdk/xor.h 00:02:27.073 TEST_HEADER include/spdk/zipf.h 00:02:27.073 CXX test/cpp_headers/accel.o 00:02:27.073 LINK lsvmd 00:02:27.073 LINK rpc_client_test 00:02:27.073 LINK jsoncat 00:02:27.073 LINK spdk_nvme_discover 00:02:27.073 LINK histogram_perf 00:02:27.073 LINK poller_perf 00:02:27.073 LINK event_perf 00:02:27.073 LINK led 00:02:27.073 LINK zipf 00:02:27.073 LINK interrupt_tgt 00:02:27.335 LINK nvmf_tgt 00:02:27.335 LINK cmb_copy 00:02:27.335 LINK vhost 00:02:27.335 LINK iscsi_tgt 00:02:27.335 LINK spdk_trace_record 00:02:27.335 LINK ioat_perf 00:02:27.335 LINK spdk_tgt 00:02:27.335 LINK bdev_svc 00:02:27.335 LINK hello_world 00:02:27.335 LINK mkfs 00:02:27.335 LINK hotplug 00:02:27.335 LINK hello_sock 00:02:27.335 LINK hello_blob 00:02:27.335 LINK hello_bdev 00:02:27.335 LINK aer 00:02:27.335 LINK thread 00:02:27.335 CXX test/cpp_headers/accel_module.o 00:02:27.600 CXX test/cpp_headers/assert.o 00:02:27.600 CC test/event/reactor/reactor.o 00:02:27.600 LINK arbitration 00:02:27.600 LINK reconnect 00:02:27.600 LINK nvmf 00:02:27.600 LINK idxd_perf 00:02:27.600 LINK spdk_dd 00:02:27.600 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:02:27.600 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:02:27.600 CXX test/cpp_headers/barrier.o 00:02:27.600 CC test/app/stub/stub.o 00:02:27.600 CC test/event/reactor_perf/reactor_perf.o 00:02:27.600 LINK abort 00:02:27.600 CC test/event/app_repeat/app_repeat.o 00:02:27.600 CC test/event/scheduler/scheduler.o 00:02:27.600 CC app/fio/bdev/fio_plugin.o 00:02:27.600 CC test/nvme/reset/reset.o 00:02:27.600 CXX test/cpp_headers/base64.o 00:02:27.600 LINK dif 00:02:27.600 LINK test_dma 00:02:27.600 LINK bdevio 00:02:27.600 CC examples/blob/cli/blobcli.o 00:02:27.600 CC examples/ioat/verify/verify.o 00:02:27.600 LINK spdk_trace 00:02:27.600 CC test/env/vtophys/vtophys.o 00:02:27.600 CXX test/cpp_headers/bdev.o 00:02:27.600 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:02:27.600 CXX test/cpp_headers/bdev_module.o 00:02:27.600 CXX test/cpp_headers/bdev_zone.o 00:02:27.868 CC test/nvme/sgl/sgl.o 00:02:27.868 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:02:27.868 LINK reactor 00:02:27.868 CXX test/cpp_headers/bit_array.o 00:02:27.868 LINK accel_perf 00:02:27.868 CC test/env/pci/pci_ut.o 00:02:27.868 LINK nvme_fuzz 00:02:27.868 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:02:27.868 CC test/env/memory/memory_ut.o 00:02:27.868 LINK nvme_manage 00:02:27.868 CC test/nvme/e2edp/nvme_dp.o 00:02:27.868 LINK reactor_perf 00:02:27.868 CC test/nvme/overhead/overhead.o 00:02:27.868 CC test/nvme/err_injection/err_injection.o 00:02:27.868 LINK pmr_persistence 00:02:27.868 LINK stub 00:02:27.868 LINK app_repeat 00:02:27.868 CC test/nvme/reserve/reserve.o 00:02:27.868 CC test/nvme/startup/startup.o 00:02:27.868 CXX test/cpp_headers/bit_pool.o 00:02:27.868 CC test/nvme/simple_copy/simple_copy.o 00:02:27.868 CC test/nvme/connect_stress/connect_stress.o 00:02:27.868 LINK vtophys 00:02:28.130 CC test/nvme/boot_partition/boot_partition.o 00:02:28.130 CC test/nvme/compliance/nvme_compliance.o 00:02:28.130 CC test/nvme/fused_ordering/fused_ordering.o 00:02:28.130 CXX test/cpp_headers/blob_bdev.o 00:02:28.130 CXX test/cpp_headers/blobfs_bdev.o 00:02:28.130 CXX test/cpp_headers/blobfs.o 00:02:28.130 CXX test/cpp_headers/blob.o 00:02:28.130 CXX test/cpp_headers/conf.o 00:02:28.130 LINK env_dpdk_post_init 00:02:28.130 CC test/nvme/doorbell_aers/doorbell_aers.o 00:02:28.130 CC test/nvme/fdp/fdp.o 00:02:28.130 LINK scheduler 00:02:28.130 CXX test/cpp_headers/config.o 00:02:28.130 LINK verify 00:02:28.130 CXX test/cpp_headers/cpuset.o 00:02:28.130 CXX test/cpp_headers/crc16.o 00:02:28.130 CC test/nvme/cuse/cuse.o 00:02:28.130 CXX test/cpp_headers/crc32.o 00:02:28.130 CXX test/cpp_headers/crc64.o 00:02:28.130 LINK spdk_nvme 00:02:28.130 CXX test/cpp_headers/dif.o 00:02:28.130 LINK mem_callbacks 00:02:28.130 CXX test/cpp_headers/dma.o 00:02:28.130 CXX test/cpp_headers/endian.o 00:02:28.130 LINK reset 00:02:28.130 CXX test/cpp_headers/env_dpdk.o 00:02:28.130 CXX test/cpp_headers/env.o 00:02:28.130 CXX test/cpp_headers/event.o 00:02:28.130 LINK startup 00:02:28.394 LINK err_injection 00:02:28.394 LINK sgl 00:02:28.394 CXX test/cpp_headers/fd_group.o 00:02:28.394 CXX test/cpp_headers/fd.o 00:02:28.394 CXX test/cpp_headers/file.o 00:02:28.394 LINK connect_stress 00:02:28.394 LINK spdk_nvme_perf 00:02:28.394 LINK boot_partition 00:02:28.394 LINK reserve 00:02:28.394 LINK nvme_dp 00:02:28.394 CXX test/cpp_headers/ftl.o 00:02:28.394 LINK bdevperf 00:02:28.394 CXX test/cpp_headers/gpt_spec.o 00:02:28.394 CXX test/cpp_headers/hexlify.o 00:02:28.394 CXX test/cpp_headers/histogram_data.o 00:02:28.394 LINK simple_copy 00:02:28.394 CXX test/cpp_headers/idxd.o 00:02:28.394 LINK spdk_nvme_identify 00:02:28.394 LINK fused_ordering 00:02:28.394 CXX test/cpp_headers/idxd_spec.o 00:02:28.394 CXX test/cpp_headers/init.o 00:02:28.394 CXX test/cpp_headers/ioat.o 00:02:28.394 CXX test/cpp_headers/ioat_spec.o 00:02:28.394 LINK overhead 00:02:28.394 LINK spdk_top 00:02:28.394 LINK doorbell_aers 00:02:28.394 CXX test/cpp_headers/iscsi_spec.o 00:02:28.394 CXX test/cpp_headers/jsonrpc.o 00:02:28.394 CXX test/cpp_headers/json.o 00:02:28.394 CXX test/cpp_headers/likely.o 00:02:28.394 CXX test/cpp_headers/log.o 00:02:28.394 LINK pci_ut 00:02:28.394 CXX test/cpp_headers/lvol.o 00:02:28.394 CXX test/cpp_headers/memory.o 00:02:28.656 CXX test/cpp_headers/mmio.o 00:02:28.656 CXX test/cpp_headers/nbd.o 00:02:28.656 LINK vhost_fuzz 00:02:28.656 CXX test/cpp_headers/notify.o 00:02:28.656 LINK spdk_bdev 00:02:28.656 CXX test/cpp_headers/nvme.o 00:02:28.656 LINK blobcli 00:02:28.656 CXX test/cpp_headers/nvme_intel.o 00:02:28.656 CXX test/cpp_headers/nvme_ocssd.o 00:02:28.656 CXX test/cpp_headers/nvme_ocssd_spec.o 00:02:28.656 CXX test/cpp_headers/nvme_spec.o 00:02:28.656 CXX test/cpp_headers/nvme_zns.o 00:02:28.656 CXX test/cpp_headers/nvmf_cmd.o 00:02:28.656 CXX test/cpp_headers/nvmf_fc_spec.o 00:02:28.656 CXX test/cpp_headers/nvmf.o 00:02:28.656 LINK nvme_compliance 00:02:28.656 CXX test/cpp_headers/nvmf_spec.o 00:02:28.656 CXX test/cpp_headers/nvmf_transport.o 00:02:28.657 CXX test/cpp_headers/opal.o 00:02:28.657 CXX test/cpp_headers/opal_spec.o 00:02:28.657 LINK fdp 00:02:28.657 CXX test/cpp_headers/pci_ids.o 00:02:28.657 CXX test/cpp_headers/pipe.o 00:02:28.657 CXX test/cpp_headers/queue.o 00:02:28.657 CXX test/cpp_headers/reduce.o 00:02:28.657 CXX test/cpp_headers/rpc.o 00:02:28.657 CXX test/cpp_headers/scheduler.o 00:02:28.657 CXX test/cpp_headers/scsi.o 00:02:28.657 CXX test/cpp_headers/scsi_spec.o 00:02:28.657 CXX test/cpp_headers/sock.o 00:02:28.657 CXX test/cpp_headers/stdinc.o 00:02:28.919 CXX test/cpp_headers/string.o 00:02:28.919 CXX test/cpp_headers/thread.o 00:02:28.919 CXX test/cpp_headers/trace.o 00:02:28.919 CXX test/cpp_headers/trace_parser.o 00:02:28.919 CXX test/cpp_headers/tree.o 00:02:28.919 CXX test/cpp_headers/ublk.o 00:02:28.919 CXX test/cpp_headers/util.o 00:02:28.919 CXX test/cpp_headers/uuid.o 00:02:28.919 CXX test/cpp_headers/version.o 00:02:28.919 CXX test/cpp_headers/vfio_user_pci.o 00:02:28.919 CXX test/cpp_headers/vfio_user_spec.o 00:02:28.919 CXX test/cpp_headers/vhost.o 00:02:28.919 CXX test/cpp_headers/vmd.o 00:02:28.919 CXX test/cpp_headers/xor.o 00:02:28.919 CXX test/cpp_headers/zipf.o 00:02:29.488 LINK memory_ut 00:02:29.747 LINK cuse 00:02:30.007 LINK iscsi_fuzz 00:02:32.542 LINK esnap 00:02:32.801 00:02:32.801 real 0m46.858s 00:02:32.801 user 9m38.303s 00:02:32.801 sys 2m10.822s 00:02:32.801 18:50:53 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:02:32.801 18:50:53 -- common/autotest_common.sh@10 -- $ set +x 00:02:32.801 ************************************ 00:02:32.801 END TEST make 00:02:32.801 ************************************ 00:02:32.801 18:50:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:32.801 18:50:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:32.801 18:50:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:32.801 18:50:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:32.801 18:50:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:32.801 18:50:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:32.801 18:50:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:32.801 18:50:53 -- scripts/common.sh@335 -- # IFS=.-: 00:02:32.801 18:50:53 -- scripts/common.sh@335 -- # read -ra ver1 00:02:32.801 18:50:53 -- scripts/common.sh@336 -- # IFS=.-: 00:02:32.802 18:50:53 -- scripts/common.sh@336 -- # read -ra ver2 00:02:32.802 18:50:53 -- scripts/common.sh@337 -- # local 'op=<' 00:02:32.802 18:50:53 -- scripts/common.sh@339 -- # ver1_l=2 00:02:32.802 18:50:53 -- scripts/common.sh@340 -- # ver2_l=1 00:02:32.802 18:50:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:32.802 18:50:53 -- scripts/common.sh@343 -- # case "$op" in 00:02:32.802 18:50:53 -- scripts/common.sh@344 -- # : 1 00:02:32.802 18:50:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:32.802 18:50:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:32.802 18:50:53 -- scripts/common.sh@364 -- # decimal 1 00:02:32.802 18:50:53 -- scripts/common.sh@352 -- # local d=1 00:02:32.802 18:50:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:32.802 18:50:53 -- scripts/common.sh@354 -- # echo 1 00:02:32.802 18:50:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:32.802 18:50:53 -- scripts/common.sh@365 -- # decimal 2 00:02:32.802 18:50:53 -- scripts/common.sh@352 -- # local d=2 00:02:32.802 18:50:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:32.802 18:50:53 -- scripts/common.sh@354 -- # echo 2 00:02:32.802 18:50:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:32.802 18:50:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:32.802 18:50:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:32.802 18:50:53 -- scripts/common.sh@367 -- # return 0 00:02:32.802 18:50:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:32.802 18:50:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:32.802 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:32.802 --rc genhtml_branch_coverage=1 00:02:32.802 --rc genhtml_function_coverage=1 00:02:32.802 --rc genhtml_legend=1 00:02:32.802 --rc geninfo_all_blocks=1 00:02:32.802 --rc geninfo_unexecuted_blocks=1 00:02:32.802 00:02:32.802 ' 00:02:32.802 18:50:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:32.802 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:32.802 --rc genhtml_branch_coverage=1 00:02:32.802 --rc genhtml_function_coverage=1 00:02:32.802 --rc genhtml_legend=1 00:02:32.802 --rc geninfo_all_blocks=1 00:02:32.802 --rc geninfo_unexecuted_blocks=1 00:02:32.802 00:02:32.802 ' 00:02:32.802 18:50:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:32.802 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:32.802 --rc genhtml_branch_coverage=1 00:02:32.802 --rc genhtml_function_coverage=1 00:02:32.802 --rc genhtml_legend=1 00:02:32.802 --rc geninfo_all_blocks=1 00:02:32.802 --rc geninfo_unexecuted_blocks=1 00:02:32.802 00:02:32.802 ' 00:02:32.802 18:50:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:32.802 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:32.802 --rc genhtml_branch_coverage=1 00:02:32.802 --rc genhtml_function_coverage=1 00:02:32.802 --rc genhtml_legend=1 00:02:32.802 --rc geninfo_all_blocks=1 00:02:32.802 --rc geninfo_unexecuted_blocks=1 00:02:32.802 00:02:32.802 ' 00:02:32.802 18:50:53 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:02:33.062 18:50:53 -- nvmf/common.sh@7 -- # uname -s 00:02:33.062 18:50:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:02:33.062 18:50:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:02:33.062 18:50:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:02:33.062 18:50:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:02:33.062 18:50:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:02:33.062 18:50:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:02:33.062 18:50:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:02:33.062 18:50:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:02:33.062 18:50:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:02:33.062 18:50:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:02:33.062 18:50:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:02:33.062 18:50:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:02:33.062 18:50:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:02:33.062 18:50:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:02:33.062 18:50:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:02:33.062 18:50:53 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:02:33.062 18:50:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:02:33.062 18:50:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:02:33.062 18:50:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:02:33.062 18:50:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:33.062 18:50:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:33.062 18:50:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:33.062 18:50:53 -- paths/export.sh@5 -- # export PATH 00:02:33.062 18:50:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:33.062 18:50:53 -- nvmf/common.sh@46 -- # : 0 00:02:33.062 18:50:53 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:02:33.062 18:50:53 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:02:33.062 18:50:53 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:02:33.062 18:50:53 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:02:33.062 18:50:53 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:02:33.062 18:50:53 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:02:33.062 18:50:53 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:02:33.062 18:50:53 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:02:33.062 18:50:53 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:02:33.062 18:50:53 -- spdk/autotest.sh@32 -- # uname -s 00:02:33.062 18:50:53 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:02:33.062 18:50:53 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:02:33.062 18:50:53 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:33.062 18:50:53 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:02:33.062 18:50:53 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:33.062 18:50:53 -- spdk/autotest.sh@44 -- # modprobe nbd 00:02:33.062 18:50:53 -- spdk/autotest.sh@46 -- # type -P udevadm 00:02:33.062 18:50:53 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:02:33.062 18:50:53 -- spdk/autotest.sh@48 -- # udevadm_pid=49675 00:02:33.062 18:50:53 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:02:33.062 18:50:53 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:33.062 18:50:53 -- spdk/autotest.sh@54 -- # echo 49677 00:02:33.062 18:50:53 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:33.062 18:50:53 -- spdk/autotest.sh@56 -- # echo 49678 00:02:33.062 18:50:53 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:33.062 18:50:53 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:02:33.062 18:50:53 -- spdk/autotest.sh@60 -- # echo 49679 00:02:33.062 18:50:53 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:33.062 18:50:53 -- spdk/autotest.sh@62 -- # echo 49680 00:02:33.062 18:50:53 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:33.062 18:50:53 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:02:33.062 18:50:53 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:02:33.062 18:50:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:02:33.062 18:50:53 -- common/autotest_common.sh@10 -- # set +x 00:02:33.062 18:50:53 -- spdk/autotest.sh@70 -- # create_test_list 00:02:33.062 18:50:53 -- common/autotest_common.sh@746 -- # xtrace_disable 00:02:33.062 18:50:53 -- common/autotest_common.sh@10 -- # set +x 00:02:33.062 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:02:33.062 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:02:33.062 18:50:53 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:02:33.062 18:50:53 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:33.062 18:50:53 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:33.062 18:50:53 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:02:33.062 18:50:53 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:33.062 18:50:53 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:02:33.062 18:50:53 -- common/autotest_common.sh@1450 -- # uname 00:02:33.062 18:50:53 -- common/autotest_common.sh@1450 -- # '[' Linux = FreeBSD ']' 00:02:33.062 18:50:53 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:02:33.062 18:50:53 -- common/autotest_common.sh@1470 -- # uname 00:02:33.062 18:50:53 -- common/autotest_common.sh@1470 -- # [[ Linux = FreeBSD ]] 00:02:33.062 18:50:53 -- spdk/autotest.sh@79 -- # [[ y == y ]] 00:02:33.062 18:50:53 -- spdk/autotest.sh@81 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:02:33.062 lcov: LCOV version 1.15 00:02:33.062 18:50:54 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:02:37.251 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:02:37.251 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:02:37.251 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:02:37.251 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:02:37.251 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:02:37.251 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:03:09.336 18:51:27 -- spdk/autotest.sh@87 -- # timing_enter pre_cleanup 00:03:09.336 18:51:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:09.336 18:51:27 -- common/autotest_common.sh@10 -- # set +x 00:03:09.336 18:51:27 -- spdk/autotest.sh@89 -- # rm -f 00:03:09.336 18:51:27 -- spdk/autotest.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:09.336 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:03:09.336 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:03:09.336 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:03:09.336 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:03:09.336 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:03:09.336 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:03:09.336 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:03:09.336 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:03:09.336 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:03:09.336 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:03:09.336 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:03:09.336 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:03:09.336 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:03:09.336 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:03:09.336 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:03:09.336 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:03:09.336 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:03:09.336 18:51:28 -- spdk/autotest.sh@94 -- # get_zoned_devs 00:03:09.337 18:51:28 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:09.337 18:51:28 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:09.337 18:51:28 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:09.337 18:51:28 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:09.337 18:51:28 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:09.337 18:51:28 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:09.337 18:51:28 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:09.337 18:51:28 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:09.337 18:51:28 -- spdk/autotest.sh@96 -- # (( 0 > 0 )) 00:03:09.337 18:51:28 -- spdk/autotest.sh@108 -- # ls /dev/nvme0n1 00:03:09.337 18:51:28 -- spdk/autotest.sh@108 -- # grep -v p 00:03:09.337 18:51:28 -- spdk/autotest.sh@108 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:03:09.337 18:51:28 -- spdk/autotest.sh@110 -- # [[ -z '' ]] 00:03:09.337 18:51:28 -- spdk/autotest.sh@111 -- # block_in_use /dev/nvme0n1 00:03:09.337 18:51:28 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:03:09.337 18:51:28 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:03:09.337 No valid GPT data, bailing 00:03:09.337 18:51:28 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:09.337 18:51:28 -- scripts/common.sh@393 -- # pt= 00:03:09.337 18:51:28 -- scripts/common.sh@394 -- # return 1 00:03:09.337 18:51:28 -- spdk/autotest.sh@112 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:03:09.337 1+0 records in 00:03:09.337 1+0 records out 00:03:09.337 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00238018 s, 441 MB/s 00:03:09.337 18:51:28 -- spdk/autotest.sh@116 -- # sync 00:03:09.337 18:51:28 -- spdk/autotest.sh@118 -- # xtrace_disable_per_cmd reap_spdk_processes 00:03:09.337 18:51:28 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:03:09.337 18:51:28 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:03:09.597 18:51:30 -- spdk/autotest.sh@122 -- # uname -s 00:03:09.597 18:51:30 -- spdk/autotest.sh@122 -- # '[' Linux = Linux ']' 00:03:09.597 18:51:30 -- spdk/autotest.sh@123 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:03:09.597 18:51:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:09.597 18:51:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:09.597 18:51:30 -- common/autotest_common.sh@10 -- # set +x 00:03:09.856 ************************************ 00:03:09.856 START TEST setup.sh 00:03:09.856 ************************************ 00:03:09.856 18:51:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:03:09.856 * Looking for test storage... 00:03:09.856 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:09.856 18:51:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:09.856 18:51:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:09.856 18:51:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:09.856 18:51:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:09.856 18:51:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:09.856 18:51:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:09.856 18:51:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:09.856 18:51:30 -- scripts/common.sh@335 -- # IFS=.-: 00:03:09.856 18:51:30 -- scripts/common.sh@335 -- # read -ra ver1 00:03:09.856 18:51:30 -- scripts/common.sh@336 -- # IFS=.-: 00:03:09.856 18:51:30 -- scripts/common.sh@336 -- # read -ra ver2 00:03:09.856 18:51:30 -- scripts/common.sh@337 -- # local 'op=<' 00:03:09.856 18:51:30 -- scripts/common.sh@339 -- # ver1_l=2 00:03:09.856 18:51:30 -- scripts/common.sh@340 -- # ver2_l=1 00:03:09.856 18:51:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:09.856 18:51:30 -- scripts/common.sh@343 -- # case "$op" in 00:03:09.856 18:51:30 -- scripts/common.sh@344 -- # : 1 00:03:09.856 18:51:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:09.856 18:51:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:09.856 18:51:30 -- scripts/common.sh@364 -- # decimal 1 00:03:09.856 18:51:30 -- scripts/common.sh@352 -- # local d=1 00:03:09.856 18:51:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:09.856 18:51:30 -- scripts/common.sh@354 -- # echo 1 00:03:09.856 18:51:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:09.856 18:51:30 -- scripts/common.sh@365 -- # decimal 2 00:03:09.856 18:51:30 -- scripts/common.sh@352 -- # local d=2 00:03:09.856 18:51:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:09.856 18:51:30 -- scripts/common.sh@354 -- # echo 2 00:03:09.856 18:51:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:09.856 18:51:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:09.856 18:51:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:09.856 18:51:30 -- scripts/common.sh@367 -- # return 0 00:03:09.856 18:51:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:09.856 18:51:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:09.856 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:09.856 --rc genhtml_branch_coverage=1 00:03:09.856 --rc genhtml_function_coverage=1 00:03:09.856 --rc genhtml_legend=1 00:03:09.856 --rc geninfo_all_blocks=1 00:03:09.856 --rc geninfo_unexecuted_blocks=1 00:03:09.856 00:03:09.856 ' 00:03:09.856 18:51:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:09.856 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:09.856 --rc genhtml_branch_coverage=1 00:03:09.856 --rc genhtml_function_coverage=1 00:03:09.856 --rc genhtml_legend=1 00:03:09.856 --rc geninfo_all_blocks=1 00:03:09.856 --rc geninfo_unexecuted_blocks=1 00:03:09.856 00:03:09.856 ' 00:03:09.856 18:51:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:09.856 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:09.856 --rc genhtml_branch_coverage=1 00:03:09.856 --rc genhtml_function_coverage=1 00:03:09.856 --rc genhtml_legend=1 00:03:09.856 --rc geninfo_all_blocks=1 00:03:09.856 --rc geninfo_unexecuted_blocks=1 00:03:09.856 00:03:09.856 ' 00:03:09.856 18:51:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:09.857 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:09.857 --rc genhtml_branch_coverage=1 00:03:09.857 --rc genhtml_function_coverage=1 00:03:09.857 --rc genhtml_legend=1 00:03:09.857 --rc geninfo_all_blocks=1 00:03:09.857 --rc geninfo_unexecuted_blocks=1 00:03:09.857 00:03:09.857 ' 00:03:09.857 18:51:30 -- setup/test-setup.sh@10 -- # uname -s 00:03:09.857 18:51:30 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:03:09.857 18:51:30 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:03:09.857 18:51:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:09.857 18:51:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:09.857 18:51:30 -- common/autotest_common.sh@10 -- # set +x 00:03:09.857 ************************************ 00:03:09.857 START TEST acl 00:03:09.857 ************************************ 00:03:09.857 18:51:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:03:09.857 * Looking for test storage... 00:03:09.857 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:09.857 18:51:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:09.857 18:51:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:09.857 18:51:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:10.117 18:51:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:10.117 18:51:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:10.117 18:51:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:10.117 18:51:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:10.117 18:51:30 -- scripts/common.sh@335 -- # IFS=.-: 00:03:10.117 18:51:30 -- scripts/common.sh@335 -- # read -ra ver1 00:03:10.117 18:51:30 -- scripts/common.sh@336 -- # IFS=.-: 00:03:10.117 18:51:30 -- scripts/common.sh@336 -- # read -ra ver2 00:03:10.117 18:51:30 -- scripts/common.sh@337 -- # local 'op=<' 00:03:10.117 18:51:30 -- scripts/common.sh@339 -- # ver1_l=2 00:03:10.117 18:51:30 -- scripts/common.sh@340 -- # ver2_l=1 00:03:10.117 18:51:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:10.117 18:51:30 -- scripts/common.sh@343 -- # case "$op" in 00:03:10.117 18:51:30 -- scripts/common.sh@344 -- # : 1 00:03:10.117 18:51:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:10.117 18:51:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:10.117 18:51:30 -- scripts/common.sh@364 -- # decimal 1 00:03:10.117 18:51:30 -- scripts/common.sh@352 -- # local d=1 00:03:10.117 18:51:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:10.117 18:51:30 -- scripts/common.sh@354 -- # echo 1 00:03:10.117 18:51:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:10.117 18:51:30 -- scripts/common.sh@365 -- # decimal 2 00:03:10.117 18:51:30 -- scripts/common.sh@352 -- # local d=2 00:03:10.117 18:51:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:10.117 18:51:30 -- scripts/common.sh@354 -- # echo 2 00:03:10.117 18:51:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:10.117 18:51:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:10.117 18:51:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:10.117 18:51:30 -- scripts/common.sh@367 -- # return 0 00:03:10.117 18:51:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:10.118 18:51:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:10.118 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:10.118 --rc genhtml_branch_coverage=1 00:03:10.118 --rc genhtml_function_coverage=1 00:03:10.118 --rc genhtml_legend=1 00:03:10.118 --rc geninfo_all_blocks=1 00:03:10.118 --rc geninfo_unexecuted_blocks=1 00:03:10.118 00:03:10.118 ' 00:03:10.118 18:51:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:10.118 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:10.118 --rc genhtml_branch_coverage=1 00:03:10.118 --rc genhtml_function_coverage=1 00:03:10.118 --rc genhtml_legend=1 00:03:10.118 --rc geninfo_all_blocks=1 00:03:10.118 --rc geninfo_unexecuted_blocks=1 00:03:10.118 00:03:10.118 ' 00:03:10.118 18:51:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:10.118 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:10.118 --rc genhtml_branch_coverage=1 00:03:10.118 --rc genhtml_function_coverage=1 00:03:10.118 --rc genhtml_legend=1 00:03:10.118 --rc geninfo_all_blocks=1 00:03:10.118 --rc geninfo_unexecuted_blocks=1 00:03:10.118 00:03:10.118 ' 00:03:10.118 18:51:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:10.118 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:10.118 --rc genhtml_branch_coverage=1 00:03:10.118 --rc genhtml_function_coverage=1 00:03:10.118 --rc genhtml_legend=1 00:03:10.118 --rc geninfo_all_blocks=1 00:03:10.118 --rc geninfo_unexecuted_blocks=1 00:03:10.118 00:03:10.118 ' 00:03:10.118 18:51:30 -- setup/acl.sh@10 -- # get_zoned_devs 00:03:10.118 18:51:30 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:10.118 18:51:30 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:10.118 18:51:30 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:10.118 18:51:30 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:10.118 18:51:30 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:10.118 18:51:30 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:10.118 18:51:30 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:10.118 18:51:30 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:10.118 18:51:30 -- setup/acl.sh@12 -- # devs=() 00:03:10.118 18:51:30 -- setup/acl.sh@12 -- # declare -a devs 00:03:10.118 18:51:30 -- setup/acl.sh@13 -- # drivers=() 00:03:10.118 18:51:30 -- setup/acl.sh@13 -- # declare -A drivers 00:03:10.118 18:51:30 -- setup/acl.sh@51 -- # setup reset 00:03:10.118 18:51:30 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:10.118 18:51:30 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:11.502 18:51:32 -- setup/acl.sh@52 -- # collect_setup_devs 00:03:11.502 18:51:32 -- setup/acl.sh@16 -- # local dev driver 00:03:11.502 18:51:32 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:11.502 18:51:32 -- setup/acl.sh@15 -- # setup output status 00:03:11.502 18:51:32 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:11.502 18:51:32 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:12.881 Hugepages 00:03:12.881 node hugesize free / total 00:03:12.881 18:51:33 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:12.881 18:51:33 -- setup/acl.sh@19 -- # continue 00:03:12.881 18:51:33 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:12.881 18:51:33 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:12.881 18:51:33 -- setup/acl.sh@19 -- # continue 00:03:12.881 18:51:33 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:12.881 18:51:33 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:03:12.881 18:51:33 -- setup/acl.sh@19 -- # continue 00:03:12.881 18:51:33 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:12.881 00:03:12.881 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:12.881 18:51:33 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:03:12.881 18:51:33 -- setup/acl.sh@19 -- # continue 00:03:12.881 18:51:33 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:12.881 18:51:33 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:03:12.881 18:51:33 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:12.881 18:51:33 -- setup/acl.sh@20 -- # continue 00:03:12.881 18:51:33 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:12.881 18:51:33 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:03:12.881 18:51:33 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:12.881 18:51:33 -- setup/acl.sh@20 -- # continue 00:03:12.881 18:51:33 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:12.881 18:51:33 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:03:12.881 18:51:33 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:12.881 18:51:33 -- setup/acl.sh@20 -- # continue 00:03:12.881 18:51:33 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:12.881 18:51:33 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:03:12.881 18:51:33 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:12.881 18:51:33 -- setup/acl.sh@20 -- # continue 00:03:12.881 18:51:33 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:12.881 18:51:33 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:03:12.881 18:51:33 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:12.881 18:51:33 -- setup/acl.sh@20 -- # continue 00:03:12.881 18:51:33 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:12.881 18:51:33 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:03:12.881 18:51:33 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:12.881 18:51:33 -- setup/acl.sh@20 -- # continue 00:03:12.881 18:51:33 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:12.881 18:51:33 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:03:12.881 18:51:33 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:12.881 18:51:33 -- setup/acl.sh@20 -- # continue 00:03:12.881 18:51:33 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:12.881 18:51:33 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:03:12.881 18:51:33 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:12.881 18:51:33 -- setup/acl.sh@20 -- # continue 00:03:12.881 18:51:33 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:12.881 18:51:33 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:03:12.881 18:51:33 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:12.881 18:51:33 -- setup/acl.sh@20 -- # continue 00:03:12.881 18:51:33 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:12.882 18:51:33 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:03:12.882 18:51:33 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:12.882 18:51:33 -- setup/acl.sh@20 -- # continue 00:03:12.882 18:51:33 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:12.882 18:51:33 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:03:12.882 18:51:33 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:12.882 18:51:33 -- setup/acl.sh@20 -- # continue 00:03:12.882 18:51:33 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:12.882 18:51:33 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:03:12.882 18:51:33 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:12.882 18:51:33 -- setup/acl.sh@20 -- # continue 00:03:12.882 18:51:33 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:12.882 18:51:33 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:03:12.882 18:51:33 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:12.882 18:51:33 -- setup/acl.sh@20 -- # continue 00:03:12.882 18:51:33 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:12.882 18:51:33 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:03:12.882 18:51:33 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:12.882 18:51:33 -- setup/acl.sh@20 -- # continue 00:03:12.882 18:51:33 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:12.882 18:51:33 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:03:12.882 18:51:33 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:12.882 18:51:33 -- setup/acl.sh@20 -- # continue 00:03:12.882 18:51:33 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:12.882 18:51:33 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:03:12.882 18:51:33 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:03:12.882 18:51:33 -- setup/acl.sh@20 -- # continue 00:03:12.882 18:51:33 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:12.882 18:51:33 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:03:12.882 18:51:33 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:03:12.882 18:51:33 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:12.882 18:51:33 -- setup/acl.sh@22 -- # devs+=("$dev") 00:03:12.882 18:51:33 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:03:12.882 18:51:33 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:03:12.882 18:51:33 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:03:12.882 18:51:33 -- setup/acl.sh@54 -- # run_test denied denied 00:03:12.882 18:51:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:12.882 18:51:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:12.882 18:51:33 -- common/autotest_common.sh@10 -- # set +x 00:03:12.882 ************************************ 00:03:12.882 START TEST denied 00:03:12.882 ************************************ 00:03:12.882 18:51:33 -- common/autotest_common.sh@1114 -- # denied 00:03:12.882 18:51:33 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:03:12.882 18:51:33 -- setup/acl.sh@38 -- # setup output config 00:03:12.882 18:51:33 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:03:12.882 18:51:33 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:12.882 18:51:33 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:14.797 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:03:14.797 18:51:35 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:03:14.797 18:51:35 -- setup/acl.sh@28 -- # local dev driver 00:03:14.797 18:51:35 -- setup/acl.sh@30 -- # for dev in "$@" 00:03:14.797 18:51:35 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:03:14.797 18:51:35 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:03:14.797 18:51:35 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:03:14.797 18:51:35 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:03:14.797 18:51:35 -- setup/acl.sh@41 -- # setup reset 00:03:14.797 18:51:35 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:14.797 18:51:35 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:17.349 00:03:17.350 real 0m4.120s 00:03:17.350 user 0m1.224s 00:03:17.350 sys 0m1.990s 00:03:17.350 18:51:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:17.350 18:51:37 -- common/autotest_common.sh@10 -- # set +x 00:03:17.350 ************************************ 00:03:17.350 END TEST denied 00:03:17.350 ************************************ 00:03:17.350 18:51:37 -- setup/acl.sh@55 -- # run_test allowed allowed 00:03:17.350 18:51:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:17.350 18:51:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:17.350 18:51:37 -- common/autotest_common.sh@10 -- # set +x 00:03:17.350 ************************************ 00:03:17.350 START TEST allowed 00:03:17.350 ************************************ 00:03:17.350 18:51:37 -- common/autotest_common.sh@1114 -- # allowed 00:03:17.350 18:51:37 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:03:17.350 18:51:37 -- setup/acl.sh@45 -- # setup output config 00:03:17.350 18:51:37 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:03:17.350 18:51:37 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:17.350 18:51:37 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:19.261 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:19.261 18:51:40 -- setup/acl.sh@47 -- # verify 00:03:19.261 18:51:40 -- setup/acl.sh@28 -- # local dev driver 00:03:19.261 18:51:40 -- setup/acl.sh@48 -- # setup reset 00:03:19.261 18:51:40 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:19.261 18:51:40 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:21.171 00:03:21.171 real 0m4.061s 00:03:21.171 user 0m1.090s 00:03:21.171 sys 0m1.884s 00:03:21.171 18:51:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:21.171 18:51:41 -- common/autotest_common.sh@10 -- # set +x 00:03:21.171 ************************************ 00:03:21.171 END TEST allowed 00:03:21.171 ************************************ 00:03:21.171 00:03:21.171 real 0m11.192s 00:03:21.171 user 0m3.527s 00:03:21.171 sys 0m5.774s 00:03:21.171 18:51:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:21.171 18:51:41 -- common/autotest_common.sh@10 -- # set +x 00:03:21.171 ************************************ 00:03:21.171 END TEST acl 00:03:21.171 ************************************ 00:03:21.171 18:51:42 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:21.171 18:51:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:21.171 18:51:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:21.171 18:51:42 -- common/autotest_common.sh@10 -- # set +x 00:03:21.171 ************************************ 00:03:21.171 START TEST hugepages 00:03:21.171 ************************************ 00:03:21.171 18:51:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:21.171 * Looking for test storage... 00:03:21.171 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:21.171 18:51:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:21.171 18:51:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:21.171 18:51:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:21.171 18:51:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:21.171 18:51:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:21.171 18:51:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:21.171 18:51:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:21.171 18:51:42 -- scripts/common.sh@335 -- # IFS=.-: 00:03:21.171 18:51:42 -- scripts/common.sh@335 -- # read -ra ver1 00:03:21.171 18:51:42 -- scripts/common.sh@336 -- # IFS=.-: 00:03:21.171 18:51:42 -- scripts/common.sh@336 -- # read -ra ver2 00:03:21.171 18:51:42 -- scripts/common.sh@337 -- # local 'op=<' 00:03:21.171 18:51:42 -- scripts/common.sh@339 -- # ver1_l=2 00:03:21.171 18:51:42 -- scripts/common.sh@340 -- # ver2_l=1 00:03:21.171 18:51:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:21.171 18:51:42 -- scripts/common.sh@343 -- # case "$op" in 00:03:21.171 18:51:42 -- scripts/common.sh@344 -- # : 1 00:03:21.171 18:51:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:21.171 18:51:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:21.171 18:51:42 -- scripts/common.sh@364 -- # decimal 1 00:03:21.171 18:51:42 -- scripts/common.sh@352 -- # local d=1 00:03:21.171 18:51:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:21.171 18:51:42 -- scripts/common.sh@354 -- # echo 1 00:03:21.171 18:51:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:21.171 18:51:42 -- scripts/common.sh@365 -- # decimal 2 00:03:21.171 18:51:42 -- scripts/common.sh@352 -- # local d=2 00:03:21.171 18:51:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:21.171 18:51:42 -- scripts/common.sh@354 -- # echo 2 00:03:21.171 18:51:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:21.171 18:51:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:21.171 18:51:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:21.171 18:51:42 -- scripts/common.sh@367 -- # return 0 00:03:21.171 18:51:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:21.171 18:51:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:21.171 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:21.171 --rc genhtml_branch_coverage=1 00:03:21.171 --rc genhtml_function_coverage=1 00:03:21.171 --rc genhtml_legend=1 00:03:21.171 --rc geninfo_all_blocks=1 00:03:21.171 --rc geninfo_unexecuted_blocks=1 00:03:21.171 00:03:21.171 ' 00:03:21.171 18:51:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:21.171 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:21.171 --rc genhtml_branch_coverage=1 00:03:21.171 --rc genhtml_function_coverage=1 00:03:21.171 --rc genhtml_legend=1 00:03:21.171 --rc geninfo_all_blocks=1 00:03:21.171 --rc geninfo_unexecuted_blocks=1 00:03:21.171 00:03:21.171 ' 00:03:21.171 18:51:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:21.171 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:21.171 --rc genhtml_branch_coverage=1 00:03:21.171 --rc genhtml_function_coverage=1 00:03:21.171 --rc genhtml_legend=1 00:03:21.171 --rc geninfo_all_blocks=1 00:03:21.171 --rc geninfo_unexecuted_blocks=1 00:03:21.171 00:03:21.171 ' 00:03:21.171 18:51:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:21.171 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:21.171 --rc genhtml_branch_coverage=1 00:03:21.171 --rc genhtml_function_coverage=1 00:03:21.171 --rc genhtml_legend=1 00:03:21.171 --rc geninfo_all_blocks=1 00:03:21.171 --rc geninfo_unexecuted_blocks=1 00:03:21.171 00:03:21.171 ' 00:03:21.171 18:51:42 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:03:21.171 18:51:42 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:03:21.171 18:51:42 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:03:21.171 18:51:42 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:03:21.171 18:51:42 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:03:21.171 18:51:42 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:03:21.171 18:51:42 -- setup/common.sh@17 -- # local get=Hugepagesize 00:03:21.171 18:51:42 -- setup/common.sh@18 -- # local node= 00:03:21.171 18:51:42 -- setup/common.sh@19 -- # local var val 00:03:21.171 18:51:42 -- setup/common.sh@20 -- # local mem_f mem 00:03:21.171 18:51:42 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:21.171 18:51:42 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:21.171 18:51:42 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:21.171 18:51:42 -- setup/common.sh@28 -- # mapfile -t mem 00:03:21.171 18:51:42 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:21.171 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.171 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.171 18:51:42 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 44650132 kB' 'MemAvailable: 48264368 kB' 'Buffers: 11580 kB' 'Cached: 9192480 kB' 'SwapCached: 0 kB' 'Active: 6166904 kB' 'Inactive: 3666172 kB' 'Active(anon): 5804088 kB' 'Inactive(anon): 0 kB' 'Active(file): 362816 kB' 'Inactive(file): 3666172 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 632412 kB' 'Mapped: 142160 kB' 'Shmem: 5175072 kB' 'KReclaimable: 157652 kB' 'Slab: 522940 kB' 'SReclaimable: 157652 kB' 'SUnreclaim: 365288 kB' 'KernelStack: 12784 kB' 'PageTables: 7824 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36559284 kB' 'Committed_AS: 7501312 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195012 kB' 'VmallocChunk: 0 kB' 'Percpu: 31488 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 427612 kB' 'DirectMap2M: 7880704 kB' 'DirectMap1G: 61865984 kB' 00:03:21.171 18:51:42 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.171 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.171 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.171 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.171 18:51:42 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.171 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.171 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.171 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.171 18:51:42 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.171 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.171 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.171 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.171 18:51:42 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.171 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.171 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.171 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.171 18:51:42 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.171 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.171 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.171 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.171 18:51:42 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.171 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.171 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.171 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.171 18:51:42 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.171 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.171 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.171 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.171 18:51:42 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.171 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.171 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.171 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.171 18:51:42 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.171 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.171 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.171 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.171 18:51:42 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.171 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.171 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.171 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.172 18:51:42 -- setup/common.sh@32 -- # continue 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # IFS=': ' 00:03:21.172 18:51:42 -- setup/common.sh@31 -- # read -r var val _ 00:03:21.173 18:51:42 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:21.173 18:51:42 -- setup/common.sh@33 -- # echo 2048 00:03:21.173 18:51:42 -- setup/common.sh@33 -- # return 0 00:03:21.173 18:51:42 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:03:21.173 18:51:42 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:03:21.173 18:51:42 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:03:21.173 18:51:42 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:03:21.173 18:51:42 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:03:21.173 18:51:42 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:03:21.173 18:51:42 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:03:21.173 18:51:42 -- setup/hugepages.sh@207 -- # get_nodes 00:03:21.173 18:51:42 -- setup/hugepages.sh@27 -- # local node 00:03:21.173 18:51:42 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:21.173 18:51:42 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:03:21.173 18:51:42 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:21.173 18:51:42 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:21.173 18:51:42 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:21.173 18:51:42 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:21.173 18:51:42 -- setup/hugepages.sh@208 -- # clear_hp 00:03:21.173 18:51:42 -- setup/hugepages.sh@37 -- # local node hp 00:03:21.173 18:51:42 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:21.173 18:51:42 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:21.173 18:51:42 -- setup/hugepages.sh@41 -- # echo 0 00:03:21.173 18:51:42 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:21.173 18:51:42 -- setup/hugepages.sh@41 -- # echo 0 00:03:21.173 18:51:42 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:21.173 18:51:42 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:21.173 18:51:42 -- setup/hugepages.sh@41 -- # echo 0 00:03:21.173 18:51:42 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:21.173 18:51:42 -- setup/hugepages.sh@41 -- # echo 0 00:03:21.173 18:51:42 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:21.173 18:51:42 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:21.173 18:51:42 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:03:21.173 18:51:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:21.173 18:51:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:21.173 18:51:42 -- common/autotest_common.sh@10 -- # set +x 00:03:21.432 ************************************ 00:03:21.432 START TEST default_setup 00:03:21.432 ************************************ 00:03:21.432 18:51:42 -- common/autotest_common.sh@1114 -- # default_setup 00:03:21.432 18:51:42 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:03:21.432 18:51:42 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:21.432 18:51:42 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:21.432 18:51:42 -- setup/hugepages.sh@51 -- # shift 00:03:21.432 18:51:42 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:21.432 18:51:42 -- setup/hugepages.sh@52 -- # local node_ids 00:03:21.432 18:51:42 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:21.432 18:51:42 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:21.432 18:51:42 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:21.432 18:51:42 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:21.432 18:51:42 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:21.432 18:51:42 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:21.432 18:51:42 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:21.432 18:51:42 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:21.432 18:51:42 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:21.432 18:51:42 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:21.432 18:51:42 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:21.432 18:51:42 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:21.432 18:51:42 -- setup/hugepages.sh@73 -- # return 0 00:03:21.432 18:51:42 -- setup/hugepages.sh@137 -- # setup output 00:03:21.432 18:51:42 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:21.432 18:51:42 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:22.818 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:22.818 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:22.818 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:22.818 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:22.818 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:22.818 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:22.818 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:22.818 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:22.818 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:22.818 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:22.818 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:22.818 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:22.818 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:22.818 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:22.818 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:22.818 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:23.764 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:23.764 18:51:44 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:03:23.764 18:51:44 -- setup/hugepages.sh@89 -- # local node 00:03:23.764 18:51:44 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:23.764 18:51:44 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:23.764 18:51:44 -- setup/hugepages.sh@92 -- # local surp 00:03:23.764 18:51:44 -- setup/hugepages.sh@93 -- # local resv 00:03:23.764 18:51:44 -- setup/hugepages.sh@94 -- # local anon 00:03:23.764 18:51:44 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:23.764 18:51:44 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:23.764 18:51:44 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:23.764 18:51:44 -- setup/common.sh@18 -- # local node= 00:03:23.764 18:51:44 -- setup/common.sh@19 -- # local var val 00:03:23.764 18:51:44 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.764 18:51:44 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.764 18:51:44 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.764 18:51:44 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.764 18:51:44 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.764 18:51:44 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 46763576 kB' 'MemAvailable: 50377568 kB' 'Buffers: 11580 kB' 'Cached: 9192572 kB' 'SwapCached: 0 kB' 'Active: 6176448 kB' 'Inactive: 3666172 kB' 'Active(anon): 5813632 kB' 'Inactive(anon): 0 kB' 'Active(file): 362816 kB' 'Inactive(file): 3666172 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 641772 kB' 'Mapped: 142160 kB' 'Shmem: 5175164 kB' 'KReclaimable: 157164 kB' 'Slab: 522396 kB' 'SReclaimable: 157164 kB' 'SUnreclaim: 365232 kB' 'KernelStack: 12800 kB' 'PageTables: 8160 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 7509000 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195128 kB' 'VmallocChunk: 0 kB' 'Percpu: 31488 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 427612 kB' 'DirectMap2M: 7880704 kB' 'DirectMap1G: 61865984 kB' 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.764 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.764 18:51:44 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.765 18:51:44 -- setup/common.sh@33 -- # echo 0 00:03:23.765 18:51:44 -- setup/common.sh@33 -- # return 0 00:03:23.765 18:51:44 -- setup/hugepages.sh@97 -- # anon=0 00:03:23.765 18:51:44 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:23.765 18:51:44 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:23.765 18:51:44 -- setup/common.sh@18 -- # local node= 00:03:23.765 18:51:44 -- setup/common.sh@19 -- # local var val 00:03:23.765 18:51:44 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.765 18:51:44 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.765 18:51:44 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.765 18:51:44 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.765 18:51:44 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.765 18:51:44 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 46765848 kB' 'MemAvailable: 50379840 kB' 'Buffers: 11580 kB' 'Cached: 9192576 kB' 'SwapCached: 0 kB' 'Active: 6176472 kB' 'Inactive: 3666172 kB' 'Active(anon): 5813656 kB' 'Inactive(anon): 0 kB' 'Active(file): 362816 kB' 'Inactive(file): 3666172 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 641888 kB' 'Mapped: 142628 kB' 'Shmem: 5175168 kB' 'KReclaimable: 157164 kB' 'Slab: 522656 kB' 'SReclaimable: 157164 kB' 'SUnreclaim: 365492 kB' 'KernelStack: 12672 kB' 'PageTables: 7424 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 7511760 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195112 kB' 'VmallocChunk: 0 kB' 'Percpu: 31488 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 427612 kB' 'DirectMap2M: 7880704 kB' 'DirectMap1G: 61865984 kB' 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.765 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.765 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.766 18:51:44 -- setup/common.sh@33 -- # echo 0 00:03:23.766 18:51:44 -- setup/common.sh@33 -- # return 0 00:03:23.766 18:51:44 -- setup/hugepages.sh@99 -- # surp=0 00:03:23.766 18:51:44 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:23.766 18:51:44 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:23.766 18:51:44 -- setup/common.sh@18 -- # local node= 00:03:23.766 18:51:44 -- setup/common.sh@19 -- # local var val 00:03:23.766 18:51:44 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.766 18:51:44 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.766 18:51:44 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.766 18:51:44 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.766 18:51:44 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.766 18:51:44 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 46778740 kB' 'MemAvailable: 50392732 kB' 'Buffers: 11580 kB' 'Cached: 9192584 kB' 'SwapCached: 0 kB' 'Active: 6172472 kB' 'Inactive: 3666172 kB' 'Active(anon): 5809656 kB' 'Inactive(anon): 0 kB' 'Active(file): 362816 kB' 'Inactive(file): 3666172 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 637888 kB' 'Mapped: 142644 kB' 'Shmem: 5175176 kB' 'KReclaimable: 157164 kB' 'Slab: 522664 kB' 'SReclaimable: 157164 kB' 'SUnreclaim: 365500 kB' 'KernelStack: 12624 kB' 'PageTables: 7292 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 7505588 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195092 kB' 'VmallocChunk: 0 kB' 'Percpu: 31488 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 427612 kB' 'DirectMap2M: 7880704 kB' 'DirectMap1G: 61865984 kB' 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.766 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.766 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.767 18:51:44 -- setup/common.sh@33 -- # echo 0 00:03:23.767 18:51:44 -- setup/common.sh@33 -- # return 0 00:03:23.767 18:51:44 -- setup/hugepages.sh@100 -- # resv=0 00:03:23.767 18:51:44 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:23.767 nr_hugepages=1024 00:03:23.767 18:51:44 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:23.767 resv_hugepages=0 00:03:23.767 18:51:44 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:23.767 surplus_hugepages=0 00:03:23.767 18:51:44 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:23.767 anon_hugepages=0 00:03:23.767 18:51:44 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:23.767 18:51:44 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:23.767 18:51:44 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:23.767 18:51:44 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:23.767 18:51:44 -- setup/common.sh@18 -- # local node= 00:03:23.767 18:51:44 -- setup/common.sh@19 -- # local var val 00:03:23.767 18:51:44 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.767 18:51:44 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.767 18:51:44 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.767 18:51:44 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.767 18:51:44 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.767 18:51:44 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.767 18:51:44 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 46772408 kB' 'MemAvailable: 50386400 kB' 'Buffers: 11580 kB' 'Cached: 9192604 kB' 'SwapCached: 0 kB' 'Active: 6175632 kB' 'Inactive: 3666172 kB' 'Active(anon): 5812816 kB' 'Inactive(anon): 0 kB' 'Active(file): 362816 kB' 'Inactive(file): 3666172 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 641020 kB' 'Mapped: 142572 kB' 'Shmem: 5175196 kB' 'KReclaimable: 157164 kB' 'Slab: 522676 kB' 'SReclaimable: 157164 kB' 'SUnreclaim: 365512 kB' 'KernelStack: 12688 kB' 'PageTables: 7468 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 7509048 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195096 kB' 'VmallocChunk: 0 kB' 'Percpu: 31488 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 427612 kB' 'DirectMap2M: 7880704 kB' 'DirectMap1G: 61865984 kB' 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.767 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.767 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.768 18:51:44 -- setup/common.sh@33 -- # echo 1024 00:03:23.768 18:51:44 -- setup/common.sh@33 -- # return 0 00:03:23.768 18:51:44 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:23.768 18:51:44 -- setup/hugepages.sh@112 -- # get_nodes 00:03:23.768 18:51:44 -- setup/hugepages.sh@27 -- # local node 00:03:23.768 18:51:44 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:23.768 18:51:44 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:23.768 18:51:44 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:23.768 18:51:44 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:23.768 18:51:44 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:23.768 18:51:44 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:23.768 18:51:44 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:23.768 18:51:44 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:23.768 18:51:44 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:23.768 18:51:44 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:23.768 18:51:44 -- setup/common.sh@18 -- # local node=0 00:03:23.768 18:51:44 -- setup/common.sh@19 -- # local var val 00:03:23.768 18:51:44 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.768 18:51:44 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.768 18:51:44 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:23.768 18:51:44 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:23.768 18:51:44 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.768 18:51:44 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 28780416 kB' 'MemUsed: 4045440 kB' 'SwapCached: 0 kB' 'Active: 1081128 kB' 'Inactive: 138596 kB' 'Active(anon): 940052 kB' 'Inactive(anon): 0 kB' 'Active(file): 141076 kB' 'Inactive(file): 138596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 936312 kB' 'Mapped: 49828 kB' 'AnonPages: 286556 kB' 'Shmem: 656640 kB' 'KernelStack: 7096 kB' 'PageTables: 4256 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 41368 kB' 'Slab: 243616 kB' 'SReclaimable: 41368 kB' 'SUnreclaim: 202248 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.768 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.768 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.769 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.769 18:51:44 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.769 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.769 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.769 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.769 18:51:44 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.769 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.769 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.769 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.769 18:51:44 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.769 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.769 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.769 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.769 18:51:44 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.769 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.769 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.769 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.769 18:51:44 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.769 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.769 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.769 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.769 18:51:44 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.769 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.769 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.769 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.769 18:51:44 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.769 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.769 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.769 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.769 18:51:44 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.769 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.769 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.769 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.769 18:51:44 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.769 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.769 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.769 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.769 18:51:44 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.769 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.769 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.769 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.769 18:51:44 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.769 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.769 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.769 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.769 18:51:44 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.769 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.769 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.769 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.769 18:51:44 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.769 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.769 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.769 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.769 18:51:44 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.769 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.769 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.769 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.769 18:51:44 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.769 18:51:44 -- setup/common.sh@32 -- # continue 00:03:23.769 18:51:44 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.769 18:51:44 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.769 18:51:44 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.769 18:51:44 -- setup/common.sh@33 -- # echo 0 00:03:23.769 18:51:44 -- setup/common.sh@33 -- # return 0 00:03:23.769 18:51:44 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:23.769 18:51:44 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:23.769 18:51:44 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:23.769 18:51:44 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:23.769 18:51:44 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:23.769 node0=1024 expecting 1024 00:03:23.769 18:51:44 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:23.769 00:03:23.769 real 0m2.525s 00:03:23.769 user 0m0.674s 00:03:23.769 sys 0m0.969s 00:03:23.769 18:51:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:23.769 18:51:44 -- common/autotest_common.sh@10 -- # set +x 00:03:23.769 ************************************ 00:03:23.769 END TEST default_setup 00:03:23.769 ************************************ 00:03:23.769 18:51:44 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:03:23.769 18:51:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:23.769 18:51:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:23.769 18:51:44 -- common/autotest_common.sh@10 -- # set +x 00:03:23.769 ************************************ 00:03:23.769 START TEST per_node_1G_alloc 00:03:23.769 ************************************ 00:03:23.769 18:51:44 -- common/autotest_common.sh@1114 -- # per_node_1G_alloc 00:03:23.769 18:51:44 -- setup/hugepages.sh@143 -- # local IFS=, 00:03:23.769 18:51:44 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:03:23.769 18:51:44 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:23.769 18:51:44 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:03:23.769 18:51:44 -- setup/hugepages.sh@51 -- # shift 00:03:23.769 18:51:44 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:03:23.769 18:51:44 -- setup/hugepages.sh@52 -- # local node_ids 00:03:23.769 18:51:44 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:23.769 18:51:44 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:23.769 18:51:44 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:03:23.769 18:51:44 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:03:23.769 18:51:44 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:23.769 18:51:44 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:23.769 18:51:44 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:23.769 18:51:44 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:23.769 18:51:44 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:23.769 18:51:44 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:03:23.769 18:51:44 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:23.769 18:51:44 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:23.769 18:51:44 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:23.769 18:51:44 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:23.769 18:51:44 -- setup/hugepages.sh@73 -- # return 0 00:03:23.769 18:51:44 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:03:23.769 18:51:44 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:03:23.769 18:51:44 -- setup/hugepages.sh@146 -- # setup output 00:03:23.769 18:51:44 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:23.769 18:51:44 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:25.149 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:25.149 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:25.149 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:25.149 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:25.149 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:25.149 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:25.149 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:25.149 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:25.149 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:25.149 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:25.149 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:25.149 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:25.149 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:25.149 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:25.149 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:25.149 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:25.149 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:25.412 18:51:46 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:03:25.412 18:51:46 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:03:25.412 18:51:46 -- setup/hugepages.sh@89 -- # local node 00:03:25.412 18:51:46 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:25.412 18:51:46 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:25.412 18:51:46 -- setup/hugepages.sh@92 -- # local surp 00:03:25.412 18:51:46 -- setup/hugepages.sh@93 -- # local resv 00:03:25.412 18:51:46 -- setup/hugepages.sh@94 -- # local anon 00:03:25.412 18:51:46 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:25.412 18:51:46 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:25.412 18:51:46 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:25.412 18:51:46 -- setup/common.sh@18 -- # local node= 00:03:25.412 18:51:46 -- setup/common.sh@19 -- # local var val 00:03:25.412 18:51:46 -- setup/common.sh@20 -- # local mem_f mem 00:03:25.412 18:51:46 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:25.412 18:51:46 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:25.412 18:51:46 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:25.412 18:51:46 -- setup/common.sh@28 -- # mapfile -t mem 00:03:25.412 18:51:46 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:25.412 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.412 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.412 18:51:46 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 46759276 kB' 'MemAvailable: 50373268 kB' 'Buffers: 11580 kB' 'Cached: 9192656 kB' 'SwapCached: 0 kB' 'Active: 6172944 kB' 'Inactive: 3666172 kB' 'Active(anon): 5810128 kB' 'Inactive(anon): 0 kB' 'Active(file): 362816 kB' 'Inactive(file): 3666172 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 638128 kB' 'Mapped: 141780 kB' 'Shmem: 5175248 kB' 'KReclaimable: 157164 kB' 'Slab: 522452 kB' 'SReclaimable: 157164 kB' 'SUnreclaim: 365288 kB' 'KernelStack: 12656 kB' 'PageTables: 7348 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 7502968 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195220 kB' 'VmallocChunk: 0 kB' 'Percpu: 31488 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 427612 kB' 'DirectMap2M: 7880704 kB' 'DirectMap1G: 61865984 kB' 00:03:25.412 18:51:46 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.412 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.413 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.413 18:51:46 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:25.413 18:51:46 -- setup/common.sh@33 -- # echo 0 00:03:25.413 18:51:46 -- setup/common.sh@33 -- # return 0 00:03:25.413 18:51:46 -- setup/hugepages.sh@97 -- # anon=0 00:03:25.413 18:51:46 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:25.413 18:51:46 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:25.414 18:51:46 -- setup/common.sh@18 -- # local node= 00:03:25.414 18:51:46 -- setup/common.sh@19 -- # local var val 00:03:25.414 18:51:46 -- setup/common.sh@20 -- # local mem_f mem 00:03:25.414 18:51:46 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:25.414 18:51:46 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:25.414 18:51:46 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:25.414 18:51:46 -- setup/common.sh@28 -- # mapfile -t mem 00:03:25.414 18:51:46 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.414 18:51:46 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 46761740 kB' 'MemAvailable: 50375732 kB' 'Buffers: 11580 kB' 'Cached: 9192656 kB' 'SwapCached: 0 kB' 'Active: 6173280 kB' 'Inactive: 3666172 kB' 'Active(anon): 5810464 kB' 'Inactive(anon): 0 kB' 'Active(file): 362816 kB' 'Inactive(file): 3666172 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 638508 kB' 'Mapped: 141860 kB' 'Shmem: 5175248 kB' 'KReclaimable: 157164 kB' 'Slab: 522548 kB' 'SReclaimable: 157164 kB' 'SUnreclaim: 365384 kB' 'KernelStack: 12688 kB' 'PageTables: 7464 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 7502980 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195188 kB' 'VmallocChunk: 0 kB' 'Percpu: 31488 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 427612 kB' 'DirectMap2M: 7880704 kB' 'DirectMap1G: 61865984 kB' 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.414 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.414 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.415 18:51:46 -- setup/common.sh@33 -- # echo 0 00:03:25.415 18:51:46 -- setup/common.sh@33 -- # return 0 00:03:25.415 18:51:46 -- setup/hugepages.sh@99 -- # surp=0 00:03:25.415 18:51:46 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:25.415 18:51:46 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:25.415 18:51:46 -- setup/common.sh@18 -- # local node= 00:03:25.415 18:51:46 -- setup/common.sh@19 -- # local var val 00:03:25.415 18:51:46 -- setup/common.sh@20 -- # local mem_f mem 00:03:25.415 18:51:46 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:25.415 18:51:46 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:25.415 18:51:46 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:25.415 18:51:46 -- setup/common.sh@28 -- # mapfile -t mem 00:03:25.415 18:51:46 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.415 18:51:46 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 46761488 kB' 'MemAvailable: 50375480 kB' 'Buffers: 11580 kB' 'Cached: 9192656 kB' 'SwapCached: 0 kB' 'Active: 6172676 kB' 'Inactive: 3666172 kB' 'Active(anon): 5809860 kB' 'Inactive(anon): 0 kB' 'Active(file): 362816 kB' 'Inactive(file): 3666172 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 637860 kB' 'Mapped: 141804 kB' 'Shmem: 5175248 kB' 'KReclaimable: 157164 kB' 'Slab: 522516 kB' 'SReclaimable: 157164 kB' 'SUnreclaim: 365352 kB' 'KernelStack: 12704 kB' 'PageTables: 7408 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 7502992 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195188 kB' 'VmallocChunk: 0 kB' 'Percpu: 31488 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 427612 kB' 'DirectMap2M: 7880704 kB' 'DirectMap1G: 61865984 kB' 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.415 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.415 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.416 18:51:46 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:25.416 18:51:46 -- setup/common.sh@33 -- # echo 0 00:03:25.416 18:51:46 -- setup/common.sh@33 -- # return 0 00:03:25.416 18:51:46 -- setup/hugepages.sh@100 -- # resv=0 00:03:25.416 18:51:46 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:25.416 nr_hugepages=1024 00:03:25.416 18:51:46 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:25.416 resv_hugepages=0 00:03:25.416 18:51:46 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:25.416 surplus_hugepages=0 00:03:25.416 18:51:46 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:25.416 anon_hugepages=0 00:03:25.416 18:51:46 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:25.416 18:51:46 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:25.416 18:51:46 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:25.416 18:51:46 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:25.416 18:51:46 -- setup/common.sh@18 -- # local node= 00:03:25.416 18:51:46 -- setup/common.sh@19 -- # local var val 00:03:25.416 18:51:46 -- setup/common.sh@20 -- # local mem_f mem 00:03:25.416 18:51:46 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:25.416 18:51:46 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:25.416 18:51:46 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:25.416 18:51:46 -- setup/common.sh@28 -- # mapfile -t mem 00:03:25.416 18:51:46 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.416 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.417 18:51:46 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 46760928 kB' 'MemAvailable: 50374920 kB' 'Buffers: 11580 kB' 'Cached: 9192684 kB' 'SwapCached: 0 kB' 'Active: 6172508 kB' 'Inactive: 3666172 kB' 'Active(anon): 5809692 kB' 'Inactive(anon): 0 kB' 'Active(file): 362816 kB' 'Inactive(file): 3666172 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 637672 kB' 'Mapped: 141724 kB' 'Shmem: 5175276 kB' 'KReclaimable: 157164 kB' 'Slab: 522552 kB' 'SReclaimable: 157164 kB' 'SUnreclaim: 365388 kB' 'KernelStack: 12720 kB' 'PageTables: 7436 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 7503008 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195172 kB' 'VmallocChunk: 0 kB' 'Percpu: 31488 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 427612 kB' 'DirectMap2M: 7880704 kB' 'DirectMap1G: 61865984 kB' 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.417 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.417 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:25.418 18:51:46 -- setup/common.sh@33 -- # echo 1024 00:03:25.418 18:51:46 -- setup/common.sh@33 -- # return 0 00:03:25.418 18:51:46 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:25.418 18:51:46 -- setup/hugepages.sh@112 -- # get_nodes 00:03:25.418 18:51:46 -- setup/hugepages.sh@27 -- # local node 00:03:25.418 18:51:46 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:25.418 18:51:46 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:25.418 18:51:46 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:25.418 18:51:46 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:25.418 18:51:46 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:25.418 18:51:46 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:25.418 18:51:46 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:25.418 18:51:46 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:25.418 18:51:46 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:25.418 18:51:46 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:25.418 18:51:46 -- setup/common.sh@18 -- # local node=0 00:03:25.418 18:51:46 -- setup/common.sh@19 -- # local var val 00:03:25.418 18:51:46 -- setup/common.sh@20 -- # local mem_f mem 00:03:25.418 18:51:46 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:25.418 18:51:46 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:25.418 18:51:46 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:25.418 18:51:46 -- setup/common.sh@28 -- # mapfile -t mem 00:03:25.418 18:51:46 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.418 18:51:46 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 29817488 kB' 'MemUsed: 3008368 kB' 'SwapCached: 0 kB' 'Active: 1084416 kB' 'Inactive: 138596 kB' 'Active(anon): 943340 kB' 'Inactive(anon): 0 kB' 'Active(file): 141076 kB' 'Inactive(file): 138596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 936372 kB' 'Mapped: 49676 kB' 'AnonPages: 289884 kB' 'Shmem: 656700 kB' 'KernelStack: 7144 kB' 'PageTables: 4360 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 41368 kB' 'Slab: 243572 kB' 'SReclaimable: 41368 kB' 'SUnreclaim: 202204 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.418 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.418 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.419 18:51:46 -- setup/common.sh@33 -- # echo 0 00:03:25.419 18:51:46 -- setup/common.sh@33 -- # return 0 00:03:25.419 18:51:46 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:25.419 18:51:46 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:25.419 18:51:46 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:25.419 18:51:46 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:25.419 18:51:46 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:25.419 18:51:46 -- setup/common.sh@18 -- # local node=1 00:03:25.419 18:51:46 -- setup/common.sh@19 -- # local var val 00:03:25.419 18:51:46 -- setup/common.sh@20 -- # local mem_f mem 00:03:25.419 18:51:46 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:25.419 18:51:46 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:25.419 18:51:46 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:25.419 18:51:46 -- setup/common.sh@28 -- # mapfile -t mem 00:03:25.419 18:51:46 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.419 18:51:46 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709808 kB' 'MemFree: 16943784 kB' 'MemUsed: 10766024 kB' 'SwapCached: 0 kB' 'Active: 5087980 kB' 'Inactive: 3527576 kB' 'Active(anon): 4866240 kB' 'Inactive(anon): 0 kB' 'Active(file): 221740 kB' 'Inactive(file): 3527576 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8267908 kB' 'Mapped: 92048 kB' 'AnonPages: 347676 kB' 'Shmem: 4518592 kB' 'KernelStack: 5576 kB' 'PageTables: 3076 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 115796 kB' 'Slab: 278972 kB' 'SReclaimable: 115796 kB' 'SUnreclaim: 163176 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.419 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.419 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # continue 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # IFS=': ' 00:03:25.420 18:51:46 -- setup/common.sh@31 -- # read -r var val _ 00:03:25.420 18:51:46 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:25.420 18:51:46 -- setup/common.sh@33 -- # echo 0 00:03:25.420 18:51:46 -- setup/common.sh@33 -- # return 0 00:03:25.420 18:51:46 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:25.420 18:51:46 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:25.420 18:51:46 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:25.420 18:51:46 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:25.420 18:51:46 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:25.420 node0=512 expecting 512 00:03:25.420 18:51:46 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:25.420 18:51:46 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:25.420 18:51:46 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:25.420 18:51:46 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:25.420 node1=512 expecting 512 00:03:25.420 18:51:46 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:25.420 00:03:25.420 real 0m1.599s 00:03:25.420 user 0m0.633s 00:03:25.420 sys 0m0.934s 00:03:25.420 18:51:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:25.420 18:51:46 -- common/autotest_common.sh@10 -- # set +x 00:03:25.420 ************************************ 00:03:25.420 END TEST per_node_1G_alloc 00:03:25.420 ************************************ 00:03:25.420 18:51:46 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:03:25.420 18:51:46 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:25.420 18:51:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:25.420 18:51:46 -- common/autotest_common.sh@10 -- # set +x 00:03:25.420 ************************************ 00:03:25.420 START TEST even_2G_alloc 00:03:25.420 ************************************ 00:03:25.420 18:51:46 -- common/autotest_common.sh@1114 -- # even_2G_alloc 00:03:25.420 18:51:46 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:03:25.420 18:51:46 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:25.420 18:51:46 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:25.420 18:51:46 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:25.420 18:51:46 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:25.420 18:51:46 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:25.420 18:51:46 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:25.420 18:51:46 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:25.420 18:51:46 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:25.420 18:51:46 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:25.420 18:51:46 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:25.420 18:51:46 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:25.420 18:51:46 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:25.420 18:51:46 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:25.420 18:51:46 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:25.420 18:51:46 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:25.420 18:51:46 -- setup/hugepages.sh@83 -- # : 512 00:03:25.420 18:51:46 -- setup/hugepages.sh@84 -- # : 1 00:03:25.420 18:51:46 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:25.420 18:51:46 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:25.420 18:51:46 -- setup/hugepages.sh@83 -- # : 0 00:03:25.420 18:51:46 -- setup/hugepages.sh@84 -- # : 0 00:03:25.420 18:51:46 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:25.420 18:51:46 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:03:25.420 18:51:46 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:03:25.420 18:51:46 -- setup/hugepages.sh@153 -- # setup output 00:03:25.420 18:51:46 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:25.420 18:51:46 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:26.804 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:26.804 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:26.804 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:26.804 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:26.804 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:26.804 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:26.805 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:26.805 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:26.805 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:26.805 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:26.805 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:26.805 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:26.805 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:26.805 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:26.805 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:26.805 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:26.805 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:26.805 18:51:47 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:03:26.805 18:51:47 -- setup/hugepages.sh@89 -- # local node 00:03:26.805 18:51:47 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:26.805 18:51:47 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:26.805 18:51:47 -- setup/hugepages.sh@92 -- # local surp 00:03:26.805 18:51:47 -- setup/hugepages.sh@93 -- # local resv 00:03:26.805 18:51:47 -- setup/hugepages.sh@94 -- # local anon 00:03:26.805 18:51:47 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:26.805 18:51:47 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:26.805 18:51:47 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:26.805 18:51:47 -- setup/common.sh@18 -- # local node= 00:03:26.805 18:51:47 -- setup/common.sh@19 -- # local var val 00:03:26.805 18:51:47 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.805 18:51:47 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.805 18:51:47 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.805 18:51:47 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.805 18:51:47 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.805 18:51:47 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.805 18:51:47 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 46772308 kB' 'MemAvailable: 50386272 kB' 'Buffers: 11580 kB' 'Cached: 9192752 kB' 'SwapCached: 0 kB' 'Active: 6174260 kB' 'Inactive: 3666172 kB' 'Active(anon): 5811444 kB' 'Inactive(anon): 0 kB' 'Active(file): 362816 kB' 'Inactive(file): 3666172 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 639408 kB' 'Mapped: 141784 kB' 'Shmem: 5175344 kB' 'KReclaimable: 157108 kB' 'Slab: 522724 kB' 'SReclaimable: 157108 kB' 'SUnreclaim: 365616 kB' 'KernelStack: 12720 kB' 'PageTables: 7496 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 7503336 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195156 kB' 'VmallocChunk: 0 kB' 'Percpu: 31488 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 427612 kB' 'DirectMap2M: 7880704 kB' 'DirectMap1G: 61865984 kB' 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.805 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.805 18:51:47 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.806 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.806 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.806 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.806 18:51:47 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.806 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.806 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.806 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.806 18:51:47 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.806 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.806 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.806 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.806 18:51:47 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.806 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.806 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.806 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.806 18:51:47 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.806 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.806 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.806 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.806 18:51:47 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.806 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.806 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.806 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.806 18:51:47 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.806 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.806 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.806 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.806 18:51:47 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.806 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.806 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.806 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.806 18:51:47 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.806 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.806 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.806 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.806 18:51:47 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.806 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.806 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.806 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.806 18:51:47 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.806 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.806 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.806 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.806 18:51:47 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.806 18:51:47 -- setup/common.sh@32 -- # continue 00:03:26.806 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.806 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.069 18:51:47 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.069 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.069 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.069 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.069 18:51:47 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:27.069 18:51:47 -- setup/common.sh@33 -- # echo 0 00:03:27.069 18:51:47 -- setup/common.sh@33 -- # return 0 00:03:27.069 18:51:47 -- setup/hugepages.sh@97 -- # anon=0 00:03:27.069 18:51:47 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:27.069 18:51:47 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:27.069 18:51:47 -- setup/common.sh@18 -- # local node= 00:03:27.069 18:51:47 -- setup/common.sh@19 -- # local var val 00:03:27.069 18:51:47 -- setup/common.sh@20 -- # local mem_f mem 00:03:27.069 18:51:47 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:27.069 18:51:47 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:27.069 18:51:47 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:27.069 18:51:47 -- setup/common.sh@28 -- # mapfile -t mem 00:03:27.069 18:51:47 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:27.069 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.069 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.069 18:51:47 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 46773456 kB' 'MemAvailable: 50387420 kB' 'Buffers: 11580 kB' 'Cached: 9192756 kB' 'SwapCached: 0 kB' 'Active: 6175068 kB' 'Inactive: 3666172 kB' 'Active(anon): 5812252 kB' 'Inactive(anon): 0 kB' 'Active(file): 362816 kB' 'Inactive(file): 3666172 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 640304 kB' 'Mapped: 141860 kB' 'Shmem: 5175348 kB' 'KReclaimable: 157108 kB' 'Slab: 522784 kB' 'SReclaimable: 157108 kB' 'SUnreclaim: 365676 kB' 'KernelStack: 12720 kB' 'PageTables: 7492 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 7503348 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195108 kB' 'VmallocChunk: 0 kB' 'Percpu: 31488 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 427612 kB' 'DirectMap2M: 7880704 kB' 'DirectMap1G: 61865984 kB' 00:03:27.069 18:51:47 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.069 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.069 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.069 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.069 18:51:47 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.069 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.069 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.069 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.069 18:51:47 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.069 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.069 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.069 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.069 18:51:47 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.069 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.069 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.069 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.069 18:51:47 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.069 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.069 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.069 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.069 18:51:47 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.069 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.069 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.069 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.069 18:51:47 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.069 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.069 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.069 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.069 18:51:47 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.069 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.069 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.069 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.069 18:51:47 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.070 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.070 18:51:47 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.071 18:51:47 -- setup/common.sh@33 -- # echo 0 00:03:27.071 18:51:47 -- setup/common.sh@33 -- # return 0 00:03:27.071 18:51:47 -- setup/hugepages.sh@99 -- # surp=0 00:03:27.071 18:51:47 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:27.071 18:51:47 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:27.071 18:51:47 -- setup/common.sh@18 -- # local node= 00:03:27.071 18:51:47 -- setup/common.sh@19 -- # local var val 00:03:27.071 18:51:47 -- setup/common.sh@20 -- # local mem_f mem 00:03:27.071 18:51:47 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:27.071 18:51:47 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:27.071 18:51:47 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:27.071 18:51:47 -- setup/common.sh@28 -- # mapfile -t mem 00:03:27.071 18:51:47 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.071 18:51:47 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 46772780 kB' 'MemAvailable: 50386744 kB' 'Buffers: 11580 kB' 'Cached: 9192756 kB' 'SwapCached: 0 kB' 'Active: 6174784 kB' 'Inactive: 3666172 kB' 'Active(anon): 5811968 kB' 'Inactive(anon): 0 kB' 'Active(file): 362816 kB' 'Inactive(file): 3666172 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 640028 kB' 'Mapped: 141732 kB' 'Shmem: 5175348 kB' 'KReclaimable: 157108 kB' 'Slab: 522760 kB' 'SReclaimable: 157108 kB' 'SUnreclaim: 365652 kB' 'KernelStack: 12752 kB' 'PageTables: 7504 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 7503364 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195108 kB' 'VmallocChunk: 0 kB' 'Percpu: 31488 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 427612 kB' 'DirectMap2M: 7880704 kB' 'DirectMap1G: 61865984 kB' 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.071 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.071 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:27.072 18:51:47 -- setup/common.sh@33 -- # echo 0 00:03:27.072 18:51:47 -- setup/common.sh@33 -- # return 0 00:03:27.072 18:51:47 -- setup/hugepages.sh@100 -- # resv=0 00:03:27.072 18:51:47 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:27.072 nr_hugepages=1024 00:03:27.072 18:51:47 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:27.072 resv_hugepages=0 00:03:27.072 18:51:47 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:27.072 surplus_hugepages=0 00:03:27.072 18:51:47 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:27.072 anon_hugepages=0 00:03:27.072 18:51:47 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:27.072 18:51:47 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:27.072 18:51:47 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:27.072 18:51:47 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:27.072 18:51:47 -- setup/common.sh@18 -- # local node= 00:03:27.072 18:51:47 -- setup/common.sh@19 -- # local var val 00:03:27.072 18:51:47 -- setup/common.sh@20 -- # local mem_f mem 00:03:27.072 18:51:47 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:27.072 18:51:47 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:27.072 18:51:47 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:27.072 18:51:47 -- setup/common.sh@28 -- # mapfile -t mem 00:03:27.072 18:51:47 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.072 18:51:47 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 46773068 kB' 'MemAvailable: 50387032 kB' 'Buffers: 11580 kB' 'Cached: 9192780 kB' 'SwapCached: 0 kB' 'Active: 6175376 kB' 'Inactive: 3666172 kB' 'Active(anon): 5812560 kB' 'Inactive(anon): 0 kB' 'Active(file): 362816 kB' 'Inactive(file): 3666172 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 640604 kB' 'Mapped: 141728 kB' 'Shmem: 5175372 kB' 'KReclaimable: 157108 kB' 'Slab: 522760 kB' 'SReclaimable: 157108 kB' 'SUnreclaim: 365652 kB' 'KernelStack: 12736 kB' 'PageTables: 7472 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 7506028 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195188 kB' 'VmallocChunk: 0 kB' 'Percpu: 31488 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 427612 kB' 'DirectMap2M: 7880704 kB' 'DirectMap1G: 61865984 kB' 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.072 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.072 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.073 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.073 18:51:47 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:27.073 18:51:47 -- setup/common.sh@33 -- # echo 1024 00:03:27.073 18:51:47 -- setup/common.sh@33 -- # return 0 00:03:27.073 18:51:47 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:27.073 18:51:47 -- setup/hugepages.sh@112 -- # get_nodes 00:03:27.073 18:51:47 -- setup/hugepages.sh@27 -- # local node 00:03:27.073 18:51:47 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:27.073 18:51:47 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:27.073 18:51:47 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:27.073 18:51:47 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:27.073 18:51:47 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:27.073 18:51:47 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:27.073 18:51:47 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:27.073 18:51:47 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:27.074 18:51:47 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:27.074 18:51:47 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:27.074 18:51:47 -- setup/common.sh@18 -- # local node=0 00:03:27.074 18:51:47 -- setup/common.sh@19 -- # local var val 00:03:27.074 18:51:47 -- setup/common.sh@20 -- # local mem_f mem 00:03:27.074 18:51:47 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:27.074 18:51:47 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:27.074 18:51:47 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:27.074 18:51:47 -- setup/common.sh@28 -- # mapfile -t mem 00:03:27.074 18:51:47 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.074 18:51:47 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 29817388 kB' 'MemUsed: 3008468 kB' 'SwapCached: 0 kB' 'Active: 1087404 kB' 'Inactive: 138596 kB' 'Active(anon): 946328 kB' 'Inactive(anon): 0 kB' 'Active(file): 141076 kB' 'Inactive(file): 138596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 936416 kB' 'Mapped: 49676 kB' 'AnonPages: 292876 kB' 'Shmem: 656744 kB' 'KernelStack: 7384 kB' 'PageTables: 4948 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 41336 kB' 'Slab: 243708 kB' 'SReclaimable: 41336 kB' 'SUnreclaim: 202372 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.074 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.074 18:51:47 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.075 18:51:47 -- setup/common.sh@33 -- # echo 0 00:03:27.075 18:51:47 -- setup/common.sh@33 -- # return 0 00:03:27.075 18:51:47 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:27.075 18:51:47 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:27.075 18:51:47 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:27.075 18:51:47 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:27.075 18:51:47 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:27.075 18:51:47 -- setup/common.sh@18 -- # local node=1 00:03:27.075 18:51:47 -- setup/common.sh@19 -- # local var val 00:03:27.075 18:51:47 -- setup/common.sh@20 -- # local mem_f mem 00:03:27.075 18:51:47 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:27.075 18:51:47 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:27.075 18:51:47 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:27.075 18:51:47 -- setup/common.sh@28 -- # mapfile -t mem 00:03:27.075 18:51:47 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.075 18:51:47 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709808 kB' 'MemFree: 16954508 kB' 'MemUsed: 10755300 kB' 'SwapCached: 0 kB' 'Active: 5088244 kB' 'Inactive: 3527576 kB' 'Active(anon): 4866504 kB' 'Inactive(anon): 0 kB' 'Active(file): 221740 kB' 'Inactive(file): 3527576 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8267960 kB' 'Mapped: 92052 kB' 'AnonPages: 348008 kB' 'Shmem: 4518644 kB' 'KernelStack: 5608 kB' 'PageTables: 3180 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 115772 kB' 'Slab: 279052 kB' 'SReclaimable: 115772 kB' 'SUnreclaim: 163280 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.075 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.075 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.076 18:51:47 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.076 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.076 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.076 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.076 18:51:47 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.076 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.076 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.076 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.076 18:51:47 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.076 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.076 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.076 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.076 18:51:47 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.076 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.076 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.076 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.076 18:51:47 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.076 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.076 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.076 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.076 18:51:47 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.076 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.076 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.076 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.076 18:51:47 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.076 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.076 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.076 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.076 18:51:47 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.076 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.076 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.076 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.076 18:51:47 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.076 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.076 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.076 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.076 18:51:47 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.076 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.076 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.076 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.076 18:51:47 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.076 18:51:47 -- setup/common.sh@32 -- # continue 00:03:27.076 18:51:47 -- setup/common.sh@31 -- # IFS=': ' 00:03:27.076 18:51:47 -- setup/common.sh@31 -- # read -r var val _ 00:03:27.076 18:51:47 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:27.076 18:51:47 -- setup/common.sh@33 -- # echo 0 00:03:27.076 18:51:47 -- setup/common.sh@33 -- # return 0 00:03:27.076 18:51:47 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:27.076 18:51:47 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:27.076 18:51:47 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:27.076 18:51:47 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:27.076 18:51:47 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:27.076 node0=512 expecting 512 00:03:27.076 18:51:47 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:27.076 18:51:47 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:27.076 18:51:47 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:27.076 18:51:47 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:27.076 node1=512 expecting 512 00:03:27.076 18:51:47 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:27.076 00:03:27.076 real 0m1.574s 00:03:27.076 user 0m0.627s 00:03:27.076 sys 0m0.916s 00:03:27.076 18:51:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:27.076 18:51:47 -- common/autotest_common.sh@10 -- # set +x 00:03:27.076 ************************************ 00:03:27.076 END TEST even_2G_alloc 00:03:27.076 ************************************ 00:03:27.076 18:51:47 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:03:27.076 18:51:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:27.076 18:51:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:27.076 18:51:47 -- common/autotest_common.sh@10 -- # set +x 00:03:27.076 ************************************ 00:03:27.076 START TEST odd_alloc 00:03:27.076 ************************************ 00:03:27.076 18:51:48 -- common/autotest_common.sh@1114 -- # odd_alloc 00:03:27.076 18:51:48 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:03:27.076 18:51:48 -- setup/hugepages.sh@49 -- # local size=2098176 00:03:27.076 18:51:48 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:27.076 18:51:48 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:27.076 18:51:48 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:03:27.076 18:51:48 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:27.076 18:51:48 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:27.076 18:51:48 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:27.076 18:51:48 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:03:27.076 18:51:48 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:27.076 18:51:48 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:27.076 18:51:48 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:27.076 18:51:48 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:27.076 18:51:48 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:27.076 18:51:48 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:27.076 18:51:48 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:27.076 18:51:48 -- setup/hugepages.sh@83 -- # : 513 00:03:27.076 18:51:48 -- setup/hugepages.sh@84 -- # : 1 00:03:27.076 18:51:48 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:27.076 18:51:48 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:03:27.076 18:51:48 -- setup/hugepages.sh@83 -- # : 0 00:03:27.076 18:51:48 -- setup/hugepages.sh@84 -- # : 0 00:03:27.076 18:51:48 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:27.076 18:51:48 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:03:27.076 18:51:48 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:03:27.076 18:51:48 -- setup/hugepages.sh@160 -- # setup output 00:03:27.076 18:51:48 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:27.076 18:51:48 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:28.016 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:28.016 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:28.016 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:28.016 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:28.016 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:28.016 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:28.016 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:28.016 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:28.016 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:28.016 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:28.280 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:28.280 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:28.280 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:28.280 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:28.280 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:28.280 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:28.280 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:28.280 18:51:49 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:03:28.280 18:51:49 -- setup/hugepages.sh@89 -- # local node 00:03:28.280 18:51:49 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:28.280 18:51:49 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:28.280 18:51:49 -- setup/hugepages.sh@92 -- # local surp 00:03:28.280 18:51:49 -- setup/hugepages.sh@93 -- # local resv 00:03:28.280 18:51:49 -- setup/hugepages.sh@94 -- # local anon 00:03:28.280 18:51:49 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:28.280 18:51:49 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:28.280 18:51:49 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:28.280 18:51:49 -- setup/common.sh@18 -- # local node= 00:03:28.280 18:51:49 -- setup/common.sh@19 -- # local var val 00:03:28.280 18:51:49 -- setup/common.sh@20 -- # local mem_f mem 00:03:28.280 18:51:49 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:28.280 18:51:49 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:28.280 18:51:49 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:28.280 18:51:49 -- setup/common.sh@28 -- # mapfile -t mem 00:03:28.280 18:51:49 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:28.280 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.280 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.280 18:51:49 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 46779104 kB' 'MemAvailable: 50393028 kB' 'Buffers: 11580 kB' 'Cached: 9192840 kB' 'SwapCached: 0 kB' 'Active: 6179756 kB' 'Inactive: 3666172 kB' 'Active(anon): 5816940 kB' 'Inactive(anon): 0 kB' 'Active(file): 362816 kB' 'Inactive(file): 3666172 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 644372 kB' 'Mapped: 141596 kB' 'Shmem: 5175432 kB' 'KReclaimable: 157028 kB' 'Slab: 522504 kB' 'SReclaimable: 157028 kB' 'SUnreclaim: 365476 kB' 'KernelStack: 12688 kB' 'PageTables: 7224 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 7494220 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195112 kB' 'VmallocChunk: 0 kB' 'Percpu: 31488 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 427612 kB' 'DirectMap2M: 7880704 kB' 'DirectMap1G: 61865984 kB' 00:03:28.280 18:51:49 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.280 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.280 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.280 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.280 18:51:49 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.280 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.280 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.280 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.280 18:51:49 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.280 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.280 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.280 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.280 18:51:49 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.280 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.280 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.280 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.280 18:51:49 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.280 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.280 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.280 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.280 18:51:49 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.280 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.280 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.280 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.280 18:51:49 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.280 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.280 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.280 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.280 18:51:49 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.280 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.280 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.280 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.280 18:51:49 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.280 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.280 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.280 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.280 18:51:49 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.280 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.280 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.280 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.280 18:51:49 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.280 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.280 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.280 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.280 18:51:49 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.280 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.280 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.280 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.280 18:51:49 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.280 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.280 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.280 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.280 18:51:49 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.280 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.280 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.280 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.280 18:51:49 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.280 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.280 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.280 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.280 18:51:49 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.280 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.280 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.280 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.280 18:51:49 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.280 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.280 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:28.281 18:51:49 -- setup/common.sh@33 -- # echo 0 00:03:28.281 18:51:49 -- setup/common.sh@33 -- # return 0 00:03:28.281 18:51:49 -- setup/hugepages.sh@97 -- # anon=0 00:03:28.281 18:51:49 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:28.281 18:51:49 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:28.281 18:51:49 -- setup/common.sh@18 -- # local node= 00:03:28.281 18:51:49 -- setup/common.sh@19 -- # local var val 00:03:28.281 18:51:49 -- setup/common.sh@20 -- # local mem_f mem 00:03:28.281 18:51:49 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:28.281 18:51:49 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:28.281 18:51:49 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:28.281 18:51:49 -- setup/common.sh@28 -- # mapfile -t mem 00:03:28.281 18:51:49 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.281 18:51:49 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 46777524 kB' 'MemAvailable: 50391448 kB' 'Buffers: 11580 kB' 'Cached: 9192844 kB' 'SwapCached: 0 kB' 'Active: 6176256 kB' 'Inactive: 3666172 kB' 'Active(anon): 5813440 kB' 'Inactive(anon): 0 kB' 'Active(file): 362816 kB' 'Inactive(file): 3666172 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 641320 kB' 'Mapped: 141672 kB' 'Shmem: 5175436 kB' 'KReclaimable: 157028 kB' 'Slab: 522632 kB' 'SReclaimable: 157028 kB' 'SUnreclaim: 365604 kB' 'KernelStack: 12672 kB' 'PageTables: 7144 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 7490788 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195108 kB' 'VmallocChunk: 0 kB' 'Percpu: 31488 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 427612 kB' 'DirectMap2M: 7880704 kB' 'DirectMap1G: 61865984 kB' 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.281 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.281 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.282 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.282 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.283 18:51:49 -- setup/common.sh@33 -- # echo 0 00:03:28.283 18:51:49 -- setup/common.sh@33 -- # return 0 00:03:28.283 18:51:49 -- setup/hugepages.sh@99 -- # surp=0 00:03:28.283 18:51:49 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:28.283 18:51:49 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:28.283 18:51:49 -- setup/common.sh@18 -- # local node= 00:03:28.283 18:51:49 -- setup/common.sh@19 -- # local var val 00:03:28.283 18:51:49 -- setup/common.sh@20 -- # local mem_f mem 00:03:28.283 18:51:49 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:28.283 18:51:49 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:28.283 18:51:49 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:28.283 18:51:49 -- setup/common.sh@28 -- # mapfile -t mem 00:03:28.283 18:51:49 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.283 18:51:49 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 46771952 kB' 'MemAvailable: 50385876 kB' 'Buffers: 11580 kB' 'Cached: 9192856 kB' 'SwapCached: 0 kB' 'Active: 6178904 kB' 'Inactive: 3666172 kB' 'Active(anon): 5816088 kB' 'Inactive(anon): 0 kB' 'Active(file): 362816 kB' 'Inactive(file): 3666172 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 643928 kB' 'Mapped: 141116 kB' 'Shmem: 5175448 kB' 'KReclaimable: 157028 kB' 'Slab: 522656 kB' 'SReclaimable: 157028 kB' 'SUnreclaim: 365628 kB' 'KernelStack: 12688 kB' 'PageTables: 7148 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 7494248 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195096 kB' 'VmallocChunk: 0 kB' 'Percpu: 31488 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 427612 kB' 'DirectMap2M: 7880704 kB' 'DirectMap1G: 61865984 kB' 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.283 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.283 18:51:49 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:28.284 18:51:49 -- setup/common.sh@33 -- # echo 0 00:03:28.284 18:51:49 -- setup/common.sh@33 -- # return 0 00:03:28.284 18:51:49 -- setup/hugepages.sh@100 -- # resv=0 00:03:28.284 18:51:49 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:03:28.284 nr_hugepages=1025 00:03:28.284 18:51:49 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:28.284 resv_hugepages=0 00:03:28.284 18:51:49 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:28.284 surplus_hugepages=0 00:03:28.284 18:51:49 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:28.284 anon_hugepages=0 00:03:28.284 18:51:49 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:28.284 18:51:49 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:03:28.284 18:51:49 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:28.284 18:51:49 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:28.284 18:51:49 -- setup/common.sh@18 -- # local node= 00:03:28.284 18:51:49 -- setup/common.sh@19 -- # local var val 00:03:28.284 18:51:49 -- setup/common.sh@20 -- # local mem_f mem 00:03:28.284 18:51:49 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:28.284 18:51:49 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:28.284 18:51:49 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:28.284 18:51:49 -- setup/common.sh@28 -- # mapfile -t mem 00:03:28.284 18:51:49 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.284 18:51:49 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 46772204 kB' 'MemAvailable: 50386128 kB' 'Buffers: 11580 kB' 'Cached: 9192868 kB' 'SwapCached: 0 kB' 'Active: 6173584 kB' 'Inactive: 3666172 kB' 'Active(anon): 5810768 kB' 'Inactive(anon): 0 kB' 'Active(file): 362816 kB' 'Inactive(file): 3666172 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 638608 kB' 'Mapped: 141096 kB' 'Shmem: 5175460 kB' 'KReclaimable: 157028 kB' 'Slab: 522656 kB' 'SReclaimable: 157028 kB' 'SUnreclaim: 365628 kB' 'KernelStack: 12672 kB' 'PageTables: 7132 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606836 kB' 'Committed_AS: 7488144 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195108 kB' 'VmallocChunk: 0 kB' 'Percpu: 31488 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 427612 kB' 'DirectMap2M: 7880704 kB' 'DirectMap1G: 61865984 kB' 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.284 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.284 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.285 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.285 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.547 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.547 18:51:49 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.547 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.547 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.547 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.547 18:51:49 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.547 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.547 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.547 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.547 18:51:49 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.547 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.547 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.547 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.547 18:51:49 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.547 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.547 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.547 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.547 18:51:49 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.547 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.547 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.547 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.547 18:51:49 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.547 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.547 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.547 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.547 18:51:49 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.547 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.547 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.547 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.547 18:51:49 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.547 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.547 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.547 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.547 18:51:49 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:28.547 18:51:49 -- setup/common.sh@33 -- # echo 1025 00:03:28.547 18:51:49 -- setup/common.sh@33 -- # return 0 00:03:28.547 18:51:49 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:28.547 18:51:49 -- setup/hugepages.sh@112 -- # get_nodes 00:03:28.547 18:51:49 -- setup/hugepages.sh@27 -- # local node 00:03:28.547 18:51:49 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:28.547 18:51:49 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:28.547 18:51:49 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:28.547 18:51:49 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:03:28.547 18:51:49 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:28.547 18:51:49 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:28.547 18:51:49 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:28.547 18:51:49 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:28.547 18:51:49 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:28.547 18:51:49 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:28.547 18:51:49 -- setup/common.sh@18 -- # local node=0 00:03:28.547 18:51:49 -- setup/common.sh@19 -- # local var val 00:03:28.547 18:51:49 -- setup/common.sh@20 -- # local mem_f mem 00:03:28.547 18:51:49 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:28.547 18:51:49 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:28.547 18:51:49 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:28.547 18:51:49 -- setup/common.sh@28 -- # mapfile -t mem 00:03:28.547 18:51:49 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:28.547 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.547 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.547 18:51:49 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 29808516 kB' 'MemUsed: 3017340 kB' 'SwapCached: 0 kB' 'Active: 1085800 kB' 'Inactive: 138596 kB' 'Active(anon): 944724 kB' 'Inactive(anon): 0 kB' 'Active(file): 141076 kB' 'Inactive(file): 138596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 936428 kB' 'Mapped: 49280 kB' 'AnonPages: 291220 kB' 'Shmem: 656756 kB' 'KernelStack: 7064 kB' 'PageTables: 3980 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 41264 kB' 'Slab: 243440 kB' 'SReclaimable: 41264 kB' 'SUnreclaim: 202176 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:28.547 18:51:49 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.547 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.547 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.547 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.547 18:51:49 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.547 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.547 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.547 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.547 18:51:49 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.547 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.547 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.547 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.547 18:51:49 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.547 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.547 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.548 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.548 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.549 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.549 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.549 18:51:49 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.549 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.549 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.549 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.549 18:51:49 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.549 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.549 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.549 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.549 18:51:49 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.549 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.549 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.549 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.549 18:51:49 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.549 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.549 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.549 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.549 18:51:49 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.549 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.549 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.549 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.549 18:51:49 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.549 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.549 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.549 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.549 18:51:49 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.549 18:51:49 -- setup/common.sh@33 -- # echo 0 00:03:28.549 18:51:49 -- setup/common.sh@33 -- # return 0 00:03:28.549 18:51:49 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:28.549 18:51:49 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:28.549 18:51:49 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:28.549 18:51:49 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:28.549 18:51:49 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:28.549 18:51:49 -- setup/common.sh@18 -- # local node=1 00:03:28.549 18:51:49 -- setup/common.sh@19 -- # local var val 00:03:28.549 18:51:49 -- setup/common.sh@20 -- # local mem_f mem 00:03:28.549 18:51:49 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:28.549 18:51:49 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:28.549 18:51:49 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:28.549 18:51:49 -- setup/common.sh@28 -- # mapfile -t mem 00:03:28.549 18:51:49 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:28.549 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.549 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.549 18:51:49 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709808 kB' 'MemFree: 16964540 kB' 'MemUsed: 10745268 kB' 'SwapCached: 0 kB' 'Active: 5088576 kB' 'Inactive: 3527576 kB' 'Active(anon): 4866836 kB' 'Inactive(anon): 0 kB' 'Active(file): 221740 kB' 'Inactive(file): 3527576 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8268052 kB' 'Mapped: 91400 kB' 'AnonPages: 348248 kB' 'Shmem: 4518736 kB' 'KernelStack: 5640 kB' 'PageTables: 3224 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 115764 kB' 'Slab: 279208 kB' 'SReclaimable: 115764 kB' 'SUnreclaim: 163444 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:03:28.549 18:51:49 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.549 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.549 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.549 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.549 18:51:49 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.549 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.549 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.549 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.549 18:51:49 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.549 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.549 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.549 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.549 18:51:49 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.549 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.549 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.549 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.549 18:51:49 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.549 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.549 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.549 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.549 18:51:49 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.549 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.549 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.549 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.549 18:51:49 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.549 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.549 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.549 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.549 18:51:49 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.549 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.549 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.549 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.549 18:51:49 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.549 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.549 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.549 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.549 18:51:49 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.549 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.549 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.549 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.549 18:51:49 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.549 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.549 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # continue 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # IFS=': ' 00:03:28.550 18:51:49 -- setup/common.sh@31 -- # read -r var val _ 00:03:28.550 18:51:49 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:28.551 18:51:49 -- setup/common.sh@33 -- # echo 0 00:03:28.551 18:51:49 -- setup/common.sh@33 -- # return 0 00:03:28.551 18:51:49 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:28.551 18:51:49 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:28.551 18:51:49 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:28.551 18:51:49 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:28.551 18:51:49 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:03:28.551 node0=512 expecting 513 00:03:28.551 18:51:49 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:28.551 18:51:49 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:28.551 18:51:49 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:28.551 18:51:49 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:03:28.551 node1=513 expecting 512 00:03:28.551 18:51:49 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:03:28.551 00:03:28.551 real 0m1.374s 00:03:28.551 user 0m0.575s 00:03:28.551 sys 0m0.762s 00:03:28.551 18:51:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:28.551 18:51:49 -- common/autotest_common.sh@10 -- # set +x 00:03:28.551 ************************************ 00:03:28.551 END TEST odd_alloc 00:03:28.551 ************************************ 00:03:28.551 18:51:49 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:03:28.551 18:51:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:28.551 18:51:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:28.551 18:51:49 -- common/autotest_common.sh@10 -- # set +x 00:03:28.551 ************************************ 00:03:28.551 START TEST custom_alloc 00:03:28.551 ************************************ 00:03:28.551 18:51:49 -- common/autotest_common.sh@1114 -- # custom_alloc 00:03:28.551 18:51:49 -- setup/hugepages.sh@167 -- # local IFS=, 00:03:28.551 18:51:49 -- setup/hugepages.sh@169 -- # local node 00:03:28.551 18:51:49 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:03:28.551 18:51:49 -- setup/hugepages.sh@170 -- # local nodes_hp 00:03:28.551 18:51:49 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:03:28.551 18:51:49 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:03:28.551 18:51:49 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:28.551 18:51:49 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:28.551 18:51:49 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:28.551 18:51:49 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:28.551 18:51:49 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:28.551 18:51:49 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:28.551 18:51:49 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:28.551 18:51:49 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:28.551 18:51:49 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:28.551 18:51:49 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:28.551 18:51:49 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:28.551 18:51:49 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:28.551 18:51:49 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:28.551 18:51:49 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:28.551 18:51:49 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:28.551 18:51:49 -- setup/hugepages.sh@83 -- # : 256 00:03:28.551 18:51:49 -- setup/hugepages.sh@84 -- # : 1 00:03:28.551 18:51:49 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:28.551 18:51:49 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:28.551 18:51:49 -- setup/hugepages.sh@83 -- # : 0 00:03:28.551 18:51:49 -- setup/hugepages.sh@84 -- # : 0 00:03:28.551 18:51:49 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:28.551 18:51:49 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:03:28.551 18:51:49 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:03:28.551 18:51:49 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:03:28.551 18:51:49 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:28.551 18:51:49 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:28.551 18:51:49 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:28.551 18:51:49 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:28.551 18:51:49 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:28.551 18:51:49 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:28.551 18:51:49 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:28.551 18:51:49 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:28.551 18:51:49 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:28.551 18:51:49 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:28.551 18:51:49 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:28.551 18:51:49 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:28.551 18:51:49 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:03:28.551 18:51:49 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:28.551 18:51:49 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:28.551 18:51:49 -- setup/hugepages.sh@78 -- # return 0 00:03:28.551 18:51:49 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:03:28.551 18:51:49 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:28.551 18:51:49 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:28.551 18:51:49 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:28.551 18:51:49 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:28.551 18:51:49 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:28.551 18:51:49 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:28.551 18:51:49 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:03:28.551 18:51:49 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:28.551 18:51:49 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:28.551 18:51:49 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:28.551 18:51:49 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:28.551 18:51:49 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:28.551 18:51:49 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:28.551 18:51:49 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:28.551 18:51:49 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:03:28.551 18:51:49 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:28.551 18:51:49 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:28.551 18:51:49 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:28.551 18:51:49 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:03:28.551 18:51:49 -- setup/hugepages.sh@78 -- # return 0 00:03:28.551 18:51:49 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:03:28.551 18:51:49 -- setup/hugepages.sh@187 -- # setup output 00:03:28.551 18:51:49 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:28.551 18:51:49 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:29.938 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:29.938 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:29.938 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:29.938 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:29.938 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:29.938 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:29.938 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:29.938 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:29.938 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:29.938 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:29.938 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:29.938 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:29.938 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:29.938 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:29.938 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:29.938 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:29.938 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:29.938 18:51:50 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:03:29.938 18:51:50 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:03:29.938 18:51:50 -- setup/hugepages.sh@89 -- # local node 00:03:29.938 18:51:50 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:29.938 18:51:50 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:29.938 18:51:50 -- setup/hugepages.sh@92 -- # local surp 00:03:29.938 18:51:50 -- setup/hugepages.sh@93 -- # local resv 00:03:29.938 18:51:50 -- setup/hugepages.sh@94 -- # local anon 00:03:29.938 18:51:50 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:29.938 18:51:50 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:29.938 18:51:50 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:29.938 18:51:50 -- setup/common.sh@18 -- # local node= 00:03:29.938 18:51:50 -- setup/common.sh@19 -- # local var val 00:03:29.938 18:51:50 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.938 18:51:50 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.938 18:51:50 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.938 18:51:50 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.938 18:51:50 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.938 18:51:50 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.938 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.938 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45722216 kB' 'MemAvailable: 49336336 kB' 'Buffers: 11580 kB' 'Cached: 9192940 kB' 'SwapCached: 0 kB' 'Active: 6174252 kB' 'Inactive: 3666172 kB' 'Active(anon): 5811436 kB' 'Inactive(anon): 0 kB' 'Active(file): 362816 kB' 'Inactive(file): 3666172 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 639804 kB' 'Mapped: 140712 kB' 'Shmem: 5175532 kB' 'KReclaimable: 157420 kB' 'Slab: 522888 kB' 'SReclaimable: 157420 kB' 'SUnreclaim: 365468 kB' 'KernelStack: 12672 kB' 'PageTables: 7116 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 7487964 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195044 kB' 'VmallocChunk: 0 kB' 'Percpu: 31488 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 427612 kB' 'DirectMap2M: 7880704 kB' 'DirectMap1G: 61865984 kB' 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.939 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.939 18:51:50 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:29.940 18:51:50 -- setup/common.sh@33 -- # echo 0 00:03:29.940 18:51:50 -- setup/common.sh@33 -- # return 0 00:03:29.940 18:51:50 -- setup/hugepages.sh@97 -- # anon=0 00:03:29.940 18:51:50 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:29.940 18:51:50 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:29.940 18:51:50 -- setup/common.sh@18 -- # local node= 00:03:29.940 18:51:50 -- setup/common.sh@19 -- # local var val 00:03:29.940 18:51:50 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.940 18:51:50 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.940 18:51:50 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.940 18:51:50 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.940 18:51:50 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.940 18:51:50 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.940 18:51:50 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45722084 kB' 'MemAvailable: 49336204 kB' 'Buffers: 11580 kB' 'Cached: 9192944 kB' 'SwapCached: 0 kB' 'Active: 6174312 kB' 'Inactive: 3666172 kB' 'Active(anon): 5811496 kB' 'Inactive(anon): 0 kB' 'Active(file): 362816 kB' 'Inactive(file): 3666172 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 639408 kB' 'Mapped: 140696 kB' 'Shmem: 5175536 kB' 'KReclaimable: 157420 kB' 'Slab: 522956 kB' 'SReclaimable: 157420 kB' 'SUnreclaim: 365536 kB' 'KernelStack: 12624 kB' 'PageTables: 6956 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 7487980 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195044 kB' 'VmallocChunk: 0 kB' 'Percpu: 31488 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 427612 kB' 'DirectMap2M: 7880704 kB' 'DirectMap1G: 61865984 kB' 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.940 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.940 18:51:50 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.941 18:51:50 -- setup/common.sh@33 -- # echo 0 00:03:29.941 18:51:50 -- setup/common.sh@33 -- # return 0 00:03:29.941 18:51:50 -- setup/hugepages.sh@99 -- # surp=0 00:03:29.941 18:51:50 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:29.941 18:51:50 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:29.941 18:51:50 -- setup/common.sh@18 -- # local node= 00:03:29.941 18:51:50 -- setup/common.sh@19 -- # local var val 00:03:29.941 18:51:50 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.941 18:51:50 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.941 18:51:50 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.941 18:51:50 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.941 18:51:50 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.941 18:51:50 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.941 18:51:50 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45725140 kB' 'MemAvailable: 49339260 kB' 'Buffers: 11580 kB' 'Cached: 9192956 kB' 'SwapCached: 0 kB' 'Active: 6174028 kB' 'Inactive: 3666172 kB' 'Active(anon): 5811212 kB' 'Inactive(anon): 0 kB' 'Active(file): 362816 kB' 'Inactive(file): 3666172 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 639108 kB' 'Mapped: 140760 kB' 'Shmem: 5175548 kB' 'KReclaimable: 157420 kB' 'Slab: 523060 kB' 'SReclaimable: 157420 kB' 'SUnreclaim: 365640 kB' 'KernelStack: 12624 kB' 'PageTables: 6996 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 7488364 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195044 kB' 'VmallocChunk: 0 kB' 'Percpu: 31488 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 427612 kB' 'DirectMap2M: 7880704 kB' 'DirectMap1G: 61865984 kB' 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.941 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.941 18:51:50 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.942 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.942 18:51:50 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:29.942 18:51:50 -- setup/common.sh@33 -- # echo 0 00:03:29.942 18:51:50 -- setup/common.sh@33 -- # return 0 00:03:29.942 18:51:50 -- setup/hugepages.sh@100 -- # resv=0 00:03:29.942 18:51:50 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:03:29.942 nr_hugepages=1536 00:03:29.942 18:51:50 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:29.942 resv_hugepages=0 00:03:29.943 18:51:50 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:29.943 surplus_hugepages=0 00:03:29.943 18:51:50 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:29.943 anon_hugepages=0 00:03:29.943 18:51:50 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:29.943 18:51:50 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:03:29.943 18:51:50 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:29.943 18:51:50 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:29.943 18:51:50 -- setup/common.sh@18 -- # local node= 00:03:29.943 18:51:50 -- setup/common.sh@19 -- # local var val 00:03:29.943 18:51:50 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.943 18:51:50 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.943 18:51:50 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:29.943 18:51:50 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:29.943 18:51:50 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.943 18:51:50 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.943 18:51:50 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 45729472 kB' 'MemAvailable: 49343592 kB' 'Buffers: 11580 kB' 'Cached: 9192972 kB' 'SwapCached: 0 kB' 'Active: 6173944 kB' 'Inactive: 3666172 kB' 'Active(anon): 5811128 kB' 'Inactive(anon): 0 kB' 'Active(file): 362816 kB' 'Inactive(file): 3666172 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 639396 kB' 'Mapped: 140680 kB' 'Shmem: 5175564 kB' 'KReclaimable: 157420 kB' 'Slab: 522996 kB' 'SReclaimable: 157420 kB' 'SUnreclaim: 365576 kB' 'KernelStack: 12592 kB' 'PageTables: 6880 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083572 kB' 'Committed_AS: 7488376 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195028 kB' 'VmallocChunk: 0 kB' 'Percpu: 31488 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 427612 kB' 'DirectMap2M: 7880704 kB' 'DirectMap1G: 61865984 kB' 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.943 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.943 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:29.944 18:51:50 -- setup/common.sh@33 -- # echo 1536 00:03:29.944 18:51:50 -- setup/common.sh@33 -- # return 0 00:03:29.944 18:51:50 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:29.944 18:51:50 -- setup/hugepages.sh@112 -- # get_nodes 00:03:29.944 18:51:50 -- setup/hugepages.sh@27 -- # local node 00:03:29.944 18:51:50 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:29.944 18:51:50 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:29.944 18:51:50 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:29.944 18:51:50 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:29.944 18:51:50 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:29.944 18:51:50 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:29.944 18:51:50 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:29.944 18:51:50 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:29.944 18:51:50 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:29.944 18:51:50 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:29.944 18:51:50 -- setup/common.sh@18 -- # local node=0 00:03:29.944 18:51:50 -- setup/common.sh@19 -- # local var val 00:03:29.944 18:51:50 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.944 18:51:50 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.944 18:51:50 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:29.944 18:51:50 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:29.944 18:51:50 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.944 18:51:50 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.944 18:51:50 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 29822516 kB' 'MemUsed: 3003340 kB' 'SwapCached: 0 kB' 'Active: 1085896 kB' 'Inactive: 138596 kB' 'Active(anon): 944820 kB' 'Inactive(anon): 0 kB' 'Active(file): 141076 kB' 'Inactive(file): 138596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 936432 kB' 'Mapped: 49280 kB' 'AnonPages: 291236 kB' 'Shmem: 656760 kB' 'KernelStack: 7032 kB' 'PageTables: 3884 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 41664 kB' 'Slab: 243804 kB' 'SReclaimable: 41664 kB' 'SUnreclaim: 202140 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.944 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.944 18:51:50 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.945 18:51:50 -- setup/common.sh@33 -- # echo 0 00:03:29.945 18:51:50 -- setup/common.sh@33 -- # return 0 00:03:29.945 18:51:50 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:29.945 18:51:50 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:29.945 18:51:50 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:29.945 18:51:50 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:29.945 18:51:50 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:29.945 18:51:50 -- setup/common.sh@18 -- # local node=1 00:03:29.945 18:51:50 -- setup/common.sh@19 -- # local var val 00:03:29.945 18:51:50 -- setup/common.sh@20 -- # local mem_f mem 00:03:29.945 18:51:50 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:29.945 18:51:50 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:29.945 18:51:50 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:29.945 18:51:50 -- setup/common.sh@28 -- # mapfile -t mem 00:03:29.945 18:51:50 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.945 18:51:50 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27709808 kB' 'MemFree: 15906704 kB' 'MemUsed: 11803104 kB' 'SwapCached: 0 kB' 'Active: 5088320 kB' 'Inactive: 3527576 kB' 'Active(anon): 4866580 kB' 'Inactive(anon): 0 kB' 'Active(file): 221740 kB' 'Inactive(file): 3527576 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 8268148 kB' 'Mapped: 91404 kB' 'AnonPages: 347948 kB' 'Shmem: 4518832 kB' 'KernelStack: 5640 kB' 'PageTables: 3224 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 115756 kB' 'Slab: 279192 kB' 'SReclaimable: 115756 kB' 'SUnreclaim: 163436 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.945 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.945 18:51:50 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # continue 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # IFS=': ' 00:03:29.946 18:51:50 -- setup/common.sh@31 -- # read -r var val _ 00:03:29.946 18:51:50 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:29.946 18:51:50 -- setup/common.sh@33 -- # echo 0 00:03:29.946 18:51:50 -- setup/common.sh@33 -- # return 0 00:03:29.946 18:51:50 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:29.946 18:51:50 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:29.946 18:51:50 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:29.946 18:51:50 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:29.946 18:51:50 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:29.946 node0=512 expecting 512 00:03:29.946 18:51:50 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:29.946 18:51:50 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:29.946 18:51:50 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:29.946 18:51:50 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:03:29.946 node1=1024 expecting 1024 00:03:29.946 18:51:50 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:03:29.946 00:03:29.946 real 0m1.557s 00:03:29.946 user 0m0.643s 00:03:29.946 sys 0m0.882s 00:03:29.946 18:51:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:29.946 18:51:50 -- common/autotest_common.sh@10 -- # set +x 00:03:29.946 ************************************ 00:03:29.946 END TEST custom_alloc 00:03:29.946 ************************************ 00:03:30.206 18:51:50 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:03:30.206 18:51:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:30.206 18:51:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:30.206 18:51:50 -- common/autotest_common.sh@10 -- # set +x 00:03:30.206 ************************************ 00:03:30.206 START TEST no_shrink_alloc 00:03:30.206 ************************************ 00:03:30.206 18:51:50 -- common/autotest_common.sh@1114 -- # no_shrink_alloc 00:03:30.206 18:51:50 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:03:30.206 18:51:50 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:30.206 18:51:50 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:30.206 18:51:50 -- setup/hugepages.sh@51 -- # shift 00:03:30.206 18:51:50 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:30.206 18:51:50 -- setup/hugepages.sh@52 -- # local node_ids 00:03:30.206 18:51:50 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:30.206 18:51:50 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:30.206 18:51:50 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:30.206 18:51:50 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:30.206 18:51:50 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:30.206 18:51:50 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:30.206 18:51:50 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:30.206 18:51:50 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:30.206 18:51:50 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:30.206 18:51:50 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:30.206 18:51:50 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:30.206 18:51:50 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:30.206 18:51:50 -- setup/hugepages.sh@73 -- # return 0 00:03:30.206 18:51:50 -- setup/hugepages.sh@198 -- # setup output 00:03:30.207 18:51:50 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:30.207 18:51:50 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:31.590 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:31.590 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:31.590 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:31.590 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:31.590 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:31.590 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:31.590 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:31.590 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:31.590 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:31.590 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:31.590 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:31.590 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:31.590 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:31.590 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:31.590 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:31.590 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:31.590 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:31.590 18:51:52 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:03:31.590 18:51:52 -- setup/hugepages.sh@89 -- # local node 00:03:31.590 18:51:52 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:31.590 18:51:52 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:31.590 18:51:52 -- setup/hugepages.sh@92 -- # local surp 00:03:31.590 18:51:52 -- setup/hugepages.sh@93 -- # local resv 00:03:31.590 18:51:52 -- setup/hugepages.sh@94 -- # local anon 00:03:31.590 18:51:52 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:31.590 18:51:52 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:31.590 18:51:52 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:31.590 18:51:52 -- setup/common.sh@18 -- # local node= 00:03:31.590 18:51:52 -- setup/common.sh@19 -- # local var val 00:03:31.590 18:51:52 -- setup/common.sh@20 -- # local mem_f mem 00:03:31.590 18:51:52 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:31.590 18:51:52 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:31.590 18:51:52 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:31.590 18:51:52 -- setup/common.sh@28 -- # mapfile -t mem 00:03:31.590 18:51:52 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.590 18:51:52 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 46764620 kB' 'MemAvailable: 50378740 kB' 'Buffers: 11580 kB' 'Cached: 9193032 kB' 'SwapCached: 0 kB' 'Active: 6176372 kB' 'Inactive: 3666172 kB' 'Active(anon): 5813556 kB' 'Inactive(anon): 0 kB' 'Active(file): 362816 kB' 'Inactive(file): 3666172 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 641220 kB' 'Mapped: 140704 kB' 'Shmem: 5175624 kB' 'KReclaimable: 157420 kB' 'Slab: 522928 kB' 'SReclaimable: 157420 kB' 'SUnreclaim: 365508 kB' 'KernelStack: 12672 kB' 'PageTables: 7072 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 7488564 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195204 kB' 'VmallocChunk: 0 kB' 'Percpu: 31488 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 427612 kB' 'DirectMap2M: 7880704 kB' 'DirectMap1G: 61865984 kB' 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.590 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.590 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:31.591 18:51:52 -- setup/common.sh@33 -- # echo 0 00:03:31.591 18:51:52 -- setup/common.sh@33 -- # return 0 00:03:31.591 18:51:52 -- setup/hugepages.sh@97 -- # anon=0 00:03:31.591 18:51:52 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:31.591 18:51:52 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:31.591 18:51:52 -- setup/common.sh@18 -- # local node= 00:03:31.591 18:51:52 -- setup/common.sh@19 -- # local var val 00:03:31.591 18:51:52 -- setup/common.sh@20 -- # local mem_f mem 00:03:31.591 18:51:52 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:31.591 18:51:52 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:31.591 18:51:52 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:31.591 18:51:52 -- setup/common.sh@28 -- # mapfile -t mem 00:03:31.591 18:51:52 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.591 18:51:52 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 46769624 kB' 'MemAvailable: 50383744 kB' 'Buffers: 11580 kB' 'Cached: 9193032 kB' 'SwapCached: 0 kB' 'Active: 6177012 kB' 'Inactive: 3666172 kB' 'Active(anon): 5814196 kB' 'Inactive(anon): 0 kB' 'Active(file): 362816 kB' 'Inactive(file): 3666172 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 641860 kB' 'Mapped: 140704 kB' 'Shmem: 5175624 kB' 'KReclaimable: 157420 kB' 'Slab: 522952 kB' 'SReclaimable: 157420 kB' 'SUnreclaim: 365532 kB' 'KernelStack: 12656 kB' 'PageTables: 7012 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 7488576 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195172 kB' 'VmallocChunk: 0 kB' 'Percpu: 31488 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 427612 kB' 'DirectMap2M: 7880704 kB' 'DirectMap1G: 61865984 kB' 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.591 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.591 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.592 18:51:52 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.592 18:51:52 -- setup/common.sh@33 -- # echo 0 00:03:31.592 18:51:52 -- setup/common.sh@33 -- # return 0 00:03:31.592 18:51:52 -- setup/hugepages.sh@99 -- # surp=0 00:03:31.592 18:51:52 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:31.592 18:51:52 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:31.592 18:51:52 -- setup/common.sh@18 -- # local node= 00:03:31.592 18:51:52 -- setup/common.sh@19 -- # local var val 00:03:31.592 18:51:52 -- setup/common.sh@20 -- # local mem_f mem 00:03:31.592 18:51:52 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:31.592 18:51:52 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:31.592 18:51:52 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:31.592 18:51:52 -- setup/common.sh@28 -- # mapfile -t mem 00:03:31.592 18:51:52 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.592 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 46768868 kB' 'MemAvailable: 50382988 kB' 'Buffers: 11580 kB' 'Cached: 9193048 kB' 'SwapCached: 0 kB' 'Active: 6176272 kB' 'Inactive: 3666172 kB' 'Active(anon): 5813456 kB' 'Inactive(anon): 0 kB' 'Active(file): 362816 kB' 'Inactive(file): 3666172 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 641088 kB' 'Mapped: 140696 kB' 'Shmem: 5175640 kB' 'KReclaimable: 157420 kB' 'Slab: 522952 kB' 'SReclaimable: 157420 kB' 'SUnreclaim: 365532 kB' 'KernelStack: 12672 kB' 'PageTables: 7040 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 7488592 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195172 kB' 'VmallocChunk: 0 kB' 'Percpu: 31488 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 427612 kB' 'DirectMap2M: 7880704 kB' 'DirectMap1G: 61865984 kB' 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.593 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.593 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:31.594 18:51:52 -- setup/common.sh@33 -- # echo 0 00:03:31.594 18:51:52 -- setup/common.sh@33 -- # return 0 00:03:31.594 18:51:52 -- setup/hugepages.sh@100 -- # resv=0 00:03:31.594 18:51:52 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:31.594 nr_hugepages=1024 00:03:31.594 18:51:52 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:31.594 resv_hugepages=0 00:03:31.594 18:51:52 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:31.594 surplus_hugepages=0 00:03:31.594 18:51:52 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:31.594 anon_hugepages=0 00:03:31.594 18:51:52 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:31.594 18:51:52 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:31.594 18:51:52 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:31.594 18:51:52 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:31.594 18:51:52 -- setup/common.sh@18 -- # local node= 00:03:31.594 18:51:52 -- setup/common.sh@19 -- # local var val 00:03:31.594 18:51:52 -- setup/common.sh@20 -- # local mem_f mem 00:03:31.594 18:51:52 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:31.594 18:51:52 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:31.594 18:51:52 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:31.594 18:51:52 -- setup/common.sh@28 -- # mapfile -t mem 00:03:31.594 18:51:52 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.594 18:51:52 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 46776116 kB' 'MemAvailable: 50390236 kB' 'Buffers: 11580 kB' 'Cached: 9193048 kB' 'SwapCached: 0 kB' 'Active: 6177540 kB' 'Inactive: 3666172 kB' 'Active(anon): 5814724 kB' 'Inactive(anon): 0 kB' 'Active(file): 362816 kB' 'Inactive(file): 3666172 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 642472 kB' 'Mapped: 140696 kB' 'Shmem: 5175640 kB' 'KReclaimable: 157420 kB' 'Slab: 523012 kB' 'SReclaimable: 157420 kB' 'SUnreclaim: 365592 kB' 'KernelStack: 12720 kB' 'PageTables: 7208 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 7491268 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195236 kB' 'VmallocChunk: 0 kB' 'Percpu: 31488 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 427612 kB' 'DirectMap2M: 7880704 kB' 'DirectMap1G: 61865984 kB' 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.594 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.594 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.595 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.595 18:51:52 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:31.595 18:51:52 -- setup/common.sh@33 -- # echo 1024 00:03:31.595 18:51:52 -- setup/common.sh@33 -- # return 0 00:03:31.595 18:51:52 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:31.595 18:51:52 -- setup/hugepages.sh@112 -- # get_nodes 00:03:31.595 18:51:52 -- setup/hugepages.sh@27 -- # local node 00:03:31.595 18:51:52 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:31.595 18:51:52 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:31.595 18:51:52 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:31.595 18:51:52 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:31.595 18:51:52 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:31.595 18:51:52 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:31.595 18:51:52 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:31.595 18:51:52 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:31.595 18:51:52 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:31.595 18:51:52 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:31.595 18:51:52 -- setup/common.sh@18 -- # local node=0 00:03:31.595 18:51:52 -- setup/common.sh@19 -- # local var val 00:03:31.595 18:51:52 -- setup/common.sh@20 -- # local mem_f mem 00:03:31.596 18:51:52 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:31.596 18:51:52 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:31.596 18:51:52 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:31.596 18:51:52 -- setup/common.sh@28 -- # mapfile -t mem 00:03:31.596 18:51:52 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.596 18:51:52 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 28781192 kB' 'MemUsed: 4044664 kB' 'SwapCached: 0 kB' 'Active: 1088892 kB' 'Inactive: 138596 kB' 'Active(anon): 947816 kB' 'Inactive(anon): 0 kB' 'Active(file): 141076 kB' 'Inactive(file): 138596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 936436 kB' 'Mapped: 49280 kB' 'AnonPages: 294264 kB' 'Shmem: 656764 kB' 'KernelStack: 7352 kB' 'PageTables: 4760 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 41664 kB' 'Slab: 243796 kB' 'SReclaimable: 41664 kB' 'SUnreclaim: 202132 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.596 18:51:52 -- setup/common.sh@32 -- # continue 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # IFS=': ' 00:03:31.596 18:51:52 -- setup/common.sh@31 -- # read -r var val _ 00:03:31.597 18:51:52 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:31.597 18:51:52 -- setup/common.sh@33 -- # echo 0 00:03:31.597 18:51:52 -- setup/common.sh@33 -- # return 0 00:03:31.597 18:51:52 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:31.597 18:51:52 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:31.597 18:51:52 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:31.597 18:51:52 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:31.597 18:51:52 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:31.597 node0=1024 expecting 1024 00:03:31.597 18:51:52 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:31.597 18:51:52 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:03:31.597 18:51:52 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:03:31.597 18:51:52 -- setup/hugepages.sh@202 -- # setup output 00:03:31.597 18:51:52 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:31.597 18:51:52 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:32.986 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:32.986 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:32.986 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:32.986 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:32.986 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:32.986 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:32.986 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:32.986 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:32.986 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:32.986 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:03:32.986 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:03:32.986 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:03:32.986 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:03:32.986 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:03:32.986 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:03:32.986 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:03:32.986 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:03:32.986 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:03:32.986 18:51:53 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:03:32.986 18:51:53 -- setup/hugepages.sh@89 -- # local node 00:03:32.986 18:51:53 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:32.986 18:51:53 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:32.986 18:51:53 -- setup/hugepages.sh@92 -- # local surp 00:03:32.986 18:51:53 -- setup/hugepages.sh@93 -- # local resv 00:03:32.986 18:51:53 -- setup/hugepages.sh@94 -- # local anon 00:03:32.986 18:51:53 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:32.986 18:51:53 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:32.986 18:51:53 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:32.986 18:51:53 -- setup/common.sh@18 -- # local node= 00:03:32.986 18:51:53 -- setup/common.sh@19 -- # local var val 00:03:32.986 18:51:53 -- setup/common.sh@20 -- # local mem_f mem 00:03:32.986 18:51:53 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:32.986 18:51:53 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:32.986 18:51:53 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:32.986 18:51:53 -- setup/common.sh@28 -- # mapfile -t mem 00:03:32.986 18:51:53 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:32.986 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.986 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.986 18:51:53 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 46769512 kB' 'MemAvailable: 50383632 kB' 'Buffers: 11580 kB' 'Cached: 9193112 kB' 'SwapCached: 0 kB' 'Active: 6178072 kB' 'Inactive: 3666172 kB' 'Active(anon): 5815256 kB' 'Inactive(anon): 0 kB' 'Active(file): 362816 kB' 'Inactive(file): 3666172 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 642892 kB' 'Mapped: 141212 kB' 'Shmem: 5175704 kB' 'KReclaimable: 157420 kB' 'Slab: 523448 kB' 'SReclaimable: 157420 kB' 'SUnreclaim: 366028 kB' 'KernelStack: 12704 kB' 'PageTables: 7208 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 7489660 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195188 kB' 'VmallocChunk: 0 kB' 'Percpu: 31488 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 427612 kB' 'DirectMap2M: 7880704 kB' 'DirectMap1G: 61865984 kB' 00:03:32.986 18:51:53 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.986 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.986 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.986 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.986 18:51:53 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.986 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.986 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.986 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.986 18:51:53 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.986 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.986 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.986 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.986 18:51:53 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.986 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.986 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.986 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.986 18:51:53 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.986 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.986 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.986 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.986 18:51:53 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.986 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.986 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.986 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.986 18:51:53 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.986 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.986 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.986 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.986 18:51:53 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.986 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.986 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.986 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.986 18:51:53 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.986 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.986 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.986 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.986 18:51:53 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.986 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.986 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.986 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:32.987 18:51:53 -- setup/common.sh@33 -- # echo 0 00:03:32.987 18:51:53 -- setup/common.sh@33 -- # return 0 00:03:32.987 18:51:53 -- setup/hugepages.sh@97 -- # anon=0 00:03:32.987 18:51:53 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:32.987 18:51:53 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:32.987 18:51:53 -- setup/common.sh@18 -- # local node= 00:03:32.987 18:51:53 -- setup/common.sh@19 -- # local var val 00:03:32.987 18:51:53 -- setup/common.sh@20 -- # local mem_f mem 00:03:32.987 18:51:53 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:32.987 18:51:53 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:32.987 18:51:53 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:32.987 18:51:53 -- setup/common.sh@28 -- # mapfile -t mem 00:03:32.987 18:51:53 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.987 18:51:53 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 46778180 kB' 'MemAvailable: 50392300 kB' 'Buffers: 11580 kB' 'Cached: 9193112 kB' 'SwapCached: 0 kB' 'Active: 6182060 kB' 'Inactive: 3666172 kB' 'Active(anon): 5819244 kB' 'Inactive(anon): 0 kB' 'Active(file): 362816 kB' 'Inactive(file): 3666172 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 646864 kB' 'Mapped: 141648 kB' 'Shmem: 5175704 kB' 'KReclaimable: 157420 kB' 'Slab: 523424 kB' 'SReclaimable: 157420 kB' 'SUnreclaim: 366004 kB' 'KernelStack: 12752 kB' 'PageTables: 7348 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 7492516 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195140 kB' 'VmallocChunk: 0 kB' 'Percpu: 31488 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 427612 kB' 'DirectMap2M: 7880704 kB' 'DirectMap1G: 61865984 kB' 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.987 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.987 18:51:53 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.988 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.988 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.989 18:51:53 -- setup/common.sh@33 -- # echo 0 00:03:32.989 18:51:53 -- setup/common.sh@33 -- # return 0 00:03:32.989 18:51:53 -- setup/hugepages.sh@99 -- # surp=0 00:03:32.989 18:51:53 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:32.989 18:51:53 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:32.989 18:51:53 -- setup/common.sh@18 -- # local node= 00:03:32.989 18:51:53 -- setup/common.sh@19 -- # local var val 00:03:32.989 18:51:53 -- setup/common.sh@20 -- # local mem_f mem 00:03:32.989 18:51:53 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:32.989 18:51:53 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:32.989 18:51:53 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:32.989 18:51:53 -- setup/common.sh@28 -- # mapfile -t mem 00:03:32.989 18:51:53 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.989 18:51:53 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 46775412 kB' 'MemAvailable: 50389532 kB' 'Buffers: 11580 kB' 'Cached: 9193128 kB' 'SwapCached: 0 kB' 'Active: 6183928 kB' 'Inactive: 3666172 kB' 'Active(anon): 5821112 kB' 'Inactive(anon): 0 kB' 'Active(file): 362816 kB' 'Inactive(file): 3666172 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 648716 kB' 'Mapped: 141548 kB' 'Shmem: 5175720 kB' 'KReclaimable: 157420 kB' 'Slab: 523452 kB' 'SReclaimable: 157420 kB' 'SUnreclaim: 366032 kB' 'KernelStack: 12704 kB' 'PageTables: 7152 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 7494920 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195144 kB' 'VmallocChunk: 0 kB' 'Percpu: 31488 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 427612 kB' 'DirectMap2M: 7880704 kB' 'DirectMap1G: 61865984 kB' 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.989 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.989 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.990 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.990 18:51:53 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:32.990 18:51:53 -- setup/common.sh@33 -- # echo 0 00:03:32.990 18:51:53 -- setup/common.sh@33 -- # return 0 00:03:32.990 18:51:53 -- setup/hugepages.sh@100 -- # resv=0 00:03:32.990 18:51:53 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:32.990 nr_hugepages=1024 00:03:32.990 18:51:53 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:32.990 resv_hugepages=0 00:03:32.990 18:51:53 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:32.990 surplus_hugepages=0 00:03:32.990 18:51:53 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:32.990 anon_hugepages=0 00:03:32.990 18:51:53 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:32.990 18:51:53 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:32.990 18:51:53 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:32.990 18:51:53 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:32.990 18:51:53 -- setup/common.sh@18 -- # local node= 00:03:32.990 18:51:53 -- setup/common.sh@19 -- # local var val 00:03:32.990 18:51:53 -- setup/common.sh@20 -- # local mem_f mem 00:03:32.990 18:51:53 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:32.991 18:51:53 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:32.991 18:51:53 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:32.991 18:51:53 -- setup/common.sh@28 -- # mapfile -t mem 00:03:32.991 18:51:53 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.991 18:51:53 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535664 kB' 'MemFree: 46775416 kB' 'MemAvailable: 50389536 kB' 'Buffers: 11580 kB' 'Cached: 9193140 kB' 'SwapCached: 0 kB' 'Active: 6177924 kB' 'Inactive: 3666172 kB' 'Active(anon): 5815108 kB' 'Inactive(anon): 0 kB' 'Active(file): 362816 kB' 'Inactive(file): 3666172 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 642692 kB' 'Mapped: 140704 kB' 'Shmem: 5175732 kB' 'KReclaimable: 157420 kB' 'Slab: 523436 kB' 'SReclaimable: 157420 kB' 'SUnreclaim: 366016 kB' 'KernelStack: 12704 kB' 'PageTables: 7120 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607860 kB' 'Committed_AS: 7488816 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 195156 kB' 'VmallocChunk: 0 kB' 'Percpu: 31488 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 427612 kB' 'DirectMap2M: 7880704 kB' 'DirectMap1G: 61865984 kB' 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.991 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.991 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:32.992 18:51:53 -- setup/common.sh@33 -- # echo 1024 00:03:32.992 18:51:53 -- setup/common.sh@33 -- # return 0 00:03:32.992 18:51:53 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:32.992 18:51:53 -- setup/hugepages.sh@112 -- # get_nodes 00:03:32.992 18:51:53 -- setup/hugepages.sh@27 -- # local node 00:03:32.992 18:51:53 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:32.992 18:51:53 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:32.992 18:51:53 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:32.992 18:51:53 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:32.992 18:51:53 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:32.992 18:51:53 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:32.992 18:51:53 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:32.992 18:51:53 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:32.992 18:51:53 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:32.992 18:51:53 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:32.992 18:51:53 -- setup/common.sh@18 -- # local node=0 00:03:32.992 18:51:53 -- setup/common.sh@19 -- # local var val 00:03:32.992 18:51:53 -- setup/common.sh@20 -- # local mem_f mem 00:03:32.992 18:51:53 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:32.992 18:51:53 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:32.992 18:51:53 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:32.992 18:51:53 -- setup/common.sh@28 -- # mapfile -t mem 00:03:32.992 18:51:53 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.992 18:51:53 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32825856 kB' 'MemFree: 28786144 kB' 'MemUsed: 4039712 kB' 'SwapCached: 0 kB' 'Active: 1089796 kB' 'Inactive: 138596 kB' 'Active(anon): 948720 kB' 'Inactive(anon): 0 kB' 'Active(file): 141076 kB' 'Inactive(file): 138596 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 936448 kB' 'Mapped: 49280 kB' 'AnonPages: 295100 kB' 'Shmem: 656776 kB' 'KernelStack: 7064 kB' 'PageTables: 3992 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 41664 kB' 'Slab: 244004 kB' 'SReclaimable: 41664 kB' 'SUnreclaim: 202340 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.992 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.992 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # continue 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # IFS=': ' 00:03:32.993 18:51:53 -- setup/common.sh@31 -- # read -r var val _ 00:03:32.993 18:51:53 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:32.993 18:51:53 -- setup/common.sh@33 -- # echo 0 00:03:32.993 18:51:53 -- setup/common.sh@33 -- # return 0 00:03:32.993 18:51:53 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:32.993 18:51:53 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:32.993 18:51:53 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:32.993 18:51:53 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:32.993 18:51:53 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:32.993 node0=1024 expecting 1024 00:03:32.993 18:51:53 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:32.993 00:03:32.993 real 0m2.985s 00:03:32.993 user 0m1.218s 00:03:32.993 sys 0m1.700s 00:03:32.993 18:51:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:32.993 18:51:53 -- common/autotest_common.sh@10 -- # set +x 00:03:32.993 ************************************ 00:03:32.993 END TEST no_shrink_alloc 00:03:32.993 ************************************ 00:03:32.993 18:51:53 -- setup/hugepages.sh@217 -- # clear_hp 00:03:32.993 18:51:53 -- setup/hugepages.sh@37 -- # local node hp 00:03:32.993 18:51:53 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:32.993 18:51:53 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:32.993 18:51:53 -- setup/hugepages.sh@41 -- # echo 0 00:03:32.993 18:51:53 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:32.993 18:51:53 -- setup/hugepages.sh@41 -- # echo 0 00:03:32.993 18:51:54 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:32.993 18:51:54 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:32.993 18:51:54 -- setup/hugepages.sh@41 -- # echo 0 00:03:32.993 18:51:54 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:32.993 18:51:54 -- setup/hugepages.sh@41 -- # echo 0 00:03:32.993 18:51:54 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:32.993 18:51:54 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:32.993 00:03:32.993 real 0m11.992s 00:03:32.993 user 0m4.569s 00:03:32.993 sys 0m6.377s 00:03:32.993 18:51:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:32.993 18:51:54 -- common/autotest_common.sh@10 -- # set +x 00:03:32.993 ************************************ 00:03:32.993 END TEST hugepages 00:03:32.993 ************************************ 00:03:33.253 18:51:54 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:33.253 18:51:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:33.253 18:51:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:33.253 18:51:54 -- common/autotest_common.sh@10 -- # set +x 00:03:33.253 ************************************ 00:03:33.253 START TEST driver 00:03:33.253 ************************************ 00:03:33.253 18:51:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:33.253 * Looking for test storage... 00:03:33.253 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:33.253 18:51:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:33.253 18:51:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:33.253 18:51:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:33.253 18:51:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:33.253 18:51:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:33.253 18:51:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:33.253 18:51:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:33.253 18:51:54 -- scripts/common.sh@335 -- # IFS=.-: 00:03:33.253 18:51:54 -- scripts/common.sh@335 -- # read -ra ver1 00:03:33.253 18:51:54 -- scripts/common.sh@336 -- # IFS=.-: 00:03:33.253 18:51:54 -- scripts/common.sh@336 -- # read -ra ver2 00:03:33.253 18:51:54 -- scripts/common.sh@337 -- # local 'op=<' 00:03:33.253 18:51:54 -- scripts/common.sh@339 -- # ver1_l=2 00:03:33.253 18:51:54 -- scripts/common.sh@340 -- # ver2_l=1 00:03:33.253 18:51:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:33.253 18:51:54 -- scripts/common.sh@343 -- # case "$op" in 00:03:33.253 18:51:54 -- scripts/common.sh@344 -- # : 1 00:03:33.253 18:51:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:33.253 18:51:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:33.253 18:51:54 -- scripts/common.sh@364 -- # decimal 1 00:03:33.253 18:51:54 -- scripts/common.sh@352 -- # local d=1 00:03:33.253 18:51:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:33.253 18:51:54 -- scripts/common.sh@354 -- # echo 1 00:03:33.253 18:51:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:33.253 18:51:54 -- scripts/common.sh@365 -- # decimal 2 00:03:33.253 18:51:54 -- scripts/common.sh@352 -- # local d=2 00:03:33.253 18:51:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:33.253 18:51:54 -- scripts/common.sh@354 -- # echo 2 00:03:33.253 18:51:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:33.253 18:51:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:33.253 18:51:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:33.253 18:51:54 -- scripts/common.sh@367 -- # return 0 00:03:33.253 18:51:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:33.253 18:51:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:33.253 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:33.253 --rc genhtml_branch_coverage=1 00:03:33.253 --rc genhtml_function_coverage=1 00:03:33.253 --rc genhtml_legend=1 00:03:33.253 --rc geninfo_all_blocks=1 00:03:33.253 --rc geninfo_unexecuted_blocks=1 00:03:33.253 00:03:33.253 ' 00:03:33.253 18:51:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:33.253 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:33.253 --rc genhtml_branch_coverage=1 00:03:33.253 --rc genhtml_function_coverage=1 00:03:33.253 --rc genhtml_legend=1 00:03:33.253 --rc geninfo_all_blocks=1 00:03:33.253 --rc geninfo_unexecuted_blocks=1 00:03:33.253 00:03:33.253 ' 00:03:33.253 18:51:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:33.253 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:33.253 --rc genhtml_branch_coverage=1 00:03:33.253 --rc genhtml_function_coverage=1 00:03:33.253 --rc genhtml_legend=1 00:03:33.253 --rc geninfo_all_blocks=1 00:03:33.253 --rc geninfo_unexecuted_blocks=1 00:03:33.253 00:03:33.253 ' 00:03:33.253 18:51:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:33.253 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:33.253 --rc genhtml_branch_coverage=1 00:03:33.253 --rc genhtml_function_coverage=1 00:03:33.253 --rc genhtml_legend=1 00:03:33.253 --rc geninfo_all_blocks=1 00:03:33.253 --rc geninfo_unexecuted_blocks=1 00:03:33.253 00:03:33.253 ' 00:03:33.253 18:51:54 -- setup/driver.sh@68 -- # setup reset 00:03:33.253 18:51:54 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:33.253 18:51:54 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:35.789 18:51:56 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:03:35.789 18:51:56 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:35.789 18:51:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:35.789 18:51:56 -- common/autotest_common.sh@10 -- # set +x 00:03:35.789 ************************************ 00:03:35.789 START TEST guess_driver 00:03:35.789 ************************************ 00:03:35.789 18:51:56 -- common/autotest_common.sh@1114 -- # guess_driver 00:03:35.789 18:51:56 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:03:35.789 18:51:56 -- setup/driver.sh@47 -- # local fail=0 00:03:35.790 18:51:56 -- setup/driver.sh@49 -- # pick_driver 00:03:35.790 18:51:56 -- setup/driver.sh@36 -- # vfio 00:03:35.790 18:51:56 -- setup/driver.sh@21 -- # local iommu_grups 00:03:35.790 18:51:56 -- setup/driver.sh@22 -- # local unsafe_vfio 00:03:35.790 18:51:56 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:03:35.790 18:51:56 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:03:35.790 18:51:56 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:03:35.790 18:51:56 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:03:35.790 18:51:56 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:03:35.790 18:51:56 -- setup/driver.sh@14 -- # mod vfio_pci 00:03:35.790 18:51:56 -- setup/driver.sh@12 -- # dep vfio_pci 00:03:35.790 18:51:56 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:03:35.790 18:51:56 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:03:35.790 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:35.790 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:35.790 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:35.790 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:35.790 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:03:35.790 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:03:35.790 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:03:35.790 18:51:56 -- setup/driver.sh@30 -- # return 0 00:03:35.790 18:51:56 -- setup/driver.sh@37 -- # echo vfio-pci 00:03:35.790 18:51:56 -- setup/driver.sh@49 -- # driver=vfio-pci 00:03:35.790 18:51:56 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:03:35.790 18:51:56 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:03:35.790 Looking for driver=vfio-pci 00:03:35.790 18:51:56 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:35.790 18:51:56 -- setup/driver.sh@45 -- # setup output config 00:03:35.790 18:51:56 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:35.790 18:51:56 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:37.172 18:51:58 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:37.172 18:51:58 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:37.172 18:51:58 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:37.172 18:51:58 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:37.172 18:51:58 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:37.172 18:51:58 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:37.172 18:51:58 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:37.172 18:51:58 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:37.172 18:51:58 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:37.172 18:51:58 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:37.172 18:51:58 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:37.172 18:51:58 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:37.172 18:51:58 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:37.172 18:51:58 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:37.172 18:51:58 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:37.172 18:51:58 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:37.172 18:51:58 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:37.172 18:51:58 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:37.172 18:51:58 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:37.172 18:51:58 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:37.172 18:51:58 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:37.172 18:51:58 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:37.172 18:51:58 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:37.172 18:51:58 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:37.172 18:51:58 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:37.172 18:51:58 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:37.172 18:51:58 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:37.172 18:51:58 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:37.172 18:51:58 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:37.172 18:51:58 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:37.433 18:51:58 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:37.433 18:51:58 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:37.433 18:51:58 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:37.433 18:51:58 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:37.433 18:51:58 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:37.433 18:51:58 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:37.433 18:51:58 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:37.433 18:51:58 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:37.433 18:51:58 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:37.433 18:51:58 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:37.433 18:51:58 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:37.433 18:51:58 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:37.433 18:51:58 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:37.433 18:51:58 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:37.433 18:51:58 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:37.433 18:51:58 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:37.433 18:51:58 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:37.433 18:51:58 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:38.377 18:51:59 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:38.377 18:51:59 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:38.377 18:51:59 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:38.377 18:51:59 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:03:38.377 18:51:59 -- setup/driver.sh@65 -- # setup reset 00:03:38.377 18:51:59 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:38.377 18:51:59 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:40.921 00:03:40.921 real 0m4.996s 00:03:40.921 user 0m1.111s 00:03:40.921 sys 0m2.104s 00:03:40.921 18:52:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:40.921 18:52:01 -- common/autotest_common.sh@10 -- # set +x 00:03:40.921 ************************************ 00:03:40.921 END TEST guess_driver 00:03:40.921 ************************************ 00:03:40.921 00:03:40.921 real 0m7.801s 00:03:40.921 user 0m1.789s 00:03:40.921 sys 0m3.243s 00:03:40.921 18:52:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:40.921 18:52:01 -- common/autotest_common.sh@10 -- # set +x 00:03:40.921 ************************************ 00:03:40.921 END TEST driver 00:03:40.921 ************************************ 00:03:40.921 18:52:01 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:40.921 18:52:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:40.921 18:52:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:40.921 18:52:01 -- common/autotest_common.sh@10 -- # set +x 00:03:40.921 ************************************ 00:03:40.921 START TEST devices 00:03:40.921 ************************************ 00:03:40.921 18:52:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:40.921 * Looking for test storage... 00:03:40.921 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:40.921 18:52:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:40.921 18:52:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:40.921 18:52:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:41.182 18:52:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:41.182 18:52:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:41.182 18:52:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:41.182 18:52:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:41.182 18:52:01 -- scripts/common.sh@335 -- # IFS=.-: 00:03:41.182 18:52:01 -- scripts/common.sh@335 -- # read -ra ver1 00:03:41.182 18:52:01 -- scripts/common.sh@336 -- # IFS=.-: 00:03:41.182 18:52:01 -- scripts/common.sh@336 -- # read -ra ver2 00:03:41.182 18:52:01 -- scripts/common.sh@337 -- # local 'op=<' 00:03:41.182 18:52:01 -- scripts/common.sh@339 -- # ver1_l=2 00:03:41.182 18:52:01 -- scripts/common.sh@340 -- # ver2_l=1 00:03:41.182 18:52:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:41.182 18:52:01 -- scripts/common.sh@343 -- # case "$op" in 00:03:41.182 18:52:01 -- scripts/common.sh@344 -- # : 1 00:03:41.182 18:52:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:41.182 18:52:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:41.182 18:52:01 -- scripts/common.sh@364 -- # decimal 1 00:03:41.182 18:52:01 -- scripts/common.sh@352 -- # local d=1 00:03:41.182 18:52:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:41.182 18:52:01 -- scripts/common.sh@354 -- # echo 1 00:03:41.182 18:52:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:41.182 18:52:01 -- scripts/common.sh@365 -- # decimal 2 00:03:41.182 18:52:01 -- scripts/common.sh@352 -- # local d=2 00:03:41.182 18:52:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:41.182 18:52:01 -- scripts/common.sh@354 -- # echo 2 00:03:41.182 18:52:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:41.182 18:52:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:41.182 18:52:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:41.182 18:52:01 -- scripts/common.sh@367 -- # return 0 00:03:41.182 18:52:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:41.182 18:52:02 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:41.182 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:41.182 --rc genhtml_branch_coverage=1 00:03:41.182 --rc genhtml_function_coverage=1 00:03:41.182 --rc genhtml_legend=1 00:03:41.182 --rc geninfo_all_blocks=1 00:03:41.182 --rc geninfo_unexecuted_blocks=1 00:03:41.182 00:03:41.182 ' 00:03:41.182 18:52:02 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:41.182 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:41.182 --rc genhtml_branch_coverage=1 00:03:41.182 --rc genhtml_function_coverage=1 00:03:41.182 --rc genhtml_legend=1 00:03:41.182 --rc geninfo_all_blocks=1 00:03:41.182 --rc geninfo_unexecuted_blocks=1 00:03:41.182 00:03:41.182 ' 00:03:41.182 18:52:02 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:41.182 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:41.182 --rc genhtml_branch_coverage=1 00:03:41.182 --rc genhtml_function_coverage=1 00:03:41.182 --rc genhtml_legend=1 00:03:41.182 --rc geninfo_all_blocks=1 00:03:41.182 --rc geninfo_unexecuted_blocks=1 00:03:41.182 00:03:41.182 ' 00:03:41.182 18:52:02 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:41.182 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:41.182 --rc genhtml_branch_coverage=1 00:03:41.182 --rc genhtml_function_coverage=1 00:03:41.182 --rc genhtml_legend=1 00:03:41.182 --rc geninfo_all_blocks=1 00:03:41.182 --rc geninfo_unexecuted_blocks=1 00:03:41.182 00:03:41.182 ' 00:03:41.182 18:52:02 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:03:41.182 18:52:02 -- setup/devices.sh@192 -- # setup reset 00:03:41.182 18:52:02 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:41.182 18:52:02 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:42.562 18:52:03 -- setup/devices.sh@194 -- # get_zoned_devs 00:03:42.562 18:52:03 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:42.562 18:52:03 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:42.562 18:52:03 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:42.562 18:52:03 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:42.562 18:52:03 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:42.562 18:52:03 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:42.562 18:52:03 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:42.562 18:52:03 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:42.562 18:52:03 -- setup/devices.sh@196 -- # blocks=() 00:03:42.562 18:52:03 -- setup/devices.sh@196 -- # declare -a blocks 00:03:42.562 18:52:03 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:03:42.562 18:52:03 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:03:42.562 18:52:03 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:03:42.562 18:52:03 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:03:42.562 18:52:03 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:03:42.562 18:52:03 -- setup/devices.sh@201 -- # ctrl=nvme0 00:03:42.562 18:52:03 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:03:42.562 18:52:03 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:03:42.562 18:52:03 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:03:42.562 18:52:03 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:03:42.562 18:52:03 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:03:42.562 No valid GPT data, bailing 00:03:42.562 18:52:03 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:42.562 18:52:03 -- scripts/common.sh@393 -- # pt= 00:03:42.562 18:52:03 -- scripts/common.sh@394 -- # return 1 00:03:42.562 18:52:03 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:03:42.562 18:52:03 -- setup/common.sh@76 -- # local dev=nvme0n1 00:03:42.562 18:52:03 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:03:42.562 18:52:03 -- setup/common.sh@80 -- # echo 1000204886016 00:03:42.562 18:52:03 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:03:42.562 18:52:03 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:03:42.562 18:52:03 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:03:42.562 18:52:03 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:03:42.562 18:52:03 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:03:42.562 18:52:03 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:03:42.562 18:52:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:42.562 18:52:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:42.562 18:52:03 -- common/autotest_common.sh@10 -- # set +x 00:03:42.562 ************************************ 00:03:42.562 START TEST nvme_mount 00:03:42.562 ************************************ 00:03:42.562 18:52:03 -- common/autotest_common.sh@1114 -- # nvme_mount 00:03:42.562 18:52:03 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:03:42.562 18:52:03 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:03:42.562 18:52:03 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:42.562 18:52:03 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:42.562 18:52:03 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:03:42.562 18:52:03 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:42.562 18:52:03 -- setup/common.sh@40 -- # local part_no=1 00:03:42.562 18:52:03 -- setup/common.sh@41 -- # local size=1073741824 00:03:42.562 18:52:03 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:42.562 18:52:03 -- setup/common.sh@44 -- # parts=() 00:03:42.563 18:52:03 -- setup/common.sh@44 -- # local parts 00:03:42.563 18:52:03 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:42.563 18:52:03 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:42.563 18:52:03 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:42.563 18:52:03 -- setup/common.sh@46 -- # (( part++ )) 00:03:42.563 18:52:03 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:42.563 18:52:03 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:42.563 18:52:03 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:42.563 18:52:03 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:03:43.949 Creating new GPT entries in memory. 00:03:43.949 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:43.949 other utilities. 00:03:43.949 18:52:04 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:43.949 18:52:04 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:43.949 18:52:04 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:43.949 18:52:04 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:43.949 18:52:04 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:44.890 Creating new GPT entries in memory. 00:03:44.890 The operation has completed successfully. 00:03:44.890 18:52:05 -- setup/common.sh@57 -- # (( part++ )) 00:03:44.890 18:52:05 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:44.890 18:52:05 -- setup/common.sh@62 -- # wait 70349 00:03:44.890 18:52:05 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:44.890 18:52:05 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:03:44.890 18:52:05 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:44.890 18:52:05 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:03:44.890 18:52:05 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:03:44.890 18:52:05 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:44.890 18:52:05 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:44.890 18:52:05 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:44.890 18:52:05 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:03:44.890 18:52:05 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:44.890 18:52:05 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:44.890 18:52:05 -- setup/devices.sh@53 -- # local found=0 00:03:44.890 18:52:05 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:44.890 18:52:05 -- setup/devices.sh@56 -- # : 00:03:44.890 18:52:05 -- setup/devices.sh@59 -- # local pci status 00:03:44.890 18:52:05 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:44.890 18:52:05 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:44.890 18:52:05 -- setup/devices.sh@47 -- # setup output config 00:03:44.890 18:52:05 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:44.890 18:52:05 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:45.833 18:52:06 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.833 18:52:06 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:03:45.833 18:52:06 -- setup/devices.sh@63 -- # found=1 00:03:45.833 18:52:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.833 18:52:06 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.833 18:52:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.833 18:52:06 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.833 18:52:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.833 18:52:06 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.833 18:52:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.833 18:52:06 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.833 18:52:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.833 18:52:06 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.833 18:52:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:45.833 18:52:06 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:45.833 18:52:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.093 18:52:06 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.093 18:52:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.093 18:52:06 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.093 18:52:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.093 18:52:06 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.093 18:52:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.093 18:52:06 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.093 18:52:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.093 18:52:06 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.093 18:52:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.093 18:52:06 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.093 18:52:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.093 18:52:06 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.093 18:52:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.093 18:52:06 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.093 18:52:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.093 18:52:06 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.093 18:52:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.093 18:52:06 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:46.093 18:52:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.093 18:52:07 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:46.093 18:52:07 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:46.093 18:52:07 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:46.093 18:52:07 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:46.093 18:52:07 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:46.093 18:52:07 -- setup/devices.sh@110 -- # cleanup_nvme 00:03:46.093 18:52:07 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:46.093 18:52:07 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:46.093 18:52:07 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:46.093 18:52:07 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:46.355 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:46.355 18:52:07 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:46.355 18:52:07 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:46.614 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:46.614 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:46.614 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:46.614 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:46.614 18:52:07 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:03:46.614 18:52:07 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:03:46.614 18:52:07 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:46.614 18:52:07 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:03:46.614 18:52:07 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:03:46.614 18:52:07 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:46.614 18:52:07 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:46.614 18:52:07 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:46.614 18:52:07 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:03:46.614 18:52:07 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:46.614 18:52:07 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:46.614 18:52:07 -- setup/devices.sh@53 -- # local found=0 00:03:46.614 18:52:07 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:46.614 18:52:07 -- setup/devices.sh@56 -- # : 00:03:46.614 18:52:07 -- setup/devices.sh@59 -- # local pci status 00:03:46.614 18:52:07 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.614 18:52:07 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:46.614 18:52:07 -- setup/devices.sh@47 -- # setup output config 00:03:46.614 18:52:07 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:46.614 18:52:07 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:47.550 18:52:08 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.550 18:52:08 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:03:47.550 18:52:08 -- setup/devices.sh@63 -- # found=1 00:03:47.550 18:52:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.550 18:52:08 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.550 18:52:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.550 18:52:08 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.550 18:52:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.550 18:52:08 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.550 18:52:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.550 18:52:08 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.550 18:52:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.550 18:52:08 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.550 18:52:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.550 18:52:08 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.550 18:52:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.550 18:52:08 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.550 18:52:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.550 18:52:08 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.550 18:52:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.550 18:52:08 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.550 18:52:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.550 18:52:08 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.550 18:52:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.550 18:52:08 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.550 18:52:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.550 18:52:08 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.550 18:52:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.550 18:52:08 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.550 18:52:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.550 18:52:08 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.550 18:52:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.550 18:52:08 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.550 18:52:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.550 18:52:08 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:47.550 18:52:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.812 18:52:08 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:47.812 18:52:08 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:47.812 18:52:08 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:47.812 18:52:08 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:47.812 18:52:08 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:47.812 18:52:08 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:47.812 18:52:08 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:03:47.812 18:52:08 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:47.812 18:52:08 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:03:47.812 18:52:08 -- setup/devices.sh@50 -- # local mount_point= 00:03:47.812 18:52:08 -- setup/devices.sh@51 -- # local test_file= 00:03:47.812 18:52:08 -- setup/devices.sh@53 -- # local found=0 00:03:47.812 18:52:08 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:47.812 18:52:08 -- setup/devices.sh@59 -- # local pci status 00:03:47.812 18:52:08 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:47.812 18:52:08 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:47.812 18:52:08 -- setup/devices.sh@47 -- # setup output config 00:03:47.812 18:52:08 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:47.812 18:52:08 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:49.192 18:52:10 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.192 18:52:10 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:03:49.192 18:52:10 -- setup/devices.sh@63 -- # found=1 00:03:49.192 18:52:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.192 18:52:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.192 18:52:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.192 18:52:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.192 18:52:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.192 18:52:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.192 18:52:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.192 18:52:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.192 18:52:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.192 18:52:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.192 18:52:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.192 18:52:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.192 18:52:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.192 18:52:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.192 18:52:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.192 18:52:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.192 18:52:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.192 18:52:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.192 18:52:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.192 18:52:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.192 18:52:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.192 18:52:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.192 18:52:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.192 18:52:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.192 18:52:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.192 18:52:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.192 18:52:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.192 18:52:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.192 18:52:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.192 18:52:10 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.192 18:52:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.192 18:52:10 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:49.192 18:52:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.453 18:52:10 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:49.453 18:52:10 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:49.453 18:52:10 -- setup/devices.sh@68 -- # return 0 00:03:49.453 18:52:10 -- setup/devices.sh@128 -- # cleanup_nvme 00:03:49.453 18:52:10 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:49.453 18:52:10 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:49.453 18:52:10 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:49.453 18:52:10 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:49.453 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:49.453 00:03:49.453 real 0m6.686s 00:03:49.453 user 0m1.580s 00:03:49.453 sys 0m2.689s 00:03:49.453 18:52:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:49.453 18:52:10 -- common/autotest_common.sh@10 -- # set +x 00:03:49.453 ************************************ 00:03:49.453 END TEST nvme_mount 00:03:49.453 ************************************ 00:03:49.453 18:52:10 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:03:49.453 18:52:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:49.453 18:52:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:49.453 18:52:10 -- common/autotest_common.sh@10 -- # set +x 00:03:49.453 ************************************ 00:03:49.453 START TEST dm_mount 00:03:49.453 ************************************ 00:03:49.453 18:52:10 -- common/autotest_common.sh@1114 -- # dm_mount 00:03:49.453 18:52:10 -- setup/devices.sh@144 -- # pv=nvme0n1 00:03:49.453 18:52:10 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:03:49.453 18:52:10 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:03:49.453 18:52:10 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:03:49.453 18:52:10 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:49.453 18:52:10 -- setup/common.sh@40 -- # local part_no=2 00:03:49.453 18:52:10 -- setup/common.sh@41 -- # local size=1073741824 00:03:49.453 18:52:10 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:49.453 18:52:10 -- setup/common.sh@44 -- # parts=() 00:03:49.453 18:52:10 -- setup/common.sh@44 -- # local parts 00:03:49.453 18:52:10 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:49.453 18:52:10 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:49.453 18:52:10 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:49.453 18:52:10 -- setup/common.sh@46 -- # (( part++ )) 00:03:49.453 18:52:10 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:49.453 18:52:10 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:49.453 18:52:10 -- setup/common.sh@46 -- # (( part++ )) 00:03:49.453 18:52:10 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:49.453 18:52:10 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:49.453 18:52:10 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:49.453 18:52:10 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:03:50.395 Creating new GPT entries in memory. 00:03:50.395 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:50.395 other utilities. 00:03:50.395 18:52:11 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:50.395 18:52:11 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:50.395 18:52:11 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:50.395 18:52:11 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:50.395 18:52:11 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:51.333 Creating new GPT entries in memory. 00:03:51.333 The operation has completed successfully. 00:03:51.333 18:52:12 -- setup/common.sh@57 -- # (( part++ )) 00:03:51.333 18:52:12 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:51.333 18:52:12 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:51.333 18:52:12 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:51.333 18:52:12 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:03:52.719 The operation has completed successfully. 00:03:52.719 18:52:13 -- setup/common.sh@57 -- # (( part++ )) 00:03:52.719 18:52:13 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:52.719 18:52:13 -- setup/common.sh@62 -- # wait 72816 00:03:52.719 18:52:13 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:03:52.719 18:52:13 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:52.719 18:52:13 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:52.719 18:52:13 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:03:52.719 18:52:13 -- setup/devices.sh@160 -- # for t in {1..5} 00:03:52.719 18:52:13 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:52.719 18:52:13 -- setup/devices.sh@161 -- # break 00:03:52.719 18:52:13 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:52.719 18:52:13 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:03:52.719 18:52:13 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:03:52.719 18:52:13 -- setup/devices.sh@166 -- # dm=dm-0 00:03:52.719 18:52:13 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:03:52.719 18:52:13 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:03:52.719 18:52:13 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:52.719 18:52:13 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:03:52.719 18:52:13 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:52.719 18:52:13 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:52.719 18:52:13 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:03:52.719 18:52:13 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:52.719 18:52:13 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:52.719 18:52:13 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:52.719 18:52:13 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:03:52.719 18:52:13 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:52.719 18:52:13 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:52.719 18:52:13 -- setup/devices.sh@53 -- # local found=0 00:03:52.719 18:52:13 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:52.719 18:52:13 -- setup/devices.sh@56 -- # : 00:03:52.719 18:52:13 -- setup/devices.sh@59 -- # local pci status 00:03:52.719 18:52:13 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.719 18:52:13 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:52.719 18:52:13 -- setup/devices.sh@47 -- # setup output config 00:03:52.719 18:52:13 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:52.719 18:52:13 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:53.655 18:52:14 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.655 18:52:14 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:03:53.655 18:52:14 -- setup/devices.sh@63 -- # found=1 00:03:53.655 18:52:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.655 18:52:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.655 18:52:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.655 18:52:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.655 18:52:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.655 18:52:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.655 18:52:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.655 18:52:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.655 18:52:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.655 18:52:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.655 18:52:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.655 18:52:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.655 18:52:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.655 18:52:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.655 18:52:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.655 18:52:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.655 18:52:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.655 18:52:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.656 18:52:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.656 18:52:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.656 18:52:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.656 18:52:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.656 18:52:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.656 18:52:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.656 18:52:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.656 18:52:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.656 18:52:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.656 18:52:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.656 18:52:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.656 18:52:14 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.656 18:52:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.656 18:52:14 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:53.656 18:52:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.915 18:52:14 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:53.915 18:52:14 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:03:53.915 18:52:14 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:53.915 18:52:14 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:53.915 18:52:14 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:53.915 18:52:14 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:53.915 18:52:14 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:03:53.915 18:52:14 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:03:53.915 18:52:14 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:03:53.915 18:52:14 -- setup/devices.sh@50 -- # local mount_point= 00:03:53.915 18:52:14 -- setup/devices.sh@51 -- # local test_file= 00:03:53.915 18:52:14 -- setup/devices.sh@53 -- # local found=0 00:03:53.915 18:52:14 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:53.915 18:52:14 -- setup/devices.sh@59 -- # local pci status 00:03:53.915 18:52:14 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:53.915 18:52:14 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:03:53.915 18:52:14 -- setup/devices.sh@47 -- # setup output config 00:03:53.915 18:52:14 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:53.915 18:52:14 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:55.309 18:52:15 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.310 18:52:15 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:03:55.310 18:52:15 -- setup/devices.sh@63 -- # found=1 00:03:55.310 18:52:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.310 18:52:15 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.310 18:52:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.310 18:52:15 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.310 18:52:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.310 18:52:15 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.310 18:52:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.310 18:52:15 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.310 18:52:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.310 18:52:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.310 18:52:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.310 18:52:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.310 18:52:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.310 18:52:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.310 18:52:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.310 18:52:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.310 18:52:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.310 18:52:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.310 18:52:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.310 18:52:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.310 18:52:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.310 18:52:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.310 18:52:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.310 18:52:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.310 18:52:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.310 18:52:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.310 18:52:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.310 18:52:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.310 18:52:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.310 18:52:16 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.310 18:52:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.310 18:52:16 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:03:55.310 18:52:16 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.310 18:52:16 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:55.310 18:52:16 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:55.310 18:52:16 -- setup/devices.sh@68 -- # return 0 00:03:55.310 18:52:16 -- setup/devices.sh@187 -- # cleanup_dm 00:03:55.310 18:52:16 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:55.310 18:52:16 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:55.310 18:52:16 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:03:55.310 18:52:16 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:55.310 18:52:16 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:03:55.310 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:55.310 18:52:16 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:55.310 18:52:16 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:03:55.310 00:03:55.310 real 0m5.985s 00:03:55.310 user 0m1.035s 00:03:55.310 sys 0m1.814s 00:03:55.310 18:52:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:55.310 18:52:16 -- common/autotest_common.sh@10 -- # set +x 00:03:55.310 ************************************ 00:03:55.310 END TEST dm_mount 00:03:55.310 ************************************ 00:03:55.310 18:52:16 -- setup/devices.sh@1 -- # cleanup 00:03:55.310 18:52:16 -- setup/devices.sh@11 -- # cleanup_nvme 00:03:55.310 18:52:16 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:55.310 18:52:16 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:55.310 18:52:16 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:55.310 18:52:16 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:55.310 18:52:16 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:55.570 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:55.570 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:55.570 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:55.570 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:55.570 18:52:16 -- setup/devices.sh@12 -- # cleanup_dm 00:03:55.570 18:52:16 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:55.570 18:52:16 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:03:55.570 18:52:16 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:55.570 18:52:16 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:03:55.570 18:52:16 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:03:55.570 18:52:16 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:03:55.570 00:03:55.570 real 0m14.729s 00:03:55.570 user 0m3.328s 00:03:55.570 sys 0m5.621s 00:03:55.570 18:52:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:55.570 18:52:16 -- common/autotest_common.sh@10 -- # set +x 00:03:55.570 ************************************ 00:03:55.570 END TEST devices 00:03:55.570 ************************************ 00:03:55.570 00:03:55.570 real 0m45.968s 00:03:55.570 user 0m13.359s 00:03:55.570 sys 0m21.150s 00:03:55.570 18:52:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:55.570 18:52:16 -- common/autotest_common.sh@10 -- # set +x 00:03:55.828 ************************************ 00:03:55.828 END TEST setup.sh 00:03:55.828 ************************************ 00:03:55.828 18:52:16 -- spdk/autotest.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:03:56.765 Hugepages 00:03:56.765 node hugesize free / total 00:03:56.765 node0 1048576kB 0 / 0 00:03:56.765 node0 2048kB 2048 / 2048 00:03:56.765 node1 1048576kB 0 / 0 00:03:56.765 node1 2048kB 0 / 0 00:03:56.765 00:03:56.765 Type BDF Vendor Device NUMA Driver Device Block devices 00:03:56.765 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:03:56.765 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:03:56.765 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:03:56.765 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:03:56.765 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:03:57.023 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:03:57.023 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:03:57.023 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:03:57.023 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:03:57.023 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:03:57.023 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:03:57.023 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:03:57.023 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:03:57.023 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:03:57.023 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:03:57.023 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:03:57.023 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:03:57.023 18:52:17 -- spdk/autotest.sh@128 -- # uname -s 00:03:57.023 18:52:17 -- spdk/autotest.sh@128 -- # [[ Linux == Linux ]] 00:03:57.023 18:52:17 -- spdk/autotest.sh@130 -- # nvme_namespace_revert 00:03:57.023 18:52:17 -- common/autotest_common.sh@1526 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:58.407 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:58.407 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:58.407 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:58.407 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:58.407 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:58.407 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:58.407 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:58.407 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:58.407 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:03:58.407 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:03:58.407 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:03:58.407 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:03:58.407 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:03:58.407 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:03:58.407 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:03:58.407 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:03:59.350 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:03:59.350 18:52:20 -- common/autotest_common.sh@1527 -- # sleep 1 00:04:00.734 18:52:21 -- common/autotest_common.sh@1528 -- # bdfs=() 00:04:00.734 18:52:21 -- common/autotest_common.sh@1528 -- # local bdfs 00:04:00.734 18:52:21 -- common/autotest_common.sh@1529 -- # bdfs=($(get_nvme_bdfs)) 00:04:00.734 18:52:21 -- common/autotest_common.sh@1529 -- # get_nvme_bdfs 00:04:00.734 18:52:21 -- common/autotest_common.sh@1508 -- # bdfs=() 00:04:00.734 18:52:21 -- common/autotest_common.sh@1508 -- # local bdfs 00:04:00.734 18:52:21 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:04:00.734 18:52:21 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:04:00.734 18:52:21 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:04:00.734 18:52:21 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:04:00.734 18:52:21 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:04:00.734 18:52:21 -- common/autotest_common.sh@1531 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:01.678 Waiting for block devices as requested 00:04:01.678 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:04:01.939 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:04:01.939 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:04:01.939 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:04:02.201 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:04:02.201 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:04:02.201 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:04:02.201 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:04:02.462 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:04:02.462 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:04:02.462 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:04:02.462 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:04:02.753 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:04:02.753 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:04:02.753 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:04:02.753 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:04:03.015 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:04:03.015 18:52:23 -- common/autotest_common.sh@1533 -- # for bdf in "${bdfs[@]}" 00:04:03.015 18:52:23 -- common/autotest_common.sh@1534 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:04:03.015 18:52:23 -- common/autotest_common.sh@1497 -- # readlink -f /sys/class/nvme/nvme0 00:04:03.015 18:52:23 -- common/autotest_common.sh@1497 -- # grep 0000:88:00.0/nvme/nvme 00:04:03.015 18:52:23 -- common/autotest_common.sh@1497 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:04:03.015 18:52:23 -- common/autotest_common.sh@1498 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:04:03.015 18:52:23 -- common/autotest_common.sh@1502 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:04:03.015 18:52:23 -- common/autotest_common.sh@1502 -- # printf '%s\n' nvme0 00:04:03.015 18:52:23 -- common/autotest_common.sh@1534 -- # nvme_ctrlr=/dev/nvme0 00:04:03.015 18:52:23 -- common/autotest_common.sh@1535 -- # [[ -z /dev/nvme0 ]] 00:04:03.015 18:52:23 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:04:03.015 18:52:23 -- common/autotest_common.sh@1540 -- # grep oacs 00:04:03.015 18:52:23 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:04:03.015 18:52:23 -- common/autotest_common.sh@1540 -- # oacs=' 0xf' 00:04:03.015 18:52:23 -- common/autotest_common.sh@1541 -- # oacs_ns_manage=8 00:04:03.015 18:52:23 -- common/autotest_common.sh@1543 -- # [[ 8 -ne 0 ]] 00:04:03.015 18:52:23 -- common/autotest_common.sh@1549 -- # nvme id-ctrl /dev/nvme0 00:04:03.015 18:52:23 -- common/autotest_common.sh@1549 -- # grep unvmcap 00:04:03.015 18:52:23 -- common/autotest_common.sh@1549 -- # cut -d: -f2 00:04:03.015 18:52:23 -- common/autotest_common.sh@1549 -- # unvmcap=' 0' 00:04:03.015 18:52:23 -- common/autotest_common.sh@1550 -- # [[ 0 -eq 0 ]] 00:04:03.015 18:52:23 -- common/autotest_common.sh@1552 -- # continue 00:04:03.015 18:52:23 -- spdk/autotest.sh@133 -- # timing_exit pre_cleanup 00:04:03.015 18:52:23 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:03.015 18:52:23 -- common/autotest_common.sh@10 -- # set +x 00:04:03.015 18:52:23 -- spdk/autotest.sh@136 -- # timing_enter afterboot 00:04:03.015 18:52:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:03.015 18:52:23 -- common/autotest_common.sh@10 -- # set +x 00:04:03.015 18:52:23 -- spdk/autotest.sh@137 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:04.403 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:04.403 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:04.403 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:04.403 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:04.403 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:04.403 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:04.403 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:04.403 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:04.403 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:04.403 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:04.403 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:04.403 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:04.403 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:04.403 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:04.403 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:04.403 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:05.344 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:05.344 18:52:26 -- spdk/autotest.sh@138 -- # timing_exit afterboot 00:04:05.344 18:52:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:05.344 18:52:26 -- common/autotest_common.sh@10 -- # set +x 00:04:05.344 18:52:26 -- spdk/autotest.sh@142 -- # opal_revert_cleanup 00:04:05.344 18:52:26 -- common/autotest_common.sh@1586 -- # mapfile -t bdfs 00:04:05.344 18:52:26 -- common/autotest_common.sh@1586 -- # get_nvme_bdfs_by_id 0x0a54 00:04:05.344 18:52:26 -- common/autotest_common.sh@1572 -- # bdfs=() 00:04:05.344 18:52:26 -- common/autotest_common.sh@1572 -- # local bdfs 00:04:05.344 18:52:26 -- common/autotest_common.sh@1574 -- # get_nvme_bdfs 00:04:05.344 18:52:26 -- common/autotest_common.sh@1508 -- # bdfs=() 00:04:05.344 18:52:26 -- common/autotest_common.sh@1508 -- # local bdfs 00:04:05.344 18:52:26 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:04:05.345 18:52:26 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:04:05.345 18:52:26 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:04:05.603 18:52:26 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:04:05.603 18:52:26 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:04:05.603 18:52:26 -- common/autotest_common.sh@1574 -- # for bdf in $(get_nvme_bdfs) 00:04:05.603 18:52:26 -- common/autotest_common.sh@1575 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:04:05.603 18:52:26 -- common/autotest_common.sh@1575 -- # device=0x0a54 00:04:05.603 18:52:26 -- common/autotest_common.sh@1576 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:04:05.603 18:52:26 -- common/autotest_common.sh@1577 -- # bdfs+=($bdf) 00:04:05.603 18:52:26 -- common/autotest_common.sh@1581 -- # printf '%s\n' 0000:88:00.0 00:04:05.603 18:52:26 -- common/autotest_common.sh@1587 -- # [[ -z 0000:88:00.0 ]] 00:04:05.603 18:52:26 -- common/autotest_common.sh@1592 -- # spdk_tgt_pid=78249 00:04:05.603 18:52:26 -- common/autotest_common.sh@1591 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:05.603 18:52:26 -- common/autotest_common.sh@1593 -- # waitforlisten 78249 00:04:05.603 18:52:26 -- common/autotest_common.sh@829 -- # '[' -z 78249 ']' 00:04:05.603 18:52:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:05.603 18:52:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:05.603 18:52:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:05.603 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:05.603 18:52:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:05.603 18:52:26 -- common/autotest_common.sh@10 -- # set +x 00:04:05.603 [2024-11-28 18:52:26.511567] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:05.603 [2024-11-28 18:52:26.511663] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid78249 ] 00:04:05.603 EAL: No free 2048 kB hugepages reported on node 1 00:04:05.603 [2024-11-28 18:52:26.571768] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:05.862 [2024-11-28 18:52:26.681432] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:05.862 [2024-11-28 18:52:26.681606] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:06.428 18:52:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:06.428 18:52:27 -- common/autotest_common.sh@862 -- # return 0 00:04:06.428 18:52:27 -- common/autotest_common.sh@1595 -- # bdf_id=0 00:04:06.428 18:52:27 -- common/autotest_common.sh@1596 -- # for bdf in "${bdfs[@]}" 00:04:06.429 18:52:27 -- common/autotest_common.sh@1597 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:04:09.720 nvme0n1 00:04:09.720 18:52:30 -- common/autotest_common.sh@1599 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:04:09.720 [2024-11-28 18:52:30.763102] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:04:09.720 [2024-11-28 18:52:30.763145] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:04:09.720 request: 00:04:09.720 { 00:04:09.720 "nvme_ctrlr_name": "nvme0", 00:04:09.720 "password": "test", 00:04:09.720 "method": "bdev_nvme_opal_revert", 00:04:09.720 "req_id": 1 00:04:09.720 } 00:04:09.720 Got JSON-RPC error response 00:04:09.720 response: 00:04:09.720 { 00:04:09.720 "code": -32603, 00:04:09.720 "message": "Internal error" 00:04:09.720 } 00:04:09.979 18:52:30 -- common/autotest_common.sh@1599 -- # true 00:04:09.979 18:52:30 -- common/autotest_common.sh@1600 -- # (( ++bdf_id )) 00:04:09.979 18:52:30 -- common/autotest_common.sh@1603 -- # killprocess 78249 00:04:09.979 18:52:30 -- common/autotest_common.sh@936 -- # '[' -z 78249 ']' 00:04:09.979 18:52:30 -- common/autotest_common.sh@940 -- # kill -0 78249 00:04:09.979 18:52:30 -- common/autotest_common.sh@941 -- # uname 00:04:09.979 18:52:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:09.979 18:52:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 78249 00:04:09.979 18:52:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:09.979 18:52:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:09.979 18:52:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 78249' 00:04:09.979 killing process with pid 78249 00:04:09.979 18:52:30 -- common/autotest_common.sh@955 -- # kill 78249 00:04:09.979 18:52:30 -- common/autotest_common.sh@960 -- # wait 78249 00:04:11.882 18:52:32 -- spdk/autotest.sh@148 -- # '[' 0 -eq 1 ']' 00:04:11.882 18:52:32 -- spdk/autotest.sh@152 -- # '[' 1 -eq 1 ']' 00:04:11.882 18:52:32 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:04:11.882 18:52:32 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:04:11.882 18:52:32 -- spdk/autotest.sh@160 -- # timing_enter lib 00:04:11.882 18:52:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:11.882 18:52:32 -- common/autotest_common.sh@10 -- # set +x 00:04:11.882 18:52:32 -- spdk/autotest.sh@162 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:04:11.882 18:52:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:11.882 18:52:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:11.882 18:52:32 -- common/autotest_common.sh@10 -- # set +x 00:04:11.882 ************************************ 00:04:11.882 START TEST env 00:04:11.882 ************************************ 00:04:11.882 18:52:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:04:11.882 * Looking for test storage... 00:04:11.882 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:04:11.882 18:52:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:11.882 18:52:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:11.882 18:52:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:11.882 18:52:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:11.882 18:52:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:11.882 18:52:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:11.882 18:52:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:11.882 18:52:32 -- scripts/common.sh@335 -- # IFS=.-: 00:04:11.882 18:52:32 -- scripts/common.sh@335 -- # read -ra ver1 00:04:11.882 18:52:32 -- scripts/common.sh@336 -- # IFS=.-: 00:04:11.882 18:52:32 -- scripts/common.sh@336 -- # read -ra ver2 00:04:11.882 18:52:32 -- scripts/common.sh@337 -- # local 'op=<' 00:04:11.882 18:52:32 -- scripts/common.sh@339 -- # ver1_l=2 00:04:11.882 18:52:32 -- scripts/common.sh@340 -- # ver2_l=1 00:04:11.882 18:52:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:11.882 18:52:32 -- scripts/common.sh@343 -- # case "$op" in 00:04:11.882 18:52:32 -- scripts/common.sh@344 -- # : 1 00:04:11.882 18:52:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:11.882 18:52:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:11.882 18:52:32 -- scripts/common.sh@364 -- # decimal 1 00:04:11.882 18:52:32 -- scripts/common.sh@352 -- # local d=1 00:04:11.882 18:52:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:11.882 18:52:32 -- scripts/common.sh@354 -- # echo 1 00:04:11.882 18:52:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:11.882 18:52:32 -- scripts/common.sh@365 -- # decimal 2 00:04:11.882 18:52:32 -- scripts/common.sh@352 -- # local d=2 00:04:11.882 18:52:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:11.882 18:52:32 -- scripts/common.sh@354 -- # echo 2 00:04:11.882 18:52:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:11.882 18:52:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:11.882 18:52:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:11.882 18:52:32 -- scripts/common.sh@367 -- # return 0 00:04:11.882 18:52:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:11.882 18:52:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:11.882 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:11.882 --rc genhtml_branch_coverage=1 00:04:11.882 --rc genhtml_function_coverage=1 00:04:11.882 --rc genhtml_legend=1 00:04:11.882 --rc geninfo_all_blocks=1 00:04:11.882 --rc geninfo_unexecuted_blocks=1 00:04:11.882 00:04:11.882 ' 00:04:11.882 18:52:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:11.882 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:11.882 --rc genhtml_branch_coverage=1 00:04:11.882 --rc genhtml_function_coverage=1 00:04:11.882 --rc genhtml_legend=1 00:04:11.882 --rc geninfo_all_blocks=1 00:04:11.882 --rc geninfo_unexecuted_blocks=1 00:04:11.882 00:04:11.882 ' 00:04:11.882 18:52:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:11.882 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:11.882 --rc genhtml_branch_coverage=1 00:04:11.882 --rc genhtml_function_coverage=1 00:04:11.882 --rc genhtml_legend=1 00:04:11.882 --rc geninfo_all_blocks=1 00:04:11.882 --rc geninfo_unexecuted_blocks=1 00:04:11.882 00:04:11.882 ' 00:04:11.882 18:52:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:11.882 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:11.882 --rc genhtml_branch_coverage=1 00:04:11.882 --rc genhtml_function_coverage=1 00:04:11.882 --rc genhtml_legend=1 00:04:11.882 --rc geninfo_all_blocks=1 00:04:11.882 --rc geninfo_unexecuted_blocks=1 00:04:11.882 00:04:11.882 ' 00:04:11.882 18:52:32 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:04:11.882 18:52:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:11.882 18:52:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:11.882 18:52:32 -- common/autotest_common.sh@10 -- # set +x 00:04:11.882 ************************************ 00:04:11.882 START TEST env_memory 00:04:11.882 ************************************ 00:04:11.882 18:52:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:04:11.882 00:04:11.882 00:04:11.882 CUnit - A unit testing framework for C - Version 2.1-3 00:04:11.882 http://cunit.sourceforge.net/ 00:04:11.882 00:04:11.882 00:04:11.882 Suite: memory 00:04:11.882 Test: alloc and free memory map ...[2024-11-28 18:52:32.755171] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:04:11.882 passed 00:04:11.882 Test: mem map translation ...[2024-11-28 18:52:32.774682] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:04:11.882 [2024-11-28 18:52:32.774704] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:04:11.882 [2024-11-28 18:52:32.774744] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:04:11.882 [2024-11-28 18:52:32.774757] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:04:11.882 passed 00:04:11.882 Test: mem map registration ...[2024-11-28 18:52:32.815433] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:04:11.882 [2024-11-28 18:52:32.815453] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:04:11.882 passed 00:04:11.882 Test: mem map adjacent registrations ...passed 00:04:11.882 00:04:11.883 Run Summary: Type Total Ran Passed Failed Inactive 00:04:11.883 suites 1 1 n/a 0 0 00:04:11.883 tests 4 4 4 0 0 00:04:11.883 asserts 152 152 152 0 n/a 00:04:11.883 00:04:11.883 Elapsed time = 0.136 seconds 00:04:11.883 00:04:11.883 real 0m0.145s 00:04:11.883 user 0m0.137s 00:04:11.883 sys 0m0.007s 00:04:11.883 18:52:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:11.883 18:52:32 -- common/autotest_common.sh@10 -- # set +x 00:04:11.883 ************************************ 00:04:11.883 END TEST env_memory 00:04:11.883 ************************************ 00:04:11.883 18:52:32 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:11.883 18:52:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:11.883 18:52:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:11.883 18:52:32 -- common/autotest_common.sh@10 -- # set +x 00:04:11.883 ************************************ 00:04:11.883 START TEST env_vtophys 00:04:11.883 ************************************ 00:04:11.883 18:52:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:11.883 EAL: lib.eal log level changed from notice to debug 00:04:11.883 EAL: Detected lcore 0 as core 0 on socket 0 00:04:11.883 EAL: Detected lcore 1 as core 1 on socket 0 00:04:11.883 EAL: Detected lcore 2 as core 2 on socket 0 00:04:11.883 EAL: Detected lcore 3 as core 3 on socket 0 00:04:11.883 EAL: Detected lcore 4 as core 4 on socket 0 00:04:11.883 EAL: Detected lcore 5 as core 5 on socket 0 00:04:11.883 EAL: Detected lcore 6 as core 8 on socket 0 00:04:11.883 EAL: Detected lcore 7 as core 9 on socket 0 00:04:11.883 EAL: Detected lcore 8 as core 10 on socket 0 00:04:11.883 EAL: Detected lcore 9 as core 11 on socket 0 00:04:11.883 EAL: Detected lcore 10 as core 12 on socket 0 00:04:11.883 EAL: Detected lcore 11 as core 13 on socket 0 00:04:11.883 EAL: Detected lcore 12 as core 0 on socket 1 00:04:11.883 EAL: Detected lcore 13 as core 1 on socket 1 00:04:11.883 EAL: Detected lcore 14 as core 2 on socket 1 00:04:11.883 EAL: Detected lcore 15 as core 3 on socket 1 00:04:11.883 EAL: Detected lcore 16 as core 4 on socket 1 00:04:11.883 EAL: Detected lcore 17 as core 5 on socket 1 00:04:11.883 EAL: Detected lcore 18 as core 8 on socket 1 00:04:11.883 EAL: Detected lcore 19 as core 9 on socket 1 00:04:11.883 EAL: Detected lcore 20 as core 10 on socket 1 00:04:11.883 EAL: Detected lcore 21 as core 11 on socket 1 00:04:11.883 EAL: Detected lcore 22 as core 12 on socket 1 00:04:11.883 EAL: Detected lcore 23 as core 13 on socket 1 00:04:11.883 EAL: Detected lcore 24 as core 0 on socket 0 00:04:11.883 EAL: Detected lcore 25 as core 1 on socket 0 00:04:11.883 EAL: Detected lcore 26 as core 2 on socket 0 00:04:11.883 EAL: Detected lcore 27 as core 3 on socket 0 00:04:11.883 EAL: Detected lcore 28 as core 4 on socket 0 00:04:11.883 EAL: Detected lcore 29 as core 5 on socket 0 00:04:11.883 EAL: Detected lcore 30 as core 8 on socket 0 00:04:11.883 EAL: Detected lcore 31 as core 9 on socket 0 00:04:11.883 EAL: Detected lcore 32 as core 10 on socket 0 00:04:11.883 EAL: Detected lcore 33 as core 11 on socket 0 00:04:11.883 EAL: Detected lcore 34 as core 12 on socket 0 00:04:11.883 EAL: Detected lcore 35 as core 13 on socket 0 00:04:11.883 EAL: Detected lcore 36 as core 0 on socket 1 00:04:11.883 EAL: Detected lcore 37 as core 1 on socket 1 00:04:11.883 EAL: Detected lcore 38 as core 2 on socket 1 00:04:11.883 EAL: Detected lcore 39 as core 3 on socket 1 00:04:11.883 EAL: Detected lcore 40 as core 4 on socket 1 00:04:11.883 EAL: Detected lcore 41 as core 5 on socket 1 00:04:11.883 EAL: Detected lcore 42 as core 8 on socket 1 00:04:11.883 EAL: Detected lcore 43 as core 9 on socket 1 00:04:11.883 EAL: Detected lcore 44 as core 10 on socket 1 00:04:11.883 EAL: Detected lcore 45 as core 11 on socket 1 00:04:11.883 EAL: Detected lcore 46 as core 12 on socket 1 00:04:11.883 EAL: Detected lcore 47 as core 13 on socket 1 00:04:11.883 EAL: Maximum logical cores by configuration: 128 00:04:11.883 EAL: Detected CPU lcores: 48 00:04:11.883 EAL: Detected NUMA nodes: 2 00:04:11.883 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:04:11.883 EAL: Detected shared linkage of DPDK 00:04:11.883 EAL: No shared files mode enabled, IPC will be disabled 00:04:12.142 EAL: Bus pci wants IOVA as 'DC' 00:04:12.142 EAL: Buses did not request a specific IOVA mode. 00:04:12.142 EAL: IOMMU is available, selecting IOVA as VA mode. 00:04:12.142 EAL: Selected IOVA mode 'VA' 00:04:12.142 EAL: No free 2048 kB hugepages reported on node 1 00:04:12.142 EAL: Probing VFIO support... 00:04:12.142 EAL: IOMMU type 1 (Type 1) is supported 00:04:12.142 EAL: IOMMU type 7 (sPAPR) is not supported 00:04:12.142 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:04:12.142 EAL: VFIO support initialized 00:04:12.142 EAL: Ask a virtual area of 0x2e000 bytes 00:04:12.142 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:04:12.142 EAL: Setting up physically contiguous memory... 00:04:12.142 EAL: Setting maximum number of open files to 524288 00:04:12.142 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:04:12.142 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:04:12.142 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:04:12.142 EAL: Ask a virtual area of 0x61000 bytes 00:04:12.142 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:04:12.142 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:12.142 EAL: Ask a virtual area of 0x400000000 bytes 00:04:12.142 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:04:12.142 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:04:12.142 EAL: Ask a virtual area of 0x61000 bytes 00:04:12.142 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:04:12.142 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:12.142 EAL: Ask a virtual area of 0x400000000 bytes 00:04:12.142 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:04:12.142 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:04:12.142 EAL: Ask a virtual area of 0x61000 bytes 00:04:12.142 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:04:12.142 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:12.142 EAL: Ask a virtual area of 0x400000000 bytes 00:04:12.142 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:04:12.142 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:04:12.142 EAL: Ask a virtual area of 0x61000 bytes 00:04:12.142 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:04:12.142 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:12.142 EAL: Ask a virtual area of 0x400000000 bytes 00:04:12.142 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:04:12.142 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:04:12.142 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:04:12.142 EAL: Ask a virtual area of 0x61000 bytes 00:04:12.142 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:04:12.142 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:12.142 EAL: Ask a virtual area of 0x400000000 bytes 00:04:12.142 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:04:12.142 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:04:12.142 EAL: Ask a virtual area of 0x61000 bytes 00:04:12.142 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:04:12.142 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:12.142 EAL: Ask a virtual area of 0x400000000 bytes 00:04:12.142 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:04:12.142 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:04:12.142 EAL: Ask a virtual area of 0x61000 bytes 00:04:12.142 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:04:12.142 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:12.142 EAL: Ask a virtual area of 0x400000000 bytes 00:04:12.142 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:04:12.142 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:04:12.142 EAL: Ask a virtual area of 0x61000 bytes 00:04:12.142 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:04:12.142 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:12.142 EAL: Ask a virtual area of 0x400000000 bytes 00:04:12.142 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:04:12.142 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:04:12.142 EAL: Hugepages will be freed exactly as allocated. 00:04:12.142 EAL: No shared files mode enabled, IPC is disabled 00:04:12.142 EAL: No shared files mode enabled, IPC is disabled 00:04:12.142 EAL: TSC frequency is ~2700000 KHz 00:04:12.142 EAL: Main lcore 0 is ready (tid=7f535f837a00;cpuset=[0]) 00:04:12.142 EAL: Trying to obtain current memory policy. 00:04:12.142 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:12.142 EAL: Restoring previous memory policy: 0 00:04:12.142 EAL: request: mp_malloc_sync 00:04:12.142 EAL: No shared files mode enabled, IPC is disabled 00:04:12.142 EAL: Heap on socket 0 was expanded by 2MB 00:04:12.142 EAL: No shared files mode enabled, IPC is disabled 00:04:12.142 EAL: No PCI address specified using 'addr=' in: bus=pci 00:04:12.142 EAL: Mem event callback 'spdk:(nil)' registered 00:04:12.142 00:04:12.142 00:04:12.142 CUnit - A unit testing framework for C - Version 2.1-3 00:04:12.142 http://cunit.sourceforge.net/ 00:04:12.142 00:04:12.142 00:04:12.142 Suite: components_suite 00:04:12.142 Test: vtophys_malloc_test ...passed 00:04:12.142 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:04:12.142 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:12.142 EAL: Restoring previous memory policy: 4 00:04:12.142 EAL: Calling mem event callback 'spdk:(nil)' 00:04:12.142 EAL: request: mp_malloc_sync 00:04:12.142 EAL: No shared files mode enabled, IPC is disabled 00:04:12.142 EAL: Heap on socket 0 was expanded by 4MB 00:04:12.142 EAL: Calling mem event callback 'spdk:(nil)' 00:04:12.142 EAL: request: mp_malloc_sync 00:04:12.142 EAL: No shared files mode enabled, IPC is disabled 00:04:12.142 EAL: Heap on socket 0 was shrunk by 4MB 00:04:12.142 EAL: Trying to obtain current memory policy. 00:04:12.142 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:12.142 EAL: Restoring previous memory policy: 4 00:04:12.142 EAL: Calling mem event callback 'spdk:(nil)' 00:04:12.142 EAL: request: mp_malloc_sync 00:04:12.142 EAL: No shared files mode enabled, IPC is disabled 00:04:12.142 EAL: Heap on socket 0 was expanded by 6MB 00:04:12.142 EAL: Calling mem event callback 'spdk:(nil)' 00:04:12.142 EAL: request: mp_malloc_sync 00:04:12.142 EAL: No shared files mode enabled, IPC is disabled 00:04:12.142 EAL: Heap on socket 0 was shrunk by 6MB 00:04:12.142 EAL: Trying to obtain current memory policy. 00:04:12.142 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:12.142 EAL: Restoring previous memory policy: 4 00:04:12.142 EAL: Calling mem event callback 'spdk:(nil)' 00:04:12.142 EAL: request: mp_malloc_sync 00:04:12.142 EAL: No shared files mode enabled, IPC is disabled 00:04:12.142 EAL: Heap on socket 0 was expanded by 10MB 00:04:12.142 EAL: Calling mem event callback 'spdk:(nil)' 00:04:12.142 EAL: request: mp_malloc_sync 00:04:12.143 EAL: No shared files mode enabled, IPC is disabled 00:04:12.143 EAL: Heap on socket 0 was shrunk by 10MB 00:04:12.143 EAL: Trying to obtain current memory policy. 00:04:12.143 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:12.143 EAL: Restoring previous memory policy: 4 00:04:12.143 EAL: Calling mem event callback 'spdk:(nil)' 00:04:12.143 EAL: request: mp_malloc_sync 00:04:12.143 EAL: No shared files mode enabled, IPC is disabled 00:04:12.143 EAL: Heap on socket 0 was expanded by 18MB 00:04:12.143 EAL: Calling mem event callback 'spdk:(nil)' 00:04:12.143 EAL: request: mp_malloc_sync 00:04:12.143 EAL: No shared files mode enabled, IPC is disabled 00:04:12.143 EAL: Heap on socket 0 was shrunk by 18MB 00:04:12.143 EAL: Trying to obtain current memory policy. 00:04:12.143 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:12.143 EAL: Restoring previous memory policy: 4 00:04:12.143 EAL: Calling mem event callback 'spdk:(nil)' 00:04:12.143 EAL: request: mp_malloc_sync 00:04:12.143 EAL: No shared files mode enabled, IPC is disabled 00:04:12.143 EAL: Heap on socket 0 was expanded by 34MB 00:04:12.143 EAL: Calling mem event callback 'spdk:(nil)' 00:04:12.143 EAL: request: mp_malloc_sync 00:04:12.143 EAL: No shared files mode enabled, IPC is disabled 00:04:12.143 EAL: Heap on socket 0 was shrunk by 34MB 00:04:12.143 EAL: Trying to obtain current memory policy. 00:04:12.143 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:12.143 EAL: Restoring previous memory policy: 4 00:04:12.143 EAL: Calling mem event callback 'spdk:(nil)' 00:04:12.143 EAL: request: mp_malloc_sync 00:04:12.143 EAL: No shared files mode enabled, IPC is disabled 00:04:12.143 EAL: Heap on socket 0 was expanded by 66MB 00:04:12.143 EAL: Calling mem event callback 'spdk:(nil)' 00:04:12.143 EAL: request: mp_malloc_sync 00:04:12.143 EAL: No shared files mode enabled, IPC is disabled 00:04:12.143 EAL: Heap on socket 0 was shrunk by 66MB 00:04:12.143 EAL: Trying to obtain current memory policy. 00:04:12.143 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:12.143 EAL: Restoring previous memory policy: 4 00:04:12.143 EAL: Calling mem event callback 'spdk:(nil)' 00:04:12.143 EAL: request: mp_malloc_sync 00:04:12.143 EAL: No shared files mode enabled, IPC is disabled 00:04:12.143 EAL: Heap on socket 0 was expanded by 130MB 00:04:12.143 EAL: Calling mem event callback 'spdk:(nil)' 00:04:12.143 EAL: request: mp_malloc_sync 00:04:12.143 EAL: No shared files mode enabled, IPC is disabled 00:04:12.143 EAL: Heap on socket 0 was shrunk by 130MB 00:04:12.143 EAL: Trying to obtain current memory policy. 00:04:12.143 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:12.143 EAL: Restoring previous memory policy: 4 00:04:12.143 EAL: Calling mem event callback 'spdk:(nil)' 00:04:12.143 EAL: request: mp_malloc_sync 00:04:12.143 EAL: No shared files mode enabled, IPC is disabled 00:04:12.143 EAL: Heap on socket 0 was expanded by 258MB 00:04:12.402 EAL: Calling mem event callback 'spdk:(nil)' 00:04:12.402 EAL: request: mp_malloc_sync 00:04:12.402 EAL: No shared files mode enabled, IPC is disabled 00:04:12.402 EAL: Heap on socket 0 was shrunk by 258MB 00:04:12.402 EAL: Trying to obtain current memory policy. 00:04:12.402 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:12.402 EAL: Restoring previous memory policy: 4 00:04:12.402 EAL: Calling mem event callback 'spdk:(nil)' 00:04:12.402 EAL: request: mp_malloc_sync 00:04:12.402 EAL: No shared files mode enabled, IPC is disabled 00:04:12.402 EAL: Heap on socket 0 was expanded by 514MB 00:04:12.660 EAL: Calling mem event callback 'spdk:(nil)' 00:04:12.660 EAL: request: mp_malloc_sync 00:04:12.660 EAL: No shared files mode enabled, IPC is disabled 00:04:12.660 EAL: Heap on socket 0 was shrunk by 514MB 00:04:12.660 EAL: Trying to obtain current memory policy. 00:04:12.660 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:12.918 EAL: Restoring previous memory policy: 4 00:04:12.918 EAL: Calling mem event callback 'spdk:(nil)' 00:04:12.918 EAL: request: mp_malloc_sync 00:04:12.918 EAL: No shared files mode enabled, IPC is disabled 00:04:12.918 EAL: Heap on socket 0 was expanded by 1026MB 00:04:13.176 EAL: Calling mem event callback 'spdk:(nil)' 00:04:13.435 EAL: request: mp_malloc_sync 00:04:13.435 EAL: No shared files mode enabled, IPC is disabled 00:04:13.435 EAL: Heap on socket 0 was shrunk by 1026MB 00:04:13.435 passed 00:04:13.435 00:04:13.435 Run Summary: Type Total Ran Passed Failed Inactive 00:04:13.435 suites 1 1 n/a 0 0 00:04:13.435 tests 2 2 2 0 0 00:04:13.435 asserts 497 497 497 0 n/a 00:04:13.435 00:04:13.435 Elapsed time = 1.288 seconds 00:04:13.435 EAL: Calling mem event callback 'spdk:(nil)' 00:04:13.435 EAL: request: mp_malloc_sync 00:04:13.435 EAL: No shared files mode enabled, IPC is disabled 00:04:13.435 EAL: Heap on socket 0 was shrunk by 2MB 00:04:13.435 EAL: No shared files mode enabled, IPC is disabled 00:04:13.435 EAL: No shared files mode enabled, IPC is disabled 00:04:13.435 EAL: No shared files mode enabled, IPC is disabled 00:04:13.435 00:04:13.435 real 0m1.399s 00:04:13.435 user 0m0.814s 00:04:13.435 sys 0m0.551s 00:04:13.435 18:52:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:13.435 18:52:34 -- common/autotest_common.sh@10 -- # set +x 00:04:13.435 ************************************ 00:04:13.435 END TEST env_vtophys 00:04:13.435 ************************************ 00:04:13.435 18:52:34 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:04:13.435 18:52:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:13.435 18:52:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:13.435 18:52:34 -- common/autotest_common.sh@10 -- # set +x 00:04:13.435 ************************************ 00:04:13.435 START TEST env_pci 00:04:13.435 ************************************ 00:04:13.435 18:52:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:04:13.435 00:04:13.435 00:04:13.435 CUnit - A unit testing framework for C - Version 2.1-3 00:04:13.435 http://cunit.sourceforge.net/ 00:04:13.435 00:04:13.435 00:04:13.435 Suite: pci 00:04:13.436 Test: pci_hook ...[2024-11-28 18:52:34.338342] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 79292 has claimed it 00:04:13.436 EAL: Cannot find device (10000:00:01.0) 00:04:13.436 EAL: Failed to attach device on primary process 00:04:13.436 passed 00:04:13.436 00:04:13.436 Run Summary: Type Total Ran Passed Failed Inactive 00:04:13.436 suites 1 1 n/a 0 0 00:04:13.436 tests 1 1 1 0 0 00:04:13.436 asserts 25 25 25 0 n/a 00:04:13.436 00:04:13.436 Elapsed time = 0.022 seconds 00:04:13.436 00:04:13.436 real 0m0.035s 00:04:13.436 user 0m0.013s 00:04:13.436 sys 0m0.022s 00:04:13.436 18:52:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:13.436 18:52:34 -- common/autotest_common.sh@10 -- # set +x 00:04:13.436 ************************************ 00:04:13.436 END TEST env_pci 00:04:13.436 ************************************ 00:04:13.436 18:52:34 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:04:13.436 18:52:34 -- env/env.sh@15 -- # uname 00:04:13.436 18:52:34 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:04:13.436 18:52:34 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:04:13.436 18:52:34 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:13.436 18:52:34 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:04:13.436 18:52:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:13.436 18:52:34 -- common/autotest_common.sh@10 -- # set +x 00:04:13.436 ************************************ 00:04:13.436 START TEST env_dpdk_post_init 00:04:13.436 ************************************ 00:04:13.436 18:52:34 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:13.436 EAL: Detected CPU lcores: 48 00:04:13.436 EAL: Detected NUMA nodes: 2 00:04:13.436 EAL: Detected shared linkage of DPDK 00:04:13.436 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:13.436 EAL: Selected IOVA mode 'VA' 00:04:13.436 EAL: No free 2048 kB hugepages reported on node 1 00:04:13.436 EAL: VFIO support initialized 00:04:13.436 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:13.697 EAL: Using IOMMU type 1 (Type 1) 00:04:13.697 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:04:13.697 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:04:13.697 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:04:13.697 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:04:13.697 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:04:13.697 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:04:13.697 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:04:13.697 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:04:13.697 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:04:13.697 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:04:13.697 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:04:13.697 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:04:13.697 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:04:13.697 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:04:13.697 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:04:13.697 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:04:14.637 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:04:17.915 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:04:17.915 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:04:17.915 Starting DPDK initialization... 00:04:17.915 Starting SPDK post initialization... 00:04:17.916 SPDK NVMe probe 00:04:17.916 Attaching to 0000:88:00.0 00:04:17.916 Attached to 0000:88:00.0 00:04:17.916 Cleaning up... 00:04:17.916 00:04:17.916 real 0m4.395s 00:04:17.916 user 0m3.282s 00:04:17.916 sys 0m0.174s 00:04:17.916 18:52:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:17.916 18:52:38 -- common/autotest_common.sh@10 -- # set +x 00:04:17.916 ************************************ 00:04:17.916 END TEST env_dpdk_post_init 00:04:17.916 ************************************ 00:04:17.916 18:52:38 -- env/env.sh@26 -- # uname 00:04:17.916 18:52:38 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:04:17.916 18:52:38 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:17.916 18:52:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:17.916 18:52:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:17.916 18:52:38 -- common/autotest_common.sh@10 -- # set +x 00:04:17.916 ************************************ 00:04:17.916 START TEST env_mem_callbacks 00:04:17.916 ************************************ 00:04:17.916 18:52:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:17.916 EAL: Detected CPU lcores: 48 00:04:17.916 EAL: Detected NUMA nodes: 2 00:04:17.916 EAL: Detected shared linkage of DPDK 00:04:17.916 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:17.916 EAL: Selected IOVA mode 'VA' 00:04:17.916 EAL: No free 2048 kB hugepages reported on node 1 00:04:17.916 EAL: VFIO support initialized 00:04:17.916 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:17.916 00:04:17.916 00:04:17.916 CUnit - A unit testing framework for C - Version 2.1-3 00:04:17.916 http://cunit.sourceforge.net/ 00:04:17.916 00:04:17.916 00:04:17.916 Suite: memory 00:04:17.916 Test: test ... 00:04:17.916 register 0x200000200000 2097152 00:04:17.916 malloc 3145728 00:04:17.916 register 0x200000400000 4194304 00:04:17.916 buf 0x200000500000 len 3145728 PASSED 00:04:17.916 malloc 64 00:04:17.916 buf 0x2000004fff40 len 64 PASSED 00:04:17.916 malloc 4194304 00:04:17.916 register 0x200000800000 6291456 00:04:17.916 buf 0x200000a00000 len 4194304 PASSED 00:04:17.916 free 0x200000500000 3145728 00:04:17.916 free 0x2000004fff40 64 00:04:17.916 unregister 0x200000400000 4194304 PASSED 00:04:17.916 free 0x200000a00000 4194304 00:04:17.916 unregister 0x200000800000 6291456 PASSED 00:04:17.916 malloc 8388608 00:04:17.916 register 0x200000400000 10485760 00:04:17.916 buf 0x200000600000 len 8388608 PASSED 00:04:17.916 free 0x200000600000 8388608 00:04:17.916 unregister 0x200000400000 10485760 PASSED 00:04:17.916 passed 00:04:17.916 00:04:17.916 Run Summary: Type Total Ran Passed Failed Inactive 00:04:17.916 suites 1 1 n/a 0 0 00:04:17.916 tests 1 1 1 0 0 00:04:17.916 asserts 15 15 15 0 n/a 00:04:17.916 00:04:17.916 Elapsed time = 0.005 seconds 00:04:17.916 00:04:17.916 real 0m0.048s 00:04:17.916 user 0m0.016s 00:04:17.916 sys 0m0.032s 00:04:17.916 18:52:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:17.916 18:52:38 -- common/autotest_common.sh@10 -- # set +x 00:04:17.916 ************************************ 00:04:17.916 END TEST env_mem_callbacks 00:04:17.916 ************************************ 00:04:17.916 00:04:17.916 real 0m6.309s 00:04:17.916 user 0m4.428s 00:04:17.916 sys 0m0.938s 00:04:17.916 18:52:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:17.916 18:52:38 -- common/autotest_common.sh@10 -- # set +x 00:04:17.916 ************************************ 00:04:17.916 END TEST env 00:04:17.916 ************************************ 00:04:17.916 18:52:38 -- spdk/autotest.sh@163 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:17.916 18:52:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:17.916 18:52:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:17.916 18:52:38 -- common/autotest_common.sh@10 -- # set +x 00:04:17.916 ************************************ 00:04:17.916 START TEST rpc 00:04:17.916 ************************************ 00:04:17.916 18:52:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:17.916 * Looking for test storage... 00:04:18.175 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:18.175 18:52:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:18.175 18:52:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:18.175 18:52:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:18.175 18:52:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:18.175 18:52:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:18.175 18:52:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:18.175 18:52:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:18.175 18:52:39 -- scripts/common.sh@335 -- # IFS=.-: 00:04:18.175 18:52:39 -- scripts/common.sh@335 -- # read -ra ver1 00:04:18.175 18:52:39 -- scripts/common.sh@336 -- # IFS=.-: 00:04:18.175 18:52:39 -- scripts/common.sh@336 -- # read -ra ver2 00:04:18.175 18:52:39 -- scripts/common.sh@337 -- # local 'op=<' 00:04:18.175 18:52:39 -- scripts/common.sh@339 -- # ver1_l=2 00:04:18.175 18:52:39 -- scripts/common.sh@340 -- # ver2_l=1 00:04:18.175 18:52:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:18.175 18:52:39 -- scripts/common.sh@343 -- # case "$op" in 00:04:18.175 18:52:39 -- scripts/common.sh@344 -- # : 1 00:04:18.175 18:52:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:18.175 18:52:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:18.175 18:52:39 -- scripts/common.sh@364 -- # decimal 1 00:04:18.175 18:52:39 -- scripts/common.sh@352 -- # local d=1 00:04:18.175 18:52:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:18.175 18:52:39 -- scripts/common.sh@354 -- # echo 1 00:04:18.175 18:52:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:18.175 18:52:39 -- scripts/common.sh@365 -- # decimal 2 00:04:18.175 18:52:39 -- scripts/common.sh@352 -- # local d=2 00:04:18.175 18:52:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:18.175 18:52:39 -- scripts/common.sh@354 -- # echo 2 00:04:18.175 18:52:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:18.175 18:52:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:18.175 18:52:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:18.175 18:52:39 -- scripts/common.sh@367 -- # return 0 00:04:18.175 18:52:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:18.175 18:52:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:18.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:18.175 --rc genhtml_branch_coverage=1 00:04:18.175 --rc genhtml_function_coverage=1 00:04:18.175 --rc genhtml_legend=1 00:04:18.175 --rc geninfo_all_blocks=1 00:04:18.175 --rc geninfo_unexecuted_blocks=1 00:04:18.175 00:04:18.175 ' 00:04:18.175 18:52:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:18.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:18.175 --rc genhtml_branch_coverage=1 00:04:18.175 --rc genhtml_function_coverage=1 00:04:18.175 --rc genhtml_legend=1 00:04:18.175 --rc geninfo_all_blocks=1 00:04:18.175 --rc geninfo_unexecuted_blocks=1 00:04:18.175 00:04:18.175 ' 00:04:18.175 18:52:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:18.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:18.175 --rc genhtml_branch_coverage=1 00:04:18.175 --rc genhtml_function_coverage=1 00:04:18.175 --rc genhtml_legend=1 00:04:18.175 --rc geninfo_all_blocks=1 00:04:18.175 --rc geninfo_unexecuted_blocks=1 00:04:18.175 00:04:18.175 ' 00:04:18.175 18:52:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:18.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:18.175 --rc genhtml_branch_coverage=1 00:04:18.175 --rc genhtml_function_coverage=1 00:04:18.175 --rc genhtml_legend=1 00:04:18.175 --rc geninfo_all_blocks=1 00:04:18.175 --rc geninfo_unexecuted_blocks=1 00:04:18.175 00:04:18.175 ' 00:04:18.175 18:52:39 -- rpc/rpc.sh@65 -- # spdk_pid=79967 00:04:18.175 18:52:39 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:04:18.175 18:52:39 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:18.175 18:52:39 -- rpc/rpc.sh@67 -- # waitforlisten 79967 00:04:18.175 18:52:39 -- common/autotest_common.sh@829 -- # '[' -z 79967 ']' 00:04:18.175 18:52:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:18.175 18:52:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:18.175 18:52:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:18.175 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:18.175 18:52:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:18.175 18:52:39 -- common/autotest_common.sh@10 -- # set +x 00:04:18.175 [2024-11-28 18:52:39.090823] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:18.175 [2024-11-28 18:52:39.090903] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid79967 ] 00:04:18.175 EAL: No free 2048 kB hugepages reported on node 1 00:04:18.175 [2024-11-28 18:52:39.149040] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:18.434 [2024-11-28 18:52:39.255985] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:18.434 [2024-11-28 18:52:39.256149] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:04:18.434 [2024-11-28 18:52:39.256170] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 79967' to capture a snapshot of events at runtime. 00:04:18.434 [2024-11-28 18:52:39.256182] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid79967 for offline analysis/debug. 00:04:18.434 [2024-11-28 18:52:39.256213] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:19.367 18:52:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:19.367 18:52:40 -- common/autotest_common.sh@862 -- # return 0 00:04:19.367 18:52:40 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:19.367 18:52:40 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:19.367 18:52:40 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:04:19.367 18:52:40 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:04:19.367 18:52:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:19.367 18:52:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:19.367 18:52:40 -- common/autotest_common.sh@10 -- # set +x 00:04:19.367 ************************************ 00:04:19.367 START TEST rpc_integrity 00:04:19.367 ************************************ 00:04:19.367 18:52:40 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:04:19.367 18:52:40 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:19.367 18:52:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:19.367 18:52:40 -- common/autotest_common.sh@10 -- # set +x 00:04:19.367 18:52:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:19.367 18:52:40 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:19.367 18:52:40 -- rpc/rpc.sh@13 -- # jq length 00:04:19.367 18:52:40 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:19.367 18:52:40 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:19.368 18:52:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:19.368 18:52:40 -- common/autotest_common.sh@10 -- # set +x 00:04:19.368 18:52:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:19.368 18:52:40 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:04:19.368 18:52:40 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:19.368 18:52:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:19.368 18:52:40 -- common/autotest_common.sh@10 -- # set +x 00:04:19.368 18:52:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:19.368 18:52:40 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:19.368 { 00:04:19.368 "name": "Malloc0", 00:04:19.368 "aliases": [ 00:04:19.368 "6168c385-9e0f-41d6-af7f-a6fdf917fa9a" 00:04:19.368 ], 00:04:19.368 "product_name": "Malloc disk", 00:04:19.368 "block_size": 512, 00:04:19.368 "num_blocks": 16384, 00:04:19.368 "uuid": "6168c385-9e0f-41d6-af7f-a6fdf917fa9a", 00:04:19.368 "assigned_rate_limits": { 00:04:19.368 "rw_ios_per_sec": 0, 00:04:19.368 "rw_mbytes_per_sec": 0, 00:04:19.368 "r_mbytes_per_sec": 0, 00:04:19.368 "w_mbytes_per_sec": 0 00:04:19.368 }, 00:04:19.368 "claimed": false, 00:04:19.368 "zoned": false, 00:04:19.368 "supported_io_types": { 00:04:19.368 "read": true, 00:04:19.368 "write": true, 00:04:19.368 "unmap": true, 00:04:19.368 "write_zeroes": true, 00:04:19.368 "flush": true, 00:04:19.368 "reset": true, 00:04:19.368 "compare": false, 00:04:19.368 "compare_and_write": false, 00:04:19.368 "abort": true, 00:04:19.368 "nvme_admin": false, 00:04:19.368 "nvme_io": false 00:04:19.368 }, 00:04:19.368 "memory_domains": [ 00:04:19.368 { 00:04:19.368 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:19.368 "dma_device_type": 2 00:04:19.368 } 00:04:19.368 ], 00:04:19.368 "driver_specific": {} 00:04:19.368 } 00:04:19.368 ]' 00:04:19.368 18:52:40 -- rpc/rpc.sh@17 -- # jq length 00:04:19.368 18:52:40 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:19.368 18:52:40 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:04:19.368 18:52:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:19.368 18:52:40 -- common/autotest_common.sh@10 -- # set +x 00:04:19.368 [2024-11-28 18:52:40.160260] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:04:19.368 [2024-11-28 18:52:40.160314] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:19.368 [2024-11-28 18:52:40.160335] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0xcd9cb0 00:04:19.368 [2024-11-28 18:52:40.160347] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:19.368 [2024-11-28 18:52:40.161608] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:19.368 [2024-11-28 18:52:40.161640] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:19.368 Passthru0 00:04:19.368 18:52:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:19.368 18:52:40 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:19.368 18:52:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:19.368 18:52:40 -- common/autotest_common.sh@10 -- # set +x 00:04:19.368 18:52:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:19.368 18:52:40 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:19.368 { 00:04:19.368 "name": "Malloc0", 00:04:19.368 "aliases": [ 00:04:19.368 "6168c385-9e0f-41d6-af7f-a6fdf917fa9a" 00:04:19.368 ], 00:04:19.368 "product_name": "Malloc disk", 00:04:19.368 "block_size": 512, 00:04:19.368 "num_blocks": 16384, 00:04:19.368 "uuid": "6168c385-9e0f-41d6-af7f-a6fdf917fa9a", 00:04:19.368 "assigned_rate_limits": { 00:04:19.368 "rw_ios_per_sec": 0, 00:04:19.368 "rw_mbytes_per_sec": 0, 00:04:19.368 "r_mbytes_per_sec": 0, 00:04:19.368 "w_mbytes_per_sec": 0 00:04:19.368 }, 00:04:19.368 "claimed": true, 00:04:19.368 "claim_type": "exclusive_write", 00:04:19.368 "zoned": false, 00:04:19.368 "supported_io_types": { 00:04:19.368 "read": true, 00:04:19.368 "write": true, 00:04:19.368 "unmap": true, 00:04:19.368 "write_zeroes": true, 00:04:19.368 "flush": true, 00:04:19.368 "reset": true, 00:04:19.368 "compare": false, 00:04:19.368 "compare_and_write": false, 00:04:19.368 "abort": true, 00:04:19.368 "nvme_admin": false, 00:04:19.368 "nvme_io": false 00:04:19.368 }, 00:04:19.368 "memory_domains": [ 00:04:19.368 { 00:04:19.368 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:19.368 "dma_device_type": 2 00:04:19.368 } 00:04:19.368 ], 00:04:19.368 "driver_specific": {} 00:04:19.368 }, 00:04:19.368 { 00:04:19.368 "name": "Passthru0", 00:04:19.368 "aliases": [ 00:04:19.368 "51598a30-5785-5b7e-b436-68fb7e450020" 00:04:19.368 ], 00:04:19.368 "product_name": "passthru", 00:04:19.368 "block_size": 512, 00:04:19.368 "num_blocks": 16384, 00:04:19.368 "uuid": "51598a30-5785-5b7e-b436-68fb7e450020", 00:04:19.368 "assigned_rate_limits": { 00:04:19.368 "rw_ios_per_sec": 0, 00:04:19.368 "rw_mbytes_per_sec": 0, 00:04:19.368 "r_mbytes_per_sec": 0, 00:04:19.368 "w_mbytes_per_sec": 0 00:04:19.368 }, 00:04:19.368 "claimed": false, 00:04:19.368 "zoned": false, 00:04:19.368 "supported_io_types": { 00:04:19.368 "read": true, 00:04:19.368 "write": true, 00:04:19.368 "unmap": true, 00:04:19.368 "write_zeroes": true, 00:04:19.368 "flush": true, 00:04:19.368 "reset": true, 00:04:19.368 "compare": false, 00:04:19.368 "compare_and_write": false, 00:04:19.368 "abort": true, 00:04:19.368 "nvme_admin": false, 00:04:19.368 "nvme_io": false 00:04:19.368 }, 00:04:19.368 "memory_domains": [ 00:04:19.368 { 00:04:19.368 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:19.368 "dma_device_type": 2 00:04:19.368 } 00:04:19.368 ], 00:04:19.368 "driver_specific": { 00:04:19.368 "passthru": { 00:04:19.368 "name": "Passthru0", 00:04:19.368 "base_bdev_name": "Malloc0" 00:04:19.368 } 00:04:19.368 } 00:04:19.368 } 00:04:19.368 ]' 00:04:19.368 18:52:40 -- rpc/rpc.sh@21 -- # jq length 00:04:19.368 18:52:40 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:19.368 18:52:40 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:19.368 18:52:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:19.368 18:52:40 -- common/autotest_common.sh@10 -- # set +x 00:04:19.368 18:52:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:19.368 18:52:40 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:04:19.368 18:52:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:19.368 18:52:40 -- common/autotest_common.sh@10 -- # set +x 00:04:19.368 18:52:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:19.368 18:52:40 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:19.368 18:52:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:19.368 18:52:40 -- common/autotest_common.sh@10 -- # set +x 00:04:19.368 18:52:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:19.368 18:52:40 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:19.368 18:52:40 -- rpc/rpc.sh@26 -- # jq length 00:04:19.368 18:52:40 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:19.368 00:04:19.368 real 0m0.206s 00:04:19.368 user 0m0.129s 00:04:19.368 sys 0m0.022s 00:04:19.368 18:52:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:19.368 18:52:40 -- common/autotest_common.sh@10 -- # set +x 00:04:19.368 ************************************ 00:04:19.368 END TEST rpc_integrity 00:04:19.368 ************************************ 00:04:19.368 18:52:40 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:04:19.368 18:52:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:19.368 18:52:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:19.368 18:52:40 -- common/autotest_common.sh@10 -- # set +x 00:04:19.368 ************************************ 00:04:19.368 START TEST rpc_plugins 00:04:19.368 ************************************ 00:04:19.368 18:52:40 -- common/autotest_common.sh@1114 -- # rpc_plugins 00:04:19.368 18:52:40 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:04:19.368 18:52:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:19.368 18:52:40 -- common/autotest_common.sh@10 -- # set +x 00:04:19.368 18:52:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:19.368 18:52:40 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:04:19.368 18:52:40 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:04:19.368 18:52:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:19.368 18:52:40 -- common/autotest_common.sh@10 -- # set +x 00:04:19.368 18:52:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:19.368 18:52:40 -- rpc/rpc.sh@31 -- # bdevs='[ 00:04:19.368 { 00:04:19.368 "name": "Malloc1", 00:04:19.368 "aliases": [ 00:04:19.368 "c51d69eb-8982-4f69-aa10-01982ed8ad6d" 00:04:19.368 ], 00:04:19.368 "product_name": "Malloc disk", 00:04:19.368 "block_size": 4096, 00:04:19.368 "num_blocks": 256, 00:04:19.368 "uuid": "c51d69eb-8982-4f69-aa10-01982ed8ad6d", 00:04:19.368 "assigned_rate_limits": { 00:04:19.368 "rw_ios_per_sec": 0, 00:04:19.368 "rw_mbytes_per_sec": 0, 00:04:19.369 "r_mbytes_per_sec": 0, 00:04:19.369 "w_mbytes_per_sec": 0 00:04:19.369 }, 00:04:19.369 "claimed": false, 00:04:19.369 "zoned": false, 00:04:19.369 "supported_io_types": { 00:04:19.369 "read": true, 00:04:19.369 "write": true, 00:04:19.369 "unmap": true, 00:04:19.369 "write_zeroes": true, 00:04:19.369 "flush": true, 00:04:19.369 "reset": true, 00:04:19.369 "compare": false, 00:04:19.369 "compare_and_write": false, 00:04:19.369 "abort": true, 00:04:19.369 "nvme_admin": false, 00:04:19.369 "nvme_io": false 00:04:19.369 }, 00:04:19.369 "memory_domains": [ 00:04:19.369 { 00:04:19.369 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:19.369 "dma_device_type": 2 00:04:19.369 } 00:04:19.369 ], 00:04:19.369 "driver_specific": {} 00:04:19.369 } 00:04:19.369 ]' 00:04:19.369 18:52:40 -- rpc/rpc.sh@32 -- # jq length 00:04:19.369 18:52:40 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:04:19.369 18:52:40 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:04:19.369 18:52:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:19.369 18:52:40 -- common/autotest_common.sh@10 -- # set +x 00:04:19.369 18:52:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:19.369 18:52:40 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:04:19.369 18:52:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:19.369 18:52:40 -- common/autotest_common.sh@10 -- # set +x 00:04:19.369 18:52:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:19.369 18:52:40 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:04:19.369 18:52:40 -- rpc/rpc.sh@36 -- # jq length 00:04:19.369 18:52:40 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:04:19.369 00:04:19.369 real 0m0.106s 00:04:19.369 user 0m0.067s 00:04:19.369 sys 0m0.009s 00:04:19.369 18:52:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:19.369 18:52:40 -- common/autotest_common.sh@10 -- # set +x 00:04:19.369 ************************************ 00:04:19.369 END TEST rpc_plugins 00:04:19.369 ************************************ 00:04:19.626 18:52:40 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:04:19.626 18:52:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:19.626 18:52:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:19.626 18:52:40 -- common/autotest_common.sh@10 -- # set +x 00:04:19.626 ************************************ 00:04:19.626 START TEST rpc_trace_cmd_test 00:04:19.626 ************************************ 00:04:19.627 18:52:40 -- common/autotest_common.sh@1114 -- # rpc_trace_cmd_test 00:04:19.627 18:52:40 -- rpc/rpc.sh@40 -- # local info 00:04:19.627 18:52:40 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:04:19.627 18:52:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:19.627 18:52:40 -- common/autotest_common.sh@10 -- # set +x 00:04:19.627 18:52:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:19.627 18:52:40 -- rpc/rpc.sh@42 -- # info='{ 00:04:19.627 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid79967", 00:04:19.627 "tpoint_group_mask": "0x8", 00:04:19.627 "iscsi_conn": { 00:04:19.627 "mask": "0x2", 00:04:19.627 "tpoint_mask": "0x0" 00:04:19.627 }, 00:04:19.627 "scsi": { 00:04:19.627 "mask": "0x4", 00:04:19.627 "tpoint_mask": "0x0" 00:04:19.627 }, 00:04:19.627 "bdev": { 00:04:19.627 "mask": "0x8", 00:04:19.627 "tpoint_mask": "0xffffffffffffffff" 00:04:19.627 }, 00:04:19.627 "nvmf_rdma": { 00:04:19.627 "mask": "0x10", 00:04:19.627 "tpoint_mask": "0x0" 00:04:19.627 }, 00:04:19.627 "nvmf_tcp": { 00:04:19.627 "mask": "0x20", 00:04:19.627 "tpoint_mask": "0x0" 00:04:19.627 }, 00:04:19.627 "ftl": { 00:04:19.627 "mask": "0x40", 00:04:19.627 "tpoint_mask": "0x0" 00:04:19.627 }, 00:04:19.627 "blobfs": { 00:04:19.627 "mask": "0x80", 00:04:19.627 "tpoint_mask": "0x0" 00:04:19.627 }, 00:04:19.627 "dsa": { 00:04:19.627 "mask": "0x200", 00:04:19.627 "tpoint_mask": "0x0" 00:04:19.627 }, 00:04:19.627 "thread": { 00:04:19.627 "mask": "0x400", 00:04:19.627 "tpoint_mask": "0x0" 00:04:19.627 }, 00:04:19.627 "nvme_pcie": { 00:04:19.627 "mask": "0x800", 00:04:19.627 "tpoint_mask": "0x0" 00:04:19.627 }, 00:04:19.627 "iaa": { 00:04:19.627 "mask": "0x1000", 00:04:19.627 "tpoint_mask": "0x0" 00:04:19.627 }, 00:04:19.627 "nvme_tcp": { 00:04:19.627 "mask": "0x2000", 00:04:19.627 "tpoint_mask": "0x0" 00:04:19.627 }, 00:04:19.627 "bdev_nvme": { 00:04:19.627 "mask": "0x4000", 00:04:19.627 "tpoint_mask": "0x0" 00:04:19.627 } 00:04:19.627 }' 00:04:19.627 18:52:40 -- rpc/rpc.sh@43 -- # jq length 00:04:19.627 18:52:40 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:04:19.627 18:52:40 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:04:19.627 18:52:40 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:04:19.627 18:52:40 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:04:19.627 18:52:40 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:04:19.627 18:52:40 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:04:19.627 18:52:40 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:04:19.627 18:52:40 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:04:19.627 18:52:40 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:04:19.627 00:04:19.627 real 0m0.175s 00:04:19.627 user 0m0.159s 00:04:19.627 sys 0m0.010s 00:04:19.627 18:52:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:19.627 18:52:40 -- common/autotest_common.sh@10 -- # set +x 00:04:19.627 ************************************ 00:04:19.627 END TEST rpc_trace_cmd_test 00:04:19.627 ************************************ 00:04:19.627 18:52:40 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:04:19.627 18:52:40 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:04:19.627 18:52:40 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:04:19.627 18:52:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:19.627 18:52:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:19.627 18:52:40 -- common/autotest_common.sh@10 -- # set +x 00:04:19.627 ************************************ 00:04:19.627 START TEST rpc_daemon_integrity 00:04:19.627 ************************************ 00:04:19.627 18:52:40 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:04:19.627 18:52:40 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:19.627 18:52:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:19.627 18:52:40 -- common/autotest_common.sh@10 -- # set +x 00:04:19.627 18:52:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:19.627 18:52:40 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:19.627 18:52:40 -- rpc/rpc.sh@13 -- # jq length 00:04:19.627 18:52:40 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:19.627 18:52:40 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:19.627 18:52:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:19.627 18:52:40 -- common/autotest_common.sh@10 -- # set +x 00:04:19.885 18:52:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:19.885 18:52:40 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:04:19.885 18:52:40 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:19.885 18:52:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:19.885 18:52:40 -- common/autotest_common.sh@10 -- # set +x 00:04:19.885 18:52:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:19.885 18:52:40 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:19.885 { 00:04:19.885 "name": "Malloc2", 00:04:19.885 "aliases": [ 00:04:19.885 "92d6a89b-542e-461b-a4b4-0283eab8bed5" 00:04:19.885 ], 00:04:19.885 "product_name": "Malloc disk", 00:04:19.885 "block_size": 512, 00:04:19.885 "num_blocks": 16384, 00:04:19.885 "uuid": "92d6a89b-542e-461b-a4b4-0283eab8bed5", 00:04:19.885 "assigned_rate_limits": { 00:04:19.885 "rw_ios_per_sec": 0, 00:04:19.885 "rw_mbytes_per_sec": 0, 00:04:19.885 "r_mbytes_per_sec": 0, 00:04:19.885 "w_mbytes_per_sec": 0 00:04:19.885 }, 00:04:19.885 "claimed": false, 00:04:19.885 "zoned": false, 00:04:19.885 "supported_io_types": { 00:04:19.885 "read": true, 00:04:19.885 "write": true, 00:04:19.885 "unmap": true, 00:04:19.885 "write_zeroes": true, 00:04:19.885 "flush": true, 00:04:19.885 "reset": true, 00:04:19.885 "compare": false, 00:04:19.885 "compare_and_write": false, 00:04:19.885 "abort": true, 00:04:19.885 "nvme_admin": false, 00:04:19.885 "nvme_io": false 00:04:19.885 }, 00:04:19.885 "memory_domains": [ 00:04:19.885 { 00:04:19.885 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:19.885 "dma_device_type": 2 00:04:19.885 } 00:04:19.885 ], 00:04:19.885 "driver_specific": {} 00:04:19.885 } 00:04:19.885 ]' 00:04:19.885 18:52:40 -- rpc/rpc.sh@17 -- # jq length 00:04:19.885 18:52:40 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:19.885 18:52:40 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:04:19.885 18:52:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:19.885 18:52:40 -- common/autotest_common.sh@10 -- # set +x 00:04:19.885 [2024-11-28 18:52:40.725882] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:04:19.886 [2024-11-28 18:52:40.725921] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:19.886 [2024-11-28 18:52:40.725955] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0xcdb590 00:04:19.886 [2024-11-28 18:52:40.725967] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:19.886 [2024-11-28 18:52:40.727076] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:19.886 [2024-11-28 18:52:40.727097] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:19.886 Passthru0 00:04:19.886 18:52:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:19.886 18:52:40 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:19.886 18:52:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:19.886 18:52:40 -- common/autotest_common.sh@10 -- # set +x 00:04:19.886 18:52:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:19.886 18:52:40 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:19.886 { 00:04:19.886 "name": "Malloc2", 00:04:19.886 "aliases": [ 00:04:19.886 "92d6a89b-542e-461b-a4b4-0283eab8bed5" 00:04:19.886 ], 00:04:19.886 "product_name": "Malloc disk", 00:04:19.886 "block_size": 512, 00:04:19.886 "num_blocks": 16384, 00:04:19.886 "uuid": "92d6a89b-542e-461b-a4b4-0283eab8bed5", 00:04:19.886 "assigned_rate_limits": { 00:04:19.886 "rw_ios_per_sec": 0, 00:04:19.886 "rw_mbytes_per_sec": 0, 00:04:19.886 "r_mbytes_per_sec": 0, 00:04:19.886 "w_mbytes_per_sec": 0 00:04:19.886 }, 00:04:19.886 "claimed": true, 00:04:19.886 "claim_type": "exclusive_write", 00:04:19.886 "zoned": false, 00:04:19.886 "supported_io_types": { 00:04:19.886 "read": true, 00:04:19.886 "write": true, 00:04:19.886 "unmap": true, 00:04:19.886 "write_zeroes": true, 00:04:19.886 "flush": true, 00:04:19.886 "reset": true, 00:04:19.886 "compare": false, 00:04:19.886 "compare_and_write": false, 00:04:19.886 "abort": true, 00:04:19.886 "nvme_admin": false, 00:04:19.886 "nvme_io": false 00:04:19.886 }, 00:04:19.886 "memory_domains": [ 00:04:19.886 { 00:04:19.886 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:19.886 "dma_device_type": 2 00:04:19.886 } 00:04:19.886 ], 00:04:19.886 "driver_specific": {} 00:04:19.886 }, 00:04:19.886 { 00:04:19.886 "name": "Passthru0", 00:04:19.886 "aliases": [ 00:04:19.886 "e67b2032-36da-549f-9804-f2adbfd014d9" 00:04:19.886 ], 00:04:19.886 "product_name": "passthru", 00:04:19.886 "block_size": 512, 00:04:19.886 "num_blocks": 16384, 00:04:19.886 "uuid": "e67b2032-36da-549f-9804-f2adbfd014d9", 00:04:19.886 "assigned_rate_limits": { 00:04:19.886 "rw_ios_per_sec": 0, 00:04:19.886 "rw_mbytes_per_sec": 0, 00:04:19.886 "r_mbytes_per_sec": 0, 00:04:19.886 "w_mbytes_per_sec": 0 00:04:19.886 }, 00:04:19.886 "claimed": false, 00:04:19.886 "zoned": false, 00:04:19.886 "supported_io_types": { 00:04:19.886 "read": true, 00:04:19.886 "write": true, 00:04:19.886 "unmap": true, 00:04:19.886 "write_zeroes": true, 00:04:19.886 "flush": true, 00:04:19.886 "reset": true, 00:04:19.886 "compare": false, 00:04:19.886 "compare_and_write": false, 00:04:19.886 "abort": true, 00:04:19.886 "nvme_admin": false, 00:04:19.886 "nvme_io": false 00:04:19.886 }, 00:04:19.886 "memory_domains": [ 00:04:19.886 { 00:04:19.886 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:19.886 "dma_device_type": 2 00:04:19.886 } 00:04:19.886 ], 00:04:19.886 "driver_specific": { 00:04:19.886 "passthru": { 00:04:19.886 "name": "Passthru0", 00:04:19.886 "base_bdev_name": "Malloc2" 00:04:19.886 } 00:04:19.886 } 00:04:19.886 } 00:04:19.886 ]' 00:04:19.886 18:52:40 -- rpc/rpc.sh@21 -- # jq length 00:04:19.886 18:52:40 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:19.886 18:52:40 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:19.886 18:52:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:19.886 18:52:40 -- common/autotest_common.sh@10 -- # set +x 00:04:19.886 18:52:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:19.886 18:52:40 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:04:19.886 18:52:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:19.886 18:52:40 -- common/autotest_common.sh@10 -- # set +x 00:04:19.886 18:52:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:19.886 18:52:40 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:19.886 18:52:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:19.886 18:52:40 -- common/autotest_common.sh@10 -- # set +x 00:04:19.886 18:52:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:19.886 18:52:40 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:19.886 18:52:40 -- rpc/rpc.sh@26 -- # jq length 00:04:19.886 18:52:40 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:19.886 00:04:19.886 real 0m0.213s 00:04:19.886 user 0m0.137s 00:04:19.886 sys 0m0.016s 00:04:19.886 18:52:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:19.886 18:52:40 -- common/autotest_common.sh@10 -- # set +x 00:04:19.886 ************************************ 00:04:19.886 END TEST rpc_daemon_integrity 00:04:19.886 ************************************ 00:04:19.886 18:52:40 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:04:19.886 18:52:40 -- rpc/rpc.sh@84 -- # killprocess 79967 00:04:19.886 18:52:40 -- common/autotest_common.sh@936 -- # '[' -z 79967 ']' 00:04:19.886 18:52:40 -- common/autotest_common.sh@940 -- # kill -0 79967 00:04:19.886 18:52:40 -- common/autotest_common.sh@941 -- # uname 00:04:19.886 18:52:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:19.886 18:52:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 79967 00:04:19.886 18:52:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:19.886 18:52:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:19.886 18:52:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 79967' 00:04:19.886 killing process with pid 79967 00:04:19.886 18:52:40 -- common/autotest_common.sh@955 -- # kill 79967 00:04:19.886 18:52:40 -- common/autotest_common.sh@960 -- # wait 79967 00:04:20.453 00:04:20.453 real 0m2.406s 00:04:20.453 user 0m2.998s 00:04:20.453 sys 0m0.592s 00:04:20.453 18:52:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:20.453 18:52:41 -- common/autotest_common.sh@10 -- # set +x 00:04:20.453 ************************************ 00:04:20.453 END TEST rpc 00:04:20.453 ************************************ 00:04:20.453 18:52:41 -- spdk/autotest.sh@164 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:20.453 18:52:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:20.453 18:52:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:20.453 18:52:41 -- common/autotest_common.sh@10 -- # set +x 00:04:20.453 ************************************ 00:04:20.453 START TEST rpc_client 00:04:20.453 ************************************ 00:04:20.453 18:52:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:20.453 * Looking for test storage... 00:04:20.453 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:04:20.453 18:52:41 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:20.453 18:52:41 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:20.453 18:52:41 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:20.453 18:52:41 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:20.453 18:52:41 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:20.453 18:52:41 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:20.453 18:52:41 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:20.453 18:52:41 -- scripts/common.sh@335 -- # IFS=.-: 00:04:20.453 18:52:41 -- scripts/common.sh@335 -- # read -ra ver1 00:04:20.453 18:52:41 -- scripts/common.sh@336 -- # IFS=.-: 00:04:20.453 18:52:41 -- scripts/common.sh@336 -- # read -ra ver2 00:04:20.453 18:52:41 -- scripts/common.sh@337 -- # local 'op=<' 00:04:20.453 18:52:41 -- scripts/common.sh@339 -- # ver1_l=2 00:04:20.453 18:52:41 -- scripts/common.sh@340 -- # ver2_l=1 00:04:20.453 18:52:41 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:20.453 18:52:41 -- scripts/common.sh@343 -- # case "$op" in 00:04:20.453 18:52:41 -- scripts/common.sh@344 -- # : 1 00:04:20.453 18:52:41 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:20.453 18:52:41 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:20.453 18:52:41 -- scripts/common.sh@364 -- # decimal 1 00:04:20.453 18:52:41 -- scripts/common.sh@352 -- # local d=1 00:04:20.453 18:52:41 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:20.453 18:52:41 -- scripts/common.sh@354 -- # echo 1 00:04:20.454 18:52:41 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:20.454 18:52:41 -- scripts/common.sh@365 -- # decimal 2 00:04:20.454 18:52:41 -- scripts/common.sh@352 -- # local d=2 00:04:20.454 18:52:41 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:20.454 18:52:41 -- scripts/common.sh@354 -- # echo 2 00:04:20.454 18:52:41 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:20.454 18:52:41 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:20.454 18:52:41 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:20.454 18:52:41 -- scripts/common.sh@367 -- # return 0 00:04:20.454 18:52:41 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:20.454 18:52:41 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:20.454 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:20.454 --rc genhtml_branch_coverage=1 00:04:20.454 --rc genhtml_function_coverage=1 00:04:20.454 --rc genhtml_legend=1 00:04:20.454 --rc geninfo_all_blocks=1 00:04:20.454 --rc geninfo_unexecuted_blocks=1 00:04:20.454 00:04:20.454 ' 00:04:20.454 18:52:41 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:20.454 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:20.454 --rc genhtml_branch_coverage=1 00:04:20.454 --rc genhtml_function_coverage=1 00:04:20.454 --rc genhtml_legend=1 00:04:20.454 --rc geninfo_all_blocks=1 00:04:20.454 --rc geninfo_unexecuted_blocks=1 00:04:20.454 00:04:20.454 ' 00:04:20.454 18:52:41 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:20.454 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:20.454 --rc genhtml_branch_coverage=1 00:04:20.454 --rc genhtml_function_coverage=1 00:04:20.454 --rc genhtml_legend=1 00:04:20.454 --rc geninfo_all_blocks=1 00:04:20.454 --rc geninfo_unexecuted_blocks=1 00:04:20.454 00:04:20.454 ' 00:04:20.454 18:52:41 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:20.454 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:20.454 --rc genhtml_branch_coverage=1 00:04:20.454 --rc genhtml_function_coverage=1 00:04:20.454 --rc genhtml_legend=1 00:04:20.454 --rc geninfo_all_blocks=1 00:04:20.454 --rc geninfo_unexecuted_blocks=1 00:04:20.454 00:04:20.454 ' 00:04:20.454 18:52:41 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:04:20.713 OK 00:04:20.713 18:52:41 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:04:20.713 00:04:20.713 real 0m0.156s 00:04:20.713 user 0m0.100s 00:04:20.713 sys 0m0.066s 00:04:20.713 18:52:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:20.713 18:52:41 -- common/autotest_common.sh@10 -- # set +x 00:04:20.713 ************************************ 00:04:20.713 END TEST rpc_client 00:04:20.713 ************************************ 00:04:20.713 18:52:41 -- spdk/autotest.sh@165 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:20.713 18:52:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:20.713 18:52:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:20.713 18:52:41 -- common/autotest_common.sh@10 -- # set +x 00:04:20.713 ************************************ 00:04:20.713 START TEST json_config 00:04:20.713 ************************************ 00:04:20.713 18:52:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:20.713 18:52:41 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:20.713 18:52:41 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:20.713 18:52:41 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:20.713 18:52:41 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:20.713 18:52:41 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:20.713 18:52:41 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:20.713 18:52:41 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:20.713 18:52:41 -- scripts/common.sh@335 -- # IFS=.-: 00:04:20.713 18:52:41 -- scripts/common.sh@335 -- # read -ra ver1 00:04:20.713 18:52:41 -- scripts/common.sh@336 -- # IFS=.-: 00:04:20.713 18:52:41 -- scripts/common.sh@336 -- # read -ra ver2 00:04:20.713 18:52:41 -- scripts/common.sh@337 -- # local 'op=<' 00:04:20.713 18:52:41 -- scripts/common.sh@339 -- # ver1_l=2 00:04:20.713 18:52:41 -- scripts/common.sh@340 -- # ver2_l=1 00:04:20.713 18:52:41 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:20.713 18:52:41 -- scripts/common.sh@343 -- # case "$op" in 00:04:20.713 18:52:41 -- scripts/common.sh@344 -- # : 1 00:04:20.713 18:52:41 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:20.713 18:52:41 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:20.713 18:52:41 -- scripts/common.sh@364 -- # decimal 1 00:04:20.713 18:52:41 -- scripts/common.sh@352 -- # local d=1 00:04:20.713 18:52:41 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:20.713 18:52:41 -- scripts/common.sh@354 -- # echo 1 00:04:20.713 18:52:41 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:20.713 18:52:41 -- scripts/common.sh@365 -- # decimal 2 00:04:20.713 18:52:41 -- scripts/common.sh@352 -- # local d=2 00:04:20.713 18:52:41 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:20.713 18:52:41 -- scripts/common.sh@354 -- # echo 2 00:04:20.713 18:52:41 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:20.713 18:52:41 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:20.713 18:52:41 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:20.713 18:52:41 -- scripts/common.sh@367 -- # return 0 00:04:20.713 18:52:41 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:20.713 18:52:41 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:20.713 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:20.713 --rc genhtml_branch_coverage=1 00:04:20.713 --rc genhtml_function_coverage=1 00:04:20.713 --rc genhtml_legend=1 00:04:20.713 --rc geninfo_all_blocks=1 00:04:20.713 --rc geninfo_unexecuted_blocks=1 00:04:20.713 00:04:20.713 ' 00:04:20.713 18:52:41 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:20.713 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:20.713 --rc genhtml_branch_coverage=1 00:04:20.713 --rc genhtml_function_coverage=1 00:04:20.713 --rc genhtml_legend=1 00:04:20.713 --rc geninfo_all_blocks=1 00:04:20.713 --rc geninfo_unexecuted_blocks=1 00:04:20.713 00:04:20.713 ' 00:04:20.713 18:52:41 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:20.713 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:20.713 --rc genhtml_branch_coverage=1 00:04:20.713 --rc genhtml_function_coverage=1 00:04:20.713 --rc genhtml_legend=1 00:04:20.713 --rc geninfo_all_blocks=1 00:04:20.713 --rc geninfo_unexecuted_blocks=1 00:04:20.713 00:04:20.713 ' 00:04:20.713 18:52:41 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:20.713 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:20.713 --rc genhtml_branch_coverage=1 00:04:20.713 --rc genhtml_function_coverage=1 00:04:20.713 --rc genhtml_legend=1 00:04:20.713 --rc geninfo_all_blocks=1 00:04:20.713 --rc geninfo_unexecuted_blocks=1 00:04:20.713 00:04:20.713 ' 00:04:20.713 18:52:41 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:20.713 18:52:41 -- nvmf/common.sh@7 -- # uname -s 00:04:20.713 18:52:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:20.713 18:52:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:20.713 18:52:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:20.714 18:52:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:20.714 18:52:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:20.714 18:52:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:20.714 18:52:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:20.714 18:52:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:20.714 18:52:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:20.714 18:52:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:20.714 18:52:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:20.714 18:52:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:20.714 18:52:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:20.714 18:52:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:20.714 18:52:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:20.714 18:52:41 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:20.714 18:52:41 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:20.714 18:52:41 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:20.714 18:52:41 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:20.714 18:52:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:20.714 18:52:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:20.714 18:52:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:20.714 18:52:41 -- paths/export.sh@5 -- # export PATH 00:04:20.714 18:52:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:20.714 18:52:41 -- nvmf/common.sh@46 -- # : 0 00:04:20.714 18:52:41 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:20.714 18:52:41 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:20.714 18:52:41 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:20.714 18:52:41 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:20.714 18:52:41 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:20.714 18:52:41 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:20.714 18:52:41 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:20.714 18:52:41 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:20.714 18:52:41 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:04:20.714 18:52:41 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:04:20.714 18:52:41 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:04:20.714 18:52:41 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:04:20.714 18:52:41 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:04:20.714 18:52:41 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:04:20.714 18:52:41 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:04:20.714 18:52:41 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:04:20.714 18:52:41 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:04:20.714 18:52:41 -- json_config/json_config.sh@32 -- # declare -A app_params 00:04:20.714 18:52:41 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:04:20.714 18:52:41 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:04:20.714 18:52:41 -- json_config/json_config.sh@43 -- # last_event_id=0 00:04:20.714 18:52:41 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:20.714 18:52:41 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:04:20.714 INFO: JSON configuration test init 00:04:20.714 18:52:41 -- json_config/json_config.sh@420 -- # json_config_test_init 00:04:20.714 18:52:41 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:04:20.714 18:52:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:20.714 18:52:41 -- common/autotest_common.sh@10 -- # set +x 00:04:20.714 18:52:41 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:04:20.714 18:52:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:20.714 18:52:41 -- common/autotest_common.sh@10 -- # set +x 00:04:20.714 18:52:41 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:04:20.714 18:52:41 -- json_config/json_config.sh@98 -- # local app=target 00:04:20.714 18:52:41 -- json_config/json_config.sh@99 -- # shift 00:04:20.714 18:52:41 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:20.714 18:52:41 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:20.714 18:52:41 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:20.714 18:52:41 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:20.714 18:52:41 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:20.714 18:52:41 -- json_config/json_config.sh@111 -- # app_pid[$app]=80466 00:04:20.714 18:52:41 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:04:20.714 18:52:41 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:20.714 Waiting for target to run... 00:04:20.714 18:52:41 -- json_config/json_config.sh@114 -- # waitforlisten 80466 /var/tmp/spdk_tgt.sock 00:04:20.714 18:52:41 -- common/autotest_common.sh@829 -- # '[' -z 80466 ']' 00:04:20.714 18:52:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:20.714 18:52:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:20.714 18:52:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:20.714 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:20.714 18:52:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:20.714 18:52:41 -- common/autotest_common.sh@10 -- # set +x 00:04:20.714 [2024-11-28 18:52:41.722724] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:20.714 [2024-11-28 18:52:41.722812] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid80466 ] 00:04:20.714 EAL: No free 2048 kB hugepages reported on node 1 00:04:21.281 [2024-11-28 18:52:42.055090] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:21.281 [2024-11-28 18:52:42.131911] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:21.281 [2024-11-28 18:52:42.132101] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:21.848 18:52:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:21.848 18:52:42 -- common/autotest_common.sh@862 -- # return 0 00:04:21.848 18:52:42 -- json_config/json_config.sh@115 -- # echo '' 00:04:21.848 00:04:21.848 18:52:42 -- json_config/json_config.sh@322 -- # create_accel_config 00:04:21.848 18:52:42 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:04:21.848 18:52:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:21.848 18:52:42 -- common/autotest_common.sh@10 -- # set +x 00:04:21.848 18:52:42 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:04:21.848 18:52:42 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:04:21.848 18:52:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:21.848 18:52:42 -- common/autotest_common.sh@10 -- # set +x 00:04:21.848 18:52:42 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:04:21.848 18:52:42 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:04:21.848 18:52:42 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:04:25.143 18:52:45 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:04:25.143 18:52:45 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:04:25.143 18:52:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:25.143 18:52:45 -- common/autotest_common.sh@10 -- # set +x 00:04:25.143 18:52:45 -- json_config/json_config.sh@48 -- # local ret=0 00:04:25.143 18:52:45 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:04:25.143 18:52:45 -- json_config/json_config.sh@49 -- # local enabled_types 00:04:25.143 18:52:45 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:04:25.143 18:52:45 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:04:25.143 18:52:45 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:04:25.143 18:52:46 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:04:25.143 18:52:46 -- json_config/json_config.sh@51 -- # local get_types 00:04:25.143 18:52:46 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:04:25.143 18:52:46 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:04:25.143 18:52:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:25.143 18:52:46 -- common/autotest_common.sh@10 -- # set +x 00:04:25.143 18:52:46 -- json_config/json_config.sh@58 -- # return 0 00:04:25.143 18:52:46 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:04:25.143 18:52:46 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:04:25.143 18:52:46 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:04:25.143 18:52:46 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:04:25.143 18:52:46 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:04:25.144 18:52:46 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:04:25.144 18:52:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:25.144 18:52:46 -- common/autotest_common.sh@10 -- # set +x 00:04:25.144 18:52:46 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:04:25.144 18:52:46 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:04:25.144 18:52:46 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:04:25.144 18:52:46 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:25.144 18:52:46 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:25.402 MallocForNvmf0 00:04:25.402 18:52:46 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:25.402 18:52:46 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:25.660 MallocForNvmf1 00:04:25.660 18:52:46 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:04:25.660 18:52:46 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:04:25.919 [2024-11-28 18:52:46.862066] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:25.919 18:52:46 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:25.919 18:52:46 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:26.177 18:52:47 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:26.177 18:52:47 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:26.435 18:52:47 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:26.435 18:52:47 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:26.694 18:52:47 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:26.694 18:52:47 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:26.952 [2024-11-28 18:52:47.869292] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:26.952 18:52:47 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:04:26.952 18:52:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:26.952 18:52:47 -- common/autotest_common.sh@10 -- # set +x 00:04:26.952 18:52:47 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:04:26.952 18:52:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:26.952 18:52:47 -- common/autotest_common.sh@10 -- # set +x 00:04:26.952 18:52:47 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:04:26.952 18:52:47 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:26.952 18:52:47 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:27.210 MallocBdevForConfigChangeCheck 00:04:27.210 18:52:48 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:04:27.210 18:52:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:27.210 18:52:48 -- common/autotest_common.sh@10 -- # set +x 00:04:27.210 18:52:48 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:04:27.210 18:52:48 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:27.806 18:52:48 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:04:27.806 INFO: shutting down applications... 00:04:27.806 18:52:48 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:04:27.806 18:52:48 -- json_config/json_config.sh@431 -- # json_config_clear target 00:04:27.806 18:52:48 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:04:27.806 18:52:48 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:04:29.180 Calling clear_iscsi_subsystem 00:04:29.180 Calling clear_nvmf_subsystem 00:04:29.180 Calling clear_nbd_subsystem 00:04:29.180 Calling clear_ublk_subsystem 00:04:29.180 Calling clear_vhost_blk_subsystem 00:04:29.180 Calling clear_vhost_scsi_subsystem 00:04:29.180 Calling clear_scheduler_subsystem 00:04:29.180 Calling clear_bdev_subsystem 00:04:29.180 Calling clear_accel_subsystem 00:04:29.180 Calling clear_vmd_subsystem 00:04:29.180 Calling clear_sock_subsystem 00:04:29.180 Calling clear_iobuf_subsystem 00:04:29.180 18:52:50 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:04:29.180 18:52:50 -- json_config/json_config.sh@396 -- # count=100 00:04:29.180 18:52:50 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:04:29.180 18:52:50 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:29.180 18:52:50 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:04:29.180 18:52:50 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:04:29.746 18:52:50 -- json_config/json_config.sh@398 -- # break 00:04:29.746 18:52:50 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:04:29.746 18:52:50 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:04:29.746 18:52:50 -- json_config/json_config.sh@120 -- # local app=target 00:04:29.747 18:52:50 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:04:29.747 18:52:50 -- json_config/json_config.sh@124 -- # [[ -n 80466 ]] 00:04:29.747 18:52:50 -- json_config/json_config.sh@127 -- # kill -SIGINT 80466 00:04:29.747 18:52:50 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:04:29.747 18:52:50 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:29.747 18:52:50 -- json_config/json_config.sh@130 -- # kill -0 80466 00:04:29.747 18:52:50 -- json_config/json_config.sh@134 -- # sleep 0.5 00:04:30.006 18:52:51 -- json_config/json_config.sh@129 -- # (( i++ )) 00:04:30.006 18:52:51 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:30.006 18:52:51 -- json_config/json_config.sh@130 -- # kill -0 80466 00:04:30.006 18:52:51 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:04:30.006 18:52:51 -- json_config/json_config.sh@132 -- # break 00:04:30.006 18:52:51 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:04:30.006 18:52:51 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:04:30.006 SPDK target shutdown done 00:04:30.006 18:52:51 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:04:30.006 INFO: relaunching applications... 00:04:30.006 18:52:51 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:30.006 18:52:51 -- json_config/json_config.sh@98 -- # local app=target 00:04:30.006 18:52:51 -- json_config/json_config.sh@99 -- # shift 00:04:30.006 18:52:51 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:30.006 18:52:51 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:30.006 18:52:51 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:30.006 18:52:51 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:30.006 18:52:51 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:30.006 18:52:51 -- json_config/json_config.sh@111 -- # app_pid[$app]=81690 00:04:30.006 18:52:51 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:30.006 18:52:51 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:30.006 Waiting for target to run... 00:04:30.006 18:52:51 -- json_config/json_config.sh@114 -- # waitforlisten 81690 /var/tmp/spdk_tgt.sock 00:04:30.006 18:52:51 -- common/autotest_common.sh@829 -- # '[' -z 81690 ']' 00:04:30.006 18:52:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:30.006 18:52:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:30.006 18:52:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:30.006 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:30.006 18:52:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:30.006 18:52:51 -- common/autotest_common.sh@10 -- # set +x 00:04:30.266 [2024-11-28 18:52:51.090539] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:30.266 [2024-11-28 18:52:51.090639] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid81690 ] 00:04:30.266 EAL: No free 2048 kB hugepages reported on node 1 00:04:30.833 [2024-11-28 18:52:51.617916] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:30.833 [2024-11-28 18:52:51.708620] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:30.833 [2024-11-28 18:52:51.708818] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:34.119 [2024-11-28 18:52:54.727362] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:34.119 [2024-11-28 18:52:54.759840] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:34.119 18:52:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:34.119 18:52:54 -- common/autotest_common.sh@862 -- # return 0 00:04:34.119 18:52:54 -- json_config/json_config.sh@115 -- # echo '' 00:04:34.119 00:04:34.119 18:52:54 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:04:34.119 18:52:54 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:04:34.119 INFO: Checking if target configuration is the same... 00:04:34.119 18:52:54 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:34.119 18:52:54 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:04:34.119 18:52:54 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:34.119 + '[' 2 -ne 2 ']' 00:04:34.119 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:34.119 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:34.119 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:34.119 +++ basename /dev/fd/62 00:04:34.119 ++ mktemp /tmp/62.XXX 00:04:34.119 + tmp_file_1=/tmp/62.6Om 00:04:34.119 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:34.119 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:34.119 + tmp_file_2=/tmp/spdk_tgt_config.json.EY5 00:04:34.119 + ret=0 00:04:34.119 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:34.376 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:34.376 + diff -u /tmp/62.6Om /tmp/spdk_tgt_config.json.EY5 00:04:34.376 + echo 'INFO: JSON config files are the same' 00:04:34.376 INFO: JSON config files are the same 00:04:34.376 + rm /tmp/62.6Om /tmp/spdk_tgt_config.json.EY5 00:04:34.376 + exit 0 00:04:34.376 18:52:55 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:04:34.376 18:52:55 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:04:34.376 INFO: changing configuration and checking if this can be detected... 00:04:34.376 18:52:55 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:34.376 18:52:55 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:34.634 18:52:55 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:34.634 18:52:55 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:04:34.634 18:52:55 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:34.634 + '[' 2 -ne 2 ']' 00:04:34.634 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:34.634 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:34.634 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:34.634 +++ basename /dev/fd/62 00:04:34.634 ++ mktemp /tmp/62.XXX 00:04:34.634 + tmp_file_1=/tmp/62.GSY 00:04:34.634 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:34.634 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:34.634 + tmp_file_2=/tmp/spdk_tgt_config.json.4gS 00:04:34.634 + ret=0 00:04:34.634 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:35.200 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:35.201 + diff -u /tmp/62.GSY /tmp/spdk_tgt_config.json.4gS 00:04:35.201 + ret=1 00:04:35.201 + echo '=== Start of file: /tmp/62.GSY ===' 00:04:35.201 + cat /tmp/62.GSY 00:04:35.201 + echo '=== End of file: /tmp/62.GSY ===' 00:04:35.201 + echo '' 00:04:35.201 + echo '=== Start of file: /tmp/spdk_tgt_config.json.4gS ===' 00:04:35.201 + cat /tmp/spdk_tgt_config.json.4gS 00:04:35.201 + echo '=== End of file: /tmp/spdk_tgt_config.json.4gS ===' 00:04:35.201 + echo '' 00:04:35.201 + rm /tmp/62.GSY /tmp/spdk_tgt_config.json.4gS 00:04:35.201 + exit 1 00:04:35.201 18:52:56 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:04:35.201 INFO: configuration change detected. 00:04:35.201 18:52:56 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:04:35.201 18:52:56 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:04:35.201 18:52:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:35.201 18:52:56 -- common/autotest_common.sh@10 -- # set +x 00:04:35.201 18:52:56 -- json_config/json_config.sh@360 -- # local ret=0 00:04:35.201 18:52:56 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:04:35.201 18:52:56 -- json_config/json_config.sh@370 -- # [[ -n 81690 ]] 00:04:35.201 18:52:56 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:04:35.201 18:52:56 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:04:35.201 18:52:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:35.201 18:52:56 -- common/autotest_common.sh@10 -- # set +x 00:04:35.201 18:52:56 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:04:35.201 18:52:56 -- json_config/json_config.sh@246 -- # uname -s 00:04:35.201 18:52:56 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:04:35.201 18:52:56 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:04:35.201 18:52:56 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:04:35.201 18:52:56 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:04:35.201 18:52:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:35.201 18:52:56 -- common/autotest_common.sh@10 -- # set +x 00:04:35.201 18:52:56 -- json_config/json_config.sh@376 -- # killprocess 81690 00:04:35.201 18:52:56 -- common/autotest_common.sh@936 -- # '[' -z 81690 ']' 00:04:35.201 18:52:56 -- common/autotest_common.sh@940 -- # kill -0 81690 00:04:35.201 18:52:56 -- common/autotest_common.sh@941 -- # uname 00:04:35.201 18:52:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:35.201 18:52:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 81690 00:04:35.201 18:52:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:35.201 18:52:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:35.201 18:52:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 81690' 00:04:35.201 killing process with pid 81690 00:04:35.201 18:52:56 -- common/autotest_common.sh@955 -- # kill 81690 00:04:35.201 18:52:56 -- common/autotest_common.sh@960 -- # wait 81690 00:04:37.101 18:52:57 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:37.101 18:52:57 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:04:37.101 18:52:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:37.101 18:52:57 -- common/autotest_common.sh@10 -- # set +x 00:04:37.101 18:52:57 -- json_config/json_config.sh@381 -- # return 0 00:04:37.101 18:52:57 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:04:37.101 INFO: Success 00:04:37.101 00:04:37.101 real 0m16.267s 00:04:37.101 user 0m18.693s 00:04:37.101 sys 0m2.134s 00:04:37.101 18:52:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:37.101 18:52:57 -- common/autotest_common.sh@10 -- # set +x 00:04:37.101 ************************************ 00:04:37.101 END TEST json_config 00:04:37.101 ************************************ 00:04:37.101 18:52:57 -- spdk/autotest.sh@166 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:37.101 18:52:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:37.101 18:52:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:37.101 18:52:57 -- common/autotest_common.sh@10 -- # set +x 00:04:37.101 ************************************ 00:04:37.101 START TEST json_config_extra_key 00:04:37.101 ************************************ 00:04:37.101 18:52:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:37.101 18:52:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:37.101 18:52:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:37.101 18:52:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:37.101 18:52:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:37.101 18:52:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:37.101 18:52:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:37.101 18:52:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:37.101 18:52:57 -- scripts/common.sh@335 -- # IFS=.-: 00:04:37.101 18:52:57 -- scripts/common.sh@335 -- # read -ra ver1 00:04:37.101 18:52:57 -- scripts/common.sh@336 -- # IFS=.-: 00:04:37.101 18:52:57 -- scripts/common.sh@336 -- # read -ra ver2 00:04:37.101 18:52:57 -- scripts/common.sh@337 -- # local 'op=<' 00:04:37.101 18:52:57 -- scripts/common.sh@339 -- # ver1_l=2 00:04:37.101 18:52:57 -- scripts/common.sh@340 -- # ver2_l=1 00:04:37.101 18:52:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:37.101 18:52:57 -- scripts/common.sh@343 -- # case "$op" in 00:04:37.101 18:52:57 -- scripts/common.sh@344 -- # : 1 00:04:37.101 18:52:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:37.101 18:52:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:37.101 18:52:57 -- scripts/common.sh@364 -- # decimal 1 00:04:37.101 18:52:57 -- scripts/common.sh@352 -- # local d=1 00:04:37.101 18:52:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:37.101 18:52:57 -- scripts/common.sh@354 -- # echo 1 00:04:37.101 18:52:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:37.101 18:52:57 -- scripts/common.sh@365 -- # decimal 2 00:04:37.101 18:52:57 -- scripts/common.sh@352 -- # local d=2 00:04:37.101 18:52:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:37.101 18:52:57 -- scripts/common.sh@354 -- # echo 2 00:04:37.101 18:52:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:37.101 18:52:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:37.101 18:52:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:37.101 18:52:57 -- scripts/common.sh@367 -- # return 0 00:04:37.101 18:52:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:37.101 18:52:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:37.101 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:37.101 --rc genhtml_branch_coverage=1 00:04:37.101 --rc genhtml_function_coverage=1 00:04:37.101 --rc genhtml_legend=1 00:04:37.101 --rc geninfo_all_blocks=1 00:04:37.101 --rc geninfo_unexecuted_blocks=1 00:04:37.101 00:04:37.101 ' 00:04:37.101 18:52:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:37.101 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:37.101 --rc genhtml_branch_coverage=1 00:04:37.101 --rc genhtml_function_coverage=1 00:04:37.101 --rc genhtml_legend=1 00:04:37.101 --rc geninfo_all_blocks=1 00:04:37.101 --rc geninfo_unexecuted_blocks=1 00:04:37.101 00:04:37.101 ' 00:04:37.101 18:52:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:37.101 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:37.101 --rc genhtml_branch_coverage=1 00:04:37.101 --rc genhtml_function_coverage=1 00:04:37.101 --rc genhtml_legend=1 00:04:37.101 --rc geninfo_all_blocks=1 00:04:37.101 --rc geninfo_unexecuted_blocks=1 00:04:37.101 00:04:37.101 ' 00:04:37.101 18:52:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:37.101 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:37.101 --rc genhtml_branch_coverage=1 00:04:37.101 --rc genhtml_function_coverage=1 00:04:37.101 --rc genhtml_legend=1 00:04:37.101 --rc geninfo_all_blocks=1 00:04:37.101 --rc geninfo_unexecuted_blocks=1 00:04:37.101 00:04:37.101 ' 00:04:37.101 18:52:57 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:37.101 18:52:57 -- nvmf/common.sh@7 -- # uname -s 00:04:37.101 18:52:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:37.101 18:52:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:37.101 18:52:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:37.101 18:52:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:37.101 18:52:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:37.101 18:52:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:37.101 18:52:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:37.101 18:52:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:37.101 18:52:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:37.101 18:52:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:37.102 18:52:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:04:37.102 18:52:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:04:37.102 18:52:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:37.102 18:52:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:37.102 18:52:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:37.102 18:52:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:37.102 18:52:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:37.102 18:52:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:37.102 18:52:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:37.102 18:52:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:37.102 18:52:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:37.102 18:52:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:37.102 18:52:57 -- paths/export.sh@5 -- # export PATH 00:04:37.102 18:52:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:37.102 18:52:57 -- nvmf/common.sh@46 -- # : 0 00:04:37.102 18:52:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:37.102 18:52:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:37.102 18:52:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:37.102 18:52:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:37.102 18:52:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:37.102 18:52:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:37.102 18:52:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:37.102 18:52:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:37.102 18:52:57 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:04:37.102 18:52:57 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:04:37.102 18:52:57 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:04:37.102 18:52:57 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:04:37.102 18:52:57 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:04:37.102 18:52:57 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:04:37.102 18:52:57 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:04:37.102 18:52:57 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:04:37.102 18:52:57 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:37.102 18:52:57 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:04:37.102 INFO: launching applications... 00:04:37.102 18:52:57 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:37.102 18:52:57 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:04:37.102 18:52:57 -- json_config/json_config_extra_key.sh@25 -- # shift 00:04:37.102 18:52:57 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:04:37.102 18:52:57 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:04:37.102 18:52:57 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=82762 00:04:37.102 18:52:57 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:37.102 18:52:57 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:04:37.102 Waiting for target to run... 00:04:37.102 18:52:57 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 82762 /var/tmp/spdk_tgt.sock 00:04:37.102 18:52:57 -- common/autotest_common.sh@829 -- # '[' -z 82762 ']' 00:04:37.102 18:52:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:37.102 18:52:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:37.102 18:52:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:37.102 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:37.102 18:52:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:37.102 18:52:57 -- common/autotest_common.sh@10 -- # set +x 00:04:37.102 [2024-11-28 18:52:58.011176] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:37.102 [2024-11-28 18:52:58.011271] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid82762 ] 00:04:37.102 EAL: No free 2048 kB hugepages reported on node 1 00:04:37.360 [2024-11-28 18:52:58.358542] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:37.619 [2024-11-28 18:52:58.434516] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:37.619 [2024-11-28 18:52:58.434669] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:38.186 18:52:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:38.186 18:52:58 -- common/autotest_common.sh@862 -- # return 0 00:04:38.186 18:52:58 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:04:38.186 00:04:38.186 18:52:58 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:04:38.186 INFO: shutting down applications... 00:04:38.186 18:52:58 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:04:38.186 18:52:58 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:04:38.186 18:52:58 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:04:38.186 18:52:58 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 82762 ]] 00:04:38.186 18:52:58 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 82762 00:04:38.186 18:52:58 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:04:38.186 18:52:58 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:38.186 18:52:58 -- json_config/json_config_extra_key.sh@50 -- # kill -0 82762 00:04:38.186 18:52:58 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:04:38.444 18:52:59 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:04:38.444 18:52:59 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:38.444 18:52:59 -- json_config/json_config_extra_key.sh@50 -- # kill -0 82762 00:04:38.444 18:52:59 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:04:38.444 18:52:59 -- json_config/json_config_extra_key.sh@52 -- # break 00:04:38.444 18:52:59 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:04:38.444 18:52:59 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:04:38.444 SPDK target shutdown done 00:04:38.444 18:52:59 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:04:38.444 Success 00:04:38.444 00:04:38.444 real 0m1.654s 00:04:38.444 user 0m1.638s 00:04:38.444 sys 0m0.468s 00:04:38.444 18:52:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:38.444 18:52:59 -- common/autotest_common.sh@10 -- # set +x 00:04:38.445 ************************************ 00:04:38.445 END TEST json_config_extra_key 00:04:38.445 ************************************ 00:04:38.703 18:52:59 -- spdk/autotest.sh@167 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:38.703 18:52:59 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:38.703 18:52:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:38.703 18:52:59 -- common/autotest_common.sh@10 -- # set +x 00:04:38.703 ************************************ 00:04:38.703 START TEST alias_rpc 00:04:38.703 ************************************ 00:04:38.703 18:52:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:38.703 * Looking for test storage... 00:04:38.703 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:04:38.703 18:52:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:38.703 18:52:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:38.703 18:52:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:38.703 18:52:59 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:38.703 18:52:59 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:38.703 18:52:59 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:38.703 18:52:59 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:38.703 18:52:59 -- scripts/common.sh@335 -- # IFS=.-: 00:04:38.703 18:52:59 -- scripts/common.sh@335 -- # read -ra ver1 00:04:38.703 18:52:59 -- scripts/common.sh@336 -- # IFS=.-: 00:04:38.703 18:52:59 -- scripts/common.sh@336 -- # read -ra ver2 00:04:38.703 18:52:59 -- scripts/common.sh@337 -- # local 'op=<' 00:04:38.703 18:52:59 -- scripts/common.sh@339 -- # ver1_l=2 00:04:38.703 18:52:59 -- scripts/common.sh@340 -- # ver2_l=1 00:04:38.704 18:52:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:38.704 18:52:59 -- scripts/common.sh@343 -- # case "$op" in 00:04:38.704 18:52:59 -- scripts/common.sh@344 -- # : 1 00:04:38.704 18:52:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:38.704 18:52:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:38.704 18:52:59 -- scripts/common.sh@364 -- # decimal 1 00:04:38.704 18:52:59 -- scripts/common.sh@352 -- # local d=1 00:04:38.704 18:52:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:38.704 18:52:59 -- scripts/common.sh@354 -- # echo 1 00:04:38.704 18:52:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:38.704 18:52:59 -- scripts/common.sh@365 -- # decimal 2 00:04:38.704 18:52:59 -- scripts/common.sh@352 -- # local d=2 00:04:38.704 18:52:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:38.704 18:52:59 -- scripts/common.sh@354 -- # echo 2 00:04:38.704 18:52:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:38.704 18:52:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:38.704 18:52:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:38.704 18:52:59 -- scripts/common.sh@367 -- # return 0 00:04:38.704 18:52:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:38.704 18:52:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:38.704 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:38.704 --rc genhtml_branch_coverage=1 00:04:38.704 --rc genhtml_function_coverage=1 00:04:38.704 --rc genhtml_legend=1 00:04:38.704 --rc geninfo_all_blocks=1 00:04:38.704 --rc geninfo_unexecuted_blocks=1 00:04:38.704 00:04:38.704 ' 00:04:38.704 18:52:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:38.704 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:38.704 --rc genhtml_branch_coverage=1 00:04:38.704 --rc genhtml_function_coverage=1 00:04:38.704 --rc genhtml_legend=1 00:04:38.704 --rc geninfo_all_blocks=1 00:04:38.704 --rc geninfo_unexecuted_blocks=1 00:04:38.704 00:04:38.704 ' 00:04:38.704 18:52:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:38.704 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:38.704 --rc genhtml_branch_coverage=1 00:04:38.704 --rc genhtml_function_coverage=1 00:04:38.704 --rc genhtml_legend=1 00:04:38.704 --rc geninfo_all_blocks=1 00:04:38.704 --rc geninfo_unexecuted_blocks=1 00:04:38.704 00:04:38.704 ' 00:04:38.704 18:52:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:38.704 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:38.704 --rc genhtml_branch_coverage=1 00:04:38.704 --rc genhtml_function_coverage=1 00:04:38.704 --rc genhtml_legend=1 00:04:38.704 --rc geninfo_all_blocks=1 00:04:38.704 --rc geninfo_unexecuted_blocks=1 00:04:38.704 00:04:38.704 ' 00:04:38.704 18:52:59 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:04:38.704 18:52:59 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=82960 00:04:38.704 18:52:59 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 82960 00:04:38.704 18:52:59 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:38.704 18:52:59 -- common/autotest_common.sh@829 -- # '[' -z 82960 ']' 00:04:38.704 18:52:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:38.704 18:52:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:38.704 18:52:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:38.704 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:38.704 18:52:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:38.704 18:52:59 -- common/autotest_common.sh@10 -- # set +x 00:04:38.704 [2024-11-28 18:52:59.694755] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:38.704 [2024-11-28 18:52:59.694845] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid82960 ] 00:04:38.704 EAL: No free 2048 kB hugepages reported on node 1 00:04:38.963 [2024-11-28 18:52:59.752527] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:38.963 [2024-11-28 18:52:59.858562] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:38.963 [2024-11-28 18:52:59.858730] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:39.897 18:53:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:39.897 18:53:00 -- common/autotest_common.sh@862 -- # return 0 00:04:39.898 18:53:00 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:04:39.898 18:53:00 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 82960 00:04:39.898 18:53:00 -- common/autotest_common.sh@936 -- # '[' -z 82960 ']' 00:04:39.898 18:53:00 -- common/autotest_common.sh@940 -- # kill -0 82960 00:04:39.898 18:53:00 -- common/autotest_common.sh@941 -- # uname 00:04:39.898 18:53:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:39.898 18:53:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 82960 00:04:40.155 18:53:00 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:40.155 18:53:00 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:40.155 18:53:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 82960' 00:04:40.155 killing process with pid 82960 00:04:40.155 18:53:00 -- common/autotest_common.sh@955 -- # kill 82960 00:04:40.155 18:53:00 -- common/autotest_common.sh@960 -- # wait 82960 00:04:40.415 00:04:40.415 real 0m1.881s 00:04:40.415 user 0m2.165s 00:04:40.415 sys 0m0.479s 00:04:40.415 18:53:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:40.415 18:53:01 -- common/autotest_common.sh@10 -- # set +x 00:04:40.415 ************************************ 00:04:40.415 END TEST alias_rpc 00:04:40.415 ************************************ 00:04:40.415 18:53:01 -- spdk/autotest.sh@169 -- # [[ 0 -eq 0 ]] 00:04:40.415 18:53:01 -- spdk/autotest.sh@170 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:40.415 18:53:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:40.415 18:53:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:40.415 18:53:01 -- common/autotest_common.sh@10 -- # set +x 00:04:40.415 ************************************ 00:04:40.415 START TEST spdkcli_tcp 00:04:40.415 ************************************ 00:04:40.416 18:53:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:40.674 * Looking for test storage... 00:04:40.674 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:04:40.674 18:53:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:40.674 18:53:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:40.674 18:53:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:40.674 18:53:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:40.674 18:53:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:40.674 18:53:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:40.674 18:53:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:40.674 18:53:01 -- scripts/common.sh@335 -- # IFS=.-: 00:04:40.674 18:53:01 -- scripts/common.sh@335 -- # read -ra ver1 00:04:40.674 18:53:01 -- scripts/common.sh@336 -- # IFS=.-: 00:04:40.674 18:53:01 -- scripts/common.sh@336 -- # read -ra ver2 00:04:40.674 18:53:01 -- scripts/common.sh@337 -- # local 'op=<' 00:04:40.675 18:53:01 -- scripts/common.sh@339 -- # ver1_l=2 00:04:40.675 18:53:01 -- scripts/common.sh@340 -- # ver2_l=1 00:04:40.675 18:53:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:40.675 18:53:01 -- scripts/common.sh@343 -- # case "$op" in 00:04:40.675 18:53:01 -- scripts/common.sh@344 -- # : 1 00:04:40.675 18:53:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:40.675 18:53:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:40.675 18:53:01 -- scripts/common.sh@364 -- # decimal 1 00:04:40.675 18:53:01 -- scripts/common.sh@352 -- # local d=1 00:04:40.675 18:53:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:40.675 18:53:01 -- scripts/common.sh@354 -- # echo 1 00:04:40.675 18:53:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:40.675 18:53:01 -- scripts/common.sh@365 -- # decimal 2 00:04:40.675 18:53:01 -- scripts/common.sh@352 -- # local d=2 00:04:40.675 18:53:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:40.675 18:53:01 -- scripts/common.sh@354 -- # echo 2 00:04:40.675 18:53:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:40.675 18:53:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:40.675 18:53:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:40.675 18:53:01 -- scripts/common.sh@367 -- # return 0 00:04:40.675 18:53:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:40.675 18:53:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:40.675 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:40.675 --rc genhtml_branch_coverage=1 00:04:40.675 --rc genhtml_function_coverage=1 00:04:40.675 --rc genhtml_legend=1 00:04:40.675 --rc geninfo_all_blocks=1 00:04:40.675 --rc geninfo_unexecuted_blocks=1 00:04:40.675 00:04:40.675 ' 00:04:40.675 18:53:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:40.675 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:40.675 --rc genhtml_branch_coverage=1 00:04:40.675 --rc genhtml_function_coverage=1 00:04:40.675 --rc genhtml_legend=1 00:04:40.675 --rc geninfo_all_blocks=1 00:04:40.675 --rc geninfo_unexecuted_blocks=1 00:04:40.675 00:04:40.675 ' 00:04:40.675 18:53:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:40.675 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:40.675 --rc genhtml_branch_coverage=1 00:04:40.675 --rc genhtml_function_coverage=1 00:04:40.675 --rc genhtml_legend=1 00:04:40.675 --rc geninfo_all_blocks=1 00:04:40.675 --rc geninfo_unexecuted_blocks=1 00:04:40.675 00:04:40.675 ' 00:04:40.675 18:53:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:40.675 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:40.675 --rc genhtml_branch_coverage=1 00:04:40.675 --rc genhtml_function_coverage=1 00:04:40.675 --rc genhtml_legend=1 00:04:40.675 --rc geninfo_all_blocks=1 00:04:40.675 --rc geninfo_unexecuted_blocks=1 00:04:40.675 00:04:40.675 ' 00:04:40.675 18:53:01 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:04:40.675 18:53:01 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:04:40.675 18:53:01 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:04:40.675 18:53:01 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:04:40.675 18:53:01 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:04:40.675 18:53:01 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:04:40.675 18:53:01 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:04:40.675 18:53:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:40.675 18:53:01 -- common/autotest_common.sh@10 -- # set +x 00:04:40.675 18:53:01 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=83285 00:04:40.675 18:53:01 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:04:40.675 18:53:01 -- spdkcli/tcp.sh@27 -- # waitforlisten 83285 00:04:40.675 18:53:01 -- common/autotest_common.sh@829 -- # '[' -z 83285 ']' 00:04:40.675 18:53:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:40.675 18:53:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:40.675 18:53:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:40.675 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:40.675 18:53:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:40.675 18:53:01 -- common/autotest_common.sh@10 -- # set +x 00:04:40.675 [2024-11-28 18:53:01.613648] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:40.675 [2024-11-28 18:53:01.613754] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid83285 ] 00:04:40.675 EAL: No free 2048 kB hugepages reported on node 1 00:04:40.675 [2024-11-28 18:53:01.673619] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:40.934 [2024-11-28 18:53:01.782429] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:40.934 [2024-11-28 18:53:01.782644] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:40.934 [2024-11-28 18:53:01.782649] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:41.870 18:53:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:41.870 18:53:02 -- common/autotest_common.sh@862 -- # return 0 00:04:41.870 18:53:02 -- spdkcli/tcp.sh@31 -- # socat_pid=83428 00:04:41.870 18:53:02 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:04:41.870 18:53:02 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:04:41.870 [ 00:04:41.870 "bdev_malloc_delete", 00:04:41.870 "bdev_malloc_create", 00:04:41.870 "bdev_null_resize", 00:04:41.870 "bdev_null_delete", 00:04:41.870 "bdev_null_create", 00:04:41.870 "bdev_nvme_cuse_unregister", 00:04:41.870 "bdev_nvme_cuse_register", 00:04:41.870 "bdev_opal_new_user", 00:04:41.870 "bdev_opal_set_lock_state", 00:04:41.870 "bdev_opal_delete", 00:04:41.870 "bdev_opal_get_info", 00:04:41.870 "bdev_opal_create", 00:04:41.870 "bdev_nvme_opal_revert", 00:04:41.870 "bdev_nvme_opal_init", 00:04:41.870 "bdev_nvme_send_cmd", 00:04:41.870 "bdev_nvme_get_path_iostat", 00:04:41.870 "bdev_nvme_get_mdns_discovery_info", 00:04:41.870 "bdev_nvme_stop_mdns_discovery", 00:04:41.870 "bdev_nvme_start_mdns_discovery", 00:04:41.870 "bdev_nvme_set_multipath_policy", 00:04:41.870 "bdev_nvme_set_preferred_path", 00:04:41.870 "bdev_nvme_get_io_paths", 00:04:41.870 "bdev_nvme_remove_error_injection", 00:04:41.870 "bdev_nvme_add_error_injection", 00:04:41.870 "bdev_nvme_get_discovery_info", 00:04:41.870 "bdev_nvme_stop_discovery", 00:04:41.870 "bdev_nvme_start_discovery", 00:04:41.870 "bdev_nvme_get_controller_health_info", 00:04:41.870 "bdev_nvme_disable_controller", 00:04:41.870 "bdev_nvme_enable_controller", 00:04:41.870 "bdev_nvme_reset_controller", 00:04:41.870 "bdev_nvme_get_transport_statistics", 00:04:41.870 "bdev_nvme_apply_firmware", 00:04:41.870 "bdev_nvme_detach_controller", 00:04:41.870 "bdev_nvme_get_controllers", 00:04:41.870 "bdev_nvme_attach_controller", 00:04:41.870 "bdev_nvme_set_hotplug", 00:04:41.870 "bdev_nvme_set_options", 00:04:41.870 "bdev_passthru_delete", 00:04:41.870 "bdev_passthru_create", 00:04:41.870 "bdev_lvol_grow_lvstore", 00:04:41.870 "bdev_lvol_get_lvols", 00:04:41.870 "bdev_lvol_get_lvstores", 00:04:41.870 "bdev_lvol_delete", 00:04:41.870 "bdev_lvol_set_read_only", 00:04:41.870 "bdev_lvol_resize", 00:04:41.870 "bdev_lvol_decouple_parent", 00:04:41.870 "bdev_lvol_inflate", 00:04:41.870 "bdev_lvol_rename", 00:04:41.870 "bdev_lvol_clone_bdev", 00:04:41.870 "bdev_lvol_clone", 00:04:41.870 "bdev_lvol_snapshot", 00:04:41.870 "bdev_lvol_create", 00:04:41.870 "bdev_lvol_delete_lvstore", 00:04:41.870 "bdev_lvol_rename_lvstore", 00:04:41.870 "bdev_lvol_create_lvstore", 00:04:41.870 "bdev_raid_set_options", 00:04:41.870 "bdev_raid_remove_base_bdev", 00:04:41.870 "bdev_raid_add_base_bdev", 00:04:41.870 "bdev_raid_delete", 00:04:41.870 "bdev_raid_create", 00:04:41.870 "bdev_raid_get_bdevs", 00:04:41.870 "bdev_error_inject_error", 00:04:41.870 "bdev_error_delete", 00:04:41.870 "bdev_error_create", 00:04:41.870 "bdev_split_delete", 00:04:41.870 "bdev_split_create", 00:04:41.870 "bdev_delay_delete", 00:04:41.870 "bdev_delay_create", 00:04:41.870 "bdev_delay_update_latency", 00:04:41.870 "bdev_zone_block_delete", 00:04:41.870 "bdev_zone_block_create", 00:04:41.870 "blobfs_create", 00:04:41.870 "blobfs_detect", 00:04:41.870 "blobfs_set_cache_size", 00:04:41.870 "bdev_aio_delete", 00:04:41.870 "bdev_aio_rescan", 00:04:41.870 "bdev_aio_create", 00:04:41.870 "bdev_ftl_set_property", 00:04:41.870 "bdev_ftl_get_properties", 00:04:41.870 "bdev_ftl_get_stats", 00:04:41.870 "bdev_ftl_unmap", 00:04:41.870 "bdev_ftl_unload", 00:04:41.870 "bdev_ftl_delete", 00:04:41.870 "bdev_ftl_load", 00:04:41.870 "bdev_ftl_create", 00:04:41.870 "bdev_virtio_attach_controller", 00:04:41.870 "bdev_virtio_scsi_get_devices", 00:04:41.870 "bdev_virtio_detach_controller", 00:04:41.870 "bdev_virtio_blk_set_hotplug", 00:04:41.870 "bdev_iscsi_delete", 00:04:41.870 "bdev_iscsi_create", 00:04:41.870 "bdev_iscsi_set_options", 00:04:41.870 "accel_error_inject_error", 00:04:41.870 "ioat_scan_accel_module", 00:04:41.870 "dsa_scan_accel_module", 00:04:41.870 "iaa_scan_accel_module", 00:04:41.870 "iscsi_set_options", 00:04:41.870 "iscsi_get_auth_groups", 00:04:41.870 "iscsi_auth_group_remove_secret", 00:04:41.870 "iscsi_auth_group_add_secret", 00:04:41.870 "iscsi_delete_auth_group", 00:04:41.870 "iscsi_create_auth_group", 00:04:41.870 "iscsi_set_discovery_auth", 00:04:41.870 "iscsi_get_options", 00:04:41.870 "iscsi_target_node_request_logout", 00:04:41.870 "iscsi_target_node_set_redirect", 00:04:41.870 "iscsi_target_node_set_auth", 00:04:41.870 "iscsi_target_node_add_lun", 00:04:41.870 "iscsi_get_connections", 00:04:41.870 "iscsi_portal_group_set_auth", 00:04:41.870 "iscsi_start_portal_group", 00:04:41.870 "iscsi_delete_portal_group", 00:04:41.870 "iscsi_create_portal_group", 00:04:41.870 "iscsi_get_portal_groups", 00:04:41.870 "iscsi_delete_target_node", 00:04:41.870 "iscsi_target_node_remove_pg_ig_maps", 00:04:41.870 "iscsi_target_node_add_pg_ig_maps", 00:04:41.870 "iscsi_create_target_node", 00:04:41.870 "iscsi_get_target_nodes", 00:04:41.870 "iscsi_delete_initiator_group", 00:04:41.870 "iscsi_initiator_group_remove_initiators", 00:04:41.870 "iscsi_initiator_group_add_initiators", 00:04:41.870 "iscsi_create_initiator_group", 00:04:41.870 "iscsi_get_initiator_groups", 00:04:41.870 "nvmf_set_crdt", 00:04:41.870 "nvmf_set_config", 00:04:41.870 "nvmf_set_max_subsystems", 00:04:41.870 "nvmf_subsystem_get_listeners", 00:04:41.870 "nvmf_subsystem_get_qpairs", 00:04:41.870 "nvmf_subsystem_get_controllers", 00:04:41.870 "nvmf_get_stats", 00:04:41.870 "nvmf_get_transports", 00:04:41.870 "nvmf_create_transport", 00:04:41.870 "nvmf_get_targets", 00:04:41.870 "nvmf_delete_target", 00:04:41.870 "nvmf_create_target", 00:04:41.870 "nvmf_subsystem_allow_any_host", 00:04:41.870 "nvmf_subsystem_remove_host", 00:04:41.870 "nvmf_subsystem_add_host", 00:04:41.870 "nvmf_subsystem_remove_ns", 00:04:41.870 "nvmf_subsystem_add_ns", 00:04:41.870 "nvmf_subsystem_listener_set_ana_state", 00:04:41.870 "nvmf_discovery_get_referrals", 00:04:41.870 "nvmf_discovery_remove_referral", 00:04:41.870 "nvmf_discovery_add_referral", 00:04:41.870 "nvmf_subsystem_remove_listener", 00:04:41.870 "nvmf_subsystem_add_listener", 00:04:41.870 "nvmf_delete_subsystem", 00:04:41.870 "nvmf_create_subsystem", 00:04:41.870 "nvmf_get_subsystems", 00:04:41.870 "env_dpdk_get_mem_stats", 00:04:41.870 "nbd_get_disks", 00:04:41.870 "nbd_stop_disk", 00:04:41.870 "nbd_start_disk", 00:04:41.870 "ublk_recover_disk", 00:04:41.870 "ublk_get_disks", 00:04:41.870 "ublk_stop_disk", 00:04:41.870 "ublk_start_disk", 00:04:41.870 "ublk_destroy_target", 00:04:41.870 "ublk_create_target", 00:04:41.870 "virtio_blk_create_transport", 00:04:41.871 "virtio_blk_get_transports", 00:04:41.871 "vhost_controller_set_coalescing", 00:04:41.871 "vhost_get_controllers", 00:04:41.871 "vhost_delete_controller", 00:04:41.871 "vhost_create_blk_controller", 00:04:41.871 "vhost_scsi_controller_remove_target", 00:04:41.871 "vhost_scsi_controller_add_target", 00:04:41.871 "vhost_start_scsi_controller", 00:04:41.871 "vhost_create_scsi_controller", 00:04:41.871 "thread_set_cpumask", 00:04:41.871 "framework_get_scheduler", 00:04:41.871 "framework_set_scheduler", 00:04:41.871 "framework_get_reactors", 00:04:41.871 "thread_get_io_channels", 00:04:41.871 "thread_get_pollers", 00:04:41.871 "thread_get_stats", 00:04:41.871 "framework_monitor_context_switch", 00:04:41.871 "spdk_kill_instance", 00:04:41.871 "log_enable_timestamps", 00:04:41.871 "log_get_flags", 00:04:41.871 "log_clear_flag", 00:04:41.871 "log_set_flag", 00:04:41.871 "log_get_level", 00:04:41.871 "log_set_level", 00:04:41.871 "log_get_print_level", 00:04:41.871 "log_set_print_level", 00:04:41.871 "framework_enable_cpumask_locks", 00:04:41.871 "framework_disable_cpumask_locks", 00:04:41.871 "framework_wait_init", 00:04:41.871 "framework_start_init", 00:04:41.871 "scsi_get_devices", 00:04:41.871 "bdev_get_histogram", 00:04:41.871 "bdev_enable_histogram", 00:04:41.871 "bdev_set_qos_limit", 00:04:41.871 "bdev_set_qd_sampling_period", 00:04:41.871 "bdev_get_bdevs", 00:04:41.871 "bdev_reset_iostat", 00:04:41.871 "bdev_get_iostat", 00:04:41.871 "bdev_examine", 00:04:41.871 "bdev_wait_for_examine", 00:04:41.871 "bdev_set_options", 00:04:41.871 "notify_get_notifications", 00:04:41.871 "notify_get_types", 00:04:41.871 "accel_get_stats", 00:04:41.871 "accel_set_options", 00:04:41.871 "accel_set_driver", 00:04:41.871 "accel_crypto_key_destroy", 00:04:41.871 "accel_crypto_keys_get", 00:04:41.871 "accel_crypto_key_create", 00:04:41.871 "accel_assign_opc", 00:04:41.871 "accel_get_module_info", 00:04:41.871 "accel_get_opc_assignments", 00:04:41.871 "vmd_rescan", 00:04:41.871 "vmd_remove_device", 00:04:41.871 "vmd_enable", 00:04:41.871 "sock_set_default_impl", 00:04:41.871 "sock_impl_set_options", 00:04:41.871 "sock_impl_get_options", 00:04:41.871 "iobuf_get_stats", 00:04:41.871 "iobuf_set_options", 00:04:41.871 "framework_get_pci_devices", 00:04:41.871 "framework_get_config", 00:04:41.871 "framework_get_subsystems", 00:04:41.871 "trace_get_info", 00:04:41.871 "trace_get_tpoint_group_mask", 00:04:41.871 "trace_disable_tpoint_group", 00:04:41.871 "trace_enable_tpoint_group", 00:04:41.871 "trace_clear_tpoint_mask", 00:04:41.871 "trace_set_tpoint_mask", 00:04:41.871 "spdk_get_version", 00:04:41.871 "rpc_get_methods" 00:04:41.871 ] 00:04:41.871 18:53:02 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:04:41.871 18:53:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:41.871 18:53:02 -- common/autotest_common.sh@10 -- # set +x 00:04:41.871 18:53:02 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:04:41.871 18:53:02 -- spdkcli/tcp.sh@38 -- # killprocess 83285 00:04:41.871 18:53:02 -- common/autotest_common.sh@936 -- # '[' -z 83285 ']' 00:04:41.871 18:53:02 -- common/autotest_common.sh@940 -- # kill -0 83285 00:04:41.871 18:53:02 -- common/autotest_common.sh@941 -- # uname 00:04:41.871 18:53:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:41.871 18:53:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 83285 00:04:41.871 18:53:02 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:41.871 18:53:02 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:41.871 18:53:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 83285' 00:04:41.871 killing process with pid 83285 00:04:41.871 18:53:02 -- common/autotest_common.sh@955 -- # kill 83285 00:04:41.871 18:53:02 -- common/autotest_common.sh@960 -- # wait 83285 00:04:42.437 00:04:42.437 real 0m1.916s 00:04:42.437 user 0m3.651s 00:04:42.437 sys 0m0.517s 00:04:42.437 18:53:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:42.437 18:53:03 -- common/autotest_common.sh@10 -- # set +x 00:04:42.437 ************************************ 00:04:42.437 END TEST spdkcli_tcp 00:04:42.437 ************************************ 00:04:42.437 18:53:03 -- spdk/autotest.sh@173 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:42.437 18:53:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:42.437 18:53:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:42.437 18:53:03 -- common/autotest_common.sh@10 -- # set +x 00:04:42.437 ************************************ 00:04:42.437 START TEST dpdk_mem_utility 00:04:42.437 ************************************ 00:04:42.437 18:53:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:42.437 * Looking for test storage... 00:04:42.437 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:04:42.437 18:53:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:42.437 18:53:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:42.437 18:53:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:42.695 18:53:03 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:42.695 18:53:03 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:42.695 18:53:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:42.695 18:53:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:42.695 18:53:03 -- scripts/common.sh@335 -- # IFS=.-: 00:04:42.695 18:53:03 -- scripts/common.sh@335 -- # read -ra ver1 00:04:42.695 18:53:03 -- scripts/common.sh@336 -- # IFS=.-: 00:04:42.695 18:53:03 -- scripts/common.sh@336 -- # read -ra ver2 00:04:42.695 18:53:03 -- scripts/common.sh@337 -- # local 'op=<' 00:04:42.695 18:53:03 -- scripts/common.sh@339 -- # ver1_l=2 00:04:42.695 18:53:03 -- scripts/common.sh@340 -- # ver2_l=1 00:04:42.695 18:53:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:42.695 18:53:03 -- scripts/common.sh@343 -- # case "$op" in 00:04:42.695 18:53:03 -- scripts/common.sh@344 -- # : 1 00:04:42.695 18:53:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:42.695 18:53:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:42.695 18:53:03 -- scripts/common.sh@364 -- # decimal 1 00:04:42.695 18:53:03 -- scripts/common.sh@352 -- # local d=1 00:04:42.695 18:53:03 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:42.695 18:53:03 -- scripts/common.sh@354 -- # echo 1 00:04:42.695 18:53:03 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:42.695 18:53:03 -- scripts/common.sh@365 -- # decimal 2 00:04:42.695 18:53:03 -- scripts/common.sh@352 -- # local d=2 00:04:42.695 18:53:03 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:42.695 18:53:03 -- scripts/common.sh@354 -- # echo 2 00:04:42.695 18:53:03 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:42.695 18:53:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:42.695 18:53:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:42.695 18:53:03 -- scripts/common.sh@367 -- # return 0 00:04:42.695 18:53:03 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:42.695 18:53:03 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:42.695 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:42.695 --rc genhtml_branch_coverage=1 00:04:42.695 --rc genhtml_function_coverage=1 00:04:42.695 --rc genhtml_legend=1 00:04:42.695 --rc geninfo_all_blocks=1 00:04:42.695 --rc geninfo_unexecuted_blocks=1 00:04:42.695 00:04:42.695 ' 00:04:42.695 18:53:03 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:42.695 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:42.695 --rc genhtml_branch_coverage=1 00:04:42.695 --rc genhtml_function_coverage=1 00:04:42.695 --rc genhtml_legend=1 00:04:42.695 --rc geninfo_all_blocks=1 00:04:42.695 --rc geninfo_unexecuted_blocks=1 00:04:42.695 00:04:42.695 ' 00:04:42.695 18:53:03 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:42.695 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:42.695 --rc genhtml_branch_coverage=1 00:04:42.695 --rc genhtml_function_coverage=1 00:04:42.695 --rc genhtml_legend=1 00:04:42.695 --rc geninfo_all_blocks=1 00:04:42.695 --rc geninfo_unexecuted_blocks=1 00:04:42.695 00:04:42.695 ' 00:04:42.695 18:53:03 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:42.695 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:42.695 --rc genhtml_branch_coverage=1 00:04:42.695 --rc genhtml_function_coverage=1 00:04:42.695 --rc genhtml_legend=1 00:04:42.695 --rc geninfo_all_blocks=1 00:04:42.695 --rc geninfo_unexecuted_blocks=1 00:04:42.695 00:04:42.695 ' 00:04:42.695 18:53:03 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:42.695 18:53:03 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=83622 00:04:42.695 18:53:03 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:42.695 18:53:03 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 83622 00:04:42.695 18:53:03 -- common/autotest_common.sh@829 -- # '[' -z 83622 ']' 00:04:42.695 18:53:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:42.695 18:53:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:42.695 18:53:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:42.695 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:42.695 18:53:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:42.695 18:53:03 -- common/autotest_common.sh@10 -- # set +x 00:04:42.695 [2024-11-28 18:53:03.548273] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:42.695 [2024-11-28 18:53:03.548365] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid83622 ] 00:04:42.695 EAL: No free 2048 kB hugepages reported on node 1 00:04:42.695 [2024-11-28 18:53:03.606535] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:42.695 [2024-11-28 18:53:03.709851] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:42.695 [2024-11-28 18:53:03.710006] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:43.631 18:53:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:43.631 18:53:04 -- common/autotest_common.sh@862 -- # return 0 00:04:43.631 18:53:04 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:04:43.631 18:53:04 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:04:43.631 18:53:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:43.631 18:53:04 -- common/autotest_common.sh@10 -- # set +x 00:04:43.631 { 00:04:43.631 "filename": "/tmp/spdk_mem_dump.txt" 00:04:43.631 } 00:04:43.631 18:53:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:43.631 18:53:04 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:43.631 DPDK memory size 814.000000 MiB in 1 heap(s) 00:04:43.631 1 heaps totaling size 814.000000 MiB 00:04:43.631 size: 814.000000 MiB heap id: 0 00:04:43.631 end heaps---------- 00:04:43.631 8 mempools totaling size 598.116089 MiB 00:04:43.631 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:04:43.631 size: 158.602051 MiB name: PDU_data_out_Pool 00:04:43.631 size: 84.521057 MiB name: bdev_io_83622 00:04:43.631 size: 51.011292 MiB name: evtpool_83622 00:04:43.631 size: 50.003479 MiB name: msgpool_83622 00:04:43.631 size: 21.763794 MiB name: PDU_Pool 00:04:43.631 size: 19.513306 MiB name: SCSI_TASK_Pool 00:04:43.631 size: 0.026123 MiB name: Session_Pool 00:04:43.631 end mempools------- 00:04:43.631 6 memzones totaling size 4.142822 MiB 00:04:43.631 size: 1.000366 MiB name: RG_ring_0_83622 00:04:43.631 size: 1.000366 MiB name: RG_ring_1_83622 00:04:43.631 size: 1.000366 MiB name: RG_ring_4_83622 00:04:43.631 size: 1.000366 MiB name: RG_ring_5_83622 00:04:43.631 size: 0.125366 MiB name: RG_ring_2_83622 00:04:43.631 size: 0.015991 MiB name: RG_ring_3_83622 00:04:43.631 end memzones------- 00:04:43.631 18:53:04 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:04:43.631 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:04:43.631 list of free elements. size: 12.519348 MiB 00:04:43.631 element at address: 0x200000400000 with size: 1.999512 MiB 00:04:43.631 element at address: 0x200018e00000 with size: 0.999878 MiB 00:04:43.631 element at address: 0x200019000000 with size: 0.999878 MiB 00:04:43.631 element at address: 0x200003e00000 with size: 0.996277 MiB 00:04:43.631 element at address: 0x200031c00000 with size: 0.994446 MiB 00:04:43.631 element at address: 0x200013800000 with size: 0.978699 MiB 00:04:43.631 element at address: 0x200007000000 with size: 0.959839 MiB 00:04:43.631 element at address: 0x200019200000 with size: 0.936584 MiB 00:04:43.631 element at address: 0x200000200000 with size: 0.841614 MiB 00:04:43.631 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:04:43.631 element at address: 0x20000b200000 with size: 0.490723 MiB 00:04:43.631 element at address: 0x200000800000 with size: 0.487793 MiB 00:04:43.631 element at address: 0x200019400000 with size: 0.485657 MiB 00:04:43.631 element at address: 0x200027e00000 with size: 0.410034 MiB 00:04:43.631 element at address: 0x200003a00000 with size: 0.355530 MiB 00:04:43.631 list of standard malloc elements. size: 199.218079 MiB 00:04:43.631 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:04:43.631 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:04:43.631 element at address: 0x200018efff80 with size: 1.000122 MiB 00:04:43.631 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:04:43.631 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:04:43.631 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:04:43.631 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:04:43.631 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:04:43.631 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:04:43.631 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:04:43.631 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:04:43.631 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:04:43.631 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:04:43.631 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:04:43.631 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:04:43.631 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:04:43.631 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:04:43.631 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:04:43.631 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:04:43.631 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:04:43.631 element at address: 0x200003adb300 with size: 0.000183 MiB 00:04:43.631 element at address: 0x200003adb500 with size: 0.000183 MiB 00:04:43.631 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:04:43.631 element at address: 0x200003affa80 with size: 0.000183 MiB 00:04:43.631 element at address: 0x200003affb40 with size: 0.000183 MiB 00:04:43.631 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:04:43.631 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:04:43.631 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:04:43.631 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:04:43.631 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:04:43.631 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:04:43.631 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:04:43.631 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:04:43.631 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:04:43.631 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:04:43.631 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:04:43.631 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:04:43.631 element at address: 0x200027e69040 with size: 0.000183 MiB 00:04:43.631 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:04:43.631 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:04:43.631 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:04:43.631 list of memzone associated elements. size: 602.262573 MiB 00:04:43.631 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:04:43.631 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:04:43.631 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:04:43.631 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:04:43.631 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:04:43.631 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_83622_0 00:04:43.631 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:04:43.631 associated memzone info: size: 48.002930 MiB name: MP_evtpool_83622_0 00:04:43.631 element at address: 0x200003fff380 with size: 48.003052 MiB 00:04:43.631 associated memzone info: size: 48.002930 MiB name: MP_msgpool_83622_0 00:04:43.631 element at address: 0x2000195be940 with size: 20.255554 MiB 00:04:43.631 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:04:43.631 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:04:43.631 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:04:43.631 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:04:43.631 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_83622 00:04:43.631 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:04:43.631 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_83622 00:04:43.631 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:04:43.631 associated memzone info: size: 1.007996 MiB name: MP_evtpool_83622 00:04:43.631 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:04:43.631 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:04:43.631 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:04:43.631 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:04:43.631 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:04:43.631 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:04:43.631 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:04:43.632 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:04:43.632 element at address: 0x200003eff180 with size: 1.000488 MiB 00:04:43.632 associated memzone info: size: 1.000366 MiB name: RG_ring_0_83622 00:04:43.632 element at address: 0x200003affc00 with size: 1.000488 MiB 00:04:43.632 associated memzone info: size: 1.000366 MiB name: RG_ring_1_83622 00:04:43.632 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:04:43.632 associated memzone info: size: 1.000366 MiB name: RG_ring_4_83622 00:04:43.632 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:04:43.632 associated memzone info: size: 1.000366 MiB name: RG_ring_5_83622 00:04:43.632 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:04:43.632 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_83622 00:04:43.632 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:04:43.632 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:04:43.632 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:04:43.632 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:04:43.632 element at address: 0x20001947c540 with size: 0.250488 MiB 00:04:43.632 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:04:43.632 element at address: 0x200003adf880 with size: 0.125488 MiB 00:04:43.632 associated memzone info: size: 0.125366 MiB name: RG_ring_2_83622 00:04:43.632 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:04:43.632 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:04:43.632 element at address: 0x200027e69100 with size: 0.023743 MiB 00:04:43.632 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:04:43.632 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:04:43.632 associated memzone info: size: 0.015991 MiB name: RG_ring_3_83622 00:04:43.632 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:04:43.632 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:04:43.632 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:04:43.632 associated memzone info: size: 0.000183 MiB name: MP_msgpool_83622 00:04:43.632 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:04:43.632 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_83622 00:04:43.632 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:04:43.632 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:04:43.632 18:53:04 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:04:43.632 18:53:04 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 83622 00:04:43.632 18:53:04 -- common/autotest_common.sh@936 -- # '[' -z 83622 ']' 00:04:43.632 18:53:04 -- common/autotest_common.sh@940 -- # kill -0 83622 00:04:43.632 18:53:04 -- common/autotest_common.sh@941 -- # uname 00:04:43.632 18:53:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:43.632 18:53:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 83622 00:04:43.632 18:53:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:43.632 18:53:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:43.632 18:53:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 83622' 00:04:43.632 killing process with pid 83622 00:04:43.632 18:53:04 -- common/autotest_common.sh@955 -- # kill 83622 00:04:43.632 18:53:04 -- common/autotest_common.sh@960 -- # wait 83622 00:04:44.205 00:04:44.205 real 0m1.734s 00:04:44.205 user 0m1.898s 00:04:44.205 sys 0m0.460s 00:04:44.205 18:53:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:44.205 18:53:05 -- common/autotest_common.sh@10 -- # set +x 00:04:44.205 ************************************ 00:04:44.205 END TEST dpdk_mem_utility 00:04:44.205 ************************************ 00:04:44.205 18:53:05 -- spdk/autotest.sh@174 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:44.205 18:53:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:44.205 18:53:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:44.205 18:53:05 -- common/autotest_common.sh@10 -- # set +x 00:04:44.205 ************************************ 00:04:44.205 START TEST event 00:04:44.205 ************************************ 00:04:44.205 18:53:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:44.205 * Looking for test storage... 00:04:44.205 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:04:44.205 18:53:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:44.205 18:53:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:44.205 18:53:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:44.466 18:53:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:44.466 18:53:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:44.466 18:53:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:44.466 18:53:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:44.466 18:53:05 -- scripts/common.sh@335 -- # IFS=.-: 00:04:44.466 18:53:05 -- scripts/common.sh@335 -- # read -ra ver1 00:04:44.466 18:53:05 -- scripts/common.sh@336 -- # IFS=.-: 00:04:44.466 18:53:05 -- scripts/common.sh@336 -- # read -ra ver2 00:04:44.466 18:53:05 -- scripts/common.sh@337 -- # local 'op=<' 00:04:44.466 18:53:05 -- scripts/common.sh@339 -- # ver1_l=2 00:04:44.466 18:53:05 -- scripts/common.sh@340 -- # ver2_l=1 00:04:44.466 18:53:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:44.466 18:53:05 -- scripts/common.sh@343 -- # case "$op" in 00:04:44.466 18:53:05 -- scripts/common.sh@344 -- # : 1 00:04:44.466 18:53:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:44.466 18:53:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:44.466 18:53:05 -- scripts/common.sh@364 -- # decimal 1 00:04:44.466 18:53:05 -- scripts/common.sh@352 -- # local d=1 00:04:44.466 18:53:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:44.466 18:53:05 -- scripts/common.sh@354 -- # echo 1 00:04:44.466 18:53:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:44.466 18:53:05 -- scripts/common.sh@365 -- # decimal 2 00:04:44.466 18:53:05 -- scripts/common.sh@352 -- # local d=2 00:04:44.466 18:53:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:44.466 18:53:05 -- scripts/common.sh@354 -- # echo 2 00:04:44.466 18:53:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:44.466 18:53:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:44.466 18:53:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:44.466 18:53:05 -- scripts/common.sh@367 -- # return 0 00:04:44.466 18:53:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:44.466 18:53:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:44.466 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:44.466 --rc genhtml_branch_coverage=1 00:04:44.466 --rc genhtml_function_coverage=1 00:04:44.466 --rc genhtml_legend=1 00:04:44.466 --rc geninfo_all_blocks=1 00:04:44.466 --rc geninfo_unexecuted_blocks=1 00:04:44.466 00:04:44.466 ' 00:04:44.466 18:53:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:44.466 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:44.466 --rc genhtml_branch_coverage=1 00:04:44.466 --rc genhtml_function_coverage=1 00:04:44.466 --rc genhtml_legend=1 00:04:44.466 --rc geninfo_all_blocks=1 00:04:44.466 --rc geninfo_unexecuted_blocks=1 00:04:44.466 00:04:44.466 ' 00:04:44.466 18:53:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:44.466 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:44.466 --rc genhtml_branch_coverage=1 00:04:44.466 --rc genhtml_function_coverage=1 00:04:44.466 --rc genhtml_legend=1 00:04:44.466 --rc geninfo_all_blocks=1 00:04:44.466 --rc geninfo_unexecuted_blocks=1 00:04:44.466 00:04:44.466 ' 00:04:44.466 18:53:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:44.466 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:44.466 --rc genhtml_branch_coverage=1 00:04:44.466 --rc genhtml_function_coverage=1 00:04:44.466 --rc genhtml_legend=1 00:04:44.466 --rc geninfo_all_blocks=1 00:04:44.466 --rc geninfo_unexecuted_blocks=1 00:04:44.466 00:04:44.466 ' 00:04:44.466 18:53:05 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:04:44.466 18:53:05 -- bdev/nbd_common.sh@6 -- # set -e 00:04:44.466 18:53:05 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:44.466 18:53:05 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:04:44.466 18:53:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:44.466 18:53:05 -- common/autotest_common.sh@10 -- # set +x 00:04:44.466 ************************************ 00:04:44.466 START TEST event_perf 00:04:44.466 ************************************ 00:04:44.466 18:53:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:44.466 Running I/O for 1 seconds...[2024-11-28 18:53:05.289428] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:44.466 [2024-11-28 18:53:05.289514] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid83836 ] 00:04:44.466 EAL: No free 2048 kB hugepages reported on node 1 00:04:44.466 [2024-11-28 18:53:05.345901] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:44.466 [2024-11-28 18:53:05.448195] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:44.466 [2024-11-28 18:53:05.448255] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:44.466 [2024-11-28 18:53:05.448321] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:44.466 [2024-11-28 18:53:05.448324] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:45.840 Running I/O for 1 seconds... 00:04:45.840 lcore 0: 228821 00:04:45.840 lcore 1: 228821 00:04:45.840 lcore 2: 228819 00:04:45.840 lcore 3: 228820 00:04:45.840 done. 00:04:45.840 00:04:45.840 real 0m1.285s 00:04:45.840 user 0m4.205s 00:04:45.840 sys 0m0.075s 00:04:45.840 18:53:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:45.840 18:53:06 -- common/autotest_common.sh@10 -- # set +x 00:04:45.840 ************************************ 00:04:45.840 END TEST event_perf 00:04:45.840 ************************************ 00:04:45.840 18:53:06 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:45.840 18:53:06 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:45.840 18:53:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:45.840 18:53:06 -- common/autotest_common.sh@10 -- # set +x 00:04:45.840 ************************************ 00:04:45.840 START TEST event_reactor 00:04:45.840 ************************************ 00:04:45.840 18:53:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:45.840 [2024-11-28 18:53:06.597651] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:45.840 [2024-11-28 18:53:06.597743] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid83995 ] 00:04:45.840 EAL: No free 2048 kB hugepages reported on node 1 00:04:45.840 [2024-11-28 18:53:06.654067] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:45.840 [2024-11-28 18:53:06.756300] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:47.216 test_start 00:04:47.216 oneshot 00:04:47.216 tick 100 00:04:47.216 tick 100 00:04:47.216 tick 250 00:04:47.216 tick 100 00:04:47.216 tick 100 00:04:47.216 tick 100 00:04:47.216 tick 250 00:04:47.216 tick 500 00:04:47.216 tick 100 00:04:47.216 tick 100 00:04:47.216 tick 250 00:04:47.216 tick 100 00:04:47.216 tick 100 00:04:47.216 test_end 00:04:47.216 00:04:47.216 real 0m1.284s 00:04:47.216 user 0m1.203s 00:04:47.217 sys 0m0.077s 00:04:47.217 18:53:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:47.217 18:53:07 -- common/autotest_common.sh@10 -- # set +x 00:04:47.217 ************************************ 00:04:47.217 END TEST event_reactor 00:04:47.217 ************************************ 00:04:47.217 18:53:07 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:47.217 18:53:07 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:47.217 18:53:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:47.217 18:53:07 -- common/autotest_common.sh@10 -- # set +x 00:04:47.217 ************************************ 00:04:47.217 START TEST event_reactor_perf 00:04:47.217 ************************************ 00:04:47.217 18:53:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:47.217 [2024-11-28 18:53:07.909057] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:47.217 [2024-11-28 18:53:07.909145] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid84176 ] 00:04:47.217 EAL: No free 2048 kB hugepages reported on node 1 00:04:47.217 [2024-11-28 18:53:07.970509] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:47.217 [2024-11-28 18:53:08.073577] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:48.153 test_start 00:04:48.153 test_end 00:04:48.153 Performance: 443515 events per second 00:04:48.153 00:04:48.153 real 0m1.287s 00:04:48.153 user 0m1.206s 00:04:48.153 sys 0m0.076s 00:04:48.153 18:53:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:48.153 18:53:09 -- common/autotest_common.sh@10 -- # set +x 00:04:48.153 ************************************ 00:04:48.153 END TEST event_reactor_perf 00:04:48.153 ************************************ 00:04:48.413 18:53:09 -- event/event.sh@49 -- # uname -s 00:04:48.413 18:53:09 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:04:48.413 18:53:09 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:48.413 18:53:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:48.413 18:53:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:48.413 18:53:09 -- common/autotest_common.sh@10 -- # set +x 00:04:48.413 ************************************ 00:04:48.413 START TEST event_scheduler 00:04:48.413 ************************************ 00:04:48.413 18:53:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:48.413 * Looking for test storage... 00:04:48.413 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:04:48.413 18:53:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:48.413 18:53:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:48.413 18:53:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:48.413 18:53:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:48.413 18:53:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:48.413 18:53:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:48.413 18:53:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:48.413 18:53:09 -- scripts/common.sh@335 -- # IFS=.-: 00:04:48.413 18:53:09 -- scripts/common.sh@335 -- # read -ra ver1 00:04:48.413 18:53:09 -- scripts/common.sh@336 -- # IFS=.-: 00:04:48.413 18:53:09 -- scripts/common.sh@336 -- # read -ra ver2 00:04:48.413 18:53:09 -- scripts/common.sh@337 -- # local 'op=<' 00:04:48.413 18:53:09 -- scripts/common.sh@339 -- # ver1_l=2 00:04:48.413 18:53:09 -- scripts/common.sh@340 -- # ver2_l=1 00:04:48.413 18:53:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:48.413 18:53:09 -- scripts/common.sh@343 -- # case "$op" in 00:04:48.413 18:53:09 -- scripts/common.sh@344 -- # : 1 00:04:48.413 18:53:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:48.413 18:53:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:48.413 18:53:09 -- scripts/common.sh@364 -- # decimal 1 00:04:48.413 18:53:09 -- scripts/common.sh@352 -- # local d=1 00:04:48.413 18:53:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:48.413 18:53:09 -- scripts/common.sh@354 -- # echo 1 00:04:48.413 18:53:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:48.413 18:53:09 -- scripts/common.sh@365 -- # decimal 2 00:04:48.413 18:53:09 -- scripts/common.sh@352 -- # local d=2 00:04:48.413 18:53:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:48.413 18:53:09 -- scripts/common.sh@354 -- # echo 2 00:04:48.413 18:53:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:48.413 18:53:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:48.413 18:53:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:48.413 18:53:09 -- scripts/common.sh@367 -- # return 0 00:04:48.413 18:53:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:48.413 18:53:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:48.413 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:48.413 --rc genhtml_branch_coverage=1 00:04:48.413 --rc genhtml_function_coverage=1 00:04:48.413 --rc genhtml_legend=1 00:04:48.413 --rc geninfo_all_blocks=1 00:04:48.413 --rc geninfo_unexecuted_blocks=1 00:04:48.413 00:04:48.413 ' 00:04:48.413 18:53:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:48.413 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:48.413 --rc genhtml_branch_coverage=1 00:04:48.413 --rc genhtml_function_coverage=1 00:04:48.413 --rc genhtml_legend=1 00:04:48.413 --rc geninfo_all_blocks=1 00:04:48.413 --rc geninfo_unexecuted_blocks=1 00:04:48.413 00:04:48.413 ' 00:04:48.413 18:53:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:48.413 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:48.413 --rc genhtml_branch_coverage=1 00:04:48.413 --rc genhtml_function_coverage=1 00:04:48.413 --rc genhtml_legend=1 00:04:48.413 --rc geninfo_all_blocks=1 00:04:48.413 --rc geninfo_unexecuted_blocks=1 00:04:48.413 00:04:48.413 ' 00:04:48.413 18:53:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:48.413 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:48.413 --rc genhtml_branch_coverage=1 00:04:48.413 --rc genhtml_function_coverage=1 00:04:48.413 --rc genhtml_legend=1 00:04:48.413 --rc geninfo_all_blocks=1 00:04:48.413 --rc geninfo_unexecuted_blocks=1 00:04:48.413 00:04:48.413 ' 00:04:48.413 18:53:09 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:04:48.413 18:53:09 -- scheduler/scheduler.sh@35 -- # scheduler_pid=84473 00:04:48.413 18:53:09 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:04:48.413 18:53:09 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:04:48.413 18:53:09 -- scheduler/scheduler.sh@37 -- # waitforlisten 84473 00:04:48.413 18:53:09 -- common/autotest_common.sh@829 -- # '[' -z 84473 ']' 00:04:48.413 18:53:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:48.413 18:53:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:48.413 18:53:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:48.413 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:48.413 18:53:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:48.413 18:53:09 -- common/autotest_common.sh@10 -- # set +x 00:04:48.413 [2024-11-28 18:53:09.398080] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:48.413 [2024-11-28 18:53:09.398159] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid84473 ] 00:04:48.413 EAL: No free 2048 kB hugepages reported on node 1 00:04:48.413 [2024-11-28 18:53:09.455491] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:48.673 [2024-11-28 18:53:09.557687] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:48.673 [2024-11-28 18:53:09.557785] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:48.673 [2024-11-28 18:53:09.557878] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:48.673 [2024-11-28 18:53:09.557881] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:48.673 18:53:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:48.673 18:53:09 -- common/autotest_common.sh@862 -- # return 0 00:04:48.673 18:53:09 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:04:48.673 18:53:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:48.673 18:53:09 -- common/autotest_common.sh@10 -- # set +x 00:04:48.673 POWER: Env isn't set yet! 00:04:48.673 POWER: Attempting to initialise ACPI cpufreq power management... 00:04:48.673 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:04:48.673 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:04:48.673 POWER: Cannot get available frequencies of lcore 0 00:04:48.673 POWER: Attempting to initialise PSTAT power management... 00:04:48.673 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:04:48.673 POWER: Initialized successfully for lcore 0 power management 00:04:48.673 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:04:48.673 POWER: Initialized successfully for lcore 1 power management 00:04:48.673 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:04:48.673 POWER: Initialized successfully for lcore 2 power management 00:04:48.673 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:04:48.673 POWER: Initialized successfully for lcore 3 power management 00:04:48.673 [2024-11-28 18:53:09.646677] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:04:48.673 [2024-11-28 18:53:09.646708] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:04:48.673 [2024-11-28 18:53:09.646731] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:04:48.673 18:53:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:48.673 18:53:09 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:04:48.673 18:53:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:48.673 18:53:09 -- common/autotest_common.sh@10 -- # set +x 00:04:48.933 [2024-11-28 18:53:09.751608] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:04:48.933 18:53:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:48.933 18:53:09 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:04:48.933 18:53:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:48.933 18:53:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:48.933 18:53:09 -- common/autotest_common.sh@10 -- # set +x 00:04:48.933 ************************************ 00:04:48.933 START TEST scheduler_create_thread 00:04:48.933 ************************************ 00:04:48.933 18:53:09 -- common/autotest_common.sh@1114 -- # scheduler_create_thread 00:04:48.933 18:53:09 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:04:48.933 18:53:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:48.933 18:53:09 -- common/autotest_common.sh@10 -- # set +x 00:04:48.933 2 00:04:48.933 18:53:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:48.933 18:53:09 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:04:48.933 18:53:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:48.933 18:53:09 -- common/autotest_common.sh@10 -- # set +x 00:04:48.933 3 00:04:48.933 18:53:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:48.933 18:53:09 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:04:48.933 18:53:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:48.933 18:53:09 -- common/autotest_common.sh@10 -- # set +x 00:04:48.933 4 00:04:48.933 18:53:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:48.933 18:53:09 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:04:48.933 18:53:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:48.933 18:53:09 -- common/autotest_common.sh@10 -- # set +x 00:04:48.933 5 00:04:48.933 18:53:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:48.933 18:53:09 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:04:48.933 18:53:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:48.933 18:53:09 -- common/autotest_common.sh@10 -- # set +x 00:04:48.933 6 00:04:48.933 18:53:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:48.933 18:53:09 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:04:48.933 18:53:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:48.933 18:53:09 -- common/autotest_common.sh@10 -- # set +x 00:04:48.933 7 00:04:48.933 18:53:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:48.933 18:53:09 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:04:48.933 18:53:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:48.933 18:53:09 -- common/autotest_common.sh@10 -- # set +x 00:04:48.933 8 00:04:48.933 18:53:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:48.933 18:53:09 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:04:48.933 18:53:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:48.933 18:53:09 -- common/autotest_common.sh@10 -- # set +x 00:04:48.933 9 00:04:48.933 18:53:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:48.933 18:53:09 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:04:48.933 18:53:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:48.933 18:53:09 -- common/autotest_common.sh@10 -- # set +x 00:04:48.933 10 00:04:48.933 18:53:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:48.933 18:53:09 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:04:48.933 18:53:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:48.933 18:53:09 -- common/autotest_common.sh@10 -- # set +x 00:04:48.933 18:53:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:48.933 18:53:09 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:04:48.933 18:53:09 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:04:48.933 18:53:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:48.933 18:53:09 -- common/autotest_common.sh@10 -- # set +x 00:04:48.933 18:53:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:48.933 18:53:09 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:04:48.933 18:53:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:48.933 18:53:09 -- common/autotest_common.sh@10 -- # set +x 00:04:49.500 18:53:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:49.500 18:53:10 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:04:49.500 18:53:10 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:04:49.500 18:53:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:49.500 18:53:10 -- common/autotest_common.sh@10 -- # set +x 00:04:50.876 18:53:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:50.876 00:04:50.876 real 0m1.757s 00:04:50.876 user 0m0.013s 00:04:50.876 sys 0m0.002s 00:04:50.876 18:53:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:50.876 18:53:11 -- common/autotest_common.sh@10 -- # set +x 00:04:50.876 ************************************ 00:04:50.876 END TEST scheduler_create_thread 00:04:50.876 ************************************ 00:04:50.876 18:53:11 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:04:50.876 18:53:11 -- scheduler/scheduler.sh@46 -- # killprocess 84473 00:04:50.876 18:53:11 -- common/autotest_common.sh@936 -- # '[' -z 84473 ']' 00:04:50.876 18:53:11 -- common/autotest_common.sh@940 -- # kill -0 84473 00:04:50.876 18:53:11 -- common/autotest_common.sh@941 -- # uname 00:04:50.876 18:53:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:50.876 18:53:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 84473 00:04:50.876 18:53:11 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:04:50.876 18:53:11 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:04:50.876 18:53:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 84473' 00:04:50.876 killing process with pid 84473 00:04:50.876 18:53:11 -- common/autotest_common.sh@955 -- # kill 84473 00:04:50.876 18:53:11 -- common/autotest_common.sh@960 -- # wait 84473 00:04:51.135 [2024-11-28 18:53:11.995776] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:04:51.135 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:04:51.135 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:04:51.135 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:04:51.135 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:04:51.135 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:04:51.135 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:04:51.135 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:04:51.135 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:04:51.393 00:04:51.393 real 0m3.041s 00:04:51.393 user 0m3.931s 00:04:51.393 sys 0m0.323s 00:04:51.393 18:53:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:51.393 18:53:12 -- common/autotest_common.sh@10 -- # set +x 00:04:51.393 ************************************ 00:04:51.393 END TEST event_scheduler 00:04:51.393 ************************************ 00:04:51.393 18:53:12 -- event/event.sh@51 -- # modprobe -n nbd 00:04:51.393 18:53:12 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:04:51.393 18:53:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:51.393 18:53:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:51.393 18:53:12 -- common/autotest_common.sh@10 -- # set +x 00:04:51.393 ************************************ 00:04:51.393 START TEST app_repeat 00:04:51.393 ************************************ 00:04:51.393 18:53:12 -- common/autotest_common.sh@1114 -- # app_repeat_test 00:04:51.393 18:53:12 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:51.393 18:53:12 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:51.393 18:53:12 -- event/event.sh@13 -- # local nbd_list 00:04:51.393 18:53:12 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:51.393 18:53:12 -- event/event.sh@14 -- # local bdev_list 00:04:51.393 18:53:12 -- event/event.sh@15 -- # local repeat_times=4 00:04:51.393 18:53:12 -- event/event.sh@17 -- # modprobe nbd 00:04:51.393 18:53:12 -- event/event.sh@19 -- # repeat_pid=84817 00:04:51.393 18:53:12 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:04:51.393 18:53:12 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:04:51.394 18:53:12 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 84817' 00:04:51.394 Process app_repeat pid: 84817 00:04:51.394 18:53:12 -- event/event.sh@23 -- # for i in {0..2} 00:04:51.394 18:53:12 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:04:51.394 spdk_app_start Round 0 00:04:51.394 18:53:12 -- event/event.sh@25 -- # waitforlisten 84817 /var/tmp/spdk-nbd.sock 00:04:51.394 18:53:12 -- common/autotest_common.sh@829 -- # '[' -z 84817 ']' 00:04:51.394 18:53:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:51.394 18:53:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:51.394 18:53:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:51.394 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:51.394 18:53:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:51.394 18:53:12 -- common/autotest_common.sh@10 -- # set +x 00:04:51.394 [2024-11-28 18:53:12.315458] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:51.394 [2024-11-28 18:53:12.315540] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid84817 ] 00:04:51.394 EAL: No free 2048 kB hugepages reported on node 1 00:04:51.394 [2024-11-28 18:53:12.377635] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:51.652 [2024-11-28 18:53:12.496585] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:51.652 [2024-11-28 18:53:12.496588] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:52.588 18:53:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:52.588 18:53:13 -- common/autotest_common.sh@862 -- # return 0 00:04:52.588 18:53:13 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:52.588 Malloc0 00:04:52.588 18:53:13 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:52.846 Malloc1 00:04:52.846 18:53:13 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:52.846 18:53:13 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:52.846 18:53:13 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:52.846 18:53:13 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:52.846 18:53:13 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:52.846 18:53:13 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:52.847 18:53:13 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:52.847 18:53:13 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:52.847 18:53:13 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:52.847 18:53:13 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:52.847 18:53:13 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:52.847 18:53:13 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:52.847 18:53:13 -- bdev/nbd_common.sh@12 -- # local i 00:04:52.847 18:53:13 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:52.847 18:53:13 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:52.847 18:53:13 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:53.105 /dev/nbd0 00:04:53.105 18:53:14 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:53.105 18:53:14 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:53.105 18:53:14 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:53.105 18:53:14 -- common/autotest_common.sh@867 -- # local i 00:04:53.105 18:53:14 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:53.105 18:53:14 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:53.105 18:53:14 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:53.105 18:53:14 -- common/autotest_common.sh@871 -- # break 00:04:53.105 18:53:14 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:53.105 18:53:14 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:53.105 18:53:14 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:53.105 1+0 records in 00:04:53.105 1+0 records out 00:04:53.105 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000194504 s, 21.1 MB/s 00:04:53.105 18:53:14 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:53.105 18:53:14 -- common/autotest_common.sh@884 -- # size=4096 00:04:53.105 18:53:14 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:53.105 18:53:14 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:53.105 18:53:14 -- common/autotest_common.sh@887 -- # return 0 00:04:53.105 18:53:14 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:53.105 18:53:14 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:53.105 18:53:14 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:53.364 /dev/nbd1 00:04:53.364 18:53:14 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:53.364 18:53:14 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:53.364 18:53:14 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:53.364 18:53:14 -- common/autotest_common.sh@867 -- # local i 00:04:53.364 18:53:14 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:53.364 18:53:14 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:53.364 18:53:14 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:53.364 18:53:14 -- common/autotest_common.sh@871 -- # break 00:04:53.364 18:53:14 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:53.364 18:53:14 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:53.364 18:53:14 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:53.364 1+0 records in 00:04:53.364 1+0 records out 00:04:53.364 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000222244 s, 18.4 MB/s 00:04:53.364 18:53:14 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:53.364 18:53:14 -- common/autotest_common.sh@884 -- # size=4096 00:04:53.364 18:53:14 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:53.364 18:53:14 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:53.364 18:53:14 -- common/autotest_common.sh@887 -- # return 0 00:04:53.364 18:53:14 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:53.364 18:53:14 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:53.364 18:53:14 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:53.364 18:53:14 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:53.364 18:53:14 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:53.622 18:53:14 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:53.622 { 00:04:53.622 "nbd_device": "/dev/nbd0", 00:04:53.622 "bdev_name": "Malloc0" 00:04:53.622 }, 00:04:53.622 { 00:04:53.622 "nbd_device": "/dev/nbd1", 00:04:53.622 "bdev_name": "Malloc1" 00:04:53.622 } 00:04:53.622 ]' 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:53.880 { 00:04:53.880 "nbd_device": "/dev/nbd0", 00:04:53.880 "bdev_name": "Malloc0" 00:04:53.880 }, 00:04:53.880 { 00:04:53.880 "nbd_device": "/dev/nbd1", 00:04:53.880 "bdev_name": "Malloc1" 00:04:53.880 } 00:04:53.880 ]' 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:53.880 /dev/nbd1' 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:53.880 /dev/nbd1' 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@65 -- # count=2 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@95 -- # count=2 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:53.880 256+0 records in 00:04:53.880 256+0 records out 00:04:53.880 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00514578 s, 204 MB/s 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:53.880 256+0 records in 00:04:53.880 256+0 records out 00:04:53.880 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225883 s, 46.4 MB/s 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:53.880 256+0 records in 00:04:53.880 256+0 records out 00:04:53.880 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.021447 s, 48.9 MB/s 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@51 -- # local i 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:53.880 18:53:14 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:04:54.144 18:53:15 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:04:54.145 18:53:15 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:04:54.145 18:53:15 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:04:54.145 18:53:15 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:54.145 18:53:15 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:54.145 18:53:15 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:04:54.145 18:53:15 -- bdev/nbd_common.sh@41 -- # break 00:04:54.145 18:53:15 -- bdev/nbd_common.sh@45 -- # return 0 00:04:54.145 18:53:15 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:54.145 18:53:15 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:04:54.403 18:53:15 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:04:54.403 18:53:15 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:04:54.403 18:53:15 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:04:54.403 18:53:15 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:04:54.403 18:53:15 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:04:54.403 18:53:15 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:04:54.403 18:53:15 -- bdev/nbd_common.sh@41 -- # break 00:04:54.403 18:53:15 -- bdev/nbd_common.sh@45 -- # return 0 00:04:54.403 18:53:15 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:54.403 18:53:15 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:54.403 18:53:15 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:54.681 18:53:15 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:04:54.681 18:53:15 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:04:54.681 18:53:15 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:54.681 18:53:15 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:04:54.681 18:53:15 -- bdev/nbd_common.sh@65 -- # echo '' 00:04:54.681 18:53:15 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:54.681 18:53:15 -- bdev/nbd_common.sh@65 -- # true 00:04:54.681 18:53:15 -- bdev/nbd_common.sh@65 -- # count=0 00:04:54.681 18:53:15 -- bdev/nbd_common.sh@66 -- # echo 0 00:04:54.681 18:53:15 -- bdev/nbd_common.sh@104 -- # count=0 00:04:54.681 18:53:15 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:04:54.681 18:53:15 -- bdev/nbd_common.sh@109 -- # return 0 00:04:54.681 18:53:15 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:04:54.939 18:53:15 -- event/event.sh@35 -- # sleep 3 00:04:55.197 [2024-11-28 18:53:16.199985] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:55.455 [2024-11-28 18:53:16.314059] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:55.455 [2024-11-28 18:53:16.314059] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:55.455 [2024-11-28 18:53:16.375554] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:04:55.455 [2024-11-28 18:53:16.375633] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:04:57.986 18:53:18 -- event/event.sh@23 -- # for i in {0..2} 00:04:57.986 18:53:18 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:04:57.986 spdk_app_start Round 1 00:04:57.986 18:53:18 -- event/event.sh@25 -- # waitforlisten 84817 /var/tmp/spdk-nbd.sock 00:04:57.986 18:53:18 -- common/autotest_common.sh@829 -- # '[' -z 84817 ']' 00:04:57.986 18:53:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:04:57.986 18:53:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:57.986 18:53:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:04:57.986 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:04:57.986 18:53:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:57.986 18:53:18 -- common/autotest_common.sh@10 -- # set +x 00:04:58.244 18:53:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:58.244 18:53:19 -- common/autotest_common.sh@862 -- # return 0 00:04:58.244 18:53:19 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:58.502 Malloc0 00:04:58.502 18:53:19 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:04:58.761 Malloc1 00:04:58.761 18:53:19 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:58.761 18:53:19 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:58.761 18:53:19 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:58.761 18:53:19 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:04:58.761 18:53:19 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:58.761 18:53:19 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:04:58.761 18:53:19 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:04:58.761 18:53:19 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:58.761 18:53:19 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:04:58.761 18:53:19 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:04:58.761 18:53:19 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:58.761 18:53:19 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:04:58.761 18:53:19 -- bdev/nbd_common.sh@12 -- # local i 00:04:58.761 18:53:19 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:04:58.761 18:53:19 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:58.761 18:53:19 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:04:59.019 /dev/nbd0 00:04:59.019 18:53:19 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:04:59.019 18:53:19 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:04:59.019 18:53:19 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:04:59.019 18:53:19 -- common/autotest_common.sh@867 -- # local i 00:04:59.019 18:53:19 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:59.019 18:53:19 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:59.019 18:53:19 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:04:59.019 18:53:19 -- common/autotest_common.sh@871 -- # break 00:04:59.019 18:53:19 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:59.019 18:53:19 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:59.019 18:53:19 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:59.019 1+0 records in 00:04:59.019 1+0 records out 00:04:59.019 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000210983 s, 19.4 MB/s 00:04:59.019 18:53:19 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:59.019 18:53:19 -- common/autotest_common.sh@884 -- # size=4096 00:04:59.019 18:53:19 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:59.019 18:53:19 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:59.019 18:53:19 -- common/autotest_common.sh@887 -- # return 0 00:04:59.019 18:53:19 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:59.019 18:53:19 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:59.019 18:53:19 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:04:59.278 /dev/nbd1 00:04:59.278 18:53:20 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:04:59.278 18:53:20 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:04:59.278 18:53:20 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:04:59.278 18:53:20 -- common/autotest_common.sh@867 -- # local i 00:04:59.278 18:53:20 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:04:59.278 18:53:20 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:04:59.278 18:53:20 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:04:59.278 18:53:20 -- common/autotest_common.sh@871 -- # break 00:04:59.278 18:53:20 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:04:59.278 18:53:20 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:04:59.278 18:53:20 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:04:59.278 1+0 records in 00:04:59.278 1+0 records out 00:04:59.278 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000192879 s, 21.2 MB/s 00:04:59.278 18:53:20 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:59.278 18:53:20 -- common/autotest_common.sh@884 -- # size=4096 00:04:59.278 18:53:20 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:04:59.278 18:53:20 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:04:59.278 18:53:20 -- common/autotest_common.sh@887 -- # return 0 00:04:59.278 18:53:20 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:04:59.278 18:53:20 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:04:59.278 18:53:20 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:04:59.278 18:53:20 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:59.278 18:53:20 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:04:59.536 18:53:20 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:04:59.536 { 00:04:59.536 "nbd_device": "/dev/nbd0", 00:04:59.536 "bdev_name": "Malloc0" 00:04:59.536 }, 00:04:59.536 { 00:04:59.536 "nbd_device": "/dev/nbd1", 00:04:59.536 "bdev_name": "Malloc1" 00:04:59.536 } 00:04:59.536 ]' 00:04:59.536 18:53:20 -- bdev/nbd_common.sh@64 -- # echo '[ 00:04:59.536 { 00:04:59.536 "nbd_device": "/dev/nbd0", 00:04:59.536 "bdev_name": "Malloc0" 00:04:59.536 }, 00:04:59.536 { 00:04:59.536 "nbd_device": "/dev/nbd1", 00:04:59.536 "bdev_name": "Malloc1" 00:04:59.536 } 00:04:59.536 ]' 00:04:59.536 18:53:20 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:04:59.795 18:53:20 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:04:59.795 /dev/nbd1' 00:04:59.795 18:53:20 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:04:59.795 /dev/nbd1' 00:04:59.795 18:53:20 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:04:59.795 18:53:20 -- bdev/nbd_common.sh@65 -- # count=2 00:04:59.795 18:53:20 -- bdev/nbd_common.sh@66 -- # echo 2 00:04:59.795 18:53:20 -- bdev/nbd_common.sh@95 -- # count=2 00:04:59.795 18:53:20 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:04:59.795 18:53:20 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:04:59.795 18:53:20 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:59.795 18:53:20 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:59.795 18:53:20 -- bdev/nbd_common.sh@71 -- # local operation=write 00:04:59.795 18:53:20 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:59.795 18:53:20 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:04:59.795 18:53:20 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:04:59.795 256+0 records in 00:04:59.795 256+0 records out 00:04:59.795 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00419032 s, 250 MB/s 00:04:59.795 18:53:20 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:59.795 18:53:20 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:04:59.795 256+0 records in 00:04:59.795 256+0 records out 00:04:59.795 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0208434 s, 50.3 MB/s 00:04:59.795 18:53:20 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:04:59.795 18:53:20 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:04:59.795 256+0 records in 00:04:59.795 256+0 records out 00:04:59.795 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241809 s, 43.4 MB/s 00:04:59.795 18:53:20 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:04:59.795 18:53:20 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:59.795 18:53:20 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:04:59.795 18:53:20 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:04:59.795 18:53:20 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:59.795 18:53:20 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:04:59.795 18:53:20 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:04:59.795 18:53:20 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:59.795 18:53:20 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:04:59.795 18:53:20 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:04:59.795 18:53:20 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:04:59.795 18:53:20 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:04:59.795 18:53:20 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:04:59.795 18:53:20 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:04:59.795 18:53:20 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:04:59.795 18:53:20 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:04:59.795 18:53:20 -- bdev/nbd_common.sh@51 -- # local i 00:04:59.795 18:53:20 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:04:59.795 18:53:20 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:00.053 18:53:20 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:00.053 18:53:20 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:00.053 18:53:20 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:00.053 18:53:20 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:00.053 18:53:20 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:00.053 18:53:20 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:00.053 18:53:20 -- bdev/nbd_common.sh@41 -- # break 00:05:00.053 18:53:20 -- bdev/nbd_common.sh@45 -- # return 0 00:05:00.053 18:53:20 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:00.053 18:53:20 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:00.311 18:53:21 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:00.311 18:53:21 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:00.311 18:53:21 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:00.311 18:53:21 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:00.311 18:53:21 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:00.311 18:53:21 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:00.311 18:53:21 -- bdev/nbd_common.sh@41 -- # break 00:05:00.311 18:53:21 -- bdev/nbd_common.sh@45 -- # return 0 00:05:00.311 18:53:21 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:00.311 18:53:21 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:00.311 18:53:21 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:00.569 18:53:21 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:00.569 18:53:21 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:00.569 18:53:21 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:00.570 18:53:21 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:00.570 18:53:21 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:00.570 18:53:21 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:00.570 18:53:21 -- bdev/nbd_common.sh@65 -- # true 00:05:00.570 18:53:21 -- bdev/nbd_common.sh@65 -- # count=0 00:05:00.570 18:53:21 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:00.570 18:53:21 -- bdev/nbd_common.sh@104 -- # count=0 00:05:00.570 18:53:21 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:00.570 18:53:21 -- bdev/nbd_common.sh@109 -- # return 0 00:05:00.570 18:53:21 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:00.828 18:53:21 -- event/event.sh@35 -- # sleep 3 00:05:01.087 [2024-11-28 18:53:22.078876] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:01.346 [2024-11-28 18:53:22.192671] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:01.346 [2024-11-28 18:53:22.192675] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:01.346 [2024-11-28 18:53:22.254338] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:01.346 [2024-11-28 18:53:22.254446] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:03.877 18:53:24 -- event/event.sh@23 -- # for i in {0..2} 00:05:03.877 18:53:24 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:05:03.877 spdk_app_start Round 2 00:05:03.877 18:53:24 -- event/event.sh@25 -- # waitforlisten 84817 /var/tmp/spdk-nbd.sock 00:05:03.877 18:53:24 -- common/autotest_common.sh@829 -- # '[' -z 84817 ']' 00:05:03.877 18:53:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:03.877 18:53:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:03.877 18:53:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:03.877 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:03.877 18:53:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:03.877 18:53:24 -- common/autotest_common.sh@10 -- # set +x 00:05:04.136 18:53:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:04.136 18:53:25 -- common/autotest_common.sh@862 -- # return 0 00:05:04.136 18:53:25 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:04.394 Malloc0 00:05:04.394 18:53:25 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:04.651 Malloc1 00:05:04.651 18:53:25 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:04.651 18:53:25 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:04.651 18:53:25 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:04.651 18:53:25 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:04.651 18:53:25 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:04.651 18:53:25 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:04.651 18:53:25 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:04.651 18:53:25 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:04.651 18:53:25 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:04.651 18:53:25 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:04.651 18:53:25 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:04.651 18:53:25 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:04.651 18:53:25 -- bdev/nbd_common.sh@12 -- # local i 00:05:04.651 18:53:25 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:04.651 18:53:25 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:04.651 18:53:25 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:04.910 /dev/nbd0 00:05:04.910 18:53:25 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:04.910 18:53:25 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:04.910 18:53:25 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:05:04.910 18:53:25 -- common/autotest_common.sh@867 -- # local i 00:05:04.910 18:53:25 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:04.910 18:53:25 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:04.910 18:53:25 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:05:04.910 18:53:25 -- common/autotest_common.sh@871 -- # break 00:05:04.910 18:53:25 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:04.910 18:53:25 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:04.910 18:53:25 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:04.910 1+0 records in 00:05:04.910 1+0 records out 00:05:04.910 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000204553 s, 20.0 MB/s 00:05:04.910 18:53:25 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:04.910 18:53:25 -- common/autotest_common.sh@884 -- # size=4096 00:05:04.910 18:53:25 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:04.910 18:53:25 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:04.910 18:53:25 -- common/autotest_common.sh@887 -- # return 0 00:05:04.910 18:53:25 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:04.910 18:53:25 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:04.910 18:53:25 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:05.170 /dev/nbd1 00:05:05.170 18:53:26 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:05.170 18:53:26 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:05.170 18:53:26 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:05:05.170 18:53:26 -- common/autotest_common.sh@867 -- # local i 00:05:05.170 18:53:26 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:05.170 18:53:26 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:05.170 18:53:26 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:05:05.170 18:53:26 -- common/autotest_common.sh@871 -- # break 00:05:05.170 18:53:26 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:05.170 18:53:26 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:05.170 18:53:26 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:05.170 1+0 records in 00:05:05.170 1+0 records out 00:05:05.170 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000204115 s, 20.1 MB/s 00:05:05.170 18:53:26 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:05.170 18:53:26 -- common/autotest_common.sh@884 -- # size=4096 00:05:05.170 18:53:26 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:05.170 18:53:26 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:05.170 18:53:26 -- common/autotest_common.sh@887 -- # return 0 00:05:05.170 18:53:26 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:05.170 18:53:26 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:05.170 18:53:26 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:05.170 18:53:26 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:05.170 18:53:26 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:05.428 18:53:26 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:05.428 { 00:05:05.428 "nbd_device": "/dev/nbd0", 00:05:05.428 "bdev_name": "Malloc0" 00:05:05.428 }, 00:05:05.428 { 00:05:05.428 "nbd_device": "/dev/nbd1", 00:05:05.428 "bdev_name": "Malloc1" 00:05:05.428 } 00:05:05.428 ]' 00:05:05.428 18:53:26 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:05.428 { 00:05:05.428 "nbd_device": "/dev/nbd0", 00:05:05.428 "bdev_name": "Malloc0" 00:05:05.428 }, 00:05:05.428 { 00:05:05.428 "nbd_device": "/dev/nbd1", 00:05:05.428 "bdev_name": "Malloc1" 00:05:05.428 } 00:05:05.428 ]' 00:05:05.428 18:53:26 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:05.428 18:53:26 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:05.428 /dev/nbd1' 00:05:05.428 18:53:26 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:05.428 /dev/nbd1' 00:05:05.428 18:53:26 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:05.428 18:53:26 -- bdev/nbd_common.sh@65 -- # count=2 00:05:05.428 18:53:26 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:05.428 18:53:26 -- bdev/nbd_common.sh@95 -- # count=2 00:05:05.428 18:53:26 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:05.428 18:53:26 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:05.428 18:53:26 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:05.428 18:53:26 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:05.429 18:53:26 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:05.429 18:53:26 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:05.429 18:53:26 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:05.429 18:53:26 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:05.429 256+0 records in 00:05:05.429 256+0 records out 00:05:05.429 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00514084 s, 204 MB/s 00:05:05.429 18:53:26 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:05.429 18:53:26 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:05.687 256+0 records in 00:05:05.687 256+0 records out 00:05:05.687 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0227349 s, 46.1 MB/s 00:05:05.687 18:53:26 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:05.687 18:53:26 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:05.687 256+0 records in 00:05:05.687 256+0 records out 00:05:05.687 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0219462 s, 47.8 MB/s 00:05:05.687 18:53:26 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:05.687 18:53:26 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:05.687 18:53:26 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:05.687 18:53:26 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:05.687 18:53:26 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:05.687 18:53:26 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:05.687 18:53:26 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:05.687 18:53:26 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:05.687 18:53:26 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:05.687 18:53:26 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:05.687 18:53:26 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:05.687 18:53:26 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:05.687 18:53:26 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:05.687 18:53:26 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:05.687 18:53:26 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:05.687 18:53:26 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:05.687 18:53:26 -- bdev/nbd_common.sh@51 -- # local i 00:05:05.687 18:53:26 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:05.687 18:53:26 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:05.945 18:53:26 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:05.945 18:53:26 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:05.945 18:53:26 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:05.945 18:53:26 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:05.945 18:53:26 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:05.945 18:53:26 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:05.945 18:53:26 -- bdev/nbd_common.sh@41 -- # break 00:05:05.945 18:53:26 -- bdev/nbd_common.sh@45 -- # return 0 00:05:05.945 18:53:26 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:05.945 18:53:26 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:06.203 18:53:27 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:06.203 18:53:27 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:06.203 18:53:27 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:06.204 18:53:27 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:06.204 18:53:27 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:06.204 18:53:27 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:06.204 18:53:27 -- bdev/nbd_common.sh@41 -- # break 00:05:06.204 18:53:27 -- bdev/nbd_common.sh@45 -- # return 0 00:05:06.204 18:53:27 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:06.204 18:53:27 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:06.204 18:53:27 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:06.462 18:53:27 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:06.462 18:53:27 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:06.462 18:53:27 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:06.462 18:53:27 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:06.462 18:53:27 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:06.462 18:53:27 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:06.462 18:53:27 -- bdev/nbd_common.sh@65 -- # true 00:05:06.462 18:53:27 -- bdev/nbd_common.sh@65 -- # count=0 00:05:06.462 18:53:27 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:06.462 18:53:27 -- bdev/nbd_common.sh@104 -- # count=0 00:05:06.462 18:53:27 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:06.462 18:53:27 -- bdev/nbd_common.sh@109 -- # return 0 00:05:06.462 18:53:27 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:06.720 18:53:27 -- event/event.sh@35 -- # sleep 3 00:05:06.979 [2024-11-28 18:53:27.954659] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:07.238 [2024-11-28 18:53:28.070751] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:07.238 [2024-11-28 18:53:28.070753] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:07.238 [2024-11-28 18:53:28.130402] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:07.238 [2024-11-28 18:53:28.130478] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:09.769 18:53:30 -- event/event.sh@38 -- # waitforlisten 84817 /var/tmp/spdk-nbd.sock 00:05:09.769 18:53:30 -- common/autotest_common.sh@829 -- # '[' -z 84817 ']' 00:05:09.769 18:53:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:09.769 18:53:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:09.769 18:53:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:09.769 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:09.769 18:53:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:09.769 18:53:30 -- common/autotest_common.sh@10 -- # set +x 00:05:10.028 18:53:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:10.028 18:53:30 -- common/autotest_common.sh@862 -- # return 0 00:05:10.028 18:53:30 -- event/event.sh@39 -- # killprocess 84817 00:05:10.028 18:53:30 -- common/autotest_common.sh@936 -- # '[' -z 84817 ']' 00:05:10.028 18:53:30 -- common/autotest_common.sh@940 -- # kill -0 84817 00:05:10.028 18:53:30 -- common/autotest_common.sh@941 -- # uname 00:05:10.028 18:53:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:10.028 18:53:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 84817 00:05:10.028 18:53:30 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:10.028 18:53:30 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:10.028 18:53:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 84817' 00:05:10.028 killing process with pid 84817 00:05:10.028 18:53:30 -- common/autotest_common.sh@955 -- # kill 84817 00:05:10.028 18:53:30 -- common/autotest_common.sh@960 -- # wait 84817 00:05:10.286 spdk_app_start is called in Round 0. 00:05:10.286 Shutdown signal received, stop current app iteration 00:05:10.286 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:10.286 spdk_app_start is called in Round 1. 00:05:10.286 Shutdown signal received, stop current app iteration 00:05:10.286 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:10.286 spdk_app_start is called in Round 2. 00:05:10.286 Shutdown signal received, stop current app iteration 00:05:10.286 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:10.286 spdk_app_start is called in Round 3. 00:05:10.286 Shutdown signal received, stop current app iteration 00:05:10.286 18:53:31 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:05:10.286 18:53:31 -- event/event.sh@42 -- # return 0 00:05:10.286 00:05:10.286 real 0m18.931s 00:05:10.286 user 0m41.241s 00:05:10.286 sys 0m3.238s 00:05:10.286 18:53:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:10.286 18:53:31 -- common/autotest_common.sh@10 -- # set +x 00:05:10.286 ************************************ 00:05:10.286 END TEST app_repeat 00:05:10.286 ************************************ 00:05:10.286 18:53:31 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:05:10.286 18:53:31 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:10.286 18:53:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:10.286 18:53:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:10.286 18:53:31 -- common/autotest_common.sh@10 -- # set +x 00:05:10.286 ************************************ 00:05:10.286 START TEST cpu_locks 00:05:10.286 ************************************ 00:05:10.286 18:53:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:10.286 * Looking for test storage... 00:05:10.286 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:05:10.286 18:53:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:10.286 18:53:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:10.286 18:53:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:10.545 18:53:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:10.545 18:53:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:10.545 18:53:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:10.545 18:53:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:10.545 18:53:31 -- scripts/common.sh@335 -- # IFS=.-: 00:05:10.545 18:53:31 -- scripts/common.sh@335 -- # read -ra ver1 00:05:10.545 18:53:31 -- scripts/common.sh@336 -- # IFS=.-: 00:05:10.545 18:53:31 -- scripts/common.sh@336 -- # read -ra ver2 00:05:10.545 18:53:31 -- scripts/common.sh@337 -- # local 'op=<' 00:05:10.545 18:53:31 -- scripts/common.sh@339 -- # ver1_l=2 00:05:10.545 18:53:31 -- scripts/common.sh@340 -- # ver2_l=1 00:05:10.545 18:53:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:10.545 18:53:31 -- scripts/common.sh@343 -- # case "$op" in 00:05:10.545 18:53:31 -- scripts/common.sh@344 -- # : 1 00:05:10.545 18:53:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:10.545 18:53:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:10.545 18:53:31 -- scripts/common.sh@364 -- # decimal 1 00:05:10.545 18:53:31 -- scripts/common.sh@352 -- # local d=1 00:05:10.545 18:53:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:10.545 18:53:31 -- scripts/common.sh@354 -- # echo 1 00:05:10.545 18:53:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:10.545 18:53:31 -- scripts/common.sh@365 -- # decimal 2 00:05:10.545 18:53:31 -- scripts/common.sh@352 -- # local d=2 00:05:10.545 18:53:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:10.545 18:53:31 -- scripts/common.sh@354 -- # echo 2 00:05:10.545 18:53:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:10.545 18:53:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:10.545 18:53:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:10.545 18:53:31 -- scripts/common.sh@367 -- # return 0 00:05:10.545 18:53:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:10.545 18:53:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:10.545 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:10.545 --rc genhtml_branch_coverage=1 00:05:10.545 --rc genhtml_function_coverage=1 00:05:10.545 --rc genhtml_legend=1 00:05:10.545 --rc geninfo_all_blocks=1 00:05:10.545 --rc geninfo_unexecuted_blocks=1 00:05:10.545 00:05:10.545 ' 00:05:10.545 18:53:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:10.545 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:10.545 --rc genhtml_branch_coverage=1 00:05:10.545 --rc genhtml_function_coverage=1 00:05:10.545 --rc genhtml_legend=1 00:05:10.545 --rc geninfo_all_blocks=1 00:05:10.545 --rc geninfo_unexecuted_blocks=1 00:05:10.545 00:05:10.545 ' 00:05:10.545 18:53:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:10.545 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:10.545 --rc genhtml_branch_coverage=1 00:05:10.545 --rc genhtml_function_coverage=1 00:05:10.545 --rc genhtml_legend=1 00:05:10.545 --rc geninfo_all_blocks=1 00:05:10.545 --rc geninfo_unexecuted_blocks=1 00:05:10.545 00:05:10.545 ' 00:05:10.545 18:53:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:10.545 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:10.545 --rc genhtml_branch_coverage=1 00:05:10.545 --rc genhtml_function_coverage=1 00:05:10.545 --rc genhtml_legend=1 00:05:10.545 --rc geninfo_all_blocks=1 00:05:10.545 --rc geninfo_unexecuted_blocks=1 00:05:10.545 00:05:10.545 ' 00:05:10.545 18:53:31 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:05:10.545 18:53:31 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:05:10.545 18:53:31 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:05:10.545 18:53:31 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:05:10.545 18:53:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:10.545 18:53:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:10.546 18:53:31 -- common/autotest_common.sh@10 -- # set +x 00:05:10.546 ************************************ 00:05:10.546 START TEST default_locks 00:05:10.546 ************************************ 00:05:10.546 18:53:31 -- common/autotest_common.sh@1114 -- # default_locks 00:05:10.546 18:53:31 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=87376 00:05:10.546 18:53:31 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:10.546 18:53:31 -- event/cpu_locks.sh@47 -- # waitforlisten 87376 00:05:10.546 18:53:31 -- common/autotest_common.sh@829 -- # '[' -z 87376 ']' 00:05:10.546 18:53:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:10.546 18:53:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:10.546 18:53:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:10.546 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:10.546 18:53:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:10.546 18:53:31 -- common/autotest_common.sh@10 -- # set +x 00:05:10.546 [2024-11-28 18:53:31.442158] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:10.546 [2024-11-28 18:53:31.442239] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid87376 ] 00:05:10.546 EAL: No free 2048 kB hugepages reported on node 1 00:05:10.546 [2024-11-28 18:53:31.503644] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:10.804 [2024-11-28 18:53:31.612123] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:10.804 [2024-11-28 18:53:31.612289] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:11.371 18:53:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:11.371 18:53:32 -- common/autotest_common.sh@862 -- # return 0 00:05:11.371 18:53:32 -- event/cpu_locks.sh@49 -- # locks_exist 87376 00:05:11.371 18:53:32 -- event/cpu_locks.sh@22 -- # lslocks -p 87376 00:05:11.371 18:53:32 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:11.629 lslocks: write error 00:05:11.629 18:53:32 -- event/cpu_locks.sh@50 -- # killprocess 87376 00:05:11.629 18:53:32 -- common/autotest_common.sh@936 -- # '[' -z 87376 ']' 00:05:11.629 18:53:32 -- common/autotest_common.sh@940 -- # kill -0 87376 00:05:11.629 18:53:32 -- common/autotest_common.sh@941 -- # uname 00:05:11.629 18:53:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:11.629 18:53:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 87376 00:05:11.888 18:53:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:11.888 18:53:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:11.888 18:53:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 87376' 00:05:11.888 killing process with pid 87376 00:05:11.888 18:53:32 -- common/autotest_common.sh@955 -- # kill 87376 00:05:11.888 18:53:32 -- common/autotest_common.sh@960 -- # wait 87376 00:05:12.147 18:53:33 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 87376 00:05:12.147 18:53:33 -- common/autotest_common.sh@650 -- # local es=0 00:05:12.147 18:53:33 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 87376 00:05:12.147 18:53:33 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:12.147 18:53:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:12.147 18:53:33 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:12.147 18:53:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:12.147 18:53:33 -- common/autotest_common.sh@653 -- # waitforlisten 87376 00:05:12.147 18:53:33 -- common/autotest_common.sh@829 -- # '[' -z 87376 ']' 00:05:12.147 18:53:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:12.147 18:53:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:12.147 18:53:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:12.147 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:12.147 18:53:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:12.147 18:53:33 -- common/autotest_common.sh@10 -- # set +x 00:05:12.147 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (87376) - No such process 00:05:12.147 ERROR: process (pid: 87376) is no longer running 00:05:12.147 18:53:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:12.147 18:53:33 -- common/autotest_common.sh@862 -- # return 1 00:05:12.147 18:53:33 -- common/autotest_common.sh@653 -- # es=1 00:05:12.147 18:53:33 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:12.147 18:53:33 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:12.147 18:53:33 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:12.147 18:53:33 -- event/cpu_locks.sh@54 -- # no_locks 00:05:12.147 18:53:33 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:12.147 18:53:33 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:12.147 18:53:33 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:12.147 00:05:12.147 real 0m1.766s 00:05:12.147 user 0m1.912s 00:05:12.147 sys 0m0.548s 00:05:12.147 18:53:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:12.147 18:53:33 -- common/autotest_common.sh@10 -- # set +x 00:05:12.147 ************************************ 00:05:12.147 END TEST default_locks 00:05:12.147 ************************************ 00:05:12.147 18:53:33 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:05:12.147 18:53:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:12.147 18:53:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:12.147 18:53:33 -- common/autotest_common.sh@10 -- # set +x 00:05:12.147 ************************************ 00:05:12.147 START TEST default_locks_via_rpc 00:05:12.147 ************************************ 00:05:12.147 18:53:33 -- common/autotest_common.sh@1114 -- # default_locks_via_rpc 00:05:12.147 18:53:33 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=87677 00:05:12.147 18:53:33 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:12.147 18:53:33 -- event/cpu_locks.sh@63 -- # waitforlisten 87677 00:05:12.147 18:53:33 -- common/autotest_common.sh@829 -- # '[' -z 87677 ']' 00:05:12.147 18:53:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:12.147 18:53:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:12.147 18:53:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:12.147 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:12.147 18:53:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:12.147 18:53:33 -- common/autotest_common.sh@10 -- # set +x 00:05:12.406 [2024-11-28 18:53:33.238563] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:12.406 [2024-11-28 18:53:33.238643] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid87677 ] 00:05:12.406 EAL: No free 2048 kB hugepages reported on node 1 00:05:12.406 [2024-11-28 18:53:33.301257] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:12.406 [2024-11-28 18:53:33.414159] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:12.406 [2024-11-28 18:53:33.414339] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:13.340 18:53:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:13.340 18:53:34 -- common/autotest_common.sh@862 -- # return 0 00:05:13.340 18:53:34 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:05:13.340 18:53:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:13.340 18:53:34 -- common/autotest_common.sh@10 -- # set +x 00:05:13.340 18:53:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:13.340 18:53:34 -- event/cpu_locks.sh@67 -- # no_locks 00:05:13.340 18:53:34 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:13.340 18:53:34 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:13.340 18:53:34 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:13.340 18:53:34 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:05:13.340 18:53:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:13.340 18:53:34 -- common/autotest_common.sh@10 -- # set +x 00:05:13.340 18:53:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:13.340 18:53:34 -- event/cpu_locks.sh@71 -- # locks_exist 87677 00:05:13.340 18:53:34 -- event/cpu_locks.sh@22 -- # lslocks -p 87677 00:05:13.340 18:53:34 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:13.599 18:53:34 -- event/cpu_locks.sh@73 -- # killprocess 87677 00:05:13.599 18:53:34 -- common/autotest_common.sh@936 -- # '[' -z 87677 ']' 00:05:13.599 18:53:34 -- common/autotest_common.sh@940 -- # kill -0 87677 00:05:13.599 18:53:34 -- common/autotest_common.sh@941 -- # uname 00:05:13.599 18:53:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:13.599 18:53:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 87677 00:05:13.599 18:53:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:13.599 18:53:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:13.599 18:53:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 87677' 00:05:13.599 killing process with pid 87677 00:05:13.599 18:53:34 -- common/autotest_common.sh@955 -- # kill 87677 00:05:13.599 18:53:34 -- common/autotest_common.sh@960 -- # wait 87677 00:05:14.174 00:05:14.174 real 0m1.760s 00:05:14.174 user 0m1.889s 00:05:14.174 sys 0m0.582s 00:05:14.174 18:53:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:14.174 18:53:34 -- common/autotest_common.sh@10 -- # set +x 00:05:14.174 ************************************ 00:05:14.174 END TEST default_locks_via_rpc 00:05:14.174 ************************************ 00:05:14.174 18:53:34 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:05:14.174 18:53:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:14.174 18:53:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:14.174 18:53:34 -- common/autotest_common.sh@10 -- # set +x 00:05:14.174 ************************************ 00:05:14.174 START TEST non_locking_app_on_locked_coremask 00:05:14.174 ************************************ 00:05:14.174 18:53:34 -- common/autotest_common.sh@1114 -- # non_locking_app_on_locked_coremask 00:05:14.174 18:53:34 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=87966 00:05:14.174 18:53:34 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:14.174 18:53:34 -- event/cpu_locks.sh@81 -- # waitforlisten 87966 /var/tmp/spdk.sock 00:05:14.174 18:53:34 -- common/autotest_common.sh@829 -- # '[' -z 87966 ']' 00:05:14.174 18:53:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:14.174 18:53:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:14.174 18:53:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:14.174 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:14.174 18:53:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:14.174 18:53:34 -- common/autotest_common.sh@10 -- # set +x 00:05:14.174 [2024-11-28 18:53:35.021677] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:14.174 [2024-11-28 18:53:35.021791] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid87966 ] 00:05:14.174 EAL: No free 2048 kB hugepages reported on node 1 00:05:14.174 [2024-11-28 18:53:35.079765] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:14.174 [2024-11-28 18:53:35.186641] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:14.174 [2024-11-28 18:53:35.186823] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:15.114 18:53:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:15.114 18:53:35 -- common/autotest_common.sh@862 -- # return 0 00:05:15.114 18:53:35 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=88052 00:05:15.114 18:53:35 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:05:15.114 18:53:35 -- event/cpu_locks.sh@85 -- # waitforlisten 88052 /var/tmp/spdk2.sock 00:05:15.114 18:53:35 -- common/autotest_common.sh@829 -- # '[' -z 88052 ']' 00:05:15.114 18:53:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:15.114 18:53:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:15.114 18:53:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:15.114 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:15.114 18:53:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:15.114 18:53:35 -- common/autotest_common.sh@10 -- # set +x 00:05:15.114 [2024-11-28 18:53:36.035665] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:15.114 [2024-11-28 18:53:36.035773] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid88052 ] 00:05:15.114 EAL: No free 2048 kB hugepages reported on node 1 00:05:15.114 [2024-11-28 18:53:36.130663] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:15.114 [2024-11-28 18:53:36.130696] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:15.373 [2024-11-28 18:53:36.362969] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:15.373 [2024-11-28 18:53:36.363163] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:15.941 18:53:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:15.941 18:53:36 -- common/autotest_common.sh@862 -- # return 0 00:05:15.941 18:53:36 -- event/cpu_locks.sh@87 -- # locks_exist 87966 00:05:15.941 18:53:36 -- event/cpu_locks.sh@22 -- # lslocks -p 87966 00:05:15.941 18:53:36 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:16.507 lslocks: write error 00:05:16.507 18:53:37 -- event/cpu_locks.sh@89 -- # killprocess 87966 00:05:16.507 18:53:37 -- common/autotest_common.sh@936 -- # '[' -z 87966 ']' 00:05:16.507 18:53:37 -- common/autotest_common.sh@940 -- # kill -0 87966 00:05:16.507 18:53:37 -- common/autotest_common.sh@941 -- # uname 00:05:16.507 18:53:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:16.507 18:53:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 87966 00:05:16.507 18:53:37 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:16.507 18:53:37 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:16.507 18:53:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 87966' 00:05:16.507 killing process with pid 87966 00:05:16.507 18:53:37 -- common/autotest_common.sh@955 -- # kill 87966 00:05:16.507 18:53:37 -- common/autotest_common.sh@960 -- # wait 87966 00:05:17.443 18:53:38 -- event/cpu_locks.sh@90 -- # killprocess 88052 00:05:17.443 18:53:38 -- common/autotest_common.sh@936 -- # '[' -z 88052 ']' 00:05:17.443 18:53:38 -- common/autotest_common.sh@940 -- # kill -0 88052 00:05:17.443 18:53:38 -- common/autotest_common.sh@941 -- # uname 00:05:17.443 18:53:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:17.443 18:53:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 88052 00:05:17.443 18:53:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:17.443 18:53:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:17.443 18:53:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 88052' 00:05:17.443 killing process with pid 88052 00:05:17.443 18:53:38 -- common/autotest_common.sh@955 -- # kill 88052 00:05:17.443 18:53:38 -- common/autotest_common.sh@960 -- # wait 88052 00:05:18.011 00:05:18.011 real 0m3.900s 00:05:18.011 user 0m4.278s 00:05:18.011 sys 0m1.059s 00:05:18.011 18:53:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:18.011 18:53:38 -- common/autotest_common.sh@10 -- # set +x 00:05:18.011 ************************************ 00:05:18.011 END TEST non_locking_app_on_locked_coremask 00:05:18.011 ************************************ 00:05:18.011 18:53:38 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:05:18.011 18:53:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:18.011 18:53:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:18.011 18:53:38 -- common/autotest_common.sh@10 -- # set +x 00:05:18.011 ************************************ 00:05:18.011 START TEST locking_app_on_unlocked_coremask 00:05:18.011 ************************************ 00:05:18.011 18:53:38 -- common/autotest_common.sh@1114 -- # locking_app_on_unlocked_coremask 00:05:18.011 18:53:38 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=88420 00:05:18.011 18:53:38 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:05:18.011 18:53:38 -- event/cpu_locks.sh@99 -- # waitforlisten 88420 /var/tmp/spdk.sock 00:05:18.011 18:53:38 -- common/autotest_common.sh@829 -- # '[' -z 88420 ']' 00:05:18.011 18:53:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:18.011 18:53:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:18.011 18:53:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:18.011 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:18.011 18:53:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:18.011 18:53:38 -- common/autotest_common.sh@10 -- # set +x 00:05:18.011 [2024-11-28 18:53:38.950946] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:18.011 [2024-11-28 18:53:38.951026] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid88420 ] 00:05:18.011 EAL: No free 2048 kB hugepages reported on node 1 00:05:18.011 [2024-11-28 18:53:39.013128] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:18.011 [2024-11-28 18:53:39.013173] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:18.270 [2024-11-28 18:53:39.127540] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:18.270 [2024-11-28 18:53:39.127720] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:19.204 18:53:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:19.204 18:53:39 -- common/autotest_common.sh@862 -- # return 0 00:05:19.204 18:53:39 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=88560 00:05:19.204 18:53:39 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:19.204 18:53:39 -- event/cpu_locks.sh@103 -- # waitforlisten 88560 /var/tmp/spdk2.sock 00:05:19.204 18:53:39 -- common/autotest_common.sh@829 -- # '[' -z 88560 ']' 00:05:19.204 18:53:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:19.204 18:53:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:19.205 18:53:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:19.205 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:19.205 18:53:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:19.205 18:53:39 -- common/autotest_common.sh@10 -- # set +x 00:05:19.205 [2024-11-28 18:53:39.940318] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:19.205 [2024-11-28 18:53:39.940400] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid88560 ] 00:05:19.205 EAL: No free 2048 kB hugepages reported on node 1 00:05:19.205 [2024-11-28 18:53:40.037075] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:19.464 [2024-11-28 18:53:40.271068] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:19.464 [2024-11-28 18:53:40.271256] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:20.032 18:53:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:20.032 18:53:40 -- common/autotest_common.sh@862 -- # return 0 00:05:20.032 18:53:40 -- event/cpu_locks.sh@105 -- # locks_exist 88560 00:05:20.032 18:53:40 -- event/cpu_locks.sh@22 -- # lslocks -p 88560 00:05:20.032 18:53:40 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:20.290 lslocks: write error 00:05:20.290 18:53:41 -- event/cpu_locks.sh@107 -- # killprocess 88420 00:05:20.290 18:53:41 -- common/autotest_common.sh@936 -- # '[' -z 88420 ']' 00:05:20.290 18:53:41 -- common/autotest_common.sh@940 -- # kill -0 88420 00:05:20.548 18:53:41 -- common/autotest_common.sh@941 -- # uname 00:05:20.548 18:53:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:20.548 18:53:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 88420 00:05:20.548 18:53:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:20.548 18:53:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:20.548 18:53:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 88420' 00:05:20.548 killing process with pid 88420 00:05:20.548 18:53:41 -- common/autotest_common.sh@955 -- # kill 88420 00:05:20.548 18:53:41 -- common/autotest_common.sh@960 -- # wait 88420 00:05:21.482 18:53:42 -- event/cpu_locks.sh@108 -- # killprocess 88560 00:05:21.482 18:53:42 -- common/autotest_common.sh@936 -- # '[' -z 88560 ']' 00:05:21.482 18:53:42 -- common/autotest_common.sh@940 -- # kill -0 88560 00:05:21.482 18:53:42 -- common/autotest_common.sh@941 -- # uname 00:05:21.482 18:53:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:21.482 18:53:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 88560 00:05:21.482 18:53:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:21.482 18:53:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:21.482 18:53:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 88560' 00:05:21.482 killing process with pid 88560 00:05:21.482 18:53:42 -- common/autotest_common.sh@955 -- # kill 88560 00:05:21.482 18:53:42 -- common/autotest_common.sh@960 -- # wait 88560 00:05:22.049 00:05:22.049 real 0m3.891s 00:05:22.049 user 0m4.241s 00:05:22.049 sys 0m1.102s 00:05:22.049 18:53:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:22.049 18:53:42 -- common/autotest_common.sh@10 -- # set +x 00:05:22.049 ************************************ 00:05:22.049 END TEST locking_app_on_unlocked_coremask 00:05:22.049 ************************************ 00:05:22.049 18:53:42 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:05:22.049 18:53:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:22.049 18:53:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:22.049 18:53:42 -- common/autotest_common.sh@10 -- # set +x 00:05:22.049 ************************************ 00:05:22.049 START TEST locking_app_on_locked_coremask 00:05:22.049 ************************************ 00:05:22.049 18:53:42 -- common/autotest_common.sh@1114 -- # locking_app_on_locked_coremask 00:05:22.049 18:53:42 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=89000 00:05:22.049 18:53:42 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:22.049 18:53:42 -- event/cpu_locks.sh@116 -- # waitforlisten 89000 /var/tmp/spdk.sock 00:05:22.049 18:53:42 -- common/autotest_common.sh@829 -- # '[' -z 89000 ']' 00:05:22.049 18:53:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:22.049 18:53:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:22.049 18:53:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:22.049 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:22.049 18:53:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:22.049 18:53:42 -- common/autotest_common.sh@10 -- # set +x 00:05:22.049 [2024-11-28 18:53:42.865777] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:22.049 [2024-11-28 18:53:42.865872] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid89000 ] 00:05:22.049 EAL: No free 2048 kB hugepages reported on node 1 00:05:22.049 [2024-11-28 18:53:42.923456] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:22.049 [2024-11-28 18:53:43.030840] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:22.049 [2024-11-28 18:53:43.031013] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:22.985 18:53:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:22.985 18:53:43 -- common/autotest_common.sh@862 -- # return 0 00:05:22.985 18:53:43 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=89036 00:05:22.985 18:53:43 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:22.985 18:53:43 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 89036 /var/tmp/spdk2.sock 00:05:22.985 18:53:43 -- common/autotest_common.sh@650 -- # local es=0 00:05:22.985 18:53:43 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 89036 /var/tmp/spdk2.sock 00:05:22.985 18:53:43 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:22.985 18:53:43 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:22.985 18:53:43 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:22.985 18:53:43 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:22.985 18:53:43 -- common/autotest_common.sh@653 -- # waitforlisten 89036 /var/tmp/spdk2.sock 00:05:22.985 18:53:43 -- common/autotest_common.sh@829 -- # '[' -z 89036 ']' 00:05:22.985 18:53:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:22.985 18:53:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:22.985 18:53:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:22.985 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:22.985 18:53:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:22.985 18:53:43 -- common/autotest_common.sh@10 -- # set +x 00:05:22.985 [2024-11-28 18:53:43.875371] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:22.985 [2024-11-28 18:53:43.875484] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid89036 ] 00:05:22.985 EAL: No free 2048 kB hugepages reported on node 1 00:05:22.985 [2024-11-28 18:53:43.967875] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 89000 has claimed it. 00:05:22.985 [2024-11-28 18:53:43.967946] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:23.551 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (89036) - No such process 00:05:23.551 ERROR: process (pid: 89036) is no longer running 00:05:23.551 18:53:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:23.551 18:53:44 -- common/autotest_common.sh@862 -- # return 1 00:05:23.551 18:53:44 -- common/autotest_common.sh@653 -- # es=1 00:05:23.551 18:53:44 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:23.551 18:53:44 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:23.551 18:53:44 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:23.551 18:53:44 -- event/cpu_locks.sh@122 -- # locks_exist 89000 00:05:23.551 18:53:44 -- event/cpu_locks.sh@22 -- # lslocks -p 89000 00:05:23.551 18:53:44 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:24.118 lslocks: write error 00:05:24.118 18:53:44 -- event/cpu_locks.sh@124 -- # killprocess 89000 00:05:24.118 18:53:44 -- common/autotest_common.sh@936 -- # '[' -z 89000 ']' 00:05:24.118 18:53:44 -- common/autotest_common.sh@940 -- # kill -0 89000 00:05:24.118 18:53:44 -- common/autotest_common.sh@941 -- # uname 00:05:24.118 18:53:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:24.118 18:53:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 89000 00:05:24.118 18:53:44 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:24.118 18:53:44 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:24.118 18:53:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 89000' 00:05:24.118 killing process with pid 89000 00:05:24.118 18:53:44 -- common/autotest_common.sh@955 -- # kill 89000 00:05:24.118 18:53:44 -- common/autotest_common.sh@960 -- # wait 89000 00:05:24.375 00:05:24.375 real 0m2.525s 00:05:24.375 user 0m2.899s 00:05:24.375 sys 0m0.673s 00:05:24.375 18:53:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:24.375 18:53:45 -- common/autotest_common.sh@10 -- # set +x 00:05:24.375 ************************************ 00:05:24.375 END TEST locking_app_on_locked_coremask 00:05:24.375 ************************************ 00:05:24.375 18:53:45 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:05:24.375 18:53:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:24.375 18:53:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:24.375 18:53:45 -- common/autotest_common.sh@10 -- # set +x 00:05:24.375 ************************************ 00:05:24.375 START TEST locking_overlapped_coremask 00:05:24.375 ************************************ 00:05:24.375 18:53:45 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask 00:05:24.375 18:53:45 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=89313 00:05:24.375 18:53:45 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:05:24.375 18:53:45 -- event/cpu_locks.sh@133 -- # waitforlisten 89313 /var/tmp/spdk.sock 00:05:24.375 18:53:45 -- common/autotest_common.sh@829 -- # '[' -z 89313 ']' 00:05:24.375 18:53:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:24.375 18:53:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:24.375 18:53:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:24.375 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:24.375 18:53:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:24.375 18:53:45 -- common/autotest_common.sh@10 -- # set +x 00:05:24.375 [2024-11-28 18:53:45.417202] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:24.375 [2024-11-28 18:53:45.417299] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid89313 ] 00:05:24.634 EAL: No free 2048 kB hugepages reported on node 1 00:05:24.634 [2024-11-28 18:53:45.475945] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:24.634 [2024-11-28 18:53:45.584675] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:24.634 [2024-11-28 18:53:45.584879] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:24.634 [2024-11-28 18:53:45.584940] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:24.634 [2024-11-28 18:53:45.584944] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:25.568 18:53:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:25.568 18:53:46 -- common/autotest_common.sh@862 -- # return 0 00:05:25.568 18:53:46 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=89455 00:05:25.568 18:53:46 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 89455 /var/tmp/spdk2.sock 00:05:25.568 18:53:46 -- common/autotest_common.sh@650 -- # local es=0 00:05:25.568 18:53:46 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 89455 /var/tmp/spdk2.sock 00:05:25.568 18:53:46 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:25.568 18:53:46 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:05:25.568 18:53:46 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:25.568 18:53:46 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:25.568 18:53:46 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:25.568 18:53:46 -- common/autotest_common.sh@653 -- # waitforlisten 89455 /var/tmp/spdk2.sock 00:05:25.568 18:53:46 -- common/autotest_common.sh@829 -- # '[' -z 89455 ']' 00:05:25.568 18:53:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:25.568 18:53:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:25.568 18:53:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:25.568 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:25.568 18:53:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:25.568 18:53:46 -- common/autotest_common.sh@10 -- # set +x 00:05:25.568 [2024-11-28 18:53:46.434529] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:25.568 [2024-11-28 18:53:46.434603] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid89455 ] 00:05:25.568 EAL: No free 2048 kB hugepages reported on node 1 00:05:25.568 [2024-11-28 18:53:46.522720] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 89313 has claimed it. 00:05:25.569 [2024-11-28 18:53:46.522781] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:26.135 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (89455) - No such process 00:05:26.135 ERROR: process (pid: 89455) is no longer running 00:05:26.135 18:53:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:26.135 18:53:47 -- common/autotest_common.sh@862 -- # return 1 00:05:26.135 18:53:47 -- common/autotest_common.sh@653 -- # es=1 00:05:26.135 18:53:47 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:26.135 18:53:47 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:26.135 18:53:47 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:26.135 18:53:47 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:05:26.135 18:53:47 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:26.135 18:53:47 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:26.135 18:53:47 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:26.135 18:53:47 -- event/cpu_locks.sh@141 -- # killprocess 89313 00:05:26.135 18:53:47 -- common/autotest_common.sh@936 -- # '[' -z 89313 ']' 00:05:26.135 18:53:47 -- common/autotest_common.sh@940 -- # kill -0 89313 00:05:26.135 18:53:47 -- common/autotest_common.sh@941 -- # uname 00:05:26.135 18:53:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:26.135 18:53:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 89313 00:05:26.135 18:53:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:26.135 18:53:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:26.135 18:53:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 89313' 00:05:26.135 killing process with pid 89313 00:05:26.135 18:53:47 -- common/autotest_common.sh@955 -- # kill 89313 00:05:26.135 18:53:47 -- common/autotest_common.sh@960 -- # wait 89313 00:05:26.702 00:05:26.702 real 0m2.235s 00:05:26.702 user 0m6.330s 00:05:26.702 sys 0m0.502s 00:05:26.702 18:53:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:26.702 18:53:47 -- common/autotest_common.sh@10 -- # set +x 00:05:26.702 ************************************ 00:05:26.702 END TEST locking_overlapped_coremask 00:05:26.702 ************************************ 00:05:26.702 18:53:47 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:05:26.702 18:53:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:26.702 18:53:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:26.702 18:53:47 -- common/autotest_common.sh@10 -- # set +x 00:05:26.702 ************************************ 00:05:26.702 START TEST locking_overlapped_coremask_via_rpc 00:05:26.702 ************************************ 00:05:26.702 18:53:47 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask_via_rpc 00:05:26.702 18:53:47 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=89621 00:05:26.702 18:53:47 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:05:26.702 18:53:47 -- event/cpu_locks.sh@149 -- # waitforlisten 89621 /var/tmp/spdk.sock 00:05:26.702 18:53:47 -- common/autotest_common.sh@829 -- # '[' -z 89621 ']' 00:05:26.702 18:53:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:26.702 18:53:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:26.702 18:53:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:26.702 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:26.702 18:53:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:26.702 18:53:47 -- common/autotest_common.sh@10 -- # set +x 00:05:26.702 [2024-11-28 18:53:47.683518] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:26.702 [2024-11-28 18:53:47.683598] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid89621 ] 00:05:26.702 EAL: No free 2048 kB hugepages reported on node 1 00:05:26.702 [2024-11-28 18:53:47.745808] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:26.702 [2024-11-28 18:53:47.745855] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:26.961 [2024-11-28 18:53:47.859515] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:26.961 [2024-11-28 18:53:47.859760] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:26.961 [2024-11-28 18:53:47.859831] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:26.961 [2024-11-28 18:53:47.859834] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:27.896 18:53:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:27.896 18:53:48 -- common/autotest_common.sh@862 -- # return 0 00:05:27.896 18:53:48 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=89763 00:05:27.896 18:53:48 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:05:27.896 18:53:48 -- event/cpu_locks.sh@153 -- # waitforlisten 89763 /var/tmp/spdk2.sock 00:05:27.896 18:53:48 -- common/autotest_common.sh@829 -- # '[' -z 89763 ']' 00:05:27.896 18:53:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:27.896 18:53:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:27.896 18:53:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:27.896 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:27.896 18:53:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:27.896 18:53:48 -- common/autotest_common.sh@10 -- # set +x 00:05:27.896 [2024-11-28 18:53:48.679065] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:27.896 [2024-11-28 18:53:48.679138] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid89763 ] 00:05:27.896 EAL: No free 2048 kB hugepages reported on node 1 00:05:27.896 [2024-11-28 18:53:48.766927] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:27.896 [2024-11-28 18:53:48.766966] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:28.155 [2024-11-28 18:53:48.983297] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:28.155 [2024-11-28 18:53:48.983519] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:28.155 [2024-11-28 18:53:48.987452] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:05:28.155 [2024-11-28 18:53:48.987454] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:28.721 18:53:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:28.721 18:53:49 -- common/autotest_common.sh@862 -- # return 0 00:05:28.721 18:53:49 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:05:28.721 18:53:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:28.721 18:53:49 -- common/autotest_common.sh@10 -- # set +x 00:05:28.721 18:53:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:28.721 18:53:49 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:28.721 18:53:49 -- common/autotest_common.sh@650 -- # local es=0 00:05:28.721 18:53:49 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:28.721 18:53:49 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:05:28.721 18:53:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:28.721 18:53:49 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:05:28.721 18:53:49 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:28.721 18:53:49 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:28.721 18:53:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:28.721 18:53:49 -- common/autotest_common.sh@10 -- # set +x 00:05:28.721 [2024-11-28 18:53:49.654486] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 89621 has claimed it. 00:05:28.721 request: 00:05:28.721 { 00:05:28.721 "method": "framework_enable_cpumask_locks", 00:05:28.721 "req_id": 1 00:05:28.721 } 00:05:28.721 Got JSON-RPC error response 00:05:28.721 response: 00:05:28.721 { 00:05:28.721 "code": -32603, 00:05:28.721 "message": "Failed to claim CPU core: 2" 00:05:28.722 } 00:05:28.722 18:53:49 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:05:28.722 18:53:49 -- common/autotest_common.sh@653 -- # es=1 00:05:28.722 18:53:49 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:28.722 18:53:49 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:28.722 18:53:49 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:28.722 18:53:49 -- event/cpu_locks.sh@158 -- # waitforlisten 89621 /var/tmp/spdk.sock 00:05:28.722 18:53:49 -- common/autotest_common.sh@829 -- # '[' -z 89621 ']' 00:05:28.722 18:53:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:28.722 18:53:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:28.722 18:53:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:28.722 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:28.722 18:53:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:28.722 18:53:49 -- common/autotest_common.sh@10 -- # set +x 00:05:28.980 18:53:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:28.980 18:53:49 -- common/autotest_common.sh@862 -- # return 0 00:05:28.980 18:53:49 -- event/cpu_locks.sh@159 -- # waitforlisten 89763 /var/tmp/spdk2.sock 00:05:28.980 18:53:49 -- common/autotest_common.sh@829 -- # '[' -z 89763 ']' 00:05:28.980 18:53:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:28.980 18:53:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:28.980 18:53:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:28.980 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:28.980 18:53:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:28.980 18:53:49 -- common/autotest_common.sh@10 -- # set +x 00:05:29.237 18:53:50 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:29.237 18:53:50 -- common/autotest_common.sh@862 -- # return 0 00:05:29.237 18:53:50 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:05:29.237 18:53:50 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:29.237 18:53:50 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:29.237 18:53:50 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:29.237 00:05:29.237 real 0m2.535s 00:05:29.237 user 0m1.263s 00:05:29.237 sys 0m0.202s 00:05:29.237 18:53:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:29.237 18:53:50 -- common/autotest_common.sh@10 -- # set +x 00:05:29.237 ************************************ 00:05:29.237 END TEST locking_overlapped_coremask_via_rpc 00:05:29.237 ************************************ 00:05:29.237 18:53:50 -- event/cpu_locks.sh@174 -- # cleanup 00:05:29.237 18:53:50 -- event/cpu_locks.sh@15 -- # [[ -z 89621 ]] 00:05:29.237 18:53:50 -- event/cpu_locks.sh@15 -- # killprocess 89621 00:05:29.237 18:53:50 -- common/autotest_common.sh@936 -- # '[' -z 89621 ']' 00:05:29.237 18:53:50 -- common/autotest_common.sh@940 -- # kill -0 89621 00:05:29.237 18:53:50 -- common/autotest_common.sh@941 -- # uname 00:05:29.237 18:53:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:29.237 18:53:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 89621 00:05:29.237 18:53:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:29.237 18:53:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:29.237 18:53:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 89621' 00:05:29.237 killing process with pid 89621 00:05:29.237 18:53:50 -- common/autotest_common.sh@955 -- # kill 89621 00:05:29.237 18:53:50 -- common/autotest_common.sh@960 -- # wait 89621 00:05:29.803 18:53:50 -- event/cpu_locks.sh@16 -- # [[ -z 89763 ]] 00:05:29.803 18:53:50 -- event/cpu_locks.sh@16 -- # killprocess 89763 00:05:29.803 18:53:50 -- common/autotest_common.sh@936 -- # '[' -z 89763 ']' 00:05:29.803 18:53:50 -- common/autotest_common.sh@940 -- # kill -0 89763 00:05:29.803 18:53:50 -- common/autotest_common.sh@941 -- # uname 00:05:29.803 18:53:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:29.803 18:53:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 89763 00:05:29.803 18:53:50 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:05:29.803 18:53:50 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:05:29.803 18:53:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 89763' 00:05:29.803 killing process with pid 89763 00:05:29.803 18:53:50 -- common/autotest_common.sh@955 -- # kill 89763 00:05:29.803 18:53:50 -- common/autotest_common.sh@960 -- # wait 89763 00:05:30.367 18:53:51 -- event/cpu_locks.sh@18 -- # rm -f 00:05:30.367 18:53:51 -- event/cpu_locks.sh@1 -- # cleanup 00:05:30.367 18:53:51 -- event/cpu_locks.sh@15 -- # [[ -z 89621 ]] 00:05:30.367 18:53:51 -- event/cpu_locks.sh@15 -- # killprocess 89621 00:05:30.367 18:53:51 -- common/autotest_common.sh@936 -- # '[' -z 89621 ']' 00:05:30.367 18:53:51 -- common/autotest_common.sh@940 -- # kill -0 89621 00:05:30.367 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (89621) - No such process 00:05:30.367 18:53:51 -- common/autotest_common.sh@963 -- # echo 'Process with pid 89621 is not found' 00:05:30.367 Process with pid 89621 is not found 00:05:30.367 18:53:51 -- event/cpu_locks.sh@16 -- # [[ -z 89763 ]] 00:05:30.367 18:53:51 -- event/cpu_locks.sh@16 -- # killprocess 89763 00:05:30.367 18:53:51 -- common/autotest_common.sh@936 -- # '[' -z 89763 ']' 00:05:30.367 18:53:51 -- common/autotest_common.sh@940 -- # kill -0 89763 00:05:30.367 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (89763) - No such process 00:05:30.367 18:53:51 -- common/autotest_common.sh@963 -- # echo 'Process with pid 89763 is not found' 00:05:30.367 Process with pid 89763 is not found 00:05:30.367 18:53:51 -- event/cpu_locks.sh@18 -- # rm -f 00:05:30.367 00:05:30.367 real 0m19.920s 00:05:30.367 user 0m35.566s 00:05:30.367 sys 0m5.512s 00:05:30.367 18:53:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:30.367 18:53:51 -- common/autotest_common.sh@10 -- # set +x 00:05:30.367 ************************************ 00:05:30.367 END TEST cpu_locks 00:05:30.367 ************************************ 00:05:30.367 00:05:30.367 real 0m46.071s 00:05:30.367 user 1m27.506s 00:05:30.367 sys 0m9.504s 00:05:30.367 18:53:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:30.367 18:53:51 -- common/autotest_common.sh@10 -- # set +x 00:05:30.367 ************************************ 00:05:30.367 END TEST event 00:05:30.367 ************************************ 00:05:30.367 18:53:51 -- spdk/autotest.sh@175 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:30.367 18:53:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:30.367 18:53:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:30.367 18:53:51 -- common/autotest_common.sh@10 -- # set +x 00:05:30.367 ************************************ 00:05:30.367 START TEST thread 00:05:30.367 ************************************ 00:05:30.367 18:53:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:30.367 * Looking for test storage... 00:05:30.367 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:05:30.367 18:53:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:30.367 18:53:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:30.367 18:53:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:30.367 18:53:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:30.367 18:53:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:30.367 18:53:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:30.367 18:53:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:30.367 18:53:51 -- scripts/common.sh@335 -- # IFS=.-: 00:05:30.367 18:53:51 -- scripts/common.sh@335 -- # read -ra ver1 00:05:30.367 18:53:51 -- scripts/common.sh@336 -- # IFS=.-: 00:05:30.367 18:53:51 -- scripts/common.sh@336 -- # read -ra ver2 00:05:30.367 18:53:51 -- scripts/common.sh@337 -- # local 'op=<' 00:05:30.367 18:53:51 -- scripts/common.sh@339 -- # ver1_l=2 00:05:30.367 18:53:51 -- scripts/common.sh@340 -- # ver2_l=1 00:05:30.367 18:53:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:30.367 18:53:51 -- scripts/common.sh@343 -- # case "$op" in 00:05:30.367 18:53:51 -- scripts/common.sh@344 -- # : 1 00:05:30.367 18:53:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:30.367 18:53:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:30.367 18:53:51 -- scripts/common.sh@364 -- # decimal 1 00:05:30.367 18:53:51 -- scripts/common.sh@352 -- # local d=1 00:05:30.367 18:53:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:30.367 18:53:51 -- scripts/common.sh@354 -- # echo 1 00:05:30.367 18:53:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:30.367 18:53:51 -- scripts/common.sh@365 -- # decimal 2 00:05:30.367 18:53:51 -- scripts/common.sh@352 -- # local d=2 00:05:30.367 18:53:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:30.367 18:53:51 -- scripts/common.sh@354 -- # echo 2 00:05:30.367 18:53:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:30.367 18:53:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:30.367 18:53:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:30.367 18:53:51 -- scripts/common.sh@367 -- # return 0 00:05:30.367 18:53:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:30.367 18:53:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:30.367 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:30.367 --rc genhtml_branch_coverage=1 00:05:30.367 --rc genhtml_function_coverage=1 00:05:30.367 --rc genhtml_legend=1 00:05:30.367 --rc geninfo_all_blocks=1 00:05:30.367 --rc geninfo_unexecuted_blocks=1 00:05:30.367 00:05:30.367 ' 00:05:30.367 18:53:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:30.367 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:30.368 --rc genhtml_branch_coverage=1 00:05:30.368 --rc genhtml_function_coverage=1 00:05:30.368 --rc genhtml_legend=1 00:05:30.368 --rc geninfo_all_blocks=1 00:05:30.368 --rc geninfo_unexecuted_blocks=1 00:05:30.368 00:05:30.368 ' 00:05:30.368 18:53:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:30.368 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:30.368 --rc genhtml_branch_coverage=1 00:05:30.368 --rc genhtml_function_coverage=1 00:05:30.368 --rc genhtml_legend=1 00:05:30.368 --rc geninfo_all_blocks=1 00:05:30.368 --rc geninfo_unexecuted_blocks=1 00:05:30.368 00:05:30.368 ' 00:05:30.368 18:53:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:30.368 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:30.368 --rc genhtml_branch_coverage=1 00:05:30.368 --rc genhtml_function_coverage=1 00:05:30.368 --rc genhtml_legend=1 00:05:30.368 --rc geninfo_all_blocks=1 00:05:30.368 --rc geninfo_unexecuted_blocks=1 00:05:30.368 00:05:30.368 ' 00:05:30.368 18:53:51 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:30.368 18:53:51 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:30.368 18:53:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:30.368 18:53:51 -- common/autotest_common.sh@10 -- # set +x 00:05:30.368 ************************************ 00:05:30.368 START TEST thread_poller_perf 00:05:30.368 ************************************ 00:05:30.368 18:53:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:30.368 [2024-11-28 18:53:51.379671] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:30.368 [2024-11-28 18:53:51.379773] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid90143 ] 00:05:30.368 EAL: No free 2048 kB hugepages reported on node 1 00:05:30.625 [2024-11-28 18:53:51.441808] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:30.625 [2024-11-28 18:53:51.553308] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:30.625 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:05:31.994 [2024-11-28T17:53:53.042Z] ====================================== 00:05:31.994 [2024-11-28T17:53:53.042Z] busy:2718703031 (cyc) 00:05:31.994 [2024-11-28T17:53:53.042Z] total_run_count: 277000 00:05:31.994 [2024-11-28T17:53:53.042Z] tsc_hz: 2700000000 (cyc) 00:05:31.994 [2024-11-28T17:53:53.042Z] ====================================== 00:05:31.994 [2024-11-28T17:53:53.042Z] poller_cost: 9814 (cyc), 3634 (nsec) 00:05:31.994 00:05:31.994 real 0m1.323s 00:05:31.994 user 0m1.236s 00:05:31.994 sys 0m0.078s 00:05:31.994 18:53:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:31.994 18:53:52 -- common/autotest_common.sh@10 -- # set +x 00:05:31.994 ************************************ 00:05:31.994 END TEST thread_poller_perf 00:05:31.994 ************************************ 00:05:31.995 18:53:52 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:31.995 18:53:52 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:31.995 18:53:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:31.995 18:53:52 -- common/autotest_common.sh@10 -- # set +x 00:05:31.995 ************************************ 00:05:31.995 START TEST thread_poller_perf 00:05:31.995 ************************************ 00:05:31.995 18:53:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:31.995 [2024-11-28 18:53:52.730855] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:31.995 [2024-11-28 18:53:52.730946] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid90297 ] 00:05:31.995 EAL: No free 2048 kB hugepages reported on node 1 00:05:31.995 [2024-11-28 18:53:52.793107] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:31.995 [2024-11-28 18:53:52.915058] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:31.995 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:05:33.367 [2024-11-28T17:53:54.415Z] ====================================== 00:05:33.367 [2024-11-28T17:53:54.415Z] busy:2703640379 (cyc) 00:05:33.367 [2024-11-28T17:53:54.415Z] total_run_count: 3826000 00:05:33.367 [2024-11-28T17:53:54.415Z] tsc_hz: 2700000000 (cyc) 00:05:33.367 [2024-11-28T17:53:54.415Z] ====================================== 00:05:33.367 [2024-11-28T17:53:54.415Z] poller_cost: 706 (cyc), 261 (nsec) 00:05:33.367 00:05:33.367 real 0m1.327s 00:05:33.367 user 0m1.232s 00:05:33.367 sys 0m0.087s 00:05:33.367 18:53:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:33.367 18:53:54 -- common/autotest_common.sh@10 -- # set +x 00:05:33.367 ************************************ 00:05:33.367 END TEST thread_poller_perf 00:05:33.367 ************************************ 00:05:33.367 18:53:54 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:05:33.367 00:05:33.367 real 0m2.847s 00:05:33.367 user 0m2.579s 00:05:33.367 sys 0m0.269s 00:05:33.367 18:53:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:33.367 18:53:54 -- common/autotest_common.sh@10 -- # set +x 00:05:33.367 ************************************ 00:05:33.367 END TEST thread 00:05:33.367 ************************************ 00:05:33.367 18:53:54 -- spdk/autotest.sh@176 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:33.367 18:53:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:33.367 18:53:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:33.367 18:53:54 -- common/autotest_common.sh@10 -- # set +x 00:05:33.367 ************************************ 00:05:33.367 START TEST accel 00:05:33.367 ************************************ 00:05:33.367 18:53:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:33.367 * Looking for test storage... 00:05:33.367 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:05:33.367 18:53:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:33.367 18:53:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:33.367 18:53:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:33.367 18:53:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:33.367 18:53:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:33.367 18:53:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:33.367 18:53:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:33.367 18:53:54 -- scripts/common.sh@335 -- # IFS=.-: 00:05:33.367 18:53:54 -- scripts/common.sh@335 -- # read -ra ver1 00:05:33.367 18:53:54 -- scripts/common.sh@336 -- # IFS=.-: 00:05:33.367 18:53:54 -- scripts/common.sh@336 -- # read -ra ver2 00:05:33.367 18:53:54 -- scripts/common.sh@337 -- # local 'op=<' 00:05:33.367 18:53:54 -- scripts/common.sh@339 -- # ver1_l=2 00:05:33.367 18:53:54 -- scripts/common.sh@340 -- # ver2_l=1 00:05:33.367 18:53:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:33.367 18:53:54 -- scripts/common.sh@343 -- # case "$op" in 00:05:33.367 18:53:54 -- scripts/common.sh@344 -- # : 1 00:05:33.367 18:53:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:33.367 18:53:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:33.367 18:53:54 -- scripts/common.sh@364 -- # decimal 1 00:05:33.367 18:53:54 -- scripts/common.sh@352 -- # local d=1 00:05:33.367 18:53:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:33.367 18:53:54 -- scripts/common.sh@354 -- # echo 1 00:05:33.367 18:53:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:33.367 18:53:54 -- scripts/common.sh@365 -- # decimal 2 00:05:33.367 18:53:54 -- scripts/common.sh@352 -- # local d=2 00:05:33.367 18:53:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:33.367 18:53:54 -- scripts/common.sh@354 -- # echo 2 00:05:33.367 18:53:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:33.367 18:53:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:33.367 18:53:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:33.367 18:53:54 -- scripts/common.sh@367 -- # return 0 00:05:33.367 18:53:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:33.367 18:53:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:33.367 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:33.367 --rc genhtml_branch_coverage=1 00:05:33.367 --rc genhtml_function_coverage=1 00:05:33.367 --rc genhtml_legend=1 00:05:33.367 --rc geninfo_all_blocks=1 00:05:33.367 --rc geninfo_unexecuted_blocks=1 00:05:33.367 00:05:33.367 ' 00:05:33.367 18:53:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:33.367 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:33.367 --rc genhtml_branch_coverage=1 00:05:33.367 --rc genhtml_function_coverage=1 00:05:33.367 --rc genhtml_legend=1 00:05:33.367 --rc geninfo_all_blocks=1 00:05:33.367 --rc geninfo_unexecuted_blocks=1 00:05:33.367 00:05:33.367 ' 00:05:33.367 18:53:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:33.367 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:33.367 --rc genhtml_branch_coverage=1 00:05:33.367 --rc genhtml_function_coverage=1 00:05:33.367 --rc genhtml_legend=1 00:05:33.367 --rc geninfo_all_blocks=1 00:05:33.367 --rc geninfo_unexecuted_blocks=1 00:05:33.367 00:05:33.367 ' 00:05:33.367 18:53:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:33.367 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:33.367 --rc genhtml_branch_coverage=1 00:05:33.367 --rc genhtml_function_coverage=1 00:05:33.367 --rc genhtml_legend=1 00:05:33.367 --rc geninfo_all_blocks=1 00:05:33.367 --rc geninfo_unexecuted_blocks=1 00:05:33.367 00:05:33.367 ' 00:05:33.367 18:53:54 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:05:33.367 18:53:54 -- accel/accel.sh@74 -- # get_expected_opcs 00:05:33.367 18:53:54 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:33.367 18:53:54 -- accel/accel.sh@59 -- # spdk_tgt_pid=90628 00:05:33.367 18:53:54 -- accel/accel.sh@60 -- # waitforlisten 90628 00:05:33.367 18:53:54 -- common/autotest_common.sh@829 -- # '[' -z 90628 ']' 00:05:33.367 18:53:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:33.367 18:53:54 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:05:33.367 18:53:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:33.367 18:53:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:33.367 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:33.367 18:53:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:33.367 18:53:54 -- common/autotest_common.sh@10 -- # set +x 00:05:33.367 18:53:54 -- accel/accel.sh@58 -- # build_accel_config 00:05:33.367 18:53:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:33.367 18:53:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:33.367 18:53:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:33.367 18:53:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:33.367 18:53:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:33.367 18:53:54 -- accel/accel.sh@41 -- # local IFS=, 00:05:33.367 18:53:54 -- accel/accel.sh@42 -- # jq -r . 00:05:33.367 [2024-11-28 18:53:54.264117] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:33.367 [2024-11-28 18:53:54.264207] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid90628 ] 00:05:33.367 EAL: No free 2048 kB hugepages reported on node 1 00:05:33.367 [2024-11-28 18:53:54.319807] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:33.626 [2024-11-28 18:53:54.430050] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:33.626 [2024-11-28 18:53:54.430211] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:34.192 18:53:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:34.192 18:53:55 -- common/autotest_common.sh@862 -- # return 0 00:05:34.192 18:53:55 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:05:34.192 18:53:55 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:05:34.192 18:53:55 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:05:34.192 18:53:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:34.192 18:53:55 -- common/autotest_common.sh@10 -- # set +x 00:05:34.192 18:53:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:34.451 18:53:55 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:34.451 18:53:55 -- accel/accel.sh@64 -- # IFS== 00:05:34.451 18:53:55 -- accel/accel.sh@64 -- # read -r opc module 00:05:34.451 18:53:55 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:34.451 18:53:55 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:34.451 18:53:55 -- accel/accel.sh@64 -- # IFS== 00:05:34.451 18:53:55 -- accel/accel.sh@64 -- # read -r opc module 00:05:34.451 18:53:55 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:34.451 18:53:55 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:34.451 18:53:55 -- accel/accel.sh@64 -- # IFS== 00:05:34.451 18:53:55 -- accel/accel.sh@64 -- # read -r opc module 00:05:34.451 18:53:55 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:34.451 18:53:55 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:34.451 18:53:55 -- accel/accel.sh@64 -- # IFS== 00:05:34.451 18:53:55 -- accel/accel.sh@64 -- # read -r opc module 00:05:34.451 18:53:55 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:34.451 18:53:55 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:34.451 18:53:55 -- accel/accel.sh@64 -- # IFS== 00:05:34.451 18:53:55 -- accel/accel.sh@64 -- # read -r opc module 00:05:34.451 18:53:55 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:34.451 18:53:55 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:34.451 18:53:55 -- accel/accel.sh@64 -- # IFS== 00:05:34.451 18:53:55 -- accel/accel.sh@64 -- # read -r opc module 00:05:34.451 18:53:55 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:34.451 18:53:55 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:34.451 18:53:55 -- accel/accel.sh@64 -- # IFS== 00:05:34.451 18:53:55 -- accel/accel.sh@64 -- # read -r opc module 00:05:34.451 18:53:55 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:34.451 18:53:55 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:34.451 18:53:55 -- accel/accel.sh@64 -- # IFS== 00:05:34.451 18:53:55 -- accel/accel.sh@64 -- # read -r opc module 00:05:34.451 18:53:55 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:34.451 18:53:55 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:34.451 18:53:55 -- accel/accel.sh@64 -- # IFS== 00:05:34.451 18:53:55 -- accel/accel.sh@64 -- # read -r opc module 00:05:34.451 18:53:55 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:34.451 18:53:55 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:34.451 18:53:55 -- accel/accel.sh@64 -- # IFS== 00:05:34.451 18:53:55 -- accel/accel.sh@64 -- # read -r opc module 00:05:34.451 18:53:55 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:34.451 18:53:55 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:34.451 18:53:55 -- accel/accel.sh@64 -- # IFS== 00:05:34.451 18:53:55 -- accel/accel.sh@64 -- # read -r opc module 00:05:34.451 18:53:55 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:34.451 18:53:55 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:34.451 18:53:55 -- accel/accel.sh@64 -- # IFS== 00:05:34.451 18:53:55 -- accel/accel.sh@64 -- # read -r opc module 00:05:34.451 18:53:55 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:34.451 18:53:55 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:34.451 18:53:55 -- accel/accel.sh@64 -- # IFS== 00:05:34.451 18:53:55 -- accel/accel.sh@64 -- # read -r opc module 00:05:34.451 18:53:55 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:34.451 18:53:55 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:34.451 18:53:55 -- accel/accel.sh@64 -- # IFS== 00:05:34.451 18:53:55 -- accel/accel.sh@64 -- # read -r opc module 00:05:34.451 18:53:55 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:34.451 18:53:55 -- accel/accel.sh@67 -- # killprocess 90628 00:05:34.451 18:53:55 -- common/autotest_common.sh@936 -- # '[' -z 90628 ']' 00:05:34.451 18:53:55 -- common/autotest_common.sh@940 -- # kill -0 90628 00:05:34.451 18:53:55 -- common/autotest_common.sh@941 -- # uname 00:05:34.451 18:53:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:34.451 18:53:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 90628 00:05:34.451 18:53:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:34.451 18:53:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:34.451 18:53:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 90628' 00:05:34.451 killing process with pid 90628 00:05:34.451 18:53:55 -- common/autotest_common.sh@955 -- # kill 90628 00:05:34.451 18:53:55 -- common/autotest_common.sh@960 -- # wait 90628 00:05:35.019 18:53:55 -- accel/accel.sh@68 -- # trap - ERR 00:05:35.019 18:53:55 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:05:35.019 18:53:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:05:35.019 18:53:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:35.019 18:53:55 -- common/autotest_common.sh@10 -- # set +x 00:05:35.019 18:53:55 -- common/autotest_common.sh@1114 -- # accel_perf -h 00:05:35.019 18:53:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:05:35.019 18:53:55 -- accel/accel.sh@12 -- # build_accel_config 00:05:35.019 18:53:55 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:35.019 18:53:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:35.019 18:53:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:35.019 18:53:55 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:35.019 18:53:55 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:35.019 18:53:55 -- accel/accel.sh@41 -- # local IFS=, 00:05:35.019 18:53:55 -- accel/accel.sh@42 -- # jq -r . 00:05:35.019 18:53:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:35.019 18:53:55 -- common/autotest_common.sh@10 -- # set +x 00:05:35.019 18:53:55 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:05:35.019 18:53:55 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:35.019 18:53:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:35.019 18:53:55 -- common/autotest_common.sh@10 -- # set +x 00:05:35.019 ************************************ 00:05:35.019 START TEST accel_missing_filename 00:05:35.019 ************************************ 00:05:35.019 18:53:55 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress 00:05:35.019 18:53:55 -- common/autotest_common.sh@650 -- # local es=0 00:05:35.019 18:53:55 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress 00:05:35.019 18:53:55 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:35.019 18:53:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:35.019 18:53:55 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:35.019 18:53:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:35.019 18:53:55 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress 00:05:35.019 18:53:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:05:35.019 18:53:55 -- accel/accel.sh@12 -- # build_accel_config 00:05:35.019 18:53:55 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:35.019 18:53:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:35.019 18:53:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:35.019 18:53:55 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:35.019 18:53:55 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:35.019 18:53:55 -- accel/accel.sh@41 -- # local IFS=, 00:05:35.019 18:53:55 -- accel/accel.sh@42 -- # jq -r . 00:05:35.019 [2024-11-28 18:53:55.832935] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:35.019 [2024-11-28 18:53:55.833012] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid90804 ] 00:05:35.019 EAL: No free 2048 kB hugepages reported on node 1 00:05:35.019 [2024-11-28 18:53:55.895794] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:35.019 [2024-11-28 18:53:56.012794] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:35.277 [2024-11-28 18:53:56.074775] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:35.277 [2024-11-28 18:53:56.158729] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:35.278 A filename is required. 00:05:35.278 18:53:56 -- common/autotest_common.sh@653 -- # es=234 00:05:35.278 18:53:56 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:35.278 18:53:56 -- common/autotest_common.sh@662 -- # es=106 00:05:35.278 18:53:56 -- common/autotest_common.sh@663 -- # case "$es" in 00:05:35.278 18:53:56 -- common/autotest_common.sh@670 -- # es=1 00:05:35.278 18:53:56 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:35.278 00:05:35.278 real 0m0.465s 00:05:35.278 user 0m0.346s 00:05:35.278 sys 0m0.153s 00:05:35.278 18:53:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:35.278 18:53:56 -- common/autotest_common.sh@10 -- # set +x 00:05:35.278 ************************************ 00:05:35.278 END TEST accel_missing_filename 00:05:35.278 ************************************ 00:05:35.278 18:53:56 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:35.278 18:53:56 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:35.278 18:53:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:35.278 18:53:56 -- common/autotest_common.sh@10 -- # set +x 00:05:35.278 ************************************ 00:05:35.278 START TEST accel_compress_verify 00:05:35.278 ************************************ 00:05:35.278 18:53:56 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:35.278 18:53:56 -- common/autotest_common.sh@650 -- # local es=0 00:05:35.278 18:53:56 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:35.278 18:53:56 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:35.278 18:53:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:35.278 18:53:56 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:35.278 18:53:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:35.278 18:53:56 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:35.278 18:53:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:35.278 18:53:56 -- accel/accel.sh@12 -- # build_accel_config 00:05:35.278 18:53:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:35.278 18:53:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:35.278 18:53:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:35.278 18:53:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:35.278 18:53:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:35.278 18:53:56 -- accel/accel.sh@41 -- # local IFS=, 00:05:35.278 18:53:56 -- accel/accel.sh@42 -- # jq -r . 00:05:35.278 [2024-11-28 18:53:56.320133] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:35.278 [2024-11-28 18:53:56.320220] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid90946 ] 00:05:35.536 EAL: No free 2048 kB hugepages reported on node 1 00:05:35.536 [2024-11-28 18:53:56.385428] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:35.536 [2024-11-28 18:53:56.500206] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:35.536 [2024-11-28 18:53:56.562157] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:35.795 [2024-11-28 18:53:56.647367] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:35.795 00:05:35.795 Compression does not support the verify option, aborting. 00:05:35.795 18:53:56 -- common/autotest_common.sh@653 -- # es=161 00:05:35.795 18:53:56 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:35.795 18:53:56 -- common/autotest_common.sh@662 -- # es=33 00:05:35.795 18:53:56 -- common/autotest_common.sh@663 -- # case "$es" in 00:05:35.795 18:53:56 -- common/autotest_common.sh@670 -- # es=1 00:05:35.795 18:53:56 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:35.795 00:05:35.795 real 0m0.473s 00:05:35.795 user 0m0.367s 00:05:35.795 sys 0m0.142s 00:05:35.795 18:53:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:35.795 18:53:56 -- common/autotest_common.sh@10 -- # set +x 00:05:35.795 ************************************ 00:05:35.795 END TEST accel_compress_verify 00:05:35.795 ************************************ 00:05:35.795 18:53:56 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:05:35.795 18:53:56 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:35.795 18:53:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:35.795 18:53:56 -- common/autotest_common.sh@10 -- # set +x 00:05:35.795 ************************************ 00:05:35.795 START TEST accel_wrong_workload 00:05:35.795 ************************************ 00:05:35.795 18:53:56 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w foobar 00:05:35.795 18:53:56 -- common/autotest_common.sh@650 -- # local es=0 00:05:35.795 18:53:56 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:05:35.795 18:53:56 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:35.795 18:53:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:35.795 18:53:56 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:35.795 18:53:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:35.795 18:53:56 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w foobar 00:05:35.795 18:53:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:05:35.795 18:53:56 -- accel/accel.sh@12 -- # build_accel_config 00:05:35.795 18:53:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:35.795 18:53:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:35.795 18:53:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:35.795 18:53:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:35.795 18:53:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:35.795 18:53:56 -- accel/accel.sh@41 -- # local IFS=, 00:05:35.795 18:53:56 -- accel/accel.sh@42 -- # jq -r . 00:05:35.795 Unsupported workload type: foobar 00:05:35.795 [2024-11-28 18:53:56.816704] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:05:35.795 accel_perf options: 00:05:35.795 [-h help message] 00:05:35.795 [-q queue depth per core] 00:05:35.795 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:35.795 [-T number of threads per core 00:05:35.795 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:35.795 [-t time in seconds] 00:05:35.795 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:35.795 [ dif_verify, , dif_generate, dif_generate_copy 00:05:35.795 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:35.795 [-l for compress/decompress workloads, name of uncompressed input file 00:05:35.795 [-S for crc32c workload, use this seed value (default 0) 00:05:35.795 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:35.795 [-f for fill workload, use this BYTE value (default 255) 00:05:35.795 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:35.795 [-y verify result if this switch is on] 00:05:35.795 [-a tasks to allocate per core (default: same value as -q)] 00:05:35.796 Can be used to spread operations across a wider range of memory. 00:05:35.796 18:53:56 -- common/autotest_common.sh@653 -- # es=1 00:05:35.796 18:53:56 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:35.796 18:53:56 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:35.796 18:53:56 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:35.796 00:05:35.796 real 0m0.023s 00:05:35.796 user 0m0.013s 00:05:35.796 sys 0m0.009s 00:05:35.796 18:53:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:35.796 18:53:56 -- common/autotest_common.sh@10 -- # set +x 00:05:35.796 ************************************ 00:05:35.796 END TEST accel_wrong_workload 00:05:35.796 ************************************ 00:05:35.796 Error: writing output failed: Broken pipe 00:05:35.796 18:53:56 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:05:36.055 18:53:56 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:36.055 18:53:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:36.055 18:53:56 -- common/autotest_common.sh@10 -- # set +x 00:05:36.055 ************************************ 00:05:36.055 START TEST accel_negative_buffers 00:05:36.055 ************************************ 00:05:36.055 18:53:56 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:05:36.055 18:53:56 -- common/autotest_common.sh@650 -- # local es=0 00:05:36.055 18:53:56 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:05:36.055 18:53:56 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:36.055 18:53:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:36.055 18:53:56 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:36.055 18:53:56 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:36.055 18:53:56 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w xor -y -x -1 00:05:36.055 18:53:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:05:36.055 18:53:56 -- accel/accel.sh@12 -- # build_accel_config 00:05:36.055 18:53:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:36.055 18:53:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:36.055 18:53:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:36.055 18:53:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:36.055 18:53:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:36.055 18:53:56 -- accel/accel.sh@41 -- # local IFS=, 00:05:36.055 18:53:56 -- accel/accel.sh@42 -- # jq -r . 00:05:36.055 -x option must be non-negative. 00:05:36.055 [2024-11-28 18:53:56.864673] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:05:36.055 accel_perf options: 00:05:36.055 [-h help message] 00:05:36.055 [-q queue depth per core] 00:05:36.055 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:36.055 [-T number of threads per core 00:05:36.055 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:36.055 [-t time in seconds] 00:05:36.055 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:36.055 [ dif_verify, , dif_generate, dif_generate_copy 00:05:36.055 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:36.055 [-l for compress/decompress workloads, name of uncompressed input file 00:05:36.055 [-S for crc32c workload, use this seed value (default 0) 00:05:36.055 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:36.055 [-f for fill workload, use this BYTE value (default 255) 00:05:36.055 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:36.055 [-y verify result if this switch is on] 00:05:36.055 [-a tasks to allocate per core (default: same value as -q)] 00:05:36.055 Can be used to spread operations across a wider range of memory. 00:05:36.055 18:53:56 -- common/autotest_common.sh@653 -- # es=1 00:05:36.055 18:53:56 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:36.055 18:53:56 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:36.055 18:53:56 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:36.055 00:05:36.055 real 0m0.022s 00:05:36.055 user 0m0.008s 00:05:36.055 sys 0m0.015s 00:05:36.055 18:53:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:36.055 18:53:56 -- common/autotest_common.sh@10 -- # set +x 00:05:36.055 ************************************ 00:05:36.055 END TEST accel_negative_buffers 00:05:36.055 ************************************ 00:05:36.055 Error: writing output failed: Broken pipe 00:05:36.055 18:53:56 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:05:36.055 18:53:56 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:36.055 18:53:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:36.055 18:53:56 -- common/autotest_common.sh@10 -- # set +x 00:05:36.055 ************************************ 00:05:36.055 START TEST accel_crc32c 00:05:36.055 ************************************ 00:05:36.055 18:53:56 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -S 32 -y 00:05:36.055 18:53:56 -- accel/accel.sh@16 -- # local accel_opc 00:05:36.055 18:53:56 -- accel/accel.sh@17 -- # local accel_module 00:05:36.055 18:53:56 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:36.055 18:53:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:36.055 18:53:56 -- accel/accel.sh@12 -- # build_accel_config 00:05:36.055 18:53:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:36.055 18:53:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:36.055 18:53:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:36.055 18:53:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:36.055 18:53:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:36.055 18:53:56 -- accel/accel.sh@41 -- # local IFS=, 00:05:36.055 18:53:56 -- accel/accel.sh@42 -- # jq -r . 00:05:36.055 [2024-11-28 18:53:56.911033] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:36.055 [2024-11-28 18:53:56.911104] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid91013 ] 00:05:36.056 EAL: No free 2048 kB hugepages reported on node 1 00:05:36.056 [2024-11-28 18:53:56.972945] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:36.056 [2024-11-28 18:53:57.090178] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:37.431 18:53:58 -- accel/accel.sh@18 -- # out=' 00:05:37.431 SPDK Configuration: 00:05:37.431 Core mask: 0x1 00:05:37.431 00:05:37.431 Accel Perf Configuration: 00:05:37.431 Workload Type: crc32c 00:05:37.431 CRC-32C seed: 32 00:05:37.431 Transfer size: 4096 bytes 00:05:37.431 Vector count 1 00:05:37.431 Module: software 00:05:37.431 Queue depth: 32 00:05:37.431 Allocate depth: 32 00:05:37.431 # threads/core: 1 00:05:37.431 Run time: 1 seconds 00:05:37.431 Verify: Yes 00:05:37.431 00:05:37.431 Running for 1 seconds... 00:05:37.431 00:05:37.431 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:37.431 ------------------------------------------------------------------------------------ 00:05:37.431 0,0 412224/s 1610 MiB/s 0 0 00:05:37.431 ==================================================================================== 00:05:37.431 Total 412224/s 1610 MiB/s 0 0' 00:05:37.431 18:53:58 -- accel/accel.sh@20 -- # IFS=: 00:05:37.431 18:53:58 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:37.431 18:53:58 -- accel/accel.sh@20 -- # read -r var val 00:05:37.431 18:53:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:37.431 18:53:58 -- accel/accel.sh@12 -- # build_accel_config 00:05:37.431 18:53:58 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:37.431 18:53:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:37.431 18:53:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:37.431 18:53:58 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:37.431 18:53:58 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:37.431 18:53:58 -- accel/accel.sh@41 -- # local IFS=, 00:05:37.431 18:53:58 -- accel/accel.sh@42 -- # jq -r . 00:05:37.431 [2024-11-28 18:53:58.388556] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:37.431 [2024-11-28 18:53:58.388634] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid91151 ] 00:05:37.431 EAL: No free 2048 kB hugepages reported on node 1 00:05:37.431 [2024-11-28 18:53:58.451445] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:37.690 [2024-11-28 18:53:58.572503] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:37.690 18:53:58 -- accel/accel.sh@21 -- # val= 00:05:37.690 18:53:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.690 18:53:58 -- accel/accel.sh@20 -- # IFS=: 00:05:37.690 18:53:58 -- accel/accel.sh@20 -- # read -r var val 00:05:37.690 18:53:58 -- accel/accel.sh@21 -- # val= 00:05:37.690 18:53:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.690 18:53:58 -- accel/accel.sh@20 -- # IFS=: 00:05:37.690 18:53:58 -- accel/accel.sh@20 -- # read -r var val 00:05:37.690 18:53:58 -- accel/accel.sh@21 -- # val=0x1 00:05:37.690 18:53:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.690 18:53:58 -- accel/accel.sh@20 -- # IFS=: 00:05:37.690 18:53:58 -- accel/accel.sh@20 -- # read -r var val 00:05:37.690 18:53:58 -- accel/accel.sh@21 -- # val= 00:05:37.690 18:53:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.690 18:53:58 -- accel/accel.sh@20 -- # IFS=: 00:05:37.690 18:53:58 -- accel/accel.sh@20 -- # read -r var val 00:05:37.690 18:53:58 -- accel/accel.sh@21 -- # val= 00:05:37.690 18:53:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.690 18:53:58 -- accel/accel.sh@20 -- # IFS=: 00:05:37.690 18:53:58 -- accel/accel.sh@20 -- # read -r var val 00:05:37.690 18:53:58 -- accel/accel.sh@21 -- # val=crc32c 00:05:37.690 18:53:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.690 18:53:58 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:37.690 18:53:58 -- accel/accel.sh@20 -- # IFS=: 00:05:37.690 18:53:58 -- accel/accel.sh@20 -- # read -r var val 00:05:37.690 18:53:58 -- accel/accel.sh@21 -- # val=32 00:05:37.690 18:53:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.690 18:53:58 -- accel/accel.sh@20 -- # IFS=: 00:05:37.690 18:53:58 -- accel/accel.sh@20 -- # read -r var val 00:05:37.690 18:53:58 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:37.690 18:53:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.690 18:53:58 -- accel/accel.sh@20 -- # IFS=: 00:05:37.690 18:53:58 -- accel/accel.sh@20 -- # read -r var val 00:05:37.690 18:53:58 -- accel/accel.sh@21 -- # val= 00:05:37.690 18:53:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.690 18:53:58 -- accel/accel.sh@20 -- # IFS=: 00:05:37.690 18:53:58 -- accel/accel.sh@20 -- # read -r var val 00:05:37.690 18:53:58 -- accel/accel.sh@21 -- # val=software 00:05:37.690 18:53:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.690 18:53:58 -- accel/accel.sh@23 -- # accel_module=software 00:05:37.690 18:53:58 -- accel/accel.sh@20 -- # IFS=: 00:05:37.690 18:53:58 -- accel/accel.sh@20 -- # read -r var val 00:05:37.690 18:53:58 -- accel/accel.sh@21 -- # val=32 00:05:37.690 18:53:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.690 18:53:58 -- accel/accel.sh@20 -- # IFS=: 00:05:37.690 18:53:58 -- accel/accel.sh@20 -- # read -r var val 00:05:37.690 18:53:58 -- accel/accel.sh@21 -- # val=32 00:05:37.690 18:53:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.690 18:53:58 -- accel/accel.sh@20 -- # IFS=: 00:05:37.690 18:53:58 -- accel/accel.sh@20 -- # read -r var val 00:05:37.690 18:53:58 -- accel/accel.sh@21 -- # val=1 00:05:37.690 18:53:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.690 18:53:58 -- accel/accel.sh@20 -- # IFS=: 00:05:37.690 18:53:58 -- accel/accel.sh@20 -- # read -r var val 00:05:37.690 18:53:58 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:37.690 18:53:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.690 18:53:58 -- accel/accel.sh@20 -- # IFS=: 00:05:37.690 18:53:58 -- accel/accel.sh@20 -- # read -r var val 00:05:37.690 18:53:58 -- accel/accel.sh@21 -- # val=Yes 00:05:37.690 18:53:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.690 18:53:58 -- accel/accel.sh@20 -- # IFS=: 00:05:37.690 18:53:58 -- accel/accel.sh@20 -- # read -r var val 00:05:37.690 18:53:58 -- accel/accel.sh@21 -- # val= 00:05:37.690 18:53:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.690 18:53:58 -- accel/accel.sh@20 -- # IFS=: 00:05:37.690 18:53:58 -- accel/accel.sh@20 -- # read -r var val 00:05:37.690 18:53:58 -- accel/accel.sh@21 -- # val= 00:05:37.690 18:53:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:37.690 18:53:58 -- accel/accel.sh@20 -- # IFS=: 00:05:37.690 18:53:58 -- accel/accel.sh@20 -- # read -r var val 00:05:39.064 18:53:59 -- accel/accel.sh@21 -- # val= 00:05:39.064 18:53:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.064 18:53:59 -- accel/accel.sh@20 -- # IFS=: 00:05:39.064 18:53:59 -- accel/accel.sh@20 -- # read -r var val 00:05:39.064 18:53:59 -- accel/accel.sh@21 -- # val= 00:05:39.064 18:53:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.064 18:53:59 -- accel/accel.sh@20 -- # IFS=: 00:05:39.064 18:53:59 -- accel/accel.sh@20 -- # read -r var val 00:05:39.064 18:53:59 -- accel/accel.sh@21 -- # val= 00:05:39.064 18:53:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.064 18:53:59 -- accel/accel.sh@20 -- # IFS=: 00:05:39.064 18:53:59 -- accel/accel.sh@20 -- # read -r var val 00:05:39.064 18:53:59 -- accel/accel.sh@21 -- # val= 00:05:39.064 18:53:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.064 18:53:59 -- accel/accel.sh@20 -- # IFS=: 00:05:39.064 18:53:59 -- accel/accel.sh@20 -- # read -r var val 00:05:39.064 18:53:59 -- accel/accel.sh@21 -- # val= 00:05:39.064 18:53:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.064 18:53:59 -- accel/accel.sh@20 -- # IFS=: 00:05:39.064 18:53:59 -- accel/accel.sh@20 -- # read -r var val 00:05:39.064 18:53:59 -- accel/accel.sh@21 -- # val= 00:05:39.064 18:53:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:39.064 18:53:59 -- accel/accel.sh@20 -- # IFS=: 00:05:39.064 18:53:59 -- accel/accel.sh@20 -- # read -r var val 00:05:39.064 18:53:59 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:39.064 18:53:59 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:39.064 18:53:59 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:39.064 00:05:39.064 real 0m2.941s 00:05:39.064 user 0m2.655s 00:05:39.064 sys 0m0.279s 00:05:39.065 18:53:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:39.065 18:53:59 -- common/autotest_common.sh@10 -- # set +x 00:05:39.065 ************************************ 00:05:39.065 END TEST accel_crc32c 00:05:39.065 ************************************ 00:05:39.065 18:53:59 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:05:39.065 18:53:59 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:39.065 18:53:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:39.065 18:53:59 -- common/autotest_common.sh@10 -- # set +x 00:05:39.065 ************************************ 00:05:39.065 START TEST accel_crc32c_C2 00:05:39.065 ************************************ 00:05:39.065 18:53:59 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -y -C 2 00:05:39.065 18:53:59 -- accel/accel.sh@16 -- # local accel_opc 00:05:39.065 18:53:59 -- accel/accel.sh@17 -- # local accel_module 00:05:39.065 18:53:59 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:39.065 18:53:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:39.065 18:53:59 -- accel/accel.sh@12 -- # build_accel_config 00:05:39.065 18:53:59 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:39.065 18:53:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:39.065 18:53:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:39.065 18:53:59 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:39.065 18:53:59 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:39.065 18:53:59 -- accel/accel.sh@41 -- # local IFS=, 00:05:39.065 18:53:59 -- accel/accel.sh@42 -- # jq -r . 00:05:39.065 [2024-11-28 18:53:59.880150] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:39.065 [2024-11-28 18:53:59.880241] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid91440 ] 00:05:39.065 EAL: No free 2048 kB hugepages reported on node 1 00:05:39.065 [2024-11-28 18:53:59.943590] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:39.065 [2024-11-28 18:54:00.064135] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:40.439 18:54:01 -- accel/accel.sh@18 -- # out=' 00:05:40.439 SPDK Configuration: 00:05:40.439 Core mask: 0x1 00:05:40.439 00:05:40.439 Accel Perf Configuration: 00:05:40.439 Workload Type: crc32c 00:05:40.439 CRC-32C seed: 0 00:05:40.439 Transfer size: 4096 bytes 00:05:40.439 Vector count 2 00:05:40.439 Module: software 00:05:40.439 Queue depth: 32 00:05:40.439 Allocate depth: 32 00:05:40.439 # threads/core: 1 00:05:40.439 Run time: 1 seconds 00:05:40.439 Verify: Yes 00:05:40.439 00:05:40.439 Running for 1 seconds... 00:05:40.439 00:05:40.439 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:40.439 ------------------------------------------------------------------------------------ 00:05:40.439 0,0 314176/s 2454 MiB/s 0 0 00:05:40.439 ==================================================================================== 00:05:40.439 Total 314176/s 1227 MiB/s 0 0' 00:05:40.439 18:54:01 -- accel/accel.sh@20 -- # IFS=: 00:05:40.439 18:54:01 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:40.439 18:54:01 -- accel/accel.sh@20 -- # read -r var val 00:05:40.439 18:54:01 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:40.439 18:54:01 -- accel/accel.sh@12 -- # build_accel_config 00:05:40.439 18:54:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:40.439 18:54:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:40.439 18:54:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:40.439 18:54:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:40.439 18:54:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:40.439 18:54:01 -- accel/accel.sh@41 -- # local IFS=, 00:05:40.439 18:54:01 -- accel/accel.sh@42 -- # jq -r . 00:05:40.439 [2024-11-28 18:54:01.349736] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:40.439 [2024-11-28 18:54:01.349819] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid91662 ] 00:05:40.439 EAL: No free 2048 kB hugepages reported on node 1 00:05:40.439 [2024-11-28 18:54:01.412175] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:40.698 [2024-11-28 18:54:01.529823] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:40.698 18:54:01 -- accel/accel.sh@21 -- # val= 00:05:40.698 18:54:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.698 18:54:01 -- accel/accel.sh@20 -- # IFS=: 00:05:40.698 18:54:01 -- accel/accel.sh@20 -- # read -r var val 00:05:40.698 18:54:01 -- accel/accel.sh@21 -- # val= 00:05:40.698 18:54:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.698 18:54:01 -- accel/accel.sh@20 -- # IFS=: 00:05:40.698 18:54:01 -- accel/accel.sh@20 -- # read -r var val 00:05:40.698 18:54:01 -- accel/accel.sh@21 -- # val=0x1 00:05:40.698 18:54:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.698 18:54:01 -- accel/accel.sh@20 -- # IFS=: 00:05:40.698 18:54:01 -- accel/accel.sh@20 -- # read -r var val 00:05:40.698 18:54:01 -- accel/accel.sh@21 -- # val= 00:05:40.698 18:54:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.698 18:54:01 -- accel/accel.sh@20 -- # IFS=: 00:05:40.698 18:54:01 -- accel/accel.sh@20 -- # read -r var val 00:05:40.698 18:54:01 -- accel/accel.sh@21 -- # val= 00:05:40.698 18:54:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.698 18:54:01 -- accel/accel.sh@20 -- # IFS=: 00:05:40.698 18:54:01 -- accel/accel.sh@20 -- # read -r var val 00:05:40.698 18:54:01 -- accel/accel.sh@21 -- # val=crc32c 00:05:40.698 18:54:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.698 18:54:01 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:40.698 18:54:01 -- accel/accel.sh@20 -- # IFS=: 00:05:40.698 18:54:01 -- accel/accel.sh@20 -- # read -r var val 00:05:40.698 18:54:01 -- accel/accel.sh@21 -- # val=0 00:05:40.698 18:54:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.698 18:54:01 -- accel/accel.sh@20 -- # IFS=: 00:05:40.698 18:54:01 -- accel/accel.sh@20 -- # read -r var val 00:05:40.698 18:54:01 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:40.698 18:54:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.698 18:54:01 -- accel/accel.sh@20 -- # IFS=: 00:05:40.698 18:54:01 -- accel/accel.sh@20 -- # read -r var val 00:05:40.698 18:54:01 -- accel/accel.sh@21 -- # val= 00:05:40.698 18:54:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.698 18:54:01 -- accel/accel.sh@20 -- # IFS=: 00:05:40.698 18:54:01 -- accel/accel.sh@20 -- # read -r var val 00:05:40.698 18:54:01 -- accel/accel.sh@21 -- # val=software 00:05:40.698 18:54:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.698 18:54:01 -- accel/accel.sh@23 -- # accel_module=software 00:05:40.698 18:54:01 -- accel/accel.sh@20 -- # IFS=: 00:05:40.698 18:54:01 -- accel/accel.sh@20 -- # read -r var val 00:05:40.698 18:54:01 -- accel/accel.sh@21 -- # val=32 00:05:40.698 18:54:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.698 18:54:01 -- accel/accel.sh@20 -- # IFS=: 00:05:40.698 18:54:01 -- accel/accel.sh@20 -- # read -r var val 00:05:40.698 18:54:01 -- accel/accel.sh@21 -- # val=32 00:05:40.698 18:54:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.698 18:54:01 -- accel/accel.sh@20 -- # IFS=: 00:05:40.698 18:54:01 -- accel/accel.sh@20 -- # read -r var val 00:05:40.698 18:54:01 -- accel/accel.sh@21 -- # val=1 00:05:40.698 18:54:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.698 18:54:01 -- accel/accel.sh@20 -- # IFS=: 00:05:40.698 18:54:01 -- accel/accel.sh@20 -- # read -r var val 00:05:40.698 18:54:01 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:40.698 18:54:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.698 18:54:01 -- accel/accel.sh@20 -- # IFS=: 00:05:40.698 18:54:01 -- accel/accel.sh@20 -- # read -r var val 00:05:40.698 18:54:01 -- accel/accel.sh@21 -- # val=Yes 00:05:40.698 18:54:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.698 18:54:01 -- accel/accel.sh@20 -- # IFS=: 00:05:40.698 18:54:01 -- accel/accel.sh@20 -- # read -r var val 00:05:40.698 18:54:01 -- accel/accel.sh@21 -- # val= 00:05:40.698 18:54:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.698 18:54:01 -- accel/accel.sh@20 -- # IFS=: 00:05:40.698 18:54:01 -- accel/accel.sh@20 -- # read -r var val 00:05:40.698 18:54:01 -- accel/accel.sh@21 -- # val= 00:05:40.698 18:54:01 -- accel/accel.sh@22 -- # case "$var" in 00:05:40.698 18:54:01 -- accel/accel.sh@20 -- # IFS=: 00:05:40.698 18:54:01 -- accel/accel.sh@20 -- # read -r var val 00:05:42.074 18:54:02 -- accel/accel.sh@21 -- # val= 00:05:42.074 18:54:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.074 18:54:02 -- accel/accel.sh@20 -- # IFS=: 00:05:42.074 18:54:02 -- accel/accel.sh@20 -- # read -r var val 00:05:42.074 18:54:02 -- accel/accel.sh@21 -- # val= 00:05:42.074 18:54:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.074 18:54:02 -- accel/accel.sh@20 -- # IFS=: 00:05:42.074 18:54:02 -- accel/accel.sh@20 -- # read -r var val 00:05:42.074 18:54:02 -- accel/accel.sh@21 -- # val= 00:05:42.074 18:54:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.074 18:54:02 -- accel/accel.sh@20 -- # IFS=: 00:05:42.074 18:54:02 -- accel/accel.sh@20 -- # read -r var val 00:05:42.074 18:54:02 -- accel/accel.sh@21 -- # val= 00:05:42.074 18:54:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.074 18:54:02 -- accel/accel.sh@20 -- # IFS=: 00:05:42.074 18:54:02 -- accel/accel.sh@20 -- # read -r var val 00:05:42.074 18:54:02 -- accel/accel.sh@21 -- # val= 00:05:42.074 18:54:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.074 18:54:02 -- accel/accel.sh@20 -- # IFS=: 00:05:42.074 18:54:02 -- accel/accel.sh@20 -- # read -r var val 00:05:42.074 18:54:02 -- accel/accel.sh@21 -- # val= 00:05:42.074 18:54:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.074 18:54:02 -- accel/accel.sh@20 -- # IFS=: 00:05:42.074 18:54:02 -- accel/accel.sh@20 -- # read -r var val 00:05:42.074 18:54:02 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:42.074 18:54:02 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:42.074 18:54:02 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:42.074 00:05:42.074 real 0m2.948s 00:05:42.074 user 0m2.652s 00:05:42.074 sys 0m0.285s 00:05:42.074 18:54:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:42.074 18:54:02 -- common/autotest_common.sh@10 -- # set +x 00:05:42.074 ************************************ 00:05:42.074 END TEST accel_crc32c_C2 00:05:42.074 ************************************ 00:05:42.074 18:54:02 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:05:42.074 18:54:02 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:42.074 18:54:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:42.074 18:54:02 -- common/autotest_common.sh@10 -- # set +x 00:05:42.074 ************************************ 00:05:42.074 START TEST accel_copy 00:05:42.074 ************************************ 00:05:42.074 18:54:02 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy -y 00:05:42.074 18:54:02 -- accel/accel.sh@16 -- # local accel_opc 00:05:42.074 18:54:02 -- accel/accel.sh@17 -- # local accel_module 00:05:42.074 18:54:02 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:05:42.074 18:54:02 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:42.074 18:54:02 -- accel/accel.sh@12 -- # build_accel_config 00:05:42.074 18:54:02 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:42.074 18:54:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:42.074 18:54:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:42.075 18:54:02 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:42.075 18:54:02 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:42.075 18:54:02 -- accel/accel.sh@41 -- # local IFS=, 00:05:42.075 18:54:02 -- accel/accel.sh@42 -- # jq -r . 00:05:42.075 [2024-11-28 18:54:02.851851] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:42.075 [2024-11-28 18:54:02.851929] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid91853 ] 00:05:42.075 EAL: No free 2048 kB hugepages reported on node 1 00:05:42.075 [2024-11-28 18:54:02.913273] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:42.075 [2024-11-28 18:54:03.036753] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:43.450 18:54:04 -- accel/accel.sh@18 -- # out=' 00:05:43.450 SPDK Configuration: 00:05:43.450 Core mask: 0x1 00:05:43.450 00:05:43.450 Accel Perf Configuration: 00:05:43.450 Workload Type: copy 00:05:43.450 Transfer size: 4096 bytes 00:05:43.450 Vector count 1 00:05:43.450 Module: software 00:05:43.450 Queue depth: 32 00:05:43.451 Allocate depth: 32 00:05:43.451 # threads/core: 1 00:05:43.451 Run time: 1 seconds 00:05:43.451 Verify: Yes 00:05:43.451 00:05:43.451 Running for 1 seconds... 00:05:43.451 00:05:43.451 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:43.451 ------------------------------------------------------------------------------------ 00:05:43.451 0,0 277312/s 1083 MiB/s 0 0 00:05:43.451 ==================================================================================== 00:05:43.451 Total 277312/s 1083 MiB/s 0 0' 00:05:43.451 18:54:04 -- accel/accel.sh@20 -- # IFS=: 00:05:43.451 18:54:04 -- accel/accel.sh@20 -- # read -r var val 00:05:43.451 18:54:04 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:05:43.451 18:54:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:43.451 18:54:04 -- accel/accel.sh@12 -- # build_accel_config 00:05:43.451 18:54:04 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:43.451 18:54:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:43.451 18:54:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:43.451 18:54:04 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:43.451 18:54:04 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:43.451 18:54:04 -- accel/accel.sh@41 -- # local IFS=, 00:05:43.451 18:54:04 -- accel/accel.sh@42 -- # jq -r . 00:05:43.451 [2024-11-28 18:54:04.319028] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:43.451 [2024-11-28 18:54:04.319106] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid92114 ] 00:05:43.451 EAL: No free 2048 kB hugepages reported on node 1 00:05:43.451 [2024-11-28 18:54:04.381108] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:43.451 [2024-11-28 18:54:04.496014] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:43.710 18:54:04 -- accel/accel.sh@21 -- # val= 00:05:43.710 18:54:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.710 18:54:04 -- accel/accel.sh@20 -- # IFS=: 00:05:43.710 18:54:04 -- accel/accel.sh@20 -- # read -r var val 00:05:43.710 18:54:04 -- accel/accel.sh@21 -- # val= 00:05:43.710 18:54:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.710 18:54:04 -- accel/accel.sh@20 -- # IFS=: 00:05:43.710 18:54:04 -- accel/accel.sh@20 -- # read -r var val 00:05:43.710 18:54:04 -- accel/accel.sh@21 -- # val=0x1 00:05:43.710 18:54:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.710 18:54:04 -- accel/accel.sh@20 -- # IFS=: 00:05:43.710 18:54:04 -- accel/accel.sh@20 -- # read -r var val 00:05:43.710 18:54:04 -- accel/accel.sh@21 -- # val= 00:05:43.710 18:54:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.710 18:54:04 -- accel/accel.sh@20 -- # IFS=: 00:05:43.710 18:54:04 -- accel/accel.sh@20 -- # read -r var val 00:05:43.710 18:54:04 -- accel/accel.sh@21 -- # val= 00:05:43.710 18:54:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.710 18:54:04 -- accel/accel.sh@20 -- # IFS=: 00:05:43.710 18:54:04 -- accel/accel.sh@20 -- # read -r var val 00:05:43.710 18:54:04 -- accel/accel.sh@21 -- # val=copy 00:05:43.710 18:54:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.710 18:54:04 -- accel/accel.sh@24 -- # accel_opc=copy 00:05:43.710 18:54:04 -- accel/accel.sh@20 -- # IFS=: 00:05:43.710 18:54:04 -- accel/accel.sh@20 -- # read -r var val 00:05:43.710 18:54:04 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:43.710 18:54:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.710 18:54:04 -- accel/accel.sh@20 -- # IFS=: 00:05:43.710 18:54:04 -- accel/accel.sh@20 -- # read -r var val 00:05:43.710 18:54:04 -- accel/accel.sh@21 -- # val= 00:05:43.710 18:54:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.710 18:54:04 -- accel/accel.sh@20 -- # IFS=: 00:05:43.710 18:54:04 -- accel/accel.sh@20 -- # read -r var val 00:05:43.710 18:54:04 -- accel/accel.sh@21 -- # val=software 00:05:43.710 18:54:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.710 18:54:04 -- accel/accel.sh@23 -- # accel_module=software 00:05:43.710 18:54:04 -- accel/accel.sh@20 -- # IFS=: 00:05:43.710 18:54:04 -- accel/accel.sh@20 -- # read -r var val 00:05:43.710 18:54:04 -- accel/accel.sh@21 -- # val=32 00:05:43.710 18:54:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.710 18:54:04 -- accel/accel.sh@20 -- # IFS=: 00:05:43.710 18:54:04 -- accel/accel.sh@20 -- # read -r var val 00:05:43.710 18:54:04 -- accel/accel.sh@21 -- # val=32 00:05:43.710 18:54:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.710 18:54:04 -- accel/accel.sh@20 -- # IFS=: 00:05:43.710 18:54:04 -- accel/accel.sh@20 -- # read -r var val 00:05:43.710 18:54:04 -- accel/accel.sh@21 -- # val=1 00:05:43.710 18:54:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.710 18:54:04 -- accel/accel.sh@20 -- # IFS=: 00:05:43.710 18:54:04 -- accel/accel.sh@20 -- # read -r var val 00:05:43.710 18:54:04 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:43.710 18:54:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.710 18:54:04 -- accel/accel.sh@20 -- # IFS=: 00:05:43.710 18:54:04 -- accel/accel.sh@20 -- # read -r var val 00:05:43.710 18:54:04 -- accel/accel.sh@21 -- # val=Yes 00:05:43.710 18:54:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.710 18:54:04 -- accel/accel.sh@20 -- # IFS=: 00:05:43.710 18:54:04 -- accel/accel.sh@20 -- # read -r var val 00:05:43.710 18:54:04 -- accel/accel.sh@21 -- # val= 00:05:43.710 18:54:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.710 18:54:04 -- accel/accel.sh@20 -- # IFS=: 00:05:43.710 18:54:04 -- accel/accel.sh@20 -- # read -r var val 00:05:43.710 18:54:04 -- accel/accel.sh@21 -- # val= 00:05:43.710 18:54:04 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.710 18:54:04 -- accel/accel.sh@20 -- # IFS=: 00:05:43.710 18:54:04 -- accel/accel.sh@20 -- # read -r var val 00:05:45.084 18:54:05 -- accel/accel.sh@21 -- # val= 00:05:45.084 18:54:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.084 18:54:05 -- accel/accel.sh@20 -- # IFS=: 00:05:45.084 18:54:05 -- accel/accel.sh@20 -- # read -r var val 00:05:45.084 18:54:05 -- accel/accel.sh@21 -- # val= 00:05:45.084 18:54:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.084 18:54:05 -- accel/accel.sh@20 -- # IFS=: 00:05:45.084 18:54:05 -- accel/accel.sh@20 -- # read -r var val 00:05:45.084 18:54:05 -- accel/accel.sh@21 -- # val= 00:05:45.084 18:54:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.084 18:54:05 -- accel/accel.sh@20 -- # IFS=: 00:05:45.084 18:54:05 -- accel/accel.sh@20 -- # read -r var val 00:05:45.084 18:54:05 -- accel/accel.sh@21 -- # val= 00:05:45.084 18:54:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.084 18:54:05 -- accel/accel.sh@20 -- # IFS=: 00:05:45.084 18:54:05 -- accel/accel.sh@20 -- # read -r var val 00:05:45.084 18:54:05 -- accel/accel.sh@21 -- # val= 00:05:45.084 18:54:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.084 18:54:05 -- accel/accel.sh@20 -- # IFS=: 00:05:45.084 18:54:05 -- accel/accel.sh@20 -- # read -r var val 00:05:45.084 18:54:05 -- accel/accel.sh@21 -- # val= 00:05:45.084 18:54:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.084 18:54:05 -- accel/accel.sh@20 -- # IFS=: 00:05:45.084 18:54:05 -- accel/accel.sh@20 -- # read -r var val 00:05:45.084 18:54:05 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:45.084 18:54:05 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:05:45.084 18:54:05 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:45.084 00:05:45.084 real 0m2.939s 00:05:45.084 user 0m2.639s 00:05:45.084 sys 0m0.288s 00:05:45.084 18:54:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:45.084 18:54:05 -- common/autotest_common.sh@10 -- # set +x 00:05:45.084 ************************************ 00:05:45.084 END TEST accel_copy 00:05:45.084 ************************************ 00:05:45.084 18:54:05 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:45.084 18:54:05 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:05:45.084 18:54:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:45.084 18:54:05 -- common/autotest_common.sh@10 -- # set +x 00:05:45.084 ************************************ 00:05:45.084 START TEST accel_fill 00:05:45.084 ************************************ 00:05:45.084 18:54:05 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:45.084 18:54:05 -- accel/accel.sh@16 -- # local accel_opc 00:05:45.084 18:54:05 -- accel/accel.sh@17 -- # local accel_module 00:05:45.084 18:54:05 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:45.084 18:54:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:45.084 18:54:05 -- accel/accel.sh@12 -- # build_accel_config 00:05:45.084 18:54:05 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:45.084 18:54:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:45.084 18:54:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:45.084 18:54:05 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:45.084 18:54:05 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:45.084 18:54:05 -- accel/accel.sh@41 -- # local IFS=, 00:05:45.084 18:54:05 -- accel/accel.sh@42 -- # jq -r . 00:05:45.084 [2024-11-28 18:54:05.818208] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:45.084 [2024-11-28 18:54:05.818296] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid92281 ] 00:05:45.084 EAL: No free 2048 kB hugepages reported on node 1 00:05:45.084 [2024-11-28 18:54:05.881548] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:45.084 [2024-11-28 18:54:05.996470] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:46.460 18:54:07 -- accel/accel.sh@18 -- # out=' 00:05:46.460 SPDK Configuration: 00:05:46.460 Core mask: 0x1 00:05:46.460 00:05:46.460 Accel Perf Configuration: 00:05:46.460 Workload Type: fill 00:05:46.460 Fill pattern: 0x80 00:05:46.460 Transfer size: 4096 bytes 00:05:46.460 Vector count 1 00:05:46.460 Module: software 00:05:46.460 Queue depth: 64 00:05:46.460 Allocate depth: 64 00:05:46.460 # threads/core: 1 00:05:46.460 Run time: 1 seconds 00:05:46.460 Verify: Yes 00:05:46.460 00:05:46.460 Running for 1 seconds... 00:05:46.460 00:05:46.460 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:46.460 ------------------------------------------------------------------------------------ 00:05:46.460 0,0 404992/s 1582 MiB/s 0 0 00:05:46.460 ==================================================================================== 00:05:46.460 Total 404992/s 1582 MiB/s 0 0' 00:05:46.460 18:54:07 -- accel/accel.sh@20 -- # IFS=: 00:05:46.460 18:54:07 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:46.460 18:54:07 -- accel/accel.sh@20 -- # read -r var val 00:05:46.460 18:54:07 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:46.460 18:54:07 -- accel/accel.sh@12 -- # build_accel_config 00:05:46.460 18:54:07 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:46.460 18:54:07 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:46.460 18:54:07 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:46.460 18:54:07 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:46.460 18:54:07 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:46.460 18:54:07 -- accel/accel.sh@41 -- # local IFS=, 00:05:46.460 18:54:07 -- accel/accel.sh@42 -- # jq -r . 00:05:46.460 [2024-11-28 18:54:07.291706] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:46.460 [2024-11-28 18:54:07.291796] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid92420 ] 00:05:46.460 EAL: No free 2048 kB hugepages reported on node 1 00:05:46.460 [2024-11-28 18:54:07.354545] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:46.460 [2024-11-28 18:54:07.473044] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:46.718 18:54:07 -- accel/accel.sh@21 -- # val= 00:05:46.718 18:54:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.718 18:54:07 -- accel/accel.sh@20 -- # IFS=: 00:05:46.718 18:54:07 -- accel/accel.sh@20 -- # read -r var val 00:05:46.718 18:54:07 -- accel/accel.sh@21 -- # val= 00:05:46.718 18:54:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.718 18:54:07 -- accel/accel.sh@20 -- # IFS=: 00:05:46.718 18:54:07 -- accel/accel.sh@20 -- # read -r var val 00:05:46.718 18:54:07 -- accel/accel.sh@21 -- # val=0x1 00:05:46.718 18:54:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.718 18:54:07 -- accel/accel.sh@20 -- # IFS=: 00:05:46.718 18:54:07 -- accel/accel.sh@20 -- # read -r var val 00:05:46.718 18:54:07 -- accel/accel.sh@21 -- # val= 00:05:46.718 18:54:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.718 18:54:07 -- accel/accel.sh@20 -- # IFS=: 00:05:46.718 18:54:07 -- accel/accel.sh@20 -- # read -r var val 00:05:46.718 18:54:07 -- accel/accel.sh@21 -- # val= 00:05:46.718 18:54:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.718 18:54:07 -- accel/accel.sh@20 -- # IFS=: 00:05:46.718 18:54:07 -- accel/accel.sh@20 -- # read -r var val 00:05:46.718 18:54:07 -- accel/accel.sh@21 -- # val=fill 00:05:46.718 18:54:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.718 18:54:07 -- accel/accel.sh@24 -- # accel_opc=fill 00:05:46.718 18:54:07 -- accel/accel.sh@20 -- # IFS=: 00:05:46.718 18:54:07 -- accel/accel.sh@20 -- # read -r var val 00:05:46.718 18:54:07 -- accel/accel.sh@21 -- # val=0x80 00:05:46.718 18:54:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.718 18:54:07 -- accel/accel.sh@20 -- # IFS=: 00:05:46.718 18:54:07 -- accel/accel.sh@20 -- # read -r var val 00:05:46.718 18:54:07 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:46.718 18:54:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.718 18:54:07 -- accel/accel.sh@20 -- # IFS=: 00:05:46.718 18:54:07 -- accel/accel.sh@20 -- # read -r var val 00:05:46.718 18:54:07 -- accel/accel.sh@21 -- # val= 00:05:46.718 18:54:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.718 18:54:07 -- accel/accel.sh@20 -- # IFS=: 00:05:46.718 18:54:07 -- accel/accel.sh@20 -- # read -r var val 00:05:46.718 18:54:07 -- accel/accel.sh@21 -- # val=software 00:05:46.718 18:54:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.718 18:54:07 -- accel/accel.sh@23 -- # accel_module=software 00:05:46.718 18:54:07 -- accel/accel.sh@20 -- # IFS=: 00:05:46.718 18:54:07 -- accel/accel.sh@20 -- # read -r var val 00:05:46.718 18:54:07 -- accel/accel.sh@21 -- # val=64 00:05:46.718 18:54:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.718 18:54:07 -- accel/accel.sh@20 -- # IFS=: 00:05:46.718 18:54:07 -- accel/accel.sh@20 -- # read -r var val 00:05:46.718 18:54:07 -- accel/accel.sh@21 -- # val=64 00:05:46.718 18:54:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.718 18:54:07 -- accel/accel.sh@20 -- # IFS=: 00:05:46.718 18:54:07 -- accel/accel.sh@20 -- # read -r var val 00:05:46.719 18:54:07 -- accel/accel.sh@21 -- # val=1 00:05:46.719 18:54:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.719 18:54:07 -- accel/accel.sh@20 -- # IFS=: 00:05:46.719 18:54:07 -- accel/accel.sh@20 -- # read -r var val 00:05:46.719 18:54:07 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:46.719 18:54:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.719 18:54:07 -- accel/accel.sh@20 -- # IFS=: 00:05:46.719 18:54:07 -- accel/accel.sh@20 -- # read -r var val 00:05:46.719 18:54:07 -- accel/accel.sh@21 -- # val=Yes 00:05:46.719 18:54:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.719 18:54:07 -- accel/accel.sh@20 -- # IFS=: 00:05:46.719 18:54:07 -- accel/accel.sh@20 -- # read -r var val 00:05:46.719 18:54:07 -- accel/accel.sh@21 -- # val= 00:05:46.719 18:54:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.719 18:54:07 -- accel/accel.sh@20 -- # IFS=: 00:05:46.719 18:54:07 -- accel/accel.sh@20 -- # read -r var val 00:05:46.719 18:54:07 -- accel/accel.sh@21 -- # val= 00:05:46.719 18:54:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.719 18:54:07 -- accel/accel.sh@20 -- # IFS=: 00:05:46.719 18:54:07 -- accel/accel.sh@20 -- # read -r var val 00:05:48.095 18:54:08 -- accel/accel.sh@21 -- # val= 00:05:48.095 18:54:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.095 18:54:08 -- accel/accel.sh@20 -- # IFS=: 00:05:48.095 18:54:08 -- accel/accel.sh@20 -- # read -r var val 00:05:48.095 18:54:08 -- accel/accel.sh@21 -- # val= 00:05:48.095 18:54:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.095 18:54:08 -- accel/accel.sh@20 -- # IFS=: 00:05:48.095 18:54:08 -- accel/accel.sh@20 -- # read -r var val 00:05:48.095 18:54:08 -- accel/accel.sh@21 -- # val= 00:05:48.095 18:54:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.095 18:54:08 -- accel/accel.sh@20 -- # IFS=: 00:05:48.095 18:54:08 -- accel/accel.sh@20 -- # read -r var val 00:05:48.095 18:54:08 -- accel/accel.sh@21 -- # val= 00:05:48.095 18:54:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.095 18:54:08 -- accel/accel.sh@20 -- # IFS=: 00:05:48.095 18:54:08 -- accel/accel.sh@20 -- # read -r var val 00:05:48.095 18:54:08 -- accel/accel.sh@21 -- # val= 00:05:48.095 18:54:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.095 18:54:08 -- accel/accel.sh@20 -- # IFS=: 00:05:48.095 18:54:08 -- accel/accel.sh@20 -- # read -r var val 00:05:48.095 18:54:08 -- accel/accel.sh@21 -- # val= 00:05:48.095 18:54:08 -- accel/accel.sh@22 -- # case "$var" in 00:05:48.095 18:54:08 -- accel/accel.sh@20 -- # IFS=: 00:05:48.095 18:54:08 -- accel/accel.sh@20 -- # read -r var val 00:05:48.095 18:54:08 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:48.095 18:54:08 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:05:48.095 18:54:08 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:48.095 00:05:48.095 real 0m2.946s 00:05:48.095 user 0m2.655s 00:05:48.095 sys 0m0.281s 00:05:48.095 18:54:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:48.095 18:54:08 -- common/autotest_common.sh@10 -- # set +x 00:05:48.095 ************************************ 00:05:48.095 END TEST accel_fill 00:05:48.095 ************************************ 00:05:48.095 18:54:08 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:05:48.095 18:54:08 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:48.095 18:54:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:48.095 18:54:08 -- common/autotest_common.sh@10 -- # set +x 00:05:48.095 ************************************ 00:05:48.095 START TEST accel_copy_crc32c 00:05:48.095 ************************************ 00:05:48.095 18:54:08 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y 00:05:48.095 18:54:08 -- accel/accel.sh@16 -- # local accel_opc 00:05:48.095 18:54:08 -- accel/accel.sh@17 -- # local accel_module 00:05:48.095 18:54:08 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:48.095 18:54:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:48.095 18:54:08 -- accel/accel.sh@12 -- # build_accel_config 00:05:48.095 18:54:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:48.095 18:54:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:48.095 18:54:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:48.095 18:54:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:48.095 18:54:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:48.095 18:54:08 -- accel/accel.sh@41 -- # local IFS=, 00:05:48.095 18:54:08 -- accel/accel.sh@42 -- # jq -r . 00:05:48.095 [2024-11-28 18:54:08.790581] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:48.095 [2024-11-28 18:54:08.790663] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid93113 ] 00:05:48.095 EAL: No free 2048 kB hugepages reported on node 1 00:05:48.095 [2024-11-28 18:54:08.855864] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:48.095 [2024-11-28 18:54:08.971086] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:49.468 18:54:10 -- accel/accel.sh@18 -- # out=' 00:05:49.468 SPDK Configuration: 00:05:49.468 Core mask: 0x1 00:05:49.468 00:05:49.468 Accel Perf Configuration: 00:05:49.468 Workload Type: copy_crc32c 00:05:49.468 CRC-32C seed: 0 00:05:49.468 Vector size: 4096 bytes 00:05:49.468 Transfer size: 4096 bytes 00:05:49.468 Vector count 1 00:05:49.468 Module: software 00:05:49.468 Queue depth: 32 00:05:49.468 Allocate depth: 32 00:05:49.468 # threads/core: 1 00:05:49.468 Run time: 1 seconds 00:05:49.468 Verify: Yes 00:05:49.468 00:05:49.468 Running for 1 seconds... 00:05:49.468 00:05:49.468 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:49.468 ------------------------------------------------------------------------------------ 00:05:49.468 0,0 219360/s 856 MiB/s 0 0 00:05:49.468 ==================================================================================== 00:05:49.468 Total 219360/s 856 MiB/s 0 0' 00:05:49.468 18:54:10 -- accel/accel.sh@20 -- # IFS=: 00:05:49.468 18:54:10 -- accel/accel.sh@20 -- # read -r var val 00:05:49.468 18:54:10 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:49.468 18:54:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:49.468 18:54:10 -- accel/accel.sh@12 -- # build_accel_config 00:05:49.468 18:54:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:49.468 18:54:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:49.468 18:54:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:49.468 18:54:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:49.468 18:54:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:49.468 18:54:10 -- accel/accel.sh@41 -- # local IFS=, 00:05:49.468 18:54:10 -- accel/accel.sh@42 -- # jq -r . 00:05:49.468 [2024-11-28 18:54:10.256857] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:49.469 [2024-11-28 18:54:10.256936] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid93348 ] 00:05:49.469 EAL: No free 2048 kB hugepages reported on node 1 00:05:49.469 [2024-11-28 18:54:10.320551] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:49.469 [2024-11-28 18:54:10.435596] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:49.469 18:54:10 -- accel/accel.sh@21 -- # val= 00:05:49.469 18:54:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.469 18:54:10 -- accel/accel.sh@20 -- # IFS=: 00:05:49.469 18:54:10 -- accel/accel.sh@20 -- # read -r var val 00:05:49.469 18:54:10 -- accel/accel.sh@21 -- # val= 00:05:49.469 18:54:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.469 18:54:10 -- accel/accel.sh@20 -- # IFS=: 00:05:49.469 18:54:10 -- accel/accel.sh@20 -- # read -r var val 00:05:49.469 18:54:10 -- accel/accel.sh@21 -- # val=0x1 00:05:49.469 18:54:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.469 18:54:10 -- accel/accel.sh@20 -- # IFS=: 00:05:49.469 18:54:10 -- accel/accel.sh@20 -- # read -r var val 00:05:49.469 18:54:10 -- accel/accel.sh@21 -- # val= 00:05:49.469 18:54:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.469 18:54:10 -- accel/accel.sh@20 -- # IFS=: 00:05:49.469 18:54:10 -- accel/accel.sh@20 -- # read -r var val 00:05:49.469 18:54:10 -- accel/accel.sh@21 -- # val= 00:05:49.469 18:54:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.469 18:54:10 -- accel/accel.sh@20 -- # IFS=: 00:05:49.469 18:54:10 -- accel/accel.sh@20 -- # read -r var val 00:05:49.469 18:54:10 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:49.469 18:54:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.469 18:54:10 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:49.469 18:54:10 -- accel/accel.sh@20 -- # IFS=: 00:05:49.469 18:54:10 -- accel/accel.sh@20 -- # read -r var val 00:05:49.469 18:54:10 -- accel/accel.sh@21 -- # val=0 00:05:49.469 18:54:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.469 18:54:10 -- accel/accel.sh@20 -- # IFS=: 00:05:49.469 18:54:10 -- accel/accel.sh@20 -- # read -r var val 00:05:49.469 18:54:10 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:49.469 18:54:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.469 18:54:10 -- accel/accel.sh@20 -- # IFS=: 00:05:49.469 18:54:10 -- accel/accel.sh@20 -- # read -r var val 00:05:49.469 18:54:10 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:49.469 18:54:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.469 18:54:10 -- accel/accel.sh@20 -- # IFS=: 00:05:49.469 18:54:10 -- accel/accel.sh@20 -- # read -r var val 00:05:49.469 18:54:10 -- accel/accel.sh@21 -- # val= 00:05:49.469 18:54:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.469 18:54:10 -- accel/accel.sh@20 -- # IFS=: 00:05:49.469 18:54:10 -- accel/accel.sh@20 -- # read -r var val 00:05:49.469 18:54:10 -- accel/accel.sh@21 -- # val=software 00:05:49.469 18:54:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.469 18:54:10 -- accel/accel.sh@23 -- # accel_module=software 00:05:49.469 18:54:10 -- accel/accel.sh@20 -- # IFS=: 00:05:49.469 18:54:10 -- accel/accel.sh@20 -- # read -r var val 00:05:49.469 18:54:10 -- accel/accel.sh@21 -- # val=32 00:05:49.469 18:54:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.469 18:54:10 -- accel/accel.sh@20 -- # IFS=: 00:05:49.469 18:54:10 -- accel/accel.sh@20 -- # read -r var val 00:05:49.469 18:54:10 -- accel/accel.sh@21 -- # val=32 00:05:49.469 18:54:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.469 18:54:10 -- accel/accel.sh@20 -- # IFS=: 00:05:49.469 18:54:10 -- accel/accel.sh@20 -- # read -r var val 00:05:49.469 18:54:10 -- accel/accel.sh@21 -- # val=1 00:05:49.469 18:54:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.469 18:54:10 -- accel/accel.sh@20 -- # IFS=: 00:05:49.469 18:54:10 -- accel/accel.sh@20 -- # read -r var val 00:05:49.469 18:54:10 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:49.469 18:54:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.469 18:54:10 -- accel/accel.sh@20 -- # IFS=: 00:05:49.469 18:54:10 -- accel/accel.sh@20 -- # read -r var val 00:05:49.469 18:54:10 -- accel/accel.sh@21 -- # val=Yes 00:05:49.469 18:54:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.469 18:54:10 -- accel/accel.sh@20 -- # IFS=: 00:05:49.469 18:54:10 -- accel/accel.sh@20 -- # read -r var val 00:05:49.469 18:54:10 -- accel/accel.sh@21 -- # val= 00:05:49.469 18:54:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.469 18:54:10 -- accel/accel.sh@20 -- # IFS=: 00:05:49.469 18:54:10 -- accel/accel.sh@20 -- # read -r var val 00:05:49.469 18:54:10 -- accel/accel.sh@21 -- # val= 00:05:49.469 18:54:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.469 18:54:10 -- accel/accel.sh@20 -- # IFS=: 00:05:49.469 18:54:10 -- accel/accel.sh@20 -- # read -r var val 00:05:50.841 18:54:11 -- accel/accel.sh@21 -- # val= 00:05:50.841 18:54:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.841 18:54:11 -- accel/accel.sh@20 -- # IFS=: 00:05:50.841 18:54:11 -- accel/accel.sh@20 -- # read -r var val 00:05:50.841 18:54:11 -- accel/accel.sh@21 -- # val= 00:05:50.841 18:54:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.841 18:54:11 -- accel/accel.sh@20 -- # IFS=: 00:05:50.841 18:54:11 -- accel/accel.sh@20 -- # read -r var val 00:05:50.841 18:54:11 -- accel/accel.sh@21 -- # val= 00:05:50.841 18:54:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.841 18:54:11 -- accel/accel.sh@20 -- # IFS=: 00:05:50.841 18:54:11 -- accel/accel.sh@20 -- # read -r var val 00:05:50.841 18:54:11 -- accel/accel.sh@21 -- # val= 00:05:50.841 18:54:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.841 18:54:11 -- accel/accel.sh@20 -- # IFS=: 00:05:50.841 18:54:11 -- accel/accel.sh@20 -- # read -r var val 00:05:50.841 18:54:11 -- accel/accel.sh@21 -- # val= 00:05:50.841 18:54:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.841 18:54:11 -- accel/accel.sh@20 -- # IFS=: 00:05:50.841 18:54:11 -- accel/accel.sh@20 -- # read -r var val 00:05:50.841 18:54:11 -- accel/accel.sh@21 -- # val= 00:05:50.841 18:54:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.841 18:54:11 -- accel/accel.sh@20 -- # IFS=: 00:05:50.841 18:54:11 -- accel/accel.sh@20 -- # read -r var val 00:05:50.841 18:54:11 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:50.841 18:54:11 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:50.841 18:54:11 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:50.841 00:05:50.841 real 0m2.941s 00:05:50.841 user 0m2.635s 00:05:50.841 sys 0m0.296s 00:05:50.841 18:54:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:50.841 18:54:11 -- common/autotest_common.sh@10 -- # set +x 00:05:50.841 ************************************ 00:05:50.841 END TEST accel_copy_crc32c 00:05:50.841 ************************************ 00:05:50.841 18:54:11 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:05:50.841 18:54:11 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:50.841 18:54:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:50.841 18:54:11 -- common/autotest_common.sh@10 -- # set +x 00:05:50.841 ************************************ 00:05:50.841 START TEST accel_copy_crc32c_C2 00:05:50.841 ************************************ 00:05:50.841 18:54:11 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:05:50.841 18:54:11 -- accel/accel.sh@16 -- # local accel_opc 00:05:50.841 18:54:11 -- accel/accel.sh@17 -- # local accel_module 00:05:50.841 18:54:11 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:50.841 18:54:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:50.841 18:54:11 -- accel/accel.sh@12 -- # build_accel_config 00:05:50.841 18:54:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:50.841 18:54:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:50.841 18:54:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:50.841 18:54:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:50.841 18:54:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:50.841 18:54:11 -- accel/accel.sh@41 -- # local IFS=, 00:05:50.841 18:54:11 -- accel/accel.sh@42 -- # jq -r . 00:05:50.841 [2024-11-28 18:54:11.759792] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:50.841 [2024-11-28 18:54:11.759879] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid93514 ] 00:05:50.841 EAL: No free 2048 kB hugepages reported on node 1 00:05:50.841 [2024-11-28 18:54:11.823116] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:51.100 [2024-11-28 18:54:11.938126] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:52.474 18:54:13 -- accel/accel.sh@18 -- # out=' 00:05:52.474 SPDK Configuration: 00:05:52.474 Core mask: 0x1 00:05:52.474 00:05:52.474 Accel Perf Configuration: 00:05:52.474 Workload Type: copy_crc32c 00:05:52.474 CRC-32C seed: 0 00:05:52.474 Vector size: 4096 bytes 00:05:52.474 Transfer size: 8192 bytes 00:05:52.474 Vector count 2 00:05:52.474 Module: software 00:05:52.474 Queue depth: 32 00:05:52.474 Allocate depth: 32 00:05:52.474 # threads/core: 1 00:05:52.474 Run time: 1 seconds 00:05:52.474 Verify: Yes 00:05:52.474 00:05:52.474 Running for 1 seconds... 00:05:52.474 00:05:52.474 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:52.474 ------------------------------------------------------------------------------------ 00:05:52.474 0,0 154912/s 1210 MiB/s 0 0 00:05:52.474 ==================================================================================== 00:05:52.474 Total 154912/s 605 MiB/s 0 0' 00:05:52.474 18:54:13 -- accel/accel.sh@20 -- # IFS=: 00:05:52.474 18:54:13 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:52.474 18:54:13 -- accel/accel.sh@20 -- # read -r var val 00:05:52.474 18:54:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:52.474 18:54:13 -- accel/accel.sh@12 -- # build_accel_config 00:05:52.474 18:54:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:52.474 18:54:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:52.474 18:54:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:52.474 18:54:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:52.474 18:54:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:52.474 18:54:13 -- accel/accel.sh@41 -- # local IFS=, 00:05:52.474 18:54:13 -- accel/accel.sh@42 -- # jq -r . 00:05:52.474 [2024-11-28 18:54:13.231659] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:52.474 [2024-11-28 18:54:13.231738] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid93742 ] 00:05:52.474 EAL: No free 2048 kB hugepages reported on node 1 00:05:52.474 [2024-11-28 18:54:13.298513] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:52.475 [2024-11-28 18:54:13.413871] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:52.475 18:54:13 -- accel/accel.sh@21 -- # val= 00:05:52.475 18:54:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.475 18:54:13 -- accel/accel.sh@20 -- # IFS=: 00:05:52.475 18:54:13 -- accel/accel.sh@20 -- # read -r var val 00:05:52.475 18:54:13 -- accel/accel.sh@21 -- # val= 00:05:52.475 18:54:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.475 18:54:13 -- accel/accel.sh@20 -- # IFS=: 00:05:52.475 18:54:13 -- accel/accel.sh@20 -- # read -r var val 00:05:52.475 18:54:13 -- accel/accel.sh@21 -- # val=0x1 00:05:52.475 18:54:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.475 18:54:13 -- accel/accel.sh@20 -- # IFS=: 00:05:52.475 18:54:13 -- accel/accel.sh@20 -- # read -r var val 00:05:52.475 18:54:13 -- accel/accel.sh@21 -- # val= 00:05:52.475 18:54:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.475 18:54:13 -- accel/accel.sh@20 -- # IFS=: 00:05:52.475 18:54:13 -- accel/accel.sh@20 -- # read -r var val 00:05:52.475 18:54:13 -- accel/accel.sh@21 -- # val= 00:05:52.475 18:54:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.475 18:54:13 -- accel/accel.sh@20 -- # IFS=: 00:05:52.475 18:54:13 -- accel/accel.sh@20 -- # read -r var val 00:05:52.475 18:54:13 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:52.475 18:54:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.475 18:54:13 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:52.475 18:54:13 -- accel/accel.sh@20 -- # IFS=: 00:05:52.475 18:54:13 -- accel/accel.sh@20 -- # read -r var val 00:05:52.475 18:54:13 -- accel/accel.sh@21 -- # val=0 00:05:52.475 18:54:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.475 18:54:13 -- accel/accel.sh@20 -- # IFS=: 00:05:52.475 18:54:13 -- accel/accel.sh@20 -- # read -r var val 00:05:52.475 18:54:13 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:52.475 18:54:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.475 18:54:13 -- accel/accel.sh@20 -- # IFS=: 00:05:52.475 18:54:13 -- accel/accel.sh@20 -- # read -r var val 00:05:52.475 18:54:13 -- accel/accel.sh@21 -- # val='8192 bytes' 00:05:52.475 18:54:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.475 18:54:13 -- accel/accel.sh@20 -- # IFS=: 00:05:52.475 18:54:13 -- accel/accel.sh@20 -- # read -r var val 00:05:52.475 18:54:13 -- accel/accel.sh@21 -- # val= 00:05:52.475 18:54:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.475 18:54:13 -- accel/accel.sh@20 -- # IFS=: 00:05:52.475 18:54:13 -- accel/accel.sh@20 -- # read -r var val 00:05:52.475 18:54:13 -- accel/accel.sh@21 -- # val=software 00:05:52.475 18:54:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.475 18:54:13 -- accel/accel.sh@23 -- # accel_module=software 00:05:52.475 18:54:13 -- accel/accel.sh@20 -- # IFS=: 00:05:52.475 18:54:13 -- accel/accel.sh@20 -- # read -r var val 00:05:52.475 18:54:13 -- accel/accel.sh@21 -- # val=32 00:05:52.475 18:54:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.475 18:54:13 -- accel/accel.sh@20 -- # IFS=: 00:05:52.475 18:54:13 -- accel/accel.sh@20 -- # read -r var val 00:05:52.475 18:54:13 -- accel/accel.sh@21 -- # val=32 00:05:52.475 18:54:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.475 18:54:13 -- accel/accel.sh@20 -- # IFS=: 00:05:52.475 18:54:13 -- accel/accel.sh@20 -- # read -r var val 00:05:52.475 18:54:13 -- accel/accel.sh@21 -- # val=1 00:05:52.475 18:54:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.475 18:54:13 -- accel/accel.sh@20 -- # IFS=: 00:05:52.475 18:54:13 -- accel/accel.sh@20 -- # read -r var val 00:05:52.475 18:54:13 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:52.475 18:54:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.475 18:54:13 -- accel/accel.sh@20 -- # IFS=: 00:05:52.475 18:54:13 -- accel/accel.sh@20 -- # read -r var val 00:05:52.475 18:54:13 -- accel/accel.sh@21 -- # val=Yes 00:05:52.475 18:54:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.475 18:54:13 -- accel/accel.sh@20 -- # IFS=: 00:05:52.475 18:54:13 -- accel/accel.sh@20 -- # read -r var val 00:05:52.475 18:54:13 -- accel/accel.sh@21 -- # val= 00:05:52.475 18:54:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.475 18:54:13 -- accel/accel.sh@20 -- # IFS=: 00:05:52.475 18:54:13 -- accel/accel.sh@20 -- # read -r var val 00:05:52.475 18:54:13 -- accel/accel.sh@21 -- # val= 00:05:52.475 18:54:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.475 18:54:13 -- accel/accel.sh@20 -- # IFS=: 00:05:52.475 18:54:13 -- accel/accel.sh@20 -- # read -r var val 00:05:53.850 18:54:14 -- accel/accel.sh@21 -- # val= 00:05:53.850 18:54:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.850 18:54:14 -- accel/accel.sh@20 -- # IFS=: 00:05:53.850 18:54:14 -- accel/accel.sh@20 -- # read -r var val 00:05:53.850 18:54:14 -- accel/accel.sh@21 -- # val= 00:05:53.850 18:54:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.850 18:54:14 -- accel/accel.sh@20 -- # IFS=: 00:05:53.850 18:54:14 -- accel/accel.sh@20 -- # read -r var val 00:05:53.850 18:54:14 -- accel/accel.sh@21 -- # val= 00:05:53.850 18:54:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.850 18:54:14 -- accel/accel.sh@20 -- # IFS=: 00:05:53.850 18:54:14 -- accel/accel.sh@20 -- # read -r var val 00:05:53.850 18:54:14 -- accel/accel.sh@21 -- # val= 00:05:53.850 18:54:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.850 18:54:14 -- accel/accel.sh@20 -- # IFS=: 00:05:53.850 18:54:14 -- accel/accel.sh@20 -- # read -r var val 00:05:53.850 18:54:14 -- accel/accel.sh@21 -- # val= 00:05:53.850 18:54:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.850 18:54:14 -- accel/accel.sh@20 -- # IFS=: 00:05:53.850 18:54:14 -- accel/accel.sh@20 -- # read -r var val 00:05:53.850 18:54:14 -- accel/accel.sh@21 -- # val= 00:05:53.850 18:54:14 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.850 18:54:14 -- accel/accel.sh@20 -- # IFS=: 00:05:53.850 18:54:14 -- accel/accel.sh@20 -- # read -r var val 00:05:53.850 18:54:14 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:53.850 18:54:14 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:53.850 18:54:14 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:53.850 00:05:53.850 real 0m2.933s 00:05:53.850 user 0m2.640s 00:05:53.850 sys 0m0.284s 00:05:53.850 18:54:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:53.850 18:54:14 -- common/autotest_common.sh@10 -- # set +x 00:05:53.850 ************************************ 00:05:53.850 END TEST accel_copy_crc32c_C2 00:05:53.850 ************************************ 00:05:53.850 18:54:14 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:05:53.850 18:54:14 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:53.850 18:54:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:53.850 18:54:14 -- common/autotest_common.sh@10 -- # set +x 00:05:53.850 ************************************ 00:05:53.850 START TEST accel_dualcast 00:05:53.850 ************************************ 00:05:53.850 18:54:14 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dualcast -y 00:05:53.850 18:54:14 -- accel/accel.sh@16 -- # local accel_opc 00:05:53.850 18:54:14 -- accel/accel.sh@17 -- # local accel_module 00:05:53.850 18:54:14 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:05:53.850 18:54:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:53.850 18:54:14 -- accel/accel.sh@12 -- # build_accel_config 00:05:53.850 18:54:14 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:53.850 18:54:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:53.850 18:54:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:53.850 18:54:14 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:53.850 18:54:14 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:53.850 18:54:14 -- accel/accel.sh@41 -- # local IFS=, 00:05:53.850 18:54:14 -- accel/accel.sh@42 -- # jq -r . 00:05:53.850 [2024-11-28 18:54:14.715256] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:53.850 [2024-11-28 18:54:14.715339] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid93937 ] 00:05:53.850 EAL: No free 2048 kB hugepages reported on node 1 00:05:53.850 [2024-11-28 18:54:14.777059] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:53.850 [2024-11-28 18:54:14.892552] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:55.224 18:54:16 -- accel/accel.sh@18 -- # out=' 00:05:55.224 SPDK Configuration: 00:05:55.224 Core mask: 0x1 00:05:55.224 00:05:55.224 Accel Perf Configuration: 00:05:55.224 Workload Type: dualcast 00:05:55.224 Transfer size: 4096 bytes 00:05:55.224 Vector count 1 00:05:55.224 Module: software 00:05:55.224 Queue depth: 32 00:05:55.224 Allocate depth: 32 00:05:55.224 # threads/core: 1 00:05:55.224 Run time: 1 seconds 00:05:55.224 Verify: Yes 00:05:55.224 00:05:55.224 Running for 1 seconds... 00:05:55.224 00:05:55.224 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:55.224 ------------------------------------------------------------------------------------ 00:05:55.224 0,0 299776/s 1171 MiB/s 0 0 00:05:55.224 ==================================================================================== 00:05:55.224 Total 299776/s 1171 MiB/s 0 0' 00:05:55.224 18:54:16 -- accel/accel.sh@20 -- # IFS=: 00:05:55.224 18:54:16 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:05:55.224 18:54:16 -- accel/accel.sh@20 -- # read -r var val 00:05:55.224 18:54:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:55.224 18:54:16 -- accel/accel.sh@12 -- # build_accel_config 00:05:55.224 18:54:16 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:55.224 18:54:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:55.224 18:54:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:55.224 18:54:16 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:55.224 18:54:16 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:55.224 18:54:16 -- accel/accel.sh@41 -- # local IFS=, 00:05:55.224 18:54:16 -- accel/accel.sh@42 -- # jq -r . 00:05:55.224 [2024-11-28 18:54:16.173340] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:55.224 [2024-11-28 18:54:16.173428] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid94080 ] 00:05:55.224 EAL: No free 2048 kB hugepages reported on node 1 00:05:55.224 [2024-11-28 18:54:16.235610] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:55.484 [2024-11-28 18:54:16.352570] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:55.484 18:54:16 -- accel/accel.sh@21 -- # val= 00:05:55.484 18:54:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.484 18:54:16 -- accel/accel.sh@20 -- # IFS=: 00:05:55.484 18:54:16 -- accel/accel.sh@20 -- # read -r var val 00:05:55.484 18:54:16 -- accel/accel.sh@21 -- # val= 00:05:55.484 18:54:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.484 18:54:16 -- accel/accel.sh@20 -- # IFS=: 00:05:55.484 18:54:16 -- accel/accel.sh@20 -- # read -r var val 00:05:55.484 18:54:16 -- accel/accel.sh@21 -- # val=0x1 00:05:55.484 18:54:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.484 18:54:16 -- accel/accel.sh@20 -- # IFS=: 00:05:55.484 18:54:16 -- accel/accel.sh@20 -- # read -r var val 00:05:55.484 18:54:16 -- accel/accel.sh@21 -- # val= 00:05:55.484 18:54:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.484 18:54:16 -- accel/accel.sh@20 -- # IFS=: 00:05:55.484 18:54:16 -- accel/accel.sh@20 -- # read -r var val 00:05:55.484 18:54:16 -- accel/accel.sh@21 -- # val= 00:05:55.484 18:54:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.484 18:54:16 -- accel/accel.sh@20 -- # IFS=: 00:05:55.484 18:54:16 -- accel/accel.sh@20 -- # read -r var val 00:05:55.484 18:54:16 -- accel/accel.sh@21 -- # val=dualcast 00:05:55.484 18:54:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.484 18:54:16 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:05:55.484 18:54:16 -- accel/accel.sh@20 -- # IFS=: 00:05:55.484 18:54:16 -- accel/accel.sh@20 -- # read -r var val 00:05:55.484 18:54:16 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:55.484 18:54:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.484 18:54:16 -- accel/accel.sh@20 -- # IFS=: 00:05:55.484 18:54:16 -- accel/accel.sh@20 -- # read -r var val 00:05:55.484 18:54:16 -- accel/accel.sh@21 -- # val= 00:05:55.484 18:54:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.484 18:54:16 -- accel/accel.sh@20 -- # IFS=: 00:05:55.484 18:54:16 -- accel/accel.sh@20 -- # read -r var val 00:05:55.484 18:54:16 -- accel/accel.sh@21 -- # val=software 00:05:55.484 18:54:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.484 18:54:16 -- accel/accel.sh@23 -- # accel_module=software 00:05:55.484 18:54:16 -- accel/accel.sh@20 -- # IFS=: 00:05:55.484 18:54:16 -- accel/accel.sh@20 -- # read -r var val 00:05:55.484 18:54:16 -- accel/accel.sh@21 -- # val=32 00:05:55.484 18:54:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.484 18:54:16 -- accel/accel.sh@20 -- # IFS=: 00:05:55.484 18:54:16 -- accel/accel.sh@20 -- # read -r var val 00:05:55.484 18:54:16 -- accel/accel.sh@21 -- # val=32 00:05:55.484 18:54:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.484 18:54:16 -- accel/accel.sh@20 -- # IFS=: 00:05:55.484 18:54:16 -- accel/accel.sh@20 -- # read -r var val 00:05:55.484 18:54:16 -- accel/accel.sh@21 -- # val=1 00:05:55.484 18:54:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.484 18:54:16 -- accel/accel.sh@20 -- # IFS=: 00:05:55.484 18:54:16 -- accel/accel.sh@20 -- # read -r var val 00:05:55.484 18:54:16 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:55.484 18:54:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.484 18:54:16 -- accel/accel.sh@20 -- # IFS=: 00:05:55.484 18:54:16 -- accel/accel.sh@20 -- # read -r var val 00:05:55.484 18:54:16 -- accel/accel.sh@21 -- # val=Yes 00:05:55.484 18:54:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.484 18:54:16 -- accel/accel.sh@20 -- # IFS=: 00:05:55.484 18:54:16 -- accel/accel.sh@20 -- # read -r var val 00:05:55.484 18:54:16 -- accel/accel.sh@21 -- # val= 00:05:55.484 18:54:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.484 18:54:16 -- accel/accel.sh@20 -- # IFS=: 00:05:55.484 18:54:16 -- accel/accel.sh@20 -- # read -r var val 00:05:55.484 18:54:16 -- accel/accel.sh@21 -- # val= 00:05:55.484 18:54:16 -- accel/accel.sh@22 -- # case "$var" in 00:05:55.484 18:54:16 -- accel/accel.sh@20 -- # IFS=: 00:05:55.484 18:54:16 -- accel/accel.sh@20 -- # read -r var val 00:05:56.861 18:54:17 -- accel/accel.sh@21 -- # val= 00:05:56.861 18:54:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.861 18:54:17 -- accel/accel.sh@20 -- # IFS=: 00:05:56.861 18:54:17 -- accel/accel.sh@20 -- # read -r var val 00:05:56.861 18:54:17 -- accel/accel.sh@21 -- # val= 00:05:56.861 18:54:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.861 18:54:17 -- accel/accel.sh@20 -- # IFS=: 00:05:56.861 18:54:17 -- accel/accel.sh@20 -- # read -r var val 00:05:56.861 18:54:17 -- accel/accel.sh@21 -- # val= 00:05:56.861 18:54:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.861 18:54:17 -- accel/accel.sh@20 -- # IFS=: 00:05:56.861 18:54:17 -- accel/accel.sh@20 -- # read -r var val 00:05:56.861 18:54:17 -- accel/accel.sh@21 -- # val= 00:05:56.861 18:54:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.861 18:54:17 -- accel/accel.sh@20 -- # IFS=: 00:05:56.861 18:54:17 -- accel/accel.sh@20 -- # read -r var val 00:05:56.861 18:54:17 -- accel/accel.sh@21 -- # val= 00:05:56.861 18:54:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.861 18:54:17 -- accel/accel.sh@20 -- # IFS=: 00:05:56.861 18:54:17 -- accel/accel.sh@20 -- # read -r var val 00:05:56.861 18:54:17 -- accel/accel.sh@21 -- # val= 00:05:56.861 18:54:17 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.861 18:54:17 -- accel/accel.sh@20 -- # IFS=: 00:05:56.861 18:54:17 -- accel/accel.sh@20 -- # read -r var val 00:05:56.861 18:54:17 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:56.861 18:54:17 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:05:56.861 18:54:17 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:56.861 00:05:56.861 real 0m2.934s 00:05:56.861 user 0m2.647s 00:05:56.861 sys 0m0.279s 00:05:56.861 18:54:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:56.861 18:54:17 -- common/autotest_common.sh@10 -- # set +x 00:05:56.861 ************************************ 00:05:56.861 END TEST accel_dualcast 00:05:56.861 ************************************ 00:05:56.861 18:54:17 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:05:56.861 18:54:17 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:56.861 18:54:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:56.861 18:54:17 -- common/autotest_common.sh@10 -- # set +x 00:05:56.861 ************************************ 00:05:56.861 START TEST accel_compare 00:05:56.861 ************************************ 00:05:56.861 18:54:17 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compare -y 00:05:56.861 18:54:17 -- accel/accel.sh@16 -- # local accel_opc 00:05:56.861 18:54:17 -- accel/accel.sh@17 -- # local accel_module 00:05:56.861 18:54:17 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:05:56.861 18:54:17 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:56.861 18:54:17 -- accel/accel.sh@12 -- # build_accel_config 00:05:56.861 18:54:17 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:56.861 18:54:17 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:56.861 18:54:17 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:56.861 18:54:17 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:56.861 18:54:17 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:56.861 18:54:17 -- accel/accel.sh@41 -- # local IFS=, 00:05:56.861 18:54:17 -- accel/accel.sh@42 -- # jq -r . 00:05:56.861 [2024-11-28 18:54:17.677235] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:56.861 [2024-11-28 18:54:17.677314] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid94247 ] 00:05:56.861 EAL: No free 2048 kB hugepages reported on node 1 00:05:56.861 [2024-11-28 18:54:17.739767] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:56.861 [2024-11-28 18:54:17.855647] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:58.236 18:54:19 -- accel/accel.sh@18 -- # out=' 00:05:58.236 SPDK Configuration: 00:05:58.236 Core mask: 0x1 00:05:58.236 00:05:58.236 Accel Perf Configuration: 00:05:58.236 Workload Type: compare 00:05:58.236 Transfer size: 4096 bytes 00:05:58.236 Vector count 1 00:05:58.236 Module: software 00:05:58.236 Queue depth: 32 00:05:58.236 Allocate depth: 32 00:05:58.236 # threads/core: 1 00:05:58.236 Run time: 1 seconds 00:05:58.236 Verify: Yes 00:05:58.236 00:05:58.236 Running for 1 seconds... 00:05:58.236 00:05:58.236 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:58.236 ------------------------------------------------------------------------------------ 00:05:58.236 0,0 400288/s 1563 MiB/s 0 0 00:05:58.236 ==================================================================================== 00:05:58.236 Total 400288/s 1563 MiB/s 0 0' 00:05:58.236 18:54:19 -- accel/accel.sh@20 -- # IFS=: 00:05:58.236 18:54:19 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:05:58.236 18:54:19 -- accel/accel.sh@20 -- # read -r var val 00:05:58.236 18:54:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:05:58.236 18:54:19 -- accel/accel.sh@12 -- # build_accel_config 00:05:58.236 18:54:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:58.236 18:54:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:58.236 18:54:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:58.236 18:54:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:58.236 18:54:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:58.236 18:54:19 -- accel/accel.sh@41 -- # local IFS=, 00:05:58.236 18:54:19 -- accel/accel.sh@42 -- # jq -r . 00:05:58.236 [2024-11-28 18:54:19.143132] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:58.236 [2024-11-28 18:54:19.143211] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid94502 ] 00:05:58.236 EAL: No free 2048 kB hugepages reported on node 1 00:05:58.236 [2024-11-28 18:54:19.204714] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:58.495 [2024-11-28 18:54:19.322365] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:58.495 18:54:19 -- accel/accel.sh@21 -- # val= 00:05:58.495 18:54:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.495 18:54:19 -- accel/accel.sh@20 -- # IFS=: 00:05:58.495 18:54:19 -- accel/accel.sh@20 -- # read -r var val 00:05:58.495 18:54:19 -- accel/accel.sh@21 -- # val= 00:05:58.495 18:54:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.495 18:54:19 -- accel/accel.sh@20 -- # IFS=: 00:05:58.495 18:54:19 -- accel/accel.sh@20 -- # read -r var val 00:05:58.495 18:54:19 -- accel/accel.sh@21 -- # val=0x1 00:05:58.495 18:54:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.495 18:54:19 -- accel/accel.sh@20 -- # IFS=: 00:05:58.495 18:54:19 -- accel/accel.sh@20 -- # read -r var val 00:05:58.495 18:54:19 -- accel/accel.sh@21 -- # val= 00:05:58.495 18:54:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.495 18:54:19 -- accel/accel.sh@20 -- # IFS=: 00:05:58.495 18:54:19 -- accel/accel.sh@20 -- # read -r var val 00:05:58.495 18:54:19 -- accel/accel.sh@21 -- # val= 00:05:58.495 18:54:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.495 18:54:19 -- accel/accel.sh@20 -- # IFS=: 00:05:58.495 18:54:19 -- accel/accel.sh@20 -- # read -r var val 00:05:58.495 18:54:19 -- accel/accel.sh@21 -- # val=compare 00:05:58.495 18:54:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.495 18:54:19 -- accel/accel.sh@24 -- # accel_opc=compare 00:05:58.495 18:54:19 -- accel/accel.sh@20 -- # IFS=: 00:05:58.495 18:54:19 -- accel/accel.sh@20 -- # read -r var val 00:05:58.495 18:54:19 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:58.495 18:54:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.495 18:54:19 -- accel/accel.sh@20 -- # IFS=: 00:05:58.495 18:54:19 -- accel/accel.sh@20 -- # read -r var val 00:05:58.495 18:54:19 -- accel/accel.sh@21 -- # val= 00:05:58.495 18:54:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.495 18:54:19 -- accel/accel.sh@20 -- # IFS=: 00:05:58.495 18:54:19 -- accel/accel.sh@20 -- # read -r var val 00:05:58.495 18:54:19 -- accel/accel.sh@21 -- # val=software 00:05:58.495 18:54:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.495 18:54:19 -- accel/accel.sh@23 -- # accel_module=software 00:05:58.495 18:54:19 -- accel/accel.sh@20 -- # IFS=: 00:05:58.495 18:54:19 -- accel/accel.sh@20 -- # read -r var val 00:05:58.495 18:54:19 -- accel/accel.sh@21 -- # val=32 00:05:58.495 18:54:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.495 18:54:19 -- accel/accel.sh@20 -- # IFS=: 00:05:58.495 18:54:19 -- accel/accel.sh@20 -- # read -r var val 00:05:58.495 18:54:19 -- accel/accel.sh@21 -- # val=32 00:05:58.495 18:54:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.495 18:54:19 -- accel/accel.sh@20 -- # IFS=: 00:05:58.495 18:54:19 -- accel/accel.sh@20 -- # read -r var val 00:05:58.495 18:54:19 -- accel/accel.sh@21 -- # val=1 00:05:58.495 18:54:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.495 18:54:19 -- accel/accel.sh@20 -- # IFS=: 00:05:58.495 18:54:19 -- accel/accel.sh@20 -- # read -r var val 00:05:58.495 18:54:19 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:58.495 18:54:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.495 18:54:19 -- accel/accel.sh@20 -- # IFS=: 00:05:58.495 18:54:19 -- accel/accel.sh@20 -- # read -r var val 00:05:58.495 18:54:19 -- accel/accel.sh@21 -- # val=Yes 00:05:58.495 18:54:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.495 18:54:19 -- accel/accel.sh@20 -- # IFS=: 00:05:58.495 18:54:19 -- accel/accel.sh@20 -- # read -r var val 00:05:58.495 18:54:19 -- accel/accel.sh@21 -- # val= 00:05:58.495 18:54:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.495 18:54:19 -- accel/accel.sh@20 -- # IFS=: 00:05:58.495 18:54:19 -- accel/accel.sh@20 -- # read -r var val 00:05:58.495 18:54:19 -- accel/accel.sh@21 -- # val= 00:05:58.495 18:54:19 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.495 18:54:19 -- accel/accel.sh@20 -- # IFS=: 00:05:58.495 18:54:19 -- accel/accel.sh@20 -- # read -r var val 00:05:59.872 18:54:20 -- accel/accel.sh@21 -- # val= 00:05:59.872 18:54:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.872 18:54:20 -- accel/accel.sh@20 -- # IFS=: 00:05:59.872 18:54:20 -- accel/accel.sh@20 -- # read -r var val 00:05:59.872 18:54:20 -- accel/accel.sh@21 -- # val= 00:05:59.872 18:54:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.872 18:54:20 -- accel/accel.sh@20 -- # IFS=: 00:05:59.872 18:54:20 -- accel/accel.sh@20 -- # read -r var val 00:05:59.872 18:54:20 -- accel/accel.sh@21 -- # val= 00:05:59.872 18:54:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.872 18:54:20 -- accel/accel.sh@20 -- # IFS=: 00:05:59.872 18:54:20 -- accel/accel.sh@20 -- # read -r var val 00:05:59.872 18:54:20 -- accel/accel.sh@21 -- # val= 00:05:59.872 18:54:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.872 18:54:20 -- accel/accel.sh@20 -- # IFS=: 00:05:59.872 18:54:20 -- accel/accel.sh@20 -- # read -r var val 00:05:59.872 18:54:20 -- accel/accel.sh@21 -- # val= 00:05:59.872 18:54:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.872 18:54:20 -- accel/accel.sh@20 -- # IFS=: 00:05:59.872 18:54:20 -- accel/accel.sh@20 -- # read -r var val 00:05:59.872 18:54:20 -- accel/accel.sh@21 -- # val= 00:05:59.872 18:54:20 -- accel/accel.sh@22 -- # case "$var" in 00:05:59.872 18:54:20 -- accel/accel.sh@20 -- # IFS=: 00:05:59.872 18:54:20 -- accel/accel.sh@20 -- # read -r var val 00:05:59.872 18:54:20 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:59.872 18:54:20 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:05:59.872 18:54:20 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:59.872 00:05:59.872 real 0m2.940s 00:05:59.872 user 0m2.641s 00:05:59.872 sys 0m0.290s 00:05:59.872 18:54:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:59.872 18:54:20 -- common/autotest_common.sh@10 -- # set +x 00:05:59.872 ************************************ 00:05:59.872 END TEST accel_compare 00:05:59.872 ************************************ 00:05:59.872 18:54:20 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:05:59.872 18:54:20 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:59.872 18:54:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:59.872 18:54:20 -- common/autotest_common.sh@10 -- # set +x 00:05:59.872 ************************************ 00:05:59.872 START TEST accel_xor 00:05:59.872 ************************************ 00:05:59.872 18:54:20 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y 00:05:59.872 18:54:20 -- accel/accel.sh@16 -- # local accel_opc 00:05:59.872 18:54:20 -- accel/accel.sh@17 -- # local accel_module 00:05:59.872 18:54:20 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:05:59.872 18:54:20 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:05:59.872 18:54:20 -- accel/accel.sh@12 -- # build_accel_config 00:05:59.872 18:54:20 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:59.872 18:54:20 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:59.872 18:54:20 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:59.872 18:54:20 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:59.872 18:54:20 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:59.872 18:54:20 -- accel/accel.sh@41 -- # local IFS=, 00:05:59.872 18:54:20 -- accel/accel.sh@42 -- # jq -r . 00:05:59.872 [2024-11-28 18:54:20.642196] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:59.872 [2024-11-28 18:54:20.642278] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid94658 ] 00:05:59.872 EAL: No free 2048 kB hugepages reported on node 1 00:05:59.872 [2024-11-28 18:54:20.705523] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:59.872 [2024-11-28 18:54:20.821474] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:01.247 18:54:22 -- accel/accel.sh@18 -- # out=' 00:06:01.247 SPDK Configuration: 00:06:01.247 Core mask: 0x1 00:06:01.247 00:06:01.247 Accel Perf Configuration: 00:06:01.247 Workload Type: xor 00:06:01.247 Source buffers: 2 00:06:01.247 Transfer size: 4096 bytes 00:06:01.247 Vector count 1 00:06:01.247 Module: software 00:06:01.247 Queue depth: 32 00:06:01.247 Allocate depth: 32 00:06:01.247 # threads/core: 1 00:06:01.247 Run time: 1 seconds 00:06:01.247 Verify: Yes 00:06:01.247 00:06:01.247 Running for 1 seconds... 00:06:01.247 00:06:01.247 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:01.247 ------------------------------------------------------------------------------------ 00:06:01.247 0,0 192224/s 750 MiB/s 0 0 00:06:01.247 ==================================================================================== 00:06:01.247 Total 192224/s 750 MiB/s 0 0' 00:06:01.247 18:54:22 -- accel/accel.sh@20 -- # IFS=: 00:06:01.247 18:54:22 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:06:01.248 18:54:22 -- accel/accel.sh@20 -- # read -r var val 00:06:01.248 18:54:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:06:01.248 18:54:22 -- accel/accel.sh@12 -- # build_accel_config 00:06:01.248 18:54:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:01.248 18:54:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:01.248 18:54:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:01.248 18:54:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:01.248 18:54:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:01.248 18:54:22 -- accel/accel.sh@41 -- # local IFS=, 00:06:01.248 18:54:22 -- accel/accel.sh@42 -- # jq -r . 00:06:01.248 [2024-11-28 18:54:22.121751] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:01.248 [2024-11-28 18:54:22.121841] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid94807 ] 00:06:01.248 EAL: No free 2048 kB hugepages reported on node 1 00:06:01.248 [2024-11-28 18:54:22.189735] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:01.507 [2024-11-28 18:54:22.303499] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:01.507 18:54:22 -- accel/accel.sh@21 -- # val= 00:06:01.507 18:54:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.507 18:54:22 -- accel/accel.sh@20 -- # IFS=: 00:06:01.507 18:54:22 -- accel/accel.sh@20 -- # read -r var val 00:06:01.507 18:54:22 -- accel/accel.sh@21 -- # val= 00:06:01.507 18:54:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.507 18:54:22 -- accel/accel.sh@20 -- # IFS=: 00:06:01.507 18:54:22 -- accel/accel.sh@20 -- # read -r var val 00:06:01.507 18:54:22 -- accel/accel.sh@21 -- # val=0x1 00:06:01.507 18:54:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.507 18:54:22 -- accel/accel.sh@20 -- # IFS=: 00:06:01.507 18:54:22 -- accel/accel.sh@20 -- # read -r var val 00:06:01.507 18:54:22 -- accel/accel.sh@21 -- # val= 00:06:01.507 18:54:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.507 18:54:22 -- accel/accel.sh@20 -- # IFS=: 00:06:01.507 18:54:22 -- accel/accel.sh@20 -- # read -r var val 00:06:01.507 18:54:22 -- accel/accel.sh@21 -- # val= 00:06:01.507 18:54:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.507 18:54:22 -- accel/accel.sh@20 -- # IFS=: 00:06:01.507 18:54:22 -- accel/accel.sh@20 -- # read -r var val 00:06:01.507 18:54:22 -- accel/accel.sh@21 -- # val=xor 00:06:01.507 18:54:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.507 18:54:22 -- accel/accel.sh@24 -- # accel_opc=xor 00:06:01.507 18:54:22 -- accel/accel.sh@20 -- # IFS=: 00:06:01.507 18:54:22 -- accel/accel.sh@20 -- # read -r var val 00:06:01.507 18:54:22 -- accel/accel.sh@21 -- # val=2 00:06:01.507 18:54:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.507 18:54:22 -- accel/accel.sh@20 -- # IFS=: 00:06:01.507 18:54:22 -- accel/accel.sh@20 -- # read -r var val 00:06:01.507 18:54:22 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:01.507 18:54:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.507 18:54:22 -- accel/accel.sh@20 -- # IFS=: 00:06:01.507 18:54:22 -- accel/accel.sh@20 -- # read -r var val 00:06:01.507 18:54:22 -- accel/accel.sh@21 -- # val= 00:06:01.507 18:54:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.507 18:54:22 -- accel/accel.sh@20 -- # IFS=: 00:06:01.507 18:54:22 -- accel/accel.sh@20 -- # read -r var val 00:06:01.507 18:54:22 -- accel/accel.sh@21 -- # val=software 00:06:01.507 18:54:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.507 18:54:22 -- accel/accel.sh@23 -- # accel_module=software 00:06:01.507 18:54:22 -- accel/accel.sh@20 -- # IFS=: 00:06:01.507 18:54:22 -- accel/accel.sh@20 -- # read -r var val 00:06:01.507 18:54:22 -- accel/accel.sh@21 -- # val=32 00:06:01.507 18:54:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.507 18:54:22 -- accel/accel.sh@20 -- # IFS=: 00:06:01.507 18:54:22 -- accel/accel.sh@20 -- # read -r var val 00:06:01.507 18:54:22 -- accel/accel.sh@21 -- # val=32 00:06:01.507 18:54:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.507 18:54:22 -- accel/accel.sh@20 -- # IFS=: 00:06:01.507 18:54:22 -- accel/accel.sh@20 -- # read -r var val 00:06:01.507 18:54:22 -- accel/accel.sh@21 -- # val=1 00:06:01.507 18:54:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.507 18:54:22 -- accel/accel.sh@20 -- # IFS=: 00:06:01.507 18:54:22 -- accel/accel.sh@20 -- # read -r var val 00:06:01.507 18:54:22 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:01.507 18:54:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.507 18:54:22 -- accel/accel.sh@20 -- # IFS=: 00:06:01.507 18:54:22 -- accel/accel.sh@20 -- # read -r var val 00:06:01.507 18:54:22 -- accel/accel.sh@21 -- # val=Yes 00:06:01.507 18:54:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.507 18:54:22 -- accel/accel.sh@20 -- # IFS=: 00:06:01.507 18:54:22 -- accel/accel.sh@20 -- # read -r var val 00:06:01.507 18:54:22 -- accel/accel.sh@21 -- # val= 00:06:01.507 18:54:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.507 18:54:22 -- accel/accel.sh@20 -- # IFS=: 00:06:01.507 18:54:22 -- accel/accel.sh@20 -- # read -r var val 00:06:01.507 18:54:22 -- accel/accel.sh@21 -- # val= 00:06:01.507 18:54:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.507 18:54:22 -- accel/accel.sh@20 -- # IFS=: 00:06:01.507 18:54:22 -- accel/accel.sh@20 -- # read -r var val 00:06:02.883 18:54:23 -- accel/accel.sh@21 -- # val= 00:06:02.883 18:54:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.883 18:54:23 -- accel/accel.sh@20 -- # IFS=: 00:06:02.883 18:54:23 -- accel/accel.sh@20 -- # read -r var val 00:06:02.883 18:54:23 -- accel/accel.sh@21 -- # val= 00:06:02.883 18:54:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.883 18:54:23 -- accel/accel.sh@20 -- # IFS=: 00:06:02.883 18:54:23 -- accel/accel.sh@20 -- # read -r var val 00:06:02.883 18:54:23 -- accel/accel.sh@21 -- # val= 00:06:02.883 18:54:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.883 18:54:23 -- accel/accel.sh@20 -- # IFS=: 00:06:02.883 18:54:23 -- accel/accel.sh@20 -- # read -r var val 00:06:02.883 18:54:23 -- accel/accel.sh@21 -- # val= 00:06:02.883 18:54:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.883 18:54:23 -- accel/accel.sh@20 -- # IFS=: 00:06:02.883 18:54:23 -- accel/accel.sh@20 -- # read -r var val 00:06:02.883 18:54:23 -- accel/accel.sh@21 -- # val= 00:06:02.883 18:54:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.883 18:54:23 -- accel/accel.sh@20 -- # IFS=: 00:06:02.883 18:54:23 -- accel/accel.sh@20 -- # read -r var val 00:06:02.883 18:54:23 -- accel/accel.sh@21 -- # val= 00:06:02.883 18:54:23 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.883 18:54:23 -- accel/accel.sh@20 -- # IFS=: 00:06:02.883 18:54:23 -- accel/accel.sh@20 -- # read -r var val 00:06:02.883 18:54:23 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:02.883 18:54:23 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:06:02.883 18:54:23 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:02.883 00:06:02.883 real 0m2.944s 00:06:02.883 user 0m2.647s 00:06:02.883 sys 0m0.287s 00:06:02.883 18:54:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:02.883 18:54:23 -- common/autotest_common.sh@10 -- # set +x 00:06:02.883 ************************************ 00:06:02.883 END TEST accel_xor 00:06:02.883 ************************************ 00:06:02.883 18:54:23 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:06:02.883 18:54:23 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:02.883 18:54:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:02.883 18:54:23 -- common/autotest_common.sh@10 -- # set +x 00:06:02.883 ************************************ 00:06:02.883 START TEST accel_xor 00:06:02.883 ************************************ 00:06:02.883 18:54:23 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y -x 3 00:06:02.883 18:54:23 -- accel/accel.sh@16 -- # local accel_opc 00:06:02.883 18:54:23 -- accel/accel.sh@17 -- # local accel_module 00:06:02.883 18:54:23 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:06:02.883 18:54:23 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:06:02.883 18:54:23 -- accel/accel.sh@12 -- # build_accel_config 00:06:02.883 18:54:23 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:02.884 18:54:23 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:02.884 18:54:23 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:02.884 18:54:23 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:02.884 18:54:23 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:02.884 18:54:23 -- accel/accel.sh@41 -- # local IFS=, 00:06:02.884 18:54:23 -- accel/accel.sh@42 -- # jq -r . 00:06:02.884 [2024-11-28 18:54:23.614805] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:02.884 [2024-11-28 18:54:23.614894] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid95079 ] 00:06:02.884 EAL: No free 2048 kB hugepages reported on node 1 00:06:02.884 [2024-11-28 18:54:23.677689] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:02.884 [2024-11-28 18:54:23.793878] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:04.268 18:54:25 -- accel/accel.sh@18 -- # out=' 00:06:04.268 SPDK Configuration: 00:06:04.268 Core mask: 0x1 00:06:04.268 00:06:04.269 Accel Perf Configuration: 00:06:04.269 Workload Type: xor 00:06:04.269 Source buffers: 3 00:06:04.269 Transfer size: 4096 bytes 00:06:04.269 Vector count 1 00:06:04.269 Module: software 00:06:04.269 Queue depth: 32 00:06:04.269 Allocate depth: 32 00:06:04.269 # threads/core: 1 00:06:04.269 Run time: 1 seconds 00:06:04.269 Verify: Yes 00:06:04.269 00:06:04.269 Running for 1 seconds... 00:06:04.269 00:06:04.269 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:04.269 ------------------------------------------------------------------------------------ 00:06:04.269 0,0 184864/s 722 MiB/s 0 0 00:06:04.269 ==================================================================================== 00:06:04.269 Total 184864/s 722 MiB/s 0 0' 00:06:04.269 18:54:25 -- accel/accel.sh@20 -- # IFS=: 00:06:04.269 18:54:25 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:06:04.269 18:54:25 -- accel/accel.sh@20 -- # read -r var val 00:06:04.269 18:54:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:06:04.269 18:54:25 -- accel/accel.sh@12 -- # build_accel_config 00:06:04.269 18:54:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:04.269 18:54:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:04.269 18:54:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:04.269 18:54:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:04.269 18:54:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:04.269 18:54:25 -- accel/accel.sh@41 -- # local IFS=, 00:06:04.269 18:54:25 -- accel/accel.sh@42 -- # jq -r . 00:06:04.269 [2024-11-28 18:54:25.071031] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:04.269 [2024-11-28 18:54:25.071114] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid95230 ] 00:06:04.269 EAL: No free 2048 kB hugepages reported on node 1 00:06:04.269 [2024-11-28 18:54:25.133472] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:04.269 [2024-11-28 18:54:25.249556] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:04.269 18:54:25 -- accel/accel.sh@21 -- # val= 00:06:04.269 18:54:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.269 18:54:25 -- accel/accel.sh@20 -- # IFS=: 00:06:04.269 18:54:25 -- accel/accel.sh@20 -- # read -r var val 00:06:04.269 18:54:25 -- accel/accel.sh@21 -- # val= 00:06:04.269 18:54:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.269 18:54:25 -- accel/accel.sh@20 -- # IFS=: 00:06:04.269 18:54:25 -- accel/accel.sh@20 -- # read -r var val 00:06:04.269 18:54:25 -- accel/accel.sh@21 -- # val=0x1 00:06:04.269 18:54:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.269 18:54:25 -- accel/accel.sh@20 -- # IFS=: 00:06:04.269 18:54:25 -- accel/accel.sh@20 -- # read -r var val 00:06:04.269 18:54:25 -- accel/accel.sh@21 -- # val= 00:06:04.269 18:54:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.269 18:54:25 -- accel/accel.sh@20 -- # IFS=: 00:06:04.269 18:54:25 -- accel/accel.sh@20 -- # read -r var val 00:06:04.269 18:54:25 -- accel/accel.sh@21 -- # val= 00:06:04.269 18:54:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.269 18:54:25 -- accel/accel.sh@20 -- # IFS=: 00:06:04.269 18:54:25 -- accel/accel.sh@20 -- # read -r var val 00:06:04.269 18:54:25 -- accel/accel.sh@21 -- # val=xor 00:06:04.269 18:54:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.269 18:54:25 -- accel/accel.sh@24 -- # accel_opc=xor 00:06:04.269 18:54:25 -- accel/accel.sh@20 -- # IFS=: 00:06:04.269 18:54:25 -- accel/accel.sh@20 -- # read -r var val 00:06:04.269 18:54:25 -- accel/accel.sh@21 -- # val=3 00:06:04.269 18:54:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.269 18:54:25 -- accel/accel.sh@20 -- # IFS=: 00:06:04.269 18:54:25 -- accel/accel.sh@20 -- # read -r var val 00:06:04.269 18:54:25 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:04.269 18:54:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.269 18:54:25 -- accel/accel.sh@20 -- # IFS=: 00:06:04.269 18:54:25 -- accel/accel.sh@20 -- # read -r var val 00:06:04.269 18:54:25 -- accel/accel.sh@21 -- # val= 00:06:04.269 18:54:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.269 18:54:25 -- accel/accel.sh@20 -- # IFS=: 00:06:04.269 18:54:25 -- accel/accel.sh@20 -- # read -r var val 00:06:04.269 18:54:25 -- accel/accel.sh@21 -- # val=software 00:06:04.269 18:54:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.269 18:54:25 -- accel/accel.sh@23 -- # accel_module=software 00:06:04.269 18:54:25 -- accel/accel.sh@20 -- # IFS=: 00:06:04.269 18:54:25 -- accel/accel.sh@20 -- # read -r var val 00:06:04.269 18:54:25 -- accel/accel.sh@21 -- # val=32 00:06:04.269 18:54:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.269 18:54:25 -- accel/accel.sh@20 -- # IFS=: 00:06:04.269 18:54:25 -- accel/accel.sh@20 -- # read -r var val 00:06:04.269 18:54:25 -- accel/accel.sh@21 -- # val=32 00:06:04.269 18:54:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.269 18:54:25 -- accel/accel.sh@20 -- # IFS=: 00:06:04.269 18:54:25 -- accel/accel.sh@20 -- # read -r var val 00:06:04.269 18:54:25 -- accel/accel.sh@21 -- # val=1 00:06:04.269 18:54:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.269 18:54:25 -- accel/accel.sh@20 -- # IFS=: 00:06:04.269 18:54:25 -- accel/accel.sh@20 -- # read -r var val 00:06:04.269 18:54:25 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:04.526 18:54:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.526 18:54:25 -- accel/accel.sh@20 -- # IFS=: 00:06:04.526 18:54:25 -- accel/accel.sh@20 -- # read -r var val 00:06:04.526 18:54:25 -- accel/accel.sh@21 -- # val=Yes 00:06:04.526 18:54:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.526 18:54:25 -- accel/accel.sh@20 -- # IFS=: 00:06:04.526 18:54:25 -- accel/accel.sh@20 -- # read -r var val 00:06:04.526 18:54:25 -- accel/accel.sh@21 -- # val= 00:06:04.526 18:54:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.526 18:54:25 -- accel/accel.sh@20 -- # IFS=: 00:06:04.526 18:54:25 -- accel/accel.sh@20 -- # read -r var val 00:06:04.526 18:54:25 -- accel/accel.sh@21 -- # val= 00:06:04.526 18:54:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.526 18:54:25 -- accel/accel.sh@20 -- # IFS=: 00:06:04.526 18:54:25 -- accel/accel.sh@20 -- # read -r var val 00:06:05.901 18:54:26 -- accel/accel.sh@21 -- # val= 00:06:05.901 18:54:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.901 18:54:26 -- accel/accel.sh@20 -- # IFS=: 00:06:05.901 18:54:26 -- accel/accel.sh@20 -- # read -r var val 00:06:05.901 18:54:26 -- accel/accel.sh@21 -- # val= 00:06:05.901 18:54:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.901 18:54:26 -- accel/accel.sh@20 -- # IFS=: 00:06:05.901 18:54:26 -- accel/accel.sh@20 -- # read -r var val 00:06:05.901 18:54:26 -- accel/accel.sh@21 -- # val= 00:06:05.901 18:54:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.901 18:54:26 -- accel/accel.sh@20 -- # IFS=: 00:06:05.901 18:54:26 -- accel/accel.sh@20 -- # read -r var val 00:06:05.901 18:54:26 -- accel/accel.sh@21 -- # val= 00:06:05.901 18:54:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.901 18:54:26 -- accel/accel.sh@20 -- # IFS=: 00:06:05.901 18:54:26 -- accel/accel.sh@20 -- # read -r var val 00:06:05.901 18:54:26 -- accel/accel.sh@21 -- # val= 00:06:05.901 18:54:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.901 18:54:26 -- accel/accel.sh@20 -- # IFS=: 00:06:05.901 18:54:26 -- accel/accel.sh@20 -- # read -r var val 00:06:05.901 18:54:26 -- accel/accel.sh@21 -- # val= 00:06:05.901 18:54:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.901 18:54:26 -- accel/accel.sh@20 -- # IFS=: 00:06:05.901 18:54:26 -- accel/accel.sh@20 -- # read -r var val 00:06:05.901 18:54:26 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:05.901 18:54:26 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:06:05.901 18:54:26 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:05.901 00:06:05.901 real 0m2.922s 00:06:05.901 user 0m2.614s 00:06:05.901 sys 0m0.298s 00:06:05.901 18:54:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:05.901 18:54:26 -- common/autotest_common.sh@10 -- # set +x 00:06:05.901 ************************************ 00:06:05.901 END TEST accel_xor 00:06:05.901 ************************************ 00:06:05.901 18:54:26 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:06:05.901 18:54:26 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:05.901 18:54:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:05.901 18:54:26 -- common/autotest_common.sh@10 -- # set +x 00:06:05.901 ************************************ 00:06:05.901 START TEST accel_dif_verify 00:06:05.901 ************************************ 00:06:05.901 18:54:26 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_verify 00:06:05.901 18:54:26 -- accel/accel.sh@16 -- # local accel_opc 00:06:05.901 18:54:26 -- accel/accel.sh@17 -- # local accel_module 00:06:05.901 18:54:26 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:06:05.901 18:54:26 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:06:05.901 18:54:26 -- accel/accel.sh@12 -- # build_accel_config 00:06:05.901 18:54:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:05.901 18:54:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:05.901 18:54:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:05.901 18:54:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:05.901 18:54:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:05.901 18:54:26 -- accel/accel.sh@41 -- # local IFS=, 00:06:05.901 18:54:26 -- accel/accel.sh@42 -- # jq -r . 00:06:05.902 [2024-11-28 18:54:26.561084] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:05.902 [2024-11-28 18:54:26.561161] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid95387 ] 00:06:05.902 EAL: No free 2048 kB hugepages reported on node 1 00:06:05.902 [2024-11-28 18:54:26.623173] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:05.902 [2024-11-28 18:54:26.740116] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:07.276 18:54:28 -- accel/accel.sh@18 -- # out=' 00:06:07.276 SPDK Configuration: 00:06:07.276 Core mask: 0x1 00:06:07.276 00:06:07.276 Accel Perf Configuration: 00:06:07.276 Workload Type: dif_verify 00:06:07.276 Vector size: 4096 bytes 00:06:07.276 Transfer size: 4096 bytes 00:06:07.276 Block size: 512 bytes 00:06:07.276 Metadata size: 8 bytes 00:06:07.276 Vector count 1 00:06:07.276 Module: software 00:06:07.276 Queue depth: 32 00:06:07.276 Allocate depth: 32 00:06:07.276 # threads/core: 1 00:06:07.276 Run time: 1 seconds 00:06:07.276 Verify: No 00:06:07.276 00:06:07.276 Running for 1 seconds... 00:06:07.276 00:06:07.276 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:07.276 ------------------------------------------------------------------------------------ 00:06:07.276 0,0 81824/s 324 MiB/s 0 0 00:06:07.276 ==================================================================================== 00:06:07.276 Total 81824/s 319 MiB/s 0 0' 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # IFS=: 00:06:07.276 18:54:28 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # read -r var val 00:06:07.276 18:54:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:06:07.276 18:54:28 -- accel/accel.sh@12 -- # build_accel_config 00:06:07.276 18:54:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:07.276 18:54:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:07.276 18:54:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:07.276 18:54:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:07.276 18:54:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:07.276 18:54:28 -- accel/accel.sh@41 -- # local IFS=, 00:06:07.276 18:54:28 -- accel/accel.sh@42 -- # jq -r . 00:06:07.276 [2024-11-28 18:54:28.029008] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:07.276 [2024-11-28 18:54:28.029088] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid95609 ] 00:06:07.276 EAL: No free 2048 kB hugepages reported on node 1 00:06:07.276 [2024-11-28 18:54:28.090923] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:07.276 [2024-11-28 18:54:28.207323] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:07.276 18:54:28 -- accel/accel.sh@21 -- # val= 00:06:07.276 18:54:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # IFS=: 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # read -r var val 00:06:07.276 18:54:28 -- accel/accel.sh@21 -- # val= 00:06:07.276 18:54:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # IFS=: 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # read -r var val 00:06:07.276 18:54:28 -- accel/accel.sh@21 -- # val=0x1 00:06:07.276 18:54:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # IFS=: 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # read -r var val 00:06:07.276 18:54:28 -- accel/accel.sh@21 -- # val= 00:06:07.276 18:54:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # IFS=: 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # read -r var val 00:06:07.276 18:54:28 -- accel/accel.sh@21 -- # val= 00:06:07.276 18:54:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # IFS=: 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # read -r var val 00:06:07.276 18:54:28 -- accel/accel.sh@21 -- # val=dif_verify 00:06:07.276 18:54:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.276 18:54:28 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # IFS=: 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # read -r var val 00:06:07.276 18:54:28 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:07.276 18:54:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # IFS=: 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # read -r var val 00:06:07.276 18:54:28 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:07.276 18:54:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # IFS=: 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # read -r var val 00:06:07.276 18:54:28 -- accel/accel.sh@21 -- # val='512 bytes' 00:06:07.276 18:54:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # IFS=: 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # read -r var val 00:06:07.276 18:54:28 -- accel/accel.sh@21 -- # val='8 bytes' 00:06:07.276 18:54:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # IFS=: 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # read -r var val 00:06:07.276 18:54:28 -- accel/accel.sh@21 -- # val= 00:06:07.276 18:54:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # IFS=: 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # read -r var val 00:06:07.276 18:54:28 -- accel/accel.sh@21 -- # val=software 00:06:07.276 18:54:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.276 18:54:28 -- accel/accel.sh@23 -- # accel_module=software 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # IFS=: 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # read -r var val 00:06:07.276 18:54:28 -- accel/accel.sh@21 -- # val=32 00:06:07.276 18:54:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # IFS=: 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # read -r var val 00:06:07.276 18:54:28 -- accel/accel.sh@21 -- # val=32 00:06:07.276 18:54:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # IFS=: 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # read -r var val 00:06:07.276 18:54:28 -- accel/accel.sh@21 -- # val=1 00:06:07.276 18:54:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # IFS=: 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # read -r var val 00:06:07.276 18:54:28 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:07.276 18:54:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # IFS=: 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # read -r var val 00:06:07.276 18:54:28 -- accel/accel.sh@21 -- # val=No 00:06:07.276 18:54:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # IFS=: 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # read -r var val 00:06:07.276 18:54:28 -- accel/accel.sh@21 -- # val= 00:06:07.276 18:54:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # IFS=: 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # read -r var val 00:06:07.276 18:54:28 -- accel/accel.sh@21 -- # val= 00:06:07.276 18:54:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # IFS=: 00:06:07.276 18:54:28 -- accel/accel.sh@20 -- # read -r var val 00:06:08.651 18:54:29 -- accel/accel.sh@21 -- # val= 00:06:08.651 18:54:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.651 18:54:29 -- accel/accel.sh@20 -- # IFS=: 00:06:08.651 18:54:29 -- accel/accel.sh@20 -- # read -r var val 00:06:08.651 18:54:29 -- accel/accel.sh@21 -- # val= 00:06:08.651 18:54:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.651 18:54:29 -- accel/accel.sh@20 -- # IFS=: 00:06:08.651 18:54:29 -- accel/accel.sh@20 -- # read -r var val 00:06:08.651 18:54:29 -- accel/accel.sh@21 -- # val= 00:06:08.651 18:54:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.651 18:54:29 -- accel/accel.sh@20 -- # IFS=: 00:06:08.651 18:54:29 -- accel/accel.sh@20 -- # read -r var val 00:06:08.651 18:54:29 -- accel/accel.sh@21 -- # val= 00:06:08.651 18:54:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.651 18:54:29 -- accel/accel.sh@20 -- # IFS=: 00:06:08.651 18:54:29 -- accel/accel.sh@20 -- # read -r var val 00:06:08.651 18:54:29 -- accel/accel.sh@21 -- # val= 00:06:08.651 18:54:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.651 18:54:29 -- accel/accel.sh@20 -- # IFS=: 00:06:08.651 18:54:29 -- accel/accel.sh@20 -- # read -r var val 00:06:08.651 18:54:29 -- accel/accel.sh@21 -- # val= 00:06:08.651 18:54:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.651 18:54:29 -- accel/accel.sh@20 -- # IFS=: 00:06:08.651 18:54:29 -- accel/accel.sh@20 -- # read -r var val 00:06:08.651 18:54:29 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:08.651 18:54:29 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:06:08.651 18:54:29 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:08.651 00:06:08.651 real 0m2.940s 00:06:08.651 user 0m2.636s 00:06:08.651 sys 0m0.298s 00:06:08.651 18:54:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:08.651 18:54:29 -- common/autotest_common.sh@10 -- # set +x 00:06:08.651 ************************************ 00:06:08.651 END TEST accel_dif_verify 00:06:08.651 ************************************ 00:06:08.651 18:54:29 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:06:08.651 18:54:29 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:08.651 18:54:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:08.651 18:54:29 -- common/autotest_common.sh@10 -- # set +x 00:06:08.651 ************************************ 00:06:08.651 START TEST accel_dif_generate 00:06:08.651 ************************************ 00:06:08.651 18:54:29 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate 00:06:08.651 18:54:29 -- accel/accel.sh@16 -- # local accel_opc 00:06:08.651 18:54:29 -- accel/accel.sh@17 -- # local accel_module 00:06:08.651 18:54:29 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:06:08.651 18:54:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:06:08.651 18:54:29 -- accel/accel.sh@12 -- # build_accel_config 00:06:08.651 18:54:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:08.651 18:54:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:08.651 18:54:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:08.651 18:54:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:08.651 18:54:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:08.651 18:54:29 -- accel/accel.sh@41 -- # local IFS=, 00:06:08.651 18:54:29 -- accel/accel.sh@42 -- # jq -r . 00:06:08.651 [2024-11-28 18:54:29.526581] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:08.651 [2024-11-28 18:54:29.526670] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid95806 ] 00:06:08.651 EAL: No free 2048 kB hugepages reported on node 1 00:06:08.651 [2024-11-28 18:54:29.591086] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:08.909 [2024-11-28 18:54:29.706711] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:10.284 18:54:30 -- accel/accel.sh@18 -- # out=' 00:06:10.284 SPDK Configuration: 00:06:10.284 Core mask: 0x1 00:06:10.284 00:06:10.284 Accel Perf Configuration: 00:06:10.285 Workload Type: dif_generate 00:06:10.285 Vector size: 4096 bytes 00:06:10.285 Transfer size: 4096 bytes 00:06:10.285 Block size: 512 bytes 00:06:10.285 Metadata size: 8 bytes 00:06:10.285 Vector count 1 00:06:10.285 Module: software 00:06:10.285 Queue depth: 32 00:06:10.285 Allocate depth: 32 00:06:10.285 # threads/core: 1 00:06:10.285 Run time: 1 seconds 00:06:10.285 Verify: No 00:06:10.285 00:06:10.285 Running for 1 seconds... 00:06:10.285 00:06:10.285 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:10.285 ------------------------------------------------------------------------------------ 00:06:10.285 0,0 96640/s 383 MiB/s 0 0 00:06:10.285 ==================================================================================== 00:06:10.285 Total 96640/s 377 MiB/s 0 0' 00:06:10.285 18:54:30 -- accel/accel.sh@20 -- # IFS=: 00:06:10.285 18:54:30 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:06:10.285 18:54:30 -- accel/accel.sh@20 -- # read -r var val 00:06:10.285 18:54:30 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:06:10.285 18:54:30 -- accel/accel.sh@12 -- # build_accel_config 00:06:10.285 18:54:30 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:10.285 18:54:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:10.285 18:54:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:10.285 18:54:30 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:10.285 18:54:30 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:10.285 18:54:30 -- accel/accel.sh@41 -- # local IFS=, 00:06:10.285 18:54:30 -- accel/accel.sh@42 -- # jq -r . 00:06:10.285 [2024-11-28 18:54:30.995515] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:10.285 [2024-11-28 18:54:30.995597] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid95959 ] 00:06:10.285 EAL: No free 2048 kB hugepages reported on node 1 00:06:10.285 [2024-11-28 18:54:31.057317] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:10.285 [2024-11-28 18:54:31.172237] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:10.285 18:54:31 -- accel/accel.sh@21 -- # val= 00:06:10.285 18:54:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # IFS=: 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # read -r var val 00:06:10.285 18:54:31 -- accel/accel.sh@21 -- # val= 00:06:10.285 18:54:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # IFS=: 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # read -r var val 00:06:10.285 18:54:31 -- accel/accel.sh@21 -- # val=0x1 00:06:10.285 18:54:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # IFS=: 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # read -r var val 00:06:10.285 18:54:31 -- accel/accel.sh@21 -- # val= 00:06:10.285 18:54:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # IFS=: 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # read -r var val 00:06:10.285 18:54:31 -- accel/accel.sh@21 -- # val= 00:06:10.285 18:54:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # IFS=: 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # read -r var val 00:06:10.285 18:54:31 -- accel/accel.sh@21 -- # val=dif_generate 00:06:10.285 18:54:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.285 18:54:31 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # IFS=: 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # read -r var val 00:06:10.285 18:54:31 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:10.285 18:54:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # IFS=: 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # read -r var val 00:06:10.285 18:54:31 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:10.285 18:54:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # IFS=: 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # read -r var val 00:06:10.285 18:54:31 -- accel/accel.sh@21 -- # val='512 bytes' 00:06:10.285 18:54:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # IFS=: 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # read -r var val 00:06:10.285 18:54:31 -- accel/accel.sh@21 -- # val='8 bytes' 00:06:10.285 18:54:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # IFS=: 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # read -r var val 00:06:10.285 18:54:31 -- accel/accel.sh@21 -- # val= 00:06:10.285 18:54:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # IFS=: 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # read -r var val 00:06:10.285 18:54:31 -- accel/accel.sh@21 -- # val=software 00:06:10.285 18:54:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.285 18:54:31 -- accel/accel.sh@23 -- # accel_module=software 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # IFS=: 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # read -r var val 00:06:10.285 18:54:31 -- accel/accel.sh@21 -- # val=32 00:06:10.285 18:54:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # IFS=: 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # read -r var val 00:06:10.285 18:54:31 -- accel/accel.sh@21 -- # val=32 00:06:10.285 18:54:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # IFS=: 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # read -r var val 00:06:10.285 18:54:31 -- accel/accel.sh@21 -- # val=1 00:06:10.285 18:54:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # IFS=: 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # read -r var val 00:06:10.285 18:54:31 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:10.285 18:54:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # IFS=: 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # read -r var val 00:06:10.285 18:54:31 -- accel/accel.sh@21 -- # val=No 00:06:10.285 18:54:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # IFS=: 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # read -r var val 00:06:10.285 18:54:31 -- accel/accel.sh@21 -- # val= 00:06:10.285 18:54:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # IFS=: 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # read -r var val 00:06:10.285 18:54:31 -- accel/accel.sh@21 -- # val= 00:06:10.285 18:54:31 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # IFS=: 00:06:10.285 18:54:31 -- accel/accel.sh@20 -- # read -r var val 00:06:11.662 18:54:32 -- accel/accel.sh@21 -- # val= 00:06:11.662 18:54:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.662 18:54:32 -- accel/accel.sh@20 -- # IFS=: 00:06:11.662 18:54:32 -- accel/accel.sh@20 -- # read -r var val 00:06:11.662 18:54:32 -- accel/accel.sh@21 -- # val= 00:06:11.662 18:54:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.662 18:54:32 -- accel/accel.sh@20 -- # IFS=: 00:06:11.662 18:54:32 -- accel/accel.sh@20 -- # read -r var val 00:06:11.662 18:54:32 -- accel/accel.sh@21 -- # val= 00:06:11.662 18:54:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.662 18:54:32 -- accel/accel.sh@20 -- # IFS=: 00:06:11.662 18:54:32 -- accel/accel.sh@20 -- # read -r var val 00:06:11.662 18:54:32 -- accel/accel.sh@21 -- # val= 00:06:11.662 18:54:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.662 18:54:32 -- accel/accel.sh@20 -- # IFS=: 00:06:11.662 18:54:32 -- accel/accel.sh@20 -- # read -r var val 00:06:11.662 18:54:32 -- accel/accel.sh@21 -- # val= 00:06:11.662 18:54:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.662 18:54:32 -- accel/accel.sh@20 -- # IFS=: 00:06:11.662 18:54:32 -- accel/accel.sh@20 -- # read -r var val 00:06:11.662 18:54:32 -- accel/accel.sh@21 -- # val= 00:06:11.662 18:54:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:11.662 18:54:32 -- accel/accel.sh@20 -- # IFS=: 00:06:11.662 18:54:32 -- accel/accel.sh@20 -- # read -r var val 00:06:11.662 18:54:32 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:11.662 18:54:32 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:06:11.662 18:54:32 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:11.662 00:06:11.662 real 0m2.936s 00:06:11.662 user 0m2.645s 00:06:11.662 sys 0m0.285s 00:06:11.662 18:54:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:11.662 18:54:32 -- common/autotest_common.sh@10 -- # set +x 00:06:11.662 ************************************ 00:06:11.662 END TEST accel_dif_generate 00:06:11.662 ************************************ 00:06:11.662 18:54:32 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:06:11.662 18:54:32 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:11.662 18:54:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:11.662 18:54:32 -- common/autotest_common.sh@10 -- # set +x 00:06:11.662 ************************************ 00:06:11.662 START TEST accel_dif_generate_copy 00:06:11.662 ************************************ 00:06:11.662 18:54:32 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate_copy 00:06:11.662 18:54:32 -- accel/accel.sh@16 -- # local accel_opc 00:06:11.662 18:54:32 -- accel/accel.sh@17 -- # local accel_module 00:06:11.662 18:54:32 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:06:11.662 18:54:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:11.662 18:54:32 -- accel/accel.sh@12 -- # build_accel_config 00:06:11.662 18:54:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:11.662 18:54:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:11.662 18:54:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:11.662 18:54:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:11.662 18:54:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:11.662 18:54:32 -- accel/accel.sh@41 -- # local IFS=, 00:06:11.662 18:54:32 -- accel/accel.sh@42 -- # jq -r . 00:06:11.662 [2024-11-28 18:54:32.488388] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:11.662 [2024-11-28 18:54:32.488480] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid96117 ] 00:06:11.662 EAL: No free 2048 kB hugepages reported on node 1 00:06:11.662 [2024-11-28 18:54:32.550961] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:11.662 [2024-11-28 18:54:32.667329] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:13.038 18:54:33 -- accel/accel.sh@18 -- # out=' 00:06:13.038 SPDK Configuration: 00:06:13.038 Core mask: 0x1 00:06:13.038 00:06:13.038 Accel Perf Configuration: 00:06:13.038 Workload Type: dif_generate_copy 00:06:13.038 Vector size: 4096 bytes 00:06:13.038 Transfer size: 4096 bytes 00:06:13.038 Vector count 1 00:06:13.038 Module: software 00:06:13.038 Queue depth: 32 00:06:13.038 Allocate depth: 32 00:06:13.038 # threads/core: 1 00:06:13.038 Run time: 1 seconds 00:06:13.038 Verify: No 00:06:13.038 00:06:13.038 Running for 1 seconds... 00:06:13.038 00:06:13.038 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:13.038 ------------------------------------------------------------------------------------ 00:06:13.038 0,0 78208/s 310 MiB/s 0 0 00:06:13.038 ==================================================================================== 00:06:13.038 Total 78208/s 305 MiB/s 0 0' 00:06:13.038 18:54:33 -- accel/accel.sh@20 -- # IFS=: 00:06:13.038 18:54:33 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:06:13.038 18:54:33 -- accel/accel.sh@20 -- # read -r var val 00:06:13.038 18:54:33 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:13.038 18:54:33 -- accel/accel.sh@12 -- # build_accel_config 00:06:13.038 18:54:33 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:13.038 18:54:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:13.038 18:54:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:13.038 18:54:33 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:13.038 18:54:33 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:13.038 18:54:33 -- accel/accel.sh@41 -- # local IFS=, 00:06:13.038 18:54:33 -- accel/accel.sh@42 -- # jq -r . 00:06:13.038 [2024-11-28 18:54:33.962956] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:13.038 [2024-11-28 18:54:33.963038] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid96382 ] 00:06:13.038 EAL: No free 2048 kB hugepages reported on node 1 00:06:13.038 [2024-11-28 18:54:34.024609] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:13.297 [2024-11-28 18:54:34.140828] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:13.297 18:54:34 -- accel/accel.sh@21 -- # val= 00:06:13.297 18:54:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.297 18:54:34 -- accel/accel.sh@20 -- # IFS=: 00:06:13.297 18:54:34 -- accel/accel.sh@20 -- # read -r var val 00:06:13.298 18:54:34 -- accel/accel.sh@21 -- # val= 00:06:13.298 18:54:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.298 18:54:34 -- accel/accel.sh@20 -- # IFS=: 00:06:13.298 18:54:34 -- accel/accel.sh@20 -- # read -r var val 00:06:13.298 18:54:34 -- accel/accel.sh@21 -- # val=0x1 00:06:13.298 18:54:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.298 18:54:34 -- accel/accel.sh@20 -- # IFS=: 00:06:13.298 18:54:34 -- accel/accel.sh@20 -- # read -r var val 00:06:13.298 18:54:34 -- accel/accel.sh@21 -- # val= 00:06:13.298 18:54:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.298 18:54:34 -- accel/accel.sh@20 -- # IFS=: 00:06:13.298 18:54:34 -- accel/accel.sh@20 -- # read -r var val 00:06:13.298 18:54:34 -- accel/accel.sh@21 -- # val= 00:06:13.298 18:54:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.298 18:54:34 -- accel/accel.sh@20 -- # IFS=: 00:06:13.298 18:54:34 -- accel/accel.sh@20 -- # read -r var val 00:06:13.298 18:54:34 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:06:13.298 18:54:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.298 18:54:34 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:06:13.298 18:54:34 -- accel/accel.sh@20 -- # IFS=: 00:06:13.298 18:54:34 -- accel/accel.sh@20 -- # read -r var val 00:06:13.298 18:54:34 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:13.298 18:54:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.298 18:54:34 -- accel/accel.sh@20 -- # IFS=: 00:06:13.298 18:54:34 -- accel/accel.sh@20 -- # read -r var val 00:06:13.298 18:54:34 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:13.298 18:54:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.298 18:54:34 -- accel/accel.sh@20 -- # IFS=: 00:06:13.298 18:54:34 -- accel/accel.sh@20 -- # read -r var val 00:06:13.298 18:54:34 -- accel/accel.sh@21 -- # val= 00:06:13.298 18:54:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.298 18:54:34 -- accel/accel.sh@20 -- # IFS=: 00:06:13.298 18:54:34 -- accel/accel.sh@20 -- # read -r var val 00:06:13.298 18:54:34 -- accel/accel.sh@21 -- # val=software 00:06:13.298 18:54:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.298 18:54:34 -- accel/accel.sh@23 -- # accel_module=software 00:06:13.298 18:54:34 -- accel/accel.sh@20 -- # IFS=: 00:06:13.298 18:54:34 -- accel/accel.sh@20 -- # read -r var val 00:06:13.298 18:54:34 -- accel/accel.sh@21 -- # val=32 00:06:13.298 18:54:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.298 18:54:34 -- accel/accel.sh@20 -- # IFS=: 00:06:13.298 18:54:34 -- accel/accel.sh@20 -- # read -r var val 00:06:13.298 18:54:34 -- accel/accel.sh@21 -- # val=32 00:06:13.298 18:54:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.298 18:54:34 -- accel/accel.sh@20 -- # IFS=: 00:06:13.298 18:54:34 -- accel/accel.sh@20 -- # read -r var val 00:06:13.298 18:54:34 -- accel/accel.sh@21 -- # val=1 00:06:13.298 18:54:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.298 18:54:34 -- accel/accel.sh@20 -- # IFS=: 00:06:13.298 18:54:34 -- accel/accel.sh@20 -- # read -r var val 00:06:13.298 18:54:34 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:13.298 18:54:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.298 18:54:34 -- accel/accel.sh@20 -- # IFS=: 00:06:13.298 18:54:34 -- accel/accel.sh@20 -- # read -r var val 00:06:13.298 18:54:34 -- accel/accel.sh@21 -- # val=No 00:06:13.298 18:54:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.298 18:54:34 -- accel/accel.sh@20 -- # IFS=: 00:06:13.298 18:54:34 -- accel/accel.sh@20 -- # read -r var val 00:06:13.298 18:54:34 -- accel/accel.sh@21 -- # val= 00:06:13.298 18:54:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.298 18:54:34 -- accel/accel.sh@20 -- # IFS=: 00:06:13.298 18:54:34 -- accel/accel.sh@20 -- # read -r var val 00:06:13.298 18:54:34 -- accel/accel.sh@21 -- # val= 00:06:13.298 18:54:34 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.298 18:54:34 -- accel/accel.sh@20 -- # IFS=: 00:06:13.298 18:54:34 -- accel/accel.sh@20 -- # read -r var val 00:06:14.681 18:54:35 -- accel/accel.sh@21 -- # val= 00:06:14.681 18:54:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.681 18:54:35 -- accel/accel.sh@20 -- # IFS=: 00:06:14.681 18:54:35 -- accel/accel.sh@20 -- # read -r var val 00:06:14.681 18:54:35 -- accel/accel.sh@21 -- # val= 00:06:14.681 18:54:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.681 18:54:35 -- accel/accel.sh@20 -- # IFS=: 00:06:14.681 18:54:35 -- accel/accel.sh@20 -- # read -r var val 00:06:14.681 18:54:35 -- accel/accel.sh@21 -- # val= 00:06:14.681 18:54:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.681 18:54:35 -- accel/accel.sh@20 -- # IFS=: 00:06:14.681 18:54:35 -- accel/accel.sh@20 -- # read -r var val 00:06:14.681 18:54:35 -- accel/accel.sh@21 -- # val= 00:06:14.681 18:54:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.681 18:54:35 -- accel/accel.sh@20 -- # IFS=: 00:06:14.681 18:54:35 -- accel/accel.sh@20 -- # read -r var val 00:06:14.681 18:54:35 -- accel/accel.sh@21 -- # val= 00:06:14.681 18:54:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.681 18:54:35 -- accel/accel.sh@20 -- # IFS=: 00:06:14.681 18:54:35 -- accel/accel.sh@20 -- # read -r var val 00:06:14.681 18:54:35 -- accel/accel.sh@21 -- # val= 00:06:14.681 18:54:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:14.681 18:54:35 -- accel/accel.sh@20 -- # IFS=: 00:06:14.681 18:54:35 -- accel/accel.sh@20 -- # read -r var val 00:06:14.681 18:54:35 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:14.681 18:54:35 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:06:14.681 18:54:35 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:14.681 00:06:14.681 real 0m2.950s 00:06:14.681 user 0m2.646s 00:06:14.681 sys 0m0.295s 00:06:14.681 18:54:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:14.681 18:54:35 -- common/autotest_common.sh@10 -- # set +x 00:06:14.681 ************************************ 00:06:14.681 END TEST accel_dif_generate_copy 00:06:14.681 ************************************ 00:06:14.681 18:54:35 -- accel/accel.sh@107 -- # [[ y == y ]] 00:06:14.681 18:54:35 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:14.681 18:54:35 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:14.681 18:54:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:14.681 18:54:35 -- common/autotest_common.sh@10 -- # set +x 00:06:14.681 ************************************ 00:06:14.681 START TEST accel_comp 00:06:14.681 ************************************ 00:06:14.681 18:54:35 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:14.681 18:54:35 -- accel/accel.sh@16 -- # local accel_opc 00:06:14.681 18:54:35 -- accel/accel.sh@17 -- # local accel_module 00:06:14.681 18:54:35 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:14.681 18:54:35 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:14.681 18:54:35 -- accel/accel.sh@12 -- # build_accel_config 00:06:14.681 18:54:35 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:14.681 18:54:35 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:14.681 18:54:35 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:14.681 18:54:35 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:14.681 18:54:35 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:14.681 18:54:35 -- accel/accel.sh@41 -- # local IFS=, 00:06:14.681 18:54:35 -- accel/accel.sh@42 -- # jq -r . 00:06:14.681 [2024-11-28 18:54:35.465529] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:14.681 [2024-11-28 18:54:35.465606] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid96539 ] 00:06:14.681 EAL: No free 2048 kB hugepages reported on node 1 00:06:14.681 [2024-11-28 18:54:35.526852] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:14.681 [2024-11-28 18:54:35.643460] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:16.055 18:54:36 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:16.055 00:06:16.055 SPDK Configuration: 00:06:16.055 Core mask: 0x1 00:06:16.055 00:06:16.055 Accel Perf Configuration: 00:06:16.055 Workload Type: compress 00:06:16.055 Transfer size: 4096 bytes 00:06:16.055 Vector count 1 00:06:16.055 Module: software 00:06:16.056 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:16.056 Queue depth: 32 00:06:16.056 Allocate depth: 32 00:06:16.056 # threads/core: 1 00:06:16.056 Run time: 1 seconds 00:06:16.056 Verify: No 00:06:16.056 00:06:16.056 Running for 1 seconds... 00:06:16.056 00:06:16.056 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:16.056 ------------------------------------------------------------------------------------ 00:06:16.056 0,0 32320/s 134 MiB/s 0 0 00:06:16.056 ==================================================================================== 00:06:16.056 Total 32320/s 126 MiB/s 0 0' 00:06:16.056 18:54:36 -- accel/accel.sh@20 -- # IFS=: 00:06:16.056 18:54:36 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:16.056 18:54:36 -- accel/accel.sh@20 -- # read -r var val 00:06:16.056 18:54:36 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:16.056 18:54:36 -- accel/accel.sh@12 -- # build_accel_config 00:06:16.056 18:54:36 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:16.056 18:54:36 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:16.056 18:54:36 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:16.056 18:54:36 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:16.056 18:54:36 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:16.056 18:54:36 -- accel/accel.sh@41 -- # local IFS=, 00:06:16.056 18:54:36 -- accel/accel.sh@42 -- # jq -r . 00:06:16.056 [2024-11-28 18:54:36.936580] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:16.056 [2024-11-28 18:54:36.936659] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid96690 ] 00:06:16.056 EAL: No free 2048 kB hugepages reported on node 1 00:06:16.056 [2024-11-28 18:54:36.999587] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:16.315 [2024-11-28 18:54:37.116243] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:16.315 18:54:37 -- accel/accel.sh@21 -- # val= 00:06:16.315 18:54:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.315 18:54:37 -- accel/accel.sh@20 -- # IFS=: 00:06:16.315 18:54:37 -- accel/accel.sh@20 -- # read -r var val 00:06:16.315 18:54:37 -- accel/accel.sh@21 -- # val= 00:06:16.315 18:54:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.315 18:54:37 -- accel/accel.sh@20 -- # IFS=: 00:06:16.315 18:54:37 -- accel/accel.sh@20 -- # read -r var val 00:06:16.315 18:54:37 -- accel/accel.sh@21 -- # val= 00:06:16.315 18:54:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.315 18:54:37 -- accel/accel.sh@20 -- # IFS=: 00:06:16.315 18:54:37 -- accel/accel.sh@20 -- # read -r var val 00:06:16.315 18:54:37 -- accel/accel.sh@21 -- # val=0x1 00:06:16.315 18:54:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.315 18:54:37 -- accel/accel.sh@20 -- # IFS=: 00:06:16.315 18:54:37 -- accel/accel.sh@20 -- # read -r var val 00:06:16.315 18:54:37 -- accel/accel.sh@21 -- # val= 00:06:16.315 18:54:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.315 18:54:37 -- accel/accel.sh@20 -- # IFS=: 00:06:16.315 18:54:37 -- accel/accel.sh@20 -- # read -r var val 00:06:16.315 18:54:37 -- accel/accel.sh@21 -- # val= 00:06:16.315 18:54:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.315 18:54:37 -- accel/accel.sh@20 -- # IFS=: 00:06:16.315 18:54:37 -- accel/accel.sh@20 -- # read -r var val 00:06:16.315 18:54:37 -- accel/accel.sh@21 -- # val=compress 00:06:16.315 18:54:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.315 18:54:37 -- accel/accel.sh@24 -- # accel_opc=compress 00:06:16.315 18:54:37 -- accel/accel.sh@20 -- # IFS=: 00:06:16.315 18:54:37 -- accel/accel.sh@20 -- # read -r var val 00:06:16.315 18:54:37 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:16.315 18:54:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.315 18:54:37 -- accel/accel.sh@20 -- # IFS=: 00:06:16.315 18:54:37 -- accel/accel.sh@20 -- # read -r var val 00:06:16.315 18:54:37 -- accel/accel.sh@21 -- # val= 00:06:16.315 18:54:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.315 18:54:37 -- accel/accel.sh@20 -- # IFS=: 00:06:16.315 18:54:37 -- accel/accel.sh@20 -- # read -r var val 00:06:16.315 18:54:37 -- accel/accel.sh@21 -- # val=software 00:06:16.315 18:54:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.315 18:54:37 -- accel/accel.sh@23 -- # accel_module=software 00:06:16.315 18:54:37 -- accel/accel.sh@20 -- # IFS=: 00:06:16.315 18:54:37 -- accel/accel.sh@20 -- # read -r var val 00:06:16.315 18:54:37 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:16.315 18:54:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.315 18:54:37 -- accel/accel.sh@20 -- # IFS=: 00:06:16.315 18:54:37 -- accel/accel.sh@20 -- # read -r var val 00:06:16.315 18:54:37 -- accel/accel.sh@21 -- # val=32 00:06:16.315 18:54:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.315 18:54:37 -- accel/accel.sh@20 -- # IFS=: 00:06:16.315 18:54:37 -- accel/accel.sh@20 -- # read -r var val 00:06:16.315 18:54:37 -- accel/accel.sh@21 -- # val=32 00:06:16.315 18:54:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.315 18:54:37 -- accel/accel.sh@20 -- # IFS=: 00:06:16.315 18:54:37 -- accel/accel.sh@20 -- # read -r var val 00:06:16.315 18:54:37 -- accel/accel.sh@21 -- # val=1 00:06:16.315 18:54:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.315 18:54:37 -- accel/accel.sh@20 -- # IFS=: 00:06:16.315 18:54:37 -- accel/accel.sh@20 -- # read -r var val 00:06:16.315 18:54:37 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:16.315 18:54:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.315 18:54:37 -- accel/accel.sh@20 -- # IFS=: 00:06:16.315 18:54:37 -- accel/accel.sh@20 -- # read -r var val 00:06:16.315 18:54:37 -- accel/accel.sh@21 -- # val=No 00:06:16.315 18:54:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.315 18:54:37 -- accel/accel.sh@20 -- # IFS=: 00:06:16.315 18:54:37 -- accel/accel.sh@20 -- # read -r var val 00:06:16.315 18:54:37 -- accel/accel.sh@21 -- # val= 00:06:16.315 18:54:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.315 18:54:37 -- accel/accel.sh@20 -- # IFS=: 00:06:16.315 18:54:37 -- accel/accel.sh@20 -- # read -r var val 00:06:16.315 18:54:37 -- accel/accel.sh@21 -- # val= 00:06:16.315 18:54:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.315 18:54:37 -- accel/accel.sh@20 -- # IFS=: 00:06:16.315 18:54:37 -- accel/accel.sh@20 -- # read -r var val 00:06:17.691 18:54:38 -- accel/accel.sh@21 -- # val= 00:06:17.691 18:54:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.691 18:54:38 -- accel/accel.sh@20 -- # IFS=: 00:06:17.691 18:54:38 -- accel/accel.sh@20 -- # read -r var val 00:06:17.691 18:54:38 -- accel/accel.sh@21 -- # val= 00:06:17.691 18:54:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.691 18:54:38 -- accel/accel.sh@20 -- # IFS=: 00:06:17.691 18:54:38 -- accel/accel.sh@20 -- # read -r var val 00:06:17.691 18:54:38 -- accel/accel.sh@21 -- # val= 00:06:17.691 18:54:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.691 18:54:38 -- accel/accel.sh@20 -- # IFS=: 00:06:17.691 18:54:38 -- accel/accel.sh@20 -- # read -r var val 00:06:17.691 18:54:38 -- accel/accel.sh@21 -- # val= 00:06:17.691 18:54:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.691 18:54:38 -- accel/accel.sh@20 -- # IFS=: 00:06:17.691 18:54:38 -- accel/accel.sh@20 -- # read -r var val 00:06:17.691 18:54:38 -- accel/accel.sh@21 -- # val= 00:06:17.691 18:54:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.691 18:54:38 -- accel/accel.sh@20 -- # IFS=: 00:06:17.691 18:54:38 -- accel/accel.sh@20 -- # read -r var val 00:06:17.691 18:54:38 -- accel/accel.sh@21 -- # val= 00:06:17.691 18:54:38 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.691 18:54:38 -- accel/accel.sh@20 -- # IFS=: 00:06:17.691 18:54:38 -- accel/accel.sh@20 -- # read -r var val 00:06:17.691 18:54:38 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:17.691 18:54:38 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:06:17.691 18:54:38 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:17.691 00:06:17.691 real 0m2.943s 00:06:17.691 user 0m2.643s 00:06:17.691 sys 0m0.294s 00:06:17.691 18:54:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:17.691 18:54:38 -- common/autotest_common.sh@10 -- # set +x 00:06:17.691 ************************************ 00:06:17.691 END TEST accel_comp 00:06:17.691 ************************************ 00:06:17.691 18:54:38 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:17.691 18:54:38 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:17.691 18:54:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:17.691 18:54:38 -- common/autotest_common.sh@10 -- # set +x 00:06:17.691 ************************************ 00:06:17.691 START TEST accel_decomp 00:06:17.691 ************************************ 00:06:17.691 18:54:38 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:17.691 18:54:38 -- accel/accel.sh@16 -- # local accel_opc 00:06:17.691 18:54:38 -- accel/accel.sh@17 -- # local accel_module 00:06:17.691 18:54:38 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:17.691 18:54:38 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:17.691 18:54:38 -- accel/accel.sh@12 -- # build_accel_config 00:06:17.691 18:54:38 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:17.691 18:54:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:17.691 18:54:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:17.691 18:54:38 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:17.691 18:54:38 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:17.691 18:54:38 -- accel/accel.sh@41 -- # local IFS=, 00:06:17.692 18:54:38 -- accel/accel.sh@42 -- # jq -r . 00:06:17.692 [2024-11-28 18:54:38.432978] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:17.692 [2024-11-28 18:54:38.433059] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid96963 ] 00:06:17.692 EAL: No free 2048 kB hugepages reported on node 1 00:06:17.692 [2024-11-28 18:54:38.496329] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:17.692 [2024-11-28 18:54:38.612682] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:19.068 18:54:39 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:19.068 00:06:19.068 SPDK Configuration: 00:06:19.068 Core mask: 0x1 00:06:19.068 00:06:19.068 Accel Perf Configuration: 00:06:19.068 Workload Type: decompress 00:06:19.068 Transfer size: 4096 bytes 00:06:19.068 Vector count 1 00:06:19.068 Module: software 00:06:19.068 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:19.068 Queue depth: 32 00:06:19.068 Allocate depth: 32 00:06:19.068 # threads/core: 1 00:06:19.068 Run time: 1 seconds 00:06:19.068 Verify: Yes 00:06:19.068 00:06:19.068 Running for 1 seconds... 00:06:19.068 00:06:19.068 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:19.068 ------------------------------------------------------------------------------------ 00:06:19.068 0,0 55712/s 102 MiB/s 0 0 00:06:19.068 ==================================================================================== 00:06:19.068 Total 55712/s 217 MiB/s 0 0' 00:06:19.068 18:54:39 -- accel/accel.sh@20 -- # IFS=: 00:06:19.068 18:54:39 -- accel/accel.sh@20 -- # read -r var val 00:06:19.068 18:54:39 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:19.068 18:54:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:19.068 18:54:39 -- accel/accel.sh@12 -- # build_accel_config 00:06:19.068 18:54:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:19.068 18:54:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:19.068 18:54:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:19.068 18:54:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:19.068 18:54:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:19.068 18:54:39 -- accel/accel.sh@41 -- # local IFS=, 00:06:19.068 18:54:39 -- accel/accel.sh@42 -- # jq -r . 00:06:19.068 [2024-11-28 18:54:39.908824] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:19.068 [2024-11-28 18:54:39.908904] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid97103 ] 00:06:19.068 EAL: No free 2048 kB hugepages reported on node 1 00:06:19.068 [2024-11-28 18:54:39.970898] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:19.068 [2024-11-28 18:54:40.095005] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:19.327 18:54:40 -- accel/accel.sh@21 -- # val= 00:06:19.327 18:54:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.327 18:54:40 -- accel/accel.sh@20 -- # IFS=: 00:06:19.327 18:54:40 -- accel/accel.sh@20 -- # read -r var val 00:06:19.327 18:54:40 -- accel/accel.sh@21 -- # val= 00:06:19.327 18:54:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.327 18:54:40 -- accel/accel.sh@20 -- # IFS=: 00:06:19.327 18:54:40 -- accel/accel.sh@20 -- # read -r var val 00:06:19.327 18:54:40 -- accel/accel.sh@21 -- # val= 00:06:19.327 18:54:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.327 18:54:40 -- accel/accel.sh@20 -- # IFS=: 00:06:19.327 18:54:40 -- accel/accel.sh@20 -- # read -r var val 00:06:19.327 18:54:40 -- accel/accel.sh@21 -- # val=0x1 00:06:19.327 18:54:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.327 18:54:40 -- accel/accel.sh@20 -- # IFS=: 00:06:19.327 18:54:40 -- accel/accel.sh@20 -- # read -r var val 00:06:19.327 18:54:40 -- accel/accel.sh@21 -- # val= 00:06:19.327 18:54:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.327 18:54:40 -- accel/accel.sh@20 -- # IFS=: 00:06:19.327 18:54:40 -- accel/accel.sh@20 -- # read -r var val 00:06:19.327 18:54:40 -- accel/accel.sh@21 -- # val= 00:06:19.327 18:54:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.327 18:54:40 -- accel/accel.sh@20 -- # IFS=: 00:06:19.327 18:54:40 -- accel/accel.sh@20 -- # read -r var val 00:06:19.327 18:54:40 -- accel/accel.sh@21 -- # val=decompress 00:06:19.327 18:54:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.327 18:54:40 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:19.327 18:54:40 -- accel/accel.sh@20 -- # IFS=: 00:06:19.327 18:54:40 -- accel/accel.sh@20 -- # read -r var val 00:06:19.327 18:54:40 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:19.327 18:54:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.327 18:54:40 -- accel/accel.sh@20 -- # IFS=: 00:06:19.327 18:54:40 -- accel/accel.sh@20 -- # read -r var val 00:06:19.327 18:54:40 -- accel/accel.sh@21 -- # val= 00:06:19.327 18:54:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.327 18:54:40 -- accel/accel.sh@20 -- # IFS=: 00:06:19.327 18:54:40 -- accel/accel.sh@20 -- # read -r var val 00:06:19.327 18:54:40 -- accel/accel.sh@21 -- # val=software 00:06:19.327 18:54:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.327 18:54:40 -- accel/accel.sh@23 -- # accel_module=software 00:06:19.327 18:54:40 -- accel/accel.sh@20 -- # IFS=: 00:06:19.327 18:54:40 -- accel/accel.sh@20 -- # read -r var val 00:06:19.327 18:54:40 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:19.327 18:54:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.327 18:54:40 -- accel/accel.sh@20 -- # IFS=: 00:06:19.327 18:54:40 -- accel/accel.sh@20 -- # read -r var val 00:06:19.327 18:54:40 -- accel/accel.sh@21 -- # val=32 00:06:19.327 18:54:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.327 18:54:40 -- accel/accel.sh@20 -- # IFS=: 00:06:19.327 18:54:40 -- accel/accel.sh@20 -- # read -r var val 00:06:19.327 18:54:40 -- accel/accel.sh@21 -- # val=32 00:06:19.327 18:54:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.327 18:54:40 -- accel/accel.sh@20 -- # IFS=: 00:06:19.327 18:54:40 -- accel/accel.sh@20 -- # read -r var val 00:06:19.327 18:54:40 -- accel/accel.sh@21 -- # val=1 00:06:19.327 18:54:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.327 18:54:40 -- accel/accel.sh@20 -- # IFS=: 00:06:19.327 18:54:40 -- accel/accel.sh@20 -- # read -r var val 00:06:19.327 18:54:40 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:19.327 18:54:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.327 18:54:40 -- accel/accel.sh@20 -- # IFS=: 00:06:19.327 18:54:40 -- accel/accel.sh@20 -- # read -r var val 00:06:19.327 18:54:40 -- accel/accel.sh@21 -- # val=Yes 00:06:19.327 18:54:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.327 18:54:40 -- accel/accel.sh@20 -- # IFS=: 00:06:19.327 18:54:40 -- accel/accel.sh@20 -- # read -r var val 00:06:19.327 18:54:40 -- accel/accel.sh@21 -- # val= 00:06:19.327 18:54:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.327 18:54:40 -- accel/accel.sh@20 -- # IFS=: 00:06:19.327 18:54:40 -- accel/accel.sh@20 -- # read -r var val 00:06:19.327 18:54:40 -- accel/accel.sh@21 -- # val= 00:06:19.327 18:54:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.327 18:54:40 -- accel/accel.sh@20 -- # IFS=: 00:06:19.327 18:54:40 -- accel/accel.sh@20 -- # read -r var val 00:06:20.704 18:54:41 -- accel/accel.sh@21 -- # val= 00:06:20.704 18:54:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.704 18:54:41 -- accel/accel.sh@20 -- # IFS=: 00:06:20.705 18:54:41 -- accel/accel.sh@20 -- # read -r var val 00:06:20.705 18:54:41 -- accel/accel.sh@21 -- # val= 00:06:20.705 18:54:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.705 18:54:41 -- accel/accel.sh@20 -- # IFS=: 00:06:20.705 18:54:41 -- accel/accel.sh@20 -- # read -r var val 00:06:20.705 18:54:41 -- accel/accel.sh@21 -- # val= 00:06:20.705 18:54:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.705 18:54:41 -- accel/accel.sh@20 -- # IFS=: 00:06:20.705 18:54:41 -- accel/accel.sh@20 -- # read -r var val 00:06:20.705 18:54:41 -- accel/accel.sh@21 -- # val= 00:06:20.705 18:54:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.705 18:54:41 -- accel/accel.sh@20 -- # IFS=: 00:06:20.705 18:54:41 -- accel/accel.sh@20 -- # read -r var val 00:06:20.705 18:54:41 -- accel/accel.sh@21 -- # val= 00:06:20.705 18:54:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.705 18:54:41 -- accel/accel.sh@20 -- # IFS=: 00:06:20.705 18:54:41 -- accel/accel.sh@20 -- # read -r var val 00:06:20.705 18:54:41 -- accel/accel.sh@21 -- # val= 00:06:20.705 18:54:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.705 18:54:41 -- accel/accel.sh@20 -- # IFS=: 00:06:20.705 18:54:41 -- accel/accel.sh@20 -- # read -r var val 00:06:20.705 18:54:41 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:20.705 18:54:41 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:20.705 18:54:41 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:20.705 00:06:20.705 real 0m2.947s 00:06:20.705 user 0m2.649s 00:06:20.705 sys 0m0.291s 00:06:20.705 18:54:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:20.705 18:54:41 -- common/autotest_common.sh@10 -- # set +x 00:06:20.705 ************************************ 00:06:20.705 END TEST accel_decomp 00:06:20.705 ************************************ 00:06:20.705 18:54:41 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:20.705 18:54:41 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:20.705 18:54:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:20.705 18:54:41 -- common/autotest_common.sh@10 -- # set +x 00:06:20.705 ************************************ 00:06:20.705 START TEST accel_decmop_full 00:06:20.705 ************************************ 00:06:20.705 18:54:41 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:20.705 18:54:41 -- accel/accel.sh@16 -- # local accel_opc 00:06:20.705 18:54:41 -- accel/accel.sh@17 -- # local accel_module 00:06:20.705 18:54:41 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:20.705 18:54:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:20.705 18:54:41 -- accel/accel.sh@12 -- # build_accel_config 00:06:20.705 18:54:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:20.705 18:54:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:20.705 18:54:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:20.705 18:54:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:20.705 18:54:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:20.705 18:54:41 -- accel/accel.sh@41 -- # local IFS=, 00:06:20.705 18:54:41 -- accel/accel.sh@42 -- # jq -r . 00:06:20.705 [2024-11-28 18:54:41.408506] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:20.705 [2024-11-28 18:54:41.408591] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid97266 ] 00:06:20.705 EAL: No free 2048 kB hugepages reported on node 1 00:06:20.705 [2024-11-28 18:54:41.472327] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:20.705 [2024-11-28 18:54:41.585484] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:22.082 18:54:42 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:22.082 00:06:22.082 SPDK Configuration: 00:06:22.082 Core mask: 0x1 00:06:22.082 00:06:22.082 Accel Perf Configuration: 00:06:22.082 Workload Type: decompress 00:06:22.082 Transfer size: 111250 bytes 00:06:22.082 Vector count 1 00:06:22.082 Module: software 00:06:22.082 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:22.082 Queue depth: 32 00:06:22.082 Allocate depth: 32 00:06:22.082 # threads/core: 1 00:06:22.082 Run time: 1 seconds 00:06:22.082 Verify: Yes 00:06:22.082 00:06:22.082 Running for 1 seconds... 00:06:22.082 00:06:22.082 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:22.082 ------------------------------------------------------------------------------------ 00:06:22.082 0,0 3808/s 157 MiB/s 0 0 00:06:22.082 ==================================================================================== 00:06:22.082 Total 3808/s 404 MiB/s 0 0' 00:06:22.082 18:54:42 -- accel/accel.sh@20 -- # IFS=: 00:06:22.083 18:54:42 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:22.083 18:54:42 -- accel/accel.sh@20 -- # read -r var val 00:06:22.083 18:54:42 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:22.083 18:54:42 -- accel/accel.sh@12 -- # build_accel_config 00:06:22.083 18:54:42 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:22.083 18:54:42 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:22.083 18:54:42 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:22.083 18:54:42 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:22.083 18:54:42 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:22.083 18:54:42 -- accel/accel.sh@41 -- # local IFS=, 00:06:22.083 18:54:42 -- accel/accel.sh@42 -- # jq -r . 00:06:22.083 [2024-11-28 18:54:42.892457] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:22.083 [2024-11-28 18:54:42.892530] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid97532 ] 00:06:22.083 EAL: No free 2048 kB hugepages reported on node 1 00:06:22.083 [2024-11-28 18:54:42.957974] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:22.083 [2024-11-28 18:54:43.074121] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:22.340 18:54:43 -- accel/accel.sh@21 -- # val= 00:06:22.340 18:54:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.340 18:54:43 -- accel/accel.sh@20 -- # IFS=: 00:06:22.340 18:54:43 -- accel/accel.sh@20 -- # read -r var val 00:06:22.340 18:54:43 -- accel/accel.sh@21 -- # val= 00:06:22.340 18:54:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.340 18:54:43 -- accel/accel.sh@20 -- # IFS=: 00:06:22.340 18:54:43 -- accel/accel.sh@20 -- # read -r var val 00:06:22.340 18:54:43 -- accel/accel.sh@21 -- # val= 00:06:22.340 18:54:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.340 18:54:43 -- accel/accel.sh@20 -- # IFS=: 00:06:22.340 18:54:43 -- accel/accel.sh@20 -- # read -r var val 00:06:22.340 18:54:43 -- accel/accel.sh@21 -- # val=0x1 00:06:22.340 18:54:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.340 18:54:43 -- accel/accel.sh@20 -- # IFS=: 00:06:22.340 18:54:43 -- accel/accel.sh@20 -- # read -r var val 00:06:22.340 18:54:43 -- accel/accel.sh@21 -- # val= 00:06:22.340 18:54:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.340 18:54:43 -- accel/accel.sh@20 -- # IFS=: 00:06:22.340 18:54:43 -- accel/accel.sh@20 -- # read -r var val 00:06:22.340 18:54:43 -- accel/accel.sh@21 -- # val= 00:06:22.340 18:54:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.340 18:54:43 -- accel/accel.sh@20 -- # IFS=: 00:06:22.340 18:54:43 -- accel/accel.sh@20 -- # read -r var val 00:06:22.340 18:54:43 -- accel/accel.sh@21 -- # val=decompress 00:06:22.340 18:54:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.340 18:54:43 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:22.340 18:54:43 -- accel/accel.sh@20 -- # IFS=: 00:06:22.340 18:54:43 -- accel/accel.sh@20 -- # read -r var val 00:06:22.340 18:54:43 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:22.340 18:54:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.340 18:54:43 -- accel/accel.sh@20 -- # IFS=: 00:06:22.340 18:54:43 -- accel/accel.sh@20 -- # read -r var val 00:06:22.340 18:54:43 -- accel/accel.sh@21 -- # val= 00:06:22.340 18:54:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.340 18:54:43 -- accel/accel.sh@20 -- # IFS=: 00:06:22.340 18:54:43 -- accel/accel.sh@20 -- # read -r var val 00:06:22.340 18:54:43 -- accel/accel.sh@21 -- # val=software 00:06:22.340 18:54:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.340 18:54:43 -- accel/accel.sh@23 -- # accel_module=software 00:06:22.340 18:54:43 -- accel/accel.sh@20 -- # IFS=: 00:06:22.340 18:54:43 -- accel/accel.sh@20 -- # read -r var val 00:06:22.340 18:54:43 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:22.340 18:54:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.340 18:54:43 -- accel/accel.sh@20 -- # IFS=: 00:06:22.340 18:54:43 -- accel/accel.sh@20 -- # read -r var val 00:06:22.340 18:54:43 -- accel/accel.sh@21 -- # val=32 00:06:22.340 18:54:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.340 18:54:43 -- accel/accel.sh@20 -- # IFS=: 00:06:22.340 18:54:43 -- accel/accel.sh@20 -- # read -r var val 00:06:22.340 18:54:43 -- accel/accel.sh@21 -- # val=32 00:06:22.340 18:54:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.340 18:54:43 -- accel/accel.sh@20 -- # IFS=: 00:06:22.340 18:54:43 -- accel/accel.sh@20 -- # read -r var val 00:06:22.340 18:54:43 -- accel/accel.sh@21 -- # val=1 00:06:22.340 18:54:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.340 18:54:43 -- accel/accel.sh@20 -- # IFS=: 00:06:22.340 18:54:43 -- accel/accel.sh@20 -- # read -r var val 00:06:22.340 18:54:43 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:22.340 18:54:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.340 18:54:43 -- accel/accel.sh@20 -- # IFS=: 00:06:22.341 18:54:43 -- accel/accel.sh@20 -- # read -r var val 00:06:22.341 18:54:43 -- accel/accel.sh@21 -- # val=Yes 00:06:22.341 18:54:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.341 18:54:43 -- accel/accel.sh@20 -- # IFS=: 00:06:22.341 18:54:43 -- accel/accel.sh@20 -- # read -r var val 00:06:22.341 18:54:43 -- accel/accel.sh@21 -- # val= 00:06:22.341 18:54:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.341 18:54:43 -- accel/accel.sh@20 -- # IFS=: 00:06:22.341 18:54:43 -- accel/accel.sh@20 -- # read -r var val 00:06:22.341 18:54:43 -- accel/accel.sh@21 -- # val= 00:06:22.341 18:54:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.341 18:54:43 -- accel/accel.sh@20 -- # IFS=: 00:06:22.341 18:54:43 -- accel/accel.sh@20 -- # read -r var val 00:06:23.710 18:54:44 -- accel/accel.sh@21 -- # val= 00:06:23.710 18:54:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.710 18:54:44 -- accel/accel.sh@20 -- # IFS=: 00:06:23.710 18:54:44 -- accel/accel.sh@20 -- # read -r var val 00:06:23.710 18:54:44 -- accel/accel.sh@21 -- # val= 00:06:23.710 18:54:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.710 18:54:44 -- accel/accel.sh@20 -- # IFS=: 00:06:23.710 18:54:44 -- accel/accel.sh@20 -- # read -r var val 00:06:23.710 18:54:44 -- accel/accel.sh@21 -- # val= 00:06:23.710 18:54:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.710 18:54:44 -- accel/accel.sh@20 -- # IFS=: 00:06:23.710 18:54:44 -- accel/accel.sh@20 -- # read -r var val 00:06:23.710 18:54:44 -- accel/accel.sh@21 -- # val= 00:06:23.710 18:54:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.710 18:54:44 -- accel/accel.sh@20 -- # IFS=: 00:06:23.710 18:54:44 -- accel/accel.sh@20 -- # read -r var val 00:06:23.710 18:54:44 -- accel/accel.sh@21 -- # val= 00:06:23.710 18:54:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.710 18:54:44 -- accel/accel.sh@20 -- # IFS=: 00:06:23.710 18:54:44 -- accel/accel.sh@20 -- # read -r var val 00:06:23.710 18:54:44 -- accel/accel.sh@21 -- # val= 00:06:23.710 18:54:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.710 18:54:44 -- accel/accel.sh@20 -- # IFS=: 00:06:23.710 18:54:44 -- accel/accel.sh@20 -- # read -r var val 00:06:23.710 18:54:44 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:23.710 18:54:44 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:23.710 18:54:44 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:23.710 00:06:23.710 real 0m2.973s 00:06:23.710 user 0m2.676s 00:06:23.710 sys 0m0.289s 00:06:23.710 18:54:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:23.710 18:54:44 -- common/autotest_common.sh@10 -- # set +x 00:06:23.710 ************************************ 00:06:23.710 END TEST accel_decmop_full 00:06:23.710 ************************************ 00:06:23.710 18:54:44 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:23.710 18:54:44 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:23.710 18:54:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:23.710 18:54:44 -- common/autotest_common.sh@10 -- # set +x 00:06:23.710 ************************************ 00:06:23.710 START TEST accel_decomp_mcore 00:06:23.710 ************************************ 00:06:23.710 18:54:44 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:23.710 18:54:44 -- accel/accel.sh@16 -- # local accel_opc 00:06:23.710 18:54:44 -- accel/accel.sh@17 -- # local accel_module 00:06:23.710 18:54:44 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:23.710 18:54:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:23.710 18:54:44 -- accel/accel.sh@12 -- # build_accel_config 00:06:23.710 18:54:44 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:23.710 18:54:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:23.710 18:54:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:23.710 18:54:44 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:23.710 18:54:44 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:23.710 18:54:44 -- accel/accel.sh@41 -- # local IFS=, 00:06:23.710 18:54:44 -- accel/accel.sh@42 -- # jq -r . 00:06:23.710 [2024-11-28 18:54:44.405011] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:23.710 [2024-11-28 18:54:44.405090] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid97691 ] 00:06:23.710 EAL: No free 2048 kB hugepages reported on node 1 00:06:23.710 [2024-11-28 18:54:44.468194] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:23.710 [2024-11-28 18:54:44.587784] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:23.710 [2024-11-28 18:54:44.587805] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:23.710 [2024-11-28 18:54:44.587862] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:23.710 [2024-11-28 18:54:44.587864] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:25.082 18:54:45 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:25.082 00:06:25.082 SPDK Configuration: 00:06:25.082 Core mask: 0xf 00:06:25.082 00:06:25.082 Accel Perf Configuration: 00:06:25.082 Workload Type: decompress 00:06:25.082 Transfer size: 4096 bytes 00:06:25.082 Vector count 1 00:06:25.082 Module: software 00:06:25.082 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:25.082 Queue depth: 32 00:06:25.082 Allocate depth: 32 00:06:25.082 # threads/core: 1 00:06:25.082 Run time: 1 seconds 00:06:25.082 Verify: Yes 00:06:25.082 00:06:25.082 Running for 1 seconds... 00:06:25.082 00:06:25.082 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:25.082 ------------------------------------------------------------------------------------ 00:06:25.082 0,0 56480/s 104 MiB/s 0 0 00:06:25.082 3,0 56992/s 105 MiB/s 0 0 00:06:25.082 2,0 57056/s 105 MiB/s 0 0 00:06:25.082 1,0 56992/s 105 MiB/s 0 0 00:06:25.082 ==================================================================================== 00:06:25.082 Total 227520/s 888 MiB/s 0 0' 00:06:25.082 18:54:45 -- accel/accel.sh@20 -- # IFS=: 00:06:25.082 18:54:45 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:25.082 18:54:45 -- accel/accel.sh@20 -- # read -r var val 00:06:25.082 18:54:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:25.082 18:54:45 -- accel/accel.sh@12 -- # build_accel_config 00:06:25.082 18:54:45 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:25.082 18:54:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:25.082 18:54:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:25.082 18:54:45 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:25.082 18:54:45 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:25.082 18:54:45 -- accel/accel.sh@41 -- # local IFS=, 00:06:25.082 18:54:45 -- accel/accel.sh@42 -- # jq -r . 00:06:25.082 [2024-11-28 18:54:45.888711] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:25.082 [2024-11-28 18:54:45.888799] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid97834 ] 00:06:25.082 EAL: No free 2048 kB hugepages reported on node 1 00:06:25.082 [2024-11-28 18:54:45.949611] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:25.082 [2024-11-28 18:54:46.067617] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:25.082 [2024-11-28 18:54:46.067670] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:25.082 [2024-11-28 18:54:46.067735] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:25.082 [2024-11-28 18:54:46.067739] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:25.082 18:54:46 -- accel/accel.sh@21 -- # val= 00:06:25.082 18:54:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.082 18:54:46 -- accel/accel.sh@20 -- # IFS=: 00:06:25.082 18:54:46 -- accel/accel.sh@20 -- # read -r var val 00:06:25.082 18:54:46 -- accel/accel.sh@21 -- # val= 00:06:25.082 18:54:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.082 18:54:46 -- accel/accel.sh@20 -- # IFS=: 00:06:25.082 18:54:46 -- accel/accel.sh@20 -- # read -r var val 00:06:25.082 18:54:46 -- accel/accel.sh@21 -- # val= 00:06:25.082 18:54:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.082 18:54:46 -- accel/accel.sh@20 -- # IFS=: 00:06:25.082 18:54:46 -- accel/accel.sh@20 -- # read -r var val 00:06:25.082 18:54:46 -- accel/accel.sh@21 -- # val=0xf 00:06:25.082 18:54:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.082 18:54:46 -- accel/accel.sh@20 -- # IFS=: 00:06:25.082 18:54:46 -- accel/accel.sh@20 -- # read -r var val 00:06:25.082 18:54:46 -- accel/accel.sh@21 -- # val= 00:06:25.082 18:54:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.082 18:54:46 -- accel/accel.sh@20 -- # IFS=: 00:06:25.082 18:54:46 -- accel/accel.sh@20 -- # read -r var val 00:06:25.341 18:54:46 -- accel/accel.sh@21 -- # val= 00:06:25.341 18:54:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.341 18:54:46 -- accel/accel.sh@20 -- # IFS=: 00:06:25.341 18:54:46 -- accel/accel.sh@20 -- # read -r var val 00:06:25.341 18:54:46 -- accel/accel.sh@21 -- # val=decompress 00:06:25.341 18:54:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.341 18:54:46 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:25.341 18:54:46 -- accel/accel.sh@20 -- # IFS=: 00:06:25.341 18:54:46 -- accel/accel.sh@20 -- # read -r var val 00:06:25.341 18:54:46 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:25.341 18:54:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.341 18:54:46 -- accel/accel.sh@20 -- # IFS=: 00:06:25.341 18:54:46 -- accel/accel.sh@20 -- # read -r var val 00:06:25.341 18:54:46 -- accel/accel.sh@21 -- # val= 00:06:25.341 18:54:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.341 18:54:46 -- accel/accel.sh@20 -- # IFS=: 00:06:25.341 18:54:46 -- accel/accel.sh@20 -- # read -r var val 00:06:25.341 18:54:46 -- accel/accel.sh@21 -- # val=software 00:06:25.341 18:54:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.341 18:54:46 -- accel/accel.sh@23 -- # accel_module=software 00:06:25.341 18:54:46 -- accel/accel.sh@20 -- # IFS=: 00:06:25.341 18:54:46 -- accel/accel.sh@20 -- # read -r var val 00:06:25.341 18:54:46 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:25.341 18:54:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.341 18:54:46 -- accel/accel.sh@20 -- # IFS=: 00:06:25.341 18:54:46 -- accel/accel.sh@20 -- # read -r var val 00:06:25.341 18:54:46 -- accel/accel.sh@21 -- # val=32 00:06:25.341 18:54:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.341 18:54:46 -- accel/accel.sh@20 -- # IFS=: 00:06:25.341 18:54:46 -- accel/accel.sh@20 -- # read -r var val 00:06:25.341 18:54:46 -- accel/accel.sh@21 -- # val=32 00:06:25.341 18:54:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.341 18:54:46 -- accel/accel.sh@20 -- # IFS=: 00:06:25.341 18:54:46 -- accel/accel.sh@20 -- # read -r var val 00:06:25.341 18:54:46 -- accel/accel.sh@21 -- # val=1 00:06:25.341 18:54:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.341 18:54:46 -- accel/accel.sh@20 -- # IFS=: 00:06:25.341 18:54:46 -- accel/accel.sh@20 -- # read -r var val 00:06:25.341 18:54:46 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:25.341 18:54:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.341 18:54:46 -- accel/accel.sh@20 -- # IFS=: 00:06:25.341 18:54:46 -- accel/accel.sh@20 -- # read -r var val 00:06:25.341 18:54:46 -- accel/accel.sh@21 -- # val=Yes 00:06:25.341 18:54:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.341 18:54:46 -- accel/accel.sh@20 -- # IFS=: 00:06:25.341 18:54:46 -- accel/accel.sh@20 -- # read -r var val 00:06:25.341 18:54:46 -- accel/accel.sh@21 -- # val= 00:06:25.341 18:54:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.341 18:54:46 -- accel/accel.sh@20 -- # IFS=: 00:06:25.341 18:54:46 -- accel/accel.sh@20 -- # read -r var val 00:06:25.341 18:54:46 -- accel/accel.sh@21 -- # val= 00:06:25.341 18:54:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:25.341 18:54:46 -- accel/accel.sh@20 -- # IFS=: 00:06:25.341 18:54:46 -- accel/accel.sh@20 -- # read -r var val 00:06:26.714 18:54:47 -- accel/accel.sh@21 -- # val= 00:06:26.714 18:54:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.714 18:54:47 -- accel/accel.sh@20 -- # IFS=: 00:06:26.714 18:54:47 -- accel/accel.sh@20 -- # read -r var val 00:06:26.714 18:54:47 -- accel/accel.sh@21 -- # val= 00:06:26.714 18:54:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.714 18:54:47 -- accel/accel.sh@20 -- # IFS=: 00:06:26.714 18:54:47 -- accel/accel.sh@20 -- # read -r var val 00:06:26.714 18:54:47 -- accel/accel.sh@21 -- # val= 00:06:26.714 18:54:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.714 18:54:47 -- accel/accel.sh@20 -- # IFS=: 00:06:26.714 18:54:47 -- accel/accel.sh@20 -- # read -r var val 00:06:26.714 18:54:47 -- accel/accel.sh@21 -- # val= 00:06:26.714 18:54:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.714 18:54:47 -- accel/accel.sh@20 -- # IFS=: 00:06:26.714 18:54:47 -- accel/accel.sh@20 -- # read -r var val 00:06:26.714 18:54:47 -- accel/accel.sh@21 -- # val= 00:06:26.714 18:54:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.714 18:54:47 -- accel/accel.sh@20 -- # IFS=: 00:06:26.714 18:54:47 -- accel/accel.sh@20 -- # read -r var val 00:06:26.714 18:54:47 -- accel/accel.sh@21 -- # val= 00:06:26.714 18:54:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.714 18:54:47 -- accel/accel.sh@20 -- # IFS=: 00:06:26.714 18:54:47 -- accel/accel.sh@20 -- # read -r var val 00:06:26.714 18:54:47 -- accel/accel.sh@21 -- # val= 00:06:26.714 18:54:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.714 18:54:47 -- accel/accel.sh@20 -- # IFS=: 00:06:26.714 18:54:47 -- accel/accel.sh@20 -- # read -r var val 00:06:26.714 18:54:47 -- accel/accel.sh@21 -- # val= 00:06:26.714 18:54:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.714 18:54:47 -- accel/accel.sh@20 -- # IFS=: 00:06:26.714 18:54:47 -- accel/accel.sh@20 -- # read -r var val 00:06:26.714 18:54:47 -- accel/accel.sh@21 -- # val= 00:06:26.714 18:54:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.714 18:54:47 -- accel/accel.sh@20 -- # IFS=: 00:06:26.714 18:54:47 -- accel/accel.sh@20 -- # read -r var val 00:06:26.714 18:54:47 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:26.714 18:54:47 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:26.714 18:54:47 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:26.714 00:06:26.714 real 0m2.946s 00:06:26.714 user 0m9.499s 00:06:26.714 sys 0m0.305s 00:06:26.714 18:54:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:26.714 18:54:47 -- common/autotest_common.sh@10 -- # set +x 00:06:26.714 ************************************ 00:06:26.714 END TEST accel_decomp_mcore 00:06:26.714 ************************************ 00:06:26.714 18:54:47 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:26.714 18:54:47 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:26.714 18:54:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:26.714 18:54:47 -- common/autotest_common.sh@10 -- # set +x 00:06:26.714 ************************************ 00:06:26.714 START TEST accel_decomp_full_mcore 00:06:26.714 ************************************ 00:06:26.714 18:54:47 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:26.714 18:54:47 -- accel/accel.sh@16 -- # local accel_opc 00:06:26.714 18:54:47 -- accel/accel.sh@17 -- # local accel_module 00:06:26.714 18:54:47 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:26.714 18:54:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:26.714 18:54:47 -- accel/accel.sh@12 -- # build_accel_config 00:06:26.714 18:54:47 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:26.714 18:54:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:26.714 18:54:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:26.714 18:54:47 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:26.714 18:54:47 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:26.714 18:54:47 -- accel/accel.sh@41 -- # local IFS=, 00:06:26.714 18:54:47 -- accel/accel.sh@42 -- # jq -r . 00:06:26.714 [2024-11-28 18:54:47.374473] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:26.714 [2024-11-28 18:54:47.374562] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid98125 ] 00:06:26.714 EAL: No free 2048 kB hugepages reported on node 1 00:06:26.714 [2024-11-28 18:54:47.440033] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:26.714 [2024-11-28 18:54:47.559543] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:26.714 [2024-11-28 18:54:47.559565] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:26.714 [2024-11-28 18:54:47.559624] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:26.714 [2024-11-28 18:54:47.559627] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:28.091 18:54:48 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:28.091 00:06:28.091 SPDK Configuration: 00:06:28.091 Core mask: 0xf 00:06:28.091 00:06:28.091 Accel Perf Configuration: 00:06:28.091 Workload Type: decompress 00:06:28.091 Transfer size: 111250 bytes 00:06:28.091 Vector count 1 00:06:28.091 Module: software 00:06:28.091 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:28.091 Queue depth: 32 00:06:28.091 Allocate depth: 32 00:06:28.091 # threads/core: 1 00:06:28.091 Run time: 1 seconds 00:06:28.091 Verify: Yes 00:06:28.091 00:06:28.091 Running for 1 seconds... 00:06:28.091 00:06:28.091 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:28.091 ------------------------------------------------------------------------------------ 00:06:28.091 0,0 4288/s 177 MiB/s 0 0 00:06:28.091 3,0 4288/s 177 MiB/s 0 0 00:06:28.091 2,0 4288/s 177 MiB/s 0 0 00:06:28.091 1,0 4288/s 177 MiB/s 0 0 00:06:28.091 ==================================================================================== 00:06:28.091 Total 17152/s 1819 MiB/s 0 0' 00:06:28.091 18:54:48 -- accel/accel.sh@20 -- # IFS=: 00:06:28.091 18:54:48 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:28.091 18:54:48 -- accel/accel.sh@20 -- # read -r var val 00:06:28.091 18:54:48 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:28.091 18:54:48 -- accel/accel.sh@12 -- # build_accel_config 00:06:28.091 18:54:48 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:28.091 18:54:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:28.091 18:54:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:28.091 18:54:48 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:28.091 18:54:48 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:28.091 18:54:48 -- accel/accel.sh@41 -- # local IFS=, 00:06:28.091 18:54:48 -- accel/accel.sh@42 -- # jq -r . 00:06:28.091 [2024-11-28 18:54:48.875554] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:28.091 [2024-11-28 18:54:48.875639] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid98268 ] 00:06:28.091 EAL: No free 2048 kB hugepages reported on node 1 00:06:28.091 [2024-11-28 18:54:48.939832] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:28.091 [2024-11-28 18:54:49.059049] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:28.091 [2024-11-28 18:54:49.059118] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:28.091 [2024-11-28 18:54:49.059217] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:28.091 [2024-11-28 18:54:49.059220] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:28.091 18:54:49 -- accel/accel.sh@21 -- # val= 00:06:28.091 18:54:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.091 18:54:49 -- accel/accel.sh@20 -- # IFS=: 00:06:28.091 18:54:49 -- accel/accel.sh@20 -- # read -r var val 00:06:28.091 18:54:49 -- accel/accel.sh@21 -- # val= 00:06:28.091 18:54:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.091 18:54:49 -- accel/accel.sh@20 -- # IFS=: 00:06:28.091 18:54:49 -- accel/accel.sh@20 -- # read -r var val 00:06:28.091 18:54:49 -- accel/accel.sh@21 -- # val= 00:06:28.091 18:54:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.091 18:54:49 -- accel/accel.sh@20 -- # IFS=: 00:06:28.091 18:54:49 -- accel/accel.sh@20 -- # read -r var val 00:06:28.091 18:54:49 -- accel/accel.sh@21 -- # val=0xf 00:06:28.091 18:54:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.091 18:54:49 -- accel/accel.sh@20 -- # IFS=: 00:06:28.091 18:54:49 -- accel/accel.sh@20 -- # read -r var val 00:06:28.091 18:54:49 -- accel/accel.sh@21 -- # val= 00:06:28.091 18:54:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.091 18:54:49 -- accel/accel.sh@20 -- # IFS=: 00:06:28.091 18:54:49 -- accel/accel.sh@20 -- # read -r var val 00:06:28.091 18:54:49 -- accel/accel.sh@21 -- # val= 00:06:28.091 18:54:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.091 18:54:49 -- accel/accel.sh@20 -- # IFS=: 00:06:28.091 18:54:49 -- accel/accel.sh@20 -- # read -r var val 00:06:28.091 18:54:49 -- accel/accel.sh@21 -- # val=decompress 00:06:28.091 18:54:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.091 18:54:49 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:28.091 18:54:49 -- accel/accel.sh@20 -- # IFS=: 00:06:28.091 18:54:49 -- accel/accel.sh@20 -- # read -r var val 00:06:28.091 18:54:49 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:28.091 18:54:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.091 18:54:49 -- accel/accel.sh@20 -- # IFS=: 00:06:28.091 18:54:49 -- accel/accel.sh@20 -- # read -r var val 00:06:28.091 18:54:49 -- accel/accel.sh@21 -- # val= 00:06:28.091 18:54:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.091 18:54:49 -- accel/accel.sh@20 -- # IFS=: 00:06:28.091 18:54:49 -- accel/accel.sh@20 -- # read -r var val 00:06:28.091 18:54:49 -- accel/accel.sh@21 -- # val=software 00:06:28.091 18:54:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.091 18:54:49 -- accel/accel.sh@23 -- # accel_module=software 00:06:28.091 18:54:49 -- accel/accel.sh@20 -- # IFS=: 00:06:28.091 18:54:49 -- accel/accel.sh@20 -- # read -r var val 00:06:28.091 18:54:49 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:28.091 18:54:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.091 18:54:49 -- accel/accel.sh@20 -- # IFS=: 00:06:28.091 18:54:49 -- accel/accel.sh@20 -- # read -r var val 00:06:28.091 18:54:49 -- accel/accel.sh@21 -- # val=32 00:06:28.091 18:54:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.091 18:54:49 -- accel/accel.sh@20 -- # IFS=: 00:06:28.091 18:54:49 -- accel/accel.sh@20 -- # read -r var val 00:06:28.091 18:54:49 -- accel/accel.sh@21 -- # val=32 00:06:28.091 18:54:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.091 18:54:49 -- accel/accel.sh@20 -- # IFS=: 00:06:28.091 18:54:49 -- accel/accel.sh@20 -- # read -r var val 00:06:28.091 18:54:49 -- accel/accel.sh@21 -- # val=1 00:06:28.091 18:54:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.091 18:54:49 -- accel/accel.sh@20 -- # IFS=: 00:06:28.091 18:54:49 -- accel/accel.sh@20 -- # read -r var val 00:06:28.091 18:54:49 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:28.091 18:54:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.091 18:54:49 -- accel/accel.sh@20 -- # IFS=: 00:06:28.091 18:54:49 -- accel/accel.sh@20 -- # read -r var val 00:06:28.091 18:54:49 -- accel/accel.sh@21 -- # val=Yes 00:06:28.091 18:54:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.092 18:54:49 -- accel/accel.sh@20 -- # IFS=: 00:06:28.092 18:54:49 -- accel/accel.sh@20 -- # read -r var val 00:06:28.092 18:54:49 -- accel/accel.sh@21 -- # val= 00:06:28.092 18:54:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.092 18:54:49 -- accel/accel.sh@20 -- # IFS=: 00:06:28.092 18:54:49 -- accel/accel.sh@20 -- # read -r var val 00:06:28.092 18:54:49 -- accel/accel.sh@21 -- # val= 00:06:28.092 18:54:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:28.092 18:54:49 -- accel/accel.sh@20 -- # IFS=: 00:06:28.092 18:54:49 -- accel/accel.sh@20 -- # read -r var val 00:06:29.466 18:54:50 -- accel/accel.sh@21 -- # val= 00:06:29.466 18:54:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.466 18:54:50 -- accel/accel.sh@20 -- # IFS=: 00:06:29.466 18:54:50 -- accel/accel.sh@20 -- # read -r var val 00:06:29.466 18:54:50 -- accel/accel.sh@21 -- # val= 00:06:29.466 18:54:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.466 18:54:50 -- accel/accel.sh@20 -- # IFS=: 00:06:29.466 18:54:50 -- accel/accel.sh@20 -- # read -r var val 00:06:29.466 18:54:50 -- accel/accel.sh@21 -- # val= 00:06:29.466 18:54:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.466 18:54:50 -- accel/accel.sh@20 -- # IFS=: 00:06:29.466 18:54:50 -- accel/accel.sh@20 -- # read -r var val 00:06:29.466 18:54:50 -- accel/accel.sh@21 -- # val= 00:06:29.466 18:54:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.466 18:54:50 -- accel/accel.sh@20 -- # IFS=: 00:06:29.466 18:54:50 -- accel/accel.sh@20 -- # read -r var val 00:06:29.466 18:54:50 -- accel/accel.sh@21 -- # val= 00:06:29.466 18:54:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.466 18:54:50 -- accel/accel.sh@20 -- # IFS=: 00:06:29.466 18:54:50 -- accel/accel.sh@20 -- # read -r var val 00:06:29.466 18:54:50 -- accel/accel.sh@21 -- # val= 00:06:29.466 18:54:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.466 18:54:50 -- accel/accel.sh@20 -- # IFS=: 00:06:29.466 18:54:50 -- accel/accel.sh@20 -- # read -r var val 00:06:29.466 18:54:50 -- accel/accel.sh@21 -- # val= 00:06:29.466 18:54:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.466 18:54:50 -- accel/accel.sh@20 -- # IFS=: 00:06:29.466 18:54:50 -- accel/accel.sh@20 -- # read -r var val 00:06:29.466 18:54:50 -- accel/accel.sh@21 -- # val= 00:06:29.466 18:54:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.466 18:54:50 -- accel/accel.sh@20 -- # IFS=: 00:06:29.466 18:54:50 -- accel/accel.sh@20 -- # read -r var val 00:06:29.466 18:54:50 -- accel/accel.sh@21 -- # val= 00:06:29.466 18:54:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.466 18:54:50 -- accel/accel.sh@20 -- # IFS=: 00:06:29.466 18:54:50 -- accel/accel.sh@20 -- # read -r var val 00:06:29.466 18:54:50 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:29.466 18:54:50 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:29.466 18:54:50 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:29.466 00:06:29.466 real 0m2.998s 00:06:29.466 user 0m9.646s 00:06:29.466 sys 0m0.317s 00:06:29.466 18:54:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:29.466 18:54:50 -- common/autotest_common.sh@10 -- # set +x 00:06:29.466 ************************************ 00:06:29.466 END TEST accel_decomp_full_mcore 00:06:29.466 ************************************ 00:06:29.466 18:54:50 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:29.466 18:54:50 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:29.466 18:54:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:29.466 18:54:50 -- common/autotest_common.sh@10 -- # set +x 00:06:29.466 ************************************ 00:06:29.466 START TEST accel_decomp_mthread 00:06:29.466 ************************************ 00:06:29.467 18:54:50 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:29.467 18:54:50 -- accel/accel.sh@16 -- # local accel_opc 00:06:29.467 18:54:50 -- accel/accel.sh@17 -- # local accel_module 00:06:29.467 18:54:50 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:29.467 18:54:50 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:29.467 18:54:50 -- accel/accel.sh@12 -- # build_accel_config 00:06:29.467 18:54:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:29.467 18:54:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:29.467 18:54:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:29.467 18:54:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:29.467 18:54:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:29.467 18:54:50 -- accel/accel.sh@41 -- # local IFS=, 00:06:29.467 18:54:50 -- accel/accel.sh@42 -- # jq -r . 00:06:29.467 [2024-11-28 18:54:50.401418] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:29.467 [2024-11-28 18:54:50.401504] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid98430 ] 00:06:29.467 EAL: No free 2048 kB hugepages reported on node 1 00:06:29.467 [2024-11-28 18:54:50.466069] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:29.725 [2024-11-28 18:54:50.581920] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:31.100 18:54:51 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:31.100 00:06:31.100 SPDK Configuration: 00:06:31.100 Core mask: 0x1 00:06:31.100 00:06:31.100 Accel Perf Configuration: 00:06:31.100 Workload Type: decompress 00:06:31.100 Transfer size: 4096 bytes 00:06:31.100 Vector count 1 00:06:31.100 Module: software 00:06:31.100 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:31.100 Queue depth: 32 00:06:31.100 Allocate depth: 32 00:06:31.100 # threads/core: 2 00:06:31.100 Run time: 1 seconds 00:06:31.100 Verify: Yes 00:06:31.100 00:06:31.100 Running for 1 seconds... 00:06:31.100 00:06:31.100 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:31.100 ------------------------------------------------------------------------------------ 00:06:31.100 0,1 28192/s 51 MiB/s 0 0 00:06:31.100 0,0 28096/s 51 MiB/s 0 0 00:06:31.100 ==================================================================================== 00:06:31.100 Total 56288/s 219 MiB/s 0 0' 00:06:31.100 18:54:51 -- accel/accel.sh@20 -- # IFS=: 00:06:31.100 18:54:51 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:31.100 18:54:51 -- accel/accel.sh@20 -- # read -r var val 00:06:31.100 18:54:51 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:31.100 18:54:51 -- accel/accel.sh@12 -- # build_accel_config 00:06:31.100 18:54:51 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:31.100 18:54:51 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:31.100 18:54:51 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:31.100 18:54:51 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:31.100 18:54:51 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:31.100 18:54:51 -- accel/accel.sh@41 -- # local IFS=, 00:06:31.100 18:54:51 -- accel/accel.sh@42 -- # jq -r . 00:06:31.100 [2024-11-28 18:54:51.877920] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:31.100 [2024-11-28 18:54:51.878007] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid98695 ] 00:06:31.100 EAL: No free 2048 kB hugepages reported on node 1 00:06:31.100 [2024-11-28 18:54:51.944490] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:31.100 [2024-11-28 18:54:52.060315] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:31.100 18:54:52 -- accel/accel.sh@21 -- # val= 00:06:31.100 18:54:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.100 18:54:52 -- accel/accel.sh@20 -- # IFS=: 00:06:31.100 18:54:52 -- accel/accel.sh@20 -- # read -r var val 00:06:31.100 18:54:52 -- accel/accel.sh@21 -- # val= 00:06:31.100 18:54:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.100 18:54:52 -- accel/accel.sh@20 -- # IFS=: 00:06:31.100 18:54:52 -- accel/accel.sh@20 -- # read -r var val 00:06:31.100 18:54:52 -- accel/accel.sh@21 -- # val= 00:06:31.100 18:54:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.100 18:54:52 -- accel/accel.sh@20 -- # IFS=: 00:06:31.100 18:54:52 -- accel/accel.sh@20 -- # read -r var val 00:06:31.100 18:54:52 -- accel/accel.sh@21 -- # val=0x1 00:06:31.100 18:54:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.100 18:54:52 -- accel/accel.sh@20 -- # IFS=: 00:06:31.100 18:54:52 -- accel/accel.sh@20 -- # read -r var val 00:06:31.100 18:54:52 -- accel/accel.sh@21 -- # val= 00:06:31.100 18:54:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.100 18:54:52 -- accel/accel.sh@20 -- # IFS=: 00:06:31.100 18:54:52 -- accel/accel.sh@20 -- # read -r var val 00:06:31.100 18:54:52 -- accel/accel.sh@21 -- # val= 00:06:31.100 18:54:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.100 18:54:52 -- accel/accel.sh@20 -- # IFS=: 00:06:31.100 18:54:52 -- accel/accel.sh@20 -- # read -r var val 00:06:31.100 18:54:52 -- accel/accel.sh@21 -- # val=decompress 00:06:31.100 18:54:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.100 18:54:52 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:31.100 18:54:52 -- accel/accel.sh@20 -- # IFS=: 00:06:31.100 18:54:52 -- accel/accel.sh@20 -- # read -r var val 00:06:31.100 18:54:52 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:31.100 18:54:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.100 18:54:52 -- accel/accel.sh@20 -- # IFS=: 00:06:31.100 18:54:52 -- accel/accel.sh@20 -- # read -r var val 00:06:31.100 18:54:52 -- accel/accel.sh@21 -- # val= 00:06:31.100 18:54:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.100 18:54:52 -- accel/accel.sh@20 -- # IFS=: 00:06:31.100 18:54:52 -- accel/accel.sh@20 -- # read -r var val 00:06:31.100 18:54:52 -- accel/accel.sh@21 -- # val=software 00:06:31.100 18:54:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.101 18:54:52 -- accel/accel.sh@23 -- # accel_module=software 00:06:31.101 18:54:52 -- accel/accel.sh@20 -- # IFS=: 00:06:31.101 18:54:52 -- accel/accel.sh@20 -- # read -r var val 00:06:31.101 18:54:52 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:31.101 18:54:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.101 18:54:52 -- accel/accel.sh@20 -- # IFS=: 00:06:31.101 18:54:52 -- accel/accel.sh@20 -- # read -r var val 00:06:31.101 18:54:52 -- accel/accel.sh@21 -- # val=32 00:06:31.101 18:54:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.101 18:54:52 -- accel/accel.sh@20 -- # IFS=: 00:06:31.101 18:54:52 -- accel/accel.sh@20 -- # read -r var val 00:06:31.101 18:54:52 -- accel/accel.sh@21 -- # val=32 00:06:31.101 18:54:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.101 18:54:52 -- accel/accel.sh@20 -- # IFS=: 00:06:31.101 18:54:52 -- accel/accel.sh@20 -- # read -r var val 00:06:31.101 18:54:52 -- accel/accel.sh@21 -- # val=2 00:06:31.101 18:54:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.101 18:54:52 -- accel/accel.sh@20 -- # IFS=: 00:06:31.101 18:54:52 -- accel/accel.sh@20 -- # read -r var val 00:06:31.101 18:54:52 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:31.101 18:54:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.101 18:54:52 -- accel/accel.sh@20 -- # IFS=: 00:06:31.101 18:54:52 -- accel/accel.sh@20 -- # read -r var val 00:06:31.101 18:54:52 -- accel/accel.sh@21 -- # val=Yes 00:06:31.101 18:54:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.101 18:54:52 -- accel/accel.sh@20 -- # IFS=: 00:06:31.101 18:54:52 -- accel/accel.sh@20 -- # read -r var val 00:06:31.101 18:54:52 -- accel/accel.sh@21 -- # val= 00:06:31.101 18:54:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.101 18:54:52 -- accel/accel.sh@20 -- # IFS=: 00:06:31.101 18:54:52 -- accel/accel.sh@20 -- # read -r var val 00:06:31.101 18:54:52 -- accel/accel.sh@21 -- # val= 00:06:31.101 18:54:52 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.101 18:54:52 -- accel/accel.sh@20 -- # IFS=: 00:06:31.101 18:54:52 -- accel/accel.sh@20 -- # read -r var val 00:06:32.476 18:54:53 -- accel/accel.sh@21 -- # val= 00:06:32.476 18:54:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.476 18:54:53 -- accel/accel.sh@20 -- # IFS=: 00:06:32.476 18:54:53 -- accel/accel.sh@20 -- # read -r var val 00:06:32.476 18:54:53 -- accel/accel.sh@21 -- # val= 00:06:32.476 18:54:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.476 18:54:53 -- accel/accel.sh@20 -- # IFS=: 00:06:32.476 18:54:53 -- accel/accel.sh@20 -- # read -r var val 00:06:32.476 18:54:53 -- accel/accel.sh@21 -- # val= 00:06:32.476 18:54:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.476 18:54:53 -- accel/accel.sh@20 -- # IFS=: 00:06:32.476 18:54:53 -- accel/accel.sh@20 -- # read -r var val 00:06:32.476 18:54:53 -- accel/accel.sh@21 -- # val= 00:06:32.476 18:54:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.476 18:54:53 -- accel/accel.sh@20 -- # IFS=: 00:06:32.476 18:54:53 -- accel/accel.sh@20 -- # read -r var val 00:06:32.476 18:54:53 -- accel/accel.sh@21 -- # val= 00:06:32.476 18:54:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.476 18:54:53 -- accel/accel.sh@20 -- # IFS=: 00:06:32.476 18:54:53 -- accel/accel.sh@20 -- # read -r var val 00:06:32.476 18:54:53 -- accel/accel.sh@21 -- # val= 00:06:32.476 18:54:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.476 18:54:53 -- accel/accel.sh@20 -- # IFS=: 00:06:32.476 18:54:53 -- accel/accel.sh@20 -- # read -r var val 00:06:32.476 18:54:53 -- accel/accel.sh@21 -- # val= 00:06:32.476 18:54:53 -- accel/accel.sh@22 -- # case "$var" in 00:06:32.476 18:54:53 -- accel/accel.sh@20 -- # IFS=: 00:06:32.476 18:54:53 -- accel/accel.sh@20 -- # read -r var val 00:06:32.476 18:54:53 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:32.476 18:54:53 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:32.476 18:54:53 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:32.476 00:06:32.476 real 0m2.966s 00:06:32.476 user 0m2.657s 00:06:32.476 sys 0m0.300s 00:06:32.476 18:54:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:32.476 18:54:53 -- common/autotest_common.sh@10 -- # set +x 00:06:32.476 ************************************ 00:06:32.476 END TEST accel_decomp_mthread 00:06:32.476 ************************************ 00:06:32.476 18:54:53 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:32.476 18:54:53 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:32.476 18:54:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:32.476 18:54:53 -- common/autotest_common.sh@10 -- # set +x 00:06:32.476 ************************************ 00:06:32.476 START TEST accel_deomp_full_mthread 00:06:32.476 ************************************ 00:06:32.476 18:54:53 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:32.476 18:54:53 -- accel/accel.sh@16 -- # local accel_opc 00:06:32.476 18:54:53 -- accel/accel.sh@17 -- # local accel_module 00:06:32.476 18:54:53 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:32.476 18:54:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:32.476 18:54:53 -- accel/accel.sh@12 -- # build_accel_config 00:06:32.476 18:54:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:32.476 18:54:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:32.476 18:54:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:32.476 18:54:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:32.476 18:54:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:32.476 18:54:53 -- accel/accel.sh@41 -- # local IFS=, 00:06:32.476 18:54:53 -- accel/accel.sh@42 -- # jq -r . 00:06:32.476 [2024-11-28 18:54:53.393230] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:32.476 [2024-11-28 18:54:53.393310] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid98858 ] 00:06:32.476 EAL: No free 2048 kB hugepages reported on node 1 00:06:32.476 [2024-11-28 18:54:53.458939] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:32.735 [2024-11-28 18:54:53.575545] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:34.112 18:54:54 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:34.112 00:06:34.112 SPDK Configuration: 00:06:34.112 Core mask: 0x1 00:06:34.112 00:06:34.112 Accel Perf Configuration: 00:06:34.112 Workload Type: decompress 00:06:34.112 Transfer size: 111250 bytes 00:06:34.112 Vector count 1 00:06:34.112 Module: software 00:06:34.112 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:34.112 Queue depth: 32 00:06:34.112 Allocate depth: 32 00:06:34.112 # threads/core: 2 00:06:34.112 Run time: 1 seconds 00:06:34.112 Verify: Yes 00:06:34.112 00:06:34.112 Running for 1 seconds... 00:06:34.112 00:06:34.112 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:34.112 ------------------------------------------------------------------------------------ 00:06:34.112 0,1 1952/s 80 MiB/s 0 0 00:06:34.112 0,0 1920/s 79 MiB/s 0 0 00:06:34.112 ==================================================================================== 00:06:34.112 Total 3872/s 410 MiB/s 0 0' 00:06:34.112 18:54:54 -- accel/accel.sh@20 -- # IFS=: 00:06:34.112 18:54:54 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:34.112 18:54:54 -- accel/accel.sh@20 -- # read -r var val 00:06:34.112 18:54:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:34.112 18:54:54 -- accel/accel.sh@12 -- # build_accel_config 00:06:34.112 18:54:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:34.112 18:54:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:34.112 18:54:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:34.112 18:54:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:34.112 18:54:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:34.112 18:54:54 -- accel/accel.sh@41 -- # local IFS=, 00:06:34.112 18:54:54 -- accel/accel.sh@42 -- # jq -r . 00:06:34.112 [2024-11-28 18:54:54.909628] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:34.112 [2024-11-28 18:54:54.909709] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid98998 ] 00:06:34.112 EAL: No free 2048 kB hugepages reported on node 1 00:06:34.112 [2024-11-28 18:54:54.970251] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:34.113 [2024-11-28 18:54:55.086333] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:34.113 18:54:55 -- accel/accel.sh@21 -- # val= 00:06:34.113 18:54:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.113 18:54:55 -- accel/accel.sh@20 -- # IFS=: 00:06:34.113 18:54:55 -- accel/accel.sh@20 -- # read -r var val 00:06:34.113 18:54:55 -- accel/accel.sh@21 -- # val= 00:06:34.113 18:54:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.113 18:54:55 -- accel/accel.sh@20 -- # IFS=: 00:06:34.113 18:54:55 -- accel/accel.sh@20 -- # read -r var val 00:06:34.113 18:54:55 -- accel/accel.sh@21 -- # val= 00:06:34.113 18:54:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.113 18:54:55 -- accel/accel.sh@20 -- # IFS=: 00:06:34.113 18:54:55 -- accel/accel.sh@20 -- # read -r var val 00:06:34.113 18:54:55 -- accel/accel.sh@21 -- # val=0x1 00:06:34.113 18:54:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.113 18:54:55 -- accel/accel.sh@20 -- # IFS=: 00:06:34.113 18:54:55 -- accel/accel.sh@20 -- # read -r var val 00:06:34.113 18:54:55 -- accel/accel.sh@21 -- # val= 00:06:34.113 18:54:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.113 18:54:55 -- accel/accel.sh@20 -- # IFS=: 00:06:34.113 18:54:55 -- accel/accel.sh@20 -- # read -r var val 00:06:34.113 18:54:55 -- accel/accel.sh@21 -- # val= 00:06:34.113 18:54:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.113 18:54:55 -- accel/accel.sh@20 -- # IFS=: 00:06:34.113 18:54:55 -- accel/accel.sh@20 -- # read -r var val 00:06:34.113 18:54:55 -- accel/accel.sh@21 -- # val=decompress 00:06:34.113 18:54:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.113 18:54:55 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:34.113 18:54:55 -- accel/accel.sh@20 -- # IFS=: 00:06:34.113 18:54:55 -- accel/accel.sh@20 -- # read -r var val 00:06:34.113 18:54:55 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:34.113 18:54:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.113 18:54:55 -- accel/accel.sh@20 -- # IFS=: 00:06:34.113 18:54:55 -- accel/accel.sh@20 -- # read -r var val 00:06:34.113 18:54:55 -- accel/accel.sh@21 -- # val= 00:06:34.113 18:54:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.113 18:54:55 -- accel/accel.sh@20 -- # IFS=: 00:06:34.113 18:54:55 -- accel/accel.sh@20 -- # read -r var val 00:06:34.113 18:54:55 -- accel/accel.sh@21 -- # val=software 00:06:34.113 18:54:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.113 18:54:55 -- accel/accel.sh@23 -- # accel_module=software 00:06:34.113 18:54:55 -- accel/accel.sh@20 -- # IFS=: 00:06:34.113 18:54:55 -- accel/accel.sh@20 -- # read -r var val 00:06:34.113 18:54:55 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:34.113 18:54:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.113 18:54:55 -- accel/accel.sh@20 -- # IFS=: 00:06:34.113 18:54:55 -- accel/accel.sh@20 -- # read -r var val 00:06:34.113 18:54:55 -- accel/accel.sh@21 -- # val=32 00:06:34.113 18:54:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.113 18:54:55 -- accel/accel.sh@20 -- # IFS=: 00:06:34.113 18:54:55 -- accel/accel.sh@20 -- # read -r var val 00:06:34.113 18:54:55 -- accel/accel.sh@21 -- # val=32 00:06:34.113 18:54:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.113 18:54:55 -- accel/accel.sh@20 -- # IFS=: 00:06:34.113 18:54:55 -- accel/accel.sh@20 -- # read -r var val 00:06:34.113 18:54:55 -- accel/accel.sh@21 -- # val=2 00:06:34.113 18:54:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.113 18:54:55 -- accel/accel.sh@20 -- # IFS=: 00:06:34.113 18:54:55 -- accel/accel.sh@20 -- # read -r var val 00:06:34.113 18:54:55 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:34.113 18:54:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.113 18:54:55 -- accel/accel.sh@20 -- # IFS=: 00:06:34.113 18:54:55 -- accel/accel.sh@20 -- # read -r var val 00:06:34.113 18:54:55 -- accel/accel.sh@21 -- # val=Yes 00:06:34.113 18:54:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.113 18:54:55 -- accel/accel.sh@20 -- # IFS=: 00:06:34.113 18:54:55 -- accel/accel.sh@20 -- # read -r var val 00:06:34.113 18:54:55 -- accel/accel.sh@21 -- # val= 00:06:34.113 18:54:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.113 18:54:55 -- accel/accel.sh@20 -- # IFS=: 00:06:34.113 18:54:55 -- accel/accel.sh@20 -- # read -r var val 00:06:34.113 18:54:55 -- accel/accel.sh@21 -- # val= 00:06:34.370 18:54:55 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.370 18:54:55 -- accel/accel.sh@20 -- # IFS=: 00:06:34.370 18:54:55 -- accel/accel.sh@20 -- # read -r var val 00:06:35.744 18:54:56 -- accel/accel.sh@21 -- # val= 00:06:35.744 18:54:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.744 18:54:56 -- accel/accel.sh@20 -- # IFS=: 00:06:35.744 18:54:56 -- accel/accel.sh@20 -- # read -r var val 00:06:35.744 18:54:56 -- accel/accel.sh@21 -- # val= 00:06:35.744 18:54:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.744 18:54:56 -- accel/accel.sh@20 -- # IFS=: 00:06:35.744 18:54:56 -- accel/accel.sh@20 -- # read -r var val 00:06:35.744 18:54:56 -- accel/accel.sh@21 -- # val= 00:06:35.744 18:54:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.744 18:54:56 -- accel/accel.sh@20 -- # IFS=: 00:06:35.744 18:54:56 -- accel/accel.sh@20 -- # read -r var val 00:06:35.744 18:54:56 -- accel/accel.sh@21 -- # val= 00:06:35.744 18:54:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.744 18:54:56 -- accel/accel.sh@20 -- # IFS=: 00:06:35.744 18:54:56 -- accel/accel.sh@20 -- # read -r var val 00:06:35.744 18:54:56 -- accel/accel.sh@21 -- # val= 00:06:35.744 18:54:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.744 18:54:56 -- accel/accel.sh@20 -- # IFS=: 00:06:35.744 18:54:56 -- accel/accel.sh@20 -- # read -r var val 00:06:35.744 18:54:56 -- accel/accel.sh@21 -- # val= 00:06:35.744 18:54:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.744 18:54:56 -- accel/accel.sh@20 -- # IFS=: 00:06:35.744 18:54:56 -- accel/accel.sh@20 -- # read -r var val 00:06:35.744 18:54:56 -- accel/accel.sh@21 -- # val= 00:06:35.744 18:54:56 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.744 18:54:56 -- accel/accel.sh@20 -- # IFS=: 00:06:35.744 18:54:56 -- accel/accel.sh@20 -- # read -r var val 00:06:35.744 18:54:56 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:35.744 18:54:56 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:35.744 18:54:56 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:35.744 00:06:35.744 real 0m3.025s 00:06:35.744 user 0m2.723s 00:06:35.744 sys 0m0.294s 00:06:35.744 18:54:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:35.744 18:54:56 -- common/autotest_common.sh@10 -- # set +x 00:06:35.744 ************************************ 00:06:35.744 END TEST accel_deomp_full_mthread 00:06:35.744 ************************************ 00:06:35.744 18:54:56 -- accel/accel.sh@116 -- # [[ n == y ]] 00:06:35.744 18:54:56 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:35.744 18:54:56 -- accel/accel.sh@129 -- # build_accel_config 00:06:35.744 18:54:56 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:35.744 18:54:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:35.744 18:54:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:35.744 18:54:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:35.744 18:54:56 -- common/autotest_common.sh@10 -- # set +x 00:06:35.744 18:54:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:35.744 18:54:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:35.744 18:54:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:35.744 18:54:56 -- accel/accel.sh@41 -- # local IFS=, 00:06:35.744 18:54:56 -- accel/accel.sh@42 -- # jq -r . 00:06:35.744 ************************************ 00:06:35.744 START TEST accel_dif_functional_tests 00:06:35.744 ************************************ 00:06:35.744 18:54:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:35.744 [2024-11-28 18:54:56.461705] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:35.744 [2024-11-28 18:54:56.461777] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid99279 ] 00:06:35.744 EAL: No free 2048 kB hugepages reported on node 1 00:06:35.744 [2024-11-28 18:54:56.522820] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:35.744 [2024-11-28 18:54:56.639428] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:35.744 [2024-11-28 18:54:56.639462] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:35.744 [2024-11-28 18:54:56.639466] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:35.744 00:06:35.744 00:06:35.744 CUnit - A unit testing framework for C - Version 2.1-3 00:06:35.744 http://cunit.sourceforge.net/ 00:06:35.744 00:06:35.744 00:06:35.744 Suite: accel_dif 00:06:35.744 Test: verify: DIF generated, GUARD check ...passed 00:06:35.744 Test: verify: DIF generated, APPTAG check ...passed 00:06:35.744 Test: verify: DIF generated, REFTAG check ...passed 00:06:35.744 Test: verify: DIF not generated, GUARD check ...[2024-11-28 18:54:56.728954] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:35.744 [2024-11-28 18:54:56.729034] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:35.744 passed 00:06:35.744 Test: verify: DIF not generated, APPTAG check ...[2024-11-28 18:54:56.729071] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:35.744 [2024-11-28 18:54:56.729097] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:35.744 passed 00:06:35.744 Test: verify: DIF not generated, REFTAG check ...[2024-11-28 18:54:56.729142] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:35.744 [2024-11-28 18:54:56.729167] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:35.744 passed 00:06:35.744 Test: verify: APPTAG correct, APPTAG check ...passed 00:06:35.744 Test: verify: APPTAG incorrect, APPTAG check ...[2024-11-28 18:54:56.729229] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:06:35.744 passed 00:06:35.744 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:06:35.744 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:06:35.744 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:06:35.744 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-11-28 18:54:56.729361] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:06:35.744 passed 00:06:35.744 Test: generate copy: DIF generated, GUARD check ...passed 00:06:35.744 Test: generate copy: DIF generated, APTTAG check ...passed 00:06:35.744 Test: generate copy: DIF generated, REFTAG check ...passed 00:06:35.744 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:06:35.744 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:06:35.744 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:06:35.744 Test: generate copy: iovecs-len validate ...[2024-11-28 18:54:56.729623] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:06:35.744 passed 00:06:35.744 Test: generate copy: buffer alignment validate ...passed 00:06:35.744 00:06:35.744 Run Summary: Type Total Ran Passed Failed Inactive 00:06:35.744 suites 1 1 n/a 0 0 00:06:35.744 tests 20 20 20 0 0 00:06:35.744 asserts 204 204 204 0 n/a 00:06:35.744 00:06:35.744 Elapsed time = 0.002 seconds 00:06:36.004 00:06:36.004 real 0m0.565s 00:06:36.004 user 0m0.852s 00:06:36.004 sys 0m0.173s 00:06:36.004 18:54:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:36.004 18:54:56 -- common/autotest_common.sh@10 -- # set +x 00:06:36.004 ************************************ 00:06:36.004 END TEST accel_dif_functional_tests 00:06:36.004 ************************************ 00:06:36.004 00:06:36.004 real 1m2.927s 00:06:36.004 user 1m10.597s 00:06:36.004 sys 0m7.295s 00:06:36.004 18:54:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:36.004 18:54:57 -- common/autotest_common.sh@10 -- # set +x 00:06:36.004 ************************************ 00:06:36.004 END TEST accel 00:06:36.004 ************************************ 00:06:36.004 18:54:57 -- spdk/autotest.sh@177 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:36.004 18:54:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:36.004 18:54:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:36.004 18:54:57 -- common/autotest_common.sh@10 -- # set +x 00:06:36.004 ************************************ 00:06:36.004 START TEST accel_rpc 00:06:36.004 ************************************ 00:06:36.004 18:54:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:36.262 * Looking for test storage... 00:06:36.262 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:36.262 18:54:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:36.262 18:54:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:36.262 18:54:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:36.262 18:54:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:36.262 18:54:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:36.263 18:54:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:36.263 18:54:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:36.263 18:54:57 -- scripts/common.sh@335 -- # IFS=.-: 00:06:36.263 18:54:57 -- scripts/common.sh@335 -- # read -ra ver1 00:06:36.263 18:54:57 -- scripts/common.sh@336 -- # IFS=.-: 00:06:36.263 18:54:57 -- scripts/common.sh@336 -- # read -ra ver2 00:06:36.263 18:54:57 -- scripts/common.sh@337 -- # local 'op=<' 00:06:36.263 18:54:57 -- scripts/common.sh@339 -- # ver1_l=2 00:06:36.263 18:54:57 -- scripts/common.sh@340 -- # ver2_l=1 00:06:36.263 18:54:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:36.263 18:54:57 -- scripts/common.sh@343 -- # case "$op" in 00:06:36.263 18:54:57 -- scripts/common.sh@344 -- # : 1 00:06:36.263 18:54:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:36.263 18:54:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:36.263 18:54:57 -- scripts/common.sh@364 -- # decimal 1 00:06:36.263 18:54:57 -- scripts/common.sh@352 -- # local d=1 00:06:36.263 18:54:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:36.263 18:54:57 -- scripts/common.sh@354 -- # echo 1 00:06:36.263 18:54:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:36.263 18:54:57 -- scripts/common.sh@365 -- # decimal 2 00:06:36.263 18:54:57 -- scripts/common.sh@352 -- # local d=2 00:06:36.263 18:54:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:36.263 18:54:57 -- scripts/common.sh@354 -- # echo 2 00:06:36.263 18:54:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:36.263 18:54:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:36.263 18:54:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:36.263 18:54:57 -- scripts/common.sh@367 -- # return 0 00:06:36.263 18:54:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:36.263 18:54:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:36.263 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:36.263 --rc genhtml_branch_coverage=1 00:06:36.263 --rc genhtml_function_coverage=1 00:06:36.263 --rc genhtml_legend=1 00:06:36.263 --rc geninfo_all_blocks=1 00:06:36.263 --rc geninfo_unexecuted_blocks=1 00:06:36.263 00:06:36.263 ' 00:06:36.263 18:54:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:36.263 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:36.263 --rc genhtml_branch_coverage=1 00:06:36.263 --rc genhtml_function_coverage=1 00:06:36.263 --rc genhtml_legend=1 00:06:36.263 --rc geninfo_all_blocks=1 00:06:36.263 --rc geninfo_unexecuted_blocks=1 00:06:36.263 00:06:36.263 ' 00:06:36.263 18:54:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:36.263 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:36.263 --rc genhtml_branch_coverage=1 00:06:36.263 --rc genhtml_function_coverage=1 00:06:36.263 --rc genhtml_legend=1 00:06:36.263 --rc geninfo_all_blocks=1 00:06:36.263 --rc geninfo_unexecuted_blocks=1 00:06:36.263 00:06:36.263 ' 00:06:36.263 18:54:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:36.263 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:36.263 --rc genhtml_branch_coverage=1 00:06:36.263 --rc genhtml_function_coverage=1 00:06:36.263 --rc genhtml_legend=1 00:06:36.263 --rc geninfo_all_blocks=1 00:06:36.263 --rc geninfo_unexecuted_blocks=1 00:06:36.263 00:06:36.263 ' 00:06:36.263 18:54:57 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:36.263 18:54:57 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=99360 00:06:36.263 18:54:57 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:06:36.263 18:54:57 -- accel/accel_rpc.sh@15 -- # waitforlisten 99360 00:06:36.263 18:54:57 -- common/autotest_common.sh@829 -- # '[' -z 99360 ']' 00:06:36.263 18:54:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:36.263 18:54:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:36.263 18:54:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:36.263 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:36.263 18:54:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:36.263 18:54:57 -- common/autotest_common.sh@10 -- # set +x 00:06:36.263 [2024-11-28 18:54:57.232044] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:36.263 [2024-11-28 18:54:57.232143] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid99360 ] 00:06:36.263 EAL: No free 2048 kB hugepages reported on node 1 00:06:36.263 [2024-11-28 18:54:57.289615] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:36.522 [2024-11-28 18:54:57.394476] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:36.522 [2024-11-28 18:54:57.394644] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:36.522 18:54:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:36.522 18:54:57 -- common/autotest_common.sh@862 -- # return 0 00:06:36.522 18:54:57 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:06:36.522 18:54:57 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:06:36.522 18:54:57 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:06:36.522 18:54:57 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:06:36.522 18:54:57 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:06:36.522 18:54:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:36.522 18:54:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:36.522 18:54:57 -- common/autotest_common.sh@10 -- # set +x 00:06:36.522 ************************************ 00:06:36.522 START TEST accel_assign_opcode 00:06:36.522 ************************************ 00:06:36.522 18:54:57 -- common/autotest_common.sh@1114 -- # accel_assign_opcode_test_suite 00:06:36.522 18:54:57 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:06:36.522 18:54:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:36.522 18:54:57 -- common/autotest_common.sh@10 -- # set +x 00:06:36.522 [2024-11-28 18:54:57.451201] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:06:36.522 18:54:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:36.522 18:54:57 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:06:36.522 18:54:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:36.522 18:54:57 -- common/autotest_common.sh@10 -- # set +x 00:06:36.522 [2024-11-28 18:54:57.459215] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:06:36.522 18:54:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:36.522 18:54:57 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:06:36.522 18:54:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:36.522 18:54:57 -- common/autotest_common.sh@10 -- # set +x 00:06:36.781 18:54:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:36.781 18:54:57 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:06:36.781 18:54:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:36.781 18:54:57 -- common/autotest_common.sh@10 -- # set +x 00:06:36.781 18:54:57 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:06:36.781 18:54:57 -- accel/accel_rpc.sh@42 -- # grep software 00:06:36.781 18:54:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:36.781 software 00:06:36.781 00:06:36.781 real 0m0.297s 00:06:36.781 user 0m0.042s 00:06:36.781 sys 0m0.005s 00:06:36.781 18:54:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:36.781 18:54:57 -- common/autotest_common.sh@10 -- # set +x 00:06:36.781 ************************************ 00:06:36.781 END TEST accel_assign_opcode 00:06:36.781 ************************************ 00:06:36.781 18:54:57 -- accel/accel_rpc.sh@55 -- # killprocess 99360 00:06:36.781 18:54:57 -- common/autotest_common.sh@936 -- # '[' -z 99360 ']' 00:06:36.781 18:54:57 -- common/autotest_common.sh@940 -- # kill -0 99360 00:06:36.781 18:54:57 -- common/autotest_common.sh@941 -- # uname 00:06:36.781 18:54:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:36.781 18:54:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 99360 00:06:36.781 18:54:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:36.781 18:54:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:36.781 18:54:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 99360' 00:06:36.781 killing process with pid 99360 00:06:36.781 18:54:57 -- common/autotest_common.sh@955 -- # kill 99360 00:06:36.781 18:54:57 -- common/autotest_common.sh@960 -- # wait 99360 00:06:37.347 00:06:37.347 real 0m1.214s 00:06:37.347 user 0m1.136s 00:06:37.347 sys 0m0.433s 00:06:37.347 18:54:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:37.347 18:54:58 -- common/autotest_common.sh@10 -- # set +x 00:06:37.347 ************************************ 00:06:37.347 END TEST accel_rpc 00:06:37.347 ************************************ 00:06:37.347 18:54:58 -- spdk/autotest.sh@178 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:37.347 18:54:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:37.347 18:54:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:37.347 18:54:58 -- common/autotest_common.sh@10 -- # set +x 00:06:37.347 ************************************ 00:06:37.347 START TEST app_cmdline 00:06:37.347 ************************************ 00:06:37.347 18:54:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:37.347 * Looking for test storage... 00:06:37.347 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:37.347 18:54:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:37.347 18:54:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:37.347 18:54:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:37.606 18:54:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:37.606 18:54:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:37.606 18:54:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:37.606 18:54:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:37.606 18:54:58 -- scripts/common.sh@335 -- # IFS=.-: 00:06:37.606 18:54:58 -- scripts/common.sh@335 -- # read -ra ver1 00:06:37.606 18:54:58 -- scripts/common.sh@336 -- # IFS=.-: 00:06:37.606 18:54:58 -- scripts/common.sh@336 -- # read -ra ver2 00:06:37.606 18:54:58 -- scripts/common.sh@337 -- # local 'op=<' 00:06:37.606 18:54:58 -- scripts/common.sh@339 -- # ver1_l=2 00:06:37.606 18:54:58 -- scripts/common.sh@340 -- # ver2_l=1 00:06:37.606 18:54:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:37.606 18:54:58 -- scripts/common.sh@343 -- # case "$op" in 00:06:37.606 18:54:58 -- scripts/common.sh@344 -- # : 1 00:06:37.606 18:54:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:37.606 18:54:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:37.606 18:54:58 -- scripts/common.sh@364 -- # decimal 1 00:06:37.606 18:54:58 -- scripts/common.sh@352 -- # local d=1 00:06:37.606 18:54:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:37.606 18:54:58 -- scripts/common.sh@354 -- # echo 1 00:06:37.606 18:54:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:37.606 18:54:58 -- scripts/common.sh@365 -- # decimal 2 00:06:37.606 18:54:58 -- scripts/common.sh@352 -- # local d=2 00:06:37.606 18:54:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:37.606 18:54:58 -- scripts/common.sh@354 -- # echo 2 00:06:37.606 18:54:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:37.606 18:54:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:37.606 18:54:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:37.606 18:54:58 -- scripts/common.sh@367 -- # return 0 00:06:37.606 18:54:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:37.606 18:54:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:37.606 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:37.606 --rc genhtml_branch_coverage=1 00:06:37.606 --rc genhtml_function_coverage=1 00:06:37.606 --rc genhtml_legend=1 00:06:37.606 --rc geninfo_all_blocks=1 00:06:37.606 --rc geninfo_unexecuted_blocks=1 00:06:37.606 00:06:37.606 ' 00:06:37.606 18:54:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:37.606 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:37.606 --rc genhtml_branch_coverage=1 00:06:37.606 --rc genhtml_function_coverage=1 00:06:37.606 --rc genhtml_legend=1 00:06:37.606 --rc geninfo_all_blocks=1 00:06:37.606 --rc geninfo_unexecuted_blocks=1 00:06:37.606 00:06:37.606 ' 00:06:37.606 18:54:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:37.606 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:37.606 --rc genhtml_branch_coverage=1 00:06:37.606 --rc genhtml_function_coverage=1 00:06:37.606 --rc genhtml_legend=1 00:06:37.606 --rc geninfo_all_blocks=1 00:06:37.606 --rc geninfo_unexecuted_blocks=1 00:06:37.606 00:06:37.606 ' 00:06:37.606 18:54:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:37.606 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:37.606 --rc genhtml_branch_coverage=1 00:06:37.606 --rc genhtml_function_coverage=1 00:06:37.606 --rc genhtml_legend=1 00:06:37.606 --rc geninfo_all_blocks=1 00:06:37.606 --rc geninfo_unexecuted_blocks=1 00:06:37.606 00:06:37.606 ' 00:06:37.606 18:54:58 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:06:37.606 18:54:58 -- app/cmdline.sh@17 -- # spdk_tgt_pid=99572 00:06:37.606 18:54:58 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:06:37.606 18:54:58 -- app/cmdline.sh@18 -- # waitforlisten 99572 00:06:37.606 18:54:58 -- common/autotest_common.sh@829 -- # '[' -z 99572 ']' 00:06:37.606 18:54:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:37.606 18:54:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:37.606 18:54:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:37.606 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:37.606 18:54:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:37.606 18:54:58 -- common/autotest_common.sh@10 -- # set +x 00:06:37.606 [2024-11-28 18:54:58.474903] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:37.606 [2024-11-28 18:54:58.474998] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid99572 ] 00:06:37.606 EAL: No free 2048 kB hugepages reported on node 1 00:06:37.606 [2024-11-28 18:54:58.532347] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:37.606 [2024-11-28 18:54:58.639444] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:37.606 [2024-11-28 18:54:58.639617] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:38.541 18:54:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:38.541 18:54:59 -- common/autotest_common.sh@862 -- # return 0 00:06:38.541 18:54:59 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:06:38.800 { 00:06:38.800 "version": "SPDK v24.01.1-pre git sha1 c13c99a5e", 00:06:38.800 "fields": { 00:06:38.800 "major": 24, 00:06:38.800 "minor": 1, 00:06:38.800 "patch": 1, 00:06:38.800 "suffix": "-pre", 00:06:38.800 "commit": "c13c99a5e" 00:06:38.800 } 00:06:38.800 } 00:06:38.800 18:54:59 -- app/cmdline.sh@22 -- # expected_methods=() 00:06:38.800 18:54:59 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:06:38.800 18:54:59 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:06:38.800 18:54:59 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:06:38.800 18:54:59 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:06:38.800 18:54:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:38.800 18:54:59 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:06:38.800 18:54:59 -- common/autotest_common.sh@10 -- # set +x 00:06:38.800 18:54:59 -- app/cmdline.sh@26 -- # sort 00:06:38.800 18:54:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:38.800 18:54:59 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:06:38.800 18:54:59 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:06:38.800 18:54:59 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:38.800 18:54:59 -- common/autotest_common.sh@650 -- # local es=0 00:06:38.800 18:54:59 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:38.800 18:54:59 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:38.800 18:54:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:38.800 18:54:59 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:38.800 18:54:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:38.800 18:54:59 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:38.800 18:54:59 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:38.800 18:54:59 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:38.800 18:54:59 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:06:38.800 18:54:59 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:39.058 request: 00:06:39.058 { 00:06:39.058 "method": "env_dpdk_get_mem_stats", 00:06:39.058 "req_id": 1 00:06:39.058 } 00:06:39.058 Got JSON-RPC error response 00:06:39.058 response: 00:06:39.058 { 00:06:39.058 "code": -32601, 00:06:39.058 "message": "Method not found" 00:06:39.058 } 00:06:39.058 18:55:00 -- common/autotest_common.sh@653 -- # es=1 00:06:39.058 18:55:00 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:39.058 18:55:00 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:39.058 18:55:00 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:39.058 18:55:00 -- app/cmdline.sh@1 -- # killprocess 99572 00:06:39.058 18:55:00 -- common/autotest_common.sh@936 -- # '[' -z 99572 ']' 00:06:39.058 18:55:00 -- common/autotest_common.sh@940 -- # kill -0 99572 00:06:39.058 18:55:00 -- common/autotest_common.sh@941 -- # uname 00:06:39.058 18:55:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:39.058 18:55:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 99572 00:06:39.058 18:55:00 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:39.058 18:55:00 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:39.058 18:55:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 99572' 00:06:39.058 killing process with pid 99572 00:06:39.058 18:55:00 -- common/autotest_common.sh@955 -- # kill 99572 00:06:39.058 18:55:00 -- common/autotest_common.sh@960 -- # wait 99572 00:06:39.625 00:06:39.625 real 0m2.266s 00:06:39.625 user 0m2.886s 00:06:39.626 sys 0m0.511s 00:06:39.626 18:55:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:39.626 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:06:39.626 ************************************ 00:06:39.626 END TEST app_cmdline 00:06:39.626 ************************************ 00:06:39.626 18:55:00 -- spdk/autotest.sh@179 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:39.626 18:55:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:39.626 18:55:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:39.626 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:06:39.626 ************************************ 00:06:39.626 START TEST version 00:06:39.626 ************************************ 00:06:39.626 18:55:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:39.626 * Looking for test storage... 00:06:39.626 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:39.626 18:55:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:39.626 18:55:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:39.626 18:55:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:39.885 18:55:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:39.885 18:55:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:39.885 18:55:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:39.885 18:55:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:39.885 18:55:00 -- scripts/common.sh@335 -- # IFS=.-: 00:06:39.885 18:55:00 -- scripts/common.sh@335 -- # read -ra ver1 00:06:39.885 18:55:00 -- scripts/common.sh@336 -- # IFS=.-: 00:06:39.885 18:55:00 -- scripts/common.sh@336 -- # read -ra ver2 00:06:39.885 18:55:00 -- scripts/common.sh@337 -- # local 'op=<' 00:06:39.885 18:55:00 -- scripts/common.sh@339 -- # ver1_l=2 00:06:39.885 18:55:00 -- scripts/common.sh@340 -- # ver2_l=1 00:06:39.885 18:55:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:39.885 18:55:00 -- scripts/common.sh@343 -- # case "$op" in 00:06:39.885 18:55:00 -- scripts/common.sh@344 -- # : 1 00:06:39.885 18:55:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:39.885 18:55:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:39.885 18:55:00 -- scripts/common.sh@364 -- # decimal 1 00:06:39.885 18:55:00 -- scripts/common.sh@352 -- # local d=1 00:06:39.885 18:55:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:39.885 18:55:00 -- scripts/common.sh@354 -- # echo 1 00:06:39.885 18:55:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:39.885 18:55:00 -- scripts/common.sh@365 -- # decimal 2 00:06:39.885 18:55:00 -- scripts/common.sh@352 -- # local d=2 00:06:39.885 18:55:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:39.885 18:55:00 -- scripts/common.sh@354 -- # echo 2 00:06:39.885 18:55:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:39.885 18:55:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:39.885 18:55:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:39.885 18:55:00 -- scripts/common.sh@367 -- # return 0 00:06:39.885 18:55:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:39.885 18:55:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:39.885 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:39.885 --rc genhtml_branch_coverage=1 00:06:39.885 --rc genhtml_function_coverage=1 00:06:39.885 --rc genhtml_legend=1 00:06:39.885 --rc geninfo_all_blocks=1 00:06:39.885 --rc geninfo_unexecuted_blocks=1 00:06:39.885 00:06:39.885 ' 00:06:39.885 18:55:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:39.885 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:39.885 --rc genhtml_branch_coverage=1 00:06:39.885 --rc genhtml_function_coverage=1 00:06:39.885 --rc genhtml_legend=1 00:06:39.885 --rc geninfo_all_blocks=1 00:06:39.885 --rc geninfo_unexecuted_blocks=1 00:06:39.885 00:06:39.885 ' 00:06:39.885 18:55:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:39.885 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:39.885 --rc genhtml_branch_coverage=1 00:06:39.885 --rc genhtml_function_coverage=1 00:06:39.885 --rc genhtml_legend=1 00:06:39.885 --rc geninfo_all_blocks=1 00:06:39.885 --rc geninfo_unexecuted_blocks=1 00:06:39.885 00:06:39.885 ' 00:06:39.885 18:55:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:39.885 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:39.885 --rc genhtml_branch_coverage=1 00:06:39.885 --rc genhtml_function_coverage=1 00:06:39.885 --rc genhtml_legend=1 00:06:39.885 --rc geninfo_all_blocks=1 00:06:39.885 --rc geninfo_unexecuted_blocks=1 00:06:39.885 00:06:39.885 ' 00:06:39.885 18:55:00 -- app/version.sh@17 -- # get_header_version major 00:06:39.885 18:55:00 -- app/version.sh@14 -- # cut -f2 00:06:39.885 18:55:00 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:39.885 18:55:00 -- app/version.sh@14 -- # tr -d '"' 00:06:39.885 18:55:00 -- app/version.sh@17 -- # major=24 00:06:39.885 18:55:00 -- app/version.sh@18 -- # get_header_version minor 00:06:39.885 18:55:00 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:39.885 18:55:00 -- app/version.sh@14 -- # cut -f2 00:06:39.885 18:55:00 -- app/version.sh@14 -- # tr -d '"' 00:06:39.885 18:55:00 -- app/version.sh@18 -- # minor=1 00:06:39.885 18:55:00 -- app/version.sh@19 -- # get_header_version patch 00:06:39.885 18:55:00 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:39.885 18:55:00 -- app/version.sh@14 -- # cut -f2 00:06:39.885 18:55:00 -- app/version.sh@14 -- # tr -d '"' 00:06:39.885 18:55:00 -- app/version.sh@19 -- # patch=1 00:06:39.885 18:55:00 -- app/version.sh@20 -- # get_header_version suffix 00:06:39.885 18:55:00 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:39.885 18:55:00 -- app/version.sh@14 -- # cut -f2 00:06:39.885 18:55:00 -- app/version.sh@14 -- # tr -d '"' 00:06:39.885 18:55:00 -- app/version.sh@20 -- # suffix=-pre 00:06:39.885 18:55:00 -- app/version.sh@22 -- # version=24.1 00:06:39.885 18:55:00 -- app/version.sh@25 -- # (( patch != 0 )) 00:06:39.885 18:55:00 -- app/version.sh@25 -- # version=24.1.1 00:06:39.886 18:55:00 -- app/version.sh@28 -- # version=24.1.1rc0 00:06:39.886 18:55:00 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:39.886 18:55:00 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:06:39.886 18:55:00 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:06:39.886 18:55:00 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:06:39.886 00:06:39.886 real 0m0.192s 00:06:39.886 user 0m0.129s 00:06:39.886 sys 0m0.089s 00:06:39.886 18:55:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:39.886 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:06:39.886 ************************************ 00:06:39.886 END TEST version 00:06:39.886 ************************************ 00:06:39.886 18:55:00 -- spdk/autotest.sh@181 -- # '[' 0 -eq 1 ']' 00:06:39.886 18:55:00 -- spdk/autotest.sh@191 -- # uname -s 00:06:39.886 18:55:00 -- spdk/autotest.sh@191 -- # [[ Linux == Linux ]] 00:06:39.886 18:55:00 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:39.886 18:55:00 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:39.886 18:55:00 -- spdk/autotest.sh@204 -- # '[' 0 -eq 1 ']' 00:06:39.886 18:55:00 -- spdk/autotest.sh@251 -- # '[' 0 -eq 1 ']' 00:06:39.886 18:55:00 -- spdk/autotest.sh@255 -- # timing_exit lib 00:06:39.886 18:55:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:39.886 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:06:39.886 18:55:00 -- spdk/autotest.sh@257 -- # '[' 0 -eq 1 ']' 00:06:39.886 18:55:00 -- spdk/autotest.sh@265 -- # '[' 0 -eq 1 ']' 00:06:39.886 18:55:00 -- spdk/autotest.sh@274 -- # '[' 1 -eq 1 ']' 00:06:39.886 18:55:00 -- spdk/autotest.sh@275 -- # export NET_TYPE 00:06:39.886 18:55:00 -- spdk/autotest.sh@278 -- # '[' tcp = rdma ']' 00:06:39.886 18:55:00 -- spdk/autotest.sh@281 -- # '[' tcp = tcp ']' 00:06:39.886 18:55:00 -- spdk/autotest.sh@282 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:39.886 18:55:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:39.886 18:55:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:39.886 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:06:39.886 ************************************ 00:06:39.886 START TEST nvmf_tcp 00:06:39.886 ************************************ 00:06:39.886 18:55:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:39.886 * Looking for test storage... 00:06:39.886 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:06:39.886 18:55:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:39.886 18:55:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:39.886 18:55:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:40.147 18:55:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:40.147 18:55:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:40.147 18:55:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:40.147 18:55:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:40.147 18:55:00 -- scripts/common.sh@335 -- # IFS=.-: 00:06:40.147 18:55:00 -- scripts/common.sh@335 -- # read -ra ver1 00:06:40.147 18:55:00 -- scripts/common.sh@336 -- # IFS=.-: 00:06:40.147 18:55:00 -- scripts/common.sh@336 -- # read -ra ver2 00:06:40.147 18:55:00 -- scripts/common.sh@337 -- # local 'op=<' 00:06:40.147 18:55:00 -- scripts/common.sh@339 -- # ver1_l=2 00:06:40.147 18:55:00 -- scripts/common.sh@340 -- # ver2_l=1 00:06:40.147 18:55:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:40.147 18:55:00 -- scripts/common.sh@343 -- # case "$op" in 00:06:40.147 18:55:00 -- scripts/common.sh@344 -- # : 1 00:06:40.147 18:55:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:40.147 18:55:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:40.147 18:55:00 -- scripts/common.sh@364 -- # decimal 1 00:06:40.147 18:55:00 -- scripts/common.sh@352 -- # local d=1 00:06:40.147 18:55:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:40.147 18:55:00 -- scripts/common.sh@354 -- # echo 1 00:06:40.147 18:55:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:40.147 18:55:00 -- scripts/common.sh@365 -- # decimal 2 00:06:40.147 18:55:00 -- scripts/common.sh@352 -- # local d=2 00:06:40.147 18:55:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:40.147 18:55:00 -- scripts/common.sh@354 -- # echo 2 00:06:40.147 18:55:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:40.147 18:55:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:40.147 18:55:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:40.147 18:55:00 -- scripts/common.sh@367 -- # return 0 00:06:40.147 18:55:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:40.147 18:55:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:40.147 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:40.147 --rc genhtml_branch_coverage=1 00:06:40.147 --rc genhtml_function_coverage=1 00:06:40.147 --rc genhtml_legend=1 00:06:40.147 --rc geninfo_all_blocks=1 00:06:40.147 --rc geninfo_unexecuted_blocks=1 00:06:40.147 00:06:40.147 ' 00:06:40.147 18:55:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:40.147 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:40.147 --rc genhtml_branch_coverage=1 00:06:40.147 --rc genhtml_function_coverage=1 00:06:40.147 --rc genhtml_legend=1 00:06:40.147 --rc geninfo_all_blocks=1 00:06:40.147 --rc geninfo_unexecuted_blocks=1 00:06:40.147 00:06:40.147 ' 00:06:40.147 18:55:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:40.147 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:40.147 --rc genhtml_branch_coverage=1 00:06:40.147 --rc genhtml_function_coverage=1 00:06:40.147 --rc genhtml_legend=1 00:06:40.147 --rc geninfo_all_blocks=1 00:06:40.147 --rc geninfo_unexecuted_blocks=1 00:06:40.147 00:06:40.147 ' 00:06:40.147 18:55:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:40.147 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:40.147 --rc genhtml_branch_coverage=1 00:06:40.147 --rc genhtml_function_coverage=1 00:06:40.147 --rc genhtml_legend=1 00:06:40.147 --rc geninfo_all_blocks=1 00:06:40.147 --rc geninfo_unexecuted_blocks=1 00:06:40.147 00:06:40.147 ' 00:06:40.147 18:55:00 -- nvmf/nvmf.sh@10 -- # uname -s 00:06:40.147 18:55:00 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:06:40.147 18:55:00 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:40.147 18:55:00 -- nvmf/common.sh@7 -- # uname -s 00:06:40.147 18:55:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:40.147 18:55:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:40.147 18:55:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:40.147 18:55:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:40.148 18:55:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:40.148 18:55:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:40.148 18:55:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:40.148 18:55:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:40.148 18:55:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:40.148 18:55:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:40.148 18:55:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:40.148 18:55:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:40.148 18:55:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:40.148 18:55:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:40.148 18:55:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:40.148 18:55:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:40.148 18:55:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:40.148 18:55:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:40.148 18:55:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:40.148 18:55:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:40.148 18:55:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:40.148 18:55:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:40.148 18:55:00 -- paths/export.sh@5 -- # export PATH 00:06:40.148 18:55:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:40.148 18:55:00 -- nvmf/common.sh@46 -- # : 0 00:06:40.148 18:55:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:40.148 18:55:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:40.148 18:55:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:40.148 18:55:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:40.148 18:55:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:40.148 18:55:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:40.148 18:55:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:40.148 18:55:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:40.148 18:55:00 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:06:40.148 18:55:00 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:06:40.148 18:55:00 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:06:40.148 18:55:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:40.148 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:06:40.148 18:55:00 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:06:40.148 18:55:00 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:40.148 18:55:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:40.148 18:55:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:40.148 18:55:00 -- common/autotest_common.sh@10 -- # set +x 00:06:40.148 ************************************ 00:06:40.148 START TEST nvmf_example 00:06:40.148 ************************************ 00:06:40.148 18:55:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:40.148 * Looking for test storage... 00:06:40.148 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:40.148 18:55:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:40.148 18:55:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:40.148 18:55:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:40.148 18:55:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:40.148 18:55:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:40.148 18:55:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:40.148 18:55:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:40.148 18:55:01 -- scripts/common.sh@335 -- # IFS=.-: 00:06:40.148 18:55:01 -- scripts/common.sh@335 -- # read -ra ver1 00:06:40.148 18:55:01 -- scripts/common.sh@336 -- # IFS=.-: 00:06:40.148 18:55:01 -- scripts/common.sh@336 -- # read -ra ver2 00:06:40.148 18:55:01 -- scripts/common.sh@337 -- # local 'op=<' 00:06:40.148 18:55:01 -- scripts/common.sh@339 -- # ver1_l=2 00:06:40.148 18:55:01 -- scripts/common.sh@340 -- # ver2_l=1 00:06:40.148 18:55:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:40.148 18:55:01 -- scripts/common.sh@343 -- # case "$op" in 00:06:40.148 18:55:01 -- scripts/common.sh@344 -- # : 1 00:06:40.148 18:55:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:40.148 18:55:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:40.148 18:55:01 -- scripts/common.sh@364 -- # decimal 1 00:06:40.148 18:55:01 -- scripts/common.sh@352 -- # local d=1 00:06:40.148 18:55:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:40.148 18:55:01 -- scripts/common.sh@354 -- # echo 1 00:06:40.148 18:55:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:40.148 18:55:01 -- scripts/common.sh@365 -- # decimal 2 00:06:40.148 18:55:01 -- scripts/common.sh@352 -- # local d=2 00:06:40.148 18:55:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:40.148 18:55:01 -- scripts/common.sh@354 -- # echo 2 00:06:40.148 18:55:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:40.148 18:55:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:40.148 18:55:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:40.148 18:55:01 -- scripts/common.sh@367 -- # return 0 00:06:40.148 18:55:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:40.148 18:55:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:40.148 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:40.148 --rc genhtml_branch_coverage=1 00:06:40.148 --rc genhtml_function_coverage=1 00:06:40.148 --rc genhtml_legend=1 00:06:40.148 --rc geninfo_all_blocks=1 00:06:40.148 --rc geninfo_unexecuted_blocks=1 00:06:40.148 00:06:40.148 ' 00:06:40.148 18:55:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:40.148 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:40.148 --rc genhtml_branch_coverage=1 00:06:40.148 --rc genhtml_function_coverage=1 00:06:40.148 --rc genhtml_legend=1 00:06:40.148 --rc geninfo_all_blocks=1 00:06:40.148 --rc geninfo_unexecuted_blocks=1 00:06:40.148 00:06:40.148 ' 00:06:40.148 18:55:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:40.148 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:40.148 --rc genhtml_branch_coverage=1 00:06:40.148 --rc genhtml_function_coverage=1 00:06:40.148 --rc genhtml_legend=1 00:06:40.148 --rc geninfo_all_blocks=1 00:06:40.148 --rc geninfo_unexecuted_blocks=1 00:06:40.148 00:06:40.148 ' 00:06:40.148 18:55:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:40.148 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:40.148 --rc genhtml_branch_coverage=1 00:06:40.148 --rc genhtml_function_coverage=1 00:06:40.148 --rc genhtml_legend=1 00:06:40.148 --rc geninfo_all_blocks=1 00:06:40.148 --rc geninfo_unexecuted_blocks=1 00:06:40.148 00:06:40.148 ' 00:06:40.148 18:55:01 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:40.148 18:55:01 -- nvmf/common.sh@7 -- # uname -s 00:06:40.148 18:55:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:40.148 18:55:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:40.148 18:55:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:40.148 18:55:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:40.148 18:55:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:40.148 18:55:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:40.148 18:55:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:40.148 18:55:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:40.148 18:55:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:40.148 18:55:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:40.148 18:55:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:40.148 18:55:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:40.148 18:55:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:40.148 18:55:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:40.148 18:55:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:40.148 18:55:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:40.148 18:55:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:40.148 18:55:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:40.148 18:55:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:40.148 18:55:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:40.148 18:55:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:40.149 18:55:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:40.149 18:55:01 -- paths/export.sh@5 -- # export PATH 00:06:40.149 18:55:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:40.149 18:55:01 -- nvmf/common.sh@46 -- # : 0 00:06:40.149 18:55:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:40.149 18:55:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:40.149 18:55:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:40.149 18:55:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:40.149 18:55:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:40.149 18:55:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:40.149 18:55:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:40.149 18:55:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:40.149 18:55:01 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:06:40.149 18:55:01 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:06:40.149 18:55:01 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:06:40.149 18:55:01 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:06:40.149 18:55:01 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:06:40.149 18:55:01 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:06:40.149 18:55:01 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:06:40.149 18:55:01 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:06:40.149 18:55:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:40.149 18:55:01 -- common/autotest_common.sh@10 -- # set +x 00:06:40.149 18:55:01 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:06:40.149 18:55:01 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:40.149 18:55:01 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:40.149 18:55:01 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:40.149 18:55:01 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:40.149 18:55:01 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:40.149 18:55:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:40.149 18:55:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:40.149 18:55:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:40.149 18:55:01 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:40.149 18:55:01 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:40.149 18:55:01 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:40.149 18:55:01 -- common/autotest_common.sh@10 -- # set +x 00:06:42.682 18:55:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:42.682 18:55:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:42.682 18:55:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:42.682 18:55:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:42.682 18:55:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:42.682 18:55:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:42.682 18:55:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:42.682 18:55:03 -- nvmf/common.sh@294 -- # net_devs=() 00:06:42.682 18:55:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:42.682 18:55:03 -- nvmf/common.sh@295 -- # e810=() 00:06:42.682 18:55:03 -- nvmf/common.sh@295 -- # local -ga e810 00:06:42.682 18:55:03 -- nvmf/common.sh@296 -- # x722=() 00:06:42.682 18:55:03 -- nvmf/common.sh@296 -- # local -ga x722 00:06:42.682 18:55:03 -- nvmf/common.sh@297 -- # mlx=() 00:06:42.682 18:55:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:42.682 18:55:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:42.682 18:55:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:42.682 18:55:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:42.682 18:55:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:42.682 18:55:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:42.682 18:55:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:42.683 18:55:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:42.683 18:55:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:42.683 18:55:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:42.683 18:55:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:42.683 18:55:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:42.683 18:55:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:42.683 18:55:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:42.683 18:55:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:42.683 18:55:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:42.683 18:55:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:42.683 18:55:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:42.683 18:55:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:42.683 18:55:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:42.683 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:42.683 18:55:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:42.683 18:55:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:42.683 18:55:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:42.683 18:55:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:42.683 18:55:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:42.683 18:55:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:42.683 18:55:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:42.683 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:42.683 18:55:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:42.683 18:55:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:42.683 18:55:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:42.683 18:55:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:42.683 18:55:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:42.683 18:55:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:42.683 18:55:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:42.683 18:55:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:42.683 18:55:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:42.683 18:55:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:42.683 18:55:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:42.683 18:55:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:42.683 18:55:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:42.683 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:42.683 18:55:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:42.683 18:55:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:42.683 18:55:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:42.683 18:55:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:42.683 18:55:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:42.683 18:55:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:42.683 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:42.683 18:55:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:42.683 18:55:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:42.683 18:55:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:42.683 18:55:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:42.683 18:55:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:42.683 18:55:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:42.683 18:55:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:42.683 18:55:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:42.683 18:55:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:42.683 18:55:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:42.683 18:55:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:42.683 18:55:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:42.683 18:55:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:42.683 18:55:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:42.683 18:55:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:42.683 18:55:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:42.683 18:55:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:42.683 18:55:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:42.683 18:55:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:42.683 18:55:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:42.683 18:55:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:42.683 18:55:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:42.683 18:55:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:42.683 18:55:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:42.683 18:55:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:42.683 18:55:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:42.683 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:42.683 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.224 ms 00:06:42.683 00:06:42.683 --- 10.0.0.2 ping statistics --- 00:06:42.683 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:42.683 rtt min/avg/max/mdev = 0.224/0.224/0.224/0.000 ms 00:06:42.683 18:55:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:42.683 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:42.683 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.105 ms 00:06:42.683 00:06:42.683 --- 10.0.0.1 ping statistics --- 00:06:42.683 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:42.683 rtt min/avg/max/mdev = 0.105/0.105/0.105/0.000 ms 00:06:42.683 18:55:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:42.683 18:55:03 -- nvmf/common.sh@410 -- # return 0 00:06:42.683 18:55:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:42.683 18:55:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:42.683 18:55:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:42.683 18:55:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:42.683 18:55:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:42.683 18:55:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:42.683 18:55:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:42.683 18:55:03 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:06:42.683 18:55:03 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:06:42.683 18:55:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:42.683 18:55:03 -- common/autotest_common.sh@10 -- # set +x 00:06:42.683 18:55:03 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:06:42.683 18:55:03 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:06:42.683 18:55:03 -- target/nvmf_example.sh@34 -- # nvmfpid=101760 00:06:42.683 18:55:03 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:06:42.683 18:55:03 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:06:42.683 18:55:03 -- target/nvmf_example.sh@36 -- # waitforlisten 101760 00:06:42.683 18:55:03 -- common/autotest_common.sh@829 -- # '[' -z 101760 ']' 00:06:42.683 18:55:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:42.683 18:55:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:42.683 18:55:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:42.683 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:42.683 18:55:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:42.683 18:55:03 -- common/autotest_common.sh@10 -- # set +x 00:06:42.683 EAL: No free 2048 kB hugepages reported on node 1 00:06:43.619 18:55:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:43.619 18:55:04 -- common/autotest_common.sh@862 -- # return 0 00:06:43.619 18:55:04 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:06:43.619 18:55:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:43.619 18:55:04 -- common/autotest_common.sh@10 -- # set +x 00:06:43.619 18:55:04 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:06:43.619 18:55:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:43.619 18:55:04 -- common/autotest_common.sh@10 -- # set +x 00:06:43.619 18:55:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:43.619 18:55:04 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:06:43.619 18:55:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:43.619 18:55:04 -- common/autotest_common.sh@10 -- # set +x 00:06:43.619 18:55:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:43.619 18:55:04 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:06:43.619 18:55:04 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:43.619 18:55:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:43.619 18:55:04 -- common/autotest_common.sh@10 -- # set +x 00:06:43.619 18:55:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:43.619 18:55:04 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:06:43.619 18:55:04 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:06:43.619 18:55:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:43.619 18:55:04 -- common/autotest_common.sh@10 -- # set +x 00:06:43.619 18:55:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:43.619 18:55:04 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:43.619 18:55:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:43.619 18:55:04 -- common/autotest_common.sh@10 -- # set +x 00:06:43.619 18:55:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:43.619 18:55:04 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:06:43.619 18:55:04 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:06:43.619 EAL: No free 2048 kB hugepages reported on node 1 00:06:55.822 Initializing NVMe Controllers 00:06:55.822 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:06:55.822 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:06:55.822 Initialization complete. Launching workers. 00:06:55.822 ======================================================== 00:06:55.822 Latency(us) 00:06:55.822 Device Information : IOPS MiB/s Average min max 00:06:55.822 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15313.63 59.82 4181.44 668.44 16349.81 00:06:55.822 ======================================================== 00:06:55.822 Total : 15313.63 59.82 4181.44 668.44 16349.81 00:06:55.822 00:06:55.822 18:55:14 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:06:55.822 18:55:14 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:06:55.822 18:55:14 -- nvmf/common.sh@476 -- # nvmfcleanup 00:06:55.822 18:55:14 -- nvmf/common.sh@116 -- # sync 00:06:55.822 18:55:14 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:06:55.822 18:55:14 -- nvmf/common.sh@119 -- # set +e 00:06:55.822 18:55:14 -- nvmf/common.sh@120 -- # for i in {1..20} 00:06:55.822 18:55:14 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:06:55.822 rmmod nvme_tcp 00:06:55.822 rmmod nvme_fabrics 00:06:55.822 rmmod nvme_keyring 00:06:55.822 18:55:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:06:55.822 18:55:14 -- nvmf/common.sh@123 -- # set -e 00:06:55.822 18:55:14 -- nvmf/common.sh@124 -- # return 0 00:06:55.822 18:55:14 -- nvmf/common.sh@477 -- # '[' -n 101760 ']' 00:06:55.822 18:55:14 -- nvmf/common.sh@478 -- # killprocess 101760 00:06:55.822 18:55:14 -- common/autotest_common.sh@936 -- # '[' -z 101760 ']' 00:06:55.822 18:55:14 -- common/autotest_common.sh@940 -- # kill -0 101760 00:06:55.822 18:55:14 -- common/autotest_common.sh@941 -- # uname 00:06:55.822 18:55:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:55.822 18:55:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 101760 00:06:55.822 18:55:14 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:06:55.822 18:55:14 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:06:55.822 18:55:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 101760' 00:06:55.822 killing process with pid 101760 00:06:55.822 18:55:14 -- common/autotest_common.sh@955 -- # kill 101760 00:06:55.822 18:55:14 -- common/autotest_common.sh@960 -- # wait 101760 00:06:55.822 nvmf threads initialize successfully 00:06:55.822 bdev subsystem init successfully 00:06:55.822 created a nvmf target service 00:06:55.822 create targets's poll groups done 00:06:55.822 all subsystems of target started 00:06:55.822 nvmf target is running 00:06:55.822 all subsystems of target stopped 00:06:55.822 destroy targets's poll groups done 00:06:55.822 destroyed the nvmf target service 00:06:55.822 bdev subsystem finish successfully 00:06:55.822 nvmf threads destroy successfully 00:06:55.822 18:55:15 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:06:55.822 18:55:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:06:55.822 18:55:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:06:55.822 18:55:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:06:55.822 18:55:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:06:55.822 18:55:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:55.822 18:55:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:55.822 18:55:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:56.081 18:55:17 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:06:56.081 18:55:17 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:06:56.081 18:55:17 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:56.081 18:55:17 -- common/autotest_common.sh@10 -- # set +x 00:06:56.081 00:06:56.081 real 0m16.127s 00:06:56.081 user 0m45.495s 00:06:56.081 sys 0m3.338s 00:06:56.081 18:55:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:56.081 18:55:17 -- common/autotest_common.sh@10 -- # set +x 00:06:56.081 ************************************ 00:06:56.081 END TEST nvmf_example 00:06:56.081 ************************************ 00:06:56.343 18:55:17 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:56.343 18:55:17 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:56.343 18:55:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:56.343 18:55:17 -- common/autotest_common.sh@10 -- # set +x 00:06:56.343 ************************************ 00:06:56.343 START TEST nvmf_filesystem 00:06:56.343 ************************************ 00:06:56.343 18:55:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:56.343 * Looking for test storage... 00:06:56.343 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:56.343 18:55:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:56.343 18:55:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:56.343 18:55:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:56.343 18:55:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:56.343 18:55:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:56.343 18:55:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:56.343 18:55:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:56.343 18:55:17 -- scripts/common.sh@335 -- # IFS=.-: 00:06:56.344 18:55:17 -- scripts/common.sh@335 -- # read -ra ver1 00:06:56.344 18:55:17 -- scripts/common.sh@336 -- # IFS=.-: 00:06:56.344 18:55:17 -- scripts/common.sh@336 -- # read -ra ver2 00:06:56.344 18:55:17 -- scripts/common.sh@337 -- # local 'op=<' 00:06:56.344 18:55:17 -- scripts/common.sh@339 -- # ver1_l=2 00:06:56.344 18:55:17 -- scripts/common.sh@340 -- # ver2_l=1 00:06:56.344 18:55:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:56.344 18:55:17 -- scripts/common.sh@343 -- # case "$op" in 00:06:56.344 18:55:17 -- scripts/common.sh@344 -- # : 1 00:06:56.344 18:55:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:56.344 18:55:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:56.344 18:55:17 -- scripts/common.sh@364 -- # decimal 1 00:06:56.344 18:55:17 -- scripts/common.sh@352 -- # local d=1 00:06:56.344 18:55:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:56.344 18:55:17 -- scripts/common.sh@354 -- # echo 1 00:06:56.344 18:55:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:56.344 18:55:17 -- scripts/common.sh@365 -- # decimal 2 00:06:56.344 18:55:17 -- scripts/common.sh@352 -- # local d=2 00:06:56.344 18:55:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:56.344 18:55:17 -- scripts/common.sh@354 -- # echo 2 00:06:56.344 18:55:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:56.344 18:55:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:56.344 18:55:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:56.344 18:55:17 -- scripts/common.sh@367 -- # return 0 00:06:56.344 18:55:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:56.344 18:55:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:56.344 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:56.344 --rc genhtml_branch_coverage=1 00:06:56.344 --rc genhtml_function_coverage=1 00:06:56.344 --rc genhtml_legend=1 00:06:56.344 --rc geninfo_all_blocks=1 00:06:56.344 --rc geninfo_unexecuted_blocks=1 00:06:56.344 00:06:56.344 ' 00:06:56.344 18:55:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:56.344 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:56.344 --rc genhtml_branch_coverage=1 00:06:56.344 --rc genhtml_function_coverage=1 00:06:56.344 --rc genhtml_legend=1 00:06:56.344 --rc geninfo_all_blocks=1 00:06:56.344 --rc geninfo_unexecuted_blocks=1 00:06:56.344 00:06:56.344 ' 00:06:56.344 18:55:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:56.344 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:56.344 --rc genhtml_branch_coverage=1 00:06:56.344 --rc genhtml_function_coverage=1 00:06:56.344 --rc genhtml_legend=1 00:06:56.344 --rc geninfo_all_blocks=1 00:06:56.344 --rc geninfo_unexecuted_blocks=1 00:06:56.344 00:06:56.344 ' 00:06:56.344 18:55:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:56.344 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:56.344 --rc genhtml_branch_coverage=1 00:06:56.344 --rc genhtml_function_coverage=1 00:06:56.344 --rc genhtml_legend=1 00:06:56.344 --rc geninfo_all_blocks=1 00:06:56.344 --rc geninfo_unexecuted_blocks=1 00:06:56.344 00:06:56.344 ' 00:06:56.344 18:55:17 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:06:56.344 18:55:17 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:06:56.344 18:55:17 -- common/autotest_common.sh@34 -- # set -e 00:06:56.344 18:55:17 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:06:56.344 18:55:17 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:06:56.344 18:55:17 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:06:56.344 18:55:17 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:06:56.344 18:55:17 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:06:56.344 18:55:17 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:06:56.344 18:55:17 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:06:56.344 18:55:17 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:06:56.344 18:55:17 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:06:56.344 18:55:17 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:06:56.344 18:55:17 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:06:56.344 18:55:17 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:06:56.344 18:55:17 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:06:56.344 18:55:17 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:06:56.344 18:55:17 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:06:56.344 18:55:17 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:06:56.344 18:55:17 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:06:56.344 18:55:17 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:06:56.344 18:55:17 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:06:56.344 18:55:17 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:06:56.344 18:55:17 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:06:56.344 18:55:17 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:06:56.344 18:55:17 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:56.344 18:55:17 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:06:56.344 18:55:17 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:06:56.344 18:55:17 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:06:56.344 18:55:17 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:06:56.344 18:55:17 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:06:56.344 18:55:17 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:06:56.344 18:55:17 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:06:56.344 18:55:17 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:06:56.344 18:55:17 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:06:56.344 18:55:17 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:06:56.344 18:55:17 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:06:56.344 18:55:17 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:06:56.344 18:55:17 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:06:56.344 18:55:17 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:06:56.344 18:55:17 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:06:56.344 18:55:17 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:06:56.344 18:55:17 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:56.344 18:55:17 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:06:56.344 18:55:17 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:06:56.344 18:55:17 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:06:56.344 18:55:17 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:06:56.344 18:55:17 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:06:56.344 18:55:17 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:06:56.344 18:55:17 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:06:56.344 18:55:17 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:06:56.344 18:55:17 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:06:56.344 18:55:17 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:06:56.344 18:55:17 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:06:56.344 18:55:17 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:06:56.345 18:55:17 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:06:56.345 18:55:17 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:06:56.345 18:55:17 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:06:56.345 18:55:17 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:06:56.345 18:55:17 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:06:56.345 18:55:17 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:06:56.345 18:55:17 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:06:56.345 18:55:17 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:06:56.345 18:55:17 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:06:56.345 18:55:17 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:06:56.345 18:55:17 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:06:56.345 18:55:17 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:06:56.345 18:55:17 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR= 00:06:56.345 18:55:17 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:06:56.345 18:55:17 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:06:56.345 18:55:17 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:06:56.345 18:55:17 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:06:56.345 18:55:17 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:06:56.345 18:55:17 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:06:56.345 18:55:17 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:06:56.345 18:55:17 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:06:56.345 18:55:17 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:06:56.345 18:55:17 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:06:56.345 18:55:17 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:06:56.345 18:55:17 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:06:56.345 18:55:17 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:06:56.345 18:55:17 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:06:56.345 18:55:17 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:06:56.345 18:55:17 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:06:56.345 18:55:17 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:06:56.345 18:55:17 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:06:56.345 18:55:17 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:56.345 18:55:17 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:56.345 18:55:17 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:56.345 18:55:17 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:56.345 18:55:17 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:56.345 18:55:17 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:56.345 18:55:17 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:56.345 18:55:17 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:56.345 18:55:17 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:06:56.345 18:55:17 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:06:56.345 18:55:17 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:06:56.345 18:55:17 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:06:56.345 18:55:17 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:06:56.345 18:55:17 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:06:56.345 18:55:17 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:06:56.345 18:55:17 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:06:56.345 #define SPDK_CONFIG_H 00:06:56.345 #define SPDK_CONFIG_APPS 1 00:06:56.345 #define SPDK_CONFIG_ARCH native 00:06:56.345 #undef SPDK_CONFIG_ASAN 00:06:56.345 #undef SPDK_CONFIG_AVAHI 00:06:56.345 #undef SPDK_CONFIG_CET 00:06:56.345 #define SPDK_CONFIG_COVERAGE 1 00:06:56.345 #define SPDK_CONFIG_CROSS_PREFIX 00:06:56.345 #undef SPDK_CONFIG_CRYPTO 00:06:56.345 #undef SPDK_CONFIG_CRYPTO_MLX5 00:06:56.345 #undef SPDK_CONFIG_CUSTOMOCF 00:06:56.345 #undef SPDK_CONFIG_DAOS 00:06:56.345 #define SPDK_CONFIG_DAOS_DIR 00:06:56.345 #define SPDK_CONFIG_DEBUG 1 00:06:56.345 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:06:56.345 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:56.345 #define SPDK_CONFIG_DPDK_INC_DIR 00:06:56.345 #define SPDK_CONFIG_DPDK_LIB_DIR 00:06:56.345 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:06:56.345 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:56.345 #define SPDK_CONFIG_EXAMPLES 1 00:06:56.345 #undef SPDK_CONFIG_FC 00:06:56.345 #define SPDK_CONFIG_FC_PATH 00:06:56.345 #define SPDK_CONFIG_FIO_PLUGIN 1 00:06:56.345 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:06:56.345 #undef SPDK_CONFIG_FUSE 00:06:56.345 #undef SPDK_CONFIG_FUZZER 00:06:56.345 #define SPDK_CONFIG_FUZZER_LIB 00:06:56.345 #undef SPDK_CONFIG_GOLANG 00:06:56.345 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:06:56.345 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:06:56.345 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:06:56.345 #undef SPDK_CONFIG_HAVE_LIBBSD 00:06:56.345 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:06:56.345 #define SPDK_CONFIG_IDXD 1 00:06:56.345 #define SPDK_CONFIG_IDXD_KERNEL 1 00:06:56.345 #undef SPDK_CONFIG_IPSEC_MB 00:06:56.345 #define SPDK_CONFIG_IPSEC_MB_DIR 00:06:56.345 #define SPDK_CONFIG_ISAL 1 00:06:56.345 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:06:56.345 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:06:56.345 #define SPDK_CONFIG_LIBDIR 00:06:56.345 #undef SPDK_CONFIG_LTO 00:06:56.345 #define SPDK_CONFIG_MAX_LCORES 00:06:56.345 #define SPDK_CONFIG_NVME_CUSE 1 00:06:56.345 #undef SPDK_CONFIG_OCF 00:06:56.345 #define SPDK_CONFIG_OCF_PATH 00:06:56.345 #define SPDK_CONFIG_OPENSSL_PATH 00:06:56.345 #undef SPDK_CONFIG_PGO_CAPTURE 00:06:56.345 #undef SPDK_CONFIG_PGO_USE 00:06:56.345 #define SPDK_CONFIG_PREFIX /usr/local 00:06:56.345 #undef SPDK_CONFIG_RAID5F 00:06:56.345 #undef SPDK_CONFIG_RBD 00:06:56.345 #define SPDK_CONFIG_RDMA 1 00:06:56.345 #define SPDK_CONFIG_RDMA_PROV verbs 00:06:56.345 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:06:56.345 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:06:56.345 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:06:56.345 #define SPDK_CONFIG_SHARED 1 00:06:56.345 #undef SPDK_CONFIG_SMA 00:06:56.345 #define SPDK_CONFIG_TESTS 1 00:06:56.345 #undef SPDK_CONFIG_TSAN 00:06:56.345 #define SPDK_CONFIG_UBLK 1 00:06:56.345 #define SPDK_CONFIG_UBSAN 1 00:06:56.345 #undef SPDK_CONFIG_UNIT_TESTS 00:06:56.345 #undef SPDK_CONFIG_URING 00:06:56.345 #define SPDK_CONFIG_URING_PATH 00:06:56.345 #undef SPDK_CONFIG_URING_ZNS 00:06:56.345 #undef SPDK_CONFIG_USDT 00:06:56.346 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:06:56.346 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:06:56.346 #undef SPDK_CONFIG_VFIO_USER 00:06:56.346 #define SPDK_CONFIG_VFIO_USER_DIR 00:06:56.346 #define SPDK_CONFIG_VHOST 1 00:06:56.346 #define SPDK_CONFIG_VIRTIO 1 00:06:56.346 #undef SPDK_CONFIG_VTUNE 00:06:56.346 #define SPDK_CONFIG_VTUNE_DIR 00:06:56.346 #define SPDK_CONFIG_WERROR 1 00:06:56.346 #define SPDK_CONFIG_WPDK_DIR 00:06:56.346 #undef SPDK_CONFIG_XNVME 00:06:56.346 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:06:56.346 18:55:17 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:06:56.346 18:55:17 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:56.346 18:55:17 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:56.346 18:55:17 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:56.346 18:55:17 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:56.346 18:55:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:56.346 18:55:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:56.346 18:55:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:56.346 18:55:17 -- paths/export.sh@5 -- # export PATH 00:06:56.346 18:55:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:56.346 18:55:17 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:56.346 18:55:17 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:56.346 18:55:17 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:56.346 18:55:17 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:56.346 18:55:17 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:06:56.346 18:55:17 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:56.346 18:55:17 -- pm/common@16 -- # TEST_TAG=N/A 00:06:56.346 18:55:17 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:06:56.346 18:55:17 -- common/autotest_common.sh@52 -- # : 1 00:06:56.346 18:55:17 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:06:56.346 18:55:17 -- common/autotest_common.sh@56 -- # : 0 00:06:56.346 18:55:17 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:06:56.346 18:55:17 -- common/autotest_common.sh@58 -- # : 0 00:06:56.346 18:55:17 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:06:56.346 18:55:17 -- common/autotest_common.sh@60 -- # : 1 00:06:56.346 18:55:17 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:06:56.346 18:55:17 -- common/autotest_common.sh@62 -- # : 0 00:06:56.346 18:55:17 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:06:56.346 18:55:17 -- common/autotest_common.sh@64 -- # : 00:06:56.346 18:55:17 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:06:56.346 18:55:17 -- common/autotest_common.sh@66 -- # : 0 00:06:56.346 18:55:17 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:06:56.346 18:55:17 -- common/autotest_common.sh@68 -- # : 0 00:06:56.346 18:55:17 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:06:56.346 18:55:17 -- common/autotest_common.sh@70 -- # : 0 00:06:56.346 18:55:17 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:06:56.346 18:55:17 -- common/autotest_common.sh@72 -- # : 0 00:06:56.346 18:55:17 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:06:56.346 18:55:17 -- common/autotest_common.sh@74 -- # : 0 00:06:56.346 18:55:17 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:06:56.346 18:55:17 -- common/autotest_common.sh@76 -- # : 0 00:06:56.346 18:55:17 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:06:56.346 18:55:17 -- common/autotest_common.sh@78 -- # : 0 00:06:56.346 18:55:17 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:06:56.346 18:55:17 -- common/autotest_common.sh@80 -- # : 1 00:06:56.346 18:55:17 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:06:56.346 18:55:17 -- common/autotest_common.sh@82 -- # : 0 00:06:56.346 18:55:17 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:06:56.346 18:55:17 -- common/autotest_common.sh@84 -- # : 0 00:06:56.346 18:55:17 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:06:56.346 18:55:17 -- common/autotest_common.sh@86 -- # : 1 00:06:56.346 18:55:17 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:06:56.346 18:55:17 -- common/autotest_common.sh@88 -- # : 0 00:06:56.346 18:55:17 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:06:56.346 18:55:17 -- common/autotest_common.sh@90 -- # : 0 00:06:56.346 18:55:17 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:06:56.346 18:55:17 -- common/autotest_common.sh@92 -- # : 0 00:06:56.346 18:55:17 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:06:56.346 18:55:17 -- common/autotest_common.sh@94 -- # : 0 00:06:56.346 18:55:17 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:06:56.346 18:55:17 -- common/autotest_common.sh@96 -- # : tcp 00:06:56.346 18:55:17 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:06:56.346 18:55:17 -- common/autotest_common.sh@98 -- # : 0 00:06:56.346 18:55:17 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:06:56.346 18:55:17 -- common/autotest_common.sh@100 -- # : 0 00:06:56.346 18:55:17 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:06:56.346 18:55:17 -- common/autotest_common.sh@102 -- # : 0 00:06:56.346 18:55:17 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:06:56.346 18:55:17 -- common/autotest_common.sh@104 -- # : 0 00:06:56.346 18:55:17 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:06:56.346 18:55:17 -- common/autotest_common.sh@106 -- # : 0 00:06:56.346 18:55:17 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:06:56.346 18:55:17 -- common/autotest_common.sh@108 -- # : 0 00:06:56.346 18:55:17 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:06:56.346 18:55:17 -- common/autotest_common.sh@110 -- # : 0 00:06:56.346 18:55:17 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:06:56.346 18:55:17 -- common/autotest_common.sh@112 -- # : 0 00:06:56.346 18:55:17 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:06:56.346 18:55:17 -- common/autotest_common.sh@114 -- # : 0 00:06:56.346 18:55:17 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:06:56.346 18:55:17 -- common/autotest_common.sh@116 -- # : 1 00:06:56.346 18:55:17 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:06:56.346 18:55:17 -- common/autotest_common.sh@118 -- # : 00:06:56.346 18:55:17 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:06:56.347 18:55:17 -- common/autotest_common.sh@120 -- # : 0 00:06:56.347 18:55:17 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:06:56.347 18:55:17 -- common/autotest_common.sh@122 -- # : 0 00:06:56.347 18:55:17 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:06:56.347 18:55:17 -- common/autotest_common.sh@124 -- # : 0 00:06:56.347 18:55:17 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:06:56.347 18:55:17 -- common/autotest_common.sh@126 -- # : 0 00:06:56.347 18:55:17 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:06:56.347 18:55:17 -- common/autotest_common.sh@128 -- # : 0 00:06:56.347 18:55:17 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:06:56.347 18:55:17 -- common/autotest_common.sh@130 -- # : 0 00:06:56.347 18:55:17 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:06:56.347 18:55:17 -- common/autotest_common.sh@132 -- # : 00:06:56.347 18:55:17 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:06:56.347 18:55:17 -- common/autotest_common.sh@134 -- # : true 00:06:56.347 18:55:17 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:06:56.347 18:55:17 -- common/autotest_common.sh@136 -- # : 0 00:06:56.347 18:55:17 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:06:56.347 18:55:17 -- common/autotest_common.sh@138 -- # : 0 00:06:56.347 18:55:17 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:06:56.347 18:55:17 -- common/autotest_common.sh@140 -- # : 0 00:06:56.347 18:55:17 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:06:56.347 18:55:17 -- common/autotest_common.sh@142 -- # : 0 00:06:56.347 18:55:17 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:06:56.347 18:55:17 -- common/autotest_common.sh@144 -- # : 0 00:06:56.347 18:55:17 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:06:56.347 18:55:17 -- common/autotest_common.sh@146 -- # : 0 00:06:56.347 18:55:17 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:06:56.347 18:55:17 -- common/autotest_common.sh@148 -- # : e810 00:06:56.347 18:55:17 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:06:56.347 18:55:17 -- common/autotest_common.sh@150 -- # : 0 00:06:56.347 18:55:17 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:06:56.347 18:55:17 -- common/autotest_common.sh@152 -- # : 0 00:06:56.347 18:55:17 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:06:56.347 18:55:17 -- common/autotest_common.sh@154 -- # : 0 00:06:56.347 18:55:17 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:06:56.347 18:55:17 -- common/autotest_common.sh@156 -- # : 0 00:06:56.347 18:55:17 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:06:56.347 18:55:17 -- common/autotest_common.sh@158 -- # : 0 00:06:56.347 18:55:17 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:06:56.347 18:55:17 -- common/autotest_common.sh@160 -- # : 0 00:06:56.347 18:55:17 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:06:56.347 18:55:17 -- common/autotest_common.sh@163 -- # : 00:06:56.347 18:55:17 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:06:56.347 18:55:17 -- common/autotest_common.sh@165 -- # : 0 00:06:56.347 18:55:17 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:06:56.347 18:55:17 -- common/autotest_common.sh@167 -- # : 0 00:06:56.347 18:55:17 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:06:56.347 18:55:17 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:56.347 18:55:17 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:56.347 18:55:17 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:56.347 18:55:17 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:56.347 18:55:17 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:56.347 18:55:17 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:56.347 18:55:17 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:56.347 18:55:17 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:56.347 18:55:17 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:06:56.347 18:55:17 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:06:56.347 18:55:17 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:56.347 18:55:17 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:56.347 18:55:17 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:06:56.347 18:55:17 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:06:56.347 18:55:17 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:56.347 18:55:17 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:56.347 18:55:17 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:56.347 18:55:17 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:56.347 18:55:17 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:06:56.347 18:55:17 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:06:56.347 18:55:17 -- common/autotest_common.sh@196 -- # cat 00:06:56.347 18:55:17 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:06:56.347 18:55:17 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:56.347 18:55:17 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:56.347 18:55:17 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:56.347 18:55:17 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:56.347 18:55:17 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:06:56.347 18:55:17 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:06:56.347 18:55:17 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:56.347 18:55:17 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:56.347 18:55:17 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:56.347 18:55:17 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:56.347 18:55:17 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:56.348 18:55:17 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:56.348 18:55:17 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:56.348 18:55:17 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:56.348 18:55:17 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:56.348 18:55:17 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:56.348 18:55:17 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:56.348 18:55:17 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:56.348 18:55:17 -- common/autotest_common.sh@247 -- # _LCOV_MAIN=0 00:06:56.348 18:55:17 -- common/autotest_common.sh@248 -- # _LCOV_LLVM=1 00:06:56.348 18:55:17 -- common/autotest_common.sh@249 -- # _LCOV= 00:06:56.348 18:55:17 -- common/autotest_common.sh@250 -- # [[ '' == *clang* ]] 00:06:56.348 18:55:17 -- common/autotest_common.sh@250 -- # [[ 0 -eq 1 ]] 00:06:56.348 18:55:17 -- common/autotest_common.sh@252 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:06:56.348 18:55:17 -- common/autotest_common.sh@253 -- # _lcov_opt[_LCOV_MAIN]= 00:06:56.348 18:55:17 -- common/autotest_common.sh@255 -- # lcov_opt= 00:06:56.348 18:55:17 -- common/autotest_common.sh@258 -- # '[' 0 -eq 0 ']' 00:06:56.348 18:55:17 -- common/autotest_common.sh@259 -- # export valgrind= 00:06:56.348 18:55:17 -- common/autotest_common.sh@259 -- # valgrind= 00:06:56.348 18:55:17 -- common/autotest_common.sh@265 -- # uname -s 00:06:56.348 18:55:17 -- common/autotest_common.sh@265 -- # '[' Linux = Linux ']' 00:06:56.348 18:55:17 -- common/autotest_common.sh@266 -- # HUGEMEM=4096 00:06:56.348 18:55:17 -- common/autotest_common.sh@267 -- # export CLEAR_HUGE=yes 00:06:56.348 18:55:17 -- common/autotest_common.sh@267 -- # CLEAR_HUGE=yes 00:06:56.348 18:55:17 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:56.348 18:55:17 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:56.348 18:55:17 -- common/autotest_common.sh@275 -- # MAKE=make 00:06:56.348 18:55:17 -- common/autotest_common.sh@276 -- # MAKEFLAGS=-j48 00:06:56.348 18:55:17 -- common/autotest_common.sh@292 -- # export HUGEMEM=4096 00:06:56.348 18:55:17 -- common/autotest_common.sh@292 -- # HUGEMEM=4096 00:06:56.348 18:55:17 -- common/autotest_common.sh@294 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:06:56.348 18:55:17 -- common/autotest_common.sh@299 -- # NO_HUGE=() 00:06:56.348 18:55:17 -- common/autotest_common.sh@300 -- # TEST_MODE= 00:06:56.348 18:55:17 -- common/autotest_common.sh@301 -- # for i in "$@" 00:06:56.348 18:55:17 -- common/autotest_common.sh@302 -- # case "$i" in 00:06:56.348 18:55:17 -- common/autotest_common.sh@307 -- # TEST_TRANSPORT=tcp 00:06:56.348 18:55:17 -- common/autotest_common.sh@319 -- # [[ -z 103508 ]] 00:06:56.348 18:55:17 -- common/autotest_common.sh@319 -- # kill -0 103508 00:06:56.348 18:55:17 -- common/autotest_common.sh@1675 -- # set_test_storage 2147483648 00:06:56.348 18:55:17 -- common/autotest_common.sh@329 -- # [[ -v testdir ]] 00:06:56.348 18:55:17 -- common/autotest_common.sh@331 -- # local requested_size=2147483648 00:06:56.348 18:55:17 -- common/autotest_common.sh@332 -- # local mount target_dir 00:06:56.348 18:55:17 -- common/autotest_common.sh@334 -- # local -A mounts fss sizes avails uses 00:06:56.348 18:55:17 -- common/autotest_common.sh@335 -- # local source fs size avail mount use 00:06:56.348 18:55:17 -- common/autotest_common.sh@337 -- # local storage_fallback storage_candidates 00:06:56.348 18:55:17 -- common/autotest_common.sh@339 -- # mktemp -udt spdk.XXXXXX 00:06:56.348 18:55:17 -- common/autotest_common.sh@339 -- # storage_fallback=/tmp/spdk.p5Vcbr 00:06:56.348 18:55:17 -- common/autotest_common.sh@344 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:06:56.348 18:55:17 -- common/autotest_common.sh@346 -- # [[ -n '' ]] 00:06:56.348 18:55:17 -- common/autotest_common.sh@351 -- # [[ -n '' ]] 00:06:56.348 18:55:17 -- common/autotest_common.sh@356 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.p5Vcbr/tests/target /tmp/spdk.p5Vcbr 00:06:56.348 18:55:17 -- common/autotest_common.sh@359 -- # requested_size=2214592512 00:06:56.348 18:55:17 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:56.348 18:55:17 -- common/autotest_common.sh@328 -- # df -T 00:06:56.348 18:55:17 -- common/autotest_common.sh@328 -- # grep -v Filesystem 00:06:56.348 18:55:17 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_devtmpfs 00:06:56.348 18:55:17 -- common/autotest_common.sh@362 -- # fss["$mount"]=devtmpfs 00:06:56.348 18:55:17 -- common/autotest_common.sh@363 -- # avails["$mount"]=67108864 00:06:56.348 18:55:17 -- common/autotest_common.sh@363 -- # sizes["$mount"]=67108864 00:06:56.348 18:55:17 -- common/autotest_common.sh@364 -- # uses["$mount"]=0 00:06:56.348 18:55:17 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:56.348 18:55:17 -- common/autotest_common.sh@362 -- # mounts["$mount"]=/dev/pmem0 00:06:56.348 18:55:17 -- common/autotest_common.sh@362 -- # fss["$mount"]=ext2 00:06:56.348 18:55:17 -- common/autotest_common.sh@363 -- # avails["$mount"]=4096 00:06:56.348 18:55:17 -- common/autotest_common.sh@363 -- # sizes["$mount"]=5284429824 00:06:56.348 18:55:17 -- common/autotest_common.sh@364 -- # uses["$mount"]=5284425728 00:06:56.348 18:55:17 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:56.348 18:55:17 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_root 00:06:56.348 18:55:17 -- common/autotest_common.sh@362 -- # fss["$mount"]=overlay 00:06:56.348 18:55:17 -- common/autotest_common.sh@363 -- # avails["$mount"]=56689520640 00:06:56.348 18:55:17 -- common/autotest_common.sh@363 -- # sizes["$mount"]=61988519936 00:06:56.348 18:55:17 -- common/autotest_common.sh@364 -- # uses["$mount"]=5298999296 00:06:56.348 18:55:17 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:56.348 18:55:17 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:56.348 18:55:17 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:56.348 18:55:17 -- common/autotest_common.sh@363 -- # avails["$mount"]=30993002496 00:06:56.348 18:55:17 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994259968 00:06:56.348 18:55:17 -- common/autotest_common.sh@364 -- # uses["$mount"]=1257472 00:06:56.348 18:55:17 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:56.348 18:55:17 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:56.348 18:55:17 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:56.348 18:55:17 -- common/autotest_common.sh@363 -- # avails["$mount"]=12388921344 00:06:56.348 18:55:17 -- common/autotest_common.sh@363 -- # sizes["$mount"]=12397707264 00:06:56.348 18:55:17 -- common/autotest_common.sh@364 -- # uses["$mount"]=8785920 00:06:56.348 18:55:17 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:56.348 18:55:17 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:56.348 18:55:17 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:56.348 18:55:17 -- common/autotest_common.sh@363 -- # avails["$mount"]=30994087936 00:06:56.348 18:55:17 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994259968 00:06:56.348 18:55:17 -- common/autotest_common.sh@364 -- # uses["$mount"]=172032 00:06:56.348 18:55:17 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:56.348 18:55:17 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:56.348 18:55:17 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:56.348 18:55:17 -- common/autotest_common.sh@363 -- # avails["$mount"]=6198837248 00:06:56.348 18:55:17 -- common/autotest_common.sh@363 -- # sizes["$mount"]=6198849536 00:06:56.348 18:55:17 -- common/autotest_common.sh@364 -- # uses["$mount"]=12288 00:06:56.348 18:55:17 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:56.348 18:55:17 -- common/autotest_common.sh@367 -- # printf '* Looking for test storage...\n' 00:06:56.348 * Looking for test storage... 00:06:56.348 18:55:17 -- common/autotest_common.sh@369 -- # local target_space new_size 00:06:56.348 18:55:17 -- common/autotest_common.sh@370 -- # for target_dir in "${storage_candidates[@]}" 00:06:56.348 18:55:17 -- common/autotest_common.sh@373 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:56.348 18:55:17 -- common/autotest_common.sh@373 -- # awk '$1 !~ /Filesystem/{print $6}' 00:06:56.609 18:55:17 -- common/autotest_common.sh@373 -- # mount=/ 00:06:56.610 18:55:17 -- common/autotest_common.sh@375 -- # target_space=56689520640 00:06:56.610 18:55:17 -- common/autotest_common.sh@376 -- # (( target_space == 0 || target_space < requested_size )) 00:06:56.610 18:55:17 -- common/autotest_common.sh@379 -- # (( target_space >= requested_size )) 00:06:56.610 18:55:17 -- common/autotest_common.sh@381 -- # [[ overlay == tmpfs ]] 00:06:56.610 18:55:17 -- common/autotest_common.sh@381 -- # [[ overlay == ramfs ]] 00:06:56.610 18:55:17 -- common/autotest_common.sh@381 -- # [[ / == / ]] 00:06:56.610 18:55:17 -- common/autotest_common.sh@382 -- # new_size=7513591808 00:06:56.610 18:55:17 -- common/autotest_common.sh@383 -- # (( new_size * 100 / sizes[/] > 95 )) 00:06:56.610 18:55:17 -- common/autotest_common.sh@388 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:56.610 18:55:17 -- common/autotest_common.sh@388 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:56.610 18:55:17 -- common/autotest_common.sh@389 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:56.610 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:56.610 18:55:17 -- common/autotest_common.sh@390 -- # return 0 00:06:56.610 18:55:17 -- common/autotest_common.sh@1677 -- # set -o errtrace 00:06:56.610 18:55:17 -- common/autotest_common.sh@1678 -- # shopt -s extdebug 00:06:56.610 18:55:17 -- common/autotest_common.sh@1679 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:06:56.610 18:55:17 -- common/autotest_common.sh@1681 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:06:56.610 18:55:17 -- common/autotest_common.sh@1682 -- # true 00:06:56.610 18:55:17 -- common/autotest_common.sh@1684 -- # xtrace_fd 00:06:56.610 18:55:17 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:06:56.610 18:55:17 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:06:56.610 18:55:17 -- common/autotest_common.sh@27 -- # exec 00:06:56.610 18:55:17 -- common/autotest_common.sh@29 -- # exec 00:06:56.610 18:55:17 -- common/autotest_common.sh@31 -- # xtrace_restore 00:06:56.610 18:55:17 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:06:56.610 18:55:17 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:06:56.610 18:55:17 -- common/autotest_common.sh@18 -- # set -x 00:06:56.610 18:55:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:56.610 18:55:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:56.610 18:55:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:56.610 18:55:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:56.610 18:55:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:56.610 18:55:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:56.610 18:55:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:56.610 18:55:17 -- scripts/common.sh@335 -- # IFS=.-: 00:06:56.610 18:55:17 -- scripts/common.sh@335 -- # read -ra ver1 00:06:56.610 18:55:17 -- scripts/common.sh@336 -- # IFS=.-: 00:06:56.610 18:55:17 -- scripts/common.sh@336 -- # read -ra ver2 00:06:56.610 18:55:17 -- scripts/common.sh@337 -- # local 'op=<' 00:06:56.610 18:55:17 -- scripts/common.sh@339 -- # ver1_l=2 00:06:56.610 18:55:17 -- scripts/common.sh@340 -- # ver2_l=1 00:06:56.610 18:55:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:56.610 18:55:17 -- scripts/common.sh@343 -- # case "$op" in 00:06:56.610 18:55:17 -- scripts/common.sh@344 -- # : 1 00:06:56.610 18:55:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:56.610 18:55:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:56.610 18:55:17 -- scripts/common.sh@364 -- # decimal 1 00:06:56.610 18:55:17 -- scripts/common.sh@352 -- # local d=1 00:06:56.610 18:55:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:56.610 18:55:17 -- scripts/common.sh@354 -- # echo 1 00:06:56.610 18:55:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:56.610 18:55:17 -- scripts/common.sh@365 -- # decimal 2 00:06:56.610 18:55:17 -- scripts/common.sh@352 -- # local d=2 00:06:56.610 18:55:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:56.610 18:55:17 -- scripts/common.sh@354 -- # echo 2 00:06:56.610 18:55:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:56.610 18:55:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:56.610 18:55:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:56.610 18:55:17 -- scripts/common.sh@367 -- # return 0 00:06:56.610 18:55:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:56.610 18:55:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:56.610 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:56.610 --rc genhtml_branch_coverage=1 00:06:56.610 --rc genhtml_function_coverage=1 00:06:56.610 --rc genhtml_legend=1 00:06:56.610 --rc geninfo_all_blocks=1 00:06:56.610 --rc geninfo_unexecuted_blocks=1 00:06:56.610 00:06:56.610 ' 00:06:56.610 18:55:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:56.610 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:56.610 --rc genhtml_branch_coverage=1 00:06:56.610 --rc genhtml_function_coverage=1 00:06:56.610 --rc genhtml_legend=1 00:06:56.610 --rc geninfo_all_blocks=1 00:06:56.610 --rc geninfo_unexecuted_blocks=1 00:06:56.610 00:06:56.610 ' 00:06:56.610 18:55:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:56.610 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:56.610 --rc genhtml_branch_coverage=1 00:06:56.610 --rc genhtml_function_coverage=1 00:06:56.610 --rc genhtml_legend=1 00:06:56.610 --rc geninfo_all_blocks=1 00:06:56.610 --rc geninfo_unexecuted_blocks=1 00:06:56.610 00:06:56.610 ' 00:06:56.610 18:55:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:56.610 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:56.610 --rc genhtml_branch_coverage=1 00:06:56.610 --rc genhtml_function_coverage=1 00:06:56.610 --rc genhtml_legend=1 00:06:56.610 --rc geninfo_all_blocks=1 00:06:56.610 --rc geninfo_unexecuted_blocks=1 00:06:56.610 00:06:56.610 ' 00:06:56.610 18:55:17 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:56.610 18:55:17 -- nvmf/common.sh@7 -- # uname -s 00:06:56.610 18:55:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:56.610 18:55:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:56.610 18:55:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:56.610 18:55:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:56.610 18:55:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:56.610 18:55:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:56.610 18:55:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:56.610 18:55:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:56.610 18:55:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:56.610 18:55:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:56.610 18:55:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:06:56.610 18:55:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:06:56.610 18:55:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:56.610 18:55:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:56.610 18:55:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:56.610 18:55:17 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:56.610 18:55:17 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:56.611 18:55:17 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:56.611 18:55:17 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:56.611 18:55:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:56.611 18:55:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:56.611 18:55:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:56.611 18:55:17 -- paths/export.sh@5 -- # export PATH 00:06:56.611 18:55:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:56.611 18:55:17 -- nvmf/common.sh@46 -- # : 0 00:06:56.611 18:55:17 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:56.611 18:55:17 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:56.611 18:55:17 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:56.611 18:55:17 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:56.611 18:55:17 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:56.611 18:55:17 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:56.611 18:55:17 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:56.611 18:55:17 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:56.611 18:55:17 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:06:56.611 18:55:17 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:06:56.611 18:55:17 -- target/filesystem.sh@15 -- # nvmftestinit 00:06:56.611 18:55:17 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:56.611 18:55:17 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:56.611 18:55:17 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:56.611 18:55:17 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:56.611 18:55:17 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:56.611 18:55:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:56.611 18:55:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:56.611 18:55:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:56.611 18:55:17 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:56.611 18:55:17 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:56.611 18:55:17 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:56.611 18:55:17 -- common/autotest_common.sh@10 -- # set +x 00:06:59.147 18:55:19 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:59.147 18:55:19 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:59.147 18:55:19 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:59.147 18:55:19 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:59.147 18:55:19 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:59.147 18:55:19 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:59.147 18:55:19 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:59.147 18:55:19 -- nvmf/common.sh@294 -- # net_devs=() 00:06:59.147 18:55:19 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:59.147 18:55:19 -- nvmf/common.sh@295 -- # e810=() 00:06:59.147 18:55:19 -- nvmf/common.sh@295 -- # local -ga e810 00:06:59.147 18:55:19 -- nvmf/common.sh@296 -- # x722=() 00:06:59.147 18:55:19 -- nvmf/common.sh@296 -- # local -ga x722 00:06:59.147 18:55:19 -- nvmf/common.sh@297 -- # mlx=() 00:06:59.147 18:55:19 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:59.147 18:55:19 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:59.147 18:55:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:59.147 18:55:19 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:59.147 18:55:19 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:59.147 18:55:19 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:59.147 18:55:19 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:59.147 18:55:19 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:59.147 18:55:19 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:59.147 18:55:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:59.147 18:55:19 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:59.147 18:55:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:59.147 18:55:19 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:59.147 18:55:19 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:59.147 18:55:19 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:59.147 18:55:19 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:59.147 18:55:19 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:59.147 18:55:19 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:59.147 18:55:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:59.147 18:55:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:06:59.147 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:06:59.147 18:55:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:59.147 18:55:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:59.147 18:55:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:59.147 18:55:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:59.147 18:55:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:59.147 18:55:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:59.147 18:55:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:06:59.147 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:06:59.147 18:55:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:59.147 18:55:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:59.147 18:55:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:59.147 18:55:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:59.147 18:55:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:59.147 18:55:19 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:59.147 18:55:19 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:59.147 18:55:19 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:59.147 18:55:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:59.147 18:55:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:59.147 18:55:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:59.147 18:55:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:59.147 18:55:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:06:59.147 Found net devices under 0000:0a:00.0: cvl_0_0 00:06:59.147 18:55:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:59.147 18:55:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:59.147 18:55:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:59.148 18:55:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:59.148 18:55:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:59.148 18:55:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:06:59.148 Found net devices under 0000:0a:00.1: cvl_0_1 00:06:59.148 18:55:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:59.148 18:55:19 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:59.148 18:55:19 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:59.148 18:55:19 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:59.148 18:55:19 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:59.148 18:55:19 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:59.148 18:55:19 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:59.148 18:55:19 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:59.148 18:55:19 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:59.148 18:55:19 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:59.148 18:55:19 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:59.148 18:55:19 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:59.148 18:55:19 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:59.148 18:55:19 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:59.148 18:55:19 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:59.148 18:55:19 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:59.148 18:55:19 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:59.148 18:55:19 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:59.148 18:55:19 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:59.148 18:55:19 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:59.148 18:55:19 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:59.148 18:55:19 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:59.148 18:55:19 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:59.148 18:55:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:59.148 18:55:19 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:59.148 18:55:19 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:59.148 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:59.148 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.230 ms 00:06:59.148 00:06:59.148 --- 10.0.0.2 ping statistics --- 00:06:59.148 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:59.148 rtt min/avg/max/mdev = 0.230/0.230/0.230/0.000 ms 00:06:59.148 18:55:19 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:59.148 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:59.148 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.111 ms 00:06:59.148 00:06:59.148 --- 10.0.0.1 ping statistics --- 00:06:59.148 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:59.148 rtt min/avg/max/mdev = 0.111/0.111/0.111/0.000 ms 00:06:59.148 18:55:19 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:59.148 18:55:19 -- nvmf/common.sh@410 -- # return 0 00:06:59.148 18:55:19 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:59.148 18:55:19 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:59.148 18:55:19 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:59.148 18:55:19 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:59.148 18:55:19 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:59.148 18:55:19 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:59.148 18:55:19 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:59.148 18:55:19 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:06:59.148 18:55:19 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:59.148 18:55:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:59.148 18:55:19 -- common/autotest_common.sh@10 -- # set +x 00:06:59.148 ************************************ 00:06:59.148 START TEST nvmf_filesystem_no_in_capsule 00:06:59.148 ************************************ 00:06:59.148 18:55:19 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 0 00:06:59.148 18:55:19 -- target/filesystem.sh@47 -- # in_capsule=0 00:06:59.148 18:55:19 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:06:59.148 18:55:19 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:06:59.148 18:55:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:59.148 18:55:19 -- common/autotest_common.sh@10 -- # set +x 00:06:59.148 18:55:19 -- nvmf/common.sh@469 -- # nvmfpid=105160 00:06:59.148 18:55:19 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:06:59.148 18:55:19 -- nvmf/common.sh@470 -- # waitforlisten 105160 00:06:59.148 18:55:19 -- common/autotest_common.sh@829 -- # '[' -z 105160 ']' 00:06:59.148 18:55:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:59.148 18:55:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:59.148 18:55:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:59.148 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:59.148 18:55:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:59.148 18:55:19 -- common/autotest_common.sh@10 -- # set +x 00:06:59.148 [2024-11-28 18:55:19.951848] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:59.148 [2024-11-28 18:55:19.951938] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:06:59.148 EAL: No free 2048 kB hugepages reported on node 1 00:06:59.148 [2024-11-28 18:55:20.022642] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:59.148 [2024-11-28 18:55:20.149919] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:59.148 [2024-11-28 18:55:20.150081] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:06:59.148 [2024-11-28 18:55:20.150103] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:06:59.148 [2024-11-28 18:55:20.150127] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:06:59.148 [2024-11-28 18:55:20.150208] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:59.148 [2024-11-28 18:55:20.150282] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:59.148 [2024-11-28 18:55:20.150301] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:59.148 [2024-11-28 18:55:20.150304] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:00.084 18:55:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:00.084 18:55:20 -- common/autotest_common.sh@862 -- # return 0 00:07:00.084 18:55:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:00.084 18:55:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:00.084 18:55:20 -- common/autotest_common.sh@10 -- # set +x 00:07:00.084 18:55:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:00.084 18:55:20 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:00.084 18:55:20 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:00.084 18:55:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:00.084 18:55:20 -- common/autotest_common.sh@10 -- # set +x 00:07:00.084 [2024-11-28 18:55:21.002054] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:00.084 18:55:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:00.084 18:55:21 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:00.084 18:55:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:00.084 18:55:21 -- common/autotest_common.sh@10 -- # set +x 00:07:00.343 Malloc1 00:07:00.343 18:55:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:00.343 18:55:21 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:00.343 18:55:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:00.343 18:55:21 -- common/autotest_common.sh@10 -- # set +x 00:07:00.343 18:55:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:00.343 18:55:21 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:00.343 18:55:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:00.343 18:55:21 -- common/autotest_common.sh@10 -- # set +x 00:07:00.343 18:55:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:00.343 18:55:21 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:00.343 18:55:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:00.343 18:55:21 -- common/autotest_common.sh@10 -- # set +x 00:07:00.343 [2024-11-28 18:55:21.190163] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:00.343 18:55:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:00.343 18:55:21 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:00.343 18:55:21 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:07:00.343 18:55:21 -- common/autotest_common.sh@1368 -- # local bdev_info 00:07:00.343 18:55:21 -- common/autotest_common.sh@1369 -- # local bs 00:07:00.343 18:55:21 -- common/autotest_common.sh@1370 -- # local nb 00:07:00.343 18:55:21 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:00.343 18:55:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:00.343 18:55:21 -- common/autotest_common.sh@10 -- # set +x 00:07:00.343 18:55:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:00.343 18:55:21 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:07:00.343 { 00:07:00.343 "name": "Malloc1", 00:07:00.343 "aliases": [ 00:07:00.343 "f82b3582-dc5c-40bd-b432-b6a38c13e684" 00:07:00.343 ], 00:07:00.343 "product_name": "Malloc disk", 00:07:00.343 "block_size": 512, 00:07:00.343 "num_blocks": 1048576, 00:07:00.343 "uuid": "f82b3582-dc5c-40bd-b432-b6a38c13e684", 00:07:00.343 "assigned_rate_limits": { 00:07:00.343 "rw_ios_per_sec": 0, 00:07:00.343 "rw_mbytes_per_sec": 0, 00:07:00.343 "r_mbytes_per_sec": 0, 00:07:00.343 "w_mbytes_per_sec": 0 00:07:00.343 }, 00:07:00.343 "claimed": true, 00:07:00.343 "claim_type": "exclusive_write", 00:07:00.343 "zoned": false, 00:07:00.343 "supported_io_types": { 00:07:00.343 "read": true, 00:07:00.343 "write": true, 00:07:00.343 "unmap": true, 00:07:00.343 "write_zeroes": true, 00:07:00.343 "flush": true, 00:07:00.343 "reset": true, 00:07:00.343 "compare": false, 00:07:00.343 "compare_and_write": false, 00:07:00.343 "abort": true, 00:07:00.343 "nvme_admin": false, 00:07:00.343 "nvme_io": false 00:07:00.343 }, 00:07:00.343 "memory_domains": [ 00:07:00.343 { 00:07:00.343 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:00.343 "dma_device_type": 2 00:07:00.343 } 00:07:00.343 ], 00:07:00.343 "driver_specific": {} 00:07:00.343 } 00:07:00.343 ]' 00:07:00.343 18:55:21 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:07:00.343 18:55:21 -- common/autotest_common.sh@1372 -- # bs=512 00:07:00.343 18:55:21 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:07:00.343 18:55:21 -- common/autotest_common.sh@1373 -- # nb=1048576 00:07:00.343 18:55:21 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:07:00.343 18:55:21 -- common/autotest_common.sh@1377 -- # echo 512 00:07:00.343 18:55:21 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:00.343 18:55:21 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:01.278 18:55:21 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:01.278 18:55:21 -- common/autotest_common.sh@1187 -- # local i=0 00:07:01.278 18:55:21 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:07:01.278 18:55:21 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:07:01.278 18:55:21 -- common/autotest_common.sh@1194 -- # sleep 2 00:07:03.177 18:55:23 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:07:03.177 18:55:23 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:07:03.177 18:55:23 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:07:03.177 18:55:23 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:07:03.177 18:55:23 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:07:03.177 18:55:23 -- common/autotest_common.sh@1197 -- # return 0 00:07:03.177 18:55:24 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:03.177 18:55:24 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:03.177 18:55:24 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:03.177 18:55:24 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:03.177 18:55:24 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:03.177 18:55:24 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:03.177 18:55:24 -- setup/common.sh@80 -- # echo 536870912 00:07:03.177 18:55:24 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:03.177 18:55:24 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:03.177 18:55:24 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:03.177 18:55:24 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:03.435 18:55:24 -- target/filesystem.sh@69 -- # partprobe 00:07:04.001 18:55:24 -- target/filesystem.sh@70 -- # sleep 1 00:07:04.933 18:55:25 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:07:04.934 18:55:25 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:04.934 18:55:25 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:04.934 18:55:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:04.934 18:55:25 -- common/autotest_common.sh@10 -- # set +x 00:07:04.934 ************************************ 00:07:04.934 START TEST filesystem_ext4 00:07:04.934 ************************************ 00:07:04.934 18:55:25 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:04.934 18:55:25 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:04.934 18:55:25 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:04.934 18:55:25 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:04.934 18:55:25 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:07:04.934 18:55:25 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:04.934 18:55:25 -- common/autotest_common.sh@914 -- # local i=0 00:07:04.934 18:55:25 -- common/autotest_common.sh@915 -- # local force 00:07:04.934 18:55:25 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:07:04.934 18:55:25 -- common/autotest_common.sh@918 -- # force=-F 00:07:04.934 18:55:25 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:04.934 mke2fs 1.47.0 (5-Feb-2023) 00:07:05.192 Discarding device blocks: 0/522240 done 00:07:05.192 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:05.192 Filesystem UUID: c9cd02ff-cd37-47be-bf82-349d9ba73c99 00:07:05.192 Superblock backups stored on blocks: 00:07:05.192 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:05.192 00:07:05.192 Allocating group tables: 0/64 done 00:07:05.192 Writing inode tables: 0/64 done 00:07:05.192 Creating journal (8192 blocks): done 00:07:06.273 Writing superblocks and filesystem accounting information: 0/6410/64 done 00:07:06.273 00:07:06.273 18:55:27 -- common/autotest_common.sh@931 -- # return 0 00:07:06.273 18:55:27 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:11.535 18:55:32 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:11.535 18:55:32 -- target/filesystem.sh@25 -- # sync 00:07:11.535 18:55:32 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:11.535 18:55:32 -- target/filesystem.sh@27 -- # sync 00:07:11.535 18:55:32 -- target/filesystem.sh@29 -- # i=0 00:07:11.535 18:55:32 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:11.535 18:55:32 -- target/filesystem.sh@37 -- # kill -0 105160 00:07:11.535 18:55:32 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:11.535 18:55:32 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:11.535 18:55:32 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:11.535 18:55:32 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:11.535 00:07:11.535 real 0m6.613s 00:07:11.535 user 0m0.023s 00:07:11.535 sys 0m0.067s 00:07:11.535 18:55:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:11.535 18:55:32 -- common/autotest_common.sh@10 -- # set +x 00:07:11.535 ************************************ 00:07:11.535 END TEST filesystem_ext4 00:07:11.535 ************************************ 00:07:11.535 18:55:32 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:11.535 18:55:32 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:11.535 18:55:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:11.535 18:55:32 -- common/autotest_common.sh@10 -- # set +x 00:07:11.535 ************************************ 00:07:11.535 START TEST filesystem_btrfs 00:07:11.535 ************************************ 00:07:11.535 18:55:32 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:11.535 18:55:32 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:11.535 18:55:32 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:11.535 18:55:32 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:11.535 18:55:32 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:07:11.535 18:55:32 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:11.535 18:55:32 -- common/autotest_common.sh@914 -- # local i=0 00:07:11.535 18:55:32 -- common/autotest_common.sh@915 -- # local force 00:07:11.535 18:55:32 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:07:11.535 18:55:32 -- common/autotest_common.sh@920 -- # force=-f 00:07:11.535 18:55:32 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:11.792 btrfs-progs v6.8.1 00:07:11.792 See https://btrfs.readthedocs.io for more information. 00:07:11.792 00:07:11.792 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:11.792 NOTE: several default settings have changed in version 5.15, please make sure 00:07:11.792 this does not affect your deployments: 00:07:11.792 - DUP for metadata (-m dup) 00:07:11.792 - enabled no-holes (-O no-holes) 00:07:11.792 - enabled free-space-tree (-R free-space-tree) 00:07:11.792 00:07:11.792 Label: (null) 00:07:11.792 UUID: f36ff655-7ecf-4b57-baa0-251e0ab91486 00:07:11.792 Node size: 16384 00:07:11.792 Sector size: 4096 (CPU page size: 4096) 00:07:11.792 Filesystem size: 510.00MiB 00:07:11.792 Block group profiles: 00:07:11.792 Data: single 8.00MiB 00:07:11.792 Metadata: DUP 32.00MiB 00:07:11.792 System: DUP 8.00MiB 00:07:11.792 SSD detected: yes 00:07:11.792 Zoned device: no 00:07:11.792 Features: extref, skinny-metadata, no-holes, free-space-tree 00:07:11.792 Checksum: crc32c 00:07:11.792 Number of devices: 1 00:07:11.792 Devices: 00:07:11.792 ID SIZE PATH 00:07:11.792 1 510.00MiB /dev/nvme0n1p1 00:07:11.792 00:07:11.792 18:55:32 -- common/autotest_common.sh@931 -- # return 0 00:07:11.792 18:55:32 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:12.723 18:55:33 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:12.723 18:55:33 -- target/filesystem.sh@25 -- # sync 00:07:12.723 18:55:33 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:12.723 18:55:33 -- target/filesystem.sh@27 -- # sync 00:07:12.723 18:55:33 -- target/filesystem.sh@29 -- # i=0 00:07:12.723 18:55:33 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:12.723 18:55:33 -- target/filesystem.sh@37 -- # kill -0 105160 00:07:12.723 18:55:33 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:12.723 18:55:33 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:12.723 18:55:33 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:12.723 18:55:33 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:12.723 00:07:12.723 real 0m1.204s 00:07:12.723 user 0m0.017s 00:07:12.723 sys 0m0.137s 00:07:12.723 18:55:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:12.723 18:55:33 -- common/autotest_common.sh@10 -- # set +x 00:07:12.723 ************************************ 00:07:12.723 END TEST filesystem_btrfs 00:07:12.723 ************************************ 00:07:12.982 18:55:33 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:07:12.982 18:55:33 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:12.982 18:55:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:12.982 18:55:33 -- common/autotest_common.sh@10 -- # set +x 00:07:12.982 ************************************ 00:07:12.982 START TEST filesystem_xfs 00:07:12.982 ************************************ 00:07:12.982 18:55:33 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:07:12.982 18:55:33 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:12.982 18:55:33 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:12.982 18:55:33 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:12.982 18:55:33 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:07:12.982 18:55:33 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:12.982 18:55:33 -- common/autotest_common.sh@914 -- # local i=0 00:07:12.982 18:55:33 -- common/autotest_common.sh@915 -- # local force 00:07:12.982 18:55:33 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:07:12.982 18:55:33 -- common/autotest_common.sh@920 -- # force=-f 00:07:12.982 18:55:33 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:12.982 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:12.982 = sectsz=512 attr=2, projid32bit=1 00:07:12.982 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:12.982 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:12.982 data = bsize=4096 blocks=130560, imaxpct=25 00:07:12.982 = sunit=0 swidth=0 blks 00:07:12.982 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:12.982 log =internal log bsize=4096 blocks=16384, version=2 00:07:12.982 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:12.982 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:13.917 Discarding blocks...Done. 00:07:13.917 18:55:34 -- common/autotest_common.sh@931 -- # return 0 00:07:13.917 18:55:34 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:17.198 18:55:37 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:17.199 18:55:37 -- target/filesystem.sh@25 -- # sync 00:07:17.199 18:55:37 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:17.199 18:55:37 -- target/filesystem.sh@27 -- # sync 00:07:17.199 18:55:37 -- target/filesystem.sh@29 -- # i=0 00:07:17.199 18:55:37 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:17.199 18:55:37 -- target/filesystem.sh@37 -- # kill -0 105160 00:07:17.199 18:55:37 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:17.199 18:55:37 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:17.199 18:55:37 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:17.199 18:55:37 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:17.199 00:07:17.199 real 0m3.808s 00:07:17.199 user 0m0.012s 00:07:17.199 sys 0m0.105s 00:07:17.199 18:55:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:17.199 18:55:37 -- common/autotest_common.sh@10 -- # set +x 00:07:17.199 ************************************ 00:07:17.199 END TEST filesystem_xfs 00:07:17.199 ************************************ 00:07:17.199 18:55:37 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:17.199 18:55:37 -- target/filesystem.sh@93 -- # sync 00:07:17.199 18:55:37 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:17.199 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:17.199 18:55:37 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:17.199 18:55:37 -- common/autotest_common.sh@1208 -- # local i=0 00:07:17.199 18:55:37 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:07:17.199 18:55:37 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:17.199 18:55:37 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:07:17.199 18:55:37 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:17.199 18:55:37 -- common/autotest_common.sh@1220 -- # return 0 00:07:17.199 18:55:37 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:17.199 18:55:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:17.199 18:55:37 -- common/autotest_common.sh@10 -- # set +x 00:07:17.199 18:55:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:17.199 18:55:37 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:17.199 18:55:37 -- target/filesystem.sh@101 -- # killprocess 105160 00:07:17.199 18:55:37 -- common/autotest_common.sh@936 -- # '[' -z 105160 ']' 00:07:17.199 18:55:37 -- common/autotest_common.sh@940 -- # kill -0 105160 00:07:17.199 18:55:37 -- common/autotest_common.sh@941 -- # uname 00:07:17.199 18:55:37 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:17.199 18:55:37 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 105160 00:07:17.199 18:55:37 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:17.199 18:55:37 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:17.199 18:55:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 105160' 00:07:17.199 killing process with pid 105160 00:07:17.199 18:55:37 -- common/autotest_common.sh@955 -- # kill 105160 00:07:17.199 18:55:37 -- common/autotest_common.sh@960 -- # wait 105160 00:07:17.458 18:55:38 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:17.458 00:07:17.458 real 0m18.366s 00:07:17.458 user 1m10.927s 00:07:17.458 sys 0m2.464s 00:07:17.458 18:55:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:17.458 18:55:38 -- common/autotest_common.sh@10 -- # set +x 00:07:17.458 ************************************ 00:07:17.458 END TEST nvmf_filesystem_no_in_capsule 00:07:17.458 ************************************ 00:07:17.458 18:55:38 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:07:17.458 18:55:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:17.458 18:55:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:17.458 18:55:38 -- common/autotest_common.sh@10 -- # set +x 00:07:17.458 ************************************ 00:07:17.458 START TEST nvmf_filesystem_in_capsule 00:07:17.458 ************************************ 00:07:17.458 18:55:38 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 4096 00:07:17.458 18:55:38 -- target/filesystem.sh@47 -- # in_capsule=4096 00:07:17.458 18:55:38 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:07:17.458 18:55:38 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:17.458 18:55:38 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:17.458 18:55:38 -- common/autotest_common.sh@10 -- # set +x 00:07:17.458 18:55:38 -- nvmf/common.sh@469 -- # nvmfpid=107591 00:07:17.458 18:55:38 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:17.458 18:55:38 -- nvmf/common.sh@470 -- # waitforlisten 107591 00:07:17.458 18:55:38 -- common/autotest_common.sh@829 -- # '[' -z 107591 ']' 00:07:17.458 18:55:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:17.458 18:55:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:17.458 18:55:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:17.458 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:17.458 18:55:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:17.458 18:55:38 -- common/autotest_common.sh@10 -- # set +x 00:07:17.458 [2024-11-28 18:55:38.344901] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:17.458 [2024-11-28 18:55:38.345003] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:17.458 EAL: No free 2048 kB hugepages reported on node 1 00:07:17.458 [2024-11-28 18:55:38.410092] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:17.717 [2024-11-28 18:55:38.518907] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:17.717 [2024-11-28 18:55:38.519054] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:17.717 [2024-11-28 18:55:38.519072] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:17.717 [2024-11-28 18:55:38.519084] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:17.717 [2024-11-28 18:55:38.519149] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:17.717 [2024-11-28 18:55:38.519202] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:17.717 [2024-11-28 18:55:38.519267] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:17.717 [2024-11-28 18:55:38.519270] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:18.283 18:55:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:18.283 18:55:39 -- common/autotest_common.sh@862 -- # return 0 00:07:18.284 18:55:39 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:18.284 18:55:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:18.284 18:55:39 -- common/autotest_common.sh@10 -- # set +x 00:07:18.543 18:55:39 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:18.543 18:55:39 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:18.543 18:55:39 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:07:18.543 18:55:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:18.543 18:55:39 -- common/autotest_common.sh@10 -- # set +x 00:07:18.543 [2024-11-28 18:55:39.335922] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:18.543 18:55:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:18.543 18:55:39 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:18.543 18:55:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:18.543 18:55:39 -- common/autotest_common.sh@10 -- # set +x 00:07:18.543 Malloc1 00:07:18.543 18:55:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:18.543 18:55:39 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:18.543 18:55:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:18.543 18:55:39 -- common/autotest_common.sh@10 -- # set +x 00:07:18.543 18:55:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:18.543 18:55:39 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:18.543 18:55:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:18.543 18:55:39 -- common/autotest_common.sh@10 -- # set +x 00:07:18.543 18:55:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:18.543 18:55:39 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:18.543 18:55:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:18.543 18:55:39 -- common/autotest_common.sh@10 -- # set +x 00:07:18.543 [2024-11-28 18:55:39.503745] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:18.543 18:55:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:18.543 18:55:39 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:18.543 18:55:39 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:07:18.543 18:55:39 -- common/autotest_common.sh@1368 -- # local bdev_info 00:07:18.543 18:55:39 -- common/autotest_common.sh@1369 -- # local bs 00:07:18.543 18:55:39 -- common/autotest_common.sh@1370 -- # local nb 00:07:18.543 18:55:39 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:18.543 18:55:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:18.543 18:55:39 -- common/autotest_common.sh@10 -- # set +x 00:07:18.543 18:55:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:18.543 18:55:39 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:07:18.543 { 00:07:18.543 "name": "Malloc1", 00:07:18.543 "aliases": [ 00:07:18.543 "370d11c1-fec4-4089-807e-78302279e19d" 00:07:18.543 ], 00:07:18.543 "product_name": "Malloc disk", 00:07:18.543 "block_size": 512, 00:07:18.543 "num_blocks": 1048576, 00:07:18.543 "uuid": "370d11c1-fec4-4089-807e-78302279e19d", 00:07:18.543 "assigned_rate_limits": { 00:07:18.543 "rw_ios_per_sec": 0, 00:07:18.543 "rw_mbytes_per_sec": 0, 00:07:18.543 "r_mbytes_per_sec": 0, 00:07:18.543 "w_mbytes_per_sec": 0 00:07:18.543 }, 00:07:18.543 "claimed": true, 00:07:18.543 "claim_type": "exclusive_write", 00:07:18.543 "zoned": false, 00:07:18.543 "supported_io_types": { 00:07:18.543 "read": true, 00:07:18.543 "write": true, 00:07:18.543 "unmap": true, 00:07:18.543 "write_zeroes": true, 00:07:18.543 "flush": true, 00:07:18.543 "reset": true, 00:07:18.543 "compare": false, 00:07:18.543 "compare_and_write": false, 00:07:18.543 "abort": true, 00:07:18.543 "nvme_admin": false, 00:07:18.543 "nvme_io": false 00:07:18.543 }, 00:07:18.543 "memory_domains": [ 00:07:18.543 { 00:07:18.543 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:18.543 "dma_device_type": 2 00:07:18.543 } 00:07:18.543 ], 00:07:18.543 "driver_specific": {} 00:07:18.543 } 00:07:18.543 ]' 00:07:18.543 18:55:39 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:07:18.543 18:55:39 -- common/autotest_common.sh@1372 -- # bs=512 00:07:18.543 18:55:39 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:07:18.801 18:55:39 -- common/autotest_common.sh@1373 -- # nb=1048576 00:07:18.801 18:55:39 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:07:18.801 18:55:39 -- common/autotest_common.sh@1377 -- # echo 512 00:07:18.801 18:55:39 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:18.801 18:55:39 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:19.366 18:55:40 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:19.366 18:55:40 -- common/autotest_common.sh@1187 -- # local i=0 00:07:19.366 18:55:40 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:07:19.366 18:55:40 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:07:19.366 18:55:40 -- common/autotest_common.sh@1194 -- # sleep 2 00:07:21.264 18:55:42 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:07:21.264 18:55:42 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:07:21.264 18:55:42 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:07:21.522 18:55:42 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:07:21.522 18:55:42 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:07:21.522 18:55:42 -- common/autotest_common.sh@1197 -- # return 0 00:07:21.522 18:55:42 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:21.522 18:55:42 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:21.522 18:55:42 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:21.522 18:55:42 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:21.522 18:55:42 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:21.522 18:55:42 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:21.522 18:55:42 -- setup/common.sh@80 -- # echo 536870912 00:07:21.522 18:55:42 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:21.522 18:55:42 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:21.522 18:55:42 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:21.522 18:55:42 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:21.780 18:55:42 -- target/filesystem.sh@69 -- # partprobe 00:07:22.346 18:55:43 -- target/filesystem.sh@70 -- # sleep 1 00:07:23.721 18:55:44 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:07:23.721 18:55:44 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:23.721 18:55:44 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:23.721 18:55:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:23.721 18:55:44 -- common/autotest_common.sh@10 -- # set +x 00:07:23.721 ************************************ 00:07:23.721 START TEST filesystem_in_capsule_ext4 00:07:23.721 ************************************ 00:07:23.721 18:55:44 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:23.721 18:55:44 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:23.721 18:55:44 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:23.721 18:55:44 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:23.721 18:55:44 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:07:23.721 18:55:44 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:23.721 18:55:44 -- common/autotest_common.sh@914 -- # local i=0 00:07:23.721 18:55:44 -- common/autotest_common.sh@915 -- # local force 00:07:23.721 18:55:44 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:07:23.721 18:55:44 -- common/autotest_common.sh@918 -- # force=-F 00:07:23.721 18:55:44 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:23.721 mke2fs 1.47.0 (5-Feb-2023) 00:07:23.721 Discarding device blocks: 0/522240 done 00:07:23.721 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:23.721 Filesystem UUID: 4d4ef077-bf23-446a-99fd-9bb75148a917 00:07:23.721 Superblock backups stored on blocks: 00:07:23.721 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:23.721 00:07:23.721 Allocating group tables: 0/64 done 00:07:23.721 Writing inode tables: 0/64 done 00:07:23.721 Creating journal (8192 blocks): done 00:07:26.027 Writing superblocks and filesystem accounting information: 0/64 done 00:07:26.027 00:07:26.027 18:55:46 -- common/autotest_common.sh@931 -- # return 0 00:07:26.027 18:55:46 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:32.584 18:55:52 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:32.584 18:55:53 -- target/filesystem.sh@25 -- # sync 00:07:32.584 18:55:53 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:32.584 18:55:53 -- target/filesystem.sh@27 -- # sync 00:07:32.584 18:55:53 -- target/filesystem.sh@29 -- # i=0 00:07:32.584 18:55:53 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:32.584 18:55:53 -- target/filesystem.sh@37 -- # kill -0 107591 00:07:32.584 18:55:53 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:32.584 18:55:53 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:32.584 18:55:53 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:32.584 18:55:53 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:32.584 00:07:32.584 real 0m8.699s 00:07:32.584 user 0m0.020s 00:07:32.584 sys 0m0.063s 00:07:32.584 18:55:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:32.584 18:55:53 -- common/autotest_common.sh@10 -- # set +x 00:07:32.584 ************************************ 00:07:32.584 END TEST filesystem_in_capsule_ext4 00:07:32.584 ************************************ 00:07:32.584 18:55:53 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:32.584 18:55:53 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:32.584 18:55:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:32.584 18:55:53 -- common/autotest_common.sh@10 -- # set +x 00:07:32.584 ************************************ 00:07:32.584 START TEST filesystem_in_capsule_btrfs 00:07:32.584 ************************************ 00:07:32.584 18:55:53 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:32.584 18:55:53 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:32.584 18:55:53 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:32.584 18:55:53 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:32.584 18:55:53 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:07:32.584 18:55:53 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:32.584 18:55:53 -- common/autotest_common.sh@914 -- # local i=0 00:07:32.584 18:55:53 -- common/autotest_common.sh@915 -- # local force 00:07:32.584 18:55:53 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:07:32.584 18:55:53 -- common/autotest_common.sh@920 -- # force=-f 00:07:32.584 18:55:53 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:32.584 btrfs-progs v6.8.1 00:07:32.584 See https://btrfs.readthedocs.io for more information. 00:07:32.584 00:07:32.584 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:32.584 NOTE: several default settings have changed in version 5.15, please make sure 00:07:32.584 this does not affect your deployments: 00:07:32.584 - DUP for metadata (-m dup) 00:07:32.584 - enabled no-holes (-O no-holes) 00:07:32.584 - enabled free-space-tree (-R free-space-tree) 00:07:32.584 00:07:32.584 Label: (null) 00:07:32.584 UUID: 4c6b0bb6-2590-4085-9f6b-157e4c3c2a57 00:07:32.584 Node size: 16384 00:07:32.584 Sector size: 4096 (CPU page size: 4096) 00:07:32.584 Filesystem size: 510.00MiB 00:07:32.584 Block group profiles: 00:07:32.584 Data: single 8.00MiB 00:07:32.584 Metadata: DUP 32.00MiB 00:07:32.584 System: DUP 8.00MiB 00:07:32.584 SSD detected: yes 00:07:32.584 Zoned device: no 00:07:32.584 Features: extref, skinny-metadata, no-holes, free-space-tree 00:07:32.584 Checksum: crc32c 00:07:32.584 Number of devices: 1 00:07:32.584 Devices: 00:07:32.584 ID SIZE PATH 00:07:32.584 1 510.00MiB /dev/nvme0n1p1 00:07:32.584 00:07:32.584 18:55:53 -- common/autotest_common.sh@931 -- # return 0 00:07:32.584 18:55:53 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:32.584 18:55:53 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:32.584 18:55:53 -- target/filesystem.sh@25 -- # sync 00:07:32.584 18:55:53 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:32.584 18:55:53 -- target/filesystem.sh@27 -- # sync 00:07:32.584 18:55:53 -- target/filesystem.sh@29 -- # i=0 00:07:32.584 18:55:53 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:32.584 18:55:53 -- target/filesystem.sh@37 -- # kill -0 107591 00:07:32.584 18:55:53 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:32.584 18:55:53 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:32.584 18:55:53 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:32.584 18:55:53 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:32.584 00:07:32.584 real 0m0.469s 00:07:32.584 user 0m0.016s 00:07:32.584 sys 0m0.107s 00:07:32.584 18:55:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:32.584 18:55:53 -- common/autotest_common.sh@10 -- # set +x 00:07:32.584 ************************************ 00:07:32.584 END TEST filesystem_in_capsule_btrfs 00:07:32.584 ************************************ 00:07:32.584 18:55:53 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:07:32.584 18:55:53 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:32.584 18:55:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:32.584 18:55:53 -- common/autotest_common.sh@10 -- # set +x 00:07:32.584 ************************************ 00:07:32.584 START TEST filesystem_in_capsule_xfs 00:07:32.584 ************************************ 00:07:32.584 18:55:53 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:07:32.584 18:55:53 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:32.584 18:55:53 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:32.584 18:55:53 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:32.584 18:55:53 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:07:32.584 18:55:53 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:32.584 18:55:53 -- common/autotest_common.sh@914 -- # local i=0 00:07:32.584 18:55:53 -- common/autotest_common.sh@915 -- # local force 00:07:32.584 18:55:53 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:07:32.584 18:55:53 -- common/autotest_common.sh@920 -- # force=-f 00:07:32.584 18:55:53 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:32.843 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:32.843 = sectsz=512 attr=2, projid32bit=1 00:07:32.843 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:32.843 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:32.843 data = bsize=4096 blocks=130560, imaxpct=25 00:07:32.843 = sunit=0 swidth=0 blks 00:07:32.843 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:32.843 log =internal log bsize=4096 blocks=16384, version=2 00:07:32.843 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:32.843 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:33.778 Discarding blocks...Done. 00:07:33.778 18:55:54 -- common/autotest_common.sh@931 -- # return 0 00:07:33.778 18:55:54 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:36.306 18:55:57 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:36.306 18:55:57 -- target/filesystem.sh@25 -- # sync 00:07:36.306 18:55:57 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:36.306 18:55:57 -- target/filesystem.sh@27 -- # sync 00:07:36.306 18:55:57 -- target/filesystem.sh@29 -- # i=0 00:07:36.306 18:55:57 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:36.306 18:55:57 -- target/filesystem.sh@37 -- # kill -0 107591 00:07:36.306 18:55:57 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:36.306 18:55:57 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:36.306 18:55:57 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:36.306 18:55:57 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:36.306 00:07:36.306 real 0m3.727s 00:07:36.306 user 0m0.017s 00:07:36.306 sys 0m0.065s 00:07:36.306 18:55:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:36.306 18:55:57 -- common/autotest_common.sh@10 -- # set +x 00:07:36.306 ************************************ 00:07:36.306 END TEST filesystem_in_capsule_xfs 00:07:36.306 ************************************ 00:07:36.307 18:55:57 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:36.566 18:55:57 -- target/filesystem.sh@93 -- # sync 00:07:36.566 18:55:57 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:36.566 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:36.566 18:55:57 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:36.566 18:55:57 -- common/autotest_common.sh@1208 -- # local i=0 00:07:36.566 18:55:57 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:07:36.566 18:55:57 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:36.566 18:55:57 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:07:36.566 18:55:57 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:36.566 18:55:57 -- common/autotest_common.sh@1220 -- # return 0 00:07:36.566 18:55:57 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:36.566 18:55:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:36.566 18:55:57 -- common/autotest_common.sh@10 -- # set +x 00:07:36.566 18:55:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:36.566 18:55:57 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:36.566 18:55:57 -- target/filesystem.sh@101 -- # killprocess 107591 00:07:36.566 18:55:57 -- common/autotest_common.sh@936 -- # '[' -z 107591 ']' 00:07:36.566 18:55:57 -- common/autotest_common.sh@940 -- # kill -0 107591 00:07:36.566 18:55:57 -- common/autotest_common.sh@941 -- # uname 00:07:36.566 18:55:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:36.566 18:55:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 107591 00:07:36.566 18:55:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:36.566 18:55:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:36.566 18:55:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 107591' 00:07:36.566 killing process with pid 107591 00:07:36.566 18:55:57 -- common/autotest_common.sh@955 -- # kill 107591 00:07:36.566 18:55:57 -- common/autotest_common.sh@960 -- # wait 107591 00:07:37.134 18:55:58 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:37.134 00:07:37.134 real 0m19.733s 00:07:37.134 user 1m16.214s 00:07:37.134 sys 0m2.520s 00:07:37.134 18:55:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:37.134 18:55:58 -- common/autotest_common.sh@10 -- # set +x 00:07:37.134 ************************************ 00:07:37.134 END TEST nvmf_filesystem_in_capsule 00:07:37.134 ************************************ 00:07:37.134 18:55:58 -- target/filesystem.sh@108 -- # nvmftestfini 00:07:37.134 18:55:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:37.134 18:55:58 -- nvmf/common.sh@116 -- # sync 00:07:37.134 18:55:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:37.134 18:55:58 -- nvmf/common.sh@119 -- # set +e 00:07:37.134 18:55:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:37.134 18:55:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:37.134 rmmod nvme_tcp 00:07:37.134 rmmod nvme_fabrics 00:07:37.134 rmmod nvme_keyring 00:07:37.134 18:55:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:37.134 18:55:58 -- nvmf/common.sh@123 -- # set -e 00:07:37.134 18:55:58 -- nvmf/common.sh@124 -- # return 0 00:07:37.134 18:55:58 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:07:37.134 18:55:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:37.134 18:55:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:37.134 18:55:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:37.134 18:55:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:37.134 18:55:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:37.134 18:55:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:37.134 18:55:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:37.134 18:55:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:39.673 18:56:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:39.673 00:07:39.673 real 0m43.011s 00:07:39.673 user 2m28.322s 00:07:39.673 sys 0m6.734s 00:07:39.673 18:56:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:39.673 18:56:00 -- common/autotest_common.sh@10 -- # set +x 00:07:39.673 ************************************ 00:07:39.673 END TEST nvmf_filesystem 00:07:39.673 ************************************ 00:07:39.674 18:56:00 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:39.674 18:56:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:39.674 18:56:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:39.674 18:56:00 -- common/autotest_common.sh@10 -- # set +x 00:07:39.674 ************************************ 00:07:39.674 START TEST nvmf_discovery 00:07:39.674 ************************************ 00:07:39.674 18:56:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:39.674 * Looking for test storage... 00:07:39.674 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:39.674 18:56:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:39.674 18:56:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:39.674 18:56:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:39.674 18:56:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:39.674 18:56:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:39.674 18:56:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:39.674 18:56:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:39.674 18:56:00 -- scripts/common.sh@335 -- # IFS=.-: 00:07:39.674 18:56:00 -- scripts/common.sh@335 -- # read -ra ver1 00:07:39.674 18:56:00 -- scripts/common.sh@336 -- # IFS=.-: 00:07:39.674 18:56:00 -- scripts/common.sh@336 -- # read -ra ver2 00:07:39.674 18:56:00 -- scripts/common.sh@337 -- # local 'op=<' 00:07:39.674 18:56:00 -- scripts/common.sh@339 -- # ver1_l=2 00:07:39.674 18:56:00 -- scripts/common.sh@340 -- # ver2_l=1 00:07:39.674 18:56:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:39.674 18:56:00 -- scripts/common.sh@343 -- # case "$op" in 00:07:39.674 18:56:00 -- scripts/common.sh@344 -- # : 1 00:07:39.674 18:56:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:39.674 18:56:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:39.674 18:56:00 -- scripts/common.sh@364 -- # decimal 1 00:07:39.674 18:56:00 -- scripts/common.sh@352 -- # local d=1 00:07:39.674 18:56:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:39.674 18:56:00 -- scripts/common.sh@354 -- # echo 1 00:07:39.674 18:56:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:39.674 18:56:00 -- scripts/common.sh@365 -- # decimal 2 00:07:39.674 18:56:00 -- scripts/common.sh@352 -- # local d=2 00:07:39.674 18:56:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:39.674 18:56:00 -- scripts/common.sh@354 -- # echo 2 00:07:39.674 18:56:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:39.674 18:56:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:39.674 18:56:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:39.674 18:56:00 -- scripts/common.sh@367 -- # return 0 00:07:39.674 18:56:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:39.674 18:56:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:39.674 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:39.674 --rc genhtml_branch_coverage=1 00:07:39.674 --rc genhtml_function_coverage=1 00:07:39.674 --rc genhtml_legend=1 00:07:39.674 --rc geninfo_all_blocks=1 00:07:39.674 --rc geninfo_unexecuted_blocks=1 00:07:39.674 00:07:39.674 ' 00:07:39.674 18:56:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:39.674 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:39.674 --rc genhtml_branch_coverage=1 00:07:39.674 --rc genhtml_function_coverage=1 00:07:39.674 --rc genhtml_legend=1 00:07:39.674 --rc geninfo_all_blocks=1 00:07:39.674 --rc geninfo_unexecuted_blocks=1 00:07:39.674 00:07:39.674 ' 00:07:39.674 18:56:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:39.674 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:39.674 --rc genhtml_branch_coverage=1 00:07:39.674 --rc genhtml_function_coverage=1 00:07:39.674 --rc genhtml_legend=1 00:07:39.674 --rc geninfo_all_blocks=1 00:07:39.674 --rc geninfo_unexecuted_blocks=1 00:07:39.674 00:07:39.674 ' 00:07:39.674 18:56:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:39.674 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:39.674 --rc genhtml_branch_coverage=1 00:07:39.674 --rc genhtml_function_coverage=1 00:07:39.674 --rc genhtml_legend=1 00:07:39.674 --rc geninfo_all_blocks=1 00:07:39.674 --rc geninfo_unexecuted_blocks=1 00:07:39.674 00:07:39.674 ' 00:07:39.674 18:56:00 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:39.674 18:56:00 -- nvmf/common.sh@7 -- # uname -s 00:07:39.674 18:56:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:39.674 18:56:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:39.674 18:56:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:39.674 18:56:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:39.674 18:56:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:39.674 18:56:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:39.674 18:56:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:39.674 18:56:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:39.674 18:56:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:39.674 18:56:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:39.674 18:56:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:39.674 18:56:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:39.674 18:56:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:39.674 18:56:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:39.674 18:56:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:39.674 18:56:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:39.674 18:56:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:39.674 18:56:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:39.674 18:56:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:39.674 18:56:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:39.674 18:56:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:39.674 18:56:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:39.674 18:56:00 -- paths/export.sh@5 -- # export PATH 00:07:39.674 18:56:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:39.674 18:56:00 -- nvmf/common.sh@46 -- # : 0 00:07:39.674 18:56:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:39.674 18:56:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:39.674 18:56:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:39.674 18:56:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:39.674 18:56:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:39.674 18:56:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:39.674 18:56:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:39.674 18:56:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:39.674 18:56:00 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:07:39.674 18:56:00 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:07:39.674 18:56:00 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:07:39.674 18:56:00 -- target/discovery.sh@15 -- # hash nvme 00:07:39.674 18:56:00 -- target/discovery.sh@20 -- # nvmftestinit 00:07:39.674 18:56:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:39.674 18:56:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:39.674 18:56:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:39.674 18:56:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:39.674 18:56:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:39.674 18:56:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:39.674 18:56:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:39.674 18:56:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:39.674 18:56:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:39.674 18:56:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:39.674 18:56:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:39.674 18:56:00 -- common/autotest_common.sh@10 -- # set +x 00:07:41.580 18:56:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:41.580 18:56:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:41.580 18:56:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:41.580 18:56:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:41.580 18:56:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:41.580 18:56:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:41.580 18:56:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:41.580 18:56:02 -- nvmf/common.sh@294 -- # net_devs=() 00:07:41.580 18:56:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:41.580 18:56:02 -- nvmf/common.sh@295 -- # e810=() 00:07:41.580 18:56:02 -- nvmf/common.sh@295 -- # local -ga e810 00:07:41.580 18:56:02 -- nvmf/common.sh@296 -- # x722=() 00:07:41.580 18:56:02 -- nvmf/common.sh@296 -- # local -ga x722 00:07:41.580 18:56:02 -- nvmf/common.sh@297 -- # mlx=() 00:07:41.580 18:56:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:41.580 18:56:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:41.580 18:56:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:41.581 18:56:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:41.581 18:56:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:41.581 18:56:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:41.581 18:56:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:41.581 18:56:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:41.581 18:56:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:41.581 18:56:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:41.581 18:56:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:41.581 18:56:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:41.581 18:56:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:41.581 18:56:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:41.581 18:56:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:41.581 18:56:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:41.581 18:56:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:41.581 18:56:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:41.581 18:56:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:41.581 18:56:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:41.581 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:41.581 18:56:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:41.581 18:56:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:41.581 18:56:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:41.581 18:56:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:41.581 18:56:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:41.581 18:56:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:41.581 18:56:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:41.581 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:41.581 18:56:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:41.581 18:56:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:41.581 18:56:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:41.581 18:56:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:41.581 18:56:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:41.581 18:56:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:41.581 18:56:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:41.581 18:56:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:41.581 18:56:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:41.581 18:56:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:41.581 18:56:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:41.581 18:56:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:41.581 18:56:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:41.581 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:41.581 18:56:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:41.581 18:56:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:41.581 18:56:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:41.581 18:56:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:41.581 18:56:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:41.581 18:56:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:41.581 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:41.581 18:56:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:41.581 18:56:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:41.581 18:56:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:41.581 18:56:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:41.581 18:56:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:41.581 18:56:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:41.581 18:56:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:41.581 18:56:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:41.581 18:56:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:41.581 18:56:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:41.581 18:56:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:41.581 18:56:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:41.581 18:56:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:41.581 18:56:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:41.581 18:56:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:41.581 18:56:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:41.581 18:56:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:41.581 18:56:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:41.581 18:56:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:41.581 18:56:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:41.581 18:56:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:41.581 18:56:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:41.581 18:56:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:41.581 18:56:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:41.581 18:56:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:41.581 18:56:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:41.840 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:41.840 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.201 ms 00:07:41.841 00:07:41.841 --- 10.0.0.2 ping statistics --- 00:07:41.841 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:41.841 rtt min/avg/max/mdev = 0.201/0.201/0.201/0.000 ms 00:07:41.841 18:56:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:41.841 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:41.841 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.160 ms 00:07:41.841 00:07:41.841 --- 10.0.0.1 ping statistics --- 00:07:41.841 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:41.841 rtt min/avg/max/mdev = 0.160/0.160/0.160/0.000 ms 00:07:41.841 18:56:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:41.841 18:56:02 -- nvmf/common.sh@410 -- # return 0 00:07:41.841 18:56:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:41.841 18:56:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:41.841 18:56:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:41.841 18:56:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:41.841 18:56:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:41.841 18:56:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:41.841 18:56:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:41.841 18:56:02 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:07:41.841 18:56:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:41.841 18:56:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:41.841 18:56:02 -- common/autotest_common.sh@10 -- # set +x 00:07:41.841 18:56:02 -- nvmf/common.sh@469 -- # nvmfpid=112217 00:07:41.841 18:56:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:41.841 18:56:02 -- nvmf/common.sh@470 -- # waitforlisten 112217 00:07:41.841 18:56:02 -- common/autotest_common.sh@829 -- # '[' -z 112217 ']' 00:07:41.841 18:56:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:41.841 18:56:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:41.841 18:56:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:41.841 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:41.841 18:56:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:41.841 18:56:02 -- common/autotest_common.sh@10 -- # set +x 00:07:41.841 [2024-11-28 18:56:02.707688] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:41.841 [2024-11-28 18:56:02.707777] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:41.841 EAL: No free 2048 kB hugepages reported on node 1 00:07:41.841 [2024-11-28 18:56:02.783186] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:42.099 [2024-11-28 18:56:02.908049] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:42.099 [2024-11-28 18:56:02.908206] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:42.099 [2024-11-28 18:56:02.908225] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:42.099 [2024-11-28 18:56:02.908240] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:42.099 [2024-11-28 18:56:02.910421] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:42.099 [2024-11-28 18:56:02.910460] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:42.099 [2024-11-28 18:56:02.910513] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:42.099 [2024-11-28 18:56:02.910517] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:43.034 18:56:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:43.034 18:56:03 -- common/autotest_common.sh@862 -- # return 0 00:07:43.034 18:56:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:43.034 18:56:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:43.034 18:56:03 -- common/autotest_common.sh@10 -- # set +x 00:07:43.034 18:56:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:43.034 18:56:03 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:43.034 18:56:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.034 18:56:03 -- common/autotest_common.sh@10 -- # set +x 00:07:43.034 [2024-11-28 18:56:03.768125] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:43.034 18:56:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.034 18:56:03 -- target/discovery.sh@26 -- # seq 1 4 00:07:43.034 18:56:03 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:43.034 18:56:03 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:07:43.034 18:56:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.034 18:56:03 -- common/autotest_common.sh@10 -- # set +x 00:07:43.034 Null1 00:07:43.034 18:56:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.034 18:56:03 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:43.034 18:56:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.034 18:56:03 -- common/autotest_common.sh@10 -- # set +x 00:07:43.034 18:56:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.034 18:56:03 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:07:43.034 18:56:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.034 18:56:03 -- common/autotest_common.sh@10 -- # set +x 00:07:43.035 18:56:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.035 18:56:03 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:43.035 18:56:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.035 18:56:03 -- common/autotest_common.sh@10 -- # set +x 00:07:43.035 [2024-11-28 18:56:03.816513] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:43.035 18:56:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.035 18:56:03 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:43.035 18:56:03 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:07:43.035 18:56:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.035 18:56:03 -- common/autotest_common.sh@10 -- # set +x 00:07:43.035 Null2 00:07:43.035 18:56:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.035 18:56:03 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:07:43.035 18:56:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.035 18:56:03 -- common/autotest_common.sh@10 -- # set +x 00:07:43.035 18:56:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.035 18:56:03 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:07:43.035 18:56:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.035 18:56:03 -- common/autotest_common.sh@10 -- # set +x 00:07:43.035 18:56:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.035 18:56:03 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:07:43.035 18:56:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.035 18:56:03 -- common/autotest_common.sh@10 -- # set +x 00:07:43.035 18:56:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.035 18:56:03 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:43.035 18:56:03 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:07:43.035 18:56:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.035 18:56:03 -- common/autotest_common.sh@10 -- # set +x 00:07:43.035 Null3 00:07:43.035 18:56:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.035 18:56:03 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:07:43.035 18:56:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.035 18:56:03 -- common/autotest_common.sh@10 -- # set +x 00:07:43.035 18:56:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.035 18:56:03 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:07:43.035 18:56:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.035 18:56:03 -- common/autotest_common.sh@10 -- # set +x 00:07:43.035 18:56:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.035 18:56:03 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:07:43.035 18:56:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.035 18:56:03 -- common/autotest_common.sh@10 -- # set +x 00:07:43.035 18:56:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.035 18:56:03 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:43.035 18:56:03 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:07:43.035 18:56:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.035 18:56:03 -- common/autotest_common.sh@10 -- # set +x 00:07:43.035 Null4 00:07:43.035 18:56:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.035 18:56:03 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:07:43.035 18:56:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.035 18:56:03 -- common/autotest_common.sh@10 -- # set +x 00:07:43.035 18:56:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.035 18:56:03 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:07:43.035 18:56:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.035 18:56:03 -- common/autotest_common.sh@10 -- # set +x 00:07:43.035 18:56:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.035 18:56:03 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:07:43.035 18:56:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.035 18:56:03 -- common/autotest_common.sh@10 -- # set +x 00:07:43.035 18:56:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.035 18:56:03 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:07:43.035 18:56:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.035 18:56:03 -- common/autotest_common.sh@10 -- # set +x 00:07:43.035 18:56:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.035 18:56:03 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:07:43.035 18:56:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.035 18:56:03 -- common/autotest_common.sh@10 -- # set +x 00:07:43.035 18:56:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.035 18:56:03 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:07:43.293 00:07:43.293 Discovery Log Number of Records 6, Generation counter 6 00:07:43.293 =====Discovery Log Entry 0====== 00:07:43.294 trtype: tcp 00:07:43.294 adrfam: ipv4 00:07:43.294 subtype: current discovery subsystem 00:07:43.294 treq: not required 00:07:43.294 portid: 0 00:07:43.294 trsvcid: 4420 00:07:43.294 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:43.294 traddr: 10.0.0.2 00:07:43.294 eflags: explicit discovery connections, duplicate discovery information 00:07:43.294 sectype: none 00:07:43.294 =====Discovery Log Entry 1====== 00:07:43.294 trtype: tcp 00:07:43.294 adrfam: ipv4 00:07:43.294 subtype: nvme subsystem 00:07:43.294 treq: not required 00:07:43.294 portid: 0 00:07:43.294 trsvcid: 4420 00:07:43.294 subnqn: nqn.2016-06.io.spdk:cnode1 00:07:43.294 traddr: 10.0.0.2 00:07:43.294 eflags: none 00:07:43.294 sectype: none 00:07:43.294 =====Discovery Log Entry 2====== 00:07:43.294 trtype: tcp 00:07:43.294 adrfam: ipv4 00:07:43.294 subtype: nvme subsystem 00:07:43.294 treq: not required 00:07:43.294 portid: 0 00:07:43.294 trsvcid: 4420 00:07:43.294 subnqn: nqn.2016-06.io.spdk:cnode2 00:07:43.294 traddr: 10.0.0.2 00:07:43.294 eflags: none 00:07:43.294 sectype: none 00:07:43.294 =====Discovery Log Entry 3====== 00:07:43.294 trtype: tcp 00:07:43.294 adrfam: ipv4 00:07:43.294 subtype: nvme subsystem 00:07:43.294 treq: not required 00:07:43.294 portid: 0 00:07:43.294 trsvcid: 4420 00:07:43.294 subnqn: nqn.2016-06.io.spdk:cnode3 00:07:43.294 traddr: 10.0.0.2 00:07:43.294 eflags: none 00:07:43.294 sectype: none 00:07:43.294 =====Discovery Log Entry 4====== 00:07:43.294 trtype: tcp 00:07:43.294 adrfam: ipv4 00:07:43.294 subtype: nvme subsystem 00:07:43.294 treq: not required 00:07:43.294 portid: 0 00:07:43.294 trsvcid: 4420 00:07:43.294 subnqn: nqn.2016-06.io.spdk:cnode4 00:07:43.294 traddr: 10.0.0.2 00:07:43.294 eflags: none 00:07:43.294 sectype: none 00:07:43.294 =====Discovery Log Entry 5====== 00:07:43.294 trtype: tcp 00:07:43.294 adrfam: ipv4 00:07:43.294 subtype: discovery subsystem referral 00:07:43.294 treq: not required 00:07:43.294 portid: 0 00:07:43.294 trsvcid: 4430 00:07:43.294 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:43.294 traddr: 10.0.0.2 00:07:43.294 eflags: none 00:07:43.294 sectype: none 00:07:43.294 18:56:04 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:07:43.294 Perform nvmf subsystem discovery via RPC 00:07:43.294 18:56:04 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:07:43.294 18:56:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.294 18:56:04 -- common/autotest_common.sh@10 -- # set +x 00:07:43.294 [2024-11-28 18:56:04.109284] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:07:43.294 [ 00:07:43.294 { 00:07:43.294 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:07:43.294 "subtype": "Discovery", 00:07:43.294 "listen_addresses": [ 00:07:43.294 { 00:07:43.294 "transport": "TCP", 00:07:43.294 "trtype": "TCP", 00:07:43.294 "adrfam": "IPv4", 00:07:43.294 "traddr": "10.0.0.2", 00:07:43.294 "trsvcid": "4420" 00:07:43.294 } 00:07:43.294 ], 00:07:43.294 "allow_any_host": true, 00:07:43.294 "hosts": [] 00:07:43.294 }, 00:07:43.294 { 00:07:43.294 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:07:43.294 "subtype": "NVMe", 00:07:43.294 "listen_addresses": [ 00:07:43.294 { 00:07:43.294 "transport": "TCP", 00:07:43.294 "trtype": "TCP", 00:07:43.294 "adrfam": "IPv4", 00:07:43.294 "traddr": "10.0.0.2", 00:07:43.294 "trsvcid": "4420" 00:07:43.294 } 00:07:43.294 ], 00:07:43.294 "allow_any_host": true, 00:07:43.294 "hosts": [], 00:07:43.294 "serial_number": "SPDK00000000000001", 00:07:43.294 "model_number": "SPDK bdev Controller", 00:07:43.294 "max_namespaces": 32, 00:07:43.294 "min_cntlid": 1, 00:07:43.294 "max_cntlid": 65519, 00:07:43.294 "namespaces": [ 00:07:43.294 { 00:07:43.294 "nsid": 1, 00:07:43.294 "bdev_name": "Null1", 00:07:43.294 "name": "Null1", 00:07:43.294 "nguid": "6292B2A6AA694C95823B6FD49B1A2914", 00:07:43.294 "uuid": "6292b2a6-aa69-4c95-823b-6fd49b1a2914" 00:07:43.294 } 00:07:43.294 ] 00:07:43.294 }, 00:07:43.294 { 00:07:43.294 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:07:43.294 "subtype": "NVMe", 00:07:43.294 "listen_addresses": [ 00:07:43.294 { 00:07:43.294 "transport": "TCP", 00:07:43.294 "trtype": "TCP", 00:07:43.294 "adrfam": "IPv4", 00:07:43.294 "traddr": "10.0.0.2", 00:07:43.294 "trsvcid": "4420" 00:07:43.294 } 00:07:43.294 ], 00:07:43.294 "allow_any_host": true, 00:07:43.294 "hosts": [], 00:07:43.294 "serial_number": "SPDK00000000000002", 00:07:43.294 "model_number": "SPDK bdev Controller", 00:07:43.294 "max_namespaces": 32, 00:07:43.294 "min_cntlid": 1, 00:07:43.294 "max_cntlid": 65519, 00:07:43.294 "namespaces": [ 00:07:43.294 { 00:07:43.294 "nsid": 1, 00:07:43.294 "bdev_name": "Null2", 00:07:43.294 "name": "Null2", 00:07:43.294 "nguid": "A6184E948EF546DDA5A29C60938B95FD", 00:07:43.294 "uuid": "a6184e94-8ef5-46dd-a5a2-9c60938b95fd" 00:07:43.294 } 00:07:43.294 ] 00:07:43.294 }, 00:07:43.294 { 00:07:43.294 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:07:43.294 "subtype": "NVMe", 00:07:43.294 "listen_addresses": [ 00:07:43.294 { 00:07:43.294 "transport": "TCP", 00:07:43.294 "trtype": "TCP", 00:07:43.294 "adrfam": "IPv4", 00:07:43.294 "traddr": "10.0.0.2", 00:07:43.294 "trsvcid": "4420" 00:07:43.294 } 00:07:43.294 ], 00:07:43.294 "allow_any_host": true, 00:07:43.294 "hosts": [], 00:07:43.294 "serial_number": "SPDK00000000000003", 00:07:43.294 "model_number": "SPDK bdev Controller", 00:07:43.294 "max_namespaces": 32, 00:07:43.294 "min_cntlid": 1, 00:07:43.294 "max_cntlid": 65519, 00:07:43.294 "namespaces": [ 00:07:43.294 { 00:07:43.294 "nsid": 1, 00:07:43.294 "bdev_name": "Null3", 00:07:43.294 "name": "Null3", 00:07:43.294 "nguid": "961A3010B904496F80B4F35B5899770F", 00:07:43.294 "uuid": "961a3010-b904-496f-80b4-f35b5899770f" 00:07:43.294 } 00:07:43.294 ] 00:07:43.294 }, 00:07:43.294 { 00:07:43.294 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:07:43.294 "subtype": "NVMe", 00:07:43.294 "listen_addresses": [ 00:07:43.294 { 00:07:43.294 "transport": "TCP", 00:07:43.294 "trtype": "TCP", 00:07:43.294 "adrfam": "IPv4", 00:07:43.294 "traddr": "10.0.0.2", 00:07:43.294 "trsvcid": "4420" 00:07:43.294 } 00:07:43.294 ], 00:07:43.294 "allow_any_host": true, 00:07:43.294 "hosts": [], 00:07:43.294 "serial_number": "SPDK00000000000004", 00:07:43.294 "model_number": "SPDK bdev Controller", 00:07:43.294 "max_namespaces": 32, 00:07:43.294 "min_cntlid": 1, 00:07:43.294 "max_cntlid": 65519, 00:07:43.294 "namespaces": [ 00:07:43.294 { 00:07:43.294 "nsid": 1, 00:07:43.294 "bdev_name": "Null4", 00:07:43.294 "name": "Null4", 00:07:43.294 "nguid": "6BD90E72310147CFAEC54375AD8A3305", 00:07:43.294 "uuid": "6bd90e72-3101-47cf-aec5-4375ad8a3305" 00:07:43.294 } 00:07:43.294 ] 00:07:43.294 } 00:07:43.294 ] 00:07:43.294 18:56:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.294 18:56:04 -- target/discovery.sh@42 -- # seq 1 4 00:07:43.294 18:56:04 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:43.294 18:56:04 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:43.294 18:56:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.294 18:56:04 -- common/autotest_common.sh@10 -- # set +x 00:07:43.294 18:56:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.294 18:56:04 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:07:43.294 18:56:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.294 18:56:04 -- common/autotest_common.sh@10 -- # set +x 00:07:43.294 18:56:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.294 18:56:04 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:43.294 18:56:04 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:07:43.294 18:56:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.294 18:56:04 -- common/autotest_common.sh@10 -- # set +x 00:07:43.294 18:56:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.294 18:56:04 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:07:43.294 18:56:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.294 18:56:04 -- common/autotest_common.sh@10 -- # set +x 00:07:43.294 18:56:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.294 18:56:04 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:43.294 18:56:04 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:07:43.294 18:56:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.294 18:56:04 -- common/autotest_common.sh@10 -- # set +x 00:07:43.294 18:56:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.294 18:56:04 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:07:43.294 18:56:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.294 18:56:04 -- common/autotest_common.sh@10 -- # set +x 00:07:43.294 18:56:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.294 18:56:04 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:43.294 18:56:04 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:07:43.294 18:56:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.294 18:56:04 -- common/autotest_common.sh@10 -- # set +x 00:07:43.294 18:56:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.294 18:56:04 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:07:43.294 18:56:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.294 18:56:04 -- common/autotest_common.sh@10 -- # set +x 00:07:43.294 18:56:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.294 18:56:04 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:07:43.294 18:56:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.295 18:56:04 -- common/autotest_common.sh@10 -- # set +x 00:07:43.295 18:56:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.295 18:56:04 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:07:43.295 18:56:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:43.295 18:56:04 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:07:43.295 18:56:04 -- common/autotest_common.sh@10 -- # set +x 00:07:43.295 18:56:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:43.295 18:56:04 -- target/discovery.sh@49 -- # check_bdevs= 00:07:43.295 18:56:04 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:07:43.295 18:56:04 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:07:43.295 18:56:04 -- target/discovery.sh@57 -- # nvmftestfini 00:07:43.295 18:56:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:43.295 18:56:04 -- nvmf/common.sh@116 -- # sync 00:07:43.295 18:56:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:43.295 18:56:04 -- nvmf/common.sh@119 -- # set +e 00:07:43.295 18:56:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:43.295 18:56:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:43.295 rmmod nvme_tcp 00:07:43.295 rmmod nvme_fabrics 00:07:43.295 rmmod nvme_keyring 00:07:43.295 18:56:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:43.295 18:56:04 -- nvmf/common.sh@123 -- # set -e 00:07:43.295 18:56:04 -- nvmf/common.sh@124 -- # return 0 00:07:43.295 18:56:04 -- nvmf/common.sh@477 -- # '[' -n 112217 ']' 00:07:43.295 18:56:04 -- nvmf/common.sh@478 -- # killprocess 112217 00:07:43.295 18:56:04 -- common/autotest_common.sh@936 -- # '[' -z 112217 ']' 00:07:43.295 18:56:04 -- common/autotest_common.sh@940 -- # kill -0 112217 00:07:43.295 18:56:04 -- common/autotest_common.sh@941 -- # uname 00:07:43.295 18:56:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:43.295 18:56:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 112217 00:07:43.295 18:56:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:43.295 18:56:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:43.295 18:56:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 112217' 00:07:43.295 killing process with pid 112217 00:07:43.295 18:56:04 -- common/autotest_common.sh@955 -- # kill 112217 00:07:43.295 [2024-11-28 18:56:04.328681] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:07:43.295 18:56:04 -- common/autotest_common.sh@960 -- # wait 112217 00:07:43.567 18:56:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:43.567 18:56:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:43.567 18:56:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:43.567 18:56:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:43.567 18:56:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:43.567 18:56:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:43.567 18:56:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:43.567 18:56:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:46.181 18:56:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:46.181 00:07:46.181 real 0m6.469s 00:07:46.181 user 0m7.792s 00:07:46.181 sys 0m2.028s 00:07:46.181 18:56:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:46.181 18:56:06 -- common/autotest_common.sh@10 -- # set +x 00:07:46.181 ************************************ 00:07:46.181 END TEST nvmf_discovery 00:07:46.181 ************************************ 00:07:46.181 18:56:06 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:46.181 18:56:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:46.181 18:56:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:46.181 18:56:06 -- common/autotest_common.sh@10 -- # set +x 00:07:46.181 ************************************ 00:07:46.181 START TEST nvmf_referrals 00:07:46.181 ************************************ 00:07:46.181 18:56:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:46.181 * Looking for test storage... 00:07:46.181 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:46.181 18:56:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:46.181 18:56:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:46.181 18:56:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:46.181 18:56:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:46.181 18:56:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:46.181 18:56:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:46.181 18:56:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:46.181 18:56:06 -- scripts/common.sh@335 -- # IFS=.-: 00:07:46.181 18:56:06 -- scripts/common.sh@335 -- # read -ra ver1 00:07:46.181 18:56:06 -- scripts/common.sh@336 -- # IFS=.-: 00:07:46.181 18:56:06 -- scripts/common.sh@336 -- # read -ra ver2 00:07:46.181 18:56:06 -- scripts/common.sh@337 -- # local 'op=<' 00:07:46.181 18:56:06 -- scripts/common.sh@339 -- # ver1_l=2 00:07:46.181 18:56:06 -- scripts/common.sh@340 -- # ver2_l=1 00:07:46.181 18:56:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:46.181 18:56:06 -- scripts/common.sh@343 -- # case "$op" in 00:07:46.181 18:56:06 -- scripts/common.sh@344 -- # : 1 00:07:46.181 18:56:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:46.181 18:56:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:46.181 18:56:06 -- scripts/common.sh@364 -- # decimal 1 00:07:46.181 18:56:06 -- scripts/common.sh@352 -- # local d=1 00:07:46.181 18:56:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:46.181 18:56:06 -- scripts/common.sh@354 -- # echo 1 00:07:46.181 18:56:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:46.181 18:56:06 -- scripts/common.sh@365 -- # decimal 2 00:07:46.181 18:56:06 -- scripts/common.sh@352 -- # local d=2 00:07:46.181 18:56:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:46.181 18:56:06 -- scripts/common.sh@354 -- # echo 2 00:07:46.181 18:56:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:46.181 18:56:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:46.181 18:56:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:46.181 18:56:06 -- scripts/common.sh@367 -- # return 0 00:07:46.181 18:56:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:46.181 18:56:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:46.181 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:46.181 --rc genhtml_branch_coverage=1 00:07:46.181 --rc genhtml_function_coverage=1 00:07:46.181 --rc genhtml_legend=1 00:07:46.181 --rc geninfo_all_blocks=1 00:07:46.181 --rc geninfo_unexecuted_blocks=1 00:07:46.181 00:07:46.181 ' 00:07:46.181 18:56:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:46.181 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:46.181 --rc genhtml_branch_coverage=1 00:07:46.181 --rc genhtml_function_coverage=1 00:07:46.181 --rc genhtml_legend=1 00:07:46.181 --rc geninfo_all_blocks=1 00:07:46.181 --rc geninfo_unexecuted_blocks=1 00:07:46.181 00:07:46.181 ' 00:07:46.181 18:56:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:46.181 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:46.181 --rc genhtml_branch_coverage=1 00:07:46.181 --rc genhtml_function_coverage=1 00:07:46.182 --rc genhtml_legend=1 00:07:46.182 --rc geninfo_all_blocks=1 00:07:46.182 --rc geninfo_unexecuted_blocks=1 00:07:46.182 00:07:46.182 ' 00:07:46.182 18:56:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:46.182 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:46.182 --rc genhtml_branch_coverage=1 00:07:46.182 --rc genhtml_function_coverage=1 00:07:46.182 --rc genhtml_legend=1 00:07:46.182 --rc geninfo_all_blocks=1 00:07:46.182 --rc geninfo_unexecuted_blocks=1 00:07:46.182 00:07:46.182 ' 00:07:46.182 18:56:06 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:46.182 18:56:06 -- nvmf/common.sh@7 -- # uname -s 00:07:46.182 18:56:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:46.182 18:56:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:46.182 18:56:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:46.182 18:56:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:46.182 18:56:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:46.182 18:56:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:46.182 18:56:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:46.182 18:56:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:46.182 18:56:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:46.182 18:56:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:46.182 18:56:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:46.182 18:56:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:46.182 18:56:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:46.182 18:56:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:46.182 18:56:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:46.182 18:56:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:46.182 18:56:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:46.182 18:56:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:46.182 18:56:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:46.182 18:56:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:46.182 18:56:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:46.182 18:56:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:46.182 18:56:06 -- paths/export.sh@5 -- # export PATH 00:07:46.182 18:56:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:46.182 18:56:06 -- nvmf/common.sh@46 -- # : 0 00:07:46.182 18:56:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:46.182 18:56:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:46.182 18:56:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:46.182 18:56:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:46.182 18:56:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:46.182 18:56:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:46.182 18:56:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:46.182 18:56:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:46.182 18:56:06 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:07:46.182 18:56:06 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:07:46.182 18:56:06 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:07:46.182 18:56:06 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:07:46.182 18:56:06 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:07:46.182 18:56:06 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:07:46.182 18:56:06 -- target/referrals.sh@37 -- # nvmftestinit 00:07:46.182 18:56:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:46.182 18:56:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:46.182 18:56:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:46.182 18:56:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:46.182 18:56:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:46.182 18:56:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:46.182 18:56:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:46.182 18:56:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:46.182 18:56:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:46.182 18:56:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:46.182 18:56:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:46.182 18:56:06 -- common/autotest_common.sh@10 -- # set +x 00:07:48.200 18:56:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:48.200 18:56:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:48.200 18:56:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:48.200 18:56:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:48.200 18:56:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:48.200 18:56:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:48.200 18:56:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:48.200 18:56:08 -- nvmf/common.sh@294 -- # net_devs=() 00:07:48.200 18:56:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:48.200 18:56:08 -- nvmf/common.sh@295 -- # e810=() 00:07:48.200 18:56:08 -- nvmf/common.sh@295 -- # local -ga e810 00:07:48.200 18:56:08 -- nvmf/common.sh@296 -- # x722=() 00:07:48.200 18:56:08 -- nvmf/common.sh@296 -- # local -ga x722 00:07:48.200 18:56:08 -- nvmf/common.sh@297 -- # mlx=() 00:07:48.200 18:56:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:48.200 18:56:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:48.200 18:56:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:48.200 18:56:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:48.200 18:56:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:48.200 18:56:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:48.200 18:56:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:48.200 18:56:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:48.200 18:56:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:48.200 18:56:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:48.200 18:56:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:48.200 18:56:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:48.200 18:56:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:48.200 18:56:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:48.200 18:56:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:48.200 18:56:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:48.200 18:56:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:48.200 18:56:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:48.200 18:56:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:48.200 18:56:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:48.200 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:48.200 18:56:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:48.200 18:56:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:48.200 18:56:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:48.200 18:56:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:48.200 18:56:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:48.200 18:56:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:48.200 18:56:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:48.200 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:48.200 18:56:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:48.200 18:56:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:48.200 18:56:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:48.200 18:56:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:48.200 18:56:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:48.200 18:56:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:48.200 18:56:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:48.200 18:56:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:48.200 18:56:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:48.200 18:56:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:48.200 18:56:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:48.200 18:56:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:48.200 18:56:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:48.200 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:48.200 18:56:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:48.200 18:56:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:48.200 18:56:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:48.200 18:56:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:48.200 18:56:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:48.200 18:56:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:48.200 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:48.200 18:56:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:48.200 18:56:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:48.200 18:56:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:48.200 18:56:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:48.200 18:56:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:48.200 18:56:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:48.200 18:56:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:48.200 18:56:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:48.200 18:56:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:48.200 18:56:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:48.200 18:56:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:48.200 18:56:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:48.200 18:56:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:48.200 18:56:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:48.200 18:56:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:48.200 18:56:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:48.200 18:56:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:48.200 18:56:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:48.200 18:56:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:48.200 18:56:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:48.200 18:56:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:48.200 18:56:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:48.200 18:56:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:48.200 18:56:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:48.200 18:56:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:48.200 18:56:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:48.486 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:48.486 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.127 ms 00:07:48.486 00:07:48.486 --- 10.0.0.2 ping statistics --- 00:07:48.486 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:48.486 rtt min/avg/max/mdev = 0.127/0.127/0.127/0.000 ms 00:07:48.486 18:56:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:48.486 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:48.486 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.071 ms 00:07:48.486 00:07:48.486 --- 10.0.0.1 ping statistics --- 00:07:48.486 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:48.486 rtt min/avg/max/mdev = 0.071/0.071/0.071/0.000 ms 00:07:48.486 18:56:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:48.486 18:56:09 -- nvmf/common.sh@410 -- # return 0 00:07:48.486 18:56:09 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:48.486 18:56:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:48.486 18:56:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:48.486 18:56:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:48.486 18:56:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:48.486 18:56:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:48.486 18:56:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:48.486 18:56:09 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:07:48.486 18:56:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:48.486 18:56:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:48.486 18:56:09 -- common/autotest_common.sh@10 -- # set +x 00:07:48.486 18:56:09 -- nvmf/common.sh@469 -- # nvmfpid=114394 00:07:48.486 18:56:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:48.486 18:56:09 -- nvmf/common.sh@470 -- # waitforlisten 114394 00:07:48.486 18:56:09 -- common/autotest_common.sh@829 -- # '[' -z 114394 ']' 00:07:48.486 18:56:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:48.486 18:56:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:48.486 18:56:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:48.486 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:48.486 18:56:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:48.486 18:56:09 -- common/autotest_common.sh@10 -- # set +x 00:07:48.486 [2024-11-28 18:56:09.305763] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:48.486 [2024-11-28 18:56:09.305845] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:48.486 EAL: No free 2048 kB hugepages reported on node 1 00:07:48.486 [2024-11-28 18:56:09.373233] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:48.486 [2024-11-28 18:56:09.491747] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:48.486 [2024-11-28 18:56:09.491913] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:48.486 [2024-11-28 18:56:09.491933] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:48.486 [2024-11-28 18:56:09.491948] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:48.486 [2024-11-28 18:56:09.492033] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:48.486 [2024-11-28 18:56:09.492098] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:48.486 [2024-11-28 18:56:09.492152] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:48.486 [2024-11-28 18:56:09.492154] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:49.499 18:56:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:49.499 18:56:10 -- common/autotest_common.sh@862 -- # return 0 00:07:49.499 18:56:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:49.499 18:56:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:49.499 18:56:10 -- common/autotest_common.sh@10 -- # set +x 00:07:49.499 18:56:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:49.499 18:56:10 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:49.499 18:56:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.499 18:56:10 -- common/autotest_common.sh@10 -- # set +x 00:07:49.499 [2024-11-28 18:56:10.300940] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:49.499 18:56:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.499 18:56:10 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:07:49.499 18:56:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.499 18:56:10 -- common/autotest_common.sh@10 -- # set +x 00:07:49.499 [2024-11-28 18:56:10.313205] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:07:49.499 18:56:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.499 18:56:10 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:07:49.499 18:56:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.499 18:56:10 -- common/autotest_common.sh@10 -- # set +x 00:07:49.499 18:56:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.499 18:56:10 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:07:49.499 18:56:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.499 18:56:10 -- common/autotest_common.sh@10 -- # set +x 00:07:49.499 18:56:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.499 18:56:10 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:07:49.499 18:56:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.499 18:56:10 -- common/autotest_common.sh@10 -- # set +x 00:07:49.500 18:56:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.500 18:56:10 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:49.500 18:56:10 -- target/referrals.sh@48 -- # jq length 00:07:49.500 18:56:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.500 18:56:10 -- common/autotest_common.sh@10 -- # set +x 00:07:49.500 18:56:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.500 18:56:10 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:07:49.500 18:56:10 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:07:49.500 18:56:10 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:49.500 18:56:10 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:49.500 18:56:10 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:49.500 18:56:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.500 18:56:10 -- target/referrals.sh@21 -- # sort 00:07:49.500 18:56:10 -- common/autotest_common.sh@10 -- # set +x 00:07:49.500 18:56:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.500 18:56:10 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:49.500 18:56:10 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:49.500 18:56:10 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:07:49.500 18:56:10 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:49.500 18:56:10 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:49.500 18:56:10 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:49.500 18:56:10 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:49.500 18:56:10 -- target/referrals.sh@26 -- # sort 00:07:49.792 18:56:10 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:49.792 18:56:10 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:49.792 18:56:10 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:07:49.792 18:56:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.792 18:56:10 -- common/autotest_common.sh@10 -- # set +x 00:07:49.792 18:56:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.792 18:56:10 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:07:49.792 18:56:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.792 18:56:10 -- common/autotest_common.sh@10 -- # set +x 00:07:49.792 18:56:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.792 18:56:10 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:07:49.792 18:56:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.792 18:56:10 -- common/autotest_common.sh@10 -- # set +x 00:07:49.792 18:56:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.792 18:56:10 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:49.792 18:56:10 -- target/referrals.sh@56 -- # jq length 00:07:49.792 18:56:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.792 18:56:10 -- common/autotest_common.sh@10 -- # set +x 00:07:49.792 18:56:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.792 18:56:10 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:07:49.792 18:56:10 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:07:49.792 18:56:10 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:49.793 18:56:10 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:49.793 18:56:10 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:49.793 18:56:10 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:49.793 18:56:10 -- target/referrals.sh@26 -- # sort 00:07:50.108 18:56:10 -- target/referrals.sh@26 -- # echo 00:07:50.108 18:56:10 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:07:50.108 18:56:10 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:07:50.108 18:56:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.108 18:56:10 -- common/autotest_common.sh@10 -- # set +x 00:07:50.108 18:56:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.108 18:56:10 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:50.108 18:56:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.108 18:56:10 -- common/autotest_common.sh@10 -- # set +x 00:07:50.108 18:56:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.108 18:56:10 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:07:50.108 18:56:10 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:50.108 18:56:10 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:50.108 18:56:10 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:50.108 18:56:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.108 18:56:10 -- common/autotest_common.sh@10 -- # set +x 00:07:50.108 18:56:10 -- target/referrals.sh@21 -- # sort 00:07:50.108 18:56:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.108 18:56:10 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:07:50.108 18:56:10 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:50.108 18:56:10 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:07:50.108 18:56:10 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:50.108 18:56:10 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:50.108 18:56:10 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:50.108 18:56:10 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:50.108 18:56:10 -- target/referrals.sh@26 -- # sort 00:07:50.108 18:56:11 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:07:50.108 18:56:11 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:50.108 18:56:11 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:07:50.108 18:56:11 -- target/referrals.sh@67 -- # jq -r .subnqn 00:07:50.108 18:56:11 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:50.108 18:56:11 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:50.108 18:56:11 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:50.379 18:56:11 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:07:50.379 18:56:11 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:07:50.379 18:56:11 -- target/referrals.sh@68 -- # jq -r .subnqn 00:07:50.379 18:56:11 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:50.379 18:56:11 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:50.379 18:56:11 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:50.667 18:56:11 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:50.667 18:56:11 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:50.667 18:56:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.667 18:56:11 -- common/autotest_common.sh@10 -- # set +x 00:07:50.667 18:56:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.667 18:56:11 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:07:50.667 18:56:11 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:50.667 18:56:11 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:50.667 18:56:11 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:50.667 18:56:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.667 18:56:11 -- common/autotest_common.sh@10 -- # set +x 00:07:50.667 18:56:11 -- target/referrals.sh@21 -- # sort 00:07:50.667 18:56:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.668 18:56:11 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:07:50.668 18:56:11 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:50.668 18:56:11 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:07:50.668 18:56:11 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:50.668 18:56:11 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:50.668 18:56:11 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:50.668 18:56:11 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:50.668 18:56:11 -- target/referrals.sh@26 -- # sort 00:07:50.668 18:56:11 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:07:50.668 18:56:11 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:07:50.668 18:56:11 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:07:50.668 18:56:11 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:50.668 18:56:11 -- target/referrals.sh@75 -- # jq -r .subnqn 00:07:50.946 18:56:11 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:50.946 18:56:11 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:07:50.946 18:56:11 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:07:50.946 18:56:11 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:07:50.946 18:56:11 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:07:50.946 18:56:11 -- target/referrals.sh@76 -- # jq -r .subnqn 00:07:50.946 18:56:11 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:50.946 18:56:11 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:07:51.235 18:56:12 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:07:51.235 18:56:12 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:07:51.235 18:56:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:51.235 18:56:12 -- common/autotest_common.sh@10 -- # set +x 00:07:51.235 18:56:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:51.235 18:56:12 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:51.235 18:56:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:51.235 18:56:12 -- target/referrals.sh@82 -- # jq length 00:07:51.235 18:56:12 -- common/autotest_common.sh@10 -- # set +x 00:07:51.235 18:56:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:51.235 18:56:12 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:07:51.235 18:56:12 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:07:51.235 18:56:12 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:51.235 18:56:12 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:51.235 18:56:12 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:51.235 18:56:12 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:51.235 18:56:12 -- target/referrals.sh@26 -- # sort 00:07:51.512 18:56:12 -- target/referrals.sh@26 -- # echo 00:07:51.512 18:56:12 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:07:51.512 18:56:12 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:07:51.512 18:56:12 -- target/referrals.sh@86 -- # nvmftestfini 00:07:51.512 18:56:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:51.512 18:56:12 -- nvmf/common.sh@116 -- # sync 00:07:51.512 18:56:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:51.512 18:56:12 -- nvmf/common.sh@119 -- # set +e 00:07:51.512 18:56:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:51.512 18:56:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:51.512 rmmod nvme_tcp 00:07:51.512 rmmod nvme_fabrics 00:07:51.512 rmmod nvme_keyring 00:07:51.512 18:56:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:51.512 18:56:12 -- nvmf/common.sh@123 -- # set -e 00:07:51.512 18:56:12 -- nvmf/common.sh@124 -- # return 0 00:07:51.512 18:56:12 -- nvmf/common.sh@477 -- # '[' -n 114394 ']' 00:07:51.512 18:56:12 -- nvmf/common.sh@478 -- # killprocess 114394 00:07:51.512 18:56:12 -- common/autotest_common.sh@936 -- # '[' -z 114394 ']' 00:07:51.512 18:56:12 -- common/autotest_common.sh@940 -- # kill -0 114394 00:07:51.512 18:56:12 -- common/autotest_common.sh@941 -- # uname 00:07:51.512 18:56:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:51.513 18:56:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 114394 00:07:51.513 18:56:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:51.513 18:56:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:51.513 18:56:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 114394' 00:07:51.513 killing process with pid 114394 00:07:51.513 18:56:12 -- common/autotest_common.sh@955 -- # kill 114394 00:07:51.513 18:56:12 -- common/autotest_common.sh@960 -- # wait 114394 00:07:51.819 18:56:12 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:51.819 18:56:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:51.819 18:56:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:51.819 18:56:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:51.819 18:56:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:51.819 18:56:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:51.819 18:56:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:51.819 18:56:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:53.844 18:56:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:53.844 00:07:53.844 real 0m8.042s 00:07:53.844 user 0m14.227s 00:07:53.845 sys 0m2.366s 00:07:53.845 18:56:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:53.845 18:56:14 -- common/autotest_common.sh@10 -- # set +x 00:07:53.845 ************************************ 00:07:53.845 END TEST nvmf_referrals 00:07:53.845 ************************************ 00:07:53.845 18:56:14 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:53.845 18:56:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:53.845 18:56:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:53.845 18:56:14 -- common/autotest_common.sh@10 -- # set +x 00:07:53.845 ************************************ 00:07:53.845 START TEST nvmf_connect_disconnect 00:07:53.845 ************************************ 00:07:53.845 18:56:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:07:53.845 * Looking for test storage... 00:07:53.845 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:53.845 18:56:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:53.845 18:56:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:53.845 18:56:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:53.845 18:56:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:53.845 18:56:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:53.845 18:56:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:53.845 18:56:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:53.845 18:56:14 -- scripts/common.sh@335 -- # IFS=.-: 00:07:53.845 18:56:14 -- scripts/common.sh@335 -- # read -ra ver1 00:07:53.845 18:56:14 -- scripts/common.sh@336 -- # IFS=.-: 00:07:53.845 18:56:14 -- scripts/common.sh@336 -- # read -ra ver2 00:07:53.845 18:56:14 -- scripts/common.sh@337 -- # local 'op=<' 00:07:53.845 18:56:14 -- scripts/common.sh@339 -- # ver1_l=2 00:07:53.845 18:56:14 -- scripts/common.sh@340 -- # ver2_l=1 00:07:53.845 18:56:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:53.845 18:56:14 -- scripts/common.sh@343 -- # case "$op" in 00:07:53.845 18:56:14 -- scripts/common.sh@344 -- # : 1 00:07:53.845 18:56:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:53.845 18:56:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:53.845 18:56:14 -- scripts/common.sh@364 -- # decimal 1 00:07:53.845 18:56:14 -- scripts/common.sh@352 -- # local d=1 00:07:53.845 18:56:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:53.845 18:56:14 -- scripts/common.sh@354 -- # echo 1 00:07:53.845 18:56:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:53.845 18:56:14 -- scripts/common.sh@365 -- # decimal 2 00:07:53.845 18:56:14 -- scripts/common.sh@352 -- # local d=2 00:07:53.845 18:56:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:53.845 18:56:14 -- scripts/common.sh@354 -- # echo 2 00:07:53.845 18:56:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:53.845 18:56:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:53.845 18:56:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:53.845 18:56:14 -- scripts/common.sh@367 -- # return 0 00:07:53.845 18:56:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:53.845 18:56:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:53.845 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:53.845 --rc genhtml_branch_coverage=1 00:07:53.845 --rc genhtml_function_coverage=1 00:07:53.845 --rc genhtml_legend=1 00:07:53.845 --rc geninfo_all_blocks=1 00:07:53.845 --rc geninfo_unexecuted_blocks=1 00:07:53.845 00:07:53.845 ' 00:07:53.845 18:56:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:53.845 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:53.845 --rc genhtml_branch_coverage=1 00:07:53.845 --rc genhtml_function_coverage=1 00:07:53.845 --rc genhtml_legend=1 00:07:53.845 --rc geninfo_all_blocks=1 00:07:53.845 --rc geninfo_unexecuted_blocks=1 00:07:53.845 00:07:53.845 ' 00:07:53.845 18:56:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:53.845 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:53.845 --rc genhtml_branch_coverage=1 00:07:53.845 --rc genhtml_function_coverage=1 00:07:53.845 --rc genhtml_legend=1 00:07:53.845 --rc geninfo_all_blocks=1 00:07:53.845 --rc geninfo_unexecuted_blocks=1 00:07:53.845 00:07:53.845 ' 00:07:53.845 18:56:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:53.845 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:53.845 --rc genhtml_branch_coverage=1 00:07:53.845 --rc genhtml_function_coverage=1 00:07:53.845 --rc genhtml_legend=1 00:07:53.845 --rc geninfo_all_blocks=1 00:07:53.845 --rc geninfo_unexecuted_blocks=1 00:07:53.845 00:07:53.845 ' 00:07:53.845 18:56:14 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:54.105 18:56:14 -- nvmf/common.sh@7 -- # uname -s 00:07:54.105 18:56:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:54.105 18:56:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:54.105 18:56:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:54.105 18:56:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:54.105 18:56:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:54.105 18:56:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:54.105 18:56:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:54.105 18:56:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:54.105 18:56:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:54.106 18:56:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:54.106 18:56:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:54.106 18:56:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:54.106 18:56:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:54.106 18:56:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:54.106 18:56:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:54.106 18:56:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:54.106 18:56:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:54.106 18:56:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:54.106 18:56:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:54.106 18:56:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:54.106 18:56:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:54.106 18:56:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:54.106 18:56:14 -- paths/export.sh@5 -- # export PATH 00:07:54.106 18:56:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:54.106 18:56:14 -- nvmf/common.sh@46 -- # : 0 00:07:54.106 18:56:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:54.106 18:56:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:54.106 18:56:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:54.106 18:56:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:54.106 18:56:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:54.106 18:56:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:54.106 18:56:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:54.106 18:56:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:54.106 18:56:14 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:07:54.106 18:56:14 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:07:54.106 18:56:14 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:07:54.106 18:56:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:54.106 18:56:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:54.106 18:56:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:54.106 18:56:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:54.106 18:56:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:54.106 18:56:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:54.106 18:56:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:54.106 18:56:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:54.106 18:56:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:54.106 18:56:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:54.106 18:56:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:54.106 18:56:14 -- common/autotest_common.sh@10 -- # set +x 00:07:56.010 18:56:16 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:56.010 18:56:16 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:56.010 18:56:16 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:56.010 18:56:16 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:56.010 18:56:16 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:56.010 18:56:16 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:56.010 18:56:16 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:56.010 18:56:16 -- nvmf/common.sh@294 -- # net_devs=() 00:07:56.010 18:56:16 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:56.010 18:56:16 -- nvmf/common.sh@295 -- # e810=() 00:07:56.010 18:56:16 -- nvmf/common.sh@295 -- # local -ga e810 00:07:56.010 18:56:16 -- nvmf/common.sh@296 -- # x722=() 00:07:56.010 18:56:16 -- nvmf/common.sh@296 -- # local -ga x722 00:07:56.010 18:56:16 -- nvmf/common.sh@297 -- # mlx=() 00:07:56.010 18:56:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:56.010 18:56:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:56.010 18:56:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:56.010 18:56:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:56.010 18:56:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:56.010 18:56:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:56.010 18:56:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:56.010 18:56:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:56.010 18:56:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:56.010 18:56:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:56.010 18:56:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:56.010 18:56:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:56.010 18:56:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:56.010 18:56:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:56.010 18:56:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:56.010 18:56:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:56.010 18:56:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:56.010 18:56:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:56.010 18:56:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:56.010 18:56:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:56.010 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:56.010 18:56:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:56.010 18:56:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:56.010 18:56:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:56.010 18:56:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:56.010 18:56:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:56.010 18:56:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:56.010 18:56:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:56.010 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:56.010 18:56:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:56.010 18:56:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:56.010 18:56:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:56.010 18:56:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:56.010 18:56:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:56.010 18:56:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:56.010 18:56:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:56.010 18:56:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:56.010 18:56:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:56.010 18:56:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:56.010 18:56:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:56.010 18:56:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:56.010 18:56:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:56.010 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:56.010 18:56:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:56.010 18:56:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:56.010 18:56:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:56.010 18:56:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:56.010 18:56:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:56.010 18:56:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:56.010 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:56.010 18:56:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:56.010 18:56:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:56.010 18:56:16 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:56.010 18:56:16 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:56.010 18:56:16 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:56.010 18:56:16 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:56.010 18:56:16 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:56.010 18:56:16 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:56.010 18:56:16 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:56.010 18:56:16 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:56.010 18:56:16 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:56.010 18:56:16 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:56.010 18:56:16 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:56.010 18:56:16 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:56.010 18:56:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:56.010 18:56:16 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:56.010 18:56:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:56.010 18:56:16 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:56.010 18:56:16 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:56.010 18:56:16 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:56.010 18:56:16 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:56.010 18:56:16 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:56.010 18:56:16 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:56.010 18:56:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:56.010 18:56:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:56.010 18:56:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:56.010 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:56.010 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.201 ms 00:07:56.010 00:07:56.010 --- 10.0.0.2 ping statistics --- 00:07:56.010 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:56.010 rtt min/avg/max/mdev = 0.201/0.201/0.201/0.000 ms 00:07:56.010 18:56:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:56.010 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:56.010 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.089 ms 00:07:56.010 00:07:56.010 --- 10.0.0.1 ping statistics --- 00:07:56.010 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:56.010 rtt min/avg/max/mdev = 0.089/0.089/0.089/0.000 ms 00:07:56.010 18:56:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:56.010 18:56:17 -- nvmf/common.sh@410 -- # return 0 00:07:56.010 18:56:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:56.010 18:56:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:56.010 18:56:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:56.010 18:56:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:56.010 18:56:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:56.010 18:56:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:56.010 18:56:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:56.011 18:56:17 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:07:56.011 18:56:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:56.011 18:56:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:56.011 18:56:17 -- common/autotest_common.sh@10 -- # set +x 00:07:56.011 18:56:17 -- nvmf/common.sh@469 -- # nvmfpid=116852 00:07:56.011 18:56:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:56.011 18:56:17 -- nvmf/common.sh@470 -- # waitforlisten 116852 00:07:56.011 18:56:17 -- common/autotest_common.sh@829 -- # '[' -z 116852 ']' 00:07:56.269 18:56:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:56.269 18:56:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:56.269 18:56:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:56.269 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:56.269 18:56:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:56.269 18:56:17 -- common/autotest_common.sh@10 -- # set +x 00:07:56.269 [2024-11-28 18:56:17.095892] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:56.269 [2024-11-28 18:56:17.095969] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:56.269 EAL: No free 2048 kB hugepages reported on node 1 00:07:56.269 [2024-11-28 18:56:17.166175] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:56.269 [2024-11-28 18:56:17.288774] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:56.269 [2024-11-28 18:56:17.288927] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:56.269 [2024-11-28 18:56:17.288955] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:56.269 [2024-11-28 18:56:17.288969] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:56.269 [2024-11-28 18:56:17.289028] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:56.269 [2024-11-28 18:56:17.289093] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:56.269 [2024-11-28 18:56:17.289143] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:56.269 [2024-11-28 18:56:17.289146] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:57.206 18:56:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:57.206 18:56:18 -- common/autotest_common.sh@862 -- # return 0 00:07:57.206 18:56:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:57.206 18:56:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:57.206 18:56:18 -- common/autotest_common.sh@10 -- # set +x 00:07:57.206 18:56:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:57.206 18:56:18 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:57.206 18:56:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:57.206 18:56:18 -- common/autotest_common.sh@10 -- # set +x 00:07:57.206 [2024-11-28 18:56:18.118008] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:57.206 18:56:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:57.206 18:56:18 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:07:57.206 18:56:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:57.206 18:56:18 -- common/autotest_common.sh@10 -- # set +x 00:07:57.206 18:56:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:57.206 18:56:18 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:07:57.206 18:56:18 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:57.206 18:56:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:57.206 18:56:18 -- common/autotest_common.sh@10 -- # set +x 00:07:57.206 18:56:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:57.206 18:56:18 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:57.206 18:56:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:57.206 18:56:18 -- common/autotest_common.sh@10 -- # set +x 00:07:57.206 18:56:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:57.206 18:56:18 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:57.206 18:56:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:57.206 18:56:18 -- common/autotest_common.sh@10 -- # set +x 00:07:57.206 [2024-11-28 18:56:18.169268] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:57.206 18:56:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:57.206 18:56:18 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:07:57.206 18:56:18 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:07:57.206 18:56:18 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:07:57.206 18:56:18 -- target/connect_disconnect.sh@34 -- # set +x 00:07:59.734 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:02.255 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:04.153 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:06.680 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:08.578 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:11.104 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:13.632 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:16.160 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:18.057 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:20.584 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:23.110 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:25.007 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:27.534 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:30.062 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:31.962 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:34.491 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:37.042 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:39.588 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:41.499 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:44.041 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:45.951 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:48.498 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:51.051 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:52.962 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:55.496 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:57.411 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:59.959 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:02.505 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:04.424 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:06.970 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:08.886 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:11.435 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:13.346 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:15.886 [2024-11-28 18:57:36.748200] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18e9060 is same with the state(5) to be set 00:09:15.886 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:18.426 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:20.967 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:22.876 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:25.423 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:27.333 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:29.874 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:32.416 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:34.321 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:36.856 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:39.394 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:41.303 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:43.840 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:46.385 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:48.294 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:50.832 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:52.734 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:55.274 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:57.813 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:59.710 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:02.237 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:04.136 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:06.663 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:09.189 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:11.713 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:13.611 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:16.150 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:18.674 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:20.570 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:23.095 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:25.620 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:27.517 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:30.042 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:32.568 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:34.466 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:36.994 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:39.520 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:42.047 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:43.944 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:46.463 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:48.989 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:50.888 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:53.415 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:55.942 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:57.840 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:00.369 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:02.894 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:04.791 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:07.316 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:09.213 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:11.738 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:14.263 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:16.159 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:18.685 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:21.210 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:23.108 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:25.631 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:28.157 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:30.056 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:32.582 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:35.107 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:37.634 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:39.532 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:42.055 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:44.577 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:46.472 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:48.998 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:48.998 19:00:09 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:11:48.998 19:00:09 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:11:48.998 19:00:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:48.998 19:00:09 -- nvmf/common.sh@116 -- # sync 00:11:48.998 19:00:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:48.998 19:00:09 -- nvmf/common.sh@119 -- # set +e 00:11:48.998 19:00:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:48.998 19:00:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:48.998 rmmod nvme_tcp 00:11:48.998 rmmod nvme_fabrics 00:11:48.998 rmmod nvme_keyring 00:11:48.998 19:00:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:48.998 19:00:09 -- nvmf/common.sh@123 -- # set -e 00:11:48.998 19:00:09 -- nvmf/common.sh@124 -- # return 0 00:11:48.998 19:00:09 -- nvmf/common.sh@477 -- # '[' -n 116852 ']' 00:11:48.998 19:00:09 -- nvmf/common.sh@478 -- # killprocess 116852 00:11:48.998 19:00:09 -- common/autotest_common.sh@936 -- # '[' -z 116852 ']' 00:11:48.998 19:00:09 -- common/autotest_common.sh@940 -- # kill -0 116852 00:11:48.998 19:00:09 -- common/autotest_common.sh@941 -- # uname 00:11:48.998 19:00:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:48.998 19:00:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 116852 00:11:48.998 19:00:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:48.998 19:00:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:48.998 19:00:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 116852' 00:11:48.998 killing process with pid 116852 00:11:48.998 19:00:09 -- common/autotest_common.sh@955 -- # kill 116852 00:11:48.998 19:00:09 -- common/autotest_common.sh@960 -- # wait 116852 00:11:49.257 19:00:10 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:49.257 19:00:10 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:49.257 19:00:10 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:49.257 19:00:10 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:49.257 19:00:10 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:49.257 19:00:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:49.257 19:00:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:49.257 19:00:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:51.170 19:00:12 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:51.170 00:11:51.170 real 3m57.376s 00:11:51.170 user 15m3.321s 00:11:51.170 sys 0m36.707s 00:11:51.170 19:00:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:51.170 19:00:12 -- common/autotest_common.sh@10 -- # set +x 00:11:51.170 ************************************ 00:11:51.170 END TEST nvmf_connect_disconnect 00:11:51.170 ************************************ 00:11:51.170 19:00:12 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:51.170 19:00:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:51.170 19:00:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:51.170 19:00:12 -- common/autotest_common.sh@10 -- # set +x 00:11:51.170 ************************************ 00:11:51.170 START TEST nvmf_multitarget 00:11:51.170 ************************************ 00:11:51.170 19:00:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:11:51.170 * Looking for test storage... 00:11:51.170 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:51.170 19:00:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:51.170 19:00:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:51.170 19:00:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:51.430 19:00:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:51.430 19:00:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:51.430 19:00:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:51.430 19:00:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:51.430 19:00:12 -- scripts/common.sh@335 -- # IFS=.-: 00:11:51.430 19:00:12 -- scripts/common.sh@335 -- # read -ra ver1 00:11:51.430 19:00:12 -- scripts/common.sh@336 -- # IFS=.-: 00:11:51.430 19:00:12 -- scripts/common.sh@336 -- # read -ra ver2 00:11:51.430 19:00:12 -- scripts/common.sh@337 -- # local 'op=<' 00:11:51.430 19:00:12 -- scripts/common.sh@339 -- # ver1_l=2 00:11:51.430 19:00:12 -- scripts/common.sh@340 -- # ver2_l=1 00:11:51.430 19:00:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:51.430 19:00:12 -- scripts/common.sh@343 -- # case "$op" in 00:11:51.430 19:00:12 -- scripts/common.sh@344 -- # : 1 00:11:51.430 19:00:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:51.430 19:00:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:51.430 19:00:12 -- scripts/common.sh@364 -- # decimal 1 00:11:51.430 19:00:12 -- scripts/common.sh@352 -- # local d=1 00:11:51.430 19:00:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:51.430 19:00:12 -- scripts/common.sh@354 -- # echo 1 00:11:51.430 19:00:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:51.430 19:00:12 -- scripts/common.sh@365 -- # decimal 2 00:11:51.430 19:00:12 -- scripts/common.sh@352 -- # local d=2 00:11:51.430 19:00:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:51.430 19:00:12 -- scripts/common.sh@354 -- # echo 2 00:11:51.430 19:00:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:51.430 19:00:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:51.430 19:00:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:51.430 19:00:12 -- scripts/common.sh@367 -- # return 0 00:11:51.430 19:00:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:51.430 19:00:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:51.430 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:51.430 --rc genhtml_branch_coverage=1 00:11:51.430 --rc genhtml_function_coverage=1 00:11:51.430 --rc genhtml_legend=1 00:11:51.430 --rc geninfo_all_blocks=1 00:11:51.430 --rc geninfo_unexecuted_blocks=1 00:11:51.430 00:11:51.430 ' 00:11:51.430 19:00:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:51.430 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:51.430 --rc genhtml_branch_coverage=1 00:11:51.430 --rc genhtml_function_coverage=1 00:11:51.430 --rc genhtml_legend=1 00:11:51.430 --rc geninfo_all_blocks=1 00:11:51.430 --rc geninfo_unexecuted_blocks=1 00:11:51.430 00:11:51.430 ' 00:11:51.430 19:00:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:51.430 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:51.430 --rc genhtml_branch_coverage=1 00:11:51.430 --rc genhtml_function_coverage=1 00:11:51.430 --rc genhtml_legend=1 00:11:51.430 --rc geninfo_all_blocks=1 00:11:51.430 --rc geninfo_unexecuted_blocks=1 00:11:51.430 00:11:51.430 ' 00:11:51.430 19:00:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:51.430 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:51.430 --rc genhtml_branch_coverage=1 00:11:51.430 --rc genhtml_function_coverage=1 00:11:51.430 --rc genhtml_legend=1 00:11:51.430 --rc geninfo_all_blocks=1 00:11:51.430 --rc geninfo_unexecuted_blocks=1 00:11:51.430 00:11:51.430 ' 00:11:51.430 19:00:12 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:51.430 19:00:12 -- nvmf/common.sh@7 -- # uname -s 00:11:51.430 19:00:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:51.430 19:00:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:51.430 19:00:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:51.430 19:00:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:51.430 19:00:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:51.430 19:00:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:51.430 19:00:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:51.430 19:00:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:51.430 19:00:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:51.430 19:00:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:51.430 19:00:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:51.430 19:00:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:51.430 19:00:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:51.430 19:00:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:51.430 19:00:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:51.430 19:00:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:51.430 19:00:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:51.430 19:00:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:51.430 19:00:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:51.430 19:00:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:51.430 19:00:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:51.430 19:00:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:51.430 19:00:12 -- paths/export.sh@5 -- # export PATH 00:11:51.430 19:00:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:51.430 19:00:12 -- nvmf/common.sh@46 -- # : 0 00:11:51.430 19:00:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:51.431 19:00:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:51.431 19:00:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:51.431 19:00:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:51.431 19:00:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:51.431 19:00:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:51.431 19:00:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:51.431 19:00:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:51.431 19:00:12 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:11:51.431 19:00:12 -- target/multitarget.sh@15 -- # nvmftestinit 00:11:51.431 19:00:12 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:51.431 19:00:12 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:51.431 19:00:12 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:51.431 19:00:12 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:51.431 19:00:12 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:51.431 19:00:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:51.431 19:00:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:51.431 19:00:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:51.431 19:00:12 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:51.431 19:00:12 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:51.431 19:00:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:51.431 19:00:12 -- common/autotest_common.sh@10 -- # set +x 00:11:53.337 19:00:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:11:53.337 19:00:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:11:53.337 19:00:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:11:53.337 19:00:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:11:53.337 19:00:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:11:53.337 19:00:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:11:53.337 19:00:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:11:53.337 19:00:14 -- nvmf/common.sh@294 -- # net_devs=() 00:11:53.337 19:00:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:11:53.337 19:00:14 -- nvmf/common.sh@295 -- # e810=() 00:11:53.337 19:00:14 -- nvmf/common.sh@295 -- # local -ga e810 00:11:53.337 19:00:14 -- nvmf/common.sh@296 -- # x722=() 00:11:53.337 19:00:14 -- nvmf/common.sh@296 -- # local -ga x722 00:11:53.337 19:00:14 -- nvmf/common.sh@297 -- # mlx=() 00:11:53.337 19:00:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:11:53.337 19:00:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:11:53.337 19:00:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:11:53.337 19:00:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:11:53.337 19:00:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:11:53.337 19:00:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:11:53.337 19:00:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:11:53.337 19:00:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:11:53.337 19:00:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:11:53.337 19:00:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:11:53.337 19:00:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:11:53.337 19:00:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:11:53.337 19:00:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:11:53.337 19:00:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:11:53.337 19:00:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:11:53.337 19:00:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:11:53.337 19:00:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:11:53.337 19:00:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:11:53.337 19:00:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:53.337 19:00:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:11:53.337 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:11:53.337 19:00:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:53.337 19:00:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:53.337 19:00:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:53.337 19:00:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:53.337 19:00:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:53.337 19:00:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:11:53.337 19:00:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:11:53.337 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:11:53.337 19:00:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:11:53.337 19:00:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:11:53.337 19:00:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:11:53.337 19:00:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:11:53.337 19:00:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:11:53.337 19:00:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:11:53.337 19:00:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:11:53.337 19:00:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:11:53.337 19:00:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:53.337 19:00:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:53.337 19:00:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:53.337 19:00:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:53.337 19:00:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:11:53.337 Found net devices under 0000:0a:00.0: cvl_0_0 00:11:53.337 19:00:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:53.337 19:00:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:11:53.337 19:00:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:11:53.337 19:00:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:11:53.337 19:00:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:11:53.337 19:00:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:11:53.337 Found net devices under 0000:0a:00.1: cvl_0_1 00:11:53.337 19:00:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:11:53.337 19:00:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:11:53.337 19:00:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:11:53.337 19:00:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:11:53.337 19:00:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:11:53.337 19:00:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:11:53.337 19:00:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:11:53.337 19:00:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:11:53.337 19:00:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:11:53.337 19:00:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:11:53.337 19:00:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:11:53.337 19:00:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:11:53.337 19:00:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:11:53.337 19:00:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:11:53.337 19:00:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:11:53.337 19:00:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:11:53.337 19:00:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:11:53.337 19:00:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:11:53.596 19:00:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:11:53.596 19:00:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:11:53.596 19:00:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:11:53.596 19:00:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:11:53.596 19:00:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:11:53.597 19:00:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:11:53.597 19:00:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:11:53.597 19:00:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:11:53.597 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:11:53.597 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.369 ms 00:11:53.597 00:11:53.597 --- 10.0.0.2 ping statistics --- 00:11:53.597 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:53.597 rtt min/avg/max/mdev = 0.369/0.369/0.369/0.000 ms 00:11:53.597 19:00:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:11:53.597 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:11:53.597 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.067 ms 00:11:53.597 00:11:53.597 --- 10.0.0.1 ping statistics --- 00:11:53.597 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:11:53.597 rtt min/avg/max/mdev = 0.067/0.067/0.067/0.000 ms 00:11:53.597 19:00:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:11:53.597 19:00:14 -- nvmf/common.sh@410 -- # return 0 00:11:53.597 19:00:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:11:53.597 19:00:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:11:53.597 19:00:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:11:53.597 19:00:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:11:53.597 19:00:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:11:53.597 19:00:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:11:53.597 19:00:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:11:53.597 19:00:14 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:11:53.597 19:00:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:11:53.597 19:00:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:11:53.597 19:00:14 -- common/autotest_common.sh@10 -- # set +x 00:11:53.597 19:00:14 -- nvmf/common.sh@469 -- # nvmfpid=149581 00:11:53.597 19:00:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:11:53.597 19:00:14 -- nvmf/common.sh@470 -- # waitforlisten 149581 00:11:53.597 19:00:14 -- common/autotest_common.sh@829 -- # '[' -z 149581 ']' 00:11:53.597 19:00:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:11:53.597 19:00:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:11:53.597 19:00:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:11:53.597 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:11:53.597 19:00:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:11:53.597 19:00:14 -- common/autotest_common.sh@10 -- # set +x 00:11:53.597 [2024-11-28 19:00:14.569472] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:11:53.597 [2024-11-28 19:00:14.569549] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:11:53.597 EAL: No free 2048 kB hugepages reported on node 1 00:11:53.597 [2024-11-28 19:00:14.632972] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:11:53.856 [2024-11-28 19:00:14.738412] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:11:53.856 [2024-11-28 19:00:14.738568] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:11:53.857 [2024-11-28 19:00:14.738588] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:11:53.857 [2024-11-28 19:00:14.738601] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:11:53.857 [2024-11-28 19:00:14.738652] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:11:53.857 [2024-11-28 19:00:14.738713] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:11:53.857 [2024-11-28 19:00:14.738763] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:11:53.857 [2024-11-28 19:00:14.738766] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:11:54.793 19:00:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:11:54.793 19:00:15 -- common/autotest_common.sh@862 -- # return 0 00:11:54.793 19:00:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:11:54.793 19:00:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:11:54.793 19:00:15 -- common/autotest_common.sh@10 -- # set +x 00:11:54.793 19:00:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:11:54.793 19:00:15 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:11:54.793 19:00:15 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:54.793 19:00:15 -- target/multitarget.sh@21 -- # jq length 00:11:54.793 19:00:15 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:11:54.793 19:00:15 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:11:54.793 "nvmf_tgt_1" 00:11:54.793 19:00:15 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:11:55.051 "nvmf_tgt_2" 00:11:55.051 19:00:15 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:55.051 19:00:15 -- target/multitarget.sh@28 -- # jq length 00:11:55.051 19:00:16 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:11:55.051 19:00:16 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:11:55.309 true 00:11:55.309 19:00:16 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:11:55.309 true 00:11:55.309 19:00:16 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:11:55.309 19:00:16 -- target/multitarget.sh@35 -- # jq length 00:11:55.569 19:00:16 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:11:55.569 19:00:16 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:11:55.569 19:00:16 -- target/multitarget.sh@41 -- # nvmftestfini 00:11:55.569 19:00:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:11:55.569 19:00:16 -- nvmf/common.sh@116 -- # sync 00:11:55.569 19:00:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:11:55.569 19:00:16 -- nvmf/common.sh@119 -- # set +e 00:11:55.569 19:00:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:11:55.569 19:00:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:11:55.569 rmmod nvme_tcp 00:11:55.569 rmmod nvme_fabrics 00:11:55.569 rmmod nvme_keyring 00:11:55.569 19:00:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:11:55.569 19:00:16 -- nvmf/common.sh@123 -- # set -e 00:11:55.569 19:00:16 -- nvmf/common.sh@124 -- # return 0 00:11:55.569 19:00:16 -- nvmf/common.sh@477 -- # '[' -n 149581 ']' 00:11:55.569 19:00:16 -- nvmf/common.sh@478 -- # killprocess 149581 00:11:55.569 19:00:16 -- common/autotest_common.sh@936 -- # '[' -z 149581 ']' 00:11:55.569 19:00:16 -- common/autotest_common.sh@940 -- # kill -0 149581 00:11:55.569 19:00:16 -- common/autotest_common.sh@941 -- # uname 00:11:55.570 19:00:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:11:55.570 19:00:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 149581 00:11:55.570 19:00:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:11:55.570 19:00:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:11:55.570 19:00:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 149581' 00:11:55.570 killing process with pid 149581 00:11:55.570 19:00:16 -- common/autotest_common.sh@955 -- # kill 149581 00:11:55.570 19:00:16 -- common/autotest_common.sh@960 -- # wait 149581 00:11:55.829 19:00:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:11:55.829 19:00:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:11:55.829 19:00:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:11:55.829 19:00:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:11:55.829 19:00:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:11:55.829 19:00:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:55.829 19:00:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:55.829 19:00:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:58.381 19:00:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:11:58.381 00:11:58.381 real 0m6.644s 00:11:58.381 user 0m9.793s 00:11:58.381 sys 0m1.931s 00:11:58.381 19:00:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:11:58.381 19:00:18 -- common/autotest_common.sh@10 -- # set +x 00:11:58.381 ************************************ 00:11:58.381 END TEST nvmf_multitarget 00:11:58.381 ************************************ 00:11:58.381 19:00:18 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:58.381 19:00:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:11:58.381 19:00:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:11:58.381 19:00:18 -- common/autotest_common.sh@10 -- # set +x 00:11:58.381 ************************************ 00:11:58.381 START TEST nvmf_rpc 00:11:58.381 ************************************ 00:11:58.381 19:00:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:11:58.381 * Looking for test storage... 00:11:58.381 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:11:58.381 19:00:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:11:58.381 19:00:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:11:58.381 19:00:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:11:58.381 19:00:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:11:58.381 19:00:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:11:58.381 19:00:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:11:58.381 19:00:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:11:58.381 19:00:18 -- scripts/common.sh@335 -- # IFS=.-: 00:11:58.381 19:00:18 -- scripts/common.sh@335 -- # read -ra ver1 00:11:58.381 19:00:18 -- scripts/common.sh@336 -- # IFS=.-: 00:11:58.381 19:00:18 -- scripts/common.sh@336 -- # read -ra ver2 00:11:58.381 19:00:18 -- scripts/common.sh@337 -- # local 'op=<' 00:11:58.381 19:00:18 -- scripts/common.sh@339 -- # ver1_l=2 00:11:58.381 19:00:18 -- scripts/common.sh@340 -- # ver2_l=1 00:11:58.381 19:00:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:11:58.381 19:00:18 -- scripts/common.sh@343 -- # case "$op" in 00:11:58.381 19:00:18 -- scripts/common.sh@344 -- # : 1 00:11:58.381 19:00:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:11:58.381 19:00:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:11:58.381 19:00:18 -- scripts/common.sh@364 -- # decimal 1 00:11:58.381 19:00:18 -- scripts/common.sh@352 -- # local d=1 00:11:58.381 19:00:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:11:58.381 19:00:18 -- scripts/common.sh@354 -- # echo 1 00:11:58.381 19:00:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:11:58.381 19:00:18 -- scripts/common.sh@365 -- # decimal 2 00:11:58.381 19:00:18 -- scripts/common.sh@352 -- # local d=2 00:11:58.381 19:00:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:11:58.381 19:00:18 -- scripts/common.sh@354 -- # echo 2 00:11:58.381 19:00:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:11:58.381 19:00:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:11:58.381 19:00:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:11:58.381 19:00:18 -- scripts/common.sh@367 -- # return 0 00:11:58.381 19:00:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:11:58.381 19:00:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:11:58.381 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:58.381 --rc genhtml_branch_coverage=1 00:11:58.381 --rc genhtml_function_coverage=1 00:11:58.381 --rc genhtml_legend=1 00:11:58.381 --rc geninfo_all_blocks=1 00:11:58.381 --rc geninfo_unexecuted_blocks=1 00:11:58.381 00:11:58.381 ' 00:11:58.381 19:00:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:11:58.381 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:58.381 --rc genhtml_branch_coverage=1 00:11:58.381 --rc genhtml_function_coverage=1 00:11:58.381 --rc genhtml_legend=1 00:11:58.381 --rc geninfo_all_blocks=1 00:11:58.381 --rc geninfo_unexecuted_blocks=1 00:11:58.381 00:11:58.381 ' 00:11:58.382 19:00:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:11:58.382 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:58.382 --rc genhtml_branch_coverage=1 00:11:58.382 --rc genhtml_function_coverage=1 00:11:58.382 --rc genhtml_legend=1 00:11:58.382 --rc geninfo_all_blocks=1 00:11:58.382 --rc geninfo_unexecuted_blocks=1 00:11:58.382 00:11:58.382 ' 00:11:58.382 19:00:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:11:58.382 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:11:58.382 --rc genhtml_branch_coverage=1 00:11:58.382 --rc genhtml_function_coverage=1 00:11:58.382 --rc genhtml_legend=1 00:11:58.382 --rc geninfo_all_blocks=1 00:11:58.382 --rc geninfo_unexecuted_blocks=1 00:11:58.382 00:11:58.382 ' 00:11:58.382 19:00:18 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:11:58.382 19:00:18 -- nvmf/common.sh@7 -- # uname -s 00:11:58.382 19:00:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:11:58.382 19:00:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:11:58.382 19:00:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:11:58.382 19:00:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:11:58.382 19:00:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:11:58.382 19:00:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:11:58.382 19:00:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:11:58.382 19:00:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:11:58.382 19:00:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:11:58.382 19:00:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:11:58.382 19:00:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:11:58.382 19:00:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:11:58.382 19:00:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:11:58.382 19:00:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:11:58.382 19:00:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:11:58.382 19:00:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:11:58.382 19:00:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:11:58.382 19:00:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:11:58.382 19:00:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:11:58.382 19:00:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:58.382 19:00:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:58.382 19:00:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:58.382 19:00:18 -- paths/export.sh@5 -- # export PATH 00:11:58.382 19:00:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:11:58.382 19:00:18 -- nvmf/common.sh@46 -- # : 0 00:11:58.382 19:00:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:11:58.382 19:00:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:11:58.382 19:00:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:11:58.382 19:00:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:11:58.382 19:00:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:11:58.382 19:00:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:11:58.382 19:00:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:11:58.382 19:00:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:11:58.382 19:00:18 -- target/rpc.sh@11 -- # loops=5 00:11:58.382 19:00:18 -- target/rpc.sh@23 -- # nvmftestinit 00:11:58.382 19:00:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:11:58.382 19:00:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:11:58.382 19:00:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:11:58.382 19:00:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:11:58.382 19:00:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:11:58.382 19:00:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:11:58.382 19:00:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:11:58.382 19:00:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:11:58.382 19:00:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:11:58.382 19:00:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:11:58.382 19:00:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:11:58.382 19:00:18 -- common/autotest_common.sh@10 -- # set +x 00:12:00.287 19:00:21 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:00.287 19:00:21 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:00.287 19:00:21 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:00.287 19:00:21 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:00.287 19:00:21 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:00.287 19:00:21 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:00.287 19:00:21 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:00.287 19:00:21 -- nvmf/common.sh@294 -- # net_devs=() 00:12:00.287 19:00:21 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:00.287 19:00:21 -- nvmf/common.sh@295 -- # e810=() 00:12:00.287 19:00:21 -- nvmf/common.sh@295 -- # local -ga e810 00:12:00.287 19:00:21 -- nvmf/common.sh@296 -- # x722=() 00:12:00.287 19:00:21 -- nvmf/common.sh@296 -- # local -ga x722 00:12:00.287 19:00:21 -- nvmf/common.sh@297 -- # mlx=() 00:12:00.287 19:00:21 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:00.287 19:00:21 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:00.287 19:00:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:00.287 19:00:21 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:00.287 19:00:21 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:00.287 19:00:21 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:00.287 19:00:21 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:00.287 19:00:21 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:00.287 19:00:21 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:00.287 19:00:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:00.287 19:00:21 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:00.287 19:00:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:00.287 19:00:21 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:00.287 19:00:21 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:00.287 19:00:21 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:00.287 19:00:21 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:00.287 19:00:21 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:00.287 19:00:21 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:00.287 19:00:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:00.287 19:00:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:00.287 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:00.287 19:00:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:00.287 19:00:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:00.287 19:00:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:00.287 19:00:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:00.287 19:00:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:00.287 19:00:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:00.287 19:00:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:00.287 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:00.287 19:00:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:00.287 19:00:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:00.287 19:00:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:00.287 19:00:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:00.287 19:00:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:00.287 19:00:21 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:00.287 19:00:21 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:00.287 19:00:21 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:00.287 19:00:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:00.287 19:00:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:00.287 19:00:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:00.287 19:00:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:00.287 19:00:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:00.287 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:00.287 19:00:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:00.287 19:00:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:00.287 19:00:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:00.287 19:00:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:00.287 19:00:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:00.287 19:00:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:00.287 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:00.287 19:00:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:00.287 19:00:21 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:00.287 19:00:21 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:00.287 19:00:21 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:00.287 19:00:21 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:00.287 19:00:21 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:00.287 19:00:21 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:00.287 19:00:21 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:00.287 19:00:21 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:00.287 19:00:21 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:00.287 19:00:21 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:00.287 19:00:21 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:00.287 19:00:21 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:00.287 19:00:21 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:00.287 19:00:21 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:00.287 19:00:21 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:00.287 19:00:21 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:00.287 19:00:21 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:00.287 19:00:21 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:00.287 19:00:21 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:00.287 19:00:21 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:00.287 19:00:21 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:00.287 19:00:21 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:00.287 19:00:21 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:00.287 19:00:21 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:00.287 19:00:21 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:00.287 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:00.288 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.216 ms 00:12:00.288 00:12:00.288 --- 10.0.0.2 ping statistics --- 00:12:00.288 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:00.288 rtt min/avg/max/mdev = 0.216/0.216/0.216/0.000 ms 00:12:00.288 19:00:21 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:00.288 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:00.288 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.101 ms 00:12:00.288 00:12:00.288 --- 10.0.0.1 ping statistics --- 00:12:00.288 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:00.288 rtt min/avg/max/mdev = 0.101/0.101/0.101/0.000 ms 00:12:00.288 19:00:21 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:00.288 19:00:21 -- nvmf/common.sh@410 -- # return 0 00:12:00.288 19:00:21 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:00.288 19:00:21 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:00.288 19:00:21 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:00.288 19:00:21 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:00.288 19:00:21 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:00.288 19:00:21 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:00.288 19:00:21 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:00.288 19:00:21 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:12:00.288 19:00:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:00.288 19:00:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:00.288 19:00:21 -- common/autotest_common.sh@10 -- # set +x 00:12:00.288 19:00:21 -- nvmf/common.sh@469 -- # nvmfpid=151828 00:12:00.288 19:00:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:00.288 19:00:21 -- nvmf/common.sh@470 -- # waitforlisten 151828 00:12:00.288 19:00:21 -- common/autotest_common.sh@829 -- # '[' -z 151828 ']' 00:12:00.288 19:00:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:00.288 19:00:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:00.288 19:00:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:00.288 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:00.288 19:00:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:00.288 19:00:21 -- common/autotest_common.sh@10 -- # set +x 00:12:00.288 [2024-11-28 19:00:21.308844] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:00.288 [2024-11-28 19:00:21.308918] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:00.546 EAL: No free 2048 kB hugepages reported on node 1 00:12:00.546 [2024-11-28 19:00:21.373814] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:00.546 [2024-11-28 19:00:21.478768] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:00.546 [2024-11-28 19:00:21.478922] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:00.546 [2024-11-28 19:00:21.478954] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:00.546 [2024-11-28 19:00:21.478967] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:00.546 [2024-11-28 19:00:21.479021] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:00.546 [2024-11-28 19:00:21.479080] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:00.546 [2024-11-28 19:00:21.479130] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:00.546 [2024-11-28 19:00:21.479132] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:01.479 19:00:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:01.479 19:00:22 -- common/autotest_common.sh@862 -- # return 0 00:12:01.479 19:00:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:01.479 19:00:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:01.479 19:00:22 -- common/autotest_common.sh@10 -- # set +x 00:12:01.479 19:00:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:01.479 19:00:22 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:12:01.479 19:00:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.479 19:00:22 -- common/autotest_common.sh@10 -- # set +x 00:12:01.479 19:00:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.479 19:00:22 -- target/rpc.sh@26 -- # stats='{ 00:12:01.479 "tick_rate": 2700000000, 00:12:01.479 "poll_groups": [ 00:12:01.479 { 00:12:01.479 "name": "nvmf_tgt_poll_group_0", 00:12:01.479 "admin_qpairs": 0, 00:12:01.479 "io_qpairs": 0, 00:12:01.479 "current_admin_qpairs": 0, 00:12:01.479 "current_io_qpairs": 0, 00:12:01.479 "pending_bdev_io": 0, 00:12:01.479 "completed_nvme_io": 0, 00:12:01.479 "transports": [] 00:12:01.479 }, 00:12:01.479 { 00:12:01.479 "name": "nvmf_tgt_poll_group_1", 00:12:01.479 "admin_qpairs": 0, 00:12:01.479 "io_qpairs": 0, 00:12:01.479 "current_admin_qpairs": 0, 00:12:01.479 "current_io_qpairs": 0, 00:12:01.479 "pending_bdev_io": 0, 00:12:01.479 "completed_nvme_io": 0, 00:12:01.479 "transports": [] 00:12:01.479 }, 00:12:01.479 { 00:12:01.479 "name": "nvmf_tgt_poll_group_2", 00:12:01.479 "admin_qpairs": 0, 00:12:01.479 "io_qpairs": 0, 00:12:01.479 "current_admin_qpairs": 0, 00:12:01.479 "current_io_qpairs": 0, 00:12:01.479 "pending_bdev_io": 0, 00:12:01.479 "completed_nvme_io": 0, 00:12:01.479 "transports": [] 00:12:01.479 }, 00:12:01.479 { 00:12:01.479 "name": "nvmf_tgt_poll_group_3", 00:12:01.479 "admin_qpairs": 0, 00:12:01.479 "io_qpairs": 0, 00:12:01.479 "current_admin_qpairs": 0, 00:12:01.479 "current_io_qpairs": 0, 00:12:01.479 "pending_bdev_io": 0, 00:12:01.479 "completed_nvme_io": 0, 00:12:01.479 "transports": [] 00:12:01.479 } 00:12:01.479 ] 00:12:01.479 }' 00:12:01.479 19:00:22 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:12:01.479 19:00:22 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:12:01.479 19:00:22 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:12:01.479 19:00:22 -- target/rpc.sh@15 -- # wc -l 00:12:01.479 19:00:22 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:12:01.479 19:00:22 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:12:01.479 19:00:22 -- target/rpc.sh@29 -- # [[ null == null ]] 00:12:01.479 19:00:22 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:12:01.479 19:00:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.479 19:00:22 -- common/autotest_common.sh@10 -- # set +x 00:12:01.479 [2024-11-28 19:00:22.441451] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:01.479 19:00:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.479 19:00:22 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:12:01.479 19:00:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.479 19:00:22 -- common/autotest_common.sh@10 -- # set +x 00:12:01.479 19:00:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.479 19:00:22 -- target/rpc.sh@33 -- # stats='{ 00:12:01.479 "tick_rate": 2700000000, 00:12:01.479 "poll_groups": [ 00:12:01.479 { 00:12:01.479 "name": "nvmf_tgt_poll_group_0", 00:12:01.479 "admin_qpairs": 0, 00:12:01.479 "io_qpairs": 0, 00:12:01.479 "current_admin_qpairs": 0, 00:12:01.479 "current_io_qpairs": 0, 00:12:01.479 "pending_bdev_io": 0, 00:12:01.479 "completed_nvme_io": 0, 00:12:01.479 "transports": [ 00:12:01.479 { 00:12:01.479 "trtype": "TCP" 00:12:01.479 } 00:12:01.479 ] 00:12:01.479 }, 00:12:01.479 { 00:12:01.479 "name": "nvmf_tgt_poll_group_1", 00:12:01.479 "admin_qpairs": 0, 00:12:01.479 "io_qpairs": 0, 00:12:01.479 "current_admin_qpairs": 0, 00:12:01.479 "current_io_qpairs": 0, 00:12:01.479 "pending_bdev_io": 0, 00:12:01.479 "completed_nvme_io": 0, 00:12:01.479 "transports": [ 00:12:01.479 { 00:12:01.479 "trtype": "TCP" 00:12:01.479 } 00:12:01.479 ] 00:12:01.479 }, 00:12:01.479 { 00:12:01.479 "name": "nvmf_tgt_poll_group_2", 00:12:01.479 "admin_qpairs": 0, 00:12:01.479 "io_qpairs": 0, 00:12:01.479 "current_admin_qpairs": 0, 00:12:01.479 "current_io_qpairs": 0, 00:12:01.479 "pending_bdev_io": 0, 00:12:01.479 "completed_nvme_io": 0, 00:12:01.479 "transports": [ 00:12:01.479 { 00:12:01.479 "trtype": "TCP" 00:12:01.479 } 00:12:01.479 ] 00:12:01.479 }, 00:12:01.479 { 00:12:01.479 "name": "nvmf_tgt_poll_group_3", 00:12:01.479 "admin_qpairs": 0, 00:12:01.479 "io_qpairs": 0, 00:12:01.480 "current_admin_qpairs": 0, 00:12:01.480 "current_io_qpairs": 0, 00:12:01.480 "pending_bdev_io": 0, 00:12:01.480 "completed_nvme_io": 0, 00:12:01.480 "transports": [ 00:12:01.480 { 00:12:01.480 "trtype": "TCP" 00:12:01.480 } 00:12:01.480 ] 00:12:01.480 } 00:12:01.480 ] 00:12:01.480 }' 00:12:01.480 19:00:22 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:12:01.480 19:00:22 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:12:01.480 19:00:22 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:12:01.480 19:00:22 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:01.480 19:00:22 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:12:01.480 19:00:22 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:12:01.480 19:00:22 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:12:01.480 19:00:22 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:12:01.480 19:00:22 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:01.738 19:00:22 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:12:01.738 19:00:22 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:12:01.738 19:00:22 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:12:01.738 19:00:22 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:12:01.738 19:00:22 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:12:01.738 19:00:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.738 19:00:22 -- common/autotest_common.sh@10 -- # set +x 00:12:01.738 Malloc1 00:12:01.738 19:00:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.738 19:00:22 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:12:01.738 19:00:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.738 19:00:22 -- common/autotest_common.sh@10 -- # set +x 00:12:01.738 19:00:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.738 19:00:22 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:01.738 19:00:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.738 19:00:22 -- common/autotest_common.sh@10 -- # set +x 00:12:01.738 19:00:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.738 19:00:22 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:12:01.738 19:00:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.738 19:00:22 -- common/autotest_common.sh@10 -- # set +x 00:12:01.738 19:00:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.738 19:00:22 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:01.738 19:00:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.738 19:00:22 -- common/autotest_common.sh@10 -- # set +x 00:12:01.738 [2024-11-28 19:00:22.595051] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:01.738 19:00:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.738 19:00:22 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:12:01.738 19:00:22 -- common/autotest_common.sh@650 -- # local es=0 00:12:01.738 19:00:22 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:12:01.738 19:00:22 -- common/autotest_common.sh@638 -- # local arg=nvme 00:12:01.738 19:00:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:01.738 19:00:22 -- common/autotest_common.sh@642 -- # type -t nvme 00:12:01.738 19:00:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:01.738 19:00:22 -- common/autotest_common.sh@644 -- # type -P nvme 00:12:01.738 19:00:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:01.738 19:00:22 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:12:01.738 19:00:22 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:12:01.738 19:00:22 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:12:01.738 [2024-11-28 19:00:22.617491] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:12:01.738 Failed to write to /dev/nvme-fabrics: Input/output error 00:12:01.738 could not add new controller: failed to write to nvme-fabrics device 00:12:01.738 19:00:22 -- common/autotest_common.sh@653 -- # es=1 00:12:01.738 19:00:22 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:12:01.738 19:00:22 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:12:01.738 19:00:22 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:12:01.738 19:00:22 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:01.738 19:00:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:01.738 19:00:22 -- common/autotest_common.sh@10 -- # set +x 00:12:01.738 19:00:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:01.738 19:00:22 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:02.305 19:00:23 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:12:02.305 19:00:23 -- common/autotest_common.sh@1187 -- # local i=0 00:12:02.305 19:00:23 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:02.305 19:00:23 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:02.305 19:00:23 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:04.841 19:00:25 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:04.841 19:00:25 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:04.841 19:00:25 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:04.841 19:00:25 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:04.841 19:00:25 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:04.841 19:00:25 -- common/autotest_common.sh@1197 -- # return 0 00:12:04.841 19:00:25 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:04.841 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:04.841 19:00:25 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:04.841 19:00:25 -- common/autotest_common.sh@1208 -- # local i=0 00:12:04.841 19:00:25 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:04.841 19:00:25 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:04.841 19:00:25 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:04.841 19:00:25 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:04.841 19:00:25 -- common/autotest_common.sh@1220 -- # return 0 00:12:04.841 19:00:25 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:04.841 19:00:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:04.841 19:00:25 -- common/autotest_common.sh@10 -- # set +x 00:12:04.841 19:00:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:04.841 19:00:25 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:04.841 19:00:25 -- common/autotest_common.sh@650 -- # local es=0 00:12:04.841 19:00:25 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:04.841 19:00:25 -- common/autotest_common.sh@638 -- # local arg=nvme 00:12:04.841 19:00:25 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:04.841 19:00:25 -- common/autotest_common.sh@642 -- # type -t nvme 00:12:04.841 19:00:25 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:04.841 19:00:25 -- common/autotest_common.sh@644 -- # type -P nvme 00:12:04.841 19:00:25 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:04.841 19:00:25 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:12:04.841 19:00:25 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:12:04.841 19:00:25 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:04.841 [2024-11-28 19:00:25.497503] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:12:04.841 Failed to write to /dev/nvme-fabrics: Input/output error 00:12:04.841 could not add new controller: failed to write to nvme-fabrics device 00:12:04.841 19:00:25 -- common/autotest_common.sh@653 -- # es=1 00:12:04.841 19:00:25 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:12:04.841 19:00:25 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:12:04.841 19:00:25 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:12:04.841 19:00:25 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:12:04.841 19:00:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:04.841 19:00:25 -- common/autotest_common.sh@10 -- # set +x 00:12:04.841 19:00:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:04.842 19:00:25 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:05.102 19:00:26 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:12:05.102 19:00:26 -- common/autotest_common.sh@1187 -- # local i=0 00:12:05.102 19:00:26 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:05.102 19:00:26 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:05.102 19:00:26 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:07.635 19:00:28 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:07.635 19:00:28 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:07.635 19:00:28 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:07.635 19:00:28 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:07.635 19:00:28 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:07.635 19:00:28 -- common/autotest_common.sh@1197 -- # return 0 00:12:07.635 19:00:28 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:07.635 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:07.635 19:00:28 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:07.635 19:00:28 -- common/autotest_common.sh@1208 -- # local i=0 00:12:07.635 19:00:28 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:07.635 19:00:28 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:07.635 19:00:28 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:07.635 19:00:28 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:07.635 19:00:28 -- common/autotest_common.sh@1220 -- # return 0 00:12:07.635 19:00:28 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:07.635 19:00:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:07.635 19:00:28 -- common/autotest_common.sh@10 -- # set +x 00:12:07.635 19:00:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:07.635 19:00:28 -- target/rpc.sh@81 -- # seq 1 5 00:12:07.635 19:00:28 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:07.635 19:00:28 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:07.635 19:00:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:07.635 19:00:28 -- common/autotest_common.sh@10 -- # set +x 00:12:07.635 19:00:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:07.635 19:00:28 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:07.635 19:00:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:07.635 19:00:28 -- common/autotest_common.sh@10 -- # set +x 00:12:07.635 [2024-11-28 19:00:28.274516] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:07.635 19:00:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:07.635 19:00:28 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:07.635 19:00:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:07.635 19:00:28 -- common/autotest_common.sh@10 -- # set +x 00:12:07.636 19:00:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:07.636 19:00:28 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:07.636 19:00:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:07.636 19:00:28 -- common/autotest_common.sh@10 -- # set +x 00:12:07.636 19:00:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:07.636 19:00:28 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:08.204 19:00:28 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:08.204 19:00:28 -- common/autotest_common.sh@1187 -- # local i=0 00:12:08.204 19:00:28 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:08.204 19:00:28 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:08.204 19:00:28 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:10.108 19:00:30 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:10.108 19:00:30 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:10.108 19:00:30 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:10.108 19:00:30 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:10.108 19:00:30 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:10.108 19:00:30 -- common/autotest_common.sh@1197 -- # return 0 00:12:10.108 19:00:30 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:10.108 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:10.108 19:00:31 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:10.108 19:00:31 -- common/autotest_common.sh@1208 -- # local i=0 00:12:10.108 19:00:31 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:10.108 19:00:31 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:10.108 19:00:31 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:10.108 19:00:31 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:10.369 19:00:31 -- common/autotest_common.sh@1220 -- # return 0 00:12:10.369 19:00:31 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:10.369 19:00:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.369 19:00:31 -- common/autotest_common.sh@10 -- # set +x 00:12:10.369 19:00:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.369 19:00:31 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:10.369 19:00:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.369 19:00:31 -- common/autotest_common.sh@10 -- # set +x 00:12:10.369 19:00:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.369 19:00:31 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:10.369 19:00:31 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:10.369 19:00:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.369 19:00:31 -- common/autotest_common.sh@10 -- # set +x 00:12:10.369 19:00:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.369 19:00:31 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:10.369 19:00:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.369 19:00:31 -- common/autotest_common.sh@10 -- # set +x 00:12:10.369 [2024-11-28 19:00:31.186928] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:10.369 19:00:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.369 19:00:31 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:10.369 19:00:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.369 19:00:31 -- common/autotest_common.sh@10 -- # set +x 00:12:10.369 19:00:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.369 19:00:31 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:10.369 19:00:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:10.369 19:00:31 -- common/autotest_common.sh@10 -- # set +x 00:12:10.369 19:00:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:10.369 19:00:31 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:10.937 19:00:31 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:10.937 19:00:31 -- common/autotest_common.sh@1187 -- # local i=0 00:12:10.937 19:00:31 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:10.937 19:00:31 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:10.937 19:00:31 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:13.470 19:00:33 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:13.470 19:00:33 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:13.470 19:00:33 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:13.470 19:00:33 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:13.470 19:00:33 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:13.470 19:00:33 -- common/autotest_common.sh@1197 -- # return 0 00:12:13.470 19:00:33 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:13.470 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:13.470 19:00:33 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:13.470 19:00:33 -- common/autotest_common.sh@1208 -- # local i=0 00:12:13.470 19:00:33 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:13.470 19:00:33 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:13.470 19:00:33 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:13.470 19:00:33 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:13.470 19:00:33 -- common/autotest_common.sh@1220 -- # return 0 00:12:13.470 19:00:33 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:13.470 19:00:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:13.470 19:00:33 -- common/autotest_common.sh@10 -- # set +x 00:12:13.470 19:00:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:13.470 19:00:33 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:13.470 19:00:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:13.470 19:00:33 -- common/autotest_common.sh@10 -- # set +x 00:12:13.470 19:00:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:13.470 19:00:33 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:13.470 19:00:33 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:13.470 19:00:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:13.470 19:00:33 -- common/autotest_common.sh@10 -- # set +x 00:12:13.470 19:00:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:13.470 19:00:33 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:13.470 19:00:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:13.470 19:00:34 -- common/autotest_common.sh@10 -- # set +x 00:12:13.470 [2024-11-28 19:00:34.005032] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:13.470 19:00:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:13.470 19:00:34 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:13.470 19:00:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:13.470 19:00:34 -- common/autotest_common.sh@10 -- # set +x 00:12:13.470 19:00:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:13.470 19:00:34 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:13.470 19:00:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:13.471 19:00:34 -- common/autotest_common.sh@10 -- # set +x 00:12:13.471 19:00:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:13.471 19:00:34 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:13.730 19:00:34 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:13.730 19:00:34 -- common/autotest_common.sh@1187 -- # local i=0 00:12:13.730 19:00:34 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:13.730 19:00:34 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:13.730 19:00:34 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:15.633 19:00:36 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:15.633 19:00:36 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:15.633 19:00:36 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:15.633 19:00:36 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:15.633 19:00:36 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:15.633 19:00:36 -- common/autotest_common.sh@1197 -- # return 0 00:12:15.633 19:00:36 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:15.893 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:15.893 19:00:36 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:15.893 19:00:36 -- common/autotest_common.sh@1208 -- # local i=0 00:12:15.894 19:00:36 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:15.894 19:00:36 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:15.894 19:00:36 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:15.894 19:00:36 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:15.894 19:00:36 -- common/autotest_common.sh@1220 -- # return 0 00:12:15.894 19:00:36 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:15.894 19:00:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.894 19:00:36 -- common/autotest_common.sh@10 -- # set +x 00:12:15.894 19:00:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.894 19:00:36 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:15.894 19:00:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.894 19:00:36 -- common/autotest_common.sh@10 -- # set +x 00:12:15.894 19:00:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.894 19:00:36 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:15.894 19:00:36 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:15.894 19:00:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.894 19:00:36 -- common/autotest_common.sh@10 -- # set +x 00:12:15.894 19:00:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.894 19:00:36 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:15.894 19:00:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.894 19:00:36 -- common/autotest_common.sh@10 -- # set +x 00:12:15.894 [2024-11-28 19:00:36.763370] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:15.894 19:00:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.894 19:00:36 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:15.894 19:00:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.894 19:00:36 -- common/autotest_common.sh@10 -- # set +x 00:12:15.894 19:00:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.894 19:00:36 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:15.894 19:00:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:15.894 19:00:36 -- common/autotest_common.sh@10 -- # set +x 00:12:15.894 19:00:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:15.894 19:00:36 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:16.464 19:00:37 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:16.464 19:00:37 -- common/autotest_common.sh@1187 -- # local i=0 00:12:16.464 19:00:37 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:16.464 19:00:37 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:16.464 19:00:37 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:18.369 19:00:39 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:18.369 19:00:39 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:18.369 19:00:39 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:18.369 19:00:39 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:18.369 19:00:39 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:18.369 19:00:39 -- common/autotest_common.sh@1197 -- # return 0 00:12:18.369 19:00:39 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:18.629 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:18.629 19:00:39 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:18.629 19:00:39 -- common/autotest_common.sh@1208 -- # local i=0 00:12:18.629 19:00:39 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:18.629 19:00:39 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:18.629 19:00:39 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:18.629 19:00:39 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:18.629 19:00:39 -- common/autotest_common.sh@1220 -- # return 0 00:12:18.629 19:00:39 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:18.629 19:00:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.629 19:00:39 -- common/autotest_common.sh@10 -- # set +x 00:12:18.629 19:00:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.629 19:00:39 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:18.629 19:00:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.629 19:00:39 -- common/autotest_common.sh@10 -- # set +x 00:12:18.629 19:00:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.629 19:00:39 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:18.629 19:00:39 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:18.629 19:00:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.629 19:00:39 -- common/autotest_common.sh@10 -- # set +x 00:12:18.629 19:00:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.629 19:00:39 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:18.629 19:00:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.629 19:00:39 -- common/autotest_common.sh@10 -- # set +x 00:12:18.629 [2024-11-28 19:00:39.529951] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:18.629 19:00:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.629 19:00:39 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:18.629 19:00:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.629 19:00:39 -- common/autotest_common.sh@10 -- # set +x 00:12:18.629 19:00:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.629 19:00:39 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:18.629 19:00:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:18.629 19:00:39 -- common/autotest_common.sh@10 -- # set +x 00:12:18.629 19:00:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:18.629 19:00:39 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:19.198 19:00:40 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:19.198 19:00:40 -- common/autotest_common.sh@1187 -- # local i=0 00:12:19.198 19:00:40 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:19.198 19:00:40 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:19.198 19:00:40 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:21.733 19:00:42 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:21.733 19:00:42 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:21.733 19:00:42 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:21.733 19:00:42 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:21.733 19:00:42 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:21.733 19:00:42 -- common/autotest_common.sh@1197 -- # return 0 00:12:21.733 19:00:42 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:21.733 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:21.733 19:00:42 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:21.733 19:00:42 -- common/autotest_common.sh@1208 -- # local i=0 00:12:21.733 19:00:42 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:21.733 19:00:42 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:21.733 19:00:42 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:21.733 19:00:42 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:21.733 19:00:42 -- common/autotest_common.sh@1220 -- # return 0 00:12:21.733 19:00:42 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:21.733 19:00:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.733 19:00:42 -- common/autotest_common.sh@10 -- # set +x 00:12:21.733 19:00:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.733 19:00:42 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:21.733 19:00:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.733 19:00:42 -- common/autotest_common.sh@10 -- # set +x 00:12:21.733 19:00:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.733 19:00:42 -- target/rpc.sh@99 -- # seq 1 5 00:12:21.733 19:00:42 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:21.733 19:00:42 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:21.733 19:00:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.733 19:00:42 -- common/autotest_common.sh@10 -- # set +x 00:12:21.733 19:00:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.733 19:00:42 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:21.733 19:00:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.733 19:00:42 -- common/autotest_common.sh@10 -- # set +x 00:12:21.733 [2024-11-28 19:00:42.379963] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:21.734 19:00:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.734 19:00:42 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:21.734 19:00:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.734 19:00:42 -- common/autotest_common.sh@10 -- # set +x 00:12:21.734 19:00:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.734 19:00:42 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:21.734 19:00:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.734 19:00:42 -- common/autotest_common.sh@10 -- # set +x 00:12:21.734 19:00:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.734 19:00:42 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:21.734 19:00:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.734 19:00:42 -- common/autotest_common.sh@10 -- # set +x 00:12:21.734 19:00:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.734 19:00:42 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:21.734 19:00:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.734 19:00:42 -- common/autotest_common.sh@10 -- # set +x 00:12:21.734 19:00:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.734 19:00:42 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:21.734 19:00:42 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:21.734 19:00:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.734 19:00:42 -- common/autotest_common.sh@10 -- # set +x 00:12:21.734 19:00:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.734 19:00:42 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:21.734 19:00:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.734 19:00:42 -- common/autotest_common.sh@10 -- # set +x 00:12:21.734 [2024-11-28 19:00:42.428028] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:21.734 19:00:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.734 19:00:42 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:21.734 19:00:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.734 19:00:42 -- common/autotest_common.sh@10 -- # set +x 00:12:21.734 19:00:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.734 19:00:42 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:21.734 19:00:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.734 19:00:42 -- common/autotest_common.sh@10 -- # set +x 00:12:21.734 19:00:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.734 19:00:42 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:21.734 19:00:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.734 19:00:42 -- common/autotest_common.sh@10 -- # set +x 00:12:21.734 19:00:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.734 19:00:42 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:21.734 19:00:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.734 19:00:42 -- common/autotest_common.sh@10 -- # set +x 00:12:21.734 19:00:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.734 19:00:42 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:21.734 19:00:42 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:21.734 19:00:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.734 19:00:42 -- common/autotest_common.sh@10 -- # set +x 00:12:21.734 19:00:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.734 19:00:42 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:21.734 19:00:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.734 19:00:42 -- common/autotest_common.sh@10 -- # set +x 00:12:21.734 [2024-11-28 19:00:42.476186] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:21.734 19:00:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.734 19:00:42 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:21.734 19:00:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.734 19:00:42 -- common/autotest_common.sh@10 -- # set +x 00:12:21.734 19:00:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.734 19:00:42 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:21.734 19:00:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.734 19:00:42 -- common/autotest_common.sh@10 -- # set +x 00:12:21.734 19:00:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.734 19:00:42 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:21.734 19:00:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.734 19:00:42 -- common/autotest_common.sh@10 -- # set +x 00:12:21.734 19:00:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.734 19:00:42 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:21.734 19:00:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.734 19:00:42 -- common/autotest_common.sh@10 -- # set +x 00:12:21.734 19:00:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.734 19:00:42 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:21.734 19:00:42 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:21.734 19:00:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.734 19:00:42 -- common/autotest_common.sh@10 -- # set +x 00:12:21.734 19:00:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.734 19:00:42 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:21.734 19:00:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.734 19:00:42 -- common/autotest_common.sh@10 -- # set +x 00:12:21.734 [2024-11-28 19:00:42.524343] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:21.734 19:00:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.734 19:00:42 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:21.734 19:00:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.734 19:00:42 -- common/autotest_common.sh@10 -- # set +x 00:12:21.734 19:00:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.734 19:00:42 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:21.734 19:00:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.734 19:00:42 -- common/autotest_common.sh@10 -- # set +x 00:12:21.734 19:00:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.734 19:00:42 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:21.734 19:00:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.734 19:00:42 -- common/autotest_common.sh@10 -- # set +x 00:12:21.734 19:00:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.734 19:00:42 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:21.734 19:00:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.734 19:00:42 -- common/autotest_common.sh@10 -- # set +x 00:12:21.734 19:00:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.734 19:00:42 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:21.734 19:00:42 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:21.734 19:00:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.734 19:00:42 -- common/autotest_common.sh@10 -- # set +x 00:12:21.734 19:00:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.734 19:00:42 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:21.734 19:00:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.734 19:00:42 -- common/autotest_common.sh@10 -- # set +x 00:12:21.734 [2024-11-28 19:00:42.572558] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:21.734 19:00:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.734 19:00:42 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:21.734 19:00:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.734 19:00:42 -- common/autotest_common.sh@10 -- # set +x 00:12:21.734 19:00:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.734 19:00:42 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:21.734 19:00:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.734 19:00:42 -- common/autotest_common.sh@10 -- # set +x 00:12:21.734 19:00:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.734 19:00:42 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:21.734 19:00:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.734 19:00:42 -- common/autotest_common.sh@10 -- # set +x 00:12:21.734 19:00:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.734 19:00:42 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:21.734 19:00:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.734 19:00:42 -- common/autotest_common.sh@10 -- # set +x 00:12:21.734 19:00:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.734 19:00:42 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:12:21.734 19:00:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:21.734 19:00:42 -- common/autotest_common.sh@10 -- # set +x 00:12:21.734 19:00:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:21.734 19:00:42 -- target/rpc.sh@110 -- # stats='{ 00:12:21.734 "tick_rate": 2700000000, 00:12:21.734 "poll_groups": [ 00:12:21.734 { 00:12:21.734 "name": "nvmf_tgt_poll_group_0", 00:12:21.734 "admin_qpairs": 2, 00:12:21.734 "io_qpairs": 84, 00:12:21.734 "current_admin_qpairs": 0, 00:12:21.734 "current_io_qpairs": 0, 00:12:21.734 "pending_bdev_io": 0, 00:12:21.734 "completed_nvme_io": 183, 00:12:21.734 "transports": [ 00:12:21.734 { 00:12:21.734 "trtype": "TCP" 00:12:21.734 } 00:12:21.734 ] 00:12:21.734 }, 00:12:21.734 { 00:12:21.734 "name": "nvmf_tgt_poll_group_1", 00:12:21.734 "admin_qpairs": 2, 00:12:21.734 "io_qpairs": 84, 00:12:21.734 "current_admin_qpairs": 0, 00:12:21.734 "current_io_qpairs": 0, 00:12:21.734 "pending_bdev_io": 0, 00:12:21.734 "completed_nvme_io": 198, 00:12:21.734 "transports": [ 00:12:21.734 { 00:12:21.734 "trtype": "TCP" 00:12:21.734 } 00:12:21.734 ] 00:12:21.734 }, 00:12:21.734 { 00:12:21.734 "name": "nvmf_tgt_poll_group_2", 00:12:21.734 "admin_qpairs": 1, 00:12:21.734 "io_qpairs": 84, 00:12:21.734 "current_admin_qpairs": 0, 00:12:21.735 "current_io_qpairs": 0, 00:12:21.735 "pending_bdev_io": 0, 00:12:21.735 "completed_nvme_io": 170, 00:12:21.735 "transports": [ 00:12:21.735 { 00:12:21.735 "trtype": "TCP" 00:12:21.735 } 00:12:21.735 ] 00:12:21.735 }, 00:12:21.735 { 00:12:21.735 "name": "nvmf_tgt_poll_group_3", 00:12:21.735 "admin_qpairs": 2, 00:12:21.735 "io_qpairs": 84, 00:12:21.735 "current_admin_qpairs": 0, 00:12:21.735 "current_io_qpairs": 0, 00:12:21.735 "pending_bdev_io": 0, 00:12:21.735 "completed_nvme_io": 135, 00:12:21.735 "transports": [ 00:12:21.735 { 00:12:21.735 "trtype": "TCP" 00:12:21.735 } 00:12:21.735 ] 00:12:21.735 } 00:12:21.735 ] 00:12:21.735 }' 00:12:21.735 19:00:42 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:12:21.735 19:00:42 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:12:21.735 19:00:42 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:12:21.735 19:00:42 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:21.735 19:00:42 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:12:21.735 19:00:42 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:12:21.735 19:00:42 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:12:21.735 19:00:42 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:12:21.735 19:00:42 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:21.735 19:00:42 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:12:21.735 19:00:42 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:12:21.735 19:00:42 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:12:21.735 19:00:42 -- target/rpc.sh@123 -- # nvmftestfini 00:12:21.735 19:00:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:21.735 19:00:42 -- nvmf/common.sh@116 -- # sync 00:12:21.735 19:00:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:21.735 19:00:42 -- nvmf/common.sh@119 -- # set +e 00:12:21.735 19:00:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:21.735 19:00:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:21.735 rmmod nvme_tcp 00:12:21.735 rmmod nvme_fabrics 00:12:21.735 rmmod nvme_keyring 00:12:21.735 19:00:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:21.735 19:00:42 -- nvmf/common.sh@123 -- # set -e 00:12:21.735 19:00:42 -- nvmf/common.sh@124 -- # return 0 00:12:21.735 19:00:42 -- nvmf/common.sh@477 -- # '[' -n 151828 ']' 00:12:21.735 19:00:42 -- nvmf/common.sh@478 -- # killprocess 151828 00:12:21.735 19:00:42 -- common/autotest_common.sh@936 -- # '[' -z 151828 ']' 00:12:21.735 19:00:42 -- common/autotest_common.sh@940 -- # kill -0 151828 00:12:21.735 19:00:42 -- common/autotest_common.sh@941 -- # uname 00:12:21.994 19:00:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:21.994 19:00:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 151828 00:12:21.994 19:00:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:21.994 19:00:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:21.994 19:00:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 151828' 00:12:21.994 killing process with pid 151828 00:12:21.994 19:00:42 -- common/autotest_common.sh@955 -- # kill 151828 00:12:21.994 19:00:42 -- common/autotest_common.sh@960 -- # wait 151828 00:12:22.253 19:00:43 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:22.253 19:00:43 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:22.253 19:00:43 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:22.253 19:00:43 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:22.253 19:00:43 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:22.253 19:00:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:22.253 19:00:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:22.253 19:00:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:24.164 19:00:45 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:24.164 00:12:24.164 real 0m26.343s 00:12:24.164 user 1m25.978s 00:12:24.164 sys 0m4.218s 00:12:24.164 19:00:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:24.164 19:00:45 -- common/autotest_common.sh@10 -- # set +x 00:12:24.164 ************************************ 00:12:24.164 END TEST nvmf_rpc 00:12:24.164 ************************************ 00:12:24.164 19:00:45 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:24.164 19:00:45 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:24.164 19:00:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:24.164 19:00:45 -- common/autotest_common.sh@10 -- # set +x 00:12:24.164 ************************************ 00:12:24.164 START TEST nvmf_invalid 00:12:24.164 ************************************ 00:12:24.164 19:00:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:24.428 * Looking for test storage... 00:12:24.428 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:24.428 19:00:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:24.428 19:00:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:24.428 19:00:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:24.428 19:00:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:24.428 19:00:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:24.428 19:00:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:24.428 19:00:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:24.428 19:00:45 -- scripts/common.sh@335 -- # IFS=.-: 00:12:24.428 19:00:45 -- scripts/common.sh@335 -- # read -ra ver1 00:12:24.428 19:00:45 -- scripts/common.sh@336 -- # IFS=.-: 00:12:24.428 19:00:45 -- scripts/common.sh@336 -- # read -ra ver2 00:12:24.428 19:00:45 -- scripts/common.sh@337 -- # local 'op=<' 00:12:24.428 19:00:45 -- scripts/common.sh@339 -- # ver1_l=2 00:12:24.428 19:00:45 -- scripts/common.sh@340 -- # ver2_l=1 00:12:24.428 19:00:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:24.428 19:00:45 -- scripts/common.sh@343 -- # case "$op" in 00:12:24.428 19:00:45 -- scripts/common.sh@344 -- # : 1 00:12:24.428 19:00:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:24.428 19:00:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:24.428 19:00:45 -- scripts/common.sh@364 -- # decimal 1 00:12:24.428 19:00:45 -- scripts/common.sh@352 -- # local d=1 00:12:24.428 19:00:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:24.428 19:00:45 -- scripts/common.sh@354 -- # echo 1 00:12:24.428 19:00:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:24.428 19:00:45 -- scripts/common.sh@365 -- # decimal 2 00:12:24.428 19:00:45 -- scripts/common.sh@352 -- # local d=2 00:12:24.428 19:00:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:24.428 19:00:45 -- scripts/common.sh@354 -- # echo 2 00:12:24.428 19:00:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:24.428 19:00:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:24.428 19:00:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:24.428 19:00:45 -- scripts/common.sh@367 -- # return 0 00:12:24.428 19:00:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:24.428 19:00:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:24.428 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:24.428 --rc genhtml_branch_coverage=1 00:12:24.428 --rc genhtml_function_coverage=1 00:12:24.428 --rc genhtml_legend=1 00:12:24.428 --rc geninfo_all_blocks=1 00:12:24.428 --rc geninfo_unexecuted_blocks=1 00:12:24.428 00:12:24.428 ' 00:12:24.428 19:00:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:24.428 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:24.428 --rc genhtml_branch_coverage=1 00:12:24.428 --rc genhtml_function_coverage=1 00:12:24.428 --rc genhtml_legend=1 00:12:24.428 --rc geninfo_all_blocks=1 00:12:24.428 --rc geninfo_unexecuted_blocks=1 00:12:24.428 00:12:24.428 ' 00:12:24.428 19:00:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:24.428 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:24.428 --rc genhtml_branch_coverage=1 00:12:24.428 --rc genhtml_function_coverage=1 00:12:24.428 --rc genhtml_legend=1 00:12:24.428 --rc geninfo_all_blocks=1 00:12:24.428 --rc geninfo_unexecuted_blocks=1 00:12:24.428 00:12:24.428 ' 00:12:24.428 19:00:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:24.428 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:24.428 --rc genhtml_branch_coverage=1 00:12:24.428 --rc genhtml_function_coverage=1 00:12:24.428 --rc genhtml_legend=1 00:12:24.428 --rc geninfo_all_blocks=1 00:12:24.428 --rc geninfo_unexecuted_blocks=1 00:12:24.428 00:12:24.428 ' 00:12:24.428 19:00:45 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:24.428 19:00:45 -- nvmf/common.sh@7 -- # uname -s 00:12:24.428 19:00:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:24.428 19:00:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:24.428 19:00:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:24.428 19:00:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:24.428 19:00:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:24.428 19:00:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:24.428 19:00:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:24.428 19:00:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:24.428 19:00:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:24.428 19:00:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:24.428 19:00:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:24.428 19:00:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:24.428 19:00:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:24.428 19:00:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:24.428 19:00:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:24.428 19:00:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:24.428 19:00:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:24.428 19:00:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:24.428 19:00:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:24.428 19:00:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:24.428 19:00:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:24.428 19:00:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:24.428 19:00:45 -- paths/export.sh@5 -- # export PATH 00:12:24.428 19:00:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:24.428 19:00:45 -- nvmf/common.sh@46 -- # : 0 00:12:24.428 19:00:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:24.428 19:00:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:24.428 19:00:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:24.428 19:00:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:24.428 19:00:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:24.428 19:00:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:24.428 19:00:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:24.428 19:00:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:24.428 19:00:45 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:12:24.428 19:00:45 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:24.428 19:00:45 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:12:24.428 19:00:45 -- target/invalid.sh@14 -- # target=foobar 00:12:24.428 19:00:45 -- target/invalid.sh@16 -- # RANDOM=0 00:12:24.428 19:00:45 -- target/invalid.sh@34 -- # nvmftestinit 00:12:24.428 19:00:45 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:24.428 19:00:45 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:24.428 19:00:45 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:24.428 19:00:45 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:24.428 19:00:45 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:24.428 19:00:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:24.428 19:00:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:24.428 19:00:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:24.428 19:00:45 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:24.428 19:00:45 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:24.428 19:00:45 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:24.428 19:00:45 -- common/autotest_common.sh@10 -- # set +x 00:12:26.335 19:00:47 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:26.335 19:00:47 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:26.335 19:00:47 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:26.335 19:00:47 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:26.335 19:00:47 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:26.335 19:00:47 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:26.335 19:00:47 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:26.335 19:00:47 -- nvmf/common.sh@294 -- # net_devs=() 00:12:26.335 19:00:47 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:26.335 19:00:47 -- nvmf/common.sh@295 -- # e810=() 00:12:26.335 19:00:47 -- nvmf/common.sh@295 -- # local -ga e810 00:12:26.335 19:00:47 -- nvmf/common.sh@296 -- # x722=() 00:12:26.335 19:00:47 -- nvmf/common.sh@296 -- # local -ga x722 00:12:26.335 19:00:47 -- nvmf/common.sh@297 -- # mlx=() 00:12:26.335 19:00:47 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:26.335 19:00:47 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:26.335 19:00:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:26.335 19:00:47 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:26.335 19:00:47 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:26.335 19:00:47 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:26.335 19:00:47 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:26.335 19:00:47 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:26.335 19:00:47 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:26.335 19:00:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:26.335 19:00:47 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:26.335 19:00:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:26.335 19:00:47 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:26.335 19:00:47 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:26.335 19:00:47 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:26.335 19:00:47 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:26.335 19:00:47 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:26.335 19:00:47 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:26.335 19:00:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:26.335 19:00:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:26.335 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:26.335 19:00:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:26.335 19:00:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:26.335 19:00:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:26.335 19:00:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:26.335 19:00:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:26.335 19:00:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:26.335 19:00:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:26.335 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:26.335 19:00:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:26.335 19:00:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:26.335 19:00:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:26.335 19:00:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:26.335 19:00:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:26.335 19:00:47 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:26.335 19:00:47 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:26.335 19:00:47 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:26.335 19:00:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:26.335 19:00:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:26.335 19:00:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:26.335 19:00:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:26.335 19:00:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:26.335 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:26.335 19:00:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:26.335 19:00:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:26.335 19:00:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:26.335 19:00:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:26.335 19:00:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:26.594 19:00:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:26.594 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:26.594 19:00:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:26.594 19:00:47 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:26.594 19:00:47 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:26.594 19:00:47 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:26.594 19:00:47 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:26.594 19:00:47 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:26.594 19:00:47 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:26.594 19:00:47 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:26.594 19:00:47 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:26.594 19:00:47 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:26.594 19:00:47 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:26.594 19:00:47 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:26.594 19:00:47 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:26.594 19:00:47 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:26.594 19:00:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:26.594 19:00:47 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:26.594 19:00:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:26.594 19:00:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:26.594 19:00:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:26.594 19:00:47 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:26.594 19:00:47 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:26.594 19:00:47 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:26.594 19:00:47 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:26.594 19:00:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:26.594 19:00:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:26.594 19:00:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:26.594 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:26.594 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.315 ms 00:12:26.594 00:12:26.594 --- 10.0.0.2 ping statistics --- 00:12:26.594 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:26.594 rtt min/avg/max/mdev = 0.315/0.315/0.315/0.000 ms 00:12:26.594 19:00:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:26.594 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:26.594 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.098 ms 00:12:26.594 00:12:26.594 --- 10.0.0.1 ping statistics --- 00:12:26.594 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:26.594 rtt min/avg/max/mdev = 0.098/0.098/0.098/0.000 ms 00:12:26.594 19:00:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:26.594 19:00:47 -- nvmf/common.sh@410 -- # return 0 00:12:26.594 19:00:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:26.594 19:00:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:26.594 19:00:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:26.594 19:00:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:26.594 19:00:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:26.594 19:00:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:26.594 19:00:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:26.594 19:00:47 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:12:26.594 19:00:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:26.594 19:00:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:26.594 19:00:47 -- common/autotest_common.sh@10 -- # set +x 00:12:26.594 19:00:47 -- nvmf/common.sh@469 -- # nvmfpid=156546 00:12:26.594 19:00:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:26.594 19:00:47 -- nvmf/common.sh@470 -- # waitforlisten 156546 00:12:26.594 19:00:47 -- common/autotest_common.sh@829 -- # '[' -z 156546 ']' 00:12:26.594 19:00:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:26.594 19:00:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:26.594 19:00:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:26.594 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:26.594 19:00:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:26.594 19:00:47 -- common/autotest_common.sh@10 -- # set +x 00:12:26.594 [2024-11-28 19:00:47.579745] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:26.594 [2024-11-28 19:00:47.579817] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:26.594 EAL: No free 2048 kB hugepages reported on node 1 00:12:26.853 [2024-11-28 19:00:47.643524] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:26.853 [2024-11-28 19:00:47.749151] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:26.853 [2024-11-28 19:00:47.749306] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:26.853 [2024-11-28 19:00:47.749338] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:26.853 [2024-11-28 19:00:47.749351] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:26.853 [2024-11-28 19:00:47.749415] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:26.853 [2024-11-28 19:00:47.749475] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:26.853 [2024-11-28 19:00:47.749525] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:26.853 [2024-11-28 19:00:47.749528] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:27.788 19:00:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:27.788 19:00:48 -- common/autotest_common.sh@862 -- # return 0 00:12:27.788 19:00:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:27.788 19:00:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:27.789 19:00:48 -- common/autotest_common.sh@10 -- # set +x 00:12:27.789 19:00:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:27.789 19:00:48 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:12:27.789 19:00:48 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode17371 00:12:28.047 [2024-11-28 19:00:48.897980] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:12:28.047 19:00:48 -- target/invalid.sh@40 -- # out='request: 00:12:28.047 { 00:12:28.047 "nqn": "nqn.2016-06.io.spdk:cnode17371", 00:12:28.047 "tgt_name": "foobar", 00:12:28.047 "method": "nvmf_create_subsystem", 00:12:28.047 "req_id": 1 00:12:28.047 } 00:12:28.047 Got JSON-RPC error response 00:12:28.047 response: 00:12:28.047 { 00:12:28.047 "code": -32603, 00:12:28.047 "message": "Unable to find target foobar" 00:12:28.047 }' 00:12:28.047 19:00:48 -- target/invalid.sh@41 -- # [[ request: 00:12:28.047 { 00:12:28.047 "nqn": "nqn.2016-06.io.spdk:cnode17371", 00:12:28.047 "tgt_name": "foobar", 00:12:28.047 "method": "nvmf_create_subsystem", 00:12:28.047 "req_id": 1 00:12:28.047 } 00:12:28.047 Got JSON-RPC error response 00:12:28.047 response: 00:12:28.047 { 00:12:28.047 "code": -32603, 00:12:28.047 "message": "Unable to find target foobar" 00:12:28.047 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:12:28.047 19:00:48 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:12:28.047 19:00:48 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode13425 00:12:28.305 [2024-11-28 19:00:49.150859] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode13425: invalid serial number 'SPDKISFASTANDAWESOME' 00:12:28.305 19:00:49 -- target/invalid.sh@45 -- # out='request: 00:12:28.305 { 00:12:28.305 "nqn": "nqn.2016-06.io.spdk:cnode13425", 00:12:28.305 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:28.305 "method": "nvmf_create_subsystem", 00:12:28.305 "req_id": 1 00:12:28.305 } 00:12:28.305 Got JSON-RPC error response 00:12:28.305 response: 00:12:28.305 { 00:12:28.305 "code": -32602, 00:12:28.305 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:28.305 }' 00:12:28.306 19:00:49 -- target/invalid.sh@46 -- # [[ request: 00:12:28.306 { 00:12:28.306 "nqn": "nqn.2016-06.io.spdk:cnode13425", 00:12:28.306 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:28.306 "method": "nvmf_create_subsystem", 00:12:28.306 "req_id": 1 00:12:28.306 } 00:12:28.306 Got JSON-RPC error response 00:12:28.306 response: 00:12:28.306 { 00:12:28.306 "code": -32602, 00:12:28.306 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:28.306 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:28.306 19:00:49 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:12:28.306 19:00:49 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode26708 00:12:28.564 [2024-11-28 19:00:49.419731] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode26708: invalid model number 'SPDK_Controller' 00:12:28.564 19:00:49 -- target/invalid.sh@50 -- # out='request: 00:12:28.564 { 00:12:28.564 "nqn": "nqn.2016-06.io.spdk:cnode26708", 00:12:28.564 "model_number": "SPDK_Controller\u001f", 00:12:28.564 "method": "nvmf_create_subsystem", 00:12:28.564 "req_id": 1 00:12:28.564 } 00:12:28.564 Got JSON-RPC error response 00:12:28.564 response: 00:12:28.564 { 00:12:28.564 "code": -32602, 00:12:28.564 "message": "Invalid MN SPDK_Controller\u001f" 00:12:28.564 }' 00:12:28.564 19:00:49 -- target/invalid.sh@51 -- # [[ request: 00:12:28.564 { 00:12:28.564 "nqn": "nqn.2016-06.io.spdk:cnode26708", 00:12:28.564 "model_number": "SPDK_Controller\u001f", 00:12:28.564 "method": "nvmf_create_subsystem", 00:12:28.564 "req_id": 1 00:12:28.564 } 00:12:28.564 Got JSON-RPC error response 00:12:28.564 response: 00:12:28.564 { 00:12:28.564 "code": -32602, 00:12:28.564 "message": "Invalid MN SPDK_Controller\u001f" 00:12:28.564 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:12:28.564 19:00:49 -- target/invalid.sh@54 -- # gen_random_s 21 00:12:28.564 19:00:49 -- target/invalid.sh@19 -- # local length=21 ll 00:12:28.564 19:00:49 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:28.564 19:00:49 -- target/invalid.sh@21 -- # local chars 00:12:28.564 19:00:49 -- target/invalid.sh@22 -- # local string 00:12:28.564 19:00:49 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:28.564 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # printf %x 58 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x3a' 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # string+=: 00:12:28.564 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.564 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # printf %x 33 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x21' 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # string+='!' 00:12:28.564 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.564 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # printf %x 82 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x52' 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # string+=R 00:12:28.564 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.564 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # printf %x 121 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x79' 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # string+=y 00:12:28.564 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.564 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # printf %x 80 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x50' 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # string+=P 00:12:28.564 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.564 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # printf %x 44 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x2c' 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # string+=, 00:12:28.564 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.564 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # printf %x 65 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x41' 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # string+=A 00:12:28.564 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.564 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # printf %x 66 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x42' 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # string+=B 00:12:28.564 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.564 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # printf %x 99 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x63' 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # string+=c 00:12:28.564 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.564 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # printf %x 86 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x56' 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # string+=V 00:12:28.564 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.564 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # printf %x 105 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x69' 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # string+=i 00:12:28.564 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.564 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # printf %x 109 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x6d' 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # string+=m 00:12:28.564 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.564 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # printf %x 96 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x60' 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # string+='`' 00:12:28.564 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.564 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # printf %x 85 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x55' 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # string+=U 00:12:28.564 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.564 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # printf %x 42 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x2a' 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # string+='*' 00:12:28.564 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.564 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # printf %x 67 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x43' 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # string+=C 00:12:28.564 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.564 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # printf %x 106 00:12:28.564 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:12:28.565 19:00:49 -- target/invalid.sh@25 -- # string+=j 00:12:28.565 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.565 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.565 19:00:49 -- target/invalid.sh@25 -- # printf %x 87 00:12:28.565 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x57' 00:12:28.565 19:00:49 -- target/invalid.sh@25 -- # string+=W 00:12:28.565 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.565 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.565 19:00:49 -- target/invalid.sh@25 -- # printf %x 65 00:12:28.565 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x41' 00:12:28.565 19:00:49 -- target/invalid.sh@25 -- # string+=A 00:12:28.565 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.565 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.565 19:00:49 -- target/invalid.sh@25 -- # printf %x 35 00:12:28.565 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x23' 00:12:28.565 19:00:49 -- target/invalid.sh@25 -- # string+='#' 00:12:28.565 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.565 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.565 19:00:49 -- target/invalid.sh@25 -- # printf %x 108 00:12:28.565 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:12:28.565 19:00:49 -- target/invalid.sh@25 -- # string+=l 00:12:28.565 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.565 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.565 19:00:49 -- target/invalid.sh@28 -- # [[ : == \- ]] 00:12:28.565 19:00:49 -- target/invalid.sh@31 -- # echo ':!RyP,ABcVim`U*CjWA#l' 00:12:28.565 19:00:49 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s ':!RyP,ABcVim`U*CjWA#l' nqn.2016-06.io.spdk:cnode26675 00:12:28.824 [2024-11-28 19:00:49.744754] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode26675: invalid serial number ':!RyP,ABcVim`U*CjWA#l' 00:12:28.824 19:00:49 -- target/invalid.sh@54 -- # out='request: 00:12:28.824 { 00:12:28.824 "nqn": "nqn.2016-06.io.spdk:cnode26675", 00:12:28.824 "serial_number": ":!RyP,ABcVim`U*CjWA#l", 00:12:28.824 "method": "nvmf_create_subsystem", 00:12:28.824 "req_id": 1 00:12:28.824 } 00:12:28.824 Got JSON-RPC error response 00:12:28.824 response: 00:12:28.824 { 00:12:28.824 "code": -32602, 00:12:28.824 "message": "Invalid SN :!RyP,ABcVim`U*CjWA#l" 00:12:28.824 }' 00:12:28.824 19:00:49 -- target/invalid.sh@55 -- # [[ request: 00:12:28.824 { 00:12:28.824 "nqn": "nqn.2016-06.io.spdk:cnode26675", 00:12:28.824 "serial_number": ":!RyP,ABcVim`U*CjWA#l", 00:12:28.824 "method": "nvmf_create_subsystem", 00:12:28.824 "req_id": 1 00:12:28.824 } 00:12:28.824 Got JSON-RPC error response 00:12:28.824 response: 00:12:28.824 { 00:12:28.824 "code": -32602, 00:12:28.824 "message": "Invalid SN :!RyP,ABcVim`U*CjWA#l" 00:12:28.824 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:28.824 19:00:49 -- target/invalid.sh@58 -- # gen_random_s 41 00:12:28.824 19:00:49 -- target/invalid.sh@19 -- # local length=41 ll 00:12:28.824 19:00:49 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:28.824 19:00:49 -- target/invalid.sh@21 -- # local chars 00:12:28.824 19:00:49 -- target/invalid.sh@22 -- # local string 00:12:28.824 19:00:49 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:28.824 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # printf %x 68 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x44' 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # string+=D 00:12:28.824 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.824 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # printf %x 115 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x73' 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # string+=s 00:12:28.824 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.824 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # printf %x 79 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x4f' 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # string+=O 00:12:28.824 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.824 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # printf %x 93 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x5d' 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # string+=']' 00:12:28.824 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.824 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # printf %x 42 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x2a' 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # string+='*' 00:12:28.824 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.824 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # printf %x 57 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x39' 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # string+=9 00:12:28.824 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.824 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # printf %x 69 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x45' 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # string+=E 00:12:28.824 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.824 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # printf %x 69 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x45' 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # string+=E 00:12:28.824 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.824 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # printf %x 85 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x55' 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # string+=U 00:12:28.824 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.824 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # printf %x 123 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x7b' 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # string+='{' 00:12:28.824 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.824 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # printf %x 90 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # string+=Z 00:12:28.824 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.824 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # printf %x 53 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x35' 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # string+=5 00:12:28.824 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.824 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # printf %x 56 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x38' 00:12:28.824 19:00:49 -- target/invalid.sh@25 -- # string+=8 00:12:28.825 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.825 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # printf %x 100 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x64' 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # string+=d 00:12:28.825 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.825 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # printf %x 85 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x55' 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # string+=U 00:12:28.825 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.825 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # printf %x 56 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x38' 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # string+=8 00:12:28.825 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.825 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # printf %x 88 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x58' 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # string+=X 00:12:28.825 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.825 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # printf %x 66 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x42' 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # string+=B 00:12:28.825 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.825 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # printf %x 55 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x37' 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # string+=7 00:12:28.825 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.825 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # printf %x 82 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x52' 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # string+=R 00:12:28.825 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.825 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # printf %x 66 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x42' 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # string+=B 00:12:28.825 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.825 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # printf %x 55 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x37' 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # string+=7 00:12:28.825 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.825 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # printf %x 69 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x45' 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # string+=E 00:12:28.825 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.825 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # printf %x 77 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # string+=M 00:12:28.825 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.825 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # printf %x 37 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x25' 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # string+=% 00:12:28.825 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.825 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # printf %x 118 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x76' 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # string+=v 00:12:28.825 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.825 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # printf %x 100 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x64' 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # string+=d 00:12:28.825 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.825 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # printf %x 34 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x22' 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # string+='"' 00:12:28.825 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.825 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # printf %x 68 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x44' 00:12:28.825 19:00:49 -- target/invalid.sh@25 -- # string+=D 00:12:28.825 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:28.825 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.084 19:00:49 -- target/invalid.sh@25 -- # printf %x 72 00:12:29.084 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x48' 00:12:29.084 19:00:49 -- target/invalid.sh@25 -- # string+=H 00:12:29.084 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.084 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.084 19:00:49 -- target/invalid.sh@25 -- # printf %x 45 00:12:29.084 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x2d' 00:12:29.084 19:00:49 -- target/invalid.sh@25 -- # string+=- 00:12:29.084 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.084 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.084 19:00:49 -- target/invalid.sh@25 -- # printf %x 90 00:12:29.084 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:12:29.084 19:00:49 -- target/invalid.sh@25 -- # string+=Z 00:12:29.084 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.085 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.085 19:00:49 -- target/invalid.sh@25 -- # printf %x 105 00:12:29.085 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x69' 00:12:29.085 19:00:49 -- target/invalid.sh@25 -- # string+=i 00:12:29.085 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.085 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.085 19:00:49 -- target/invalid.sh@25 -- # printf %x 51 00:12:29.085 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x33' 00:12:29.085 19:00:49 -- target/invalid.sh@25 -- # string+=3 00:12:29.085 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.085 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.085 19:00:49 -- target/invalid.sh@25 -- # printf %x 118 00:12:29.085 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x76' 00:12:29.085 19:00:49 -- target/invalid.sh@25 -- # string+=v 00:12:29.085 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.085 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.085 19:00:49 -- target/invalid.sh@25 -- # printf %x 56 00:12:29.085 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x38' 00:12:29.085 19:00:49 -- target/invalid.sh@25 -- # string+=8 00:12:29.085 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.085 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.085 19:00:49 -- target/invalid.sh@25 -- # printf %x 85 00:12:29.085 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x55' 00:12:29.085 19:00:49 -- target/invalid.sh@25 -- # string+=U 00:12:29.085 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.085 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.085 19:00:49 -- target/invalid.sh@25 -- # printf %x 73 00:12:29.085 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x49' 00:12:29.085 19:00:49 -- target/invalid.sh@25 -- # string+=I 00:12:29.085 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.085 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.085 19:00:49 -- target/invalid.sh@25 -- # printf %x 62 00:12:29.085 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x3e' 00:12:29.085 19:00:49 -- target/invalid.sh@25 -- # string+='>' 00:12:29.085 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.085 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.085 19:00:49 -- target/invalid.sh@25 -- # printf %x 118 00:12:29.085 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x76' 00:12:29.085 19:00:49 -- target/invalid.sh@25 -- # string+=v 00:12:29.085 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.085 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.085 19:00:49 -- target/invalid.sh@25 -- # printf %x 118 00:12:29.085 19:00:49 -- target/invalid.sh@25 -- # echo -e '\x76' 00:12:29.085 19:00:49 -- target/invalid.sh@25 -- # string+=v 00:12:29.085 19:00:49 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:29.085 19:00:49 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:29.085 19:00:49 -- target/invalid.sh@28 -- # [[ D == \- ]] 00:12:29.085 19:00:49 -- target/invalid.sh@31 -- # echo 'DsO]*9EEU{Z58dU8XB7RB7EM%vd"DH-Zi3v8UI>vv' 00:12:29.085 19:00:49 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d 'DsO]*9EEU{Z58dU8XB7RB7EM%vd"DH-Zi3v8UI>vv' nqn.2016-06.io.spdk:cnode9850 00:12:29.343 [2024-11-28 19:00:50.150114] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode9850: invalid model number 'DsO]*9EEU{Z58dU8XB7RB7EM%vd"DH-Zi3v8UI>vv' 00:12:29.343 19:00:50 -- target/invalid.sh@58 -- # out='request: 00:12:29.343 { 00:12:29.343 "nqn": "nqn.2016-06.io.spdk:cnode9850", 00:12:29.343 "model_number": "DsO]*9EEU{Z58dU8XB7RB7EM%vd\"DH-Zi3v8UI>vv", 00:12:29.343 "method": "nvmf_create_subsystem", 00:12:29.343 "req_id": 1 00:12:29.343 } 00:12:29.343 Got JSON-RPC error response 00:12:29.343 response: 00:12:29.343 { 00:12:29.343 "code": -32602, 00:12:29.343 "message": "Invalid MN DsO]*9EEU{Z58dU8XB7RB7EM%vd\"DH-Zi3v8UI>vv" 00:12:29.343 }' 00:12:29.343 19:00:50 -- target/invalid.sh@59 -- # [[ request: 00:12:29.343 { 00:12:29.343 "nqn": "nqn.2016-06.io.spdk:cnode9850", 00:12:29.343 "model_number": "DsO]*9EEU{Z58dU8XB7RB7EM%vd\"DH-Zi3v8UI>vv", 00:12:29.343 "method": "nvmf_create_subsystem", 00:12:29.343 "req_id": 1 00:12:29.343 } 00:12:29.343 Got JSON-RPC error response 00:12:29.343 response: 00:12:29.343 { 00:12:29.343 "code": -32602, 00:12:29.343 "message": "Invalid MN DsO]*9EEU{Z58dU8XB7RB7EM%vd\"DH-Zi3v8UI>vv" 00:12:29.343 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:12:29.343 19:00:50 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:12:29.601 [2024-11-28 19:00:50.423106] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:29.601 19:00:50 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:12:29.860 19:00:50 -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:12:29.860 19:00:50 -- target/invalid.sh@67 -- # echo '' 00:12:29.860 19:00:50 -- target/invalid.sh@67 -- # head -n 1 00:12:29.860 19:00:50 -- target/invalid.sh@67 -- # IP= 00:12:29.860 19:00:50 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:12:30.118 [2024-11-28 19:00:50.936905] nvmf_rpc.c: 783:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:12:30.118 19:00:50 -- target/invalid.sh@69 -- # out='request: 00:12:30.118 { 00:12:30.118 "nqn": "nqn.2016-06.io.spdk:cnode", 00:12:30.118 "listen_address": { 00:12:30.118 "trtype": "tcp", 00:12:30.118 "traddr": "", 00:12:30.118 "trsvcid": "4421" 00:12:30.118 }, 00:12:30.118 "method": "nvmf_subsystem_remove_listener", 00:12:30.118 "req_id": 1 00:12:30.118 } 00:12:30.118 Got JSON-RPC error response 00:12:30.118 response: 00:12:30.118 { 00:12:30.118 "code": -32602, 00:12:30.118 "message": "Invalid parameters" 00:12:30.118 }' 00:12:30.118 19:00:50 -- target/invalid.sh@70 -- # [[ request: 00:12:30.118 { 00:12:30.118 "nqn": "nqn.2016-06.io.spdk:cnode", 00:12:30.118 "listen_address": { 00:12:30.118 "trtype": "tcp", 00:12:30.118 "traddr": "", 00:12:30.118 "trsvcid": "4421" 00:12:30.118 }, 00:12:30.118 "method": "nvmf_subsystem_remove_listener", 00:12:30.118 "req_id": 1 00:12:30.118 } 00:12:30.118 Got JSON-RPC error response 00:12:30.118 response: 00:12:30.118 { 00:12:30.118 "code": -32602, 00:12:30.118 "message": "Invalid parameters" 00:12:30.118 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:12:30.118 19:00:50 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode20130 -i 0 00:12:30.376 [2024-11-28 19:00:51.197673] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode20130: invalid cntlid range [0-65519] 00:12:30.376 19:00:51 -- target/invalid.sh@73 -- # out='request: 00:12:30.376 { 00:12:30.376 "nqn": "nqn.2016-06.io.spdk:cnode20130", 00:12:30.376 "min_cntlid": 0, 00:12:30.376 "method": "nvmf_create_subsystem", 00:12:30.376 "req_id": 1 00:12:30.376 } 00:12:30.376 Got JSON-RPC error response 00:12:30.376 response: 00:12:30.376 { 00:12:30.376 "code": -32602, 00:12:30.376 "message": "Invalid cntlid range [0-65519]" 00:12:30.376 }' 00:12:30.376 19:00:51 -- target/invalid.sh@74 -- # [[ request: 00:12:30.376 { 00:12:30.376 "nqn": "nqn.2016-06.io.spdk:cnode20130", 00:12:30.376 "min_cntlid": 0, 00:12:30.376 "method": "nvmf_create_subsystem", 00:12:30.376 "req_id": 1 00:12:30.376 } 00:12:30.376 Got JSON-RPC error response 00:12:30.376 response: 00:12:30.376 { 00:12:30.376 "code": -32602, 00:12:30.376 "message": "Invalid cntlid range [0-65519]" 00:12:30.376 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:30.376 19:00:51 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode21745 -i 65520 00:12:30.633 [2024-11-28 19:00:51.446511] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode21745: invalid cntlid range [65520-65519] 00:12:30.633 19:00:51 -- target/invalid.sh@75 -- # out='request: 00:12:30.633 { 00:12:30.633 "nqn": "nqn.2016-06.io.spdk:cnode21745", 00:12:30.633 "min_cntlid": 65520, 00:12:30.633 "method": "nvmf_create_subsystem", 00:12:30.633 "req_id": 1 00:12:30.633 } 00:12:30.633 Got JSON-RPC error response 00:12:30.633 response: 00:12:30.633 { 00:12:30.633 "code": -32602, 00:12:30.633 "message": "Invalid cntlid range [65520-65519]" 00:12:30.633 }' 00:12:30.634 19:00:51 -- target/invalid.sh@76 -- # [[ request: 00:12:30.634 { 00:12:30.634 "nqn": "nqn.2016-06.io.spdk:cnode21745", 00:12:30.634 "min_cntlid": 65520, 00:12:30.634 "method": "nvmf_create_subsystem", 00:12:30.634 "req_id": 1 00:12:30.634 } 00:12:30.634 Got JSON-RPC error response 00:12:30.634 response: 00:12:30.634 { 00:12:30.634 "code": -32602, 00:12:30.634 "message": "Invalid cntlid range [65520-65519]" 00:12:30.634 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:30.634 19:00:51 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode17017 -I 0 00:12:30.892 [2024-11-28 19:00:51.715451] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode17017: invalid cntlid range [1-0] 00:12:30.892 19:00:51 -- target/invalid.sh@77 -- # out='request: 00:12:30.892 { 00:12:30.892 "nqn": "nqn.2016-06.io.spdk:cnode17017", 00:12:30.892 "max_cntlid": 0, 00:12:30.892 "method": "nvmf_create_subsystem", 00:12:30.892 "req_id": 1 00:12:30.892 } 00:12:30.892 Got JSON-RPC error response 00:12:30.892 response: 00:12:30.892 { 00:12:30.892 "code": -32602, 00:12:30.892 "message": "Invalid cntlid range [1-0]" 00:12:30.892 }' 00:12:30.892 19:00:51 -- target/invalid.sh@78 -- # [[ request: 00:12:30.892 { 00:12:30.892 "nqn": "nqn.2016-06.io.spdk:cnode17017", 00:12:30.892 "max_cntlid": 0, 00:12:30.892 "method": "nvmf_create_subsystem", 00:12:30.892 "req_id": 1 00:12:30.892 } 00:12:30.892 Got JSON-RPC error response 00:12:30.892 response: 00:12:30.892 { 00:12:30.892 "code": -32602, 00:12:30.892 "message": "Invalid cntlid range [1-0]" 00:12:30.892 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:30.892 19:00:51 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4603 -I 65520 00:12:31.150 [2024-11-28 19:00:51.968311] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode4603: invalid cntlid range [1-65520] 00:12:31.150 19:00:51 -- target/invalid.sh@79 -- # out='request: 00:12:31.150 { 00:12:31.150 "nqn": "nqn.2016-06.io.spdk:cnode4603", 00:12:31.150 "max_cntlid": 65520, 00:12:31.150 "method": "nvmf_create_subsystem", 00:12:31.150 "req_id": 1 00:12:31.150 } 00:12:31.150 Got JSON-RPC error response 00:12:31.150 response: 00:12:31.150 { 00:12:31.150 "code": -32602, 00:12:31.150 "message": "Invalid cntlid range [1-65520]" 00:12:31.150 }' 00:12:31.150 19:00:51 -- target/invalid.sh@80 -- # [[ request: 00:12:31.150 { 00:12:31.150 "nqn": "nqn.2016-06.io.spdk:cnode4603", 00:12:31.150 "max_cntlid": 65520, 00:12:31.150 "method": "nvmf_create_subsystem", 00:12:31.150 "req_id": 1 00:12:31.150 } 00:12:31.150 Got JSON-RPC error response 00:12:31.150 response: 00:12:31.150 { 00:12:31.150 "code": -32602, 00:12:31.150 "message": "Invalid cntlid range [1-65520]" 00:12:31.150 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:31.150 19:00:51 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode22135 -i 6 -I 5 00:12:31.410 [2024-11-28 19:00:52.217159] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode22135: invalid cntlid range [6-5] 00:12:31.410 19:00:52 -- target/invalid.sh@83 -- # out='request: 00:12:31.410 { 00:12:31.410 "nqn": "nqn.2016-06.io.spdk:cnode22135", 00:12:31.410 "min_cntlid": 6, 00:12:31.410 "max_cntlid": 5, 00:12:31.410 "method": "nvmf_create_subsystem", 00:12:31.410 "req_id": 1 00:12:31.410 } 00:12:31.410 Got JSON-RPC error response 00:12:31.410 response: 00:12:31.410 { 00:12:31.410 "code": -32602, 00:12:31.410 "message": "Invalid cntlid range [6-5]" 00:12:31.410 }' 00:12:31.410 19:00:52 -- target/invalid.sh@84 -- # [[ request: 00:12:31.410 { 00:12:31.410 "nqn": "nqn.2016-06.io.spdk:cnode22135", 00:12:31.410 "min_cntlid": 6, 00:12:31.410 "max_cntlid": 5, 00:12:31.410 "method": "nvmf_create_subsystem", 00:12:31.410 "req_id": 1 00:12:31.410 } 00:12:31.410 Got JSON-RPC error response 00:12:31.410 response: 00:12:31.410 { 00:12:31.410 "code": -32602, 00:12:31.410 "message": "Invalid cntlid range [6-5]" 00:12:31.410 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:31.410 19:00:52 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:12:31.410 19:00:52 -- target/invalid.sh@87 -- # out='request: 00:12:31.410 { 00:12:31.410 "name": "foobar", 00:12:31.410 "method": "nvmf_delete_target", 00:12:31.410 "req_id": 1 00:12:31.410 } 00:12:31.410 Got JSON-RPC error response 00:12:31.410 response: 00:12:31.410 { 00:12:31.410 "code": -32602, 00:12:31.410 "message": "The specified target doesn'\''t exist, cannot delete it." 00:12:31.410 }' 00:12:31.410 19:00:52 -- target/invalid.sh@88 -- # [[ request: 00:12:31.410 { 00:12:31.410 "name": "foobar", 00:12:31.410 "method": "nvmf_delete_target", 00:12:31.410 "req_id": 1 00:12:31.410 } 00:12:31.410 Got JSON-RPC error response 00:12:31.410 response: 00:12:31.410 { 00:12:31.410 "code": -32602, 00:12:31.410 "message": "The specified target doesn't exist, cannot delete it." 00:12:31.410 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:12:31.410 19:00:52 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:12:31.410 19:00:52 -- target/invalid.sh@91 -- # nvmftestfini 00:12:31.410 19:00:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:31.410 19:00:52 -- nvmf/common.sh@116 -- # sync 00:12:31.410 19:00:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:31.410 19:00:52 -- nvmf/common.sh@119 -- # set +e 00:12:31.410 19:00:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:31.410 19:00:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:31.410 rmmod nvme_tcp 00:12:31.410 rmmod nvme_fabrics 00:12:31.410 rmmod nvme_keyring 00:12:31.410 19:00:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:31.410 19:00:52 -- nvmf/common.sh@123 -- # set -e 00:12:31.410 19:00:52 -- nvmf/common.sh@124 -- # return 0 00:12:31.410 19:00:52 -- nvmf/common.sh@477 -- # '[' -n 156546 ']' 00:12:31.410 19:00:52 -- nvmf/common.sh@478 -- # killprocess 156546 00:12:31.410 19:00:52 -- common/autotest_common.sh@936 -- # '[' -z 156546 ']' 00:12:31.410 19:00:52 -- common/autotest_common.sh@940 -- # kill -0 156546 00:12:31.410 19:00:52 -- common/autotest_common.sh@941 -- # uname 00:12:31.410 19:00:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:31.410 19:00:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 156546 00:12:31.410 19:00:52 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:31.410 19:00:52 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:31.410 19:00:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 156546' 00:12:31.410 killing process with pid 156546 00:12:31.410 19:00:52 -- common/autotest_common.sh@955 -- # kill 156546 00:12:31.410 19:00:52 -- common/autotest_common.sh@960 -- # wait 156546 00:12:31.977 19:00:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:31.977 19:00:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:31.977 19:00:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:31.977 19:00:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:31.977 19:00:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:31.977 19:00:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:31.977 19:00:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:31.977 19:00:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:33.886 19:00:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:33.887 00:12:33.887 real 0m9.567s 00:12:33.887 user 0m23.821s 00:12:33.887 sys 0m2.469s 00:12:33.887 19:00:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:33.887 19:00:54 -- common/autotest_common.sh@10 -- # set +x 00:12:33.887 ************************************ 00:12:33.887 END TEST nvmf_invalid 00:12:33.887 ************************************ 00:12:33.887 19:00:54 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:33.887 19:00:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:33.887 19:00:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:33.887 19:00:54 -- common/autotest_common.sh@10 -- # set +x 00:12:33.887 ************************************ 00:12:33.887 START TEST nvmf_abort 00:12:33.887 ************************************ 00:12:33.887 19:00:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:33.887 * Looking for test storage... 00:12:33.887 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:33.887 19:00:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:33.887 19:00:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:33.887 19:00:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:33.887 19:00:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:33.887 19:00:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:33.887 19:00:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:33.887 19:00:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:33.887 19:00:54 -- scripts/common.sh@335 -- # IFS=.-: 00:12:34.147 19:00:54 -- scripts/common.sh@335 -- # read -ra ver1 00:12:34.147 19:00:54 -- scripts/common.sh@336 -- # IFS=.-: 00:12:34.147 19:00:54 -- scripts/common.sh@336 -- # read -ra ver2 00:12:34.147 19:00:54 -- scripts/common.sh@337 -- # local 'op=<' 00:12:34.147 19:00:54 -- scripts/common.sh@339 -- # ver1_l=2 00:12:34.147 19:00:54 -- scripts/common.sh@340 -- # ver2_l=1 00:12:34.147 19:00:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:34.147 19:00:54 -- scripts/common.sh@343 -- # case "$op" in 00:12:34.147 19:00:54 -- scripts/common.sh@344 -- # : 1 00:12:34.147 19:00:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:34.147 19:00:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:34.147 19:00:54 -- scripts/common.sh@364 -- # decimal 1 00:12:34.147 19:00:54 -- scripts/common.sh@352 -- # local d=1 00:12:34.147 19:00:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:34.147 19:00:54 -- scripts/common.sh@354 -- # echo 1 00:12:34.147 19:00:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:34.147 19:00:54 -- scripts/common.sh@365 -- # decimal 2 00:12:34.147 19:00:54 -- scripts/common.sh@352 -- # local d=2 00:12:34.147 19:00:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:34.147 19:00:54 -- scripts/common.sh@354 -- # echo 2 00:12:34.147 19:00:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:34.147 19:00:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:34.147 19:00:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:34.147 19:00:54 -- scripts/common.sh@367 -- # return 0 00:12:34.147 19:00:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:34.147 19:00:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:34.147 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:34.147 --rc genhtml_branch_coverage=1 00:12:34.147 --rc genhtml_function_coverage=1 00:12:34.147 --rc genhtml_legend=1 00:12:34.147 --rc geninfo_all_blocks=1 00:12:34.147 --rc geninfo_unexecuted_blocks=1 00:12:34.147 00:12:34.147 ' 00:12:34.147 19:00:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:34.147 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:34.147 --rc genhtml_branch_coverage=1 00:12:34.147 --rc genhtml_function_coverage=1 00:12:34.147 --rc genhtml_legend=1 00:12:34.147 --rc geninfo_all_blocks=1 00:12:34.147 --rc geninfo_unexecuted_blocks=1 00:12:34.147 00:12:34.147 ' 00:12:34.147 19:00:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:34.147 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:34.147 --rc genhtml_branch_coverage=1 00:12:34.147 --rc genhtml_function_coverage=1 00:12:34.147 --rc genhtml_legend=1 00:12:34.147 --rc geninfo_all_blocks=1 00:12:34.147 --rc geninfo_unexecuted_blocks=1 00:12:34.147 00:12:34.147 ' 00:12:34.147 19:00:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:34.147 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:34.147 --rc genhtml_branch_coverage=1 00:12:34.147 --rc genhtml_function_coverage=1 00:12:34.147 --rc genhtml_legend=1 00:12:34.147 --rc geninfo_all_blocks=1 00:12:34.147 --rc geninfo_unexecuted_blocks=1 00:12:34.147 00:12:34.147 ' 00:12:34.147 19:00:54 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:34.147 19:00:54 -- nvmf/common.sh@7 -- # uname -s 00:12:34.147 19:00:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:34.147 19:00:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:34.147 19:00:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:34.147 19:00:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:34.147 19:00:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:34.147 19:00:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:34.147 19:00:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:34.147 19:00:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:34.147 19:00:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:34.147 19:00:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:34.147 19:00:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:34.147 19:00:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:34.147 19:00:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:34.147 19:00:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:34.147 19:00:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:34.147 19:00:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:34.147 19:00:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:34.147 19:00:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:34.147 19:00:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:34.147 19:00:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:34.147 19:00:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:34.147 19:00:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:34.147 19:00:54 -- paths/export.sh@5 -- # export PATH 00:12:34.147 19:00:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:34.147 19:00:54 -- nvmf/common.sh@46 -- # : 0 00:12:34.147 19:00:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:34.147 19:00:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:34.147 19:00:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:34.147 19:00:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:34.148 19:00:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:34.148 19:00:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:34.148 19:00:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:34.148 19:00:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:34.148 19:00:54 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:12:34.148 19:00:54 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:12:34.148 19:00:54 -- target/abort.sh@14 -- # nvmftestinit 00:12:34.148 19:00:54 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:34.148 19:00:54 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:34.148 19:00:54 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:34.148 19:00:54 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:34.148 19:00:54 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:34.148 19:00:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:34.148 19:00:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:34.148 19:00:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:34.148 19:00:54 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:34.148 19:00:54 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:34.148 19:00:54 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:34.148 19:00:54 -- common/autotest_common.sh@10 -- # set +x 00:12:36.067 19:00:56 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:36.067 19:00:56 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:36.067 19:00:56 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:36.067 19:00:56 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:36.067 19:00:56 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:36.067 19:00:56 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:36.067 19:00:56 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:36.067 19:00:56 -- nvmf/common.sh@294 -- # net_devs=() 00:12:36.067 19:00:56 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:36.067 19:00:56 -- nvmf/common.sh@295 -- # e810=() 00:12:36.067 19:00:56 -- nvmf/common.sh@295 -- # local -ga e810 00:12:36.067 19:00:56 -- nvmf/common.sh@296 -- # x722=() 00:12:36.067 19:00:56 -- nvmf/common.sh@296 -- # local -ga x722 00:12:36.067 19:00:56 -- nvmf/common.sh@297 -- # mlx=() 00:12:36.067 19:00:56 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:36.067 19:00:56 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:36.067 19:00:56 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:36.067 19:00:56 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:36.067 19:00:56 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:36.067 19:00:56 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:36.067 19:00:56 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:36.067 19:00:56 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:36.067 19:00:56 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:36.067 19:00:56 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:36.067 19:00:56 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:36.067 19:00:56 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:36.067 19:00:56 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:36.067 19:00:56 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:36.067 19:00:56 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:36.067 19:00:56 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:36.067 19:00:56 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:36.067 19:00:56 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:36.067 19:00:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:36.067 19:00:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:36.067 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:36.067 19:00:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:36.067 19:00:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:36.067 19:00:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:36.067 19:00:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:36.067 19:00:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:36.067 19:00:56 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:36.067 19:00:56 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:36.067 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:36.067 19:00:56 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:36.067 19:00:56 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:36.067 19:00:56 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:36.067 19:00:56 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:36.067 19:00:56 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:36.067 19:00:56 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:36.067 19:00:56 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:36.067 19:00:56 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:36.067 19:00:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:36.067 19:00:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:36.067 19:00:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:36.067 19:00:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:36.067 19:00:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:36.067 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:36.067 19:00:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:36.067 19:00:56 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:36.067 19:00:56 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:36.067 19:00:56 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:36.067 19:00:56 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:36.067 19:00:56 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:36.067 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:36.067 19:00:56 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:36.067 19:00:56 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:36.067 19:00:56 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:36.067 19:00:56 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:36.067 19:00:56 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:36.067 19:00:56 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:36.067 19:00:56 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:36.067 19:00:56 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:36.067 19:00:56 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:36.067 19:00:56 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:36.067 19:00:56 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:36.067 19:00:56 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:36.067 19:00:56 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:36.067 19:00:56 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:36.067 19:00:56 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:36.067 19:00:56 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:36.067 19:00:56 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:36.067 19:00:56 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:36.067 19:00:56 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:36.067 19:00:57 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:36.067 19:00:57 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:36.067 19:00:57 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:36.067 19:00:57 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:36.327 19:00:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:36.327 19:00:57 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:36.327 19:00:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:36.327 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:36.327 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.278 ms 00:12:36.327 00:12:36.327 --- 10.0.0.2 ping statistics --- 00:12:36.327 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:36.327 rtt min/avg/max/mdev = 0.278/0.278/0.278/0.000 ms 00:12:36.327 19:00:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:36.327 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:36.327 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.159 ms 00:12:36.327 00:12:36.327 --- 10.0.0.1 ping statistics --- 00:12:36.327 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:36.327 rtt min/avg/max/mdev = 0.159/0.159/0.159/0.000 ms 00:12:36.327 19:00:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:36.327 19:00:57 -- nvmf/common.sh@410 -- # return 0 00:12:36.327 19:00:57 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:36.327 19:00:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:36.327 19:00:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:36.327 19:00:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:36.327 19:00:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:36.327 19:00:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:36.327 19:00:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:36.327 19:00:57 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:12:36.327 19:00:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:36.327 19:00:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:36.327 19:00:57 -- common/autotest_common.sh@10 -- # set +x 00:12:36.327 19:00:57 -- nvmf/common.sh@469 -- # nvmfpid=159299 00:12:36.327 19:00:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:36.327 19:00:57 -- nvmf/common.sh@470 -- # waitforlisten 159299 00:12:36.327 19:00:57 -- common/autotest_common.sh@829 -- # '[' -z 159299 ']' 00:12:36.327 19:00:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:36.327 19:00:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:36.327 19:00:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:36.327 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:36.327 19:00:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:36.327 19:00:57 -- common/autotest_common.sh@10 -- # set +x 00:12:36.327 [2024-11-28 19:00:57.270017] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:36.327 [2024-11-28 19:00:57.270090] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:36.327 EAL: No free 2048 kB hugepages reported on node 1 00:12:36.327 [2024-11-28 19:00:57.333418] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:36.588 [2024-11-28 19:00:57.442549] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:36.588 [2024-11-28 19:00:57.442705] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:36.588 [2024-11-28 19:00:57.442724] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:36.588 [2024-11-28 19:00:57.442738] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:36.588 [2024-11-28 19:00:57.442853] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:36.588 [2024-11-28 19:00:57.443010] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:36.588 [2024-11-28 19:00:57.443012] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:37.527 19:00:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:37.527 19:00:58 -- common/autotest_common.sh@862 -- # return 0 00:12:37.527 19:00:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:37.527 19:00:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:37.527 19:00:58 -- common/autotest_common.sh@10 -- # set +x 00:12:37.527 19:00:58 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:37.527 19:00:58 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:12:37.527 19:00:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:37.527 19:00:58 -- common/autotest_common.sh@10 -- # set +x 00:12:37.527 [2024-11-28 19:00:58.249078] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:37.527 19:00:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:37.527 19:00:58 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:12:37.527 19:00:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:37.527 19:00:58 -- common/autotest_common.sh@10 -- # set +x 00:12:37.527 Malloc0 00:12:37.527 19:00:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:37.527 19:00:58 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:37.527 19:00:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:37.527 19:00:58 -- common/autotest_common.sh@10 -- # set +x 00:12:37.527 Delay0 00:12:37.527 19:00:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:37.527 19:00:58 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:12:37.527 19:00:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:37.527 19:00:58 -- common/autotest_common.sh@10 -- # set +x 00:12:37.527 19:00:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:37.527 19:00:58 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:12:37.527 19:00:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:37.527 19:00:58 -- common/autotest_common.sh@10 -- # set +x 00:12:37.527 19:00:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:37.527 19:00:58 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:12:37.527 19:00:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:37.527 19:00:58 -- common/autotest_common.sh@10 -- # set +x 00:12:37.527 [2024-11-28 19:00:58.314125] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:37.527 19:00:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:37.527 19:00:58 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:37.527 19:00:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:37.527 19:00:58 -- common/autotest_common.sh@10 -- # set +x 00:12:37.527 19:00:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:37.527 19:00:58 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:12:37.527 EAL: No free 2048 kB hugepages reported on node 1 00:12:37.527 [2024-11-28 19:00:58.461579] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:12:40.058 Initializing NVMe Controllers 00:12:40.058 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:12:40.058 controller IO queue size 128 less than required 00:12:40.058 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:12:40.058 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:12:40.058 Initialization complete. Launching workers. 00:12:40.058 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 33830 00:12:40.058 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 33891, failed to submit 62 00:12:40.058 success 33830, unsuccess 61, failed 0 00:12:40.058 19:01:00 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:12:40.058 19:01:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:40.058 19:01:00 -- common/autotest_common.sh@10 -- # set +x 00:12:40.058 19:01:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:40.058 19:01:00 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:12:40.058 19:01:00 -- target/abort.sh@38 -- # nvmftestfini 00:12:40.058 19:01:00 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:40.058 19:01:00 -- nvmf/common.sh@116 -- # sync 00:12:40.058 19:01:00 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:40.058 19:01:00 -- nvmf/common.sh@119 -- # set +e 00:12:40.058 19:01:00 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:40.058 19:01:00 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:40.058 rmmod nvme_tcp 00:12:40.058 rmmod nvme_fabrics 00:12:40.058 rmmod nvme_keyring 00:12:40.058 19:01:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:40.058 19:01:00 -- nvmf/common.sh@123 -- # set -e 00:12:40.058 19:01:00 -- nvmf/common.sh@124 -- # return 0 00:12:40.058 19:01:00 -- nvmf/common.sh@477 -- # '[' -n 159299 ']' 00:12:40.058 19:01:00 -- nvmf/common.sh@478 -- # killprocess 159299 00:12:40.058 19:01:00 -- common/autotest_common.sh@936 -- # '[' -z 159299 ']' 00:12:40.058 19:01:00 -- common/autotest_common.sh@940 -- # kill -0 159299 00:12:40.058 19:01:00 -- common/autotest_common.sh@941 -- # uname 00:12:40.058 19:01:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:40.058 19:01:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 159299 00:12:40.058 19:01:00 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:12:40.058 19:01:00 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:12:40.058 19:01:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 159299' 00:12:40.058 killing process with pid 159299 00:12:40.058 19:01:00 -- common/autotest_common.sh@955 -- # kill 159299 00:12:40.058 19:01:00 -- common/autotest_common.sh@960 -- # wait 159299 00:12:40.058 19:01:01 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:40.058 19:01:01 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:40.058 19:01:01 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:40.058 19:01:01 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:40.058 19:01:01 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:40.058 19:01:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:40.058 19:01:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:40.058 19:01:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:42.593 19:01:03 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:42.593 00:12:42.593 real 0m8.305s 00:12:42.593 user 0m13.595s 00:12:42.593 sys 0m2.325s 00:12:42.593 19:01:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:42.593 19:01:03 -- common/autotest_common.sh@10 -- # set +x 00:12:42.593 ************************************ 00:12:42.593 END TEST nvmf_abort 00:12:42.593 ************************************ 00:12:42.593 19:01:03 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:42.593 19:01:03 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:42.593 19:01:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:42.593 19:01:03 -- common/autotest_common.sh@10 -- # set +x 00:12:42.593 ************************************ 00:12:42.593 START TEST nvmf_ns_hotplug_stress 00:12:42.593 ************************************ 00:12:42.593 19:01:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:12:42.593 * Looking for test storage... 00:12:42.593 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:42.593 19:01:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:42.593 19:01:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:42.593 19:01:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:42.593 19:01:03 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:42.593 19:01:03 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:42.593 19:01:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:42.593 19:01:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:42.593 19:01:03 -- scripts/common.sh@335 -- # IFS=.-: 00:12:42.593 19:01:03 -- scripts/common.sh@335 -- # read -ra ver1 00:12:42.593 19:01:03 -- scripts/common.sh@336 -- # IFS=.-: 00:12:42.593 19:01:03 -- scripts/common.sh@336 -- # read -ra ver2 00:12:42.593 19:01:03 -- scripts/common.sh@337 -- # local 'op=<' 00:12:42.593 19:01:03 -- scripts/common.sh@339 -- # ver1_l=2 00:12:42.593 19:01:03 -- scripts/common.sh@340 -- # ver2_l=1 00:12:42.593 19:01:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:42.593 19:01:03 -- scripts/common.sh@343 -- # case "$op" in 00:12:42.593 19:01:03 -- scripts/common.sh@344 -- # : 1 00:12:42.593 19:01:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:42.593 19:01:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:42.593 19:01:03 -- scripts/common.sh@364 -- # decimal 1 00:12:42.593 19:01:03 -- scripts/common.sh@352 -- # local d=1 00:12:42.593 19:01:03 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:42.593 19:01:03 -- scripts/common.sh@354 -- # echo 1 00:12:42.593 19:01:03 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:42.593 19:01:03 -- scripts/common.sh@365 -- # decimal 2 00:12:42.593 19:01:03 -- scripts/common.sh@352 -- # local d=2 00:12:42.593 19:01:03 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:42.593 19:01:03 -- scripts/common.sh@354 -- # echo 2 00:12:42.593 19:01:03 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:42.593 19:01:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:42.593 19:01:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:42.593 19:01:03 -- scripts/common.sh@367 -- # return 0 00:12:42.593 19:01:03 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:42.593 19:01:03 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:42.593 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:42.593 --rc genhtml_branch_coverage=1 00:12:42.593 --rc genhtml_function_coverage=1 00:12:42.593 --rc genhtml_legend=1 00:12:42.593 --rc geninfo_all_blocks=1 00:12:42.593 --rc geninfo_unexecuted_blocks=1 00:12:42.593 00:12:42.593 ' 00:12:42.593 19:01:03 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:42.593 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:42.593 --rc genhtml_branch_coverage=1 00:12:42.593 --rc genhtml_function_coverage=1 00:12:42.593 --rc genhtml_legend=1 00:12:42.593 --rc geninfo_all_blocks=1 00:12:42.593 --rc geninfo_unexecuted_blocks=1 00:12:42.593 00:12:42.593 ' 00:12:42.593 19:01:03 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:42.593 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:42.593 --rc genhtml_branch_coverage=1 00:12:42.593 --rc genhtml_function_coverage=1 00:12:42.593 --rc genhtml_legend=1 00:12:42.593 --rc geninfo_all_blocks=1 00:12:42.593 --rc geninfo_unexecuted_blocks=1 00:12:42.593 00:12:42.593 ' 00:12:42.593 19:01:03 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:42.593 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:42.593 --rc genhtml_branch_coverage=1 00:12:42.593 --rc genhtml_function_coverage=1 00:12:42.593 --rc genhtml_legend=1 00:12:42.593 --rc geninfo_all_blocks=1 00:12:42.593 --rc geninfo_unexecuted_blocks=1 00:12:42.593 00:12:42.593 ' 00:12:42.593 19:01:03 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:42.593 19:01:03 -- nvmf/common.sh@7 -- # uname -s 00:12:42.593 19:01:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:42.593 19:01:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:42.593 19:01:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:42.593 19:01:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:42.593 19:01:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:42.593 19:01:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:42.593 19:01:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:42.593 19:01:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:42.593 19:01:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:42.593 19:01:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:42.593 19:01:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:12:42.593 19:01:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:12:42.593 19:01:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:42.593 19:01:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:42.593 19:01:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:42.593 19:01:03 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:42.593 19:01:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:42.593 19:01:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:42.593 19:01:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:42.593 19:01:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:42.593 19:01:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:42.594 19:01:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:42.594 19:01:03 -- paths/export.sh@5 -- # export PATH 00:12:42.594 19:01:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:42.594 19:01:03 -- nvmf/common.sh@46 -- # : 0 00:12:42.594 19:01:03 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:42.594 19:01:03 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:42.594 19:01:03 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:42.594 19:01:03 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:42.594 19:01:03 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:42.594 19:01:03 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:42.594 19:01:03 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:42.594 19:01:03 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:42.594 19:01:03 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:42.594 19:01:03 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:12:42.594 19:01:03 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:42.594 19:01:03 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:42.594 19:01:03 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:42.594 19:01:03 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:42.594 19:01:03 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:42.594 19:01:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:42.594 19:01:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:42.594 19:01:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:42.594 19:01:03 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:42.594 19:01:03 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:42.594 19:01:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:42.594 19:01:03 -- common/autotest_common.sh@10 -- # set +x 00:12:44.502 19:01:05 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:44.502 19:01:05 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:44.502 19:01:05 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:44.502 19:01:05 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:44.502 19:01:05 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:44.502 19:01:05 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:44.502 19:01:05 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:44.502 19:01:05 -- nvmf/common.sh@294 -- # net_devs=() 00:12:44.502 19:01:05 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:44.502 19:01:05 -- nvmf/common.sh@295 -- # e810=() 00:12:44.502 19:01:05 -- nvmf/common.sh@295 -- # local -ga e810 00:12:44.502 19:01:05 -- nvmf/common.sh@296 -- # x722=() 00:12:44.502 19:01:05 -- nvmf/common.sh@296 -- # local -ga x722 00:12:44.502 19:01:05 -- nvmf/common.sh@297 -- # mlx=() 00:12:44.502 19:01:05 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:44.502 19:01:05 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:44.502 19:01:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:44.502 19:01:05 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:44.502 19:01:05 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:44.502 19:01:05 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:44.502 19:01:05 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:44.502 19:01:05 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:44.502 19:01:05 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:44.502 19:01:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:44.502 19:01:05 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:44.502 19:01:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:44.503 19:01:05 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:44.503 19:01:05 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:44.503 19:01:05 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:44.503 19:01:05 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:44.503 19:01:05 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:44.503 19:01:05 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:44.503 19:01:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:44.503 19:01:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:12:44.503 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:12:44.503 19:01:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:44.503 19:01:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:44.503 19:01:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:44.503 19:01:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:44.503 19:01:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:44.503 19:01:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:44.503 19:01:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:12:44.503 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:12:44.503 19:01:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:44.503 19:01:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:44.503 19:01:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:44.503 19:01:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:44.503 19:01:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:44.503 19:01:05 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:44.503 19:01:05 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:44.503 19:01:05 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:44.503 19:01:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:44.503 19:01:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:44.503 19:01:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:44.503 19:01:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:44.503 19:01:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:12:44.503 Found net devices under 0000:0a:00.0: cvl_0_0 00:12:44.503 19:01:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:44.503 19:01:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:44.503 19:01:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:44.503 19:01:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:44.503 19:01:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:44.503 19:01:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:12:44.503 Found net devices under 0000:0a:00.1: cvl_0_1 00:12:44.503 19:01:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:44.503 19:01:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:44.503 19:01:05 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:44.503 19:01:05 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:44.503 19:01:05 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:44.503 19:01:05 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:44.503 19:01:05 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:44.503 19:01:05 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:44.503 19:01:05 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:44.503 19:01:05 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:44.503 19:01:05 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:44.503 19:01:05 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:44.503 19:01:05 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:44.503 19:01:05 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:44.503 19:01:05 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:44.503 19:01:05 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:44.503 19:01:05 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:44.503 19:01:05 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:44.503 19:01:05 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:44.503 19:01:05 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:44.503 19:01:05 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:44.503 19:01:05 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:44.503 19:01:05 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:44.503 19:01:05 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:44.503 19:01:05 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:44.503 19:01:05 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:44.503 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:44.503 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.187 ms 00:12:44.503 00:12:44.503 --- 10.0.0.2 ping statistics --- 00:12:44.503 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:44.503 rtt min/avg/max/mdev = 0.187/0.187/0.187/0.000 ms 00:12:44.503 19:01:05 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:44.503 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:44.503 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.138 ms 00:12:44.503 00:12:44.503 --- 10.0.0.1 ping statistics --- 00:12:44.503 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:44.503 rtt min/avg/max/mdev = 0.138/0.138/0.138/0.000 ms 00:12:44.503 19:01:05 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:44.503 19:01:05 -- nvmf/common.sh@410 -- # return 0 00:12:44.503 19:01:05 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:44.503 19:01:05 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:44.503 19:01:05 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:44.503 19:01:05 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:44.503 19:01:05 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:44.503 19:01:05 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:44.503 19:01:05 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:44.503 19:01:05 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:12:44.503 19:01:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:44.503 19:01:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:44.503 19:01:05 -- common/autotest_common.sh@10 -- # set +x 00:12:44.503 19:01:05 -- nvmf/common.sh@469 -- # nvmfpid=161731 00:12:44.503 19:01:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:12:44.503 19:01:05 -- nvmf/common.sh@470 -- # waitforlisten 161731 00:12:44.503 19:01:05 -- common/autotest_common.sh@829 -- # '[' -z 161731 ']' 00:12:44.503 19:01:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:44.503 19:01:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:44.503 19:01:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:44.503 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:44.503 19:01:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:44.503 19:01:05 -- common/autotest_common.sh@10 -- # set +x 00:12:44.773 [2024-11-28 19:01:05.550902] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:44.773 [2024-11-28 19:01:05.550969] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:44.773 EAL: No free 2048 kB hugepages reported on node 1 00:12:44.773 [2024-11-28 19:01:05.620719] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:12:44.773 [2024-11-28 19:01:05.739414] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:44.773 [2024-11-28 19:01:05.739591] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:44.773 [2024-11-28 19:01:05.739609] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:44.773 [2024-11-28 19:01:05.739623] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:44.773 [2024-11-28 19:01:05.739690] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:44.773 [2024-11-28 19:01:05.739756] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:44.773 [2024-11-28 19:01:05.739751] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:45.706 19:01:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:45.706 19:01:06 -- common/autotest_common.sh@862 -- # return 0 00:12:45.706 19:01:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:45.706 19:01:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:45.706 19:01:06 -- common/autotest_common.sh@10 -- # set +x 00:12:45.706 19:01:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:45.706 19:01:06 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:12:45.706 19:01:06 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:12:45.963 [2024-11-28 19:01:06.910783] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:45.963 19:01:06 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:12:46.220 19:01:07 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:46.477 [2024-11-28 19:01:07.413578] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:46.478 19:01:07 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:12:46.735 19:01:07 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:12:46.992 Malloc0 00:12:46.992 19:01:07 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:12:47.249 Delay0 00:12:47.249 19:01:08 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:47.505 19:01:08 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:12:47.762 NULL1 00:12:47.762 19:01:08 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:12:48.019 19:01:08 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=162167 00:12:48.019 19:01:08 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:12:48.019 19:01:08 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162167 00:12:48.019 19:01:08 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:48.019 EAL: No free 2048 kB hugepages reported on node 1 00:12:49.396 Read completed with error (sct=0, sc=11) 00:12:49.396 19:01:10 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:49.396 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:49.396 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:49.396 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:49.396 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:49.396 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:49.396 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:49.396 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:49.654 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:49.654 19:01:10 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:12:49.655 19:01:10 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:12:49.913 true 00:12:49.913 19:01:10 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162167 00:12:49.913 19:01:10 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:50.479 19:01:11 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:50.738 19:01:11 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:12:50.738 19:01:11 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:12:50.998 true 00:12:50.998 19:01:12 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162167 00:12:50.998 19:01:12 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:51.566 19:01:12 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:51.566 19:01:12 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:12:51.566 19:01:12 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:12:51.825 true 00:12:51.825 19:01:12 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162167 00:12:51.825 19:01:12 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:52.095 19:01:13 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:52.354 19:01:13 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:12:52.354 19:01:13 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:12:52.612 true 00:12:52.612 19:01:13 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162167 00:12:52.612 19:01:13 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:53.993 19:01:14 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:53.993 19:01:14 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:12:53.993 19:01:14 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:12:54.251 true 00:12:54.251 19:01:15 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162167 00:12:54.251 19:01:15 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:54.509 19:01:15 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:54.767 19:01:15 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:12:54.767 19:01:15 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:12:55.026 true 00:12:55.026 19:01:15 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162167 00:12:55.026 19:01:15 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:55.285 19:01:16 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:55.544 19:01:16 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:12:55.544 19:01:16 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:12:55.802 true 00:12:55.802 19:01:16 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162167 00:12:55.802 19:01:16 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:56.743 19:01:17 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:56.743 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:12:57.002 19:01:18 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:12:57.002 19:01:18 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:12:57.262 true 00:12:57.262 19:01:18 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162167 00:12:57.262 19:01:18 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:57.521 19:01:18 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:57.779 19:01:18 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:12:57.779 19:01:18 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:12:58.038 true 00:12:58.038 19:01:19 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162167 00:12:58.038 19:01:19 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:58.296 19:01:19 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:12:58.555 19:01:19 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:12:58.555 19:01:19 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:12:58.813 true 00:12:58.813 19:01:19 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162167 00:12:58.813 19:01:19 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:59.785 19:01:20 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:00.044 19:01:21 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:13:00.044 19:01:21 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:13:00.302 true 00:13:00.302 19:01:21 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162167 00:13:00.302 19:01:21 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:00.561 19:01:21 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:00.820 19:01:21 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:13:00.820 19:01:21 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:13:01.079 true 00:13:01.079 19:01:22 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162167 00:13:01.079 19:01:22 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:02.022 19:01:22 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:02.022 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:02.022 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:02.022 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:02.022 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:02.281 19:01:23 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:13:02.281 19:01:23 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:13:02.540 true 00:13:02.540 19:01:23 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162167 00:13:02.540 19:01:23 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:02.799 19:01:23 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:03.058 19:01:23 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:13:03.058 19:01:23 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:13:03.317 true 00:13:03.317 19:01:24 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162167 00:13:03.317 19:01:24 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:04.257 19:01:25 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:04.257 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:04.515 19:01:25 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:13:04.515 19:01:25 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:13:04.774 true 00:13:04.774 19:01:25 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162167 00:13:04.774 19:01:25 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:05.033 19:01:25 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:05.292 19:01:26 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:13:05.292 19:01:26 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:13:05.552 true 00:13:05.552 19:01:26 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162167 00:13:05.552 19:01:26 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:06.492 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:06.492 19:01:27 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:06.492 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:06.751 19:01:27 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:13:06.751 19:01:27 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:13:07.010 true 00:13:07.010 19:01:27 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162167 00:13:07.010 19:01:27 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:07.269 19:01:28 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:07.527 19:01:28 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:13:07.527 19:01:28 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:13:07.786 true 00:13:07.786 19:01:28 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162167 00:13:07.786 19:01:28 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:08.723 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:08.723 19:01:29 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:08.723 19:01:29 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:13:08.723 19:01:29 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:13:08.982 true 00:13:08.982 19:01:29 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162167 00:13:08.982 19:01:29 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:09.241 19:01:30 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:09.500 19:01:30 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:13:09.500 19:01:30 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:13:09.759 true 00:13:09.759 19:01:30 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162167 00:13:09.759 19:01:30 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:10.700 19:01:31 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:10.960 19:01:31 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:13:10.960 19:01:31 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:13:11.218 true 00:13:11.218 19:01:32 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162167 00:13:11.218 19:01:32 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:11.477 19:01:32 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:11.736 19:01:32 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:13:11.736 19:01:32 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:13:11.994 true 00:13:11.994 19:01:32 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162167 00:13:11.994 19:01:32 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:12.254 19:01:33 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:12.512 19:01:33 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:13:12.512 19:01:33 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:13:12.771 true 00:13:12.771 19:01:33 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162167 00:13:12.771 19:01:33 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:14.154 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:14.154 19:01:34 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:14.154 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:14.154 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:14.154 19:01:35 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:13:14.154 19:01:35 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:13:14.413 true 00:13:14.413 19:01:35 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162167 00:13:14.413 19:01:35 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:14.671 19:01:35 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:14.930 19:01:35 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:13:14.930 19:01:35 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:13:15.189 true 00:13:15.189 19:01:36 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162167 00:13:15.189 19:01:36 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:15.447 19:01:36 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:15.705 19:01:36 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:13:15.705 19:01:36 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:13:15.962 true 00:13:15.962 19:01:36 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162167 00:13:15.962 19:01:36 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:16.897 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:16.897 19:01:37 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:17.494 19:01:38 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:13:17.494 19:01:38 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:13:17.494 true 00:13:17.494 19:01:38 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162167 00:13:17.494 19:01:38 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:17.753 19:01:38 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:18.012 19:01:39 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:13:18.012 19:01:39 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:13:18.271 true 00:13:18.271 19:01:39 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162167 00:13:18.271 19:01:39 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:19.211 Initializing NVMe Controllers 00:13:19.211 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:19.211 Controller IO queue size 128, less than required. 00:13:19.211 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:19.211 Controller IO queue size 128, less than required. 00:13:19.211 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:19.211 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:13:19.211 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:13:19.211 Initialization complete. Launching workers. 00:13:19.211 ======================================================== 00:13:19.211 Latency(us) 00:13:19.211 Device Information : IOPS MiB/s Average min max 00:13:19.211 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 787.96 0.38 78975.43 2641.68 1048615.85 00:13:19.211 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 10405.23 5.08 12301.55 1652.17 442481.92 00:13:19.211 ======================================================== 00:13:19.211 Total : 11193.19 5.47 16995.17 1652.17 1048615.85 00:13:19.211 00:13:19.211 19:01:40 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:19.470 19:01:40 -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:13:19.470 19:01:40 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:13:19.729 true 00:13:19.729 19:01:40 -- target/ns_hotplug_stress.sh@44 -- # kill -0 162167 00:13:19.729 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (162167) - No such process 00:13:19.729 19:01:40 -- target/ns_hotplug_stress.sh@53 -- # wait 162167 00:13:19.729 19:01:40 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:19.988 19:01:40 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:20.247 19:01:41 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:13:20.247 19:01:41 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:13:20.247 19:01:41 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:13:20.247 19:01:41 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:20.247 19:01:41 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:13:20.506 null0 00:13:20.506 19:01:41 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:20.506 19:01:41 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:20.506 19:01:41 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:13:20.764 null1 00:13:20.764 19:01:41 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:20.764 19:01:41 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:20.764 19:01:41 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:13:21.023 null2 00:13:21.023 19:01:41 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:21.023 19:01:41 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:21.023 19:01:41 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:13:21.282 null3 00:13:21.282 19:01:42 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:21.282 19:01:42 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:21.282 19:01:42 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:13:21.541 null4 00:13:21.541 19:01:42 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:21.541 19:01:42 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:21.541 19:01:42 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:13:21.799 null5 00:13:21.799 19:01:42 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:21.799 19:01:42 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:21.799 19:01:42 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:13:22.058 null6 00:13:22.058 19:01:42 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:22.058 19:01:42 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:22.058 19:01:42 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:13:22.317 null7 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@66 -- # wait 166460 166461 166463 166465 166467 166469 166471 166473 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.317 19:01:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:22.576 19:01:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:22.576 19:01:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:22.576 19:01:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:22.576 19:01:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:22.576 19:01:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:22.576 19:01:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:22.576 19:01:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:22.576 19:01:43 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:22.834 19:01:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.834 19:01:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.834 19:01:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:22.834 19:01:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.834 19:01:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.834 19:01:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:22.834 19:01:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.834 19:01:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.834 19:01:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:22.834 19:01:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.834 19:01:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.834 19:01:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:22.834 19:01:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.834 19:01:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.834 19:01:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:22.834 19:01:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.834 19:01:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.834 19:01:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:22.834 19:01:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.834 19:01:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.834 19:01:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:22.834 19:01:43 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:22.834 19:01:43 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:22.834 19:01:43 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:23.093 19:01:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:23.093 19:01:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:23.093 19:01:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:23.093 19:01:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:23.093 19:01:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:23.093 19:01:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:23.093 19:01:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:23.093 19:01:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:23.352 19:01:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.352 19:01:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.352 19:01:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:23.352 19:01:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.352 19:01:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.352 19:01:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:23.352 19:01:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.352 19:01:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.352 19:01:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:23.352 19:01:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.352 19:01:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.352 19:01:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:23.352 19:01:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.352 19:01:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.352 19:01:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:23.352 19:01:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.352 19:01:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.352 19:01:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:23.352 19:01:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.352 19:01:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.352 19:01:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:23.611 19:01:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.611 19:01:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.611 19:01:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:23.611 19:01:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:23.611 19:01:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:23.611 19:01:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:23.611 19:01:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:23.611 19:01:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:23.611 19:01:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:23.611 19:01:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:23.870 19:01:44 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:23.870 19:01:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.870 19:01:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.870 19:01:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:23.870 19:01:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.870 19:01:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.870 19:01:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:23.870 19:01:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.870 19:01:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.870 19:01:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:23.870 19:01:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.870 19:01:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.870 19:01:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:23.870 19:01:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.870 19:01:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.870 19:01:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:23.870 19:01:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.870 19:01:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.870 19:01:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:23.870 19:01:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:23.870 19:01:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:23.870 19:01:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:24.129 19:01:44 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.129 19:01:44 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.129 19:01:44 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:24.129 19:01:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:24.129 19:01:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:24.129 19:01:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:24.387 19:01:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:24.387 19:01:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:24.387 19:01:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:24.387 19:01:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:24.387 19:01:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:24.645 19:01:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.645 19:01:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.645 19:01:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:24.645 19:01:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.645 19:01:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.645 19:01:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:24.645 19:01:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.645 19:01:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.645 19:01:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:24.645 19:01:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.645 19:01:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.645 19:01:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:24.645 19:01:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.645 19:01:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.645 19:01:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:24.645 19:01:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.645 19:01:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.645 19:01:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:24.645 19:01:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.645 19:01:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.645 19:01:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:24.645 19:01:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:24.645 19:01:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:24.645 19:01:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:24.905 19:01:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:24.905 19:01:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:24.905 19:01:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:24.905 19:01:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:24.905 19:01:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:24.905 19:01:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:24.905 19:01:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:24.905 19:01:45 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:25.164 19:01:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.164 19:01:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.164 19:01:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:25.164 19:01:45 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.164 19:01:45 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.164 19:01:45 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:25.164 19:01:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.164 19:01:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.164 19:01:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:25.164 19:01:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.164 19:01:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.164 19:01:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:25.164 19:01:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.164 19:01:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.164 19:01:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:25.164 19:01:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.164 19:01:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.164 19:01:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:25.165 19:01:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.165 19:01:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.165 19:01:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:25.165 19:01:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.165 19:01:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.165 19:01:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:25.423 19:01:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:25.423 19:01:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:25.423 19:01:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:25.423 19:01:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:25.423 19:01:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:25.423 19:01:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:25.423 19:01:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:25.423 19:01:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:25.682 19:01:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.682 19:01:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.682 19:01:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:25.683 19:01:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.683 19:01:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.683 19:01:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:25.683 19:01:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.683 19:01:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.683 19:01:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:25.683 19:01:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.683 19:01:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.683 19:01:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:25.683 19:01:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.683 19:01:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.683 19:01:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:25.683 19:01:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.683 19:01:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.683 19:01:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:25.683 19:01:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.683 19:01:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.683 19:01:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:25.683 19:01:46 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:25.683 19:01:46 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:25.683 19:01:46 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:25.941 19:01:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:25.941 19:01:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:25.941 19:01:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:25.941 19:01:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:25.941 19:01:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:25.941 19:01:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:25.942 19:01:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:25.942 19:01:46 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:26.201 19:01:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.201 19:01:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.201 19:01:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:26.201 19:01:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.201 19:01:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.201 19:01:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:26.201 19:01:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.201 19:01:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.201 19:01:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.201 19:01:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.201 19:01:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:26.201 19:01:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:26.201 19:01:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.201 19:01:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.201 19:01:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:26.201 19:01:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.201 19:01:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.201 19:01:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:26.201 19:01:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.201 19:01:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.201 19:01:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:26.201 19:01:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.201 19:01:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.201 19:01:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:26.461 19:01:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:26.461 19:01:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:26.461 19:01:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:26.461 19:01:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:26.461 19:01:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:26.461 19:01:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:26.461 19:01:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:26.461 19:01:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:26.720 19:01:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.720 19:01:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.720 19:01:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:26.720 19:01:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.720 19:01:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.720 19:01:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:26.720 19:01:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.720 19:01:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.720 19:01:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:26.720 19:01:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.720 19:01:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.720 19:01:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:26.720 19:01:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.720 19:01:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.720 19:01:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:26.720 19:01:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.720 19:01:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.720 19:01:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:26.720 19:01:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.720 19:01:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.720 19:01:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:26.720 19:01:47 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:26.720 19:01:47 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:26.720 19:01:47 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:26.980 19:01:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:26.980 19:01:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:26.980 19:01:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:26.980 19:01:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:26.980 19:01:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:26.980 19:01:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:26.980 19:01:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:26.980 19:01:47 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:27.240 19:01:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.240 19:01:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.240 19:01:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:27.240 19:01:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.240 19:01:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.240 19:01:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:27.240 19:01:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.240 19:01:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.240 19:01:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:27.240 19:01:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.240 19:01:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.240 19:01:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:27.240 19:01:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.240 19:01:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.240 19:01:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:27.240 19:01:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.240 19:01:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.240 19:01:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:27.240 19:01:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.240 19:01:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.240 19:01:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:27.240 19:01:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.240 19:01:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.240 19:01:48 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:27.500 19:01:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:27.500 19:01:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:27.500 19:01:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:27.500 19:01:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:27.500 19:01:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:27.500 19:01:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:27.500 19:01:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:27.500 19:01:48 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:27.760 19:01:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.760 19:01:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.760 19:01:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.760 19:01:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.760 19:01:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.760 19:01:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.760 19:01:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.760 19:01:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.760 19:01:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.760 19:01:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.760 19:01:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.760 19:01:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:27.760 19:01:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:27.760 19:01:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:28.022 19:01:48 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:28.022 19:01:48 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:28.022 19:01:48 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:13:28.022 19:01:48 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:13:28.022 19:01:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:28.022 19:01:48 -- nvmf/common.sh@116 -- # sync 00:13:28.022 19:01:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:28.022 19:01:48 -- nvmf/common.sh@119 -- # set +e 00:13:28.022 19:01:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:28.022 19:01:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:28.022 rmmod nvme_tcp 00:13:28.022 rmmod nvme_fabrics 00:13:28.022 rmmod nvme_keyring 00:13:28.022 19:01:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:28.022 19:01:48 -- nvmf/common.sh@123 -- # set -e 00:13:28.022 19:01:48 -- nvmf/common.sh@124 -- # return 0 00:13:28.022 19:01:48 -- nvmf/common.sh@477 -- # '[' -n 161731 ']' 00:13:28.022 19:01:48 -- nvmf/common.sh@478 -- # killprocess 161731 00:13:28.022 19:01:48 -- common/autotest_common.sh@936 -- # '[' -z 161731 ']' 00:13:28.022 19:01:48 -- common/autotest_common.sh@940 -- # kill -0 161731 00:13:28.022 19:01:48 -- common/autotest_common.sh@941 -- # uname 00:13:28.022 19:01:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:28.022 19:01:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 161731 00:13:28.022 19:01:48 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:28.022 19:01:48 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:28.022 19:01:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 161731' 00:13:28.022 killing process with pid 161731 00:13:28.022 19:01:48 -- common/autotest_common.sh@955 -- # kill 161731 00:13:28.022 19:01:48 -- common/autotest_common.sh@960 -- # wait 161731 00:13:28.281 19:01:49 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:28.281 19:01:49 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:28.281 19:01:49 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:28.281 19:01:49 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:28.281 19:01:49 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:28.281 19:01:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:28.281 19:01:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:28.281 19:01:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:30.200 19:01:51 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:30.459 00:13:30.459 real 0m48.126s 00:13:30.459 user 3m39.994s 00:13:30.460 sys 0m15.295s 00:13:30.460 19:01:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:30.460 19:01:51 -- common/autotest_common.sh@10 -- # set +x 00:13:30.460 ************************************ 00:13:30.460 END TEST nvmf_ns_hotplug_stress 00:13:30.460 ************************************ 00:13:30.460 19:01:51 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:30.460 19:01:51 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:30.460 19:01:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:30.460 19:01:51 -- common/autotest_common.sh@10 -- # set +x 00:13:30.460 ************************************ 00:13:30.460 START TEST nvmf_connect_stress 00:13:30.460 ************************************ 00:13:30.460 19:01:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:30.460 * Looking for test storage... 00:13:30.460 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:30.460 19:01:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:30.460 19:01:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:30.460 19:01:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:30.460 19:01:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:30.460 19:01:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:30.460 19:01:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:30.460 19:01:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:30.460 19:01:51 -- scripts/common.sh@335 -- # IFS=.-: 00:13:30.460 19:01:51 -- scripts/common.sh@335 -- # read -ra ver1 00:13:30.460 19:01:51 -- scripts/common.sh@336 -- # IFS=.-: 00:13:30.460 19:01:51 -- scripts/common.sh@336 -- # read -ra ver2 00:13:30.460 19:01:51 -- scripts/common.sh@337 -- # local 'op=<' 00:13:30.460 19:01:51 -- scripts/common.sh@339 -- # ver1_l=2 00:13:30.460 19:01:51 -- scripts/common.sh@340 -- # ver2_l=1 00:13:30.460 19:01:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:30.460 19:01:51 -- scripts/common.sh@343 -- # case "$op" in 00:13:30.460 19:01:51 -- scripts/common.sh@344 -- # : 1 00:13:30.460 19:01:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:30.460 19:01:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:30.460 19:01:51 -- scripts/common.sh@364 -- # decimal 1 00:13:30.460 19:01:51 -- scripts/common.sh@352 -- # local d=1 00:13:30.460 19:01:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:30.460 19:01:51 -- scripts/common.sh@354 -- # echo 1 00:13:30.460 19:01:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:30.460 19:01:51 -- scripts/common.sh@365 -- # decimal 2 00:13:30.460 19:01:51 -- scripts/common.sh@352 -- # local d=2 00:13:30.460 19:01:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:30.460 19:01:51 -- scripts/common.sh@354 -- # echo 2 00:13:30.460 19:01:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:30.460 19:01:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:30.460 19:01:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:30.460 19:01:51 -- scripts/common.sh@367 -- # return 0 00:13:30.460 19:01:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:30.460 19:01:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:30.460 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:30.460 --rc genhtml_branch_coverage=1 00:13:30.460 --rc genhtml_function_coverage=1 00:13:30.460 --rc genhtml_legend=1 00:13:30.460 --rc geninfo_all_blocks=1 00:13:30.460 --rc geninfo_unexecuted_blocks=1 00:13:30.460 00:13:30.460 ' 00:13:30.460 19:01:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:30.460 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:30.460 --rc genhtml_branch_coverage=1 00:13:30.460 --rc genhtml_function_coverage=1 00:13:30.460 --rc genhtml_legend=1 00:13:30.460 --rc geninfo_all_blocks=1 00:13:30.460 --rc geninfo_unexecuted_blocks=1 00:13:30.460 00:13:30.460 ' 00:13:30.460 19:01:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:30.460 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:30.460 --rc genhtml_branch_coverage=1 00:13:30.460 --rc genhtml_function_coverage=1 00:13:30.460 --rc genhtml_legend=1 00:13:30.460 --rc geninfo_all_blocks=1 00:13:30.460 --rc geninfo_unexecuted_blocks=1 00:13:30.460 00:13:30.460 ' 00:13:30.460 19:01:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:30.460 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:30.460 --rc genhtml_branch_coverage=1 00:13:30.460 --rc genhtml_function_coverage=1 00:13:30.460 --rc genhtml_legend=1 00:13:30.460 --rc geninfo_all_blocks=1 00:13:30.460 --rc geninfo_unexecuted_blocks=1 00:13:30.460 00:13:30.460 ' 00:13:30.460 19:01:51 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:30.460 19:01:51 -- nvmf/common.sh@7 -- # uname -s 00:13:30.460 19:01:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:30.460 19:01:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:30.460 19:01:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:30.460 19:01:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:30.460 19:01:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:30.460 19:01:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:30.460 19:01:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:30.460 19:01:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:30.460 19:01:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:30.460 19:01:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:30.460 19:01:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:30.460 19:01:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:30.460 19:01:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:30.460 19:01:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:30.460 19:01:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:30.460 19:01:51 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:30.460 19:01:51 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:30.460 19:01:51 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:30.460 19:01:51 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:30.460 19:01:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:30.460 19:01:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:30.460 19:01:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:30.460 19:01:51 -- paths/export.sh@5 -- # export PATH 00:13:30.460 19:01:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:30.460 19:01:51 -- nvmf/common.sh@46 -- # : 0 00:13:30.460 19:01:51 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:30.460 19:01:51 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:30.460 19:01:51 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:30.460 19:01:51 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:30.460 19:01:51 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:30.460 19:01:51 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:30.460 19:01:51 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:30.460 19:01:51 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:30.460 19:01:51 -- target/connect_stress.sh@12 -- # nvmftestinit 00:13:30.460 19:01:51 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:30.460 19:01:51 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:30.460 19:01:51 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:30.460 19:01:51 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:30.460 19:01:51 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:30.460 19:01:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:30.460 19:01:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:30.460 19:01:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:30.460 19:01:51 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:30.460 19:01:51 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:30.460 19:01:51 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:30.460 19:01:51 -- common/autotest_common.sh@10 -- # set +x 00:13:32.374 19:01:53 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:32.374 19:01:53 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:32.374 19:01:53 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:32.374 19:01:53 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:32.374 19:01:53 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:32.374 19:01:53 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:32.374 19:01:53 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:32.374 19:01:53 -- nvmf/common.sh@294 -- # net_devs=() 00:13:32.374 19:01:53 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:32.374 19:01:53 -- nvmf/common.sh@295 -- # e810=() 00:13:32.374 19:01:53 -- nvmf/common.sh@295 -- # local -ga e810 00:13:32.374 19:01:53 -- nvmf/common.sh@296 -- # x722=() 00:13:32.374 19:01:53 -- nvmf/common.sh@296 -- # local -ga x722 00:13:32.374 19:01:53 -- nvmf/common.sh@297 -- # mlx=() 00:13:32.374 19:01:53 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:32.374 19:01:53 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:32.374 19:01:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:32.374 19:01:53 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:32.374 19:01:53 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:32.374 19:01:53 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:32.374 19:01:53 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:32.374 19:01:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:32.374 19:01:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:32.374 19:01:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:32.374 19:01:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:32.374 19:01:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:32.374 19:01:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:32.374 19:01:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:32.374 19:01:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:32.374 19:01:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:32.374 19:01:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:32.374 19:01:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:32.374 19:01:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:32.374 19:01:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:32.374 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:32.374 19:01:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:32.374 19:01:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:32.374 19:01:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:32.374 19:01:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:32.374 19:01:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:32.374 19:01:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:32.374 19:01:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:32.374 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:32.374 19:01:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:32.374 19:01:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:32.374 19:01:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:32.374 19:01:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:32.374 19:01:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:32.374 19:01:53 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:32.374 19:01:53 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:32.374 19:01:53 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:32.374 19:01:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:32.374 19:01:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:32.374 19:01:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:32.374 19:01:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:32.374 19:01:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:32.374 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:32.374 19:01:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:32.374 19:01:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:32.374 19:01:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:32.374 19:01:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:32.374 19:01:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:32.374 19:01:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:32.374 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:32.374 19:01:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:32.374 19:01:53 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:32.374 19:01:53 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:32.374 19:01:53 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:32.374 19:01:53 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:32.374 19:01:53 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:32.374 19:01:53 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:32.374 19:01:53 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:32.374 19:01:53 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:32.374 19:01:53 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:32.374 19:01:53 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:32.374 19:01:53 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:32.374 19:01:53 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:32.374 19:01:53 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:32.374 19:01:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:32.374 19:01:53 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:32.375 19:01:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:32.375 19:01:53 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:32.375 19:01:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:32.634 19:01:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:32.634 19:01:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:32.634 19:01:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:32.634 19:01:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:32.634 19:01:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:32.634 19:01:53 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:32.634 19:01:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:32.634 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:32.634 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.252 ms 00:13:32.634 00:13:32.634 --- 10.0.0.2 ping statistics --- 00:13:32.634 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:32.634 rtt min/avg/max/mdev = 0.252/0.252/0.252/0.000 ms 00:13:32.634 19:01:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:32.634 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:32.634 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.108 ms 00:13:32.634 00:13:32.634 --- 10.0.0.1 ping statistics --- 00:13:32.634 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:32.634 rtt min/avg/max/mdev = 0.108/0.108/0.108/0.000 ms 00:13:32.634 19:01:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:32.634 19:01:53 -- nvmf/common.sh@410 -- # return 0 00:13:32.634 19:01:53 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:32.634 19:01:53 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:32.634 19:01:53 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:32.634 19:01:53 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:32.634 19:01:53 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:32.634 19:01:53 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:32.634 19:01:53 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:32.634 19:01:53 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:13:32.634 19:01:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:32.634 19:01:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:32.634 19:01:53 -- common/autotest_common.sh@10 -- # set +x 00:13:32.634 19:01:53 -- nvmf/common.sh@469 -- # nvmfpid=169252 00:13:32.634 19:01:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:32.634 19:01:53 -- nvmf/common.sh@470 -- # waitforlisten 169252 00:13:32.634 19:01:53 -- common/autotest_common.sh@829 -- # '[' -z 169252 ']' 00:13:32.634 19:01:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:32.634 19:01:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:32.634 19:01:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:32.634 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:32.634 19:01:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:32.634 19:01:53 -- common/autotest_common.sh@10 -- # set +x 00:13:32.634 [2024-11-28 19:01:53.569944] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:32.634 [2024-11-28 19:01:53.570023] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:32.634 EAL: No free 2048 kB hugepages reported on node 1 00:13:32.634 [2024-11-28 19:01:53.638836] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:32.893 [2024-11-28 19:01:53.755254] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:32.893 [2024-11-28 19:01:53.755421] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:32.893 [2024-11-28 19:01:53.755440] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:32.893 [2024-11-28 19:01:53.755468] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:32.893 [2024-11-28 19:01:53.755526] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:32.893 [2024-11-28 19:01:53.755580] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:32.893 [2024-11-28 19:01:53.755584] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:33.853 19:01:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:33.853 19:01:54 -- common/autotest_common.sh@862 -- # return 0 00:13:33.853 19:01:54 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:33.853 19:01:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:33.853 19:01:54 -- common/autotest_common.sh@10 -- # set +x 00:13:33.853 19:01:54 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:33.853 19:01:54 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:33.853 19:01:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.853 19:01:54 -- common/autotest_common.sh@10 -- # set +x 00:13:33.853 [2024-11-28 19:01:54.577429] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:33.853 19:01:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.853 19:01:54 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:33.853 19:01:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.853 19:01:54 -- common/autotest_common.sh@10 -- # set +x 00:13:33.853 19:01:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.853 19:01:54 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:33.853 19:01:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.853 19:01:54 -- common/autotest_common.sh@10 -- # set +x 00:13:33.853 [2024-11-28 19:01:54.604537] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:33.853 19:01:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.853 19:01:54 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:33.853 19:01:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.853 19:01:54 -- common/autotest_common.sh@10 -- # set +x 00:13:33.853 NULL1 00:13:33.853 19:01:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:33.853 19:01:54 -- target/connect_stress.sh@21 -- # PERF_PID=169412 00:13:33.853 19:01:54 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:33.853 19:01:54 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:33.853 19:01:54 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:13:33.853 19:01:54 -- target/connect_stress.sh@27 -- # seq 1 20 00:13:33.853 19:01:54 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.853 19:01:54 -- target/connect_stress.sh@28 -- # cat 00:13:33.853 19:01:54 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.853 19:01:54 -- target/connect_stress.sh@28 -- # cat 00:13:33.853 19:01:54 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.853 19:01:54 -- target/connect_stress.sh@28 -- # cat 00:13:33.853 19:01:54 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.853 19:01:54 -- target/connect_stress.sh@28 -- # cat 00:13:33.853 19:01:54 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.853 19:01:54 -- target/connect_stress.sh@28 -- # cat 00:13:33.853 19:01:54 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.853 19:01:54 -- target/connect_stress.sh@28 -- # cat 00:13:33.853 19:01:54 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.853 19:01:54 -- target/connect_stress.sh@28 -- # cat 00:13:33.853 19:01:54 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.853 19:01:54 -- target/connect_stress.sh@28 -- # cat 00:13:33.853 19:01:54 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.853 19:01:54 -- target/connect_stress.sh@28 -- # cat 00:13:33.853 19:01:54 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.853 19:01:54 -- target/connect_stress.sh@28 -- # cat 00:13:33.854 19:01:54 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.854 19:01:54 -- target/connect_stress.sh@28 -- # cat 00:13:33.854 19:01:54 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.854 19:01:54 -- target/connect_stress.sh@28 -- # cat 00:13:33.854 EAL: No free 2048 kB hugepages reported on node 1 00:13:33.854 19:01:54 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.854 19:01:54 -- target/connect_stress.sh@28 -- # cat 00:13:33.854 19:01:54 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.854 19:01:54 -- target/connect_stress.sh@28 -- # cat 00:13:33.854 19:01:54 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.854 19:01:54 -- target/connect_stress.sh@28 -- # cat 00:13:33.854 19:01:54 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.854 19:01:54 -- target/connect_stress.sh@28 -- # cat 00:13:33.854 19:01:54 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.854 19:01:54 -- target/connect_stress.sh@28 -- # cat 00:13:33.854 19:01:54 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.854 19:01:54 -- target/connect_stress.sh@28 -- # cat 00:13:33.854 19:01:54 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.854 19:01:54 -- target/connect_stress.sh@28 -- # cat 00:13:33.854 19:01:54 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:13:33.854 19:01:54 -- target/connect_stress.sh@28 -- # cat 00:13:33.854 19:01:54 -- target/connect_stress.sh@34 -- # kill -0 169412 00:13:33.854 19:01:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:33.854 19:01:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:33.854 19:01:54 -- common/autotest_common.sh@10 -- # set +x 00:13:34.115 19:01:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.115 19:01:54 -- target/connect_stress.sh@34 -- # kill -0 169412 00:13:34.115 19:01:54 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:34.115 19:01:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.115 19:01:54 -- common/autotest_common.sh@10 -- # set +x 00:13:34.374 19:01:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.374 19:01:55 -- target/connect_stress.sh@34 -- # kill -0 169412 00:13:34.374 19:01:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:34.374 19:01:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.374 19:01:55 -- common/autotest_common.sh@10 -- # set +x 00:13:34.635 19:01:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:34.635 19:01:55 -- target/connect_stress.sh@34 -- # kill -0 169412 00:13:34.635 19:01:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:34.635 19:01:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:34.635 19:01:55 -- common/autotest_common.sh@10 -- # set +x 00:13:35.210 19:01:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.210 19:01:55 -- target/connect_stress.sh@34 -- # kill -0 169412 00:13:35.210 19:01:55 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:35.210 19:01:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.210 19:01:55 -- common/autotest_common.sh@10 -- # set +x 00:13:35.473 19:01:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.473 19:01:56 -- target/connect_stress.sh@34 -- # kill -0 169412 00:13:35.473 19:01:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:35.473 19:01:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.473 19:01:56 -- common/autotest_common.sh@10 -- # set +x 00:13:35.733 19:01:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.733 19:01:56 -- target/connect_stress.sh@34 -- # kill -0 169412 00:13:35.733 19:01:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:35.733 19:01:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.733 19:01:56 -- common/autotest_common.sh@10 -- # set +x 00:13:35.994 19:01:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:35.994 19:01:56 -- target/connect_stress.sh@34 -- # kill -0 169412 00:13:35.994 19:01:56 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:35.994 19:01:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:35.994 19:01:56 -- common/autotest_common.sh@10 -- # set +x 00:13:36.255 19:01:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.255 19:01:57 -- target/connect_stress.sh@34 -- # kill -0 169412 00:13:36.255 19:01:57 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:36.255 19:01:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.255 19:01:57 -- common/autotest_common.sh@10 -- # set +x 00:13:36.516 19:01:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:36.516 19:01:57 -- target/connect_stress.sh@34 -- # kill -0 169412 00:13:36.516 19:01:57 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:36.516 19:01:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:36.516 19:01:57 -- common/autotest_common.sh@10 -- # set +x 00:13:37.083 19:01:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.083 19:01:57 -- target/connect_stress.sh@34 -- # kill -0 169412 00:13:37.083 19:01:57 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:37.083 19:01:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.083 19:01:57 -- common/autotest_common.sh@10 -- # set +x 00:13:37.341 19:01:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.341 19:01:58 -- target/connect_stress.sh@34 -- # kill -0 169412 00:13:37.341 19:01:58 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:37.341 19:01:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.341 19:01:58 -- common/autotest_common.sh@10 -- # set +x 00:13:37.602 19:01:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.602 19:01:58 -- target/connect_stress.sh@34 -- # kill -0 169412 00:13:37.602 19:01:58 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:37.602 19:01:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.602 19:01:58 -- common/autotest_common.sh@10 -- # set +x 00:13:37.862 19:01:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:37.862 19:01:58 -- target/connect_stress.sh@34 -- # kill -0 169412 00:13:37.862 19:01:58 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:37.862 19:01:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:37.862 19:01:58 -- common/autotest_common.sh@10 -- # set +x 00:13:38.123 19:01:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:38.123 19:01:59 -- target/connect_stress.sh@34 -- # kill -0 169412 00:13:38.123 19:01:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:38.123 19:01:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:38.123 19:01:59 -- common/autotest_common.sh@10 -- # set +x 00:13:38.692 19:01:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:38.692 19:01:59 -- target/connect_stress.sh@34 -- # kill -0 169412 00:13:38.692 19:01:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:38.692 19:01:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:38.692 19:01:59 -- common/autotest_common.sh@10 -- # set +x 00:13:38.952 19:01:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:38.952 19:01:59 -- target/connect_stress.sh@34 -- # kill -0 169412 00:13:38.952 19:01:59 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:38.952 19:01:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:38.952 19:01:59 -- common/autotest_common.sh@10 -- # set +x 00:13:39.214 19:02:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:39.214 19:02:00 -- target/connect_stress.sh@34 -- # kill -0 169412 00:13:39.214 19:02:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:39.214 19:02:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:39.214 19:02:00 -- common/autotest_common.sh@10 -- # set +x 00:13:39.475 19:02:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:39.475 19:02:00 -- target/connect_stress.sh@34 -- # kill -0 169412 00:13:39.475 19:02:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:39.475 19:02:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:39.475 19:02:00 -- common/autotest_common.sh@10 -- # set +x 00:13:39.736 19:02:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:39.736 19:02:00 -- target/connect_stress.sh@34 -- # kill -0 169412 00:13:39.736 19:02:00 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:39.736 19:02:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:39.736 19:02:00 -- common/autotest_common.sh@10 -- # set +x 00:13:40.306 19:02:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.306 19:02:01 -- target/connect_stress.sh@34 -- # kill -0 169412 00:13:40.306 19:02:01 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:40.306 19:02:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.306 19:02:01 -- common/autotest_common.sh@10 -- # set +x 00:13:40.567 19:02:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.567 19:02:01 -- target/connect_stress.sh@34 -- # kill -0 169412 00:13:40.567 19:02:01 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:40.567 19:02:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.567 19:02:01 -- common/autotest_common.sh@10 -- # set +x 00:13:40.828 19:02:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:40.828 19:02:01 -- target/connect_stress.sh@34 -- # kill -0 169412 00:13:40.828 19:02:01 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:40.828 19:02:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:40.828 19:02:01 -- common/autotest_common.sh@10 -- # set +x 00:13:41.090 19:02:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.090 19:02:02 -- target/connect_stress.sh@34 -- # kill -0 169412 00:13:41.090 19:02:02 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:41.090 19:02:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.090 19:02:02 -- common/autotest_common.sh@10 -- # set +x 00:13:41.350 19:02:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.350 19:02:02 -- target/connect_stress.sh@34 -- # kill -0 169412 00:13:41.350 19:02:02 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:41.350 19:02:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.350 19:02:02 -- common/autotest_common.sh@10 -- # set +x 00:13:41.921 19:02:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:41.921 19:02:02 -- target/connect_stress.sh@34 -- # kill -0 169412 00:13:41.921 19:02:02 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:41.921 19:02:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:41.921 19:02:02 -- common/autotest_common.sh@10 -- # set +x 00:13:42.181 19:02:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.181 19:02:03 -- target/connect_stress.sh@34 -- # kill -0 169412 00:13:42.181 19:02:03 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:42.181 19:02:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.181 19:02:03 -- common/autotest_common.sh@10 -- # set +x 00:13:42.441 19:02:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.441 19:02:03 -- target/connect_stress.sh@34 -- # kill -0 169412 00:13:42.441 19:02:03 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:42.441 19:02:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.441 19:02:03 -- common/autotest_common.sh@10 -- # set +x 00:13:42.701 19:02:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.701 19:02:03 -- target/connect_stress.sh@34 -- # kill -0 169412 00:13:42.701 19:02:03 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:42.701 19:02:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.701 19:02:03 -- common/autotest_common.sh@10 -- # set +x 00:13:42.962 19:02:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:42.962 19:02:03 -- target/connect_stress.sh@34 -- # kill -0 169412 00:13:42.962 19:02:03 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:42.962 19:02:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:42.962 19:02:03 -- common/autotest_common.sh@10 -- # set +x 00:13:43.534 19:02:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.534 19:02:04 -- target/connect_stress.sh@34 -- # kill -0 169412 00:13:43.534 19:02:04 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:43.534 19:02:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.534 19:02:04 -- common/autotest_common.sh@10 -- # set +x 00:13:43.796 19:02:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:43.796 19:02:04 -- target/connect_stress.sh@34 -- # kill -0 169412 00:13:43.796 19:02:04 -- target/connect_stress.sh@35 -- # rpc_cmd 00:13:43.796 19:02:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:43.796 19:02:04 -- common/autotest_common.sh@10 -- # set +x 00:13:44.056 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:44.056 19:02:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:44.056 19:02:04 -- target/connect_stress.sh@34 -- # kill -0 169412 00:13:44.056 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (169412) - No such process 00:13:44.056 19:02:04 -- target/connect_stress.sh@38 -- # wait 169412 00:13:44.056 19:02:04 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:13:44.056 19:02:04 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:13:44.056 19:02:04 -- target/connect_stress.sh@43 -- # nvmftestfini 00:13:44.056 19:02:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:44.056 19:02:04 -- nvmf/common.sh@116 -- # sync 00:13:44.056 19:02:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:44.056 19:02:04 -- nvmf/common.sh@119 -- # set +e 00:13:44.056 19:02:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:44.056 19:02:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:44.056 rmmod nvme_tcp 00:13:44.056 rmmod nvme_fabrics 00:13:44.056 rmmod nvme_keyring 00:13:44.056 19:02:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:44.056 19:02:04 -- nvmf/common.sh@123 -- # set -e 00:13:44.056 19:02:04 -- nvmf/common.sh@124 -- # return 0 00:13:44.056 19:02:04 -- nvmf/common.sh@477 -- # '[' -n 169252 ']' 00:13:44.056 19:02:04 -- nvmf/common.sh@478 -- # killprocess 169252 00:13:44.056 19:02:04 -- common/autotest_common.sh@936 -- # '[' -z 169252 ']' 00:13:44.056 19:02:04 -- common/autotest_common.sh@940 -- # kill -0 169252 00:13:44.056 19:02:04 -- common/autotest_common.sh@941 -- # uname 00:13:44.056 19:02:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:44.056 19:02:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 169252 00:13:44.056 19:02:05 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:44.056 19:02:05 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:44.056 19:02:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 169252' 00:13:44.056 killing process with pid 169252 00:13:44.056 19:02:05 -- common/autotest_common.sh@955 -- # kill 169252 00:13:44.056 19:02:05 -- common/autotest_common.sh@960 -- # wait 169252 00:13:44.315 19:02:05 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:44.315 19:02:05 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:44.315 19:02:05 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:44.315 19:02:05 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:44.315 19:02:05 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:44.315 19:02:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:44.315 19:02:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:44.315 19:02:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:46.864 19:02:07 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:46.864 00:13:46.864 real 0m16.044s 00:13:46.864 user 0m42.316s 00:13:46.864 sys 0m4.469s 00:13:46.864 19:02:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:46.864 19:02:07 -- common/autotest_common.sh@10 -- # set +x 00:13:46.864 ************************************ 00:13:46.864 END TEST nvmf_connect_stress 00:13:46.864 ************************************ 00:13:46.864 19:02:07 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:46.864 19:02:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:46.864 19:02:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:46.864 19:02:07 -- common/autotest_common.sh@10 -- # set +x 00:13:46.864 ************************************ 00:13:46.864 START TEST nvmf_fused_ordering 00:13:46.864 ************************************ 00:13:46.864 19:02:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:13:46.864 * Looking for test storage... 00:13:46.864 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:46.864 19:02:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:46.864 19:02:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:46.864 19:02:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:46.864 19:02:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:46.864 19:02:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:46.864 19:02:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:46.864 19:02:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:46.864 19:02:07 -- scripts/common.sh@335 -- # IFS=.-: 00:13:46.864 19:02:07 -- scripts/common.sh@335 -- # read -ra ver1 00:13:46.864 19:02:07 -- scripts/common.sh@336 -- # IFS=.-: 00:13:46.864 19:02:07 -- scripts/common.sh@336 -- # read -ra ver2 00:13:46.864 19:02:07 -- scripts/common.sh@337 -- # local 'op=<' 00:13:46.864 19:02:07 -- scripts/common.sh@339 -- # ver1_l=2 00:13:46.864 19:02:07 -- scripts/common.sh@340 -- # ver2_l=1 00:13:46.864 19:02:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:46.864 19:02:07 -- scripts/common.sh@343 -- # case "$op" in 00:13:46.864 19:02:07 -- scripts/common.sh@344 -- # : 1 00:13:46.864 19:02:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:46.864 19:02:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:46.864 19:02:07 -- scripts/common.sh@364 -- # decimal 1 00:13:46.864 19:02:07 -- scripts/common.sh@352 -- # local d=1 00:13:46.864 19:02:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:46.864 19:02:07 -- scripts/common.sh@354 -- # echo 1 00:13:46.864 19:02:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:46.864 19:02:07 -- scripts/common.sh@365 -- # decimal 2 00:13:46.864 19:02:07 -- scripts/common.sh@352 -- # local d=2 00:13:46.864 19:02:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:46.864 19:02:07 -- scripts/common.sh@354 -- # echo 2 00:13:46.864 19:02:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:46.864 19:02:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:46.864 19:02:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:46.864 19:02:07 -- scripts/common.sh@367 -- # return 0 00:13:46.864 19:02:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:46.864 19:02:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:46.864 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:46.864 --rc genhtml_branch_coverage=1 00:13:46.864 --rc genhtml_function_coverage=1 00:13:46.864 --rc genhtml_legend=1 00:13:46.864 --rc geninfo_all_blocks=1 00:13:46.864 --rc geninfo_unexecuted_blocks=1 00:13:46.864 00:13:46.864 ' 00:13:46.864 19:02:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:46.864 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:46.865 --rc genhtml_branch_coverage=1 00:13:46.865 --rc genhtml_function_coverage=1 00:13:46.865 --rc genhtml_legend=1 00:13:46.865 --rc geninfo_all_blocks=1 00:13:46.865 --rc geninfo_unexecuted_blocks=1 00:13:46.865 00:13:46.865 ' 00:13:46.865 19:02:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:46.865 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:46.865 --rc genhtml_branch_coverage=1 00:13:46.865 --rc genhtml_function_coverage=1 00:13:46.865 --rc genhtml_legend=1 00:13:46.865 --rc geninfo_all_blocks=1 00:13:46.865 --rc geninfo_unexecuted_blocks=1 00:13:46.865 00:13:46.865 ' 00:13:46.865 19:02:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:46.865 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:46.865 --rc genhtml_branch_coverage=1 00:13:46.865 --rc genhtml_function_coverage=1 00:13:46.865 --rc genhtml_legend=1 00:13:46.865 --rc geninfo_all_blocks=1 00:13:46.865 --rc geninfo_unexecuted_blocks=1 00:13:46.865 00:13:46.865 ' 00:13:46.865 19:02:07 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:46.865 19:02:07 -- nvmf/common.sh@7 -- # uname -s 00:13:46.865 19:02:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:46.865 19:02:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:46.865 19:02:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:46.865 19:02:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:46.865 19:02:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:46.865 19:02:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:46.865 19:02:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:46.865 19:02:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:46.865 19:02:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:46.865 19:02:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:46.865 19:02:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:46.865 19:02:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:46.865 19:02:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:46.865 19:02:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:46.865 19:02:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:46.865 19:02:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:46.865 19:02:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:46.865 19:02:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:46.865 19:02:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:46.865 19:02:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:46.865 19:02:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:46.865 19:02:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:46.865 19:02:07 -- paths/export.sh@5 -- # export PATH 00:13:46.865 19:02:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:46.865 19:02:07 -- nvmf/common.sh@46 -- # : 0 00:13:46.865 19:02:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:46.865 19:02:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:46.865 19:02:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:46.865 19:02:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:46.865 19:02:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:46.865 19:02:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:46.865 19:02:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:46.865 19:02:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:46.865 19:02:07 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:13:46.865 19:02:07 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:46.865 19:02:07 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:46.865 19:02:07 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:46.865 19:02:07 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:46.865 19:02:07 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:46.865 19:02:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:46.865 19:02:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:46.865 19:02:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:46.865 19:02:07 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:46.865 19:02:07 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:46.865 19:02:07 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:46.865 19:02:07 -- common/autotest_common.sh@10 -- # set +x 00:13:48.770 19:02:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:48.770 19:02:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:48.770 19:02:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:48.770 19:02:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:48.770 19:02:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:48.770 19:02:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:48.770 19:02:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:48.770 19:02:09 -- nvmf/common.sh@294 -- # net_devs=() 00:13:48.770 19:02:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:48.770 19:02:09 -- nvmf/common.sh@295 -- # e810=() 00:13:48.770 19:02:09 -- nvmf/common.sh@295 -- # local -ga e810 00:13:48.770 19:02:09 -- nvmf/common.sh@296 -- # x722=() 00:13:48.770 19:02:09 -- nvmf/common.sh@296 -- # local -ga x722 00:13:48.770 19:02:09 -- nvmf/common.sh@297 -- # mlx=() 00:13:48.770 19:02:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:48.770 19:02:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:48.770 19:02:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:48.770 19:02:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:48.770 19:02:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:48.770 19:02:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:48.770 19:02:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:48.770 19:02:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:48.770 19:02:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:48.770 19:02:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:48.770 19:02:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:48.770 19:02:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:48.770 19:02:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:48.770 19:02:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:48.770 19:02:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:48.770 19:02:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:48.770 19:02:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:48.770 19:02:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:48.770 19:02:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:48.770 19:02:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:48.770 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:48.770 19:02:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:48.770 19:02:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:48.770 19:02:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:48.770 19:02:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:48.770 19:02:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:48.770 19:02:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:48.770 19:02:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:48.770 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:48.770 19:02:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:48.770 19:02:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:48.770 19:02:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:48.770 19:02:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:48.770 19:02:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:48.770 19:02:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:48.770 19:02:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:48.770 19:02:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:48.770 19:02:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:48.770 19:02:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:48.770 19:02:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:48.770 19:02:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:48.770 19:02:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:48.770 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:48.770 19:02:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:48.770 19:02:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:48.770 19:02:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:48.770 19:02:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:48.770 19:02:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:48.770 19:02:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:48.770 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:48.770 19:02:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:48.770 19:02:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:48.770 19:02:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:48.770 19:02:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:48.770 19:02:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:48.770 19:02:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:48.770 19:02:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:48.770 19:02:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:48.770 19:02:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:48.770 19:02:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:48.770 19:02:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:48.770 19:02:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:48.770 19:02:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:48.770 19:02:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:48.770 19:02:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:48.770 19:02:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:48.770 19:02:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:48.770 19:02:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:48.770 19:02:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:48.770 19:02:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:48.770 19:02:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:48.770 19:02:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:48.770 19:02:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:48.770 19:02:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:48.770 19:02:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:48.770 19:02:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:48.770 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:48.770 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.326 ms 00:13:48.770 00:13:48.770 --- 10.0.0.2 ping statistics --- 00:13:48.770 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:48.770 rtt min/avg/max/mdev = 0.326/0.326/0.326/0.000 ms 00:13:48.770 19:02:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:48.770 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:48.770 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.178 ms 00:13:48.770 00:13:48.770 --- 10.0.0.1 ping statistics --- 00:13:48.770 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:48.770 rtt min/avg/max/mdev = 0.178/0.178/0.178/0.000 ms 00:13:48.770 19:02:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:48.770 19:02:09 -- nvmf/common.sh@410 -- # return 0 00:13:48.770 19:02:09 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:48.770 19:02:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:48.770 19:02:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:48.770 19:02:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:48.770 19:02:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:48.770 19:02:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:48.770 19:02:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:48.771 19:02:09 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:13:48.771 19:02:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:48.771 19:02:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:48.771 19:02:09 -- common/autotest_common.sh@10 -- # set +x 00:13:48.771 19:02:09 -- nvmf/common.sh@469 -- # nvmfpid=172614 00:13:48.771 19:02:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:13:48.771 19:02:09 -- nvmf/common.sh@470 -- # waitforlisten 172614 00:13:48.771 19:02:09 -- common/autotest_common.sh@829 -- # '[' -z 172614 ']' 00:13:48.771 19:02:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:48.771 19:02:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:48.771 19:02:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:48.771 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:48.771 19:02:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:48.771 19:02:09 -- common/autotest_common.sh@10 -- # set +x 00:13:48.771 [2024-11-28 19:02:09.727206] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:48.771 [2024-11-28 19:02:09.727291] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:48.771 EAL: No free 2048 kB hugepages reported on node 1 00:13:48.771 [2024-11-28 19:02:09.792072] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:13:49.032 [2024-11-28 19:02:09.898549] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:49.033 [2024-11-28 19:02:09.898698] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:49.033 [2024-11-28 19:02:09.898726] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:49.033 [2024-11-28 19:02:09.898738] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:49.033 [2024-11-28 19:02:09.898765] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:49.971 19:02:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:49.971 19:02:10 -- common/autotest_common.sh@862 -- # return 0 00:13:49.971 19:02:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:49.971 19:02:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:49.971 19:02:10 -- common/autotest_common.sh@10 -- # set +x 00:13:49.971 19:02:10 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:49.971 19:02:10 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:49.971 19:02:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.971 19:02:10 -- common/autotest_common.sh@10 -- # set +x 00:13:49.971 [2024-11-28 19:02:10.740098] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:49.971 19:02:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.971 19:02:10 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:49.971 19:02:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.971 19:02:10 -- common/autotest_common.sh@10 -- # set +x 00:13:49.971 19:02:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.971 19:02:10 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:49.971 19:02:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.971 19:02:10 -- common/autotest_common.sh@10 -- # set +x 00:13:49.971 [2024-11-28 19:02:10.756272] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:49.971 19:02:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.971 19:02:10 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:49.971 19:02:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.971 19:02:10 -- common/autotest_common.sh@10 -- # set +x 00:13:49.971 NULL1 00:13:49.971 19:02:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.971 19:02:10 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:13:49.971 19:02:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.971 19:02:10 -- common/autotest_common.sh@10 -- # set +x 00:13:49.971 19:02:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.971 19:02:10 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:49.971 19:02:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.971 19:02:10 -- common/autotest_common.sh@10 -- # set +x 00:13:49.971 19:02:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.971 19:02:10 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:13:49.971 [2024-11-28 19:02:10.800384] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:49.971 [2024-11-28 19:02:10.800450] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid172769 ] 00:13:49.971 EAL: No free 2048 kB hugepages reported on node 1 00:13:50.542 Attached to nqn.2016-06.io.spdk:cnode1 00:13:50.542 Namespace ID: 1 size: 1GB 00:13:50.542 fused_ordering(0) 00:13:50.542 fused_ordering(1) 00:13:50.542 fused_ordering(2) 00:13:50.542 fused_ordering(3) 00:13:50.542 fused_ordering(4) 00:13:50.542 fused_ordering(5) 00:13:50.542 fused_ordering(6) 00:13:50.542 fused_ordering(7) 00:13:50.542 fused_ordering(8) 00:13:50.542 fused_ordering(9) 00:13:50.542 fused_ordering(10) 00:13:50.542 fused_ordering(11) 00:13:50.542 fused_ordering(12) 00:13:50.542 fused_ordering(13) 00:13:50.542 fused_ordering(14) 00:13:50.542 fused_ordering(15) 00:13:50.542 fused_ordering(16) 00:13:50.542 fused_ordering(17) 00:13:50.542 fused_ordering(18) 00:13:50.542 fused_ordering(19) 00:13:50.542 fused_ordering(20) 00:13:50.542 fused_ordering(21) 00:13:50.542 fused_ordering(22) 00:13:50.542 fused_ordering(23) 00:13:50.542 fused_ordering(24) 00:13:50.542 fused_ordering(25) 00:13:50.542 fused_ordering(26) 00:13:50.542 fused_ordering(27) 00:13:50.542 fused_ordering(28) 00:13:50.542 fused_ordering(29) 00:13:50.542 fused_ordering(30) 00:13:50.542 fused_ordering(31) 00:13:50.542 fused_ordering(32) 00:13:50.542 fused_ordering(33) 00:13:50.542 fused_ordering(34) 00:13:50.542 fused_ordering(35) 00:13:50.542 fused_ordering(36) 00:13:50.542 fused_ordering(37) 00:13:50.542 fused_ordering(38) 00:13:50.542 fused_ordering(39) 00:13:50.542 fused_ordering(40) 00:13:50.542 fused_ordering(41) 00:13:50.542 fused_ordering(42) 00:13:50.542 fused_ordering(43) 00:13:50.542 fused_ordering(44) 00:13:50.542 fused_ordering(45) 00:13:50.542 fused_ordering(46) 00:13:50.542 fused_ordering(47) 00:13:50.542 fused_ordering(48) 00:13:50.542 fused_ordering(49) 00:13:50.542 fused_ordering(50) 00:13:50.542 fused_ordering(51) 00:13:50.542 fused_ordering(52) 00:13:50.542 fused_ordering(53) 00:13:50.542 fused_ordering(54) 00:13:50.542 fused_ordering(55) 00:13:50.542 fused_ordering(56) 00:13:50.542 fused_ordering(57) 00:13:50.542 fused_ordering(58) 00:13:50.542 fused_ordering(59) 00:13:50.542 fused_ordering(60) 00:13:50.542 fused_ordering(61) 00:13:50.542 fused_ordering(62) 00:13:50.542 fused_ordering(63) 00:13:50.542 fused_ordering(64) 00:13:50.542 fused_ordering(65) 00:13:50.542 fused_ordering(66) 00:13:50.542 fused_ordering(67) 00:13:50.542 fused_ordering(68) 00:13:50.542 fused_ordering(69) 00:13:50.542 fused_ordering(70) 00:13:50.542 fused_ordering(71) 00:13:50.543 fused_ordering(72) 00:13:50.543 fused_ordering(73) 00:13:50.543 fused_ordering(74) 00:13:50.543 fused_ordering(75) 00:13:50.543 fused_ordering(76) 00:13:50.543 fused_ordering(77) 00:13:50.543 fused_ordering(78) 00:13:50.543 fused_ordering(79) 00:13:50.543 fused_ordering(80) 00:13:50.543 fused_ordering(81) 00:13:50.543 fused_ordering(82) 00:13:50.543 fused_ordering(83) 00:13:50.543 fused_ordering(84) 00:13:50.543 fused_ordering(85) 00:13:50.543 fused_ordering(86) 00:13:50.543 fused_ordering(87) 00:13:50.543 fused_ordering(88) 00:13:50.543 fused_ordering(89) 00:13:50.543 fused_ordering(90) 00:13:50.543 fused_ordering(91) 00:13:50.543 fused_ordering(92) 00:13:50.543 fused_ordering(93) 00:13:50.543 fused_ordering(94) 00:13:50.543 fused_ordering(95) 00:13:50.543 fused_ordering(96) 00:13:50.543 fused_ordering(97) 00:13:50.543 fused_ordering(98) 00:13:50.543 fused_ordering(99) 00:13:50.543 fused_ordering(100) 00:13:50.543 fused_ordering(101) 00:13:50.543 fused_ordering(102) 00:13:50.543 fused_ordering(103) 00:13:50.543 fused_ordering(104) 00:13:50.543 fused_ordering(105) 00:13:50.543 fused_ordering(106) 00:13:50.543 fused_ordering(107) 00:13:50.543 fused_ordering(108) 00:13:50.543 fused_ordering(109) 00:13:50.543 fused_ordering(110) 00:13:50.543 fused_ordering(111) 00:13:50.543 fused_ordering(112) 00:13:50.543 fused_ordering(113) 00:13:50.543 fused_ordering(114) 00:13:50.543 fused_ordering(115) 00:13:50.543 fused_ordering(116) 00:13:50.543 fused_ordering(117) 00:13:50.543 fused_ordering(118) 00:13:50.543 fused_ordering(119) 00:13:50.543 fused_ordering(120) 00:13:50.543 fused_ordering(121) 00:13:50.543 fused_ordering(122) 00:13:50.543 fused_ordering(123) 00:13:50.543 fused_ordering(124) 00:13:50.543 fused_ordering(125) 00:13:50.543 fused_ordering(126) 00:13:50.543 fused_ordering(127) 00:13:50.543 fused_ordering(128) 00:13:50.543 fused_ordering(129) 00:13:50.543 fused_ordering(130) 00:13:50.543 fused_ordering(131) 00:13:50.543 fused_ordering(132) 00:13:50.543 fused_ordering(133) 00:13:50.543 fused_ordering(134) 00:13:50.543 fused_ordering(135) 00:13:50.543 fused_ordering(136) 00:13:50.543 fused_ordering(137) 00:13:50.543 fused_ordering(138) 00:13:50.543 fused_ordering(139) 00:13:50.543 fused_ordering(140) 00:13:50.543 fused_ordering(141) 00:13:50.543 fused_ordering(142) 00:13:50.543 fused_ordering(143) 00:13:50.543 fused_ordering(144) 00:13:50.543 fused_ordering(145) 00:13:50.543 fused_ordering(146) 00:13:50.543 fused_ordering(147) 00:13:50.543 fused_ordering(148) 00:13:50.543 fused_ordering(149) 00:13:50.543 fused_ordering(150) 00:13:50.543 fused_ordering(151) 00:13:50.543 fused_ordering(152) 00:13:50.543 fused_ordering(153) 00:13:50.543 fused_ordering(154) 00:13:50.543 fused_ordering(155) 00:13:50.543 fused_ordering(156) 00:13:50.543 fused_ordering(157) 00:13:50.543 fused_ordering(158) 00:13:50.543 fused_ordering(159) 00:13:50.543 fused_ordering(160) 00:13:50.543 fused_ordering(161) 00:13:50.543 fused_ordering(162) 00:13:50.543 fused_ordering(163) 00:13:50.543 fused_ordering(164) 00:13:50.543 fused_ordering(165) 00:13:50.543 fused_ordering(166) 00:13:50.543 fused_ordering(167) 00:13:50.543 fused_ordering(168) 00:13:50.543 fused_ordering(169) 00:13:50.543 fused_ordering(170) 00:13:50.543 fused_ordering(171) 00:13:50.543 fused_ordering(172) 00:13:50.543 fused_ordering(173) 00:13:50.543 fused_ordering(174) 00:13:50.543 fused_ordering(175) 00:13:50.543 fused_ordering(176) 00:13:50.543 fused_ordering(177) 00:13:50.543 fused_ordering(178) 00:13:50.543 fused_ordering(179) 00:13:50.543 fused_ordering(180) 00:13:50.543 fused_ordering(181) 00:13:50.543 fused_ordering(182) 00:13:50.543 fused_ordering(183) 00:13:50.543 fused_ordering(184) 00:13:50.543 fused_ordering(185) 00:13:50.543 fused_ordering(186) 00:13:50.543 fused_ordering(187) 00:13:50.543 fused_ordering(188) 00:13:50.543 fused_ordering(189) 00:13:50.543 fused_ordering(190) 00:13:50.543 fused_ordering(191) 00:13:50.543 fused_ordering(192) 00:13:50.543 fused_ordering(193) 00:13:50.543 fused_ordering(194) 00:13:50.543 fused_ordering(195) 00:13:50.543 fused_ordering(196) 00:13:50.543 fused_ordering(197) 00:13:50.543 fused_ordering(198) 00:13:50.543 fused_ordering(199) 00:13:50.543 fused_ordering(200) 00:13:50.543 fused_ordering(201) 00:13:50.543 fused_ordering(202) 00:13:50.543 fused_ordering(203) 00:13:50.543 fused_ordering(204) 00:13:50.543 fused_ordering(205) 00:13:50.805 fused_ordering(206) 00:13:50.805 fused_ordering(207) 00:13:50.805 fused_ordering(208) 00:13:50.805 fused_ordering(209) 00:13:50.805 fused_ordering(210) 00:13:50.805 fused_ordering(211) 00:13:50.805 fused_ordering(212) 00:13:50.805 fused_ordering(213) 00:13:50.805 fused_ordering(214) 00:13:50.805 fused_ordering(215) 00:13:50.805 fused_ordering(216) 00:13:50.805 fused_ordering(217) 00:13:50.805 fused_ordering(218) 00:13:50.805 fused_ordering(219) 00:13:50.805 fused_ordering(220) 00:13:50.805 fused_ordering(221) 00:13:50.805 fused_ordering(222) 00:13:50.805 fused_ordering(223) 00:13:50.805 fused_ordering(224) 00:13:50.805 fused_ordering(225) 00:13:50.805 fused_ordering(226) 00:13:50.805 fused_ordering(227) 00:13:50.805 fused_ordering(228) 00:13:50.805 fused_ordering(229) 00:13:50.805 fused_ordering(230) 00:13:50.805 fused_ordering(231) 00:13:50.805 fused_ordering(232) 00:13:50.805 fused_ordering(233) 00:13:50.805 fused_ordering(234) 00:13:50.805 fused_ordering(235) 00:13:50.805 fused_ordering(236) 00:13:50.805 fused_ordering(237) 00:13:50.805 fused_ordering(238) 00:13:50.805 fused_ordering(239) 00:13:50.805 fused_ordering(240) 00:13:50.805 fused_ordering(241) 00:13:50.805 fused_ordering(242) 00:13:50.805 fused_ordering(243) 00:13:50.805 fused_ordering(244) 00:13:50.805 fused_ordering(245) 00:13:50.805 fused_ordering(246) 00:13:50.805 fused_ordering(247) 00:13:50.805 fused_ordering(248) 00:13:50.805 fused_ordering(249) 00:13:50.805 fused_ordering(250) 00:13:50.805 fused_ordering(251) 00:13:50.805 fused_ordering(252) 00:13:50.805 fused_ordering(253) 00:13:50.805 fused_ordering(254) 00:13:50.805 fused_ordering(255) 00:13:50.805 fused_ordering(256) 00:13:50.805 fused_ordering(257) 00:13:50.805 fused_ordering(258) 00:13:50.805 fused_ordering(259) 00:13:50.805 fused_ordering(260) 00:13:50.805 fused_ordering(261) 00:13:50.805 fused_ordering(262) 00:13:50.805 fused_ordering(263) 00:13:50.805 fused_ordering(264) 00:13:50.805 fused_ordering(265) 00:13:50.805 fused_ordering(266) 00:13:50.805 fused_ordering(267) 00:13:50.805 fused_ordering(268) 00:13:50.805 fused_ordering(269) 00:13:50.805 fused_ordering(270) 00:13:50.805 fused_ordering(271) 00:13:50.805 fused_ordering(272) 00:13:50.805 fused_ordering(273) 00:13:50.805 fused_ordering(274) 00:13:50.805 fused_ordering(275) 00:13:50.805 fused_ordering(276) 00:13:50.805 fused_ordering(277) 00:13:50.805 fused_ordering(278) 00:13:50.805 fused_ordering(279) 00:13:50.805 fused_ordering(280) 00:13:50.805 fused_ordering(281) 00:13:50.805 fused_ordering(282) 00:13:50.805 fused_ordering(283) 00:13:50.805 fused_ordering(284) 00:13:50.805 fused_ordering(285) 00:13:50.805 fused_ordering(286) 00:13:50.805 fused_ordering(287) 00:13:50.805 fused_ordering(288) 00:13:50.805 fused_ordering(289) 00:13:50.805 fused_ordering(290) 00:13:50.805 fused_ordering(291) 00:13:50.805 fused_ordering(292) 00:13:50.805 fused_ordering(293) 00:13:50.805 fused_ordering(294) 00:13:50.805 fused_ordering(295) 00:13:50.805 fused_ordering(296) 00:13:50.805 fused_ordering(297) 00:13:50.805 fused_ordering(298) 00:13:50.805 fused_ordering(299) 00:13:50.805 fused_ordering(300) 00:13:50.805 fused_ordering(301) 00:13:50.805 fused_ordering(302) 00:13:50.805 fused_ordering(303) 00:13:50.805 fused_ordering(304) 00:13:50.805 fused_ordering(305) 00:13:50.805 fused_ordering(306) 00:13:50.805 fused_ordering(307) 00:13:50.805 fused_ordering(308) 00:13:50.805 fused_ordering(309) 00:13:50.805 fused_ordering(310) 00:13:50.805 fused_ordering(311) 00:13:50.805 fused_ordering(312) 00:13:50.805 fused_ordering(313) 00:13:50.805 fused_ordering(314) 00:13:50.805 fused_ordering(315) 00:13:50.805 fused_ordering(316) 00:13:50.805 fused_ordering(317) 00:13:50.805 fused_ordering(318) 00:13:50.805 fused_ordering(319) 00:13:50.805 fused_ordering(320) 00:13:50.805 fused_ordering(321) 00:13:50.805 fused_ordering(322) 00:13:50.805 fused_ordering(323) 00:13:50.805 fused_ordering(324) 00:13:50.805 fused_ordering(325) 00:13:50.805 fused_ordering(326) 00:13:50.805 fused_ordering(327) 00:13:50.805 fused_ordering(328) 00:13:50.805 fused_ordering(329) 00:13:50.805 fused_ordering(330) 00:13:50.805 fused_ordering(331) 00:13:50.805 fused_ordering(332) 00:13:50.805 fused_ordering(333) 00:13:50.805 fused_ordering(334) 00:13:50.805 fused_ordering(335) 00:13:50.805 fused_ordering(336) 00:13:50.805 fused_ordering(337) 00:13:50.805 fused_ordering(338) 00:13:50.805 fused_ordering(339) 00:13:50.805 fused_ordering(340) 00:13:50.805 fused_ordering(341) 00:13:50.805 fused_ordering(342) 00:13:50.805 fused_ordering(343) 00:13:50.805 fused_ordering(344) 00:13:50.805 fused_ordering(345) 00:13:50.805 fused_ordering(346) 00:13:50.805 fused_ordering(347) 00:13:50.805 fused_ordering(348) 00:13:50.805 fused_ordering(349) 00:13:50.805 fused_ordering(350) 00:13:50.805 fused_ordering(351) 00:13:50.805 fused_ordering(352) 00:13:50.805 fused_ordering(353) 00:13:50.805 fused_ordering(354) 00:13:50.805 fused_ordering(355) 00:13:50.805 fused_ordering(356) 00:13:50.805 fused_ordering(357) 00:13:50.805 fused_ordering(358) 00:13:50.805 fused_ordering(359) 00:13:50.805 fused_ordering(360) 00:13:50.805 fused_ordering(361) 00:13:50.805 fused_ordering(362) 00:13:50.805 fused_ordering(363) 00:13:50.805 fused_ordering(364) 00:13:50.805 fused_ordering(365) 00:13:50.805 fused_ordering(366) 00:13:50.805 fused_ordering(367) 00:13:50.805 fused_ordering(368) 00:13:50.805 fused_ordering(369) 00:13:50.805 fused_ordering(370) 00:13:50.805 fused_ordering(371) 00:13:50.805 fused_ordering(372) 00:13:50.805 fused_ordering(373) 00:13:50.805 fused_ordering(374) 00:13:50.805 fused_ordering(375) 00:13:50.805 fused_ordering(376) 00:13:50.805 fused_ordering(377) 00:13:50.805 fused_ordering(378) 00:13:50.805 fused_ordering(379) 00:13:50.805 fused_ordering(380) 00:13:50.805 fused_ordering(381) 00:13:50.805 fused_ordering(382) 00:13:50.805 fused_ordering(383) 00:13:50.805 fused_ordering(384) 00:13:50.805 fused_ordering(385) 00:13:50.805 fused_ordering(386) 00:13:50.805 fused_ordering(387) 00:13:50.805 fused_ordering(388) 00:13:50.805 fused_ordering(389) 00:13:50.805 fused_ordering(390) 00:13:50.805 fused_ordering(391) 00:13:50.805 fused_ordering(392) 00:13:50.805 fused_ordering(393) 00:13:50.805 fused_ordering(394) 00:13:50.805 fused_ordering(395) 00:13:50.805 fused_ordering(396) 00:13:50.805 fused_ordering(397) 00:13:50.805 fused_ordering(398) 00:13:50.805 fused_ordering(399) 00:13:50.805 fused_ordering(400) 00:13:50.805 fused_ordering(401) 00:13:50.805 fused_ordering(402) 00:13:50.805 fused_ordering(403) 00:13:50.805 fused_ordering(404) 00:13:50.805 fused_ordering(405) 00:13:50.805 fused_ordering(406) 00:13:50.805 fused_ordering(407) 00:13:50.805 fused_ordering(408) 00:13:50.805 fused_ordering(409) 00:13:50.805 fused_ordering(410) 00:13:51.068 fused_ordering(411) 00:13:51.068 fused_ordering(412) 00:13:51.068 fused_ordering(413) 00:13:51.068 fused_ordering(414) 00:13:51.068 fused_ordering(415) 00:13:51.068 fused_ordering(416) 00:13:51.068 fused_ordering(417) 00:13:51.068 fused_ordering(418) 00:13:51.068 fused_ordering(419) 00:13:51.068 fused_ordering(420) 00:13:51.068 fused_ordering(421) 00:13:51.068 fused_ordering(422) 00:13:51.068 fused_ordering(423) 00:13:51.068 fused_ordering(424) 00:13:51.068 fused_ordering(425) 00:13:51.068 fused_ordering(426) 00:13:51.068 fused_ordering(427) 00:13:51.068 fused_ordering(428) 00:13:51.068 fused_ordering(429) 00:13:51.068 fused_ordering(430) 00:13:51.068 fused_ordering(431) 00:13:51.068 fused_ordering(432) 00:13:51.068 fused_ordering(433) 00:13:51.068 fused_ordering(434) 00:13:51.068 fused_ordering(435) 00:13:51.068 fused_ordering(436) 00:13:51.068 fused_ordering(437) 00:13:51.068 fused_ordering(438) 00:13:51.068 fused_ordering(439) 00:13:51.068 fused_ordering(440) 00:13:51.068 fused_ordering(441) 00:13:51.068 fused_ordering(442) 00:13:51.068 fused_ordering(443) 00:13:51.068 fused_ordering(444) 00:13:51.068 fused_ordering(445) 00:13:51.068 fused_ordering(446) 00:13:51.068 fused_ordering(447) 00:13:51.068 fused_ordering(448) 00:13:51.068 fused_ordering(449) 00:13:51.068 fused_ordering(450) 00:13:51.068 fused_ordering(451) 00:13:51.068 fused_ordering(452) 00:13:51.068 fused_ordering(453) 00:13:51.068 fused_ordering(454) 00:13:51.068 fused_ordering(455) 00:13:51.068 fused_ordering(456) 00:13:51.068 fused_ordering(457) 00:13:51.068 fused_ordering(458) 00:13:51.068 fused_ordering(459) 00:13:51.068 fused_ordering(460) 00:13:51.068 fused_ordering(461) 00:13:51.068 fused_ordering(462) 00:13:51.068 fused_ordering(463) 00:13:51.068 fused_ordering(464) 00:13:51.068 fused_ordering(465) 00:13:51.068 fused_ordering(466) 00:13:51.068 fused_ordering(467) 00:13:51.068 fused_ordering(468) 00:13:51.068 fused_ordering(469) 00:13:51.068 fused_ordering(470) 00:13:51.068 fused_ordering(471) 00:13:51.068 fused_ordering(472) 00:13:51.068 fused_ordering(473) 00:13:51.068 fused_ordering(474) 00:13:51.068 fused_ordering(475) 00:13:51.068 fused_ordering(476) 00:13:51.068 fused_ordering(477) 00:13:51.068 fused_ordering(478) 00:13:51.068 fused_ordering(479) 00:13:51.068 fused_ordering(480) 00:13:51.068 fused_ordering(481) 00:13:51.068 fused_ordering(482) 00:13:51.068 fused_ordering(483) 00:13:51.068 fused_ordering(484) 00:13:51.068 fused_ordering(485) 00:13:51.068 fused_ordering(486) 00:13:51.068 fused_ordering(487) 00:13:51.068 fused_ordering(488) 00:13:51.068 fused_ordering(489) 00:13:51.068 fused_ordering(490) 00:13:51.068 fused_ordering(491) 00:13:51.068 fused_ordering(492) 00:13:51.068 fused_ordering(493) 00:13:51.068 fused_ordering(494) 00:13:51.068 fused_ordering(495) 00:13:51.068 fused_ordering(496) 00:13:51.068 fused_ordering(497) 00:13:51.068 fused_ordering(498) 00:13:51.068 fused_ordering(499) 00:13:51.068 fused_ordering(500) 00:13:51.068 fused_ordering(501) 00:13:51.068 fused_ordering(502) 00:13:51.068 fused_ordering(503) 00:13:51.068 fused_ordering(504) 00:13:51.068 fused_ordering(505) 00:13:51.068 fused_ordering(506) 00:13:51.068 fused_ordering(507) 00:13:51.068 fused_ordering(508) 00:13:51.068 fused_ordering(509) 00:13:51.068 fused_ordering(510) 00:13:51.068 fused_ordering(511) 00:13:51.068 fused_ordering(512) 00:13:51.068 fused_ordering(513) 00:13:51.068 fused_ordering(514) 00:13:51.068 fused_ordering(515) 00:13:51.068 fused_ordering(516) 00:13:51.068 fused_ordering(517) 00:13:51.068 fused_ordering(518) 00:13:51.068 fused_ordering(519) 00:13:51.068 fused_ordering(520) 00:13:51.068 fused_ordering(521) 00:13:51.068 fused_ordering(522) 00:13:51.068 fused_ordering(523) 00:13:51.068 fused_ordering(524) 00:13:51.068 fused_ordering(525) 00:13:51.068 fused_ordering(526) 00:13:51.068 fused_ordering(527) 00:13:51.068 fused_ordering(528) 00:13:51.068 fused_ordering(529) 00:13:51.068 fused_ordering(530) 00:13:51.068 fused_ordering(531) 00:13:51.068 fused_ordering(532) 00:13:51.068 fused_ordering(533) 00:13:51.068 fused_ordering(534) 00:13:51.068 fused_ordering(535) 00:13:51.068 fused_ordering(536) 00:13:51.068 fused_ordering(537) 00:13:51.068 fused_ordering(538) 00:13:51.068 fused_ordering(539) 00:13:51.068 fused_ordering(540) 00:13:51.068 fused_ordering(541) 00:13:51.068 fused_ordering(542) 00:13:51.068 fused_ordering(543) 00:13:51.069 fused_ordering(544) 00:13:51.069 fused_ordering(545) 00:13:51.069 fused_ordering(546) 00:13:51.069 fused_ordering(547) 00:13:51.069 fused_ordering(548) 00:13:51.069 fused_ordering(549) 00:13:51.069 fused_ordering(550) 00:13:51.069 fused_ordering(551) 00:13:51.069 fused_ordering(552) 00:13:51.069 fused_ordering(553) 00:13:51.069 fused_ordering(554) 00:13:51.069 fused_ordering(555) 00:13:51.069 fused_ordering(556) 00:13:51.069 fused_ordering(557) 00:13:51.069 fused_ordering(558) 00:13:51.069 fused_ordering(559) 00:13:51.069 fused_ordering(560) 00:13:51.069 fused_ordering(561) 00:13:51.069 fused_ordering(562) 00:13:51.069 fused_ordering(563) 00:13:51.069 fused_ordering(564) 00:13:51.069 fused_ordering(565) 00:13:51.069 fused_ordering(566) 00:13:51.069 fused_ordering(567) 00:13:51.069 fused_ordering(568) 00:13:51.069 fused_ordering(569) 00:13:51.069 fused_ordering(570) 00:13:51.069 fused_ordering(571) 00:13:51.069 fused_ordering(572) 00:13:51.069 fused_ordering(573) 00:13:51.069 fused_ordering(574) 00:13:51.069 fused_ordering(575) 00:13:51.069 fused_ordering(576) 00:13:51.069 fused_ordering(577) 00:13:51.069 fused_ordering(578) 00:13:51.069 fused_ordering(579) 00:13:51.069 fused_ordering(580) 00:13:51.069 fused_ordering(581) 00:13:51.069 fused_ordering(582) 00:13:51.069 fused_ordering(583) 00:13:51.069 fused_ordering(584) 00:13:51.069 fused_ordering(585) 00:13:51.069 fused_ordering(586) 00:13:51.069 fused_ordering(587) 00:13:51.069 fused_ordering(588) 00:13:51.069 fused_ordering(589) 00:13:51.069 fused_ordering(590) 00:13:51.069 fused_ordering(591) 00:13:51.069 fused_ordering(592) 00:13:51.069 fused_ordering(593) 00:13:51.069 fused_ordering(594) 00:13:51.069 fused_ordering(595) 00:13:51.069 fused_ordering(596) 00:13:51.069 fused_ordering(597) 00:13:51.069 fused_ordering(598) 00:13:51.069 fused_ordering(599) 00:13:51.069 fused_ordering(600) 00:13:51.069 fused_ordering(601) 00:13:51.069 fused_ordering(602) 00:13:51.069 fused_ordering(603) 00:13:51.069 fused_ordering(604) 00:13:51.069 fused_ordering(605) 00:13:51.069 fused_ordering(606) 00:13:51.069 fused_ordering(607) 00:13:51.069 fused_ordering(608) 00:13:51.069 fused_ordering(609) 00:13:51.069 fused_ordering(610) 00:13:51.069 fused_ordering(611) 00:13:51.069 fused_ordering(612) 00:13:51.069 fused_ordering(613) 00:13:51.069 fused_ordering(614) 00:13:51.069 fused_ordering(615) 00:13:51.638 fused_ordering(616) 00:13:51.639 fused_ordering(617) 00:13:51.639 fused_ordering(618) 00:13:51.639 fused_ordering(619) 00:13:51.639 fused_ordering(620) 00:13:51.639 fused_ordering(621) 00:13:51.639 fused_ordering(622) 00:13:51.639 fused_ordering(623) 00:13:51.639 fused_ordering(624) 00:13:51.639 fused_ordering(625) 00:13:51.639 fused_ordering(626) 00:13:51.639 fused_ordering(627) 00:13:51.639 fused_ordering(628) 00:13:51.639 fused_ordering(629) 00:13:51.639 fused_ordering(630) 00:13:51.639 fused_ordering(631) 00:13:51.639 fused_ordering(632) 00:13:51.639 fused_ordering(633) 00:13:51.639 fused_ordering(634) 00:13:51.639 fused_ordering(635) 00:13:51.639 fused_ordering(636) 00:13:51.639 fused_ordering(637) 00:13:51.639 fused_ordering(638) 00:13:51.639 fused_ordering(639) 00:13:51.639 fused_ordering(640) 00:13:51.639 fused_ordering(641) 00:13:51.639 fused_ordering(642) 00:13:51.639 fused_ordering(643) 00:13:51.639 fused_ordering(644) 00:13:51.639 fused_ordering(645) 00:13:51.639 fused_ordering(646) 00:13:51.639 fused_ordering(647) 00:13:51.639 fused_ordering(648) 00:13:51.639 fused_ordering(649) 00:13:51.639 fused_ordering(650) 00:13:51.639 fused_ordering(651) 00:13:51.639 fused_ordering(652) 00:13:51.639 fused_ordering(653) 00:13:51.639 fused_ordering(654) 00:13:51.639 fused_ordering(655) 00:13:51.639 fused_ordering(656) 00:13:51.639 fused_ordering(657) 00:13:51.639 fused_ordering(658) 00:13:51.639 fused_ordering(659) 00:13:51.639 fused_ordering(660) 00:13:51.639 fused_ordering(661) 00:13:51.639 fused_ordering(662) 00:13:51.639 fused_ordering(663) 00:13:51.639 fused_ordering(664) 00:13:51.639 fused_ordering(665) 00:13:51.639 fused_ordering(666) 00:13:51.639 fused_ordering(667) 00:13:51.639 fused_ordering(668) 00:13:51.639 fused_ordering(669) 00:13:51.639 fused_ordering(670) 00:13:51.639 fused_ordering(671) 00:13:51.639 fused_ordering(672) 00:13:51.639 fused_ordering(673) 00:13:51.639 fused_ordering(674) 00:13:51.639 fused_ordering(675) 00:13:51.639 fused_ordering(676) 00:13:51.639 fused_ordering(677) 00:13:51.639 fused_ordering(678) 00:13:51.639 fused_ordering(679) 00:13:51.639 fused_ordering(680) 00:13:51.639 fused_ordering(681) 00:13:51.639 fused_ordering(682) 00:13:51.639 fused_ordering(683) 00:13:51.639 fused_ordering(684) 00:13:51.639 fused_ordering(685) 00:13:51.639 fused_ordering(686) 00:13:51.639 fused_ordering(687) 00:13:51.639 fused_ordering(688) 00:13:51.639 fused_ordering(689) 00:13:51.639 fused_ordering(690) 00:13:51.639 fused_ordering(691) 00:13:51.639 fused_ordering(692) 00:13:51.639 fused_ordering(693) 00:13:51.639 fused_ordering(694) 00:13:51.639 fused_ordering(695) 00:13:51.639 fused_ordering(696) 00:13:51.639 fused_ordering(697) 00:13:51.639 fused_ordering(698) 00:13:51.639 fused_ordering(699) 00:13:51.639 fused_ordering(700) 00:13:51.639 fused_ordering(701) 00:13:51.639 fused_ordering(702) 00:13:51.639 fused_ordering(703) 00:13:51.639 fused_ordering(704) 00:13:51.639 fused_ordering(705) 00:13:51.639 fused_ordering(706) 00:13:51.639 fused_ordering(707) 00:13:51.639 fused_ordering(708) 00:13:51.639 fused_ordering(709) 00:13:51.639 fused_ordering(710) 00:13:51.639 fused_ordering(711) 00:13:51.639 fused_ordering(712) 00:13:51.639 fused_ordering(713) 00:13:51.639 fused_ordering(714) 00:13:51.639 fused_ordering(715) 00:13:51.639 fused_ordering(716) 00:13:51.639 fused_ordering(717) 00:13:51.639 fused_ordering(718) 00:13:51.639 fused_ordering(719) 00:13:51.639 fused_ordering(720) 00:13:51.639 fused_ordering(721) 00:13:51.639 fused_ordering(722) 00:13:51.639 fused_ordering(723) 00:13:51.639 fused_ordering(724) 00:13:51.639 fused_ordering(725) 00:13:51.639 fused_ordering(726) 00:13:51.639 fused_ordering(727) 00:13:51.639 fused_ordering(728) 00:13:51.639 fused_ordering(729) 00:13:51.639 fused_ordering(730) 00:13:51.639 fused_ordering(731) 00:13:51.639 fused_ordering(732) 00:13:51.639 fused_ordering(733) 00:13:51.639 fused_ordering(734) 00:13:51.639 fused_ordering(735) 00:13:51.639 fused_ordering(736) 00:13:51.639 fused_ordering(737) 00:13:51.639 fused_ordering(738) 00:13:51.639 fused_ordering(739) 00:13:51.639 fused_ordering(740) 00:13:51.639 fused_ordering(741) 00:13:51.639 fused_ordering(742) 00:13:51.639 fused_ordering(743) 00:13:51.639 fused_ordering(744) 00:13:51.639 fused_ordering(745) 00:13:51.639 fused_ordering(746) 00:13:51.639 fused_ordering(747) 00:13:51.639 fused_ordering(748) 00:13:51.639 fused_ordering(749) 00:13:51.639 fused_ordering(750) 00:13:51.639 fused_ordering(751) 00:13:51.639 fused_ordering(752) 00:13:51.639 fused_ordering(753) 00:13:51.639 fused_ordering(754) 00:13:51.639 fused_ordering(755) 00:13:51.639 fused_ordering(756) 00:13:51.639 fused_ordering(757) 00:13:51.639 fused_ordering(758) 00:13:51.639 fused_ordering(759) 00:13:51.639 fused_ordering(760) 00:13:51.639 fused_ordering(761) 00:13:51.639 fused_ordering(762) 00:13:51.639 fused_ordering(763) 00:13:51.639 fused_ordering(764) 00:13:51.639 fused_ordering(765) 00:13:51.639 fused_ordering(766) 00:13:51.639 fused_ordering(767) 00:13:51.639 fused_ordering(768) 00:13:51.639 fused_ordering(769) 00:13:51.639 fused_ordering(770) 00:13:51.639 fused_ordering(771) 00:13:51.639 fused_ordering(772) 00:13:51.639 fused_ordering(773) 00:13:51.639 fused_ordering(774) 00:13:51.639 fused_ordering(775) 00:13:51.639 fused_ordering(776) 00:13:51.639 fused_ordering(777) 00:13:51.639 fused_ordering(778) 00:13:51.639 fused_ordering(779) 00:13:51.639 fused_ordering(780) 00:13:51.639 fused_ordering(781) 00:13:51.639 fused_ordering(782) 00:13:51.639 fused_ordering(783) 00:13:51.639 fused_ordering(784) 00:13:51.639 fused_ordering(785) 00:13:51.639 fused_ordering(786) 00:13:51.639 fused_ordering(787) 00:13:51.639 fused_ordering(788) 00:13:51.639 fused_ordering(789) 00:13:51.639 fused_ordering(790) 00:13:51.639 fused_ordering(791) 00:13:51.639 fused_ordering(792) 00:13:51.639 fused_ordering(793) 00:13:51.639 fused_ordering(794) 00:13:51.639 fused_ordering(795) 00:13:51.640 fused_ordering(796) 00:13:51.640 fused_ordering(797) 00:13:51.640 fused_ordering(798) 00:13:51.640 fused_ordering(799) 00:13:51.640 fused_ordering(800) 00:13:51.640 fused_ordering(801) 00:13:51.640 fused_ordering(802) 00:13:51.640 fused_ordering(803) 00:13:51.640 fused_ordering(804) 00:13:51.640 fused_ordering(805) 00:13:51.640 fused_ordering(806) 00:13:51.640 fused_ordering(807) 00:13:51.640 fused_ordering(808) 00:13:51.640 fused_ordering(809) 00:13:51.640 fused_ordering(810) 00:13:51.640 fused_ordering(811) 00:13:51.640 fused_ordering(812) 00:13:51.640 fused_ordering(813) 00:13:51.640 fused_ordering(814) 00:13:51.640 fused_ordering(815) 00:13:51.640 fused_ordering(816) 00:13:51.640 fused_ordering(817) 00:13:51.640 fused_ordering(818) 00:13:51.640 fused_ordering(819) 00:13:51.640 fused_ordering(820) 00:13:52.207 fused_ordering(821) 00:13:52.207 fused_ordering(822) 00:13:52.207 fused_ordering(823) 00:13:52.207 fused_ordering(824) 00:13:52.207 fused_ordering(825) 00:13:52.207 fused_ordering(826) 00:13:52.207 fused_ordering(827) 00:13:52.207 fused_ordering(828) 00:13:52.207 fused_ordering(829) 00:13:52.207 fused_ordering(830) 00:13:52.207 fused_ordering(831) 00:13:52.207 fused_ordering(832) 00:13:52.207 fused_ordering(833) 00:13:52.207 fused_ordering(834) 00:13:52.207 fused_ordering(835) 00:13:52.207 fused_ordering(836) 00:13:52.207 fused_ordering(837) 00:13:52.207 fused_ordering(838) 00:13:52.207 fused_ordering(839) 00:13:52.207 fused_ordering(840) 00:13:52.207 fused_ordering(841) 00:13:52.207 fused_ordering(842) 00:13:52.207 fused_ordering(843) 00:13:52.207 fused_ordering(844) 00:13:52.207 fused_ordering(845) 00:13:52.207 fused_ordering(846) 00:13:52.207 fused_ordering(847) 00:13:52.207 fused_ordering(848) 00:13:52.207 fused_ordering(849) 00:13:52.207 fused_ordering(850) 00:13:52.207 fused_ordering(851) 00:13:52.207 fused_ordering(852) 00:13:52.207 fused_ordering(853) 00:13:52.207 fused_ordering(854) 00:13:52.207 fused_ordering(855) 00:13:52.207 fused_ordering(856) 00:13:52.207 fused_ordering(857) 00:13:52.207 fused_ordering(858) 00:13:52.207 fused_ordering(859) 00:13:52.207 fused_ordering(860) 00:13:52.207 fused_ordering(861) 00:13:52.208 fused_ordering(862) 00:13:52.208 fused_ordering(863) 00:13:52.208 fused_ordering(864) 00:13:52.208 fused_ordering(865) 00:13:52.208 fused_ordering(866) 00:13:52.208 fused_ordering(867) 00:13:52.208 fused_ordering(868) 00:13:52.208 fused_ordering(869) 00:13:52.208 fused_ordering(870) 00:13:52.208 fused_ordering(871) 00:13:52.208 fused_ordering(872) 00:13:52.208 fused_ordering(873) 00:13:52.208 fused_ordering(874) 00:13:52.208 fused_ordering(875) 00:13:52.208 fused_ordering(876) 00:13:52.208 fused_ordering(877) 00:13:52.208 fused_ordering(878) 00:13:52.208 fused_ordering(879) 00:13:52.208 fused_ordering(880) 00:13:52.208 fused_ordering(881) 00:13:52.208 fused_ordering(882) 00:13:52.208 fused_ordering(883) 00:13:52.208 fused_ordering(884) 00:13:52.208 fused_ordering(885) 00:13:52.208 fused_ordering(886) 00:13:52.208 fused_ordering(887) 00:13:52.208 fused_ordering(888) 00:13:52.208 fused_ordering(889) 00:13:52.208 fused_ordering(890) 00:13:52.208 fused_ordering(891) 00:13:52.208 fused_ordering(892) 00:13:52.208 fused_ordering(893) 00:13:52.208 fused_ordering(894) 00:13:52.208 fused_ordering(895) 00:13:52.208 fused_ordering(896) 00:13:52.208 fused_ordering(897) 00:13:52.208 fused_ordering(898) 00:13:52.208 fused_ordering(899) 00:13:52.208 fused_ordering(900) 00:13:52.208 fused_ordering(901) 00:13:52.208 fused_ordering(902) 00:13:52.208 fused_ordering(903) 00:13:52.208 fused_ordering(904) 00:13:52.208 fused_ordering(905) 00:13:52.208 fused_ordering(906) 00:13:52.208 fused_ordering(907) 00:13:52.208 fused_ordering(908) 00:13:52.208 fused_ordering(909) 00:13:52.208 fused_ordering(910) 00:13:52.208 fused_ordering(911) 00:13:52.208 fused_ordering(912) 00:13:52.208 fused_ordering(913) 00:13:52.208 fused_ordering(914) 00:13:52.208 fused_ordering(915) 00:13:52.208 fused_ordering(916) 00:13:52.208 fused_ordering(917) 00:13:52.208 fused_ordering(918) 00:13:52.208 fused_ordering(919) 00:13:52.208 fused_ordering(920) 00:13:52.208 fused_ordering(921) 00:13:52.208 fused_ordering(922) 00:13:52.208 fused_ordering(923) 00:13:52.208 fused_ordering(924) 00:13:52.208 fused_ordering(925) 00:13:52.208 fused_ordering(926) 00:13:52.208 fused_ordering(927) 00:13:52.208 fused_ordering(928) 00:13:52.208 fused_ordering(929) 00:13:52.208 fused_ordering(930) 00:13:52.208 fused_ordering(931) 00:13:52.208 fused_ordering(932) 00:13:52.208 fused_ordering(933) 00:13:52.208 fused_ordering(934) 00:13:52.208 fused_ordering(935) 00:13:52.208 fused_ordering(936) 00:13:52.208 fused_ordering(937) 00:13:52.208 fused_ordering(938) 00:13:52.208 fused_ordering(939) 00:13:52.208 fused_ordering(940) 00:13:52.208 fused_ordering(941) 00:13:52.208 fused_ordering(942) 00:13:52.208 fused_ordering(943) 00:13:52.208 fused_ordering(944) 00:13:52.208 fused_ordering(945) 00:13:52.208 fused_ordering(946) 00:13:52.208 fused_ordering(947) 00:13:52.208 fused_ordering(948) 00:13:52.208 fused_ordering(949) 00:13:52.208 fused_ordering(950) 00:13:52.208 fused_ordering(951) 00:13:52.208 fused_ordering(952) 00:13:52.208 fused_ordering(953) 00:13:52.208 fused_ordering(954) 00:13:52.208 fused_ordering(955) 00:13:52.208 fused_ordering(956) 00:13:52.208 fused_ordering(957) 00:13:52.208 fused_ordering(958) 00:13:52.208 fused_ordering(959) 00:13:52.208 fused_ordering(960) 00:13:52.208 fused_ordering(961) 00:13:52.208 fused_ordering(962) 00:13:52.208 fused_ordering(963) 00:13:52.208 fused_ordering(964) 00:13:52.208 fused_ordering(965) 00:13:52.208 fused_ordering(966) 00:13:52.208 fused_ordering(967) 00:13:52.208 fused_ordering(968) 00:13:52.208 fused_ordering(969) 00:13:52.208 fused_ordering(970) 00:13:52.208 fused_ordering(971) 00:13:52.208 fused_ordering(972) 00:13:52.208 fused_ordering(973) 00:13:52.208 fused_ordering(974) 00:13:52.208 fused_ordering(975) 00:13:52.208 fused_ordering(976) 00:13:52.208 fused_ordering(977) 00:13:52.208 fused_ordering(978) 00:13:52.208 fused_ordering(979) 00:13:52.208 fused_ordering(980) 00:13:52.208 fused_ordering(981) 00:13:52.208 fused_ordering(982) 00:13:52.208 fused_ordering(983) 00:13:52.208 fused_ordering(984) 00:13:52.208 fused_ordering(985) 00:13:52.208 fused_ordering(986) 00:13:52.208 fused_ordering(987) 00:13:52.208 fused_ordering(988) 00:13:52.208 fused_ordering(989) 00:13:52.208 fused_ordering(990) 00:13:52.208 fused_ordering(991) 00:13:52.208 fused_ordering(992) 00:13:52.208 fused_ordering(993) 00:13:52.208 fused_ordering(994) 00:13:52.208 fused_ordering(995) 00:13:52.208 fused_ordering(996) 00:13:52.208 fused_ordering(997) 00:13:52.208 fused_ordering(998) 00:13:52.208 fused_ordering(999) 00:13:52.208 fused_ordering(1000) 00:13:52.208 fused_ordering(1001) 00:13:52.208 fused_ordering(1002) 00:13:52.208 fused_ordering(1003) 00:13:52.208 fused_ordering(1004) 00:13:52.208 fused_ordering(1005) 00:13:52.208 fused_ordering(1006) 00:13:52.208 fused_ordering(1007) 00:13:52.208 fused_ordering(1008) 00:13:52.208 fused_ordering(1009) 00:13:52.208 fused_ordering(1010) 00:13:52.208 fused_ordering(1011) 00:13:52.208 fused_ordering(1012) 00:13:52.208 fused_ordering(1013) 00:13:52.208 fused_ordering(1014) 00:13:52.208 fused_ordering(1015) 00:13:52.208 fused_ordering(1016) 00:13:52.208 fused_ordering(1017) 00:13:52.208 fused_ordering(1018) 00:13:52.208 fused_ordering(1019) 00:13:52.208 fused_ordering(1020) 00:13:52.208 fused_ordering(1021) 00:13:52.208 fused_ordering(1022) 00:13:52.208 fused_ordering(1023) 00:13:52.208 19:02:13 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:13:52.208 19:02:13 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:13:52.208 19:02:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:52.208 19:02:13 -- nvmf/common.sh@116 -- # sync 00:13:52.208 19:02:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:52.208 19:02:13 -- nvmf/common.sh@119 -- # set +e 00:13:52.208 19:02:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:52.208 19:02:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:52.208 rmmod nvme_tcp 00:13:52.208 rmmod nvme_fabrics 00:13:52.208 rmmod nvme_keyring 00:13:52.208 19:02:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:52.208 19:02:13 -- nvmf/common.sh@123 -- # set -e 00:13:52.208 19:02:13 -- nvmf/common.sh@124 -- # return 0 00:13:52.208 19:02:13 -- nvmf/common.sh@477 -- # '[' -n 172614 ']' 00:13:52.208 19:02:13 -- nvmf/common.sh@478 -- # killprocess 172614 00:13:52.208 19:02:13 -- common/autotest_common.sh@936 -- # '[' -z 172614 ']' 00:13:52.208 19:02:13 -- common/autotest_common.sh@940 -- # kill -0 172614 00:13:52.208 19:02:13 -- common/autotest_common.sh@941 -- # uname 00:13:52.208 19:02:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:52.208 19:02:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 172614 00:13:52.209 19:02:13 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:52.209 19:02:13 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:52.209 19:02:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 172614' 00:13:52.209 killing process with pid 172614 00:13:52.209 19:02:13 -- common/autotest_common.sh@955 -- # kill 172614 00:13:52.209 19:02:13 -- common/autotest_common.sh@960 -- # wait 172614 00:13:52.469 19:02:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:52.469 19:02:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:52.469 19:02:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:52.469 19:02:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:52.469 19:02:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:52.469 19:02:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:52.469 19:02:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:52.469 19:02:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:55.014 19:02:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:55.014 00:13:55.014 real 0m8.144s 00:13:55.014 user 0m6.232s 00:13:55.014 sys 0m2.778s 00:13:55.014 19:02:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:55.014 19:02:15 -- common/autotest_common.sh@10 -- # set +x 00:13:55.014 ************************************ 00:13:55.014 END TEST nvmf_fused_ordering 00:13:55.014 ************************************ 00:13:55.014 19:02:15 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:55.014 19:02:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:55.014 19:02:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:55.014 19:02:15 -- common/autotest_common.sh@10 -- # set +x 00:13:55.014 ************************************ 00:13:55.014 START TEST nvmf_delete_subsystem 00:13:55.014 ************************************ 00:13:55.014 19:02:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:13:55.014 * Looking for test storage... 00:13:55.014 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:55.014 19:02:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:55.014 19:02:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:55.014 19:02:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:55.014 19:02:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:55.014 19:02:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:55.014 19:02:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:55.014 19:02:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:55.014 19:02:15 -- scripts/common.sh@335 -- # IFS=.-: 00:13:55.014 19:02:15 -- scripts/common.sh@335 -- # read -ra ver1 00:13:55.014 19:02:15 -- scripts/common.sh@336 -- # IFS=.-: 00:13:55.014 19:02:15 -- scripts/common.sh@336 -- # read -ra ver2 00:13:55.014 19:02:15 -- scripts/common.sh@337 -- # local 'op=<' 00:13:55.014 19:02:15 -- scripts/common.sh@339 -- # ver1_l=2 00:13:55.014 19:02:15 -- scripts/common.sh@340 -- # ver2_l=1 00:13:55.014 19:02:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:55.014 19:02:15 -- scripts/common.sh@343 -- # case "$op" in 00:13:55.014 19:02:15 -- scripts/common.sh@344 -- # : 1 00:13:55.014 19:02:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:55.014 19:02:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:55.014 19:02:15 -- scripts/common.sh@364 -- # decimal 1 00:13:55.014 19:02:15 -- scripts/common.sh@352 -- # local d=1 00:13:55.014 19:02:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:55.014 19:02:15 -- scripts/common.sh@354 -- # echo 1 00:13:55.014 19:02:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:55.014 19:02:15 -- scripts/common.sh@365 -- # decimal 2 00:13:55.014 19:02:15 -- scripts/common.sh@352 -- # local d=2 00:13:55.014 19:02:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:55.014 19:02:15 -- scripts/common.sh@354 -- # echo 2 00:13:55.014 19:02:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:55.014 19:02:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:55.014 19:02:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:55.014 19:02:15 -- scripts/common.sh@367 -- # return 0 00:13:55.014 19:02:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:55.014 19:02:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:55.014 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:55.014 --rc genhtml_branch_coverage=1 00:13:55.014 --rc genhtml_function_coverage=1 00:13:55.014 --rc genhtml_legend=1 00:13:55.014 --rc geninfo_all_blocks=1 00:13:55.014 --rc geninfo_unexecuted_blocks=1 00:13:55.014 00:13:55.014 ' 00:13:55.014 19:02:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:55.014 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:55.014 --rc genhtml_branch_coverage=1 00:13:55.014 --rc genhtml_function_coverage=1 00:13:55.014 --rc genhtml_legend=1 00:13:55.014 --rc geninfo_all_blocks=1 00:13:55.014 --rc geninfo_unexecuted_blocks=1 00:13:55.014 00:13:55.014 ' 00:13:55.014 19:02:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:55.014 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:55.014 --rc genhtml_branch_coverage=1 00:13:55.014 --rc genhtml_function_coverage=1 00:13:55.014 --rc genhtml_legend=1 00:13:55.014 --rc geninfo_all_blocks=1 00:13:55.014 --rc geninfo_unexecuted_blocks=1 00:13:55.014 00:13:55.014 ' 00:13:55.014 19:02:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:55.014 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:55.014 --rc genhtml_branch_coverage=1 00:13:55.014 --rc genhtml_function_coverage=1 00:13:55.014 --rc genhtml_legend=1 00:13:55.014 --rc geninfo_all_blocks=1 00:13:55.014 --rc geninfo_unexecuted_blocks=1 00:13:55.014 00:13:55.014 ' 00:13:55.014 19:02:15 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:55.014 19:02:15 -- nvmf/common.sh@7 -- # uname -s 00:13:55.014 19:02:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:55.014 19:02:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:55.014 19:02:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:55.014 19:02:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:55.014 19:02:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:55.014 19:02:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:55.014 19:02:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:55.014 19:02:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:55.014 19:02:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:55.014 19:02:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:55.014 19:02:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:55.014 19:02:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:55.014 19:02:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:55.014 19:02:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:55.014 19:02:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:55.014 19:02:15 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:55.014 19:02:15 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:55.014 19:02:15 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:55.014 19:02:15 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:55.014 19:02:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:55.014 19:02:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:55.014 19:02:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:55.014 19:02:15 -- paths/export.sh@5 -- # export PATH 00:13:55.014 19:02:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:55.015 19:02:15 -- nvmf/common.sh@46 -- # : 0 00:13:55.015 19:02:15 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:55.015 19:02:15 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:55.015 19:02:15 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:55.015 19:02:15 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:55.015 19:02:15 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:55.015 19:02:15 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:55.015 19:02:15 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:55.015 19:02:15 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:55.015 19:02:15 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:13:55.015 19:02:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:55.015 19:02:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:55.015 19:02:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:55.015 19:02:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:55.015 19:02:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:55.015 19:02:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:55.015 19:02:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:55.015 19:02:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:55.015 19:02:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:55.015 19:02:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:55.015 19:02:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:55.015 19:02:15 -- common/autotest_common.sh@10 -- # set +x 00:13:56.924 19:02:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:56.924 19:02:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:56.924 19:02:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:56.924 19:02:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:56.924 19:02:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:56.924 19:02:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:56.924 19:02:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:56.924 19:02:17 -- nvmf/common.sh@294 -- # net_devs=() 00:13:56.924 19:02:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:56.924 19:02:17 -- nvmf/common.sh@295 -- # e810=() 00:13:56.924 19:02:17 -- nvmf/common.sh@295 -- # local -ga e810 00:13:56.924 19:02:17 -- nvmf/common.sh@296 -- # x722=() 00:13:56.924 19:02:17 -- nvmf/common.sh@296 -- # local -ga x722 00:13:56.924 19:02:17 -- nvmf/common.sh@297 -- # mlx=() 00:13:56.924 19:02:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:56.924 19:02:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:56.924 19:02:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:56.924 19:02:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:56.924 19:02:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:56.924 19:02:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:56.924 19:02:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:56.924 19:02:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:56.924 19:02:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:56.924 19:02:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:56.924 19:02:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:56.924 19:02:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:56.924 19:02:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:56.924 19:02:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:56.924 19:02:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:56.924 19:02:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:56.924 19:02:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:56.924 19:02:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:56.924 19:02:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:56.924 19:02:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:56.924 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:56.924 19:02:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:56.924 19:02:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:56.924 19:02:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:56.924 19:02:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:56.924 19:02:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:56.924 19:02:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:56.924 19:02:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:56.924 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:56.924 19:02:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:56.924 19:02:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:56.924 19:02:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:56.924 19:02:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:56.924 19:02:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:56.924 19:02:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:56.924 19:02:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:56.924 19:02:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:56.924 19:02:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:56.924 19:02:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:56.924 19:02:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:56.924 19:02:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:56.924 19:02:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:56.924 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:56.924 19:02:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:56.924 19:02:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:56.924 19:02:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:56.924 19:02:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:56.924 19:02:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:56.924 19:02:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:56.924 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:56.924 19:02:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:56.924 19:02:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:56.924 19:02:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:56.924 19:02:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:56.924 19:02:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:56.924 19:02:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:56.924 19:02:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:56.924 19:02:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:56.924 19:02:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:56.924 19:02:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:56.924 19:02:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:56.924 19:02:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:56.924 19:02:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:56.924 19:02:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:56.924 19:02:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:56.924 19:02:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:56.924 19:02:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:56.924 19:02:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:56.924 19:02:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:56.924 19:02:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:56.924 19:02:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:56.924 19:02:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:56.924 19:02:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:56.924 19:02:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:56.924 19:02:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:56.924 19:02:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:56.924 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:56.924 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.272 ms 00:13:56.924 00:13:56.924 --- 10.0.0.2 ping statistics --- 00:13:56.924 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:56.924 rtt min/avg/max/mdev = 0.272/0.272/0.272/0.000 ms 00:13:56.924 19:02:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:56.924 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:56.924 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.114 ms 00:13:56.924 00:13:56.924 --- 10.0.0.1 ping statistics --- 00:13:56.924 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:56.924 rtt min/avg/max/mdev = 0.114/0.114/0.114/0.000 ms 00:13:56.924 19:02:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:56.924 19:02:17 -- nvmf/common.sh@410 -- # return 0 00:13:56.924 19:02:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:56.924 19:02:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:56.924 19:02:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:56.924 19:02:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:56.924 19:02:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:56.924 19:02:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:56.924 19:02:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:56.924 19:02:17 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:13:56.924 19:02:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:56.924 19:02:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:56.924 19:02:17 -- common/autotest_common.sh@10 -- # set +x 00:13:56.924 19:02:17 -- nvmf/common.sh@469 -- # nvmfpid=175000 00:13:56.924 19:02:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:13:56.925 19:02:17 -- nvmf/common.sh@470 -- # waitforlisten 175000 00:13:56.925 19:02:17 -- common/autotest_common.sh@829 -- # '[' -z 175000 ']' 00:13:56.925 19:02:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:56.925 19:02:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:56.925 19:02:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:56.925 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:56.925 19:02:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:56.925 19:02:17 -- common/autotest_common.sh@10 -- # set +x 00:13:56.925 [2024-11-28 19:02:17.909777] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:56.925 [2024-11-28 19:02:17.909846] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:56.925 EAL: No free 2048 kB hugepages reported on node 1 00:13:57.184 [2024-11-28 19:02:17.972223] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:13:57.184 [2024-11-28 19:02:18.078331] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:57.184 [2024-11-28 19:02:18.078519] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:57.184 [2024-11-28 19:02:18.078540] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:57.184 [2024-11-28 19:02:18.078555] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:57.184 [2024-11-28 19:02:18.078609] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:57.184 [2024-11-28 19:02:18.078614] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:58.127 19:02:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:58.127 19:02:18 -- common/autotest_common.sh@862 -- # return 0 00:13:58.127 19:02:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:58.127 19:02:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:58.127 19:02:18 -- common/autotest_common.sh@10 -- # set +x 00:13:58.127 19:02:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:58.127 19:02:18 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:58.127 19:02:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.127 19:02:18 -- common/autotest_common.sh@10 -- # set +x 00:13:58.127 [2024-11-28 19:02:18.947652] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:58.127 19:02:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.127 19:02:18 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:58.127 19:02:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.127 19:02:18 -- common/autotest_common.sh@10 -- # set +x 00:13:58.127 19:02:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.127 19:02:18 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:58.127 19:02:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.127 19:02:18 -- common/autotest_common.sh@10 -- # set +x 00:13:58.127 [2024-11-28 19:02:18.963893] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:58.127 19:02:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.127 19:02:18 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:13:58.127 19:02:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.127 19:02:18 -- common/autotest_common.sh@10 -- # set +x 00:13:58.127 NULL1 00:13:58.127 19:02:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.127 19:02:18 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:58.127 19:02:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.127 19:02:18 -- common/autotest_common.sh@10 -- # set +x 00:13:58.127 Delay0 00:13:58.127 19:02:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.127 19:02:18 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:58.127 19:02:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:58.127 19:02:18 -- common/autotest_common.sh@10 -- # set +x 00:13:58.127 19:02:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:58.127 19:02:18 -- target/delete_subsystem.sh@28 -- # perf_pid=175155 00:13:58.127 19:02:18 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:13:58.127 19:02:18 -- target/delete_subsystem.sh@30 -- # sleep 2 00:13:58.127 EAL: No free 2048 kB hugepages reported on node 1 00:13:58.127 [2024-11-28 19:02:19.038545] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:14:00.037 19:02:20 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:00.037 19:02:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:00.037 19:02:20 -- common/autotest_common.sh@10 -- # set +x 00:14:00.299 Read completed with error (sct=0, sc=8) 00:14:00.299 Read completed with error (sct=0, sc=8) 00:14:00.299 Write completed with error (sct=0, sc=8) 00:14:00.299 Read completed with error (sct=0, sc=8) 00:14:00.299 starting I/O failed: -6 00:14:00.299 Read completed with error (sct=0, sc=8) 00:14:00.299 Write completed with error (sct=0, sc=8) 00:14:00.299 Write completed with error (sct=0, sc=8) 00:14:00.299 Read completed with error (sct=0, sc=8) 00:14:00.299 starting I/O failed: -6 00:14:00.299 Read completed with error (sct=0, sc=8) 00:14:00.299 Write completed with error (sct=0, sc=8) 00:14:00.299 Write completed with error (sct=0, sc=8) 00:14:00.299 Read completed with error (sct=0, sc=8) 00:14:00.299 starting I/O failed: -6 00:14:00.299 Read completed with error (sct=0, sc=8) 00:14:00.299 Read completed with error (sct=0, sc=8) 00:14:00.299 Read completed with error (sct=0, sc=8) 00:14:00.299 Read completed with error (sct=0, sc=8) 00:14:00.299 starting I/O failed: -6 00:14:00.299 Write completed with error (sct=0, sc=8) 00:14:00.299 Read completed with error (sct=0, sc=8) 00:14:00.299 Read completed with error (sct=0, sc=8) 00:14:00.299 Write completed with error (sct=0, sc=8) 00:14:00.299 starting I/O failed: -6 00:14:00.299 Read completed with error (sct=0, sc=8) 00:14:00.299 Write completed with error (sct=0, sc=8) 00:14:00.299 Read completed with error (sct=0, sc=8) 00:14:00.299 Read completed with error (sct=0, sc=8) 00:14:00.299 starting I/O failed: -6 00:14:00.299 Write completed with error (sct=0, sc=8) 00:14:00.299 Write completed with error (sct=0, sc=8) 00:14:00.299 Read completed with error (sct=0, sc=8) 00:14:00.299 Read completed with error (sct=0, sc=8) 00:14:00.299 starting I/O failed: -6 00:14:00.299 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Write completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 starting I/O failed: -6 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Write completed with error (sct=0, sc=8) 00:14:00.300 Write completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 starting I/O failed: -6 00:14:00.300 Write completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Write completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 starting I/O failed: -6 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Write completed with error (sct=0, sc=8) 00:14:00.300 Write completed with error (sct=0, sc=8) 00:14:00.300 starting I/O failed: -6 00:14:00.300 Write completed with error (sct=0, sc=8) 00:14:00.300 [2024-11-28 19:02:21.159368] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7ffa9400c1d0 is same with the state(5) to be set 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 starting I/O failed: -6 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 starting I/O failed: -6 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 starting I/O failed: -6 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Write completed with error (sct=0, sc=8) 00:14:00.300 starting I/O failed: -6 00:14:00.300 Write completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Write completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 starting I/O failed: -6 00:14:00.300 Write completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Write completed with error (sct=0, sc=8) 00:14:00.300 starting I/O failed: -6 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 starting I/O failed: -6 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 starting I/O failed: -6 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 starting I/O failed: -6 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 starting I/O failed: -6 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 [2024-11-28 19:02:21.159956] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214a770 is same with the state(5) to be set 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Write completed with error (sct=0, sc=8) 00:14:00.300 Write completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Write completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Write completed with error (sct=0, sc=8) 00:14:00.300 Write completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Write completed with error (sct=0, sc=8) 00:14:00.300 Write completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Write completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Write completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Write completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Write completed with error (sct=0, sc=8) 00:14:00.300 Write completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Write completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Write completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Write completed with error (sct=0, sc=8) 00:14:00.300 Write completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Write completed with error (sct=0, sc=8) 00:14:00.300 Write completed with error (sct=0, sc=8) 00:14:00.300 Write completed with error (sct=0, sc=8) 00:14:00.300 Write completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Write completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Write completed with error (sct=0, sc=8) 00:14:00.300 Read completed with error (sct=0, sc=8) 00:14:00.300 Write completed with error (sct=0, sc=8) 00:14:00.300 Write completed with error (sct=0, sc=8) 00:14:00.300 [2024-11-28 19:02:21.160512] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7ffa94000c00 is same with the state(5) to be set 00:14:01.246 [2024-11-28 19:02:22.138123] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2163960 is same with the state(5) to be set 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Write completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Write completed with error (sct=0, sc=8) 00:14:01.246 Write completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Write completed with error (sct=0, sc=8) 00:14:01.246 Write completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Write completed with error (sct=0, sc=8) 00:14:01.246 Write completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Write completed with error (sct=0, sc=8) 00:14:01.246 [2024-11-28 19:02:22.161066] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214a4c0 is same with the state(5) to be set 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Write completed with error (sct=0, sc=8) 00:14:01.246 Write completed with error (sct=0, sc=8) 00:14:01.246 Write completed with error (sct=0, sc=8) 00:14:01.246 Write completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Write completed with error (sct=0, sc=8) 00:14:01.246 Write completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 [2024-11-28 19:02:22.161214] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x214aa20 is same with the state(5) to be set 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Write completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Write completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Write completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Write completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 [2024-11-28 19:02:22.163415] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7ffa9400bf20 is same with the state(5) to be set 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Write completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Write completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Write completed with error (sct=0, sc=8) 00:14:01.246 Write completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Write completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Read completed with error (sct=0, sc=8) 00:14:01.246 Write completed with error (sct=0, sc=8) 00:14:01.246 [2024-11-28 19:02:22.164082] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7ffa9400c480 is same with the state(5) to be set 00:14:01.246 [2024-11-28 19:02:22.164539] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2163960 (9): Bad file descriptor 00:14:01.246 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:14:01.246 19:02:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:01.246 19:02:22 -- target/delete_subsystem.sh@34 -- # delay=0 00:14:01.246 19:02:22 -- target/delete_subsystem.sh@35 -- # kill -0 175155 00:14:01.246 19:02:22 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:14:01.246 Initializing NVMe Controllers 00:14:01.246 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:01.246 Controller IO queue size 128, less than required. 00:14:01.246 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:01.246 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:14:01.246 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:14:01.246 Initialization complete. Launching workers. 00:14:01.246 ======================================================== 00:14:01.246 Latency(us) 00:14:01.246 Device Information : IOPS MiB/s Average min max 00:14:01.246 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 153.91 0.08 954318.84 552.28 2001644.55 00:14:01.246 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 169.30 0.08 897113.71 1185.94 1012173.66 00:14:01.246 ======================================================== 00:14:01.246 Total : 323.21 0.16 924354.25 552.28 2001644.55 00:14:01.246 00:14:01.814 19:02:22 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:14:01.814 19:02:22 -- target/delete_subsystem.sh@35 -- # kill -0 175155 00:14:01.814 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (175155) - No such process 00:14:01.814 19:02:22 -- target/delete_subsystem.sh@45 -- # NOT wait 175155 00:14:01.814 19:02:22 -- common/autotest_common.sh@650 -- # local es=0 00:14:01.814 19:02:22 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 175155 00:14:01.814 19:02:22 -- common/autotest_common.sh@638 -- # local arg=wait 00:14:01.814 19:02:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:01.814 19:02:22 -- common/autotest_common.sh@642 -- # type -t wait 00:14:01.814 19:02:22 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:01.814 19:02:22 -- common/autotest_common.sh@653 -- # wait 175155 00:14:01.814 19:02:22 -- common/autotest_common.sh@653 -- # es=1 00:14:01.814 19:02:22 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:14:01.814 19:02:22 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:14:01.814 19:02:22 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:14:01.814 19:02:22 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:01.814 19:02:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:01.814 19:02:22 -- common/autotest_common.sh@10 -- # set +x 00:14:01.814 19:02:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:01.814 19:02:22 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:01.814 19:02:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:01.814 19:02:22 -- common/autotest_common.sh@10 -- # set +x 00:14:01.814 [2024-11-28 19:02:22.687547] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:01.814 19:02:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:01.814 19:02:22 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:01.814 19:02:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:01.814 19:02:22 -- common/autotest_common.sh@10 -- # set +x 00:14:01.814 19:02:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:01.814 19:02:22 -- target/delete_subsystem.sh@54 -- # perf_pid=175576 00:14:01.814 19:02:22 -- target/delete_subsystem.sh@56 -- # delay=0 00:14:01.814 19:02:22 -- target/delete_subsystem.sh@57 -- # kill -0 175576 00:14:01.814 19:02:22 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:14:01.814 19:02:22 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:01.814 EAL: No free 2048 kB hugepages reported on node 1 00:14:01.814 [2024-11-28 19:02:22.751000] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:14:02.388 19:02:23 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:02.388 19:02:23 -- target/delete_subsystem.sh@57 -- # kill -0 175576 00:14:02.388 19:02:23 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:02.956 19:02:23 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:02.956 19:02:23 -- target/delete_subsystem.sh@57 -- # kill -0 175576 00:14:02.956 19:02:23 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:03.218 19:02:24 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:03.218 19:02:24 -- target/delete_subsystem.sh@57 -- # kill -0 175576 00:14:03.218 19:02:24 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:03.791 19:02:24 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:03.791 19:02:24 -- target/delete_subsystem.sh@57 -- # kill -0 175576 00:14:03.792 19:02:24 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:04.359 19:02:25 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:04.359 19:02:25 -- target/delete_subsystem.sh@57 -- # kill -0 175576 00:14:04.359 19:02:25 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:04.931 19:02:25 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:04.931 19:02:25 -- target/delete_subsystem.sh@57 -- # kill -0 175576 00:14:04.931 19:02:25 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:04.931 Initializing NVMe Controllers 00:14:04.931 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:04.931 Controller IO queue size 128, less than required. 00:14:04.931 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:04.931 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:14:04.931 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:14:04.931 Initialization complete. Launching workers. 00:14:04.931 ======================================================== 00:14:04.931 Latency(us) 00:14:04.931 Device Information : IOPS MiB/s Average min max 00:14:04.931 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1004745.13 1000143.54 1011208.23 00:14:04.931 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1004873.91 1000187.85 1043117.67 00:14:04.931 ======================================================== 00:14:04.931 Total : 256.00 0.12 1004809.52 1000143.54 1043117.67 00:14:04.931 00:14:05.191 19:02:26 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:05.191 19:02:26 -- target/delete_subsystem.sh@57 -- # kill -0 175576 00:14:05.191 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (175576) - No such process 00:14:05.191 19:02:26 -- target/delete_subsystem.sh@67 -- # wait 175576 00:14:05.191 19:02:26 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:14:05.191 19:02:26 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:14:05.191 19:02:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:05.191 19:02:26 -- nvmf/common.sh@116 -- # sync 00:14:05.191 19:02:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:05.191 19:02:26 -- nvmf/common.sh@119 -- # set +e 00:14:05.191 19:02:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:05.191 19:02:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:05.191 rmmod nvme_tcp 00:14:05.450 rmmod nvme_fabrics 00:14:05.450 rmmod nvme_keyring 00:14:05.450 19:02:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:05.450 19:02:26 -- nvmf/common.sh@123 -- # set -e 00:14:05.450 19:02:26 -- nvmf/common.sh@124 -- # return 0 00:14:05.450 19:02:26 -- nvmf/common.sh@477 -- # '[' -n 175000 ']' 00:14:05.450 19:02:26 -- nvmf/common.sh@478 -- # killprocess 175000 00:14:05.450 19:02:26 -- common/autotest_common.sh@936 -- # '[' -z 175000 ']' 00:14:05.450 19:02:26 -- common/autotest_common.sh@940 -- # kill -0 175000 00:14:05.450 19:02:26 -- common/autotest_common.sh@941 -- # uname 00:14:05.450 19:02:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:05.450 19:02:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 175000 00:14:05.450 19:02:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:05.450 19:02:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:05.450 19:02:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 175000' 00:14:05.450 killing process with pid 175000 00:14:05.450 19:02:26 -- common/autotest_common.sh@955 -- # kill 175000 00:14:05.451 19:02:26 -- common/autotest_common.sh@960 -- # wait 175000 00:14:05.709 19:02:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:05.709 19:02:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:05.709 19:02:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:05.709 19:02:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:05.709 19:02:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:05.709 19:02:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:05.709 19:02:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:05.709 19:02:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:07.617 19:02:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:07.617 00:14:07.617 real 0m13.118s 00:14:07.617 user 0m29.646s 00:14:07.617 sys 0m2.957s 00:14:07.617 19:02:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:07.617 19:02:28 -- common/autotest_common.sh@10 -- # set +x 00:14:07.617 ************************************ 00:14:07.617 END TEST nvmf_delete_subsystem 00:14:07.617 ************************************ 00:14:07.617 19:02:28 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:14:07.617 19:02:28 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:14:07.617 19:02:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:07.617 19:02:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:07.617 19:02:28 -- common/autotest_common.sh@10 -- # set +x 00:14:07.617 ************************************ 00:14:07.617 START TEST nvmf_nvme_cli 00:14:07.617 ************************************ 00:14:07.617 19:02:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:14:07.878 * Looking for test storage... 00:14:07.878 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:07.878 19:02:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:07.878 19:02:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:07.878 19:02:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:07.878 19:02:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:07.878 19:02:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:07.878 19:02:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:07.878 19:02:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:07.878 19:02:28 -- scripts/common.sh@335 -- # IFS=.-: 00:14:07.878 19:02:28 -- scripts/common.sh@335 -- # read -ra ver1 00:14:07.878 19:02:28 -- scripts/common.sh@336 -- # IFS=.-: 00:14:07.878 19:02:28 -- scripts/common.sh@336 -- # read -ra ver2 00:14:07.878 19:02:28 -- scripts/common.sh@337 -- # local 'op=<' 00:14:07.878 19:02:28 -- scripts/common.sh@339 -- # ver1_l=2 00:14:07.878 19:02:28 -- scripts/common.sh@340 -- # ver2_l=1 00:14:07.878 19:02:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:07.878 19:02:28 -- scripts/common.sh@343 -- # case "$op" in 00:14:07.878 19:02:28 -- scripts/common.sh@344 -- # : 1 00:14:07.878 19:02:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:07.878 19:02:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:07.878 19:02:28 -- scripts/common.sh@364 -- # decimal 1 00:14:07.878 19:02:28 -- scripts/common.sh@352 -- # local d=1 00:14:07.878 19:02:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:07.878 19:02:28 -- scripts/common.sh@354 -- # echo 1 00:14:07.878 19:02:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:07.878 19:02:28 -- scripts/common.sh@365 -- # decimal 2 00:14:07.878 19:02:28 -- scripts/common.sh@352 -- # local d=2 00:14:07.878 19:02:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:07.878 19:02:28 -- scripts/common.sh@354 -- # echo 2 00:14:07.878 19:02:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:07.878 19:02:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:07.878 19:02:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:07.878 19:02:28 -- scripts/common.sh@367 -- # return 0 00:14:07.878 19:02:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:07.878 19:02:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:07.878 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:07.878 --rc genhtml_branch_coverage=1 00:14:07.878 --rc genhtml_function_coverage=1 00:14:07.878 --rc genhtml_legend=1 00:14:07.878 --rc geninfo_all_blocks=1 00:14:07.878 --rc geninfo_unexecuted_blocks=1 00:14:07.878 00:14:07.878 ' 00:14:07.878 19:02:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:07.878 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:07.878 --rc genhtml_branch_coverage=1 00:14:07.878 --rc genhtml_function_coverage=1 00:14:07.878 --rc genhtml_legend=1 00:14:07.878 --rc geninfo_all_blocks=1 00:14:07.878 --rc geninfo_unexecuted_blocks=1 00:14:07.878 00:14:07.878 ' 00:14:07.878 19:02:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:07.878 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:07.878 --rc genhtml_branch_coverage=1 00:14:07.878 --rc genhtml_function_coverage=1 00:14:07.878 --rc genhtml_legend=1 00:14:07.878 --rc geninfo_all_blocks=1 00:14:07.878 --rc geninfo_unexecuted_blocks=1 00:14:07.878 00:14:07.878 ' 00:14:07.878 19:02:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:07.878 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:07.878 --rc genhtml_branch_coverage=1 00:14:07.878 --rc genhtml_function_coverage=1 00:14:07.878 --rc genhtml_legend=1 00:14:07.878 --rc geninfo_all_blocks=1 00:14:07.878 --rc geninfo_unexecuted_blocks=1 00:14:07.878 00:14:07.878 ' 00:14:07.878 19:02:28 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:07.879 19:02:28 -- nvmf/common.sh@7 -- # uname -s 00:14:07.879 19:02:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:07.879 19:02:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:07.879 19:02:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:07.879 19:02:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:07.879 19:02:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:07.879 19:02:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:07.879 19:02:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:07.879 19:02:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:07.879 19:02:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:07.879 19:02:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:07.879 19:02:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:07.879 19:02:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:07.879 19:02:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:07.879 19:02:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:07.879 19:02:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:07.879 19:02:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:07.879 19:02:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:07.879 19:02:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:07.879 19:02:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:07.879 19:02:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:07.879 19:02:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:07.879 19:02:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:07.879 19:02:28 -- paths/export.sh@5 -- # export PATH 00:14:07.879 19:02:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:07.879 19:02:28 -- nvmf/common.sh@46 -- # : 0 00:14:07.879 19:02:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:07.879 19:02:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:07.879 19:02:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:07.879 19:02:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:07.879 19:02:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:07.879 19:02:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:07.879 19:02:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:07.879 19:02:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:07.879 19:02:28 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:07.879 19:02:28 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:07.879 19:02:28 -- target/nvme_cli.sh@14 -- # devs=() 00:14:07.879 19:02:28 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:14:07.879 19:02:28 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:07.879 19:02:28 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:07.879 19:02:28 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:07.879 19:02:28 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:07.879 19:02:28 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:07.879 19:02:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:07.879 19:02:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:07.879 19:02:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:07.879 19:02:28 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:07.879 19:02:28 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:07.879 19:02:28 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:07.879 19:02:28 -- common/autotest_common.sh@10 -- # set +x 00:14:09.789 19:02:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:09.789 19:02:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:09.789 19:02:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:09.789 19:02:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:09.789 19:02:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:09.789 19:02:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:09.789 19:02:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:09.789 19:02:30 -- nvmf/common.sh@294 -- # net_devs=() 00:14:09.789 19:02:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:09.789 19:02:30 -- nvmf/common.sh@295 -- # e810=() 00:14:09.789 19:02:30 -- nvmf/common.sh@295 -- # local -ga e810 00:14:09.789 19:02:30 -- nvmf/common.sh@296 -- # x722=() 00:14:09.789 19:02:30 -- nvmf/common.sh@296 -- # local -ga x722 00:14:09.789 19:02:30 -- nvmf/common.sh@297 -- # mlx=() 00:14:09.789 19:02:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:09.789 19:02:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:09.789 19:02:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:09.789 19:02:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:09.789 19:02:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:09.789 19:02:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:09.789 19:02:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:09.789 19:02:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:09.789 19:02:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:09.789 19:02:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:09.789 19:02:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:09.789 19:02:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:09.789 19:02:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:09.789 19:02:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:09.789 19:02:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:09.789 19:02:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:09.789 19:02:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:09.789 19:02:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:09.789 19:02:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:09.789 19:02:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:09.789 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:09.789 19:02:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:09.789 19:02:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:09.789 19:02:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:09.789 19:02:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:09.789 19:02:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:09.789 19:02:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:09.789 19:02:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:09.789 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:09.789 19:02:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:09.789 19:02:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:09.789 19:02:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:09.789 19:02:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:09.789 19:02:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:09.789 19:02:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:09.789 19:02:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:09.789 19:02:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:09.789 19:02:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:09.789 19:02:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:09.789 19:02:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:09.789 19:02:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:09.789 19:02:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:09.789 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:09.789 19:02:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:09.789 19:02:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:09.789 19:02:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:09.789 19:02:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:09.789 19:02:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:09.789 19:02:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:09.789 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:09.789 19:02:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:09.789 19:02:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:09.789 19:02:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:09.789 19:02:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:09.789 19:02:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:09.789 19:02:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:09.789 19:02:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:09.789 19:02:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:09.789 19:02:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:09.789 19:02:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:09.789 19:02:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:09.789 19:02:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:09.789 19:02:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:09.789 19:02:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:09.790 19:02:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:09.790 19:02:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:09.790 19:02:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:09.790 19:02:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:09.790 19:02:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:10.047 19:02:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:10.047 19:02:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:10.047 19:02:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:10.047 19:02:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:10.047 19:02:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:10.047 19:02:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:10.047 19:02:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:10.047 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:10.047 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.176 ms 00:14:10.047 00:14:10.047 --- 10.0.0.2 ping statistics --- 00:14:10.047 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:10.047 rtt min/avg/max/mdev = 0.176/0.176/0.176/0.000 ms 00:14:10.047 19:02:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:10.047 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:10.047 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.142 ms 00:14:10.047 00:14:10.047 --- 10.0.0.1 ping statistics --- 00:14:10.047 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:10.047 rtt min/avg/max/mdev = 0.142/0.142/0.142/0.000 ms 00:14:10.047 19:02:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:10.047 19:02:30 -- nvmf/common.sh@410 -- # return 0 00:14:10.047 19:02:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:10.047 19:02:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:10.047 19:02:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:10.047 19:02:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:10.047 19:02:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:10.047 19:02:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:10.047 19:02:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:10.047 19:02:30 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:14:10.047 19:02:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:10.047 19:02:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:10.047 19:02:30 -- common/autotest_common.sh@10 -- # set +x 00:14:10.047 19:02:30 -- nvmf/common.sh@469 -- # nvmfpid=178063 00:14:10.047 19:02:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:10.047 19:02:30 -- nvmf/common.sh@470 -- # waitforlisten 178063 00:14:10.047 19:02:30 -- common/autotest_common.sh@829 -- # '[' -z 178063 ']' 00:14:10.047 19:02:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:10.047 19:02:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:10.047 19:02:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:10.047 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:10.047 19:02:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:10.047 19:02:30 -- common/autotest_common.sh@10 -- # set +x 00:14:10.047 [2024-11-28 19:02:30.992655] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:10.047 [2024-11-28 19:02:30.992755] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:10.047 EAL: No free 2048 kB hugepages reported on node 1 00:14:10.047 [2024-11-28 19:02:31.062377] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:10.308 [2024-11-28 19:02:31.180783] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:10.308 [2024-11-28 19:02:31.180916] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:10.308 [2024-11-28 19:02:31.180934] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:10.308 [2024-11-28 19:02:31.180946] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:10.308 [2024-11-28 19:02:31.181021] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:10.308 [2024-11-28 19:02:31.181093] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:10.308 [2024-11-28 19:02:31.181116] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:10.308 [2024-11-28 19:02:31.181119] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:11.248 19:02:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:11.248 19:02:32 -- common/autotest_common.sh@862 -- # return 0 00:14:11.248 19:02:32 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:11.248 19:02:32 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:11.248 19:02:32 -- common/autotest_common.sh@10 -- # set +x 00:14:11.248 19:02:32 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:11.248 19:02:32 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:11.248 19:02:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:11.248 19:02:32 -- common/autotest_common.sh@10 -- # set +x 00:14:11.248 [2024-11-28 19:02:32.068192] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:11.248 19:02:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:11.248 19:02:32 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:14:11.248 19:02:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:11.248 19:02:32 -- common/autotest_common.sh@10 -- # set +x 00:14:11.248 Malloc0 00:14:11.248 19:02:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:11.248 19:02:32 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:14:11.248 19:02:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:11.248 19:02:32 -- common/autotest_common.sh@10 -- # set +x 00:14:11.248 Malloc1 00:14:11.248 19:02:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:11.248 19:02:32 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:14:11.249 19:02:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:11.249 19:02:32 -- common/autotest_common.sh@10 -- # set +x 00:14:11.249 19:02:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:11.249 19:02:32 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:11.249 19:02:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:11.249 19:02:32 -- common/autotest_common.sh@10 -- # set +x 00:14:11.249 19:02:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:11.249 19:02:32 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:11.249 19:02:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:11.249 19:02:32 -- common/autotest_common.sh@10 -- # set +x 00:14:11.249 19:02:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:11.249 19:02:32 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:11.249 19:02:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:11.249 19:02:32 -- common/autotest_common.sh@10 -- # set +x 00:14:11.249 [2024-11-28 19:02:32.154542] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:11.249 19:02:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:11.249 19:02:32 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:11.249 19:02:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:11.249 19:02:32 -- common/autotest_common.sh@10 -- # set +x 00:14:11.249 19:02:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:11.249 19:02:32 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:14:11.508 00:14:11.508 Discovery Log Number of Records 2, Generation counter 2 00:14:11.508 =====Discovery Log Entry 0====== 00:14:11.508 trtype: tcp 00:14:11.508 adrfam: ipv4 00:14:11.508 subtype: current discovery subsystem 00:14:11.508 treq: not required 00:14:11.508 portid: 0 00:14:11.508 trsvcid: 4420 00:14:11.508 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:14:11.508 traddr: 10.0.0.2 00:14:11.508 eflags: explicit discovery connections, duplicate discovery information 00:14:11.508 sectype: none 00:14:11.508 =====Discovery Log Entry 1====== 00:14:11.508 trtype: tcp 00:14:11.508 adrfam: ipv4 00:14:11.508 subtype: nvme subsystem 00:14:11.508 treq: not required 00:14:11.508 portid: 0 00:14:11.508 trsvcid: 4420 00:14:11.508 subnqn: nqn.2016-06.io.spdk:cnode1 00:14:11.508 traddr: 10.0.0.2 00:14:11.508 eflags: none 00:14:11.508 sectype: none 00:14:11.508 19:02:32 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:14:11.508 19:02:32 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:14:11.508 19:02:32 -- nvmf/common.sh@510 -- # local dev _ 00:14:11.508 19:02:32 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:11.508 19:02:32 -- nvmf/common.sh@509 -- # nvme list 00:14:11.508 19:02:32 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:11.508 19:02:32 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:11.508 19:02:32 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:11.508 19:02:32 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:11.508 19:02:32 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:14:11.508 19:02:32 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:14:12.077 19:02:32 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:14:12.077 19:02:32 -- common/autotest_common.sh@1187 -- # local i=0 00:14:12.077 19:02:32 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:14:12.077 19:02:32 -- common/autotest_common.sh@1189 -- # [[ -n 2 ]] 00:14:12.077 19:02:32 -- common/autotest_common.sh@1190 -- # nvme_device_counter=2 00:14:12.077 19:02:32 -- common/autotest_common.sh@1194 -- # sleep 2 00:14:13.991 19:02:34 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:14:13.991 19:02:34 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:14:13.991 19:02:34 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:14:13.991 19:02:34 -- common/autotest_common.sh@1196 -- # nvme_devices=2 00:14:13.991 19:02:34 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:14:13.991 19:02:34 -- common/autotest_common.sh@1197 -- # return 0 00:14:13.991 19:02:34 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:14:13.991 19:02:34 -- nvmf/common.sh@510 -- # local dev _ 00:14:13.991 19:02:34 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:13.991 19:02:34 -- nvmf/common.sh@509 -- # nvme list 00:14:14.262 19:02:35 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:14.262 19:02:35 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:14.262 19:02:35 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:14.263 19:02:35 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:14.263 19:02:35 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:14.263 19:02:35 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:14:14.263 19:02:35 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:14.263 19:02:35 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:14.263 19:02:35 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:14:14.263 19:02:35 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:14.263 19:02:35 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:14:14.263 /dev/nvme0n2 ]] 00:14:14.263 19:02:35 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:14:14.263 19:02:35 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:14:14.263 19:02:35 -- nvmf/common.sh@510 -- # local dev _ 00:14:14.263 19:02:35 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:14.263 19:02:35 -- nvmf/common.sh@509 -- # nvme list 00:14:14.263 19:02:35 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:14.263 19:02:35 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:14.263 19:02:35 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:14.263 19:02:35 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:14.263 19:02:35 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:14.263 19:02:35 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:14:14.263 19:02:35 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:14.263 19:02:35 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:14.263 19:02:35 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:14:14.263 19:02:35 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:14.263 19:02:35 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:14:14.263 19:02:35 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:14.527 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:14.527 19:02:35 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:14.527 19:02:35 -- common/autotest_common.sh@1208 -- # local i=0 00:14:14.527 19:02:35 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:14:14.527 19:02:35 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:14.527 19:02:35 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:14:14.527 19:02:35 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:14.527 19:02:35 -- common/autotest_common.sh@1220 -- # return 0 00:14:14.527 19:02:35 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:14:14.527 19:02:35 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:14.527 19:02:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:14.527 19:02:35 -- common/autotest_common.sh@10 -- # set +x 00:14:14.527 19:02:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:14.527 19:02:35 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:14.527 19:02:35 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:14:14.527 19:02:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:14.527 19:02:35 -- nvmf/common.sh@116 -- # sync 00:14:14.527 19:02:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:14.527 19:02:35 -- nvmf/common.sh@119 -- # set +e 00:14:14.527 19:02:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:14.527 19:02:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:14.527 rmmod nvme_tcp 00:14:14.527 rmmod nvme_fabrics 00:14:14.527 rmmod nvme_keyring 00:14:14.527 19:02:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:14.789 19:02:35 -- nvmf/common.sh@123 -- # set -e 00:14:14.789 19:02:35 -- nvmf/common.sh@124 -- # return 0 00:14:14.789 19:02:35 -- nvmf/common.sh@477 -- # '[' -n 178063 ']' 00:14:14.789 19:02:35 -- nvmf/common.sh@478 -- # killprocess 178063 00:14:14.789 19:02:35 -- common/autotest_common.sh@936 -- # '[' -z 178063 ']' 00:14:14.789 19:02:35 -- common/autotest_common.sh@940 -- # kill -0 178063 00:14:14.789 19:02:35 -- common/autotest_common.sh@941 -- # uname 00:14:14.789 19:02:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:14.789 19:02:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 178063 00:14:14.789 19:02:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:14.789 19:02:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:14.789 19:02:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 178063' 00:14:14.789 killing process with pid 178063 00:14:14.789 19:02:35 -- common/autotest_common.sh@955 -- # kill 178063 00:14:14.789 19:02:35 -- common/autotest_common.sh@960 -- # wait 178063 00:14:15.049 19:02:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:15.049 19:02:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:15.049 19:02:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:15.049 19:02:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:15.049 19:02:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:15.049 19:02:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:15.049 19:02:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:15.049 19:02:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:16.968 19:02:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:16.968 00:14:16.968 real 0m9.343s 00:14:16.968 user 0m19.710s 00:14:16.968 sys 0m2.248s 00:14:16.968 19:02:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:16.968 19:02:38 -- common/autotest_common.sh@10 -- # set +x 00:14:16.968 ************************************ 00:14:16.968 END TEST nvmf_nvme_cli 00:14:16.968 ************************************ 00:14:17.228 19:02:38 -- nvmf/nvmf.sh@39 -- # [[ 0 -eq 1 ]] 00:14:17.228 19:02:38 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:14:17.228 19:02:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:17.228 19:02:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:17.228 19:02:38 -- common/autotest_common.sh@10 -- # set +x 00:14:17.228 ************************************ 00:14:17.228 START TEST nvmf_host_management 00:14:17.228 ************************************ 00:14:17.228 19:02:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:14:17.228 * Looking for test storage... 00:14:17.228 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:17.228 19:02:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:17.228 19:02:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:17.228 19:02:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:17.228 19:02:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:17.228 19:02:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:17.228 19:02:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:17.228 19:02:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:17.228 19:02:38 -- scripts/common.sh@335 -- # IFS=.-: 00:14:17.228 19:02:38 -- scripts/common.sh@335 -- # read -ra ver1 00:14:17.228 19:02:38 -- scripts/common.sh@336 -- # IFS=.-: 00:14:17.228 19:02:38 -- scripts/common.sh@336 -- # read -ra ver2 00:14:17.228 19:02:38 -- scripts/common.sh@337 -- # local 'op=<' 00:14:17.228 19:02:38 -- scripts/common.sh@339 -- # ver1_l=2 00:14:17.228 19:02:38 -- scripts/common.sh@340 -- # ver2_l=1 00:14:17.228 19:02:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:17.228 19:02:38 -- scripts/common.sh@343 -- # case "$op" in 00:14:17.228 19:02:38 -- scripts/common.sh@344 -- # : 1 00:14:17.228 19:02:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:17.228 19:02:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:17.228 19:02:38 -- scripts/common.sh@364 -- # decimal 1 00:14:17.228 19:02:38 -- scripts/common.sh@352 -- # local d=1 00:14:17.228 19:02:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:17.228 19:02:38 -- scripts/common.sh@354 -- # echo 1 00:14:17.228 19:02:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:17.228 19:02:38 -- scripts/common.sh@365 -- # decimal 2 00:14:17.228 19:02:38 -- scripts/common.sh@352 -- # local d=2 00:14:17.228 19:02:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:17.228 19:02:38 -- scripts/common.sh@354 -- # echo 2 00:14:17.228 19:02:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:17.228 19:02:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:17.228 19:02:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:17.228 19:02:38 -- scripts/common.sh@367 -- # return 0 00:14:17.228 19:02:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:17.228 19:02:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:17.228 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:17.228 --rc genhtml_branch_coverage=1 00:14:17.228 --rc genhtml_function_coverage=1 00:14:17.228 --rc genhtml_legend=1 00:14:17.228 --rc geninfo_all_blocks=1 00:14:17.228 --rc geninfo_unexecuted_blocks=1 00:14:17.228 00:14:17.228 ' 00:14:17.228 19:02:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:17.228 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:17.228 --rc genhtml_branch_coverage=1 00:14:17.228 --rc genhtml_function_coverage=1 00:14:17.228 --rc genhtml_legend=1 00:14:17.228 --rc geninfo_all_blocks=1 00:14:17.228 --rc geninfo_unexecuted_blocks=1 00:14:17.228 00:14:17.228 ' 00:14:17.228 19:02:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:17.228 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:17.228 --rc genhtml_branch_coverage=1 00:14:17.228 --rc genhtml_function_coverage=1 00:14:17.228 --rc genhtml_legend=1 00:14:17.228 --rc geninfo_all_blocks=1 00:14:17.228 --rc geninfo_unexecuted_blocks=1 00:14:17.228 00:14:17.228 ' 00:14:17.228 19:02:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:17.228 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:17.228 --rc genhtml_branch_coverage=1 00:14:17.228 --rc genhtml_function_coverage=1 00:14:17.228 --rc genhtml_legend=1 00:14:17.228 --rc geninfo_all_blocks=1 00:14:17.228 --rc geninfo_unexecuted_blocks=1 00:14:17.228 00:14:17.228 ' 00:14:17.228 19:02:38 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:17.228 19:02:38 -- nvmf/common.sh@7 -- # uname -s 00:14:17.228 19:02:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:17.228 19:02:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:17.228 19:02:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:17.228 19:02:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:17.228 19:02:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:17.228 19:02:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:17.228 19:02:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:17.228 19:02:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:17.228 19:02:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:17.228 19:02:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:17.228 19:02:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:17.228 19:02:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:17.228 19:02:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:17.228 19:02:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:17.228 19:02:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:17.228 19:02:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:17.228 19:02:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:17.228 19:02:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:17.228 19:02:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:17.229 19:02:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:17.229 19:02:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:17.229 19:02:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:17.229 19:02:38 -- paths/export.sh@5 -- # export PATH 00:14:17.229 19:02:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:17.229 19:02:38 -- nvmf/common.sh@46 -- # : 0 00:14:17.229 19:02:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:17.229 19:02:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:17.229 19:02:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:17.229 19:02:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:17.229 19:02:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:17.229 19:02:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:17.229 19:02:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:17.229 19:02:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:17.229 19:02:38 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:17.229 19:02:38 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:17.229 19:02:38 -- target/host_management.sh@104 -- # nvmftestinit 00:14:17.229 19:02:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:17.229 19:02:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:17.229 19:02:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:17.229 19:02:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:17.229 19:02:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:17.229 19:02:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:17.229 19:02:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:17.229 19:02:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:17.229 19:02:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:17.229 19:02:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:17.229 19:02:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:17.229 19:02:38 -- common/autotest_common.sh@10 -- # set +x 00:14:19.142 19:02:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:19.142 19:02:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:19.142 19:02:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:19.142 19:02:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:19.142 19:02:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:19.142 19:02:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:19.142 19:02:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:19.142 19:02:40 -- nvmf/common.sh@294 -- # net_devs=() 00:14:19.142 19:02:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:19.142 19:02:40 -- nvmf/common.sh@295 -- # e810=() 00:14:19.142 19:02:40 -- nvmf/common.sh@295 -- # local -ga e810 00:14:19.142 19:02:40 -- nvmf/common.sh@296 -- # x722=() 00:14:19.142 19:02:40 -- nvmf/common.sh@296 -- # local -ga x722 00:14:19.142 19:02:40 -- nvmf/common.sh@297 -- # mlx=() 00:14:19.142 19:02:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:19.142 19:02:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:19.142 19:02:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:19.142 19:02:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:19.142 19:02:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:19.142 19:02:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:19.142 19:02:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:19.142 19:02:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:19.142 19:02:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:19.142 19:02:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:19.142 19:02:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:19.142 19:02:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:19.142 19:02:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:19.142 19:02:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:19.142 19:02:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:19.142 19:02:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:19.142 19:02:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:19.142 19:02:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:19.142 19:02:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:19.142 19:02:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:19.142 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:19.142 19:02:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:19.142 19:02:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:19.142 19:02:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:19.142 19:02:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:19.142 19:02:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:19.142 19:02:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:19.142 19:02:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:19.142 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:19.142 19:02:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:19.142 19:02:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:19.142 19:02:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:19.142 19:02:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:19.142 19:02:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:19.142 19:02:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:19.142 19:02:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:19.142 19:02:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:19.142 19:02:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:19.142 19:02:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:19.142 19:02:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:19.142 19:02:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:19.142 19:02:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:19.142 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:19.142 19:02:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:19.142 19:02:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:19.142 19:02:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:19.142 19:02:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:19.142 19:02:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:19.142 19:02:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:19.142 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:19.142 19:02:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:19.142 19:02:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:19.142 19:02:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:19.142 19:02:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:19.142 19:02:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:19.142 19:02:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:19.142 19:02:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:19.142 19:02:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:19.142 19:02:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:19.142 19:02:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:19.142 19:02:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:19.142 19:02:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:19.142 19:02:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:19.142 19:02:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:19.142 19:02:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:19.142 19:02:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:19.142 19:02:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:19.142 19:02:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:19.142 19:02:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:19.406 19:02:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:19.406 19:02:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:19.406 19:02:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:19.406 19:02:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:19.406 19:02:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:19.406 19:02:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:19.406 19:02:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:19.406 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:19.406 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.254 ms 00:14:19.406 00:14:19.406 --- 10.0.0.2 ping statistics --- 00:14:19.406 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:19.406 rtt min/avg/max/mdev = 0.254/0.254/0.254/0.000 ms 00:14:19.406 19:02:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:19.406 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:19.406 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.140 ms 00:14:19.406 00:14:19.406 --- 10.0.0.1 ping statistics --- 00:14:19.406 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:19.406 rtt min/avg/max/mdev = 0.140/0.140/0.140/0.000 ms 00:14:19.406 19:02:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:19.406 19:02:40 -- nvmf/common.sh@410 -- # return 0 00:14:19.406 19:02:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:19.406 19:02:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:19.406 19:02:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:19.406 19:02:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:19.406 19:02:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:19.406 19:02:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:19.406 19:02:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:19.406 19:02:40 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:14:19.406 19:02:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:14:19.406 19:02:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:19.406 19:02:40 -- common/autotest_common.sh@10 -- # set +x 00:14:19.406 ************************************ 00:14:19.406 START TEST nvmf_host_management 00:14:19.406 ************************************ 00:14:19.406 19:02:40 -- common/autotest_common.sh@1114 -- # nvmf_host_management 00:14:19.406 19:02:40 -- target/host_management.sh@69 -- # starttarget 00:14:19.406 19:02:40 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:14:19.406 19:02:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:19.406 19:02:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:19.406 19:02:40 -- common/autotest_common.sh@10 -- # set +x 00:14:19.406 19:02:40 -- nvmf/common.sh@469 -- # nvmfpid=180608 00:14:19.406 19:02:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:14:19.406 19:02:40 -- nvmf/common.sh@470 -- # waitforlisten 180608 00:14:19.406 19:02:40 -- common/autotest_common.sh@829 -- # '[' -z 180608 ']' 00:14:19.406 19:02:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:19.406 19:02:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:19.406 19:02:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:19.406 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:19.406 19:02:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:19.406 19:02:40 -- common/autotest_common.sh@10 -- # set +x 00:14:19.406 [2024-11-28 19:02:40.328006] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:19.406 [2024-11-28 19:02:40.328070] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:19.406 EAL: No free 2048 kB hugepages reported on node 1 00:14:19.406 [2024-11-28 19:02:40.397010] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:19.666 [2024-11-28 19:02:40.518857] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:19.666 [2024-11-28 19:02:40.519026] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:19.666 [2024-11-28 19:02:40.519044] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:19.666 [2024-11-28 19:02:40.519057] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:19.666 [2024-11-28 19:02:40.519119] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:19.666 [2024-11-28 19:02:40.519189] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:19.666 [2024-11-28 19:02:40.519250] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:14:19.666 [2024-11-28 19:02:40.519253] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:20.604 19:02:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:20.604 19:02:41 -- common/autotest_common.sh@862 -- # return 0 00:14:20.604 19:02:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:20.604 19:02:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:20.604 19:02:41 -- common/autotest_common.sh@10 -- # set +x 00:14:20.604 19:02:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:20.604 19:02:41 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:20.604 19:02:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:20.604 19:02:41 -- common/autotest_common.sh@10 -- # set +x 00:14:20.604 [2024-11-28 19:02:41.371058] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:20.604 19:02:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:20.604 19:02:41 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:14:20.604 19:02:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:20.604 19:02:41 -- common/autotest_common.sh@10 -- # set +x 00:14:20.604 19:02:41 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:14:20.604 19:02:41 -- target/host_management.sh@23 -- # cat 00:14:20.604 19:02:41 -- target/host_management.sh@30 -- # rpc_cmd 00:14:20.604 19:02:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:20.604 19:02:41 -- common/autotest_common.sh@10 -- # set +x 00:14:20.604 Malloc0 00:14:20.604 [2024-11-28 19:02:41.436153] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:20.604 19:02:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:20.604 19:02:41 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:14:20.604 19:02:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:20.604 19:02:41 -- common/autotest_common.sh@10 -- # set +x 00:14:20.604 19:02:41 -- target/host_management.sh@73 -- # perfpid=180792 00:14:20.604 19:02:41 -- target/host_management.sh@74 -- # waitforlisten 180792 /var/tmp/bdevperf.sock 00:14:20.604 19:02:41 -- common/autotest_common.sh@829 -- # '[' -z 180792 ']' 00:14:20.604 19:02:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:20.604 19:02:41 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:14:20.604 19:02:41 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:14:20.604 19:02:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:20.604 19:02:41 -- nvmf/common.sh@520 -- # config=() 00:14:20.604 19:02:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:20.604 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:20.604 19:02:41 -- nvmf/common.sh@520 -- # local subsystem config 00:14:20.604 19:02:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:20.604 19:02:41 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:20.604 19:02:41 -- common/autotest_common.sh@10 -- # set +x 00:14:20.604 19:02:41 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:20.604 { 00:14:20.604 "params": { 00:14:20.604 "name": "Nvme$subsystem", 00:14:20.604 "trtype": "$TEST_TRANSPORT", 00:14:20.604 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:20.604 "adrfam": "ipv4", 00:14:20.604 "trsvcid": "$NVMF_PORT", 00:14:20.604 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:20.604 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:20.604 "hdgst": ${hdgst:-false}, 00:14:20.604 "ddgst": ${ddgst:-false} 00:14:20.604 }, 00:14:20.604 "method": "bdev_nvme_attach_controller" 00:14:20.604 } 00:14:20.604 EOF 00:14:20.604 )") 00:14:20.604 19:02:41 -- nvmf/common.sh@542 -- # cat 00:14:20.604 19:02:41 -- nvmf/common.sh@544 -- # jq . 00:14:20.604 19:02:41 -- nvmf/common.sh@545 -- # IFS=, 00:14:20.604 19:02:41 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:20.604 "params": { 00:14:20.604 "name": "Nvme0", 00:14:20.604 "trtype": "tcp", 00:14:20.604 "traddr": "10.0.0.2", 00:14:20.604 "adrfam": "ipv4", 00:14:20.604 "trsvcid": "4420", 00:14:20.604 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:20.604 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:14:20.604 "hdgst": false, 00:14:20.604 "ddgst": false 00:14:20.604 }, 00:14:20.604 "method": "bdev_nvme_attach_controller" 00:14:20.604 }' 00:14:20.604 [2024-11-28 19:02:41.510311] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:20.604 [2024-11-28 19:02:41.510380] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid180792 ] 00:14:20.604 EAL: No free 2048 kB hugepages reported on node 1 00:14:20.604 [2024-11-28 19:02:41.571970] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:20.863 [2024-11-28 19:02:41.680588] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:20.863 Running I/O for 10 seconds... 00:14:21.806 19:02:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:21.806 19:02:42 -- common/autotest_common.sh@862 -- # return 0 00:14:21.806 19:02:42 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:14:21.806 19:02:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:21.806 19:02:42 -- common/autotest_common.sh@10 -- # set +x 00:14:21.806 19:02:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:21.806 19:02:42 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:21.806 19:02:42 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:14:21.806 19:02:42 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:14:21.806 19:02:42 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:14:21.806 19:02:42 -- target/host_management.sh@52 -- # local ret=1 00:14:21.806 19:02:42 -- target/host_management.sh@53 -- # local i 00:14:21.806 19:02:42 -- target/host_management.sh@54 -- # (( i = 10 )) 00:14:21.806 19:02:42 -- target/host_management.sh@54 -- # (( i != 0 )) 00:14:21.806 19:02:42 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:14:21.806 19:02:42 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:14:21.806 19:02:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:21.806 19:02:42 -- common/autotest_common.sh@10 -- # set +x 00:14:21.806 19:02:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:21.806 19:02:42 -- target/host_management.sh@55 -- # read_io_count=2463 00:14:21.806 19:02:42 -- target/host_management.sh@58 -- # '[' 2463 -ge 100 ']' 00:14:21.806 19:02:42 -- target/host_management.sh@59 -- # ret=0 00:14:21.806 19:02:42 -- target/host_management.sh@60 -- # break 00:14:21.806 19:02:42 -- target/host_management.sh@64 -- # return 0 00:14:21.806 19:02:42 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:14:21.806 19:02:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:21.806 19:02:42 -- common/autotest_common.sh@10 -- # set +x 00:14:21.806 [2024-11-28 19:02:42.535999] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x207fe60 is same with the state(5) to be set 00:14:21.806 [2024-11-28 19:02:42.536101] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x207fe60 is same with the state(5) to be set 00:14:21.806 [2024-11-28 19:02:42.536118] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x207fe60 is same with the state(5) to be set 00:14:21.806 [2024-11-28 19:02:42.536131] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x207fe60 is same with the state(5) to be set 00:14:21.806 [2024-11-28 19:02:42.536143] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x207fe60 is same with the state(5) to be set 00:14:21.806 [2024-11-28 19:02:42.536156] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x207fe60 is same with the state(5) to be set 00:14:21.806 [2024-11-28 19:02:42.536168] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x207fe60 is same with the state(5) to be set 00:14:21.806 [2024-11-28 19:02:42.536181] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x207fe60 is same with the state(5) to be set 00:14:21.806 [2024-11-28 19:02:42.536193] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x207fe60 is same with the state(5) to be set 00:14:21.806 [2024-11-28 19:02:42.536205] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x207fe60 is same with the state(5) to be set 00:14:21.806 [2024-11-28 19:02:42.536217] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x207fe60 is same with the state(5) to be set 00:14:21.806 [2024-11-28 19:02:42.536229] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x207fe60 is same with the state(5) to be set 00:14:21.806 [2024-11-28 19:02:42.536241] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x207fe60 is same with the state(5) to be set 00:14:21.806 [2024-11-28 19:02:42.536253] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x207fe60 is same with the state(5) to be set 00:14:21.806 [2024-11-28 19:02:42.536265] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x207fe60 is same with the state(5) to be set 00:14:21.806 [2024-11-28 19:02:42.536277] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x207fe60 is same with the state(5) to be set 00:14:21.806 [2024-11-28 19:02:42.536290] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x207fe60 is same with the state(5) to be set 00:14:21.806 [2024-11-28 19:02:42.536302] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x207fe60 is same with the state(5) to be set 00:14:21.806 [2024-11-28 19:02:42.536314] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x207fe60 is same with the state(5) to be set 00:14:21.806 [2024-11-28 19:02:42.536336] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x207fe60 is same with the state(5) to be set 00:14:21.806 [2024-11-28 19:02:42.536348] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x207fe60 is same with the state(5) to be set 00:14:21.806 [2024-11-28 19:02:42.536361] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x207fe60 is same with the state(5) to be set 00:14:21.806 [2024-11-28 19:02:42.536373] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x207fe60 is same with the state(5) to be set 00:14:21.806 [2024-11-28 19:02:42.536388] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x207fe60 is same with the state(5) to be set 00:14:21.806 [2024-11-28 19:02:42.536411] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x207fe60 is same with the state(5) to be set 00:14:21.806 [2024-11-28 19:02:42.536424] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x207fe60 is same with the state(5) to be set 00:14:21.806 [2024-11-28 19:02:42.536437] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x207fe60 is same with the state(5) to be set 00:14:21.806 [2024-11-28 19:02:42.536449] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x207fe60 is same with the state(5) to be set 00:14:21.806 [2024-11-28 19:02:42.536461] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x207fe60 is same with the state(5) to be set 00:14:21.806 [2024-11-28 19:02:42.536473] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x207fe60 is same with the state(5) to be set 00:14:21.806 [2024-11-28 19:02:42.536484] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x207fe60 is same with the state(5) to be set 00:14:21.806 [2024-11-28 19:02:42.536496] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x207fe60 is same with the state(5) to be set 00:14:21.806 [2024-11-28 19:02:42.536514] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x207fe60 is same with the state(5) to be set 00:14:21.806 [2024-11-28 19:02:42.536527] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x207fe60 is same with the state(5) to be set 00:14:21.806 [2024-11-28 19:02:42.536539] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x207fe60 is same with the state(5) to be set 00:14:21.806 [2024-11-28 19:02:42.537898] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:14:21.806 [2024-11-28 19:02:42.537939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.806 [2024-11-28 19:02:42.537957] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:14:21.806 [2024-11-28 19:02:42.537971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.806 [2024-11-28 19:02:42.537985] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:14:21.806 [2024-11-28 19:02:42.537998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.806 [2024-11-28 19:02:42.538012] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:14:21.806 [2024-11-28 19:02:42.538025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.806 [2024-11-28 19:02:42.538038] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xce6160 is same with the state(5) to be set 00:14:21.806 [2024-11-28 19:02:42.538098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:69504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.806 [2024-11-28 19:02:42.538125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.806 [2024-11-28 19:02:42.538149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:69760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.806 [2024-11-28 19:02:42.538164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.806 [2024-11-28 19:02:42.538180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:70912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.806 [2024-11-28 19:02:42.538194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.806 [2024-11-28 19:02:42.538209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:71424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.806 [2024-11-28 19:02:42.538223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.806 [2024-11-28 19:02:42.538238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:71808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.806 [2024-11-28 19:02:42.538251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.806 [2024-11-28 19:02:42.538266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:71936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.806 [2024-11-28 19:02:42.538280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.806 [2024-11-28 19:02:42.538295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:72064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.806 [2024-11-28 19:02:42.538308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.806 [2024-11-28 19:02:42.538323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:72448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.538336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.538351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:72704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.538365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.538390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:72960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.538413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.538428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:73088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.538442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.538458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:73216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.538472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.538487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:73344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.538500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.538520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:73472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.538534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.538549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:65408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.538562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.538577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:65920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.538590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.538605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:66048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.538618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.538633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:73728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.538646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.538661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:73856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.538684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.538704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:73984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.538719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.538734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:66432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.538747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.538762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:66560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.538775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.538790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:66816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.538803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.538818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:67072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.538831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.538846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:68096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.538859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.538874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:68224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.538891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.538907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:74112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.538920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.538935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:74240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.538948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.538963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:74368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.538976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.538991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:74496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.539005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.539019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:74624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.539033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.539047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:74752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.539061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.539075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:74880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.539088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.539103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:75008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.539116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.539131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:75136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.539145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.539164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:75264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.539178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.539193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:75392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.539206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.539221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:68352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.539234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.539252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:68480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.539267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.539282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:75520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.539296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.539311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:75648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.539324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.539339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:75776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.539351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.539367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:75904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.539385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.539408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:76032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.539422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.539437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:76160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.539451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.539466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:76288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.539479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.807 [2024-11-28 19:02:42.539493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:68608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.807 [2024-11-28 19:02:42.539506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.808 [2024-11-28 19:02:42.539522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:68736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.808 [2024-11-28 19:02:42.539535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.808 [2024-11-28 19:02:42.539551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:68992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.808 [2024-11-28 19:02:42.539563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.808 [2024-11-28 19:02:42.539578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:76416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.808 [2024-11-28 19:02:42.539592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.808 [2024-11-28 19:02:42.539607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:76544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.808 [2024-11-28 19:02:42.539625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.808 [2024-11-28 19:02:42.539645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:76672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.808 [2024-11-28 19:02:42.539659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.808 [2024-11-28 19:02:42.539673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:76800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.808 [2024-11-28 19:02:42.539687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.808 [2024-11-28 19:02:42.539702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:76928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.808 [2024-11-28 19:02:42.539715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.808 [2024-11-28 19:02:42.539730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:77056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.808 [2024-11-28 19:02:42.539750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.808 [2024-11-28 19:02:42.539765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:77184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.808 [2024-11-28 19:02:42.539778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.808 [2024-11-28 19:02:42.539793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:77312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.808 [2024-11-28 19:02:42.539806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.808 [2024-11-28 19:02:42.539821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:77440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.808 [2024-11-28 19:02:42.539835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.808 [2024-11-28 19:02:42.539850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:77568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.808 [2024-11-28 19:02:42.539863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.808 [2024-11-28 19:02:42.539878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:77696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.808 [2024-11-28 19:02:42.539891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.808 [2024-11-28 19:02:42.539906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:69120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.808 [2024-11-28 19:02:42.539920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.808 [2024-11-28 19:02:42.539934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:69248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.808 [2024-11-28 19:02:42.539948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.808 [2024-11-28 19:02:42.539963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:77824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.808 [2024-11-28 19:02:42.539976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.808 [2024-11-28 19:02:42.539991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:77952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:14:21.808 [2024-11-28 19:02:42.540008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:14:21.808 [2024-11-28 19:02:42.540091] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xce4030 was disconnected and freed. reset controller. 00:14:21.808 19:02:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:21.808 19:02:42 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:14:21.808 19:02:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:21.808 19:02:42 -- common/autotest_common.sh@10 -- # set +x 00:14:21.808 [2024-11-28 19:02:42.541230] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:14:21.808 task offset: 69504 on job bdev=Nvme0n1 fails 00:14:21.808 00:14:21.808 Latency(us) 00:14:21.808 [2024-11-28T18:02:42.856Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:21.808 [2024-11-28T18:02:42.856Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:14:21.808 [2024-11-28T18:02:42.856Z] Job: Nvme0n1 ended in about 0.68 seconds with error 00:14:21.808 Verification LBA range: start 0x0 length 0x400 00:14:21.808 Nvme0n1 : 0.68 3820.25 238.77 94.25 0.00 16111.19 2560.76 22913.33 00:14:21.808 [2024-11-28T18:02:42.856Z] =================================================================================================================== 00:14:21.808 [2024-11-28T18:02:42.856Z] Total : 3820.25 238.77 94.25 0.00 16111.19 2560.76 22913.33 00:14:21.808 [2024-11-28 19:02:42.543125] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:14:21.808 [2024-11-28 19:02:42.543179] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xce6160 (9): Bad file descriptor 00:14:21.808 19:02:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:21.808 19:02:42 -- target/host_management.sh@87 -- # sleep 1 00:14:21.808 [2024-11-28 19:02:42.592564] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:14:22.750 19:02:43 -- target/host_management.sh@91 -- # kill -9 180792 00:14:22.750 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (180792) - No such process 00:14:22.750 19:02:43 -- target/host_management.sh@91 -- # true 00:14:22.750 19:02:43 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:14:22.750 19:02:43 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:14:22.750 19:02:43 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:14:22.750 19:02:43 -- nvmf/common.sh@520 -- # config=() 00:14:22.750 19:02:43 -- nvmf/common.sh@520 -- # local subsystem config 00:14:22.750 19:02:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:14:22.750 19:02:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:14:22.750 { 00:14:22.750 "params": { 00:14:22.750 "name": "Nvme$subsystem", 00:14:22.750 "trtype": "$TEST_TRANSPORT", 00:14:22.750 "traddr": "$NVMF_FIRST_TARGET_IP", 00:14:22.750 "adrfam": "ipv4", 00:14:22.750 "trsvcid": "$NVMF_PORT", 00:14:22.750 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:14:22.750 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:14:22.750 "hdgst": ${hdgst:-false}, 00:14:22.750 "ddgst": ${ddgst:-false} 00:14:22.750 }, 00:14:22.750 "method": "bdev_nvme_attach_controller" 00:14:22.750 } 00:14:22.750 EOF 00:14:22.750 )") 00:14:22.750 19:02:43 -- nvmf/common.sh@542 -- # cat 00:14:22.750 19:02:43 -- nvmf/common.sh@544 -- # jq . 00:14:22.750 19:02:43 -- nvmf/common.sh@545 -- # IFS=, 00:14:22.750 19:02:43 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:14:22.750 "params": { 00:14:22.750 "name": "Nvme0", 00:14:22.750 "trtype": "tcp", 00:14:22.750 "traddr": "10.0.0.2", 00:14:22.750 "adrfam": "ipv4", 00:14:22.750 "trsvcid": "4420", 00:14:22.750 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:22.750 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:14:22.750 "hdgst": false, 00:14:22.750 "ddgst": false 00:14:22.750 }, 00:14:22.750 "method": "bdev_nvme_attach_controller" 00:14:22.750 }' 00:14:22.750 [2024-11-28 19:02:43.593891] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:22.750 [2024-11-28 19:02:43.593965] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid181075 ] 00:14:22.750 EAL: No free 2048 kB hugepages reported on node 1 00:14:22.750 [2024-11-28 19:02:43.656182] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:22.750 [2024-11-28 19:02:43.763904] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:23.009 Running I/O for 1 seconds... 00:14:23.953 00:14:23.953 Latency(us) 00:14:23.953 [2024-11-28T18:02:45.001Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:23.953 [2024-11-28T18:02:45.001Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:14:23.953 Verification LBA range: start 0x0 length 0x400 00:14:23.953 Nvme0n1 : 1.05 3934.29 245.89 0.00 0.00 15423.65 2633.58 43108.12 00:14:23.953 [2024-11-28T18:02:45.001Z] =================================================================================================================== 00:14:23.953 [2024-11-28T18:02:45.001Z] Total : 3934.29 245.89 0.00 0.00 15423.65 2633.58 43108.12 00:14:24.214 19:02:45 -- target/host_management.sh@101 -- # stoptarget 00:14:24.214 19:02:45 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:14:24.214 19:02:45 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:14:24.214 19:02:45 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:14:24.214 19:02:45 -- target/host_management.sh@40 -- # nvmftestfini 00:14:24.214 19:02:45 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:24.214 19:02:45 -- nvmf/common.sh@116 -- # sync 00:14:24.473 19:02:45 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:24.473 19:02:45 -- nvmf/common.sh@119 -- # set +e 00:14:24.473 19:02:45 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:24.473 19:02:45 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:24.473 rmmod nvme_tcp 00:14:24.473 rmmod nvme_fabrics 00:14:24.473 rmmod nvme_keyring 00:14:24.473 19:02:45 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:24.473 19:02:45 -- nvmf/common.sh@123 -- # set -e 00:14:24.473 19:02:45 -- nvmf/common.sh@124 -- # return 0 00:14:24.473 19:02:45 -- nvmf/common.sh@477 -- # '[' -n 180608 ']' 00:14:24.473 19:02:45 -- nvmf/common.sh@478 -- # killprocess 180608 00:14:24.473 19:02:45 -- common/autotest_common.sh@936 -- # '[' -z 180608 ']' 00:14:24.473 19:02:45 -- common/autotest_common.sh@940 -- # kill -0 180608 00:14:24.473 19:02:45 -- common/autotest_common.sh@941 -- # uname 00:14:24.473 19:02:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:24.473 19:02:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 180608 00:14:24.473 19:02:45 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:24.473 19:02:45 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:24.473 19:02:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 180608' 00:14:24.473 killing process with pid 180608 00:14:24.473 19:02:45 -- common/autotest_common.sh@955 -- # kill 180608 00:14:24.473 19:02:45 -- common/autotest_common.sh@960 -- # wait 180608 00:14:24.732 [2024-11-28 19:02:45.600947] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:14:24.732 19:02:45 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:24.732 19:02:45 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:24.732 19:02:45 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:24.732 19:02:45 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:24.732 19:02:45 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:24.733 19:02:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:24.733 19:02:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:24.733 19:02:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:26.646 19:02:47 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:26.646 00:14:26.646 real 0m7.389s 00:14:26.646 user 0m23.116s 00:14:26.646 sys 0m1.338s 00:14:26.646 19:02:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:26.646 19:02:47 -- common/autotest_common.sh@10 -- # set +x 00:14:26.646 ************************************ 00:14:26.646 END TEST nvmf_host_management 00:14:26.646 ************************************ 00:14:26.646 19:02:47 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:14:26.646 00:14:26.646 real 0m9.656s 00:14:26.646 user 0m23.985s 00:14:26.646 sys 0m2.758s 00:14:26.646 19:02:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:26.646 19:02:47 -- common/autotest_common.sh@10 -- # set +x 00:14:26.646 ************************************ 00:14:26.646 END TEST nvmf_host_management 00:14:26.646 ************************************ 00:14:26.908 19:02:47 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:14:26.908 19:02:47 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:26.908 19:02:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:26.908 19:02:47 -- common/autotest_common.sh@10 -- # set +x 00:14:26.908 ************************************ 00:14:26.908 START TEST nvmf_lvol 00:14:26.908 ************************************ 00:14:26.908 19:02:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:14:26.908 * Looking for test storage... 00:14:26.908 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:26.908 19:02:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:26.908 19:02:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:26.908 19:02:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:26.908 19:02:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:26.908 19:02:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:26.908 19:02:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:26.908 19:02:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:26.908 19:02:47 -- scripts/common.sh@335 -- # IFS=.-: 00:14:26.908 19:02:47 -- scripts/common.sh@335 -- # read -ra ver1 00:14:26.908 19:02:47 -- scripts/common.sh@336 -- # IFS=.-: 00:14:26.908 19:02:47 -- scripts/common.sh@336 -- # read -ra ver2 00:14:26.908 19:02:47 -- scripts/common.sh@337 -- # local 'op=<' 00:14:26.908 19:02:47 -- scripts/common.sh@339 -- # ver1_l=2 00:14:26.908 19:02:47 -- scripts/common.sh@340 -- # ver2_l=1 00:14:26.908 19:02:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:26.908 19:02:47 -- scripts/common.sh@343 -- # case "$op" in 00:14:26.908 19:02:47 -- scripts/common.sh@344 -- # : 1 00:14:26.908 19:02:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:26.908 19:02:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:26.908 19:02:47 -- scripts/common.sh@364 -- # decimal 1 00:14:26.908 19:02:47 -- scripts/common.sh@352 -- # local d=1 00:14:26.908 19:02:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:26.908 19:02:47 -- scripts/common.sh@354 -- # echo 1 00:14:26.908 19:02:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:26.908 19:02:47 -- scripts/common.sh@365 -- # decimal 2 00:14:26.908 19:02:47 -- scripts/common.sh@352 -- # local d=2 00:14:26.908 19:02:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:26.909 19:02:47 -- scripts/common.sh@354 -- # echo 2 00:14:26.909 19:02:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:26.909 19:02:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:26.909 19:02:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:26.909 19:02:47 -- scripts/common.sh@367 -- # return 0 00:14:26.909 19:02:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:26.909 19:02:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:26.909 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:26.909 --rc genhtml_branch_coverage=1 00:14:26.909 --rc genhtml_function_coverage=1 00:14:26.909 --rc genhtml_legend=1 00:14:26.909 --rc geninfo_all_blocks=1 00:14:26.909 --rc geninfo_unexecuted_blocks=1 00:14:26.909 00:14:26.909 ' 00:14:26.909 19:02:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:26.909 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:26.909 --rc genhtml_branch_coverage=1 00:14:26.909 --rc genhtml_function_coverage=1 00:14:26.909 --rc genhtml_legend=1 00:14:26.909 --rc geninfo_all_blocks=1 00:14:26.909 --rc geninfo_unexecuted_blocks=1 00:14:26.909 00:14:26.909 ' 00:14:26.909 19:02:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:26.909 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:26.909 --rc genhtml_branch_coverage=1 00:14:26.909 --rc genhtml_function_coverage=1 00:14:26.909 --rc genhtml_legend=1 00:14:26.909 --rc geninfo_all_blocks=1 00:14:26.909 --rc geninfo_unexecuted_blocks=1 00:14:26.909 00:14:26.909 ' 00:14:26.909 19:02:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:26.909 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:26.909 --rc genhtml_branch_coverage=1 00:14:26.909 --rc genhtml_function_coverage=1 00:14:26.909 --rc genhtml_legend=1 00:14:26.909 --rc geninfo_all_blocks=1 00:14:26.909 --rc geninfo_unexecuted_blocks=1 00:14:26.909 00:14:26.909 ' 00:14:26.909 19:02:47 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:26.909 19:02:47 -- nvmf/common.sh@7 -- # uname -s 00:14:26.909 19:02:47 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:26.909 19:02:47 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:26.909 19:02:47 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:26.909 19:02:47 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:26.909 19:02:47 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:26.909 19:02:47 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:26.909 19:02:47 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:26.909 19:02:47 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:26.909 19:02:47 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:26.909 19:02:47 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:26.909 19:02:47 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:26.909 19:02:47 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:26.909 19:02:47 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:26.909 19:02:47 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:26.909 19:02:47 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:26.909 19:02:47 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:26.909 19:02:47 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:26.909 19:02:47 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:26.909 19:02:47 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:26.909 19:02:47 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:26.909 19:02:47 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:26.909 19:02:47 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:26.909 19:02:47 -- paths/export.sh@5 -- # export PATH 00:14:26.909 19:02:47 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:26.909 19:02:47 -- nvmf/common.sh@46 -- # : 0 00:14:26.909 19:02:47 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:26.909 19:02:47 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:26.909 19:02:47 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:26.909 19:02:47 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:26.909 19:02:47 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:26.909 19:02:47 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:26.909 19:02:47 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:26.909 19:02:47 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:26.909 19:02:47 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:26.909 19:02:47 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:26.909 19:02:47 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:14:26.909 19:02:47 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:14:26.909 19:02:47 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:26.909 19:02:47 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:14:26.909 19:02:47 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:26.909 19:02:47 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:26.909 19:02:47 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:26.909 19:02:47 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:26.909 19:02:47 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:26.909 19:02:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:26.909 19:02:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:26.909 19:02:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:26.909 19:02:47 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:26.909 19:02:47 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:26.909 19:02:47 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:26.909 19:02:47 -- common/autotest_common.sh@10 -- # set +x 00:14:29.458 19:02:49 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:29.458 19:02:49 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:29.458 19:02:49 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:29.458 19:02:49 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:29.458 19:02:49 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:29.458 19:02:49 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:29.458 19:02:49 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:29.458 19:02:49 -- nvmf/common.sh@294 -- # net_devs=() 00:14:29.458 19:02:49 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:29.458 19:02:49 -- nvmf/common.sh@295 -- # e810=() 00:14:29.458 19:02:49 -- nvmf/common.sh@295 -- # local -ga e810 00:14:29.458 19:02:49 -- nvmf/common.sh@296 -- # x722=() 00:14:29.458 19:02:49 -- nvmf/common.sh@296 -- # local -ga x722 00:14:29.458 19:02:49 -- nvmf/common.sh@297 -- # mlx=() 00:14:29.458 19:02:49 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:29.458 19:02:49 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:29.458 19:02:49 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:29.458 19:02:49 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:29.458 19:02:49 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:29.458 19:02:49 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:29.458 19:02:49 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:29.458 19:02:49 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:29.458 19:02:49 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:29.458 19:02:49 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:29.458 19:02:49 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:29.458 19:02:49 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:29.458 19:02:49 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:29.458 19:02:49 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:29.458 19:02:49 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:29.458 19:02:49 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:29.458 19:02:49 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:29.458 19:02:49 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:29.458 19:02:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:29.458 19:02:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:29.458 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:29.458 19:02:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:29.458 19:02:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:29.458 19:02:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:29.458 19:02:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:29.458 19:02:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:29.458 19:02:49 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:29.458 19:02:49 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:29.458 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:29.458 19:02:49 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:29.458 19:02:49 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:29.458 19:02:49 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:29.458 19:02:49 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:29.458 19:02:49 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:29.458 19:02:49 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:29.458 19:02:49 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:29.458 19:02:49 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:29.458 19:02:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:29.458 19:02:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:29.458 19:02:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:29.458 19:02:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:29.458 19:02:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:29.458 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:29.458 19:02:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:29.458 19:02:49 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:29.458 19:02:49 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:29.458 19:02:49 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:29.458 19:02:49 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:29.458 19:02:49 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:29.458 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:29.458 19:02:49 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:29.458 19:02:49 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:29.458 19:02:49 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:29.458 19:02:49 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:29.458 19:02:49 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:29.458 19:02:49 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:29.458 19:02:49 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:29.458 19:02:49 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:29.458 19:02:49 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:29.458 19:02:49 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:29.458 19:02:49 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:29.458 19:02:49 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:29.458 19:02:49 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:29.458 19:02:49 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:29.458 19:02:49 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:29.458 19:02:49 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:29.458 19:02:49 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:29.458 19:02:49 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:29.458 19:02:49 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:29.459 19:02:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:29.459 19:02:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:29.459 19:02:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:29.459 19:02:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:29.459 19:02:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:29.459 19:02:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:29.459 19:02:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:29.459 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:29.459 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.216 ms 00:14:29.459 00:14:29.459 --- 10.0.0.2 ping statistics --- 00:14:29.459 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:29.459 rtt min/avg/max/mdev = 0.216/0.216/0.216/0.000 ms 00:14:29.459 19:02:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:29.459 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:29.459 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.102 ms 00:14:29.459 00:14:29.459 --- 10.0.0.1 ping statistics --- 00:14:29.459 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:29.459 rtt min/avg/max/mdev = 0.102/0.102/0.102/0.000 ms 00:14:29.459 19:02:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:29.459 19:02:50 -- nvmf/common.sh@410 -- # return 0 00:14:29.459 19:02:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:29.459 19:02:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:29.459 19:02:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:29.459 19:02:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:29.459 19:02:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:29.459 19:02:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:29.459 19:02:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:29.459 19:02:50 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:14:29.459 19:02:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:29.459 19:02:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:29.459 19:02:50 -- common/autotest_common.sh@10 -- # set +x 00:14:29.459 19:02:50 -- nvmf/common.sh@469 -- # nvmfpid=183312 00:14:29.459 19:02:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:14:29.459 19:02:50 -- nvmf/common.sh@470 -- # waitforlisten 183312 00:14:29.459 19:02:50 -- common/autotest_common.sh@829 -- # '[' -z 183312 ']' 00:14:29.459 19:02:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:29.459 19:02:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:29.459 19:02:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:29.459 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:29.459 19:02:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:29.459 19:02:50 -- common/autotest_common.sh@10 -- # set +x 00:14:29.459 [2024-11-28 19:02:50.257418] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:29.459 [2024-11-28 19:02:50.257502] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:29.459 EAL: No free 2048 kB hugepages reported on node 1 00:14:29.459 [2024-11-28 19:02:50.326711] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:29.459 [2024-11-28 19:02:50.440846] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:29.459 [2024-11-28 19:02:50.441009] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:29.459 [2024-11-28 19:02:50.441026] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:29.459 [2024-11-28 19:02:50.441039] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:29.459 [2024-11-28 19:02:50.441100] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:29.459 [2024-11-28 19:02:50.441156] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:29.459 [2024-11-28 19:02:50.441159] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:30.399 19:02:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:30.399 19:02:51 -- common/autotest_common.sh@862 -- # return 0 00:14:30.399 19:02:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:30.399 19:02:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:30.399 19:02:51 -- common/autotest_common.sh@10 -- # set +x 00:14:30.399 19:02:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:30.399 19:02:51 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:30.658 [2024-11-28 19:02:51.506358] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:30.658 19:02:51 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:30.917 19:02:51 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:14:30.917 19:02:51 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:14:31.176 19:02:52 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:14:31.176 19:02:52 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:14:31.434 19:02:52 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:14:31.694 19:02:52 -- target/nvmf_lvol.sh@29 -- # lvs=9b9000c3-6988-4f1d-97fa-d92a0856c153 00:14:31.694 19:02:52 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 9b9000c3-6988-4f1d-97fa-d92a0856c153 lvol 20 00:14:31.953 19:02:52 -- target/nvmf_lvol.sh@32 -- # lvol=7d15c266-26b5-4c09-b0b4-8a786b8eded5 00:14:31.953 19:02:52 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:32.211 19:02:53 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 7d15c266-26b5-4c09-b0b4-8a786b8eded5 00:14:32.473 19:02:53 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:32.763 [2024-11-28 19:02:53.605833] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:32.763 19:02:53 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:33.022 19:02:53 -- target/nvmf_lvol.sh@42 -- # perf_pid=183757 00:14:33.022 19:02:53 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:14:33.022 19:02:53 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:14:33.022 EAL: No free 2048 kB hugepages reported on node 1 00:14:33.958 19:02:54 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 7d15c266-26b5-4c09-b0b4-8a786b8eded5 MY_SNAPSHOT 00:14:34.216 19:02:55 -- target/nvmf_lvol.sh@47 -- # snapshot=0f0f1778-0b43-49b2-9d49-8ccae438fb77 00:14:34.216 19:02:55 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 7d15c266-26b5-4c09-b0b4-8a786b8eded5 30 00:14:34.474 19:02:55 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone 0f0f1778-0b43-49b2-9d49-8ccae438fb77 MY_CLONE 00:14:35.044 19:02:55 -- target/nvmf_lvol.sh@49 -- # clone=087bd2f1-bbec-4fc6-b384-2dd38761ac97 00:14:35.044 19:02:55 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 087bd2f1-bbec-4fc6-b384-2dd38761ac97 00:14:35.619 19:02:56 -- target/nvmf_lvol.sh@53 -- # wait 183757 00:14:43.750 Initializing NVMe Controllers 00:14:43.750 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:14:43.750 Controller IO queue size 128, less than required. 00:14:43.750 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:43.750 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:14:43.750 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:14:43.750 Initialization complete. Launching workers. 00:14:43.750 ======================================================== 00:14:43.750 Latency(us) 00:14:43.750 Device Information : IOPS MiB/s Average min max 00:14:43.750 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10733.80 41.93 11927.24 2016.59 80602.87 00:14:43.750 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10730.30 41.92 11927.94 5281.76 59625.04 00:14:43.750 ======================================================== 00:14:43.750 Total : 21464.11 83.84 11927.59 2016.59 80602.87 00:14:43.750 00:14:43.750 19:03:04 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:14:43.750 19:03:04 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 7d15c266-26b5-4c09-b0b4-8a786b8eded5 00:14:44.008 19:03:04 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 9b9000c3-6988-4f1d-97fa-d92a0856c153 00:14:44.268 19:03:05 -- target/nvmf_lvol.sh@60 -- # rm -f 00:14:44.268 19:03:05 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:14:44.268 19:03:05 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:14:44.268 19:03:05 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:44.268 19:03:05 -- nvmf/common.sh@116 -- # sync 00:14:44.268 19:03:05 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:44.268 19:03:05 -- nvmf/common.sh@119 -- # set +e 00:14:44.268 19:03:05 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:44.268 19:03:05 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:44.268 rmmod nvme_tcp 00:14:44.268 rmmod nvme_fabrics 00:14:44.268 rmmod nvme_keyring 00:14:44.268 19:03:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:44.268 19:03:05 -- nvmf/common.sh@123 -- # set -e 00:14:44.268 19:03:05 -- nvmf/common.sh@124 -- # return 0 00:14:44.268 19:03:05 -- nvmf/common.sh@477 -- # '[' -n 183312 ']' 00:14:44.268 19:03:05 -- nvmf/common.sh@478 -- # killprocess 183312 00:14:44.268 19:03:05 -- common/autotest_common.sh@936 -- # '[' -z 183312 ']' 00:14:44.268 19:03:05 -- common/autotest_common.sh@940 -- # kill -0 183312 00:14:44.268 19:03:05 -- common/autotest_common.sh@941 -- # uname 00:14:44.268 19:03:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:44.268 19:03:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 183312 00:14:44.268 19:03:05 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:44.268 19:03:05 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:44.268 19:03:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 183312' 00:14:44.268 killing process with pid 183312 00:14:44.268 19:03:05 -- common/autotest_common.sh@955 -- # kill 183312 00:14:44.268 19:03:05 -- common/autotest_common.sh@960 -- # wait 183312 00:14:44.835 19:03:05 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:44.835 19:03:05 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:44.835 19:03:05 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:44.835 19:03:05 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:44.835 19:03:05 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:44.835 19:03:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:44.835 19:03:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:44.835 19:03:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:46.747 19:03:07 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:46.747 00:14:46.747 real 0m19.927s 00:14:46.747 user 1m7.283s 00:14:46.747 sys 0m5.541s 00:14:46.747 19:03:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:46.747 19:03:07 -- common/autotest_common.sh@10 -- # set +x 00:14:46.747 ************************************ 00:14:46.747 END TEST nvmf_lvol 00:14:46.747 ************************************ 00:14:46.747 19:03:07 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:46.747 19:03:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:46.747 19:03:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:46.747 19:03:07 -- common/autotest_common.sh@10 -- # set +x 00:14:46.747 ************************************ 00:14:46.747 START TEST nvmf_lvs_grow 00:14:46.747 ************************************ 00:14:46.747 19:03:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:14:46.747 * Looking for test storage... 00:14:46.747 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:46.747 19:03:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:46.748 19:03:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:46.748 19:03:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:47.020 19:03:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:47.020 19:03:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:47.020 19:03:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:47.020 19:03:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:47.020 19:03:07 -- scripts/common.sh@335 -- # IFS=.-: 00:14:47.020 19:03:07 -- scripts/common.sh@335 -- # read -ra ver1 00:14:47.020 19:03:07 -- scripts/common.sh@336 -- # IFS=.-: 00:14:47.020 19:03:07 -- scripts/common.sh@336 -- # read -ra ver2 00:14:47.020 19:03:07 -- scripts/common.sh@337 -- # local 'op=<' 00:14:47.020 19:03:07 -- scripts/common.sh@339 -- # ver1_l=2 00:14:47.020 19:03:07 -- scripts/common.sh@340 -- # ver2_l=1 00:14:47.020 19:03:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:47.020 19:03:07 -- scripts/common.sh@343 -- # case "$op" in 00:14:47.020 19:03:07 -- scripts/common.sh@344 -- # : 1 00:14:47.020 19:03:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:47.020 19:03:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:47.020 19:03:07 -- scripts/common.sh@364 -- # decimal 1 00:14:47.020 19:03:07 -- scripts/common.sh@352 -- # local d=1 00:14:47.020 19:03:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:47.020 19:03:07 -- scripts/common.sh@354 -- # echo 1 00:14:47.020 19:03:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:47.020 19:03:07 -- scripts/common.sh@365 -- # decimal 2 00:14:47.020 19:03:07 -- scripts/common.sh@352 -- # local d=2 00:14:47.020 19:03:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:47.020 19:03:07 -- scripts/common.sh@354 -- # echo 2 00:14:47.020 19:03:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:47.020 19:03:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:47.020 19:03:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:47.020 19:03:07 -- scripts/common.sh@367 -- # return 0 00:14:47.020 19:03:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:47.020 19:03:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:47.020 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:47.020 --rc genhtml_branch_coverage=1 00:14:47.020 --rc genhtml_function_coverage=1 00:14:47.020 --rc genhtml_legend=1 00:14:47.020 --rc geninfo_all_blocks=1 00:14:47.020 --rc geninfo_unexecuted_blocks=1 00:14:47.020 00:14:47.020 ' 00:14:47.020 19:03:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:47.020 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:47.020 --rc genhtml_branch_coverage=1 00:14:47.020 --rc genhtml_function_coverage=1 00:14:47.020 --rc genhtml_legend=1 00:14:47.020 --rc geninfo_all_blocks=1 00:14:47.020 --rc geninfo_unexecuted_blocks=1 00:14:47.020 00:14:47.020 ' 00:14:47.020 19:03:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:47.020 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:47.020 --rc genhtml_branch_coverage=1 00:14:47.020 --rc genhtml_function_coverage=1 00:14:47.020 --rc genhtml_legend=1 00:14:47.020 --rc geninfo_all_blocks=1 00:14:47.020 --rc geninfo_unexecuted_blocks=1 00:14:47.020 00:14:47.020 ' 00:14:47.020 19:03:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:47.020 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:47.020 --rc genhtml_branch_coverage=1 00:14:47.020 --rc genhtml_function_coverage=1 00:14:47.020 --rc genhtml_legend=1 00:14:47.020 --rc geninfo_all_blocks=1 00:14:47.020 --rc geninfo_unexecuted_blocks=1 00:14:47.020 00:14:47.020 ' 00:14:47.020 19:03:07 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:47.020 19:03:07 -- nvmf/common.sh@7 -- # uname -s 00:14:47.020 19:03:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:47.020 19:03:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:47.020 19:03:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:47.020 19:03:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:47.020 19:03:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:47.020 19:03:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:47.020 19:03:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:47.020 19:03:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:47.020 19:03:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:47.020 19:03:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:47.020 19:03:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:47.020 19:03:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:47.020 19:03:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:47.020 19:03:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:47.020 19:03:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:47.020 19:03:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:47.020 19:03:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:47.020 19:03:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:47.020 19:03:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:47.020 19:03:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:47.020 19:03:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:47.020 19:03:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:47.020 19:03:07 -- paths/export.sh@5 -- # export PATH 00:14:47.021 19:03:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:47.021 19:03:07 -- nvmf/common.sh@46 -- # : 0 00:14:47.021 19:03:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:47.021 19:03:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:47.021 19:03:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:47.021 19:03:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:47.021 19:03:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:47.021 19:03:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:47.021 19:03:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:47.021 19:03:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:47.021 19:03:07 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:14:47.021 19:03:07 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:14:47.021 19:03:07 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:14:47.021 19:03:07 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:47.021 19:03:07 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:47.021 19:03:07 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:47.021 19:03:07 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:47.021 19:03:07 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:47.021 19:03:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:47.021 19:03:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:47.021 19:03:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:47.021 19:03:07 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:47.021 19:03:07 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:47.021 19:03:07 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:47.021 19:03:07 -- common/autotest_common.sh@10 -- # set +x 00:14:48.945 19:03:09 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:48.945 19:03:09 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:48.945 19:03:09 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:48.945 19:03:09 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:48.945 19:03:09 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:48.945 19:03:09 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:48.945 19:03:09 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:48.945 19:03:09 -- nvmf/common.sh@294 -- # net_devs=() 00:14:48.945 19:03:09 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:48.945 19:03:09 -- nvmf/common.sh@295 -- # e810=() 00:14:48.945 19:03:09 -- nvmf/common.sh@295 -- # local -ga e810 00:14:48.945 19:03:09 -- nvmf/common.sh@296 -- # x722=() 00:14:48.945 19:03:09 -- nvmf/common.sh@296 -- # local -ga x722 00:14:48.945 19:03:09 -- nvmf/common.sh@297 -- # mlx=() 00:14:48.945 19:03:09 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:48.945 19:03:09 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:48.945 19:03:09 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:48.945 19:03:09 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:48.945 19:03:09 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:48.945 19:03:09 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:48.945 19:03:09 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:48.945 19:03:09 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:48.945 19:03:09 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:48.945 19:03:09 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:48.945 19:03:09 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:48.945 19:03:09 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:48.945 19:03:09 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:48.945 19:03:09 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:48.945 19:03:09 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:48.945 19:03:09 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:48.945 19:03:09 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:48.945 19:03:09 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:48.945 19:03:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:48.945 19:03:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:48.945 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:48.945 19:03:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:48.945 19:03:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:48.945 19:03:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:48.945 19:03:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:48.945 19:03:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:48.945 19:03:09 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:48.945 19:03:09 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:48.945 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:48.945 19:03:09 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:48.945 19:03:09 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:48.945 19:03:09 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:48.945 19:03:09 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:48.945 19:03:09 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:48.945 19:03:09 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:48.945 19:03:09 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:48.945 19:03:09 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:48.945 19:03:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:48.945 19:03:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:48.945 19:03:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:48.945 19:03:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:48.945 19:03:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:48.945 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:48.945 19:03:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:48.945 19:03:09 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:48.945 19:03:09 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:48.945 19:03:09 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:48.945 19:03:09 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:48.945 19:03:09 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:48.945 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:48.945 19:03:09 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:48.945 19:03:09 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:48.945 19:03:09 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:48.946 19:03:09 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:48.946 19:03:09 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:48.946 19:03:09 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:48.946 19:03:09 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:48.946 19:03:09 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:48.946 19:03:09 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:48.946 19:03:09 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:48.946 19:03:09 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:48.946 19:03:09 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:48.946 19:03:09 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:48.946 19:03:09 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:48.946 19:03:09 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:48.946 19:03:09 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:48.946 19:03:09 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:48.946 19:03:09 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:48.946 19:03:09 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:48.946 19:03:09 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:48.946 19:03:09 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:48.946 19:03:09 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:48.946 19:03:09 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:48.946 19:03:09 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:48.946 19:03:09 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:48.946 19:03:09 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:48.946 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:48.946 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.214 ms 00:14:48.946 00:14:48.946 --- 10.0.0.2 ping statistics --- 00:14:48.946 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:48.946 rtt min/avg/max/mdev = 0.214/0.214/0.214/0.000 ms 00:14:48.946 19:03:09 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:48.946 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:48.946 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.137 ms 00:14:48.946 00:14:48.946 --- 10.0.0.1 ping statistics --- 00:14:48.946 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:48.946 rtt min/avg/max/mdev = 0.137/0.137/0.137/0.000 ms 00:14:48.946 19:03:09 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:48.946 19:03:09 -- nvmf/common.sh@410 -- # return 0 00:14:48.946 19:03:09 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:48.946 19:03:09 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:48.946 19:03:09 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:48.946 19:03:09 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:48.946 19:03:09 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:48.946 19:03:09 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:48.946 19:03:09 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:48.946 19:03:09 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:14:48.946 19:03:09 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:48.946 19:03:09 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:48.946 19:03:09 -- common/autotest_common.sh@10 -- # set +x 00:14:48.946 19:03:09 -- nvmf/common.sh@469 -- # nvmfpid=187704 00:14:48.946 19:03:09 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:14:48.946 19:03:09 -- nvmf/common.sh@470 -- # waitforlisten 187704 00:14:48.946 19:03:09 -- common/autotest_common.sh@829 -- # '[' -z 187704 ']' 00:14:48.946 19:03:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:48.946 19:03:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:48.946 19:03:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:48.946 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:48.946 19:03:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:48.946 19:03:09 -- common/autotest_common.sh@10 -- # set +x 00:14:49.235 [2024-11-28 19:03:09.988363] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:49.235 [2024-11-28 19:03:09.988443] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:49.235 EAL: No free 2048 kB hugepages reported on node 1 00:14:49.235 [2024-11-28 19:03:10.062742] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:49.235 [2024-11-28 19:03:10.177258] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:49.235 [2024-11-28 19:03:10.177444] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:49.235 [2024-11-28 19:03:10.177464] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:49.235 [2024-11-28 19:03:10.177478] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:49.235 [2024-11-28 19:03:10.177511] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:50.206 19:03:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:50.206 19:03:10 -- common/autotest_common.sh@862 -- # return 0 00:14:50.206 19:03:10 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:50.206 19:03:10 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:50.206 19:03:10 -- common/autotest_common.sh@10 -- # set +x 00:14:50.206 19:03:11 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:50.206 19:03:11 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:14:50.206 [2024-11-28 19:03:11.241860] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:50.488 19:03:11 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:14:50.488 19:03:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:14:50.488 19:03:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:50.488 19:03:11 -- common/autotest_common.sh@10 -- # set +x 00:14:50.488 ************************************ 00:14:50.488 START TEST lvs_grow_clean 00:14:50.488 ************************************ 00:14:50.488 19:03:11 -- common/autotest_common.sh@1114 -- # lvs_grow 00:14:50.488 19:03:11 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:14:50.488 19:03:11 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:14:50.488 19:03:11 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:14:50.488 19:03:11 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:14:50.488 19:03:11 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:14:50.488 19:03:11 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:14:50.488 19:03:11 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:50.488 19:03:11 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:50.488 19:03:11 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:14:50.763 19:03:11 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:14:50.763 19:03:11 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:14:51.028 19:03:11 -- target/nvmf_lvs_grow.sh@28 -- # lvs=46826650-c826-4540-b6fd-534153a68bc0 00:14:51.028 19:03:11 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 46826650-c826-4540-b6fd-534153a68bc0 00:14:51.028 19:03:11 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:14:51.292 19:03:12 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:14:51.292 19:03:12 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:14:51.292 19:03:12 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 46826650-c826-4540-b6fd-534153a68bc0 lvol 150 00:14:51.292 19:03:12 -- target/nvmf_lvs_grow.sh@33 -- # lvol=9f5e2349-5bc3-4bc6-8dbd-255ec5a50169 00:14:51.292 19:03:12 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:14:51.292 19:03:12 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:14:51.560 [2024-11-28 19:03:12.565601] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:14:51.560 [2024-11-28 19:03:12.565700] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:14:51.560 true 00:14:51.560 19:03:12 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 46826650-c826-4540-b6fd-534153a68bc0 00:14:51.560 19:03:12 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:14:51.832 19:03:12 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:14:51.833 19:03:12 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:14:52.118 19:03:13 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 9f5e2349-5bc3-4bc6-8dbd-255ec5a50169 00:14:52.395 19:03:13 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:14:52.671 [2024-11-28 19:03:13.592810] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:52.671 19:03:13 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:52.949 19:03:13 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=188287 00:14:52.950 19:03:13 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:14:52.950 19:03:13 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:14:52.950 19:03:13 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 188287 /var/tmp/bdevperf.sock 00:14:52.950 19:03:13 -- common/autotest_common.sh@829 -- # '[' -z 188287 ']' 00:14:52.950 19:03:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:14:52.950 19:03:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:52.950 19:03:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:14:52.950 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:14:52.950 19:03:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:52.950 19:03:13 -- common/autotest_common.sh@10 -- # set +x 00:14:52.950 [2024-11-28 19:03:13.907121] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:52.950 [2024-11-28 19:03:13.907200] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid188287 ] 00:14:52.950 EAL: No free 2048 kB hugepages reported on node 1 00:14:52.950 [2024-11-28 19:03:13.968104] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:53.222 [2024-11-28 19:03:14.083057] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:53.816 19:03:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:53.816 19:03:14 -- common/autotest_common.sh@862 -- # return 0 00:14:53.816 19:03:14 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:14:54.437 Nvme0n1 00:14:54.437 19:03:15 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:14:54.730 [ 00:14:54.730 { 00:14:54.730 "name": "Nvme0n1", 00:14:54.730 "aliases": [ 00:14:54.730 "9f5e2349-5bc3-4bc6-8dbd-255ec5a50169" 00:14:54.730 ], 00:14:54.730 "product_name": "NVMe disk", 00:14:54.730 "block_size": 4096, 00:14:54.730 "num_blocks": 38912, 00:14:54.730 "uuid": "9f5e2349-5bc3-4bc6-8dbd-255ec5a50169", 00:14:54.730 "assigned_rate_limits": { 00:14:54.730 "rw_ios_per_sec": 0, 00:14:54.730 "rw_mbytes_per_sec": 0, 00:14:54.730 "r_mbytes_per_sec": 0, 00:14:54.730 "w_mbytes_per_sec": 0 00:14:54.730 }, 00:14:54.730 "claimed": false, 00:14:54.730 "zoned": false, 00:14:54.730 "supported_io_types": { 00:14:54.730 "read": true, 00:14:54.730 "write": true, 00:14:54.730 "unmap": true, 00:14:54.730 "write_zeroes": true, 00:14:54.730 "flush": true, 00:14:54.730 "reset": true, 00:14:54.730 "compare": true, 00:14:54.730 "compare_and_write": true, 00:14:54.730 "abort": true, 00:14:54.730 "nvme_admin": true, 00:14:54.730 "nvme_io": true 00:14:54.730 }, 00:14:54.730 "driver_specific": { 00:14:54.730 "nvme": [ 00:14:54.730 { 00:14:54.730 "trid": { 00:14:54.730 "trtype": "TCP", 00:14:54.730 "adrfam": "IPv4", 00:14:54.730 "traddr": "10.0.0.2", 00:14:54.730 "trsvcid": "4420", 00:14:54.730 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:14:54.730 }, 00:14:54.730 "ctrlr_data": { 00:14:54.730 "cntlid": 1, 00:14:54.730 "vendor_id": "0x8086", 00:14:54.730 "model_number": "SPDK bdev Controller", 00:14:54.730 "serial_number": "SPDK0", 00:14:54.730 "firmware_revision": "24.01.1", 00:14:54.730 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:14:54.730 "oacs": { 00:14:54.730 "security": 0, 00:14:54.730 "format": 0, 00:14:54.730 "firmware": 0, 00:14:54.730 "ns_manage": 0 00:14:54.730 }, 00:14:54.730 "multi_ctrlr": true, 00:14:54.730 "ana_reporting": false 00:14:54.730 }, 00:14:54.730 "vs": { 00:14:54.730 "nvme_version": "1.3" 00:14:54.730 }, 00:14:54.730 "ns_data": { 00:14:54.730 "id": 1, 00:14:54.730 "can_share": true 00:14:54.730 } 00:14:54.730 } 00:14:54.730 ], 00:14:54.730 "mp_policy": "active_passive" 00:14:54.730 } 00:14:54.730 } 00:14:54.730 ] 00:14:54.730 19:03:15 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=188469 00:14:54.730 19:03:15 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:14:54.730 19:03:15 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:14:54.730 Running I/O for 10 seconds... 00:14:55.789 Latency(us) 00:14:55.789 [2024-11-28T18:03:16.837Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:14:55.789 [2024-11-28T18:03:16.837Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:55.789 Nvme0n1 : 1.00 14860.00 58.05 0.00 0.00 0.00 0.00 0.00 00:14:55.789 [2024-11-28T18:03:16.837Z] =================================================================================================================== 00:14:55.789 [2024-11-28T18:03:16.837Z] Total : 14860.00 58.05 0.00 0.00 0.00 0.00 0.00 00:14:55.789 00:14:56.888 19:03:17 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 46826650-c826-4540-b6fd-534153a68bc0 00:14:56.888 [2024-11-28T18:03:17.936Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:56.888 Nvme0n1 : 2.00 15187.50 59.33 0.00 0.00 0.00 0.00 0.00 00:14:56.888 [2024-11-28T18:03:17.936Z] =================================================================================================================== 00:14:56.888 [2024-11-28T18:03:17.936Z] Total : 15187.50 59.33 0.00 0.00 0.00 0.00 0.00 00:14:56.888 00:14:56.888 true 00:14:56.888 19:03:17 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 46826650-c826-4540-b6fd-534153a68bc0 00:14:56.888 19:03:17 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:14:57.174 19:03:18 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:14:57.174 19:03:18 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:14:57.174 19:03:18 -- target/nvmf_lvs_grow.sh@65 -- # wait 188469 00:14:57.745 [2024-11-28T18:03:18.793Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:57.745 Nvme0n1 : 3.00 15229.00 59.49 0.00 0.00 0.00 0.00 0.00 00:14:57.745 [2024-11-28T18:03:18.793Z] =================================================================================================================== 00:14:57.745 [2024-11-28T18:03:18.793Z] Total : 15229.00 59.49 0.00 0.00 0.00 0.00 0.00 00:14:57.745 00:14:58.687 [2024-11-28T18:03:19.735Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:58.687 Nvme0n1 : 4.00 15313.00 59.82 0.00 0.00 0.00 0.00 0.00 00:14:58.687 [2024-11-28T18:03:19.735Z] =================================================================================================================== 00:14:58.687 [2024-11-28T18:03:19.735Z] Total : 15313.00 59.82 0.00 0.00 0.00 0.00 0.00 00:14:58.687 00:14:59.627 [2024-11-28T18:03:20.675Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:14:59.627 Nvme0n1 : 5.00 15353.00 59.97 0.00 0.00 0.00 0.00 0.00 00:14:59.627 [2024-11-28T18:03:20.675Z] =================================================================================================================== 00:14:59.627 [2024-11-28T18:03:20.675Z] Total : 15353.00 59.97 0.00 0.00 0.00 0.00 0.00 00:14:59.627 00:15:01.016 [2024-11-28T18:03:22.064Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:01.016 Nvme0n1 : 6.00 15399.67 60.15 0.00 0.00 0.00 0.00 0.00 00:15:01.016 [2024-11-28T18:03:22.064Z] =================================================================================================================== 00:15:01.016 [2024-11-28T18:03:22.064Z] Total : 15399.67 60.15 0.00 0.00 0.00 0.00 0.00 00:15:01.016 00:15:01.587 [2024-11-28T18:03:22.635Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:01.587 Nvme0n1 : 7.00 15458.57 60.39 0.00 0.00 0.00 0.00 0.00 00:15:01.587 [2024-11-28T18:03:22.635Z] =================================================================================================================== 00:15:01.587 [2024-11-28T18:03:22.635Z] Total : 15458.57 60.39 0.00 0.00 0.00 0.00 0.00 00:15:01.587 00:15:02.968 [2024-11-28T18:03:24.016Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:02.968 Nvme0n1 : 8.00 15510.88 60.59 0.00 0.00 0.00 0.00 0.00 00:15:02.968 [2024-11-28T18:03:24.016Z] =================================================================================================================== 00:15:02.968 [2024-11-28T18:03:24.016Z] Total : 15510.88 60.59 0.00 0.00 0.00 0.00 0.00 00:15:02.968 00:15:03.909 [2024-11-28T18:03:24.957Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:03.909 Nvme0n1 : 9.00 15551.67 60.75 0.00 0.00 0.00 0.00 0.00 00:15:03.909 [2024-11-28T18:03:24.957Z] =================================================================================================================== 00:15:03.909 [2024-11-28T18:03:24.957Z] Total : 15551.67 60.75 0.00 0.00 0.00 0.00 0.00 00:15:03.909 00:15:04.851 [2024-11-28T18:03:25.899Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:04.851 Nvme0n1 : 10.00 15571.90 60.83 0.00 0.00 0.00 0.00 0.00 00:15:04.851 [2024-11-28T18:03:25.899Z] =================================================================================================================== 00:15:04.851 [2024-11-28T18:03:25.899Z] Total : 15571.90 60.83 0.00 0.00 0.00 0.00 0.00 00:15:04.851 00:15:04.851 00:15:04.851 Latency(us) 00:15:04.851 [2024-11-28T18:03:25.899Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:04.851 [2024-11-28T18:03:25.899Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:04.851 Nvme0n1 : 10.01 15575.50 60.84 0.00 0.00 8213.74 4636.07 16311.18 00:15:04.851 [2024-11-28T18:03:25.899Z] =================================================================================================================== 00:15:04.851 [2024-11-28T18:03:25.899Z] Total : 15575.50 60.84 0.00 0.00 8213.74 4636.07 16311.18 00:15:04.851 0 00:15:04.851 19:03:25 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 188287 00:15:04.851 19:03:25 -- common/autotest_common.sh@936 -- # '[' -z 188287 ']' 00:15:04.851 19:03:25 -- common/autotest_common.sh@940 -- # kill -0 188287 00:15:04.851 19:03:25 -- common/autotest_common.sh@941 -- # uname 00:15:04.851 19:03:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:04.851 19:03:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 188287 00:15:04.851 19:03:25 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:04.851 19:03:25 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:04.851 19:03:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 188287' 00:15:04.851 killing process with pid 188287 00:15:04.851 19:03:25 -- common/autotest_common.sh@955 -- # kill 188287 00:15:04.851 Received shutdown signal, test time was about 10.000000 seconds 00:15:04.851 00:15:04.851 Latency(us) 00:15:04.851 [2024-11-28T18:03:25.899Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:04.851 [2024-11-28T18:03:25.899Z] =================================================================================================================== 00:15:04.851 [2024-11-28T18:03:25.899Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:04.851 19:03:25 -- common/autotest_common.sh@960 -- # wait 188287 00:15:05.110 19:03:25 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:15:05.369 19:03:26 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 46826650-c826-4540-b6fd-534153a68bc0 00:15:05.369 19:03:26 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:15:05.629 19:03:26 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:15:05.629 19:03:26 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:15:05.629 19:03:26 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:05.888 [2024-11-28 19:03:26.727249] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:15:05.888 19:03:26 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 46826650-c826-4540-b6fd-534153a68bc0 00:15:05.888 19:03:26 -- common/autotest_common.sh@650 -- # local es=0 00:15:05.888 19:03:26 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 46826650-c826-4540-b6fd-534153a68bc0 00:15:05.888 19:03:26 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:05.888 19:03:26 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:05.888 19:03:26 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:05.888 19:03:26 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:05.888 19:03:26 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:05.888 19:03:26 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:05.888 19:03:26 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:05.888 19:03:26 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:15:05.888 19:03:26 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 46826650-c826-4540-b6fd-534153a68bc0 00:15:06.149 request: 00:15:06.149 { 00:15:06.149 "uuid": "46826650-c826-4540-b6fd-534153a68bc0", 00:15:06.149 "method": "bdev_lvol_get_lvstores", 00:15:06.149 "req_id": 1 00:15:06.149 } 00:15:06.149 Got JSON-RPC error response 00:15:06.149 response: 00:15:06.149 { 00:15:06.149 "code": -19, 00:15:06.149 "message": "No such device" 00:15:06.149 } 00:15:06.149 19:03:27 -- common/autotest_common.sh@653 -- # es=1 00:15:06.149 19:03:27 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:06.149 19:03:27 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:06.149 19:03:27 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:06.149 19:03:27 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:06.409 aio_bdev 00:15:06.409 19:03:27 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 9f5e2349-5bc3-4bc6-8dbd-255ec5a50169 00:15:06.409 19:03:27 -- common/autotest_common.sh@897 -- # local bdev_name=9f5e2349-5bc3-4bc6-8dbd-255ec5a50169 00:15:06.409 19:03:27 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:15:06.409 19:03:27 -- common/autotest_common.sh@899 -- # local i 00:15:06.409 19:03:27 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:15:06.409 19:03:27 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:15:06.409 19:03:27 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:06.668 19:03:27 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 9f5e2349-5bc3-4bc6-8dbd-255ec5a50169 -t 2000 00:15:06.927 [ 00:15:06.927 { 00:15:06.927 "name": "9f5e2349-5bc3-4bc6-8dbd-255ec5a50169", 00:15:06.927 "aliases": [ 00:15:06.927 "lvs/lvol" 00:15:06.927 ], 00:15:06.927 "product_name": "Logical Volume", 00:15:06.927 "block_size": 4096, 00:15:06.927 "num_blocks": 38912, 00:15:06.927 "uuid": "9f5e2349-5bc3-4bc6-8dbd-255ec5a50169", 00:15:06.927 "assigned_rate_limits": { 00:15:06.927 "rw_ios_per_sec": 0, 00:15:06.927 "rw_mbytes_per_sec": 0, 00:15:06.927 "r_mbytes_per_sec": 0, 00:15:06.927 "w_mbytes_per_sec": 0 00:15:06.927 }, 00:15:06.927 "claimed": false, 00:15:06.927 "zoned": false, 00:15:06.927 "supported_io_types": { 00:15:06.927 "read": true, 00:15:06.927 "write": true, 00:15:06.927 "unmap": true, 00:15:06.927 "write_zeroes": true, 00:15:06.927 "flush": false, 00:15:06.927 "reset": true, 00:15:06.927 "compare": false, 00:15:06.927 "compare_and_write": false, 00:15:06.927 "abort": false, 00:15:06.927 "nvme_admin": false, 00:15:06.927 "nvme_io": false 00:15:06.927 }, 00:15:06.927 "driver_specific": { 00:15:06.927 "lvol": { 00:15:06.927 "lvol_store_uuid": "46826650-c826-4540-b6fd-534153a68bc0", 00:15:06.927 "base_bdev": "aio_bdev", 00:15:06.927 "thin_provision": false, 00:15:06.927 "snapshot": false, 00:15:06.927 "clone": false, 00:15:06.927 "esnap_clone": false 00:15:06.927 } 00:15:06.927 } 00:15:06.927 } 00:15:06.927 ] 00:15:06.927 19:03:27 -- common/autotest_common.sh@905 -- # return 0 00:15:06.927 19:03:27 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 46826650-c826-4540-b6fd-534153a68bc0 00:15:06.927 19:03:27 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:15:07.188 19:03:28 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:15:07.188 19:03:28 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 46826650-c826-4540-b6fd-534153a68bc0 00:15:07.188 19:03:28 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:15:07.448 19:03:28 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:15:07.448 19:03:28 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 9f5e2349-5bc3-4bc6-8dbd-255ec5a50169 00:15:07.708 19:03:28 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 46826650-c826-4540-b6fd-534153a68bc0 00:15:07.967 19:03:28 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:08.226 19:03:29 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:08.226 00:15:08.226 real 0m17.869s 00:15:08.226 user 0m17.630s 00:15:08.226 sys 0m1.810s 00:15:08.226 19:03:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:08.226 19:03:29 -- common/autotest_common.sh@10 -- # set +x 00:15:08.226 ************************************ 00:15:08.226 END TEST lvs_grow_clean 00:15:08.226 ************************************ 00:15:08.226 19:03:29 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:15:08.226 19:03:29 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:08.226 19:03:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:08.226 19:03:29 -- common/autotest_common.sh@10 -- # set +x 00:15:08.226 ************************************ 00:15:08.226 START TEST lvs_grow_dirty 00:15:08.226 ************************************ 00:15:08.226 19:03:29 -- common/autotest_common.sh@1114 -- # lvs_grow dirty 00:15:08.226 19:03:29 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:15:08.226 19:03:29 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:15:08.226 19:03:29 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:15:08.226 19:03:29 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:15:08.226 19:03:29 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:15:08.226 19:03:29 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:15:08.226 19:03:29 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:08.226 19:03:29 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:08.226 19:03:29 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:08.486 19:03:29 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:15:08.486 19:03:29 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:15:08.747 19:03:29 -- target/nvmf_lvs_grow.sh@28 -- # lvs=e44896db-3d11-457a-b3e3-218f3a77c178 00:15:08.747 19:03:29 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e44896db-3d11-457a-b3e3-218f3a77c178 00:15:08.747 19:03:29 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:15:09.008 19:03:29 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:15:09.008 19:03:29 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:15:09.008 19:03:29 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u e44896db-3d11-457a-b3e3-218f3a77c178 lvol 150 00:15:09.266 19:03:30 -- target/nvmf_lvs_grow.sh@33 -- # lvol=a3382ce7-3cec-48bd-8967-81d6df57d049 00:15:09.266 19:03:30 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:09.266 19:03:30 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:15:09.525 [2024-11-28 19:03:30.454716] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:15:09.525 [2024-11-28 19:03:30.454809] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:15:09.525 true 00:15:09.525 19:03:30 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e44896db-3d11-457a-b3e3-218f3a77c178 00:15:09.525 19:03:30 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:15:09.784 19:03:30 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:15:09.784 19:03:30 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:15:10.044 19:03:31 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 a3382ce7-3cec-48bd-8967-81d6df57d049 00:15:10.305 19:03:31 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:15:10.568 19:03:31 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:10.828 19:03:31 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=190477 00:15:10.828 19:03:31 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:15:10.828 19:03:31 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:10.828 19:03:31 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 190477 /var/tmp/bdevperf.sock 00:15:10.828 19:03:31 -- common/autotest_common.sh@829 -- # '[' -z 190477 ']' 00:15:10.828 19:03:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:10.828 19:03:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:10.828 19:03:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:10.828 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:10.828 19:03:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:10.828 19:03:31 -- common/autotest_common.sh@10 -- # set +x 00:15:10.828 [2024-11-28 19:03:31.848649] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:10.828 [2024-11-28 19:03:31.848730] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid190477 ] 00:15:11.088 EAL: No free 2048 kB hugepages reported on node 1 00:15:11.088 [2024-11-28 19:03:31.908117] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:11.088 [2024-11-28 19:03:32.019016] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:12.029 19:03:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:12.029 19:03:32 -- common/autotest_common.sh@862 -- # return 0 00:15:12.029 19:03:32 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:15:12.288 Nvme0n1 00:15:12.288 19:03:33 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:15:12.549 [ 00:15:12.549 { 00:15:12.549 "name": "Nvme0n1", 00:15:12.549 "aliases": [ 00:15:12.549 "a3382ce7-3cec-48bd-8967-81d6df57d049" 00:15:12.549 ], 00:15:12.549 "product_name": "NVMe disk", 00:15:12.549 "block_size": 4096, 00:15:12.549 "num_blocks": 38912, 00:15:12.549 "uuid": "a3382ce7-3cec-48bd-8967-81d6df57d049", 00:15:12.549 "assigned_rate_limits": { 00:15:12.549 "rw_ios_per_sec": 0, 00:15:12.549 "rw_mbytes_per_sec": 0, 00:15:12.549 "r_mbytes_per_sec": 0, 00:15:12.549 "w_mbytes_per_sec": 0 00:15:12.549 }, 00:15:12.549 "claimed": false, 00:15:12.549 "zoned": false, 00:15:12.549 "supported_io_types": { 00:15:12.549 "read": true, 00:15:12.549 "write": true, 00:15:12.549 "unmap": true, 00:15:12.549 "write_zeroes": true, 00:15:12.549 "flush": true, 00:15:12.549 "reset": true, 00:15:12.549 "compare": true, 00:15:12.549 "compare_and_write": true, 00:15:12.549 "abort": true, 00:15:12.549 "nvme_admin": true, 00:15:12.549 "nvme_io": true 00:15:12.549 }, 00:15:12.549 "driver_specific": { 00:15:12.549 "nvme": [ 00:15:12.549 { 00:15:12.549 "trid": { 00:15:12.549 "trtype": "TCP", 00:15:12.549 "adrfam": "IPv4", 00:15:12.549 "traddr": "10.0.0.2", 00:15:12.549 "trsvcid": "4420", 00:15:12.549 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:15:12.549 }, 00:15:12.549 "ctrlr_data": { 00:15:12.549 "cntlid": 1, 00:15:12.549 "vendor_id": "0x8086", 00:15:12.549 "model_number": "SPDK bdev Controller", 00:15:12.549 "serial_number": "SPDK0", 00:15:12.549 "firmware_revision": "24.01.1", 00:15:12.549 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:15:12.549 "oacs": { 00:15:12.549 "security": 0, 00:15:12.549 "format": 0, 00:15:12.549 "firmware": 0, 00:15:12.549 "ns_manage": 0 00:15:12.549 }, 00:15:12.549 "multi_ctrlr": true, 00:15:12.549 "ana_reporting": false 00:15:12.549 }, 00:15:12.549 "vs": { 00:15:12.549 "nvme_version": "1.3" 00:15:12.549 }, 00:15:12.549 "ns_data": { 00:15:12.549 "id": 1, 00:15:12.549 "can_share": true 00:15:12.549 } 00:15:12.549 } 00:15:12.549 ], 00:15:12.549 "mp_policy": "active_passive" 00:15:12.549 } 00:15:12.549 } 00:15:12.549 ] 00:15:12.549 19:03:33 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=190746 00:15:12.549 19:03:33 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:12.549 19:03:33 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:15:12.549 Running I/O for 10 seconds... 00:15:13.490 Latency(us) 00:15:13.490 [2024-11-28T18:03:34.538Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:13.490 [2024-11-28T18:03:34.538Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:13.490 Nvme0n1 : 1.00 14872.00 58.09 0.00 0.00 0.00 0.00 0.00 00:15:13.490 [2024-11-28T18:03:34.538Z] =================================================================================================================== 00:15:13.490 [2024-11-28T18:03:34.538Z] Total : 14872.00 58.09 0.00 0.00 0.00 0.00 0.00 00:15:13.490 00:15:14.431 19:03:35 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u e44896db-3d11-457a-b3e3-218f3a77c178 00:15:14.688 [2024-11-28T18:03:35.736Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:14.688 Nvme0n1 : 2.00 15110.00 59.02 0.00 0.00 0.00 0.00 0.00 00:15:14.688 [2024-11-28T18:03:35.736Z] =================================================================================================================== 00:15:14.688 [2024-11-28T18:03:35.736Z] Total : 15110.00 59.02 0.00 0.00 0.00 0.00 0.00 00:15:14.688 00:15:14.688 true 00:15:14.688 19:03:35 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e44896db-3d11-457a-b3e3-218f3a77c178 00:15:14.688 19:03:35 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:15:14.947 19:03:35 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:15:14.947 19:03:35 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:15:14.947 19:03:35 -- target/nvmf_lvs_grow.sh@65 -- # wait 190746 00:15:15.517 [2024-11-28T18:03:36.565Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:15.517 Nvme0n1 : 3.00 15408.33 60.19 0.00 0.00 0.00 0.00 0.00 00:15:15.517 [2024-11-28T18:03:36.565Z] =================================================================================================================== 00:15:15.517 [2024-11-28T18:03:36.565Z] Total : 15408.33 60.19 0.00 0.00 0.00 0.00 0.00 00:15:15.517 00:15:16.901 [2024-11-28T18:03:37.949Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:16.901 Nvme0n1 : 4.00 15461.50 60.40 0.00 0.00 0.00 0.00 0.00 00:15:16.901 [2024-11-28T18:03:37.949Z] =================================================================================================================== 00:15:16.901 [2024-11-28T18:03:37.949Z] Total : 15461.50 60.40 0.00 0.00 0.00 0.00 0.00 00:15:16.901 00:15:17.472 [2024-11-28T18:03:38.520Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:17.472 Nvme0n1 : 5.00 15507.80 60.58 0.00 0.00 0.00 0.00 0.00 00:15:17.472 [2024-11-28T18:03:38.520Z] =================================================================================================================== 00:15:17.472 [2024-11-28T18:03:38.520Z] Total : 15507.80 60.58 0.00 0.00 0.00 0.00 0.00 00:15:17.472 00:15:18.848 [2024-11-28T18:03:39.896Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:18.848 Nvme0n1 : 6.00 15548.33 60.74 0.00 0.00 0.00 0.00 0.00 00:15:18.848 [2024-11-28T18:03:39.896Z] =================================================================================================================== 00:15:18.848 [2024-11-28T18:03:39.896Z] Total : 15548.33 60.74 0.00 0.00 0.00 0.00 0.00 00:15:18.848 00:15:19.789 [2024-11-28T18:03:40.837Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:19.789 Nvme0n1 : 7.00 15562.57 60.79 0.00 0.00 0.00 0.00 0.00 00:15:19.789 [2024-11-28T18:03:40.837Z] =================================================================================================================== 00:15:19.789 [2024-11-28T18:03:40.837Z] Total : 15562.57 60.79 0.00 0.00 0.00 0.00 0.00 00:15:19.789 00:15:20.726 [2024-11-28T18:03:41.774Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:20.726 Nvme0n1 : 8.00 15594.00 60.91 0.00 0.00 0.00 0.00 0.00 00:15:20.726 [2024-11-28T18:03:41.774Z] =================================================================================================================== 00:15:20.726 [2024-11-28T18:03:41.774Z] Total : 15594.00 60.91 0.00 0.00 0.00 0.00 0.00 00:15:20.726 00:15:21.665 [2024-11-28T18:03:42.713Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:21.665 Nvme0n1 : 9.00 15625.22 61.04 0.00 0.00 0.00 0.00 0.00 00:15:21.665 [2024-11-28T18:03:42.713Z] =================================================================================================================== 00:15:21.665 [2024-11-28T18:03:42.713Z] Total : 15625.22 61.04 0.00 0.00 0.00 0.00 0.00 00:15:21.665 00:15:22.602 [2024-11-28T18:03:43.650Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:22.602 Nvme0n1 : 10.00 15636.40 61.08 0.00 0.00 0.00 0.00 0.00 00:15:22.602 [2024-11-28T18:03:43.650Z] =================================================================================================================== 00:15:22.602 [2024-11-28T18:03:43.650Z] Total : 15636.40 61.08 0.00 0.00 0.00 0.00 0.00 00:15:22.602 00:15:22.602 00:15:22.602 Latency(us) 00:15:22.602 [2024-11-28T18:03:43.650Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:22.602 [2024-11-28T18:03:43.650Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:22.602 Nvme0n1 : 10.00 15635.64 61.08 0.00 0.00 8181.26 2803.48 18252.99 00:15:22.602 [2024-11-28T18:03:43.650Z] =================================================================================================================== 00:15:22.602 [2024-11-28T18:03:43.650Z] Total : 15635.64 61.08 0.00 0.00 8181.26 2803.48 18252.99 00:15:22.602 0 00:15:22.602 19:03:43 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 190477 00:15:22.602 19:03:43 -- common/autotest_common.sh@936 -- # '[' -z 190477 ']' 00:15:22.602 19:03:43 -- common/autotest_common.sh@940 -- # kill -0 190477 00:15:22.602 19:03:43 -- common/autotest_common.sh@941 -- # uname 00:15:22.602 19:03:43 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:22.602 19:03:43 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 190477 00:15:22.602 19:03:43 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:22.602 19:03:43 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:22.602 19:03:43 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 190477' 00:15:22.602 killing process with pid 190477 00:15:22.602 19:03:43 -- common/autotest_common.sh@955 -- # kill 190477 00:15:22.602 Received shutdown signal, test time was about 10.000000 seconds 00:15:22.602 00:15:22.602 Latency(us) 00:15:22.602 [2024-11-28T18:03:43.650Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:22.602 [2024-11-28T18:03:43.650Z] =================================================================================================================== 00:15:22.602 [2024-11-28T18:03:43.650Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:22.602 19:03:43 -- common/autotest_common.sh@960 -- # wait 190477 00:15:22.861 19:03:43 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:15:23.119 19:03:44 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e44896db-3d11-457a-b3e3-218f3a77c178 00:15:23.119 19:03:44 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:15:23.377 19:03:44 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:15:23.377 19:03:44 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:15:23.377 19:03:44 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 187704 00:15:23.377 19:03:44 -- target/nvmf_lvs_grow.sh@74 -- # wait 187704 00:15:23.377 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 187704 Killed "${NVMF_APP[@]}" "$@" 00:15:23.377 19:03:44 -- target/nvmf_lvs_grow.sh@74 -- # true 00:15:23.377 19:03:44 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:15:23.377 19:03:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:23.377 19:03:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:23.377 19:03:44 -- common/autotest_common.sh@10 -- # set +x 00:15:23.377 19:03:44 -- nvmf/common.sh@469 -- # nvmfpid=191991 00:15:23.377 19:03:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:15:23.377 19:03:44 -- nvmf/common.sh@470 -- # waitforlisten 191991 00:15:23.377 19:03:44 -- common/autotest_common.sh@829 -- # '[' -z 191991 ']' 00:15:23.377 19:03:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:23.377 19:03:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:23.377 19:03:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:23.377 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:23.377 19:03:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:23.377 19:03:44 -- common/autotest_common.sh@10 -- # set +x 00:15:23.377 [2024-11-28 19:03:44.410911] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:23.377 [2024-11-28 19:03:44.410998] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:23.637 EAL: No free 2048 kB hugepages reported on node 1 00:15:23.637 [2024-11-28 19:03:44.488356] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:23.637 [2024-11-28 19:03:44.604186] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:23.637 [2024-11-28 19:03:44.604347] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:23.637 [2024-11-28 19:03:44.604366] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:23.637 [2024-11-28 19:03:44.604380] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:23.637 [2024-11-28 19:03:44.604438] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:24.575 19:03:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:24.575 19:03:45 -- common/autotest_common.sh@862 -- # return 0 00:15:24.575 19:03:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:24.575 19:03:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:24.575 19:03:45 -- common/autotest_common.sh@10 -- # set +x 00:15:24.575 19:03:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:24.575 19:03:45 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:24.837 [2024-11-28 19:03:45.637454] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:15:24.837 [2024-11-28 19:03:45.637589] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:15:24.837 [2024-11-28 19:03:45.637640] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:15:24.837 19:03:45 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:15:24.837 19:03:45 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev a3382ce7-3cec-48bd-8967-81d6df57d049 00:15:24.837 19:03:45 -- common/autotest_common.sh@897 -- # local bdev_name=a3382ce7-3cec-48bd-8967-81d6df57d049 00:15:24.837 19:03:45 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:15:24.837 19:03:45 -- common/autotest_common.sh@899 -- # local i 00:15:24.837 19:03:45 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:15:24.837 19:03:45 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:15:24.837 19:03:45 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:25.096 19:03:45 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b a3382ce7-3cec-48bd-8967-81d6df57d049 -t 2000 00:15:25.354 [ 00:15:25.354 { 00:15:25.354 "name": "a3382ce7-3cec-48bd-8967-81d6df57d049", 00:15:25.354 "aliases": [ 00:15:25.354 "lvs/lvol" 00:15:25.354 ], 00:15:25.354 "product_name": "Logical Volume", 00:15:25.354 "block_size": 4096, 00:15:25.354 "num_blocks": 38912, 00:15:25.354 "uuid": "a3382ce7-3cec-48bd-8967-81d6df57d049", 00:15:25.354 "assigned_rate_limits": { 00:15:25.354 "rw_ios_per_sec": 0, 00:15:25.354 "rw_mbytes_per_sec": 0, 00:15:25.354 "r_mbytes_per_sec": 0, 00:15:25.354 "w_mbytes_per_sec": 0 00:15:25.354 }, 00:15:25.354 "claimed": false, 00:15:25.354 "zoned": false, 00:15:25.354 "supported_io_types": { 00:15:25.354 "read": true, 00:15:25.354 "write": true, 00:15:25.354 "unmap": true, 00:15:25.354 "write_zeroes": true, 00:15:25.354 "flush": false, 00:15:25.354 "reset": true, 00:15:25.354 "compare": false, 00:15:25.354 "compare_and_write": false, 00:15:25.354 "abort": false, 00:15:25.354 "nvme_admin": false, 00:15:25.354 "nvme_io": false 00:15:25.354 }, 00:15:25.354 "driver_specific": { 00:15:25.354 "lvol": { 00:15:25.354 "lvol_store_uuid": "e44896db-3d11-457a-b3e3-218f3a77c178", 00:15:25.354 "base_bdev": "aio_bdev", 00:15:25.354 "thin_provision": false, 00:15:25.354 "snapshot": false, 00:15:25.354 "clone": false, 00:15:25.354 "esnap_clone": false 00:15:25.354 } 00:15:25.354 } 00:15:25.354 } 00:15:25.354 ] 00:15:25.354 19:03:46 -- common/autotest_common.sh@905 -- # return 0 00:15:25.354 19:03:46 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e44896db-3d11-457a-b3e3-218f3a77c178 00:15:25.354 19:03:46 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:15:25.613 19:03:46 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:15:25.613 19:03:46 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e44896db-3d11-457a-b3e3-218f3a77c178 00:15:25.613 19:03:46 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:15:25.870 19:03:46 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:15:25.870 19:03:46 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:26.129 [2024-11-28 19:03:46.946519] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:15:26.129 19:03:46 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e44896db-3d11-457a-b3e3-218f3a77c178 00:15:26.129 19:03:46 -- common/autotest_common.sh@650 -- # local es=0 00:15:26.129 19:03:46 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e44896db-3d11-457a-b3e3-218f3a77c178 00:15:26.129 19:03:46 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:26.129 19:03:46 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:26.129 19:03:46 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:26.129 19:03:46 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:26.129 19:03:46 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:26.129 19:03:46 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:26.129 19:03:46 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:26.129 19:03:46 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:15:26.129 19:03:46 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e44896db-3d11-457a-b3e3-218f3a77c178 00:15:26.390 request: 00:15:26.390 { 00:15:26.390 "uuid": "e44896db-3d11-457a-b3e3-218f3a77c178", 00:15:26.390 "method": "bdev_lvol_get_lvstores", 00:15:26.390 "req_id": 1 00:15:26.390 } 00:15:26.390 Got JSON-RPC error response 00:15:26.390 response: 00:15:26.390 { 00:15:26.390 "code": -19, 00:15:26.390 "message": "No such device" 00:15:26.390 } 00:15:26.390 19:03:47 -- common/autotest_common.sh@653 -- # es=1 00:15:26.390 19:03:47 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:26.390 19:03:47 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:26.390 19:03:47 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:26.390 19:03:47 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:26.651 aio_bdev 00:15:26.651 19:03:47 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev a3382ce7-3cec-48bd-8967-81d6df57d049 00:15:26.652 19:03:47 -- common/autotest_common.sh@897 -- # local bdev_name=a3382ce7-3cec-48bd-8967-81d6df57d049 00:15:26.652 19:03:47 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:15:26.652 19:03:47 -- common/autotest_common.sh@899 -- # local i 00:15:26.652 19:03:47 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:15:26.652 19:03:47 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:15:26.652 19:03:47 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:26.911 19:03:47 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b a3382ce7-3cec-48bd-8967-81d6df57d049 -t 2000 00:15:27.170 [ 00:15:27.170 { 00:15:27.170 "name": "a3382ce7-3cec-48bd-8967-81d6df57d049", 00:15:27.170 "aliases": [ 00:15:27.170 "lvs/lvol" 00:15:27.170 ], 00:15:27.170 "product_name": "Logical Volume", 00:15:27.170 "block_size": 4096, 00:15:27.170 "num_blocks": 38912, 00:15:27.170 "uuid": "a3382ce7-3cec-48bd-8967-81d6df57d049", 00:15:27.170 "assigned_rate_limits": { 00:15:27.170 "rw_ios_per_sec": 0, 00:15:27.170 "rw_mbytes_per_sec": 0, 00:15:27.170 "r_mbytes_per_sec": 0, 00:15:27.170 "w_mbytes_per_sec": 0 00:15:27.170 }, 00:15:27.170 "claimed": false, 00:15:27.170 "zoned": false, 00:15:27.170 "supported_io_types": { 00:15:27.170 "read": true, 00:15:27.170 "write": true, 00:15:27.170 "unmap": true, 00:15:27.170 "write_zeroes": true, 00:15:27.170 "flush": false, 00:15:27.170 "reset": true, 00:15:27.170 "compare": false, 00:15:27.170 "compare_and_write": false, 00:15:27.170 "abort": false, 00:15:27.170 "nvme_admin": false, 00:15:27.170 "nvme_io": false 00:15:27.170 }, 00:15:27.170 "driver_specific": { 00:15:27.170 "lvol": { 00:15:27.170 "lvol_store_uuid": "e44896db-3d11-457a-b3e3-218f3a77c178", 00:15:27.170 "base_bdev": "aio_bdev", 00:15:27.170 "thin_provision": false, 00:15:27.170 "snapshot": false, 00:15:27.170 "clone": false, 00:15:27.170 "esnap_clone": false 00:15:27.170 } 00:15:27.170 } 00:15:27.170 } 00:15:27.170 ] 00:15:27.170 19:03:47 -- common/autotest_common.sh@905 -- # return 0 00:15:27.170 19:03:47 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e44896db-3d11-457a-b3e3-218f3a77c178 00:15:27.170 19:03:47 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:15:27.431 19:03:48 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:15:27.431 19:03:48 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e44896db-3d11-457a-b3e3-218f3a77c178 00:15:27.431 19:03:48 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:15:27.691 19:03:48 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:15:27.691 19:03:48 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete a3382ce7-3cec-48bd-8967-81d6df57d049 00:15:27.950 19:03:48 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u e44896db-3d11-457a-b3e3-218f3a77c178 00:15:28.211 19:03:49 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:28.471 19:03:49 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:28.471 00:15:28.471 real 0m20.201s 00:15:28.471 user 0m50.818s 00:15:28.471 sys 0m4.482s 00:15:28.471 19:03:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:28.471 19:03:49 -- common/autotest_common.sh@10 -- # set +x 00:15:28.471 ************************************ 00:15:28.471 END TEST lvs_grow_dirty 00:15:28.471 ************************************ 00:15:28.471 19:03:49 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:15:28.471 19:03:49 -- common/autotest_common.sh@806 -- # type=--id 00:15:28.471 19:03:49 -- common/autotest_common.sh@807 -- # id=0 00:15:28.472 19:03:49 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:15:28.472 19:03:49 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:15:28.472 19:03:49 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:15:28.472 19:03:49 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:15:28.472 19:03:49 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:15:28.472 19:03:49 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:15:28.472 nvmf_trace.0 00:15:28.472 19:03:49 -- common/autotest_common.sh@821 -- # return 0 00:15:28.472 19:03:49 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:15:28.472 19:03:49 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:28.472 19:03:49 -- nvmf/common.sh@116 -- # sync 00:15:28.472 19:03:49 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:28.472 19:03:49 -- nvmf/common.sh@119 -- # set +e 00:15:28.472 19:03:49 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:28.472 19:03:49 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:28.472 rmmod nvme_tcp 00:15:28.472 rmmod nvme_fabrics 00:15:28.472 rmmod nvme_keyring 00:15:28.472 19:03:49 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:28.472 19:03:49 -- nvmf/common.sh@123 -- # set -e 00:15:28.472 19:03:49 -- nvmf/common.sh@124 -- # return 0 00:15:28.472 19:03:49 -- nvmf/common.sh@477 -- # '[' -n 191991 ']' 00:15:28.472 19:03:49 -- nvmf/common.sh@478 -- # killprocess 191991 00:15:28.472 19:03:49 -- common/autotest_common.sh@936 -- # '[' -z 191991 ']' 00:15:28.472 19:03:49 -- common/autotest_common.sh@940 -- # kill -0 191991 00:15:28.472 19:03:49 -- common/autotest_common.sh@941 -- # uname 00:15:28.472 19:03:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:28.472 19:03:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 191991 00:15:28.472 19:03:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:28.472 19:03:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:28.472 19:03:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 191991' 00:15:28.472 killing process with pid 191991 00:15:28.472 19:03:49 -- common/autotest_common.sh@955 -- # kill 191991 00:15:28.472 19:03:49 -- common/autotest_common.sh@960 -- # wait 191991 00:15:28.731 19:03:49 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:28.731 19:03:49 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:28.731 19:03:49 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:28.731 19:03:49 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:28.731 19:03:49 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:28.731 19:03:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:28.731 19:03:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:28.731 19:03:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:31.282 19:03:51 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:31.282 00:15:31.282 real 0m44.139s 00:15:31.282 user 1m15.143s 00:15:31.282 sys 0m8.222s 00:15:31.282 19:03:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:31.282 19:03:51 -- common/autotest_common.sh@10 -- # set +x 00:15:31.282 ************************************ 00:15:31.282 END TEST nvmf_lvs_grow 00:15:31.282 ************************************ 00:15:31.282 19:03:51 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:15:31.282 19:03:51 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:31.282 19:03:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:31.282 19:03:51 -- common/autotest_common.sh@10 -- # set +x 00:15:31.282 ************************************ 00:15:31.282 START TEST nvmf_bdev_io_wait 00:15:31.282 ************************************ 00:15:31.282 19:03:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:15:31.282 * Looking for test storage... 00:15:31.282 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:31.282 19:03:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:31.282 19:03:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:31.282 19:03:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:31.282 19:03:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:31.282 19:03:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:31.282 19:03:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:31.282 19:03:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:31.282 19:03:51 -- scripts/common.sh@335 -- # IFS=.-: 00:15:31.282 19:03:51 -- scripts/common.sh@335 -- # read -ra ver1 00:15:31.282 19:03:51 -- scripts/common.sh@336 -- # IFS=.-: 00:15:31.282 19:03:51 -- scripts/common.sh@336 -- # read -ra ver2 00:15:31.282 19:03:51 -- scripts/common.sh@337 -- # local 'op=<' 00:15:31.282 19:03:51 -- scripts/common.sh@339 -- # ver1_l=2 00:15:31.282 19:03:51 -- scripts/common.sh@340 -- # ver2_l=1 00:15:31.282 19:03:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:31.282 19:03:51 -- scripts/common.sh@343 -- # case "$op" in 00:15:31.282 19:03:51 -- scripts/common.sh@344 -- # : 1 00:15:31.282 19:03:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:31.282 19:03:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:31.282 19:03:51 -- scripts/common.sh@364 -- # decimal 1 00:15:31.282 19:03:51 -- scripts/common.sh@352 -- # local d=1 00:15:31.282 19:03:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:31.282 19:03:51 -- scripts/common.sh@354 -- # echo 1 00:15:31.282 19:03:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:31.282 19:03:51 -- scripts/common.sh@365 -- # decimal 2 00:15:31.282 19:03:51 -- scripts/common.sh@352 -- # local d=2 00:15:31.282 19:03:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:31.282 19:03:51 -- scripts/common.sh@354 -- # echo 2 00:15:31.282 19:03:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:31.282 19:03:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:31.282 19:03:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:31.282 19:03:51 -- scripts/common.sh@367 -- # return 0 00:15:31.282 19:03:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:31.282 19:03:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:31.283 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:31.283 --rc genhtml_branch_coverage=1 00:15:31.283 --rc genhtml_function_coverage=1 00:15:31.283 --rc genhtml_legend=1 00:15:31.283 --rc geninfo_all_blocks=1 00:15:31.283 --rc geninfo_unexecuted_blocks=1 00:15:31.283 00:15:31.283 ' 00:15:31.283 19:03:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:31.283 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:31.283 --rc genhtml_branch_coverage=1 00:15:31.283 --rc genhtml_function_coverage=1 00:15:31.283 --rc genhtml_legend=1 00:15:31.283 --rc geninfo_all_blocks=1 00:15:31.283 --rc geninfo_unexecuted_blocks=1 00:15:31.283 00:15:31.283 ' 00:15:31.283 19:03:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:31.283 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:31.283 --rc genhtml_branch_coverage=1 00:15:31.283 --rc genhtml_function_coverage=1 00:15:31.283 --rc genhtml_legend=1 00:15:31.283 --rc geninfo_all_blocks=1 00:15:31.283 --rc geninfo_unexecuted_blocks=1 00:15:31.283 00:15:31.283 ' 00:15:31.283 19:03:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:31.283 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:31.283 --rc genhtml_branch_coverage=1 00:15:31.283 --rc genhtml_function_coverage=1 00:15:31.283 --rc genhtml_legend=1 00:15:31.283 --rc geninfo_all_blocks=1 00:15:31.283 --rc geninfo_unexecuted_blocks=1 00:15:31.283 00:15:31.283 ' 00:15:31.283 19:03:51 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:31.283 19:03:51 -- nvmf/common.sh@7 -- # uname -s 00:15:31.283 19:03:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:31.283 19:03:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:31.283 19:03:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:31.283 19:03:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:31.283 19:03:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:31.283 19:03:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:31.283 19:03:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:31.283 19:03:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:31.283 19:03:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:31.283 19:03:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:31.283 19:03:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:31.283 19:03:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:31.283 19:03:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:31.283 19:03:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:31.283 19:03:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:31.283 19:03:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:31.283 19:03:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:31.283 19:03:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:31.283 19:03:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:31.283 19:03:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:31.283 19:03:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:31.283 19:03:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:31.283 19:03:52 -- paths/export.sh@5 -- # export PATH 00:15:31.283 19:03:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:31.283 19:03:52 -- nvmf/common.sh@46 -- # : 0 00:15:31.283 19:03:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:31.283 19:03:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:31.283 19:03:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:31.283 19:03:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:31.283 19:03:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:31.283 19:03:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:31.283 19:03:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:31.283 19:03:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:31.283 19:03:52 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:31.283 19:03:52 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:31.283 19:03:52 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:15:31.283 19:03:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:31.283 19:03:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:31.283 19:03:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:31.283 19:03:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:31.283 19:03:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:31.283 19:03:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:31.283 19:03:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:31.283 19:03:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:31.283 19:03:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:31.283 19:03:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:31.283 19:03:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:31.283 19:03:52 -- common/autotest_common.sh@10 -- # set +x 00:15:33.188 19:03:53 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:33.188 19:03:53 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:33.188 19:03:53 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:33.188 19:03:53 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:33.188 19:03:53 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:33.188 19:03:53 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:33.188 19:03:53 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:33.188 19:03:53 -- nvmf/common.sh@294 -- # net_devs=() 00:15:33.188 19:03:53 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:33.188 19:03:53 -- nvmf/common.sh@295 -- # e810=() 00:15:33.188 19:03:53 -- nvmf/common.sh@295 -- # local -ga e810 00:15:33.188 19:03:53 -- nvmf/common.sh@296 -- # x722=() 00:15:33.188 19:03:53 -- nvmf/common.sh@296 -- # local -ga x722 00:15:33.188 19:03:53 -- nvmf/common.sh@297 -- # mlx=() 00:15:33.188 19:03:53 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:33.188 19:03:53 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:33.188 19:03:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:33.188 19:03:53 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:33.188 19:03:53 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:33.188 19:03:53 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:33.188 19:03:53 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:33.188 19:03:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:33.188 19:03:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:33.188 19:03:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:33.188 19:03:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:33.188 19:03:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:33.188 19:03:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:33.188 19:03:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:33.188 19:03:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:33.188 19:03:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:33.188 19:03:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:33.188 19:03:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:33.188 19:03:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:33.188 19:03:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:33.188 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:33.188 19:03:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:33.188 19:03:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:33.188 19:03:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:33.188 19:03:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:33.188 19:03:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:33.188 19:03:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:33.188 19:03:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:33.188 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:33.188 19:03:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:33.188 19:03:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:33.188 19:03:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:33.188 19:03:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:33.189 19:03:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:33.189 19:03:53 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:33.189 19:03:53 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:33.189 19:03:53 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:33.189 19:03:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:33.189 19:03:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:33.189 19:03:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:33.189 19:03:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:33.189 19:03:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:33.189 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:33.189 19:03:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:33.189 19:03:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:33.189 19:03:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:33.189 19:03:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:33.189 19:03:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:33.189 19:03:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:33.189 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:33.189 19:03:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:33.189 19:03:53 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:33.189 19:03:53 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:33.189 19:03:53 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:33.189 19:03:53 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:33.189 19:03:53 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:33.189 19:03:53 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:33.189 19:03:53 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:33.189 19:03:53 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:33.189 19:03:53 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:33.189 19:03:53 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:33.189 19:03:53 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:33.189 19:03:53 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:33.189 19:03:53 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:33.189 19:03:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:33.189 19:03:53 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:33.189 19:03:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:33.189 19:03:53 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:33.189 19:03:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:33.189 19:03:54 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:33.189 19:03:54 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:33.189 19:03:54 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:33.189 19:03:54 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:33.189 19:03:54 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:33.189 19:03:54 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:33.189 19:03:54 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:33.189 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:33.189 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.194 ms 00:15:33.189 00:15:33.189 --- 10.0.0.2 ping statistics --- 00:15:33.189 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:33.189 rtt min/avg/max/mdev = 0.194/0.194/0.194/0.000 ms 00:15:33.189 19:03:54 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:33.189 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:33.189 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.110 ms 00:15:33.189 00:15:33.189 --- 10.0.0.1 ping statistics --- 00:15:33.189 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:33.189 rtt min/avg/max/mdev = 0.110/0.110/0.110/0.000 ms 00:15:33.189 19:03:54 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:33.189 19:03:54 -- nvmf/common.sh@410 -- # return 0 00:15:33.189 19:03:54 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:33.189 19:03:54 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:33.189 19:03:54 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:33.189 19:03:54 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:33.189 19:03:54 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:33.189 19:03:54 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:33.189 19:03:54 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:33.448 19:03:54 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:15:33.448 19:03:54 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:33.448 19:03:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:33.448 19:03:54 -- common/autotest_common.sh@10 -- # set +x 00:15:33.448 19:03:54 -- nvmf/common.sh@469 -- # nvmfpid=194674 00:15:33.448 19:03:54 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:15:33.448 19:03:54 -- nvmf/common.sh@470 -- # waitforlisten 194674 00:15:33.448 19:03:54 -- common/autotest_common.sh@829 -- # '[' -z 194674 ']' 00:15:33.448 19:03:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:33.448 19:03:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:33.448 19:03:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:33.448 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:33.448 19:03:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:33.448 19:03:54 -- common/autotest_common.sh@10 -- # set +x 00:15:33.448 [2024-11-28 19:03:54.297093] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:33.448 [2024-11-28 19:03:54.297161] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:33.448 EAL: No free 2048 kB hugepages reported on node 1 00:15:33.448 [2024-11-28 19:03:54.367288] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:33.448 [2024-11-28 19:03:54.485972] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:33.448 [2024-11-28 19:03:54.486149] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:33.448 [2024-11-28 19:03:54.486167] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:33.448 [2024-11-28 19:03:54.486196] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:33.448 [2024-11-28 19:03:54.488421] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:33.448 [2024-11-28 19:03:54.488476] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:33.448 [2024-11-28 19:03:54.488568] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:33.448 [2024-11-28 19:03:54.488571] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:33.708 19:03:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:33.708 19:03:54 -- common/autotest_common.sh@862 -- # return 0 00:15:33.708 19:03:54 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:33.708 19:03:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:33.708 19:03:54 -- common/autotest_common.sh@10 -- # set +x 00:15:33.708 19:03:54 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:33.708 19:03:54 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:15:33.708 19:03:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:33.708 19:03:54 -- common/autotest_common.sh@10 -- # set +x 00:15:33.708 19:03:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:33.708 19:03:54 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:15:33.708 19:03:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:33.708 19:03:54 -- common/autotest_common.sh@10 -- # set +x 00:15:33.708 19:03:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:33.708 19:03:54 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:33.708 19:03:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:33.708 19:03:54 -- common/autotest_common.sh@10 -- # set +x 00:15:33.708 [2024-11-28 19:03:54.664347] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:33.708 19:03:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:33.708 19:03:54 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:33.708 19:03:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:33.708 19:03:54 -- common/autotest_common.sh@10 -- # set +x 00:15:33.708 Malloc0 00:15:33.708 19:03:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:33.708 19:03:54 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:33.708 19:03:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:33.708 19:03:54 -- common/autotest_common.sh@10 -- # set +x 00:15:33.708 19:03:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:33.708 19:03:54 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:33.708 19:03:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:33.708 19:03:54 -- common/autotest_common.sh@10 -- # set +x 00:15:33.708 19:03:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:33.708 19:03:54 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:33.708 19:03:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:33.708 19:03:54 -- common/autotest_common.sh@10 -- # set +x 00:15:33.708 [2024-11-28 19:03:54.725896] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:33.708 19:03:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:33.708 19:03:54 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=194803 00:15:33.708 19:03:54 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:15:33.708 19:03:54 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:15:33.708 19:03:54 -- target/bdev_io_wait.sh@30 -- # READ_PID=194806 00:15:33.708 19:03:54 -- nvmf/common.sh@520 -- # config=() 00:15:33.708 19:03:54 -- nvmf/common.sh@520 -- # local subsystem config 00:15:33.708 19:03:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:33.708 19:03:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:33.708 { 00:15:33.708 "params": { 00:15:33.708 "name": "Nvme$subsystem", 00:15:33.708 "trtype": "$TEST_TRANSPORT", 00:15:33.708 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:33.708 "adrfam": "ipv4", 00:15:33.708 "trsvcid": "$NVMF_PORT", 00:15:33.708 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:33.708 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:33.708 "hdgst": ${hdgst:-false}, 00:15:33.708 "ddgst": ${ddgst:-false} 00:15:33.708 }, 00:15:33.708 "method": "bdev_nvme_attach_controller" 00:15:33.709 } 00:15:33.709 EOF 00:15:33.709 )") 00:15:33.709 19:03:54 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=194809 00:15:33.709 19:03:54 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:15:33.709 19:03:54 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:15:33.709 19:03:54 -- nvmf/common.sh@520 -- # config=() 00:15:33.709 19:03:54 -- nvmf/common.sh@520 -- # local subsystem config 00:15:33.709 19:03:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:33.709 19:03:54 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:15:33.709 19:03:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:33.709 { 00:15:33.709 "params": { 00:15:33.709 "name": "Nvme$subsystem", 00:15:33.709 "trtype": "$TEST_TRANSPORT", 00:15:33.709 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:33.709 "adrfam": "ipv4", 00:15:33.709 "trsvcid": "$NVMF_PORT", 00:15:33.709 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:33.709 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:33.709 "hdgst": ${hdgst:-false}, 00:15:33.709 "ddgst": ${ddgst:-false} 00:15:33.709 }, 00:15:33.709 "method": "bdev_nvme_attach_controller" 00:15:33.709 } 00:15:33.709 EOF 00:15:33.709 )") 00:15:33.709 19:03:54 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:15:33.709 19:03:54 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=194813 00:15:33.709 19:03:54 -- nvmf/common.sh@520 -- # config=() 00:15:33.709 19:03:54 -- nvmf/common.sh@542 -- # cat 00:15:33.709 19:03:54 -- target/bdev_io_wait.sh@35 -- # sync 00:15:33.709 19:03:54 -- nvmf/common.sh@520 -- # local subsystem config 00:15:33.709 19:03:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:33.709 19:03:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:33.709 { 00:15:33.709 "params": { 00:15:33.709 "name": "Nvme$subsystem", 00:15:33.709 "trtype": "$TEST_TRANSPORT", 00:15:33.709 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:33.709 "adrfam": "ipv4", 00:15:33.709 "trsvcid": "$NVMF_PORT", 00:15:33.709 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:33.709 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:33.709 "hdgst": ${hdgst:-false}, 00:15:33.709 "ddgst": ${ddgst:-false} 00:15:33.709 }, 00:15:33.709 "method": "bdev_nvme_attach_controller" 00:15:33.709 } 00:15:33.709 EOF 00:15:33.709 )") 00:15:33.709 19:03:54 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:15:33.709 19:03:54 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:15:33.709 19:03:54 -- nvmf/common.sh@542 -- # cat 00:15:33.709 19:03:54 -- nvmf/common.sh@520 -- # config=() 00:15:33.709 19:03:54 -- nvmf/common.sh@520 -- # local subsystem config 00:15:33.709 19:03:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:33.709 19:03:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:33.709 { 00:15:33.709 "params": { 00:15:33.709 "name": "Nvme$subsystem", 00:15:33.709 "trtype": "$TEST_TRANSPORT", 00:15:33.709 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:33.709 "adrfam": "ipv4", 00:15:33.709 "trsvcid": "$NVMF_PORT", 00:15:33.709 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:33.709 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:33.709 "hdgst": ${hdgst:-false}, 00:15:33.709 "ddgst": ${ddgst:-false} 00:15:33.709 }, 00:15:33.709 "method": "bdev_nvme_attach_controller" 00:15:33.709 } 00:15:33.709 EOF 00:15:33.709 )") 00:15:33.709 19:03:54 -- nvmf/common.sh@542 -- # cat 00:15:33.709 19:03:54 -- target/bdev_io_wait.sh@37 -- # wait 194803 00:15:33.709 19:03:54 -- nvmf/common.sh@542 -- # cat 00:15:33.709 19:03:54 -- nvmf/common.sh@544 -- # jq . 00:15:33.709 19:03:54 -- nvmf/common.sh@544 -- # jq . 00:15:33.709 19:03:54 -- nvmf/common.sh@544 -- # jq . 00:15:33.709 19:03:54 -- nvmf/common.sh@545 -- # IFS=, 00:15:33.709 19:03:54 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:33.709 "params": { 00:15:33.709 "name": "Nvme1", 00:15:33.709 "trtype": "tcp", 00:15:33.709 "traddr": "10.0.0.2", 00:15:33.709 "adrfam": "ipv4", 00:15:33.709 "trsvcid": "4420", 00:15:33.709 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:33.709 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:33.709 "hdgst": false, 00:15:33.709 "ddgst": false 00:15:33.709 }, 00:15:33.709 "method": "bdev_nvme_attach_controller" 00:15:33.709 }' 00:15:33.709 19:03:54 -- nvmf/common.sh@544 -- # jq . 00:15:33.709 19:03:54 -- nvmf/common.sh@545 -- # IFS=, 00:15:33.709 19:03:54 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:33.709 "params": { 00:15:33.709 "name": "Nvme1", 00:15:33.709 "trtype": "tcp", 00:15:33.709 "traddr": "10.0.0.2", 00:15:33.709 "adrfam": "ipv4", 00:15:33.709 "trsvcid": "4420", 00:15:33.709 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:33.709 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:33.709 "hdgst": false, 00:15:33.709 "ddgst": false 00:15:33.709 }, 00:15:33.709 "method": "bdev_nvme_attach_controller" 00:15:33.709 }' 00:15:33.709 19:03:54 -- nvmf/common.sh@545 -- # IFS=, 00:15:33.709 19:03:54 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:33.709 "params": { 00:15:33.709 "name": "Nvme1", 00:15:33.709 "trtype": "tcp", 00:15:33.709 "traddr": "10.0.0.2", 00:15:33.709 "adrfam": "ipv4", 00:15:33.709 "trsvcid": "4420", 00:15:33.709 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:33.709 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:33.709 "hdgst": false, 00:15:33.709 "ddgst": false 00:15:33.709 }, 00:15:33.709 "method": "bdev_nvme_attach_controller" 00:15:33.709 }' 00:15:33.709 19:03:54 -- nvmf/common.sh@545 -- # IFS=, 00:15:33.709 19:03:54 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:33.709 "params": { 00:15:33.709 "name": "Nvme1", 00:15:33.709 "trtype": "tcp", 00:15:33.709 "traddr": "10.0.0.2", 00:15:33.709 "adrfam": "ipv4", 00:15:33.709 "trsvcid": "4420", 00:15:33.709 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:15:33.709 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:15:33.709 "hdgst": false, 00:15:33.709 "ddgst": false 00:15:33.709 }, 00:15:33.709 "method": "bdev_nvme_attach_controller" 00:15:33.709 }' 00:15:33.969 [2024-11-28 19:03:54.768718] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:33.969 [2024-11-28 19:03:54.768718] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:33.969 [2024-11-28 19:03:54.768719] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:33.969 [2024-11-28 19:03:54.768802] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-28 19:03:54.768803] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-28 19:03:54.768803] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:15:33.969 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:15:33.969 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:15:33.969 [2024-11-28 19:03:54.769171] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:33.969 [2024-11-28 19:03:54.769239] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:15:33.969 EAL: No free 2048 kB hugepages reported on node 1 00:15:33.969 EAL: No free 2048 kB hugepages reported on node 1 00:15:33.969 [2024-11-28 19:03:54.942792] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:33.969 EAL: No free 2048 kB hugepages reported on node 1 00:15:34.228 [2024-11-28 19:03:55.037210] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:15:34.229 [2024-11-28 19:03:55.041571] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:34.229 EAL: No free 2048 kB hugepages reported on node 1 00:15:34.229 [2024-11-28 19:03:55.137367] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:15:34.229 [2024-11-28 19:03:55.139914] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:34.229 [2024-11-28 19:03:55.216857] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:34.229 [2024-11-28 19:03:55.240313] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:15:34.487 [2024-11-28 19:03:55.310402] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:15:34.487 Running I/O for 1 seconds... 00:15:34.487 Running I/O for 1 seconds... 00:15:34.487 Running I/O for 1 seconds... 00:15:34.746 Running I/O for 1 seconds... 00:15:35.684 00:15:35.684 Latency(us) 00:15:35.684 [2024-11-28T18:03:56.732Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:35.684 [2024-11-28T18:03:56.732Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:15:35.684 Nvme1n1 : 1.01 13228.45 51.67 0.00 0.00 9645.96 5072.97 19320.98 00:15:35.684 [2024-11-28T18:03:56.732Z] =================================================================================================================== 00:15:35.684 [2024-11-28T18:03:56.733Z] Total : 13228.45 51.67 0.00 0.00 9645.96 5072.97 19320.98 00:15:35.685 00:15:35.685 Latency(us) 00:15:35.685 [2024-11-28T18:03:56.733Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:35.685 [2024-11-28T18:03:56.733Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:15:35.685 Nvme1n1 : 1.02 4700.41 18.36 0.00 0.00 26929.98 8980.86 36117.62 00:15:35.685 [2024-11-28T18:03:56.733Z] =================================================================================================================== 00:15:35.685 [2024-11-28T18:03:56.733Z] Total : 4700.41 18.36 0.00 0.00 26929.98 8980.86 36117.62 00:15:35.685 00:15:35.685 Latency(us) 00:15:35.685 [2024-11-28T18:03:56.733Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:35.685 [2024-11-28T18:03:56.733Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:15:35.685 Nvme1n1 : 1.00 202536.81 791.16 0.00 0.00 629.49 259.41 758.52 00:15:35.685 [2024-11-28T18:03:56.733Z] =================================================================================================================== 00:15:35.685 [2024-11-28T18:03:56.733Z] Total : 202536.81 791.16 0.00 0.00 629.49 259.41 758.52 00:15:35.685 00:15:35.685 Latency(us) 00:15:35.685 [2024-11-28T18:03:56.733Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:35.685 [2024-11-28T18:03:56.733Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:15:35.685 Nvme1n1 : 1.01 4758.51 18.59 0.00 0.00 26775.22 8543.95 50098.63 00:15:35.685 [2024-11-28T18:03:56.733Z] =================================================================================================================== 00:15:35.685 [2024-11-28T18:03:56.733Z] Total : 4758.51 18.59 0.00 0.00 26775.22 8543.95 50098.63 00:15:35.944 19:03:56 -- target/bdev_io_wait.sh@38 -- # wait 194806 00:15:35.944 19:03:56 -- target/bdev_io_wait.sh@39 -- # wait 194809 00:15:35.944 19:03:56 -- target/bdev_io_wait.sh@40 -- # wait 194813 00:15:35.944 19:03:56 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:35.944 19:03:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:35.944 19:03:56 -- common/autotest_common.sh@10 -- # set +x 00:15:35.944 19:03:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:35.944 19:03:56 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:15:35.944 19:03:56 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:15:35.944 19:03:56 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:35.944 19:03:56 -- nvmf/common.sh@116 -- # sync 00:15:35.944 19:03:56 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:35.944 19:03:56 -- nvmf/common.sh@119 -- # set +e 00:15:35.944 19:03:56 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:35.944 19:03:56 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:35.944 rmmod nvme_tcp 00:15:35.944 rmmod nvme_fabrics 00:15:36.202 rmmod nvme_keyring 00:15:36.202 19:03:57 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:36.202 19:03:57 -- nvmf/common.sh@123 -- # set -e 00:15:36.202 19:03:57 -- nvmf/common.sh@124 -- # return 0 00:15:36.202 19:03:57 -- nvmf/common.sh@477 -- # '[' -n 194674 ']' 00:15:36.202 19:03:57 -- nvmf/common.sh@478 -- # killprocess 194674 00:15:36.202 19:03:57 -- common/autotest_common.sh@936 -- # '[' -z 194674 ']' 00:15:36.202 19:03:57 -- common/autotest_common.sh@940 -- # kill -0 194674 00:15:36.202 19:03:57 -- common/autotest_common.sh@941 -- # uname 00:15:36.202 19:03:57 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:36.202 19:03:57 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 194674 00:15:36.202 19:03:57 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:36.202 19:03:57 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:36.202 19:03:57 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 194674' 00:15:36.202 killing process with pid 194674 00:15:36.202 19:03:57 -- common/autotest_common.sh@955 -- # kill 194674 00:15:36.202 19:03:57 -- common/autotest_common.sh@960 -- # wait 194674 00:15:36.463 19:03:57 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:36.463 19:03:57 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:36.463 19:03:57 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:36.463 19:03:57 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:36.463 19:03:57 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:36.463 19:03:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:36.463 19:03:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:36.463 19:03:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:38.374 19:03:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:38.374 00:15:38.374 real 0m7.513s 00:15:38.374 user 0m17.509s 00:15:38.374 sys 0m3.441s 00:15:38.374 19:03:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:38.374 19:03:59 -- common/autotest_common.sh@10 -- # set +x 00:15:38.374 ************************************ 00:15:38.374 END TEST nvmf_bdev_io_wait 00:15:38.374 ************************************ 00:15:38.374 19:03:59 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:38.374 19:03:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:38.374 19:03:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:38.374 19:03:59 -- common/autotest_common.sh@10 -- # set +x 00:15:38.374 ************************************ 00:15:38.374 START TEST nvmf_queue_depth 00:15:38.374 ************************************ 00:15:38.374 19:03:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:15:38.634 * Looking for test storage... 00:15:38.634 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:38.634 19:03:59 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:38.634 19:03:59 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:38.634 19:03:59 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:38.634 19:03:59 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:38.634 19:03:59 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:38.634 19:03:59 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:38.634 19:03:59 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:38.634 19:03:59 -- scripts/common.sh@335 -- # IFS=.-: 00:15:38.634 19:03:59 -- scripts/common.sh@335 -- # read -ra ver1 00:15:38.634 19:03:59 -- scripts/common.sh@336 -- # IFS=.-: 00:15:38.634 19:03:59 -- scripts/common.sh@336 -- # read -ra ver2 00:15:38.634 19:03:59 -- scripts/common.sh@337 -- # local 'op=<' 00:15:38.634 19:03:59 -- scripts/common.sh@339 -- # ver1_l=2 00:15:38.634 19:03:59 -- scripts/common.sh@340 -- # ver2_l=1 00:15:38.634 19:03:59 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:38.634 19:03:59 -- scripts/common.sh@343 -- # case "$op" in 00:15:38.634 19:03:59 -- scripts/common.sh@344 -- # : 1 00:15:38.634 19:03:59 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:38.634 19:03:59 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:38.634 19:03:59 -- scripts/common.sh@364 -- # decimal 1 00:15:38.634 19:03:59 -- scripts/common.sh@352 -- # local d=1 00:15:38.634 19:03:59 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:38.634 19:03:59 -- scripts/common.sh@354 -- # echo 1 00:15:38.634 19:03:59 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:38.634 19:03:59 -- scripts/common.sh@365 -- # decimal 2 00:15:38.634 19:03:59 -- scripts/common.sh@352 -- # local d=2 00:15:38.634 19:03:59 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:38.634 19:03:59 -- scripts/common.sh@354 -- # echo 2 00:15:38.634 19:03:59 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:38.634 19:03:59 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:38.634 19:03:59 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:38.634 19:03:59 -- scripts/common.sh@367 -- # return 0 00:15:38.634 19:03:59 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:38.634 19:03:59 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:38.634 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:38.634 --rc genhtml_branch_coverage=1 00:15:38.634 --rc genhtml_function_coverage=1 00:15:38.634 --rc genhtml_legend=1 00:15:38.634 --rc geninfo_all_blocks=1 00:15:38.634 --rc geninfo_unexecuted_blocks=1 00:15:38.634 00:15:38.634 ' 00:15:38.634 19:03:59 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:38.634 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:38.634 --rc genhtml_branch_coverage=1 00:15:38.634 --rc genhtml_function_coverage=1 00:15:38.634 --rc genhtml_legend=1 00:15:38.634 --rc geninfo_all_blocks=1 00:15:38.634 --rc geninfo_unexecuted_blocks=1 00:15:38.634 00:15:38.634 ' 00:15:38.634 19:03:59 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:38.634 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:38.634 --rc genhtml_branch_coverage=1 00:15:38.634 --rc genhtml_function_coverage=1 00:15:38.634 --rc genhtml_legend=1 00:15:38.634 --rc geninfo_all_blocks=1 00:15:38.634 --rc geninfo_unexecuted_blocks=1 00:15:38.634 00:15:38.634 ' 00:15:38.634 19:03:59 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:38.634 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:38.634 --rc genhtml_branch_coverage=1 00:15:38.634 --rc genhtml_function_coverage=1 00:15:38.634 --rc genhtml_legend=1 00:15:38.634 --rc geninfo_all_blocks=1 00:15:38.634 --rc geninfo_unexecuted_blocks=1 00:15:38.634 00:15:38.634 ' 00:15:38.634 19:03:59 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:38.634 19:03:59 -- nvmf/common.sh@7 -- # uname -s 00:15:38.634 19:03:59 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:38.634 19:03:59 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:38.634 19:03:59 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:38.634 19:03:59 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:38.634 19:03:59 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:38.634 19:03:59 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:38.634 19:03:59 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:38.634 19:03:59 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:38.634 19:03:59 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:38.634 19:03:59 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:38.634 19:03:59 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:38.634 19:03:59 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:38.634 19:03:59 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:38.634 19:03:59 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:38.634 19:03:59 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:38.634 19:03:59 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:38.634 19:03:59 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:38.634 19:03:59 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:38.634 19:03:59 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:38.634 19:03:59 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:38.634 19:03:59 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:38.634 19:03:59 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:38.634 19:03:59 -- paths/export.sh@5 -- # export PATH 00:15:38.634 19:03:59 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:38.634 19:03:59 -- nvmf/common.sh@46 -- # : 0 00:15:38.634 19:03:59 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:38.634 19:03:59 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:38.634 19:03:59 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:38.634 19:03:59 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:38.634 19:03:59 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:38.634 19:03:59 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:38.634 19:03:59 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:38.634 19:03:59 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:38.634 19:03:59 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:15:38.634 19:03:59 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:15:38.634 19:03:59 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:15:38.634 19:03:59 -- target/queue_depth.sh@19 -- # nvmftestinit 00:15:38.634 19:03:59 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:38.634 19:03:59 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:38.634 19:03:59 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:38.634 19:03:59 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:38.634 19:03:59 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:38.634 19:03:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:38.634 19:03:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:38.634 19:03:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:38.634 19:03:59 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:38.634 19:03:59 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:38.634 19:03:59 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:38.634 19:03:59 -- common/autotest_common.sh@10 -- # set +x 00:15:40.541 19:04:01 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:40.541 19:04:01 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:40.541 19:04:01 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:40.541 19:04:01 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:40.541 19:04:01 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:40.541 19:04:01 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:40.541 19:04:01 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:40.541 19:04:01 -- nvmf/common.sh@294 -- # net_devs=() 00:15:40.541 19:04:01 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:40.541 19:04:01 -- nvmf/common.sh@295 -- # e810=() 00:15:40.541 19:04:01 -- nvmf/common.sh@295 -- # local -ga e810 00:15:40.541 19:04:01 -- nvmf/common.sh@296 -- # x722=() 00:15:40.541 19:04:01 -- nvmf/common.sh@296 -- # local -ga x722 00:15:40.541 19:04:01 -- nvmf/common.sh@297 -- # mlx=() 00:15:40.541 19:04:01 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:40.541 19:04:01 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:40.541 19:04:01 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:40.541 19:04:01 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:40.541 19:04:01 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:40.541 19:04:01 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:40.541 19:04:01 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:40.541 19:04:01 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:40.541 19:04:01 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:40.541 19:04:01 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:40.541 19:04:01 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:40.541 19:04:01 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:40.541 19:04:01 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:40.541 19:04:01 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:40.541 19:04:01 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:40.541 19:04:01 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:40.541 19:04:01 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:40.541 19:04:01 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:40.541 19:04:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:40.541 19:04:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:40.541 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:40.541 19:04:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:40.541 19:04:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:40.541 19:04:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:40.541 19:04:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:40.541 19:04:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:40.541 19:04:01 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:40.541 19:04:01 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:40.541 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:40.541 19:04:01 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:40.541 19:04:01 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:40.541 19:04:01 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:40.541 19:04:01 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:40.541 19:04:01 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:40.541 19:04:01 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:40.541 19:04:01 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:40.541 19:04:01 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:40.541 19:04:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:40.541 19:04:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:40.541 19:04:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:40.541 19:04:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:40.541 19:04:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:40.541 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:40.541 19:04:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:40.542 19:04:01 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:40.542 19:04:01 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:40.542 19:04:01 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:40.542 19:04:01 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:40.542 19:04:01 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:40.542 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:40.542 19:04:01 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:40.542 19:04:01 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:40.542 19:04:01 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:40.542 19:04:01 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:40.542 19:04:01 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:40.542 19:04:01 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:40.542 19:04:01 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:40.542 19:04:01 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:40.542 19:04:01 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:40.542 19:04:01 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:40.542 19:04:01 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:40.542 19:04:01 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:40.542 19:04:01 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:40.542 19:04:01 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:40.542 19:04:01 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:40.542 19:04:01 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:40.542 19:04:01 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:40.542 19:04:01 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:40.542 19:04:01 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:40.542 19:04:01 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:40.542 19:04:01 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:40.802 19:04:01 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:40.802 19:04:01 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:40.802 19:04:01 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:40.802 19:04:01 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:40.802 19:04:01 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:40.802 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:40.802 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.189 ms 00:15:40.802 00:15:40.802 --- 10.0.0.2 ping statistics --- 00:15:40.802 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:40.802 rtt min/avg/max/mdev = 0.189/0.189/0.189/0.000 ms 00:15:40.802 19:04:01 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:40.802 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:40.802 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.043 ms 00:15:40.802 00:15:40.802 --- 10.0.0.1 ping statistics --- 00:15:40.802 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:40.802 rtt min/avg/max/mdev = 0.043/0.043/0.043/0.000 ms 00:15:40.802 19:04:01 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:40.802 19:04:01 -- nvmf/common.sh@410 -- # return 0 00:15:40.802 19:04:01 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:40.802 19:04:01 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:40.802 19:04:01 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:40.802 19:04:01 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:40.802 19:04:01 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:40.802 19:04:01 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:40.802 19:04:01 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:40.802 19:04:01 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:15:40.802 19:04:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:40.802 19:04:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:40.802 19:04:01 -- common/autotest_common.sh@10 -- # set +x 00:15:40.802 19:04:01 -- nvmf/common.sh@469 -- # nvmfpid=197073 00:15:40.802 19:04:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:15:40.802 19:04:01 -- nvmf/common.sh@470 -- # waitforlisten 197073 00:15:40.802 19:04:01 -- common/autotest_common.sh@829 -- # '[' -z 197073 ']' 00:15:40.802 19:04:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:40.802 19:04:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:40.802 19:04:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:40.802 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:40.802 19:04:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:40.802 19:04:01 -- common/autotest_common.sh@10 -- # set +x 00:15:40.802 [2024-11-28 19:04:01.710864] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:40.802 [2024-11-28 19:04:01.710928] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:40.802 EAL: No free 2048 kB hugepages reported on node 1 00:15:40.802 [2024-11-28 19:04:01.777480] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:41.063 [2024-11-28 19:04:01.894871] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:41.063 [2024-11-28 19:04:01.895043] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:41.063 [2024-11-28 19:04:01.895061] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:41.063 [2024-11-28 19:04:01.895074] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:41.063 [2024-11-28 19:04:01.895104] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:42.000 19:04:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:42.000 19:04:02 -- common/autotest_common.sh@862 -- # return 0 00:15:42.000 19:04:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:42.000 19:04:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:42.000 19:04:02 -- common/autotest_common.sh@10 -- # set +x 00:15:42.000 19:04:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:42.000 19:04:02 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:42.000 19:04:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:42.000 19:04:02 -- common/autotest_common.sh@10 -- # set +x 00:15:42.000 [2024-11-28 19:04:02.757144] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:42.000 19:04:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:42.000 19:04:02 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:42.000 19:04:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:42.000 19:04:02 -- common/autotest_common.sh@10 -- # set +x 00:15:42.000 Malloc0 00:15:42.000 19:04:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:42.000 19:04:02 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:15:42.000 19:04:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:42.000 19:04:02 -- common/autotest_common.sh@10 -- # set +x 00:15:42.000 19:04:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:42.000 19:04:02 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:42.000 19:04:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:42.000 19:04:02 -- common/autotest_common.sh@10 -- # set +x 00:15:42.000 19:04:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:42.000 19:04:02 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:42.000 19:04:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:42.000 19:04:02 -- common/autotest_common.sh@10 -- # set +x 00:15:42.000 [2024-11-28 19:04:02.818294] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:42.000 19:04:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:42.000 19:04:02 -- target/queue_depth.sh@30 -- # bdevperf_pid=197230 00:15:42.000 19:04:02 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:15:42.000 19:04:02 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:42.000 19:04:02 -- target/queue_depth.sh@33 -- # waitforlisten 197230 /var/tmp/bdevperf.sock 00:15:42.000 19:04:02 -- common/autotest_common.sh@829 -- # '[' -z 197230 ']' 00:15:42.000 19:04:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:42.000 19:04:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:42.000 19:04:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:42.000 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:42.000 19:04:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:42.000 19:04:02 -- common/autotest_common.sh@10 -- # set +x 00:15:42.000 [2024-11-28 19:04:02.860999] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:42.000 [2024-11-28 19:04:02.861072] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid197230 ] 00:15:42.000 EAL: No free 2048 kB hugepages reported on node 1 00:15:42.000 [2024-11-28 19:04:02.922260] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:42.000 [2024-11-28 19:04:03.035545] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:42.941 19:04:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:42.941 19:04:03 -- common/autotest_common.sh@862 -- # return 0 00:15:42.941 19:04:03 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:15:42.941 19:04:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:42.941 19:04:03 -- common/autotest_common.sh@10 -- # set +x 00:15:43.201 NVMe0n1 00:15:43.201 19:04:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:43.201 19:04:04 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:43.201 Running I/O for 10 seconds... 00:15:55.420 00:15:55.420 Latency(us) 00:15:55.420 [2024-11-28T18:04:16.468Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:55.420 [2024-11-28T18:04:16.468Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:15:55.420 Verification LBA range: start 0x0 length 0x4000 00:15:55.420 NVMe0n1 : 10.07 12524.24 48.92 0.00 0.00 81438.84 14854.83 61361.11 00:15:55.420 [2024-11-28T18:04:16.468Z] =================================================================================================================== 00:15:55.420 [2024-11-28T18:04:16.468Z] Total : 12524.24 48.92 0.00 0.00 81438.84 14854.83 61361.11 00:15:55.420 0 00:15:55.420 19:04:14 -- target/queue_depth.sh@39 -- # killprocess 197230 00:15:55.420 19:04:14 -- common/autotest_common.sh@936 -- # '[' -z 197230 ']' 00:15:55.420 19:04:14 -- common/autotest_common.sh@940 -- # kill -0 197230 00:15:55.420 19:04:14 -- common/autotest_common.sh@941 -- # uname 00:15:55.420 19:04:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:55.420 19:04:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 197230 00:15:55.420 19:04:14 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:55.420 19:04:14 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:55.421 19:04:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 197230' 00:15:55.421 killing process with pid 197230 00:15:55.421 19:04:14 -- common/autotest_common.sh@955 -- # kill 197230 00:15:55.421 Received shutdown signal, test time was about 10.000000 seconds 00:15:55.421 00:15:55.421 Latency(us) 00:15:55.421 [2024-11-28T18:04:16.469Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:55.421 [2024-11-28T18:04:16.469Z] =================================================================================================================== 00:15:55.421 [2024-11-28T18:04:16.469Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:55.421 19:04:14 -- common/autotest_common.sh@960 -- # wait 197230 00:15:55.421 19:04:14 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:15:55.421 19:04:14 -- target/queue_depth.sh@43 -- # nvmftestfini 00:15:55.421 19:04:14 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:55.421 19:04:14 -- nvmf/common.sh@116 -- # sync 00:15:55.421 19:04:14 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:55.421 19:04:14 -- nvmf/common.sh@119 -- # set +e 00:15:55.421 19:04:14 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:55.421 19:04:14 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:55.421 rmmod nvme_tcp 00:15:55.421 rmmod nvme_fabrics 00:15:55.421 rmmod nvme_keyring 00:15:55.421 19:04:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:55.421 19:04:14 -- nvmf/common.sh@123 -- # set -e 00:15:55.421 19:04:14 -- nvmf/common.sh@124 -- # return 0 00:15:55.421 19:04:14 -- nvmf/common.sh@477 -- # '[' -n 197073 ']' 00:15:55.421 19:04:14 -- nvmf/common.sh@478 -- # killprocess 197073 00:15:55.421 19:04:14 -- common/autotest_common.sh@936 -- # '[' -z 197073 ']' 00:15:55.421 19:04:14 -- common/autotest_common.sh@940 -- # kill -0 197073 00:15:55.421 19:04:14 -- common/autotest_common.sh@941 -- # uname 00:15:55.421 19:04:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:55.421 19:04:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 197073 00:15:55.421 19:04:14 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:55.421 19:04:14 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:55.421 19:04:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 197073' 00:15:55.421 killing process with pid 197073 00:15:55.421 19:04:14 -- common/autotest_common.sh@955 -- # kill 197073 00:15:55.421 19:04:14 -- common/autotest_common.sh@960 -- # wait 197073 00:15:55.421 19:04:14 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:55.421 19:04:14 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:55.421 19:04:14 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:55.421 19:04:14 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:55.421 19:04:14 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:55.421 19:04:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:55.421 19:04:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:55.421 19:04:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:55.988 19:04:17 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:55.988 00:15:55.988 real 0m17.649s 00:15:55.988 user 0m25.461s 00:15:55.988 sys 0m3.105s 00:15:55.988 19:04:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:55.988 19:04:17 -- common/autotest_common.sh@10 -- # set +x 00:15:55.988 ************************************ 00:15:55.988 END TEST nvmf_queue_depth 00:15:55.988 ************************************ 00:15:56.249 19:04:17 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:56.249 19:04:17 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:56.249 19:04:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:56.249 19:04:17 -- common/autotest_common.sh@10 -- # set +x 00:15:56.249 ************************************ 00:15:56.249 START TEST nvmf_multipath 00:15:56.249 ************************************ 00:15:56.249 19:04:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:15:56.249 * Looking for test storage... 00:15:56.249 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:56.249 19:04:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:56.249 19:04:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:56.249 19:04:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:56.249 19:04:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:56.249 19:04:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:56.249 19:04:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:56.249 19:04:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:56.249 19:04:17 -- scripts/common.sh@335 -- # IFS=.-: 00:15:56.249 19:04:17 -- scripts/common.sh@335 -- # read -ra ver1 00:15:56.249 19:04:17 -- scripts/common.sh@336 -- # IFS=.-: 00:15:56.249 19:04:17 -- scripts/common.sh@336 -- # read -ra ver2 00:15:56.249 19:04:17 -- scripts/common.sh@337 -- # local 'op=<' 00:15:56.249 19:04:17 -- scripts/common.sh@339 -- # ver1_l=2 00:15:56.249 19:04:17 -- scripts/common.sh@340 -- # ver2_l=1 00:15:56.249 19:04:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:56.249 19:04:17 -- scripts/common.sh@343 -- # case "$op" in 00:15:56.249 19:04:17 -- scripts/common.sh@344 -- # : 1 00:15:56.249 19:04:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:56.249 19:04:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:56.249 19:04:17 -- scripts/common.sh@364 -- # decimal 1 00:15:56.249 19:04:17 -- scripts/common.sh@352 -- # local d=1 00:15:56.249 19:04:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:56.249 19:04:17 -- scripts/common.sh@354 -- # echo 1 00:15:56.249 19:04:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:56.249 19:04:17 -- scripts/common.sh@365 -- # decimal 2 00:15:56.249 19:04:17 -- scripts/common.sh@352 -- # local d=2 00:15:56.249 19:04:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:56.249 19:04:17 -- scripts/common.sh@354 -- # echo 2 00:15:56.249 19:04:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:56.249 19:04:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:56.249 19:04:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:56.249 19:04:17 -- scripts/common.sh@367 -- # return 0 00:15:56.249 19:04:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:56.249 19:04:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:56.249 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:56.249 --rc genhtml_branch_coverage=1 00:15:56.249 --rc genhtml_function_coverage=1 00:15:56.249 --rc genhtml_legend=1 00:15:56.249 --rc geninfo_all_blocks=1 00:15:56.249 --rc geninfo_unexecuted_blocks=1 00:15:56.249 00:15:56.249 ' 00:15:56.249 19:04:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:56.249 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:56.249 --rc genhtml_branch_coverage=1 00:15:56.249 --rc genhtml_function_coverage=1 00:15:56.249 --rc genhtml_legend=1 00:15:56.249 --rc geninfo_all_blocks=1 00:15:56.249 --rc geninfo_unexecuted_blocks=1 00:15:56.249 00:15:56.249 ' 00:15:56.249 19:04:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:56.249 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:56.249 --rc genhtml_branch_coverage=1 00:15:56.249 --rc genhtml_function_coverage=1 00:15:56.249 --rc genhtml_legend=1 00:15:56.249 --rc geninfo_all_blocks=1 00:15:56.249 --rc geninfo_unexecuted_blocks=1 00:15:56.249 00:15:56.249 ' 00:15:56.249 19:04:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:56.249 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:56.249 --rc genhtml_branch_coverage=1 00:15:56.249 --rc genhtml_function_coverage=1 00:15:56.249 --rc genhtml_legend=1 00:15:56.249 --rc geninfo_all_blocks=1 00:15:56.249 --rc geninfo_unexecuted_blocks=1 00:15:56.250 00:15:56.250 ' 00:15:56.250 19:04:17 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:56.250 19:04:17 -- nvmf/common.sh@7 -- # uname -s 00:15:56.250 19:04:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:56.250 19:04:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:56.250 19:04:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:56.250 19:04:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:56.250 19:04:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:56.250 19:04:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:56.250 19:04:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:56.250 19:04:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:56.250 19:04:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:56.250 19:04:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:56.250 19:04:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:56.250 19:04:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:56.250 19:04:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:56.250 19:04:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:56.250 19:04:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:56.250 19:04:17 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:56.250 19:04:17 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:56.250 19:04:17 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:56.250 19:04:17 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:56.250 19:04:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:56.250 19:04:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:56.250 19:04:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:56.250 19:04:17 -- paths/export.sh@5 -- # export PATH 00:15:56.250 19:04:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:56.250 19:04:17 -- nvmf/common.sh@46 -- # : 0 00:15:56.250 19:04:17 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:56.250 19:04:17 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:56.250 19:04:17 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:56.250 19:04:17 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:56.250 19:04:17 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:56.250 19:04:17 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:56.250 19:04:17 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:56.250 19:04:17 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:56.250 19:04:17 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:56.250 19:04:17 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:56.250 19:04:17 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:15:56.250 19:04:17 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:56.250 19:04:17 -- target/multipath.sh@43 -- # nvmftestinit 00:15:56.250 19:04:17 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:56.250 19:04:17 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:56.250 19:04:17 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:56.250 19:04:17 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:56.250 19:04:17 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:56.250 19:04:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:56.250 19:04:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:56.250 19:04:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:56.250 19:04:17 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:56.250 19:04:17 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:56.250 19:04:17 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:56.250 19:04:17 -- common/autotest_common.sh@10 -- # set +x 00:15:58.790 19:04:19 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:58.790 19:04:19 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:58.790 19:04:19 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:58.790 19:04:19 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:58.790 19:04:19 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:58.790 19:04:19 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:58.790 19:04:19 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:58.790 19:04:19 -- nvmf/common.sh@294 -- # net_devs=() 00:15:58.790 19:04:19 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:58.790 19:04:19 -- nvmf/common.sh@295 -- # e810=() 00:15:58.790 19:04:19 -- nvmf/common.sh@295 -- # local -ga e810 00:15:58.790 19:04:19 -- nvmf/common.sh@296 -- # x722=() 00:15:58.790 19:04:19 -- nvmf/common.sh@296 -- # local -ga x722 00:15:58.790 19:04:19 -- nvmf/common.sh@297 -- # mlx=() 00:15:58.790 19:04:19 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:58.790 19:04:19 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:58.790 19:04:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:58.790 19:04:19 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:58.790 19:04:19 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:58.790 19:04:19 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:58.790 19:04:19 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:58.790 19:04:19 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:58.790 19:04:19 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:58.790 19:04:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:58.790 19:04:19 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:58.790 19:04:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:58.790 19:04:19 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:58.790 19:04:19 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:58.790 19:04:19 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:58.790 19:04:19 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:58.790 19:04:19 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:58.790 19:04:19 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:58.790 19:04:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:58.790 19:04:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:58.790 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:58.790 19:04:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:58.790 19:04:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:58.790 19:04:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:58.790 19:04:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:58.790 19:04:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:58.790 19:04:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:58.790 19:04:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:58.790 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:58.790 19:04:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:58.790 19:04:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:58.790 19:04:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:58.790 19:04:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:58.790 19:04:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:58.790 19:04:19 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:58.790 19:04:19 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:58.790 19:04:19 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:58.790 19:04:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:58.790 19:04:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:58.790 19:04:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:58.790 19:04:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:58.790 19:04:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:58.790 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:58.790 19:04:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:58.790 19:04:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:58.790 19:04:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:58.790 19:04:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:58.790 19:04:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:58.790 19:04:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:58.790 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:58.790 19:04:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:58.790 19:04:19 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:58.790 19:04:19 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:58.790 19:04:19 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:58.790 19:04:19 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:58.790 19:04:19 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:58.790 19:04:19 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:58.790 19:04:19 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:58.790 19:04:19 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:58.790 19:04:19 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:58.790 19:04:19 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:58.790 19:04:19 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:58.790 19:04:19 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:58.790 19:04:19 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:58.790 19:04:19 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:58.790 19:04:19 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:58.790 19:04:19 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:58.790 19:04:19 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:58.790 19:04:19 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:58.790 19:04:19 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:58.790 19:04:19 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:58.790 19:04:19 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:58.790 19:04:19 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:58.790 19:04:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:58.791 19:04:19 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:58.791 19:04:19 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:58.791 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:58.791 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.286 ms 00:15:58.791 00:15:58.791 --- 10.0.0.2 ping statistics --- 00:15:58.791 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:58.791 rtt min/avg/max/mdev = 0.286/0.286/0.286/0.000 ms 00:15:58.791 19:04:19 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:58.791 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:58.791 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.132 ms 00:15:58.791 00:15:58.791 --- 10.0.0.1 ping statistics --- 00:15:58.791 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:58.791 rtt min/avg/max/mdev = 0.132/0.132/0.132/0.000 ms 00:15:58.791 19:04:19 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:58.791 19:04:19 -- nvmf/common.sh@410 -- # return 0 00:15:58.791 19:04:19 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:58.791 19:04:19 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:58.791 19:04:19 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:58.791 19:04:19 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:58.791 19:04:19 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:58.791 19:04:19 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:58.791 19:04:19 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:58.791 19:04:19 -- target/multipath.sh@45 -- # '[' -z ']' 00:15:58.791 19:04:19 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:15:58.791 only one NIC for nvmf test 00:15:58.791 19:04:19 -- target/multipath.sh@47 -- # nvmftestfini 00:15:58.791 19:04:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:58.791 19:04:19 -- nvmf/common.sh@116 -- # sync 00:15:58.791 19:04:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:58.791 19:04:19 -- nvmf/common.sh@119 -- # set +e 00:15:58.791 19:04:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:58.791 19:04:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:58.791 rmmod nvme_tcp 00:15:58.791 rmmod nvme_fabrics 00:15:58.791 rmmod nvme_keyring 00:15:58.791 19:04:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:58.791 19:04:19 -- nvmf/common.sh@123 -- # set -e 00:15:58.791 19:04:19 -- nvmf/common.sh@124 -- # return 0 00:15:58.791 19:04:19 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:15:58.791 19:04:19 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:58.791 19:04:19 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:58.791 19:04:19 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:58.791 19:04:19 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:58.791 19:04:19 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:58.791 19:04:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:58.791 19:04:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:58.791 19:04:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:00.703 19:04:21 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:00.703 19:04:21 -- target/multipath.sh@48 -- # exit 0 00:16:00.703 19:04:21 -- target/multipath.sh@1 -- # nvmftestfini 00:16:00.703 19:04:21 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:00.703 19:04:21 -- nvmf/common.sh@116 -- # sync 00:16:00.703 19:04:21 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:00.703 19:04:21 -- nvmf/common.sh@119 -- # set +e 00:16:00.703 19:04:21 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:00.703 19:04:21 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:00.703 19:04:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:00.703 19:04:21 -- nvmf/common.sh@123 -- # set -e 00:16:00.703 19:04:21 -- nvmf/common.sh@124 -- # return 0 00:16:00.703 19:04:21 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:16:00.703 19:04:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:00.703 19:04:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:00.703 19:04:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:00.703 19:04:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:00.703 19:04:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:00.703 19:04:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:00.703 19:04:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:00.703 19:04:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:00.703 19:04:21 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:00.703 00:16:00.703 real 0m4.509s 00:16:00.703 user 0m0.902s 00:16:00.703 sys 0m1.616s 00:16:00.703 19:04:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:00.703 19:04:21 -- common/autotest_common.sh@10 -- # set +x 00:16:00.703 ************************************ 00:16:00.703 END TEST nvmf_multipath 00:16:00.703 ************************************ 00:16:00.703 19:04:21 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:16:00.703 19:04:21 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:00.703 19:04:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:00.703 19:04:21 -- common/autotest_common.sh@10 -- # set +x 00:16:00.703 ************************************ 00:16:00.703 START TEST nvmf_zcopy 00:16:00.703 ************************************ 00:16:00.703 19:04:21 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:16:00.703 * Looking for test storage... 00:16:00.703 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:00.703 19:04:21 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:00.703 19:04:21 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:00.703 19:04:21 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:00.703 19:04:21 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:00.703 19:04:21 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:00.703 19:04:21 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:00.703 19:04:21 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:00.703 19:04:21 -- scripts/common.sh@335 -- # IFS=.-: 00:16:00.703 19:04:21 -- scripts/common.sh@335 -- # read -ra ver1 00:16:00.703 19:04:21 -- scripts/common.sh@336 -- # IFS=.-: 00:16:00.703 19:04:21 -- scripts/common.sh@336 -- # read -ra ver2 00:16:00.703 19:04:21 -- scripts/common.sh@337 -- # local 'op=<' 00:16:00.703 19:04:21 -- scripts/common.sh@339 -- # ver1_l=2 00:16:00.703 19:04:21 -- scripts/common.sh@340 -- # ver2_l=1 00:16:00.703 19:04:21 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:00.703 19:04:21 -- scripts/common.sh@343 -- # case "$op" in 00:16:00.703 19:04:21 -- scripts/common.sh@344 -- # : 1 00:16:00.703 19:04:21 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:00.703 19:04:21 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:00.703 19:04:21 -- scripts/common.sh@364 -- # decimal 1 00:16:00.703 19:04:21 -- scripts/common.sh@352 -- # local d=1 00:16:00.703 19:04:21 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:00.703 19:04:21 -- scripts/common.sh@354 -- # echo 1 00:16:00.703 19:04:21 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:00.703 19:04:21 -- scripts/common.sh@365 -- # decimal 2 00:16:00.703 19:04:21 -- scripts/common.sh@352 -- # local d=2 00:16:00.703 19:04:21 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:00.703 19:04:21 -- scripts/common.sh@354 -- # echo 2 00:16:00.703 19:04:21 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:00.703 19:04:21 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:00.703 19:04:21 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:00.703 19:04:21 -- scripts/common.sh@367 -- # return 0 00:16:00.703 19:04:21 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:00.703 19:04:21 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:00.703 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:00.703 --rc genhtml_branch_coverage=1 00:16:00.703 --rc genhtml_function_coverage=1 00:16:00.703 --rc genhtml_legend=1 00:16:00.703 --rc geninfo_all_blocks=1 00:16:00.703 --rc geninfo_unexecuted_blocks=1 00:16:00.703 00:16:00.703 ' 00:16:00.703 19:04:21 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:00.703 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:00.703 --rc genhtml_branch_coverage=1 00:16:00.703 --rc genhtml_function_coverage=1 00:16:00.703 --rc genhtml_legend=1 00:16:00.703 --rc geninfo_all_blocks=1 00:16:00.703 --rc geninfo_unexecuted_blocks=1 00:16:00.703 00:16:00.703 ' 00:16:00.703 19:04:21 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:00.703 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:00.703 --rc genhtml_branch_coverage=1 00:16:00.703 --rc genhtml_function_coverage=1 00:16:00.703 --rc genhtml_legend=1 00:16:00.703 --rc geninfo_all_blocks=1 00:16:00.703 --rc geninfo_unexecuted_blocks=1 00:16:00.703 00:16:00.703 ' 00:16:00.703 19:04:21 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:00.703 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:00.703 --rc genhtml_branch_coverage=1 00:16:00.703 --rc genhtml_function_coverage=1 00:16:00.703 --rc genhtml_legend=1 00:16:00.703 --rc geninfo_all_blocks=1 00:16:00.703 --rc geninfo_unexecuted_blocks=1 00:16:00.703 00:16:00.703 ' 00:16:00.703 19:04:21 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:00.963 19:04:21 -- nvmf/common.sh@7 -- # uname -s 00:16:00.963 19:04:21 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:00.963 19:04:21 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:00.963 19:04:21 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:00.963 19:04:21 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:00.963 19:04:21 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:00.963 19:04:21 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:00.963 19:04:21 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:00.963 19:04:21 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:00.963 19:04:21 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:00.963 19:04:21 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:00.963 19:04:21 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:00.963 19:04:21 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:00.963 19:04:21 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:00.963 19:04:21 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:00.963 19:04:21 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:00.963 19:04:21 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:00.963 19:04:21 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:00.963 19:04:21 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:00.963 19:04:21 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:00.964 19:04:21 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:00.964 19:04:21 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:00.964 19:04:21 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:00.964 19:04:21 -- paths/export.sh@5 -- # export PATH 00:16:00.964 19:04:21 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:00.964 19:04:21 -- nvmf/common.sh@46 -- # : 0 00:16:00.964 19:04:21 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:00.964 19:04:21 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:00.964 19:04:21 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:00.964 19:04:21 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:00.964 19:04:21 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:00.964 19:04:21 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:00.964 19:04:21 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:00.964 19:04:21 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:00.964 19:04:21 -- target/zcopy.sh@12 -- # nvmftestinit 00:16:00.964 19:04:21 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:00.964 19:04:21 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:00.964 19:04:21 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:00.964 19:04:21 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:00.964 19:04:21 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:00.964 19:04:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:00.964 19:04:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:00.964 19:04:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:00.964 19:04:21 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:00.964 19:04:21 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:00.964 19:04:21 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:00.964 19:04:21 -- common/autotest_common.sh@10 -- # set +x 00:16:02.872 19:04:23 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:02.872 19:04:23 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:02.872 19:04:23 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:02.872 19:04:23 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:02.872 19:04:23 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:02.872 19:04:23 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:02.872 19:04:23 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:02.872 19:04:23 -- nvmf/common.sh@294 -- # net_devs=() 00:16:02.872 19:04:23 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:02.872 19:04:23 -- nvmf/common.sh@295 -- # e810=() 00:16:02.872 19:04:23 -- nvmf/common.sh@295 -- # local -ga e810 00:16:02.872 19:04:23 -- nvmf/common.sh@296 -- # x722=() 00:16:02.872 19:04:23 -- nvmf/common.sh@296 -- # local -ga x722 00:16:02.872 19:04:23 -- nvmf/common.sh@297 -- # mlx=() 00:16:02.872 19:04:23 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:02.872 19:04:23 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:02.872 19:04:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:02.872 19:04:23 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:02.872 19:04:23 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:02.872 19:04:23 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:02.872 19:04:23 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:02.872 19:04:23 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:02.872 19:04:23 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:02.872 19:04:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:02.872 19:04:23 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:02.872 19:04:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:02.872 19:04:23 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:02.872 19:04:23 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:02.872 19:04:23 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:02.872 19:04:23 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:02.872 19:04:23 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:02.872 19:04:23 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:02.872 19:04:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:02.872 19:04:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:02.872 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:02.872 19:04:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:02.872 19:04:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:02.872 19:04:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:02.872 19:04:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:02.872 19:04:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:02.872 19:04:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:02.872 19:04:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:02.872 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:02.872 19:04:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:02.872 19:04:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:02.872 19:04:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:02.872 19:04:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:02.872 19:04:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:02.872 19:04:23 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:02.872 19:04:23 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:02.872 19:04:23 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:02.872 19:04:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:02.872 19:04:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:02.872 19:04:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:02.872 19:04:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:02.872 19:04:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:02.872 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:02.872 19:04:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:02.872 19:04:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:02.872 19:04:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:02.872 19:04:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:02.872 19:04:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:02.872 19:04:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:02.872 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:02.872 19:04:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:02.872 19:04:23 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:02.872 19:04:23 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:02.872 19:04:23 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:02.872 19:04:23 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:02.872 19:04:23 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:02.872 19:04:23 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:02.872 19:04:23 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:02.872 19:04:23 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:02.872 19:04:23 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:02.872 19:04:23 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:02.872 19:04:23 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:02.872 19:04:23 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:02.873 19:04:23 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:02.873 19:04:23 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:02.873 19:04:23 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:03.132 19:04:23 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:03.132 19:04:23 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:03.132 19:04:23 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:03.132 19:04:23 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:03.132 19:04:23 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:03.132 19:04:23 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:03.132 19:04:23 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:03.132 19:04:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:03.132 19:04:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:03.132 19:04:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:03.132 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:03.132 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.195 ms 00:16:03.132 00:16:03.132 --- 10.0.0.2 ping statistics --- 00:16:03.132 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:03.132 rtt min/avg/max/mdev = 0.195/0.195/0.195/0.000 ms 00:16:03.132 19:04:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:03.132 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:03.132 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.104 ms 00:16:03.132 00:16:03.132 --- 10.0.0.1 ping statistics --- 00:16:03.132 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:03.132 rtt min/avg/max/mdev = 0.104/0.104/0.104/0.000 ms 00:16:03.132 19:04:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:03.132 19:04:24 -- nvmf/common.sh@410 -- # return 0 00:16:03.132 19:04:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:03.132 19:04:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:03.132 19:04:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:03.132 19:04:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:03.132 19:04:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:03.132 19:04:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:03.132 19:04:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:03.132 19:04:24 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:16:03.132 19:04:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:03.132 19:04:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:03.132 19:04:24 -- common/autotest_common.sh@10 -- # set +x 00:16:03.132 19:04:24 -- nvmf/common.sh@469 -- # nvmfpid=202531 00:16:03.132 19:04:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:16:03.132 19:04:24 -- nvmf/common.sh@470 -- # waitforlisten 202531 00:16:03.132 19:04:24 -- common/autotest_common.sh@829 -- # '[' -z 202531 ']' 00:16:03.132 19:04:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:03.132 19:04:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:03.132 19:04:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:03.132 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:03.132 19:04:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:03.132 19:04:24 -- common/autotest_common.sh@10 -- # set +x 00:16:03.132 [2024-11-28 19:04:24.157567] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:03.132 [2024-11-28 19:04:24.157646] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:03.393 EAL: No free 2048 kB hugepages reported on node 1 00:16:03.393 [2024-11-28 19:04:24.223194] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:03.393 [2024-11-28 19:04:24.328984] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:03.393 [2024-11-28 19:04:24.329140] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:03.393 [2024-11-28 19:04:24.329157] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:03.393 [2024-11-28 19:04:24.329170] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:03.393 [2024-11-28 19:04:24.329218] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:04.333 19:04:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:04.333 19:04:25 -- common/autotest_common.sh@862 -- # return 0 00:16:04.333 19:04:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:04.333 19:04:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:04.333 19:04:25 -- common/autotest_common.sh@10 -- # set +x 00:16:04.333 19:04:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:04.333 19:04:25 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:16:04.333 19:04:25 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:16:04.333 19:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:04.333 19:04:25 -- common/autotest_common.sh@10 -- # set +x 00:16:04.333 [2024-11-28 19:04:25.200265] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:04.333 19:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:04.333 19:04:25 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:16:04.333 19:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:04.333 19:04:25 -- common/autotest_common.sh@10 -- # set +x 00:16:04.333 19:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:04.333 19:04:25 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:04.333 19:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:04.333 19:04:25 -- common/autotest_common.sh@10 -- # set +x 00:16:04.333 [2024-11-28 19:04:25.216484] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:04.333 19:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:04.333 19:04:25 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:16:04.333 19:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:04.333 19:04:25 -- common/autotest_common.sh@10 -- # set +x 00:16:04.333 19:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:04.333 19:04:25 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:16:04.333 19:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:04.333 19:04:25 -- common/autotest_common.sh@10 -- # set +x 00:16:04.333 malloc0 00:16:04.333 19:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:04.333 19:04:25 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:16:04.333 19:04:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:04.333 19:04:25 -- common/autotest_common.sh@10 -- # set +x 00:16:04.333 19:04:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:04.333 19:04:25 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:16:04.333 19:04:25 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:16:04.333 19:04:25 -- nvmf/common.sh@520 -- # config=() 00:16:04.333 19:04:25 -- nvmf/common.sh@520 -- # local subsystem config 00:16:04.333 19:04:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:04.333 19:04:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:04.333 { 00:16:04.333 "params": { 00:16:04.333 "name": "Nvme$subsystem", 00:16:04.333 "trtype": "$TEST_TRANSPORT", 00:16:04.333 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:04.333 "adrfam": "ipv4", 00:16:04.333 "trsvcid": "$NVMF_PORT", 00:16:04.333 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:04.333 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:04.333 "hdgst": ${hdgst:-false}, 00:16:04.333 "ddgst": ${ddgst:-false} 00:16:04.333 }, 00:16:04.333 "method": "bdev_nvme_attach_controller" 00:16:04.333 } 00:16:04.333 EOF 00:16:04.333 )") 00:16:04.333 19:04:25 -- nvmf/common.sh@542 -- # cat 00:16:04.333 19:04:25 -- nvmf/common.sh@544 -- # jq . 00:16:04.333 19:04:25 -- nvmf/common.sh@545 -- # IFS=, 00:16:04.333 19:04:25 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:04.333 "params": { 00:16:04.333 "name": "Nvme1", 00:16:04.333 "trtype": "tcp", 00:16:04.333 "traddr": "10.0.0.2", 00:16:04.333 "adrfam": "ipv4", 00:16:04.333 "trsvcid": "4420", 00:16:04.333 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:04.333 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:04.333 "hdgst": false, 00:16:04.333 "ddgst": false 00:16:04.333 }, 00:16:04.333 "method": "bdev_nvme_attach_controller" 00:16:04.333 }' 00:16:04.333 [2024-11-28 19:04:25.298844] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:04.333 [2024-11-28 19:04:25.298928] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid202699 ] 00:16:04.333 EAL: No free 2048 kB hugepages reported on node 1 00:16:04.333 [2024-11-28 19:04:25.368932] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:04.595 [2024-11-28 19:04:25.490012] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:04.857 Running I/O for 10 seconds... 00:16:14.865 00:16:14.865 Latency(us) 00:16:14.865 [2024-11-28T18:04:35.913Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:14.865 [2024-11-28T18:04:35.913Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:16:14.865 Verification LBA range: start 0x0 length 0x1000 00:16:14.865 Nvme1n1 : 10.01 8020.70 62.66 0.00 0.00 15922.17 1007.31 24758.04 00:16:14.865 [2024-11-28T18:04:35.913Z] =================================================================================================================== 00:16:14.865 [2024-11-28T18:04:35.913Z] Total : 8020.70 62.66 0.00 0.00 15922.17 1007.31 24758.04 00:16:15.124 19:04:36 -- target/zcopy.sh@39 -- # perfpid=204002 00:16:15.124 19:04:36 -- target/zcopy.sh@41 -- # xtrace_disable 00:16:15.124 19:04:36 -- common/autotest_common.sh@10 -- # set +x 00:16:15.124 19:04:36 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:16:15.124 19:04:36 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:16:15.124 19:04:36 -- nvmf/common.sh@520 -- # config=() 00:16:15.124 19:04:36 -- nvmf/common.sh@520 -- # local subsystem config 00:16:15.124 19:04:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:15.124 19:04:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:15.124 { 00:16:15.124 "params": { 00:16:15.124 "name": "Nvme$subsystem", 00:16:15.124 "trtype": "$TEST_TRANSPORT", 00:16:15.124 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:15.124 "adrfam": "ipv4", 00:16:15.124 "trsvcid": "$NVMF_PORT", 00:16:15.124 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:15.124 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:15.124 "hdgst": ${hdgst:-false}, 00:16:15.124 "ddgst": ${ddgst:-false} 00:16:15.124 }, 00:16:15.124 "method": "bdev_nvme_attach_controller" 00:16:15.124 } 00:16:15.124 EOF 00:16:15.124 )") 00:16:15.124 19:04:36 -- nvmf/common.sh@542 -- # cat 00:16:15.124 [2024-11-28 19:04:36.137071] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.124 [2024-11-28 19:04:36.137122] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.124 19:04:36 -- nvmf/common.sh@544 -- # jq . 00:16:15.124 19:04:36 -- nvmf/common.sh@545 -- # IFS=, 00:16:15.124 19:04:36 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:15.124 "params": { 00:16:15.124 "name": "Nvme1", 00:16:15.124 "trtype": "tcp", 00:16:15.124 "traddr": "10.0.0.2", 00:16:15.124 "adrfam": "ipv4", 00:16:15.124 "trsvcid": "4420", 00:16:15.124 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:15.124 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:15.124 "hdgst": false, 00:16:15.124 "ddgst": false 00:16:15.124 }, 00:16:15.124 "method": "bdev_nvme_attach_controller" 00:16:15.124 }' 00:16:15.124 [2024-11-28 19:04:36.145034] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.124 [2024-11-28 19:04:36.145061] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.124 [2024-11-28 19:04:36.153050] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.124 [2024-11-28 19:04:36.153074] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.124 [2024-11-28 19:04:36.161067] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.124 [2024-11-28 19:04:36.161088] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.124 [2024-11-28 19:04:36.169085] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.124 [2024-11-28 19:04:36.169105] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.124 [2024-11-28 19:04:36.170892] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:15.124 [2024-11-28 19:04:36.170948] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid204002 ] 00:16:15.384 [2024-11-28 19:04:36.177104] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.384 [2024-11-28 19:04:36.177123] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.384 [2024-11-28 19:04:36.185127] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.384 [2024-11-28 19:04:36.185147] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.384 [2024-11-28 19:04:36.193148] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.384 [2024-11-28 19:04:36.193182] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.384 EAL: No free 2048 kB hugepages reported on node 1 00:16:15.384 [2024-11-28 19:04:36.201167] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.384 [2024-11-28 19:04:36.201186] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.384 [2024-11-28 19:04:36.209206] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.384 [2024-11-28 19:04:36.209230] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.384 [2024-11-28 19:04:36.217229] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.384 [2024-11-28 19:04:36.217253] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.384 [2024-11-28 19:04:36.225251] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.384 [2024-11-28 19:04:36.225275] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.384 [2024-11-28 19:04:36.233303] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.384 [2024-11-28 19:04:36.233328] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.384 [2024-11-28 19:04:36.236437] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:15.384 [2024-11-28 19:04:36.241309] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.384 [2024-11-28 19:04:36.241338] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.384 [2024-11-28 19:04:36.249355] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.384 [2024-11-28 19:04:36.249403] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.384 [2024-11-28 19:04:36.257346] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.384 [2024-11-28 19:04:36.257370] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.384 [2024-11-28 19:04:36.265367] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.384 [2024-11-28 19:04:36.265391] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.384 [2024-11-28 19:04:36.273401] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.384 [2024-11-28 19:04:36.273440] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.384 [2024-11-28 19:04:36.281421] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.384 [2024-11-28 19:04:36.281457] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.384 [2024-11-28 19:04:36.289455] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.384 [2024-11-28 19:04:36.289476] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.384 [2024-11-28 19:04:36.297476] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.384 [2024-11-28 19:04:36.297498] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.384 [2024-11-28 19:04:36.305523] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.384 [2024-11-28 19:04:36.305559] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.384 [2024-11-28 19:04:36.313514] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.384 [2024-11-28 19:04:36.313534] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.384 [2024-11-28 19:04:36.321520] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.384 [2024-11-28 19:04:36.321552] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.384 [2024-11-28 19:04:36.329542] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.385 [2024-11-28 19:04:36.329562] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.385 [2024-11-28 19:04:36.337585] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.385 [2024-11-28 19:04:36.337606] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.385 [2024-11-28 19:04:36.345587] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.385 [2024-11-28 19:04:36.345607] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.385 [2024-11-28 19:04:36.350861] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:15.385 [2024-11-28 19:04:36.353610] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.385 [2024-11-28 19:04:36.353631] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.385 [2024-11-28 19:04:36.361632] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.385 [2024-11-28 19:04:36.361652] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.385 [2024-11-28 19:04:36.369701] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.385 [2024-11-28 19:04:36.369738] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.385 [2024-11-28 19:04:36.377726] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.385 [2024-11-28 19:04:36.377767] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.385 [2024-11-28 19:04:36.385758] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.385 [2024-11-28 19:04:36.385800] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.385 [2024-11-28 19:04:36.393793] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.385 [2024-11-28 19:04:36.393833] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.385 [2024-11-28 19:04:36.401801] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.385 [2024-11-28 19:04:36.401840] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.385 [2024-11-28 19:04:36.409812] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.385 [2024-11-28 19:04:36.409851] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.385 [2024-11-28 19:04:36.417814] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.385 [2024-11-28 19:04:36.417839] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.385 [2024-11-28 19:04:36.425859] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.385 [2024-11-28 19:04:36.425899] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.646 [2024-11-28 19:04:36.433890] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.646 [2024-11-28 19:04:36.433928] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.646 [2024-11-28 19:04:36.441895] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.646 [2024-11-28 19:04:36.441922] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.646 [2024-11-28 19:04:36.449890] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.646 [2024-11-28 19:04:36.449914] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.646 [2024-11-28 19:04:36.457970] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.646 [2024-11-28 19:04:36.457994] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.646 [2024-11-28 19:04:36.465959] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.646 [2024-11-28 19:04:36.465987] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.646 [2024-11-28 19:04:36.474008] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.646 [2024-11-28 19:04:36.474031] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.646 [2024-11-28 19:04:36.482013] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.646 [2024-11-28 19:04:36.482041] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.646 [2024-11-28 19:04:36.490038] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.646 [2024-11-28 19:04:36.490066] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.646 [2024-11-28 19:04:36.498061] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.646 [2024-11-28 19:04:36.498089] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.646 [2024-11-28 19:04:36.506082] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.646 [2024-11-28 19:04:36.506107] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.646 [2024-11-28 19:04:36.514106] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.646 [2024-11-28 19:04:36.514131] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.646 [2024-11-28 19:04:36.522128] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-28 19:04:36.522152] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-28 19:04:36.530151] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-28 19:04:36.530174] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-28 19:04:36.538179] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-28 19:04:36.538207] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-28 19:04:36.546196] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-28 19:04:36.546222] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-28 19:04:36.554216] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-28 19:04:36.554241] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-28 19:04:36.562239] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-28 19:04:36.562264] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-28 19:04:36.570262] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-28 19:04:36.570286] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-28 19:04:36.578287] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-28 19:04:36.578314] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-28 19:04:36.586307] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-28 19:04:36.586333] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-28 19:04:36.594332] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-28 19:04:36.594357] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-28 19:04:36.602355] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-28 19:04:36.602379] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-28 19:04:36.610380] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-28 19:04:36.610414] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-28 19:04:36.618410] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-28 19:04:36.618451] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-28 19:04:36.626448] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-28 19:04:36.626471] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-28 19:04:36.634471] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-28 19:04:36.634491] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-28 19:04:36.642490] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-28 19:04:36.642515] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 Running I/O for 5 seconds... 00:16:15.647 [2024-11-28 19:04:36.650508] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-28 19:04:36.650530] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-28 19:04:36.663815] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-28 19:04:36.663848] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-28 19:04:36.674764] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-28 19:04:36.674797] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.647 [2024-11-28 19:04:36.685563] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.647 [2024-11-28 19:04:36.685591] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.909 [2024-11-28 19:04:36.698775] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.909 [2024-11-28 19:04:36.698807] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.909 [2024-11-28 19:04:36.708804] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.909 [2024-11-28 19:04:36.708835] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.909 [2024-11-28 19:04:36.720034] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.909 [2024-11-28 19:04:36.720064] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.909 [2024-11-28 19:04:36.733310] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.909 [2024-11-28 19:04:36.733341] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.909 [2024-11-28 19:04:36.743810] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.909 [2024-11-28 19:04:36.743840] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.909 [2024-11-28 19:04:36.754876] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.909 [2024-11-28 19:04:36.754906] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.909 [2024-11-28 19:04:36.767309] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.909 [2024-11-28 19:04:36.767339] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.909 [2024-11-28 19:04:36.776828] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.909 [2024-11-28 19:04:36.776856] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.909 [2024-11-28 19:04:36.788279] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.909 [2024-11-28 19:04:36.788309] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.909 [2024-11-28 19:04:36.800343] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.909 [2024-11-28 19:04:36.800374] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.909 [2024-11-28 19:04:36.809551] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.909 [2024-11-28 19:04:36.809578] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.909 [2024-11-28 19:04:36.822462] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.909 [2024-11-28 19:04:36.822497] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.909 [2024-11-28 19:04:36.832377] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.909 [2024-11-28 19:04:36.832417] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.909 [2024-11-28 19:04:36.843585] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.909 [2024-11-28 19:04:36.843621] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.909 [2024-11-28 19:04:36.856188] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.909 [2024-11-28 19:04:36.856217] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.909 [2024-11-28 19:04:36.866176] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.909 [2024-11-28 19:04:36.866207] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.909 [2024-11-28 19:04:36.877483] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.909 [2024-11-28 19:04:36.877510] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.909 [2024-11-28 19:04:36.890565] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.909 [2024-11-28 19:04:36.890593] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.909 [2024-11-28 19:04:36.900989] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.909 [2024-11-28 19:04:36.901019] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.909 [2024-11-28 19:04:36.912152] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.909 [2024-11-28 19:04:36.912182] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.909 [2024-11-28 19:04:36.924789] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.909 [2024-11-28 19:04:36.924819] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.909 [2024-11-28 19:04:36.935133] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.909 [2024-11-28 19:04:36.935163] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:15.909 [2024-11-28 19:04:36.946168] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:15.909 [2024-11-28 19:04:36.946198] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.172 [2024-11-28 19:04:36.959757] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.172 [2024-11-28 19:04:36.959788] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.172 [2024-11-28 19:04:36.970454] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.172 [2024-11-28 19:04:36.970481] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.172 [2024-11-28 19:04:36.981030] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.172 [2024-11-28 19:04:36.981060] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.172 [2024-11-28 19:04:36.991839] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.172 [2024-11-28 19:04:36.991869] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.172 [2024-11-28 19:04:37.002919] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.172 [2024-11-28 19:04:37.002949] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.172 [2024-11-28 19:04:37.015567] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.172 [2024-11-28 19:04:37.015594] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.172 [2024-11-28 19:04:37.025668] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.172 [2024-11-28 19:04:37.025713] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.172 [2024-11-28 19:04:37.036861] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.172 [2024-11-28 19:04:37.036899] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.172 [2024-11-28 19:04:37.048614] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.172 [2024-11-28 19:04:37.048642] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.172 [2024-11-28 19:04:37.061273] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.172 [2024-11-28 19:04:37.061304] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.172 [2024-11-28 19:04:37.071856] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.172 [2024-11-28 19:04:37.071887] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.172 [2024-11-28 19:04:37.082873] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.172 [2024-11-28 19:04:37.082904] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.172 [2024-11-28 19:04:37.096029] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.172 [2024-11-28 19:04:37.096059] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.172 [2024-11-28 19:04:37.106445] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.172 [2024-11-28 19:04:37.106473] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.172 [2024-11-28 19:04:37.117346] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.172 [2024-11-28 19:04:37.117376] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.172 [2024-11-28 19:04:37.130377] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.172 [2024-11-28 19:04:37.130416] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.173 [2024-11-28 19:04:37.140664] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.173 [2024-11-28 19:04:37.140710] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.173 [2024-11-28 19:04:37.151780] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.173 [2024-11-28 19:04:37.151809] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.173 [2024-11-28 19:04:37.164810] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.173 [2024-11-28 19:04:37.164840] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.173 [2024-11-28 19:04:37.175264] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.173 [2024-11-28 19:04:37.175294] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.173 [2024-11-28 19:04:37.186584] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.173 [2024-11-28 19:04:37.186612] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.173 [2024-11-28 19:04:37.197584] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.173 [2024-11-28 19:04:37.197611] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.173 [2024-11-28 19:04:37.208812] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.173 [2024-11-28 19:04:37.208843] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.433 [2024-11-28 19:04:37.219878] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.433 [2024-11-28 19:04:37.219910] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.433 [2024-11-28 19:04:37.232614] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.433 [2024-11-28 19:04:37.232641] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.433 [2024-11-28 19:04:37.242712] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.433 [2024-11-28 19:04:37.242741] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.433 [2024-11-28 19:04:37.253482] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.433 [2024-11-28 19:04:37.253517] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.433 [2024-11-28 19:04:37.266289] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.433 [2024-11-28 19:04:37.266319] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.433 [2024-11-28 19:04:37.276864] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.433 [2024-11-28 19:04:37.276894] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.433 [2024-11-28 19:04:37.288266] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.433 [2024-11-28 19:04:37.288296] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.433 [2024-11-28 19:04:37.301465] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.433 [2024-11-28 19:04:37.301492] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.433 [2024-11-28 19:04:37.311696] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.433 [2024-11-28 19:04:37.311727] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.433 [2024-11-28 19:04:37.322325] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.433 [2024-11-28 19:04:37.322355] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.433 [2024-11-28 19:04:37.332767] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.433 [2024-11-28 19:04:37.332796] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.433 [2024-11-28 19:04:37.343574] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.433 [2024-11-28 19:04:37.343602] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.433 [2024-11-28 19:04:37.354453] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.433 [2024-11-28 19:04:37.354481] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.433 [2024-11-28 19:04:37.365793] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.433 [2024-11-28 19:04:37.365824] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.433 [2024-11-28 19:04:37.376887] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.433 [2024-11-28 19:04:37.376918] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.433 [2024-11-28 19:04:37.388044] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.433 [2024-11-28 19:04:37.388074] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.433 [2024-11-28 19:04:37.399165] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.433 [2024-11-28 19:04:37.399195] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.433 [2024-11-28 19:04:37.410171] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.433 [2024-11-28 19:04:37.410201] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.433 [2024-11-28 19:04:37.423110] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.433 [2024-11-28 19:04:37.423140] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.433 [2024-11-28 19:04:37.432883] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.433 [2024-11-28 19:04:37.432913] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.433 [2024-11-28 19:04:37.443849] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.433 [2024-11-28 19:04:37.443878] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.433 [2024-11-28 19:04:37.456675] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.433 [2024-11-28 19:04:37.456718] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.433 [2024-11-28 19:04:37.466680] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.433 [2024-11-28 19:04:37.466710] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.433 [2024-11-28 19:04:37.478015] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.433 [2024-11-28 19:04:37.478046] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.693 [2024-11-28 19:04:37.491312] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.693 [2024-11-28 19:04:37.491343] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.693 [2024-11-28 19:04:37.501533] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.693 [2024-11-28 19:04:37.501560] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.693 [2024-11-28 19:04:37.512692] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.693 [2024-11-28 19:04:37.512722] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.693 [2024-11-28 19:04:37.523744] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.693 [2024-11-28 19:04:37.523774] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.693 [2024-11-28 19:04:37.534245] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.693 [2024-11-28 19:04:37.534274] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.693 [2024-11-28 19:04:37.545544] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.693 [2024-11-28 19:04:37.545571] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.693 [2024-11-28 19:04:37.556641] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.693 [2024-11-28 19:04:37.556683] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.693 [2024-11-28 19:04:37.567806] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.693 [2024-11-28 19:04:37.567836] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.693 [2024-11-28 19:04:37.578622] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.693 [2024-11-28 19:04:37.578649] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.693 [2024-11-28 19:04:37.589158] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.693 [2024-11-28 19:04:37.589188] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.693 [2024-11-28 19:04:37.600366] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.693 [2024-11-28 19:04:37.600405] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.693 [2024-11-28 19:04:37.613328] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.693 [2024-11-28 19:04:37.613357] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.693 [2024-11-28 19:04:37.622907] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.693 [2024-11-28 19:04:37.622937] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.693 [2024-11-28 19:04:37.633898] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.693 [2024-11-28 19:04:37.633928] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.694 [2024-11-28 19:04:37.644772] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.694 [2024-11-28 19:04:37.644802] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.694 [2024-11-28 19:04:37.655222] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.694 [2024-11-28 19:04:37.655253] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.694 [2024-11-28 19:04:37.665690] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.694 [2024-11-28 19:04:37.665720] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.694 [2024-11-28 19:04:37.676350] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.694 [2024-11-28 19:04:37.676379] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.694 [2024-11-28 19:04:37.687064] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.694 [2024-11-28 19:04:37.687096] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.694 [2024-11-28 19:04:37.697868] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.694 [2024-11-28 19:04:37.697899] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.694 [2024-11-28 19:04:37.710721] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.694 [2024-11-28 19:04:37.710752] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.694 [2024-11-28 19:04:37.721265] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.694 [2024-11-28 19:04:37.721295] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.694 [2024-11-28 19:04:37.732122] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.694 [2024-11-28 19:04:37.732152] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.954 [2024-11-28 19:04:37.742971] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.954 [2024-11-28 19:04:37.743002] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.954 [2024-11-28 19:04:37.754014] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.954 [2024-11-28 19:04:37.754044] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.954 [2024-11-28 19:04:37.767210] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.954 [2024-11-28 19:04:37.767241] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.954 [2024-11-28 19:04:37.777752] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.954 [2024-11-28 19:04:37.777783] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.954 [2024-11-28 19:04:37.789215] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.954 [2024-11-28 19:04:37.789246] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.954 [2024-11-28 19:04:37.800153] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.954 [2024-11-28 19:04:37.800183] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.954 [2024-11-28 19:04:37.811444] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.954 [2024-11-28 19:04:37.811471] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.954 [2024-11-28 19:04:37.824436] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.954 [2024-11-28 19:04:37.824463] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.954 [2024-11-28 19:04:37.834804] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.954 [2024-11-28 19:04:37.834834] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.954 [2024-11-28 19:04:37.846018] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.954 [2024-11-28 19:04:37.846050] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.954 [2024-11-28 19:04:37.858900] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.954 [2024-11-28 19:04:37.858931] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.954 [2024-11-28 19:04:37.869120] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.954 [2024-11-28 19:04:37.869150] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.954 [2024-11-28 19:04:37.880065] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.954 [2024-11-28 19:04:37.880095] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.954 [2024-11-28 19:04:37.890867] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.954 [2024-11-28 19:04:37.890897] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.954 [2024-11-28 19:04:37.901509] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.954 [2024-11-28 19:04:37.901535] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.954 [2024-11-28 19:04:37.912485] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.954 [2024-11-28 19:04:37.912512] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.954 [2024-11-28 19:04:37.923201] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.954 [2024-11-28 19:04:37.923232] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.954 [2024-11-28 19:04:37.933885] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.954 [2024-11-28 19:04:37.933915] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.954 [2024-11-28 19:04:37.946858] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.954 [2024-11-28 19:04:37.946888] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.954 [2024-11-28 19:04:37.957441] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.954 [2024-11-28 19:04:37.957468] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.954 [2024-11-28 19:04:37.968187] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.954 [2024-11-28 19:04:37.968217] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.954 [2024-11-28 19:04:37.979358] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.954 [2024-11-28 19:04:37.979387] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:16.954 [2024-11-28 19:04:37.990083] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:16.954 [2024-11-28 19:04:37.990113] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.218 [2024-11-28 19:04:38.003080] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.218 [2024-11-28 19:04:38.003111] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.218 [2024-11-28 19:04:38.013165] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.218 [2024-11-28 19:04:38.013194] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.218 [2024-11-28 19:04:38.024545] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.218 [2024-11-28 19:04:38.024573] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.218 [2024-11-28 19:04:38.035839] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.218 [2024-11-28 19:04:38.035870] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.218 [2024-11-28 19:04:38.048654] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.218 [2024-11-28 19:04:38.048699] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.218 [2024-11-28 19:04:38.058912] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.218 [2024-11-28 19:04:38.058943] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.218 [2024-11-28 19:04:38.070065] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.218 [2024-11-28 19:04:38.070096] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.218 [2024-11-28 19:04:38.083869] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.218 [2024-11-28 19:04:38.083899] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.218 [2024-11-28 19:04:38.094361] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.218 [2024-11-28 19:04:38.094433] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.218 [2024-11-28 19:04:38.104896] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.218 [2024-11-28 19:04:38.104926] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.218 [2024-11-28 19:04:38.115110] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.218 [2024-11-28 19:04:38.115140] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.218 [2024-11-28 19:04:38.126165] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.218 [2024-11-28 19:04:38.126196] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.218 [2024-11-28 19:04:38.139013] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.218 [2024-11-28 19:04:38.139043] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.218 [2024-11-28 19:04:38.149516] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.218 [2024-11-28 19:04:38.149543] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.218 [2024-11-28 19:04:38.160613] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.218 [2024-11-28 19:04:38.160640] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.218 [2024-11-28 19:04:38.171928] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.218 [2024-11-28 19:04:38.171958] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.218 [2024-11-28 19:04:38.182832] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.218 [2024-11-28 19:04:38.182871] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.218 [2024-11-28 19:04:38.195524] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.218 [2024-11-28 19:04:38.195551] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.218 [2024-11-28 19:04:38.205385] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.218 [2024-11-28 19:04:38.205426] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.218 [2024-11-28 19:04:38.216292] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.218 [2024-11-28 19:04:38.216322] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.218 [2024-11-28 19:04:38.227115] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.218 [2024-11-28 19:04:38.227145] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.218 [2024-11-28 19:04:38.237867] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.218 [2024-11-28 19:04:38.237897] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.218 [2024-11-28 19:04:38.251326] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.218 [2024-11-28 19:04:38.251356] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.218 [2024-11-28 19:04:38.261611] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.218 [2024-11-28 19:04:38.261638] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.481 [2024-11-28 19:04:38.272919] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.481 [2024-11-28 19:04:38.272950] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.481 [2024-11-28 19:04:38.283696] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.481 [2024-11-28 19:04:38.283726] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.481 [2024-11-28 19:04:38.294617] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.481 [2024-11-28 19:04:38.294644] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.481 [2024-11-28 19:04:38.307325] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.481 [2024-11-28 19:04:38.307363] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.481 [2024-11-28 19:04:38.317596] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.481 [2024-11-28 19:04:38.317623] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.481 [2024-11-28 19:04:38.328782] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.481 [2024-11-28 19:04:38.328812] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.481 [2024-11-28 19:04:38.341752] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.481 [2024-11-28 19:04:38.341781] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.481 [2024-11-28 19:04:38.351893] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.481 [2024-11-28 19:04:38.351923] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.481 [2024-11-28 19:04:38.362469] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.481 [2024-11-28 19:04:38.362496] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.481 [2024-11-28 19:04:38.375557] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.481 [2024-11-28 19:04:38.375585] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.481 [2024-11-28 19:04:38.386279] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.481 [2024-11-28 19:04:38.386308] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.481 [2024-11-28 19:04:38.397409] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.481 [2024-11-28 19:04:38.397451] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.481 [2024-11-28 19:04:38.410023] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.481 [2024-11-28 19:04:38.410053] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.481 [2024-11-28 19:04:38.420144] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.481 [2024-11-28 19:04:38.420174] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.481 [2024-11-28 19:04:38.431163] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.481 [2024-11-28 19:04:38.431193] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.481 [2024-11-28 19:04:38.441641] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.481 [2024-11-28 19:04:38.441684] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.481 [2024-11-28 19:04:38.452648] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.481 [2024-11-28 19:04:38.452692] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.481 [2024-11-28 19:04:38.463723] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.481 [2024-11-28 19:04:38.463753] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.481 [2024-11-28 19:04:38.474926] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.481 [2024-11-28 19:04:38.474957] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.481 [2024-11-28 19:04:38.485805] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.481 [2024-11-28 19:04:38.485835] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.481 [2024-11-28 19:04:38.496682] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.481 [2024-11-28 19:04:38.496712] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.481 [2024-11-28 19:04:38.509568] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.481 [2024-11-28 19:04:38.509595] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.481 [2024-11-28 19:04:38.519952] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.481 [2024-11-28 19:04:38.519990] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.744 [2024-11-28 19:04:38.531182] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.744 [2024-11-28 19:04:38.531214] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.744 [2024-11-28 19:04:38.543904] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.744 [2024-11-28 19:04:38.543934] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.744 [2024-11-28 19:04:38.554319] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.744 [2024-11-28 19:04:38.554349] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.744 [2024-11-28 19:04:38.565467] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.744 [2024-11-28 19:04:38.565494] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.744 [2024-11-28 19:04:38.576319] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.744 [2024-11-28 19:04:38.576348] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.744 [2024-11-28 19:04:38.587347] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.744 [2024-11-28 19:04:38.587377] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.744 [2024-11-28 19:04:38.600171] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.744 [2024-11-28 19:04:38.600201] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.744 [2024-11-28 19:04:38.610152] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.744 [2024-11-28 19:04:38.610181] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.744 [2024-11-28 19:04:38.620964] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.744 [2024-11-28 19:04:38.620994] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.744 [2024-11-28 19:04:38.632047] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.744 [2024-11-28 19:04:38.632076] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.744 [2024-11-28 19:04:38.643149] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.744 [2024-11-28 19:04:38.643180] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.744 [2024-11-28 19:04:38.655898] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.744 [2024-11-28 19:04:38.655928] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.744 [2024-11-28 19:04:38.665702] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.744 [2024-11-28 19:04:38.665732] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.744 [2024-11-28 19:04:38.676583] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.744 [2024-11-28 19:04:38.676610] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.744 [2024-11-28 19:04:38.689181] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.744 [2024-11-28 19:04:38.689210] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.744 [2024-11-28 19:04:38.699359] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.744 [2024-11-28 19:04:38.699389] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.744 [2024-11-28 19:04:38.710052] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.744 [2024-11-28 19:04:38.710083] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.744 [2024-11-28 19:04:38.723124] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.744 [2024-11-28 19:04:38.723154] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.744 [2024-11-28 19:04:38.733480] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.744 [2024-11-28 19:04:38.733530] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.744 [2024-11-28 19:04:38.744639] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.744 [2024-11-28 19:04:38.744666] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.744 [2024-11-28 19:04:38.755508] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.744 [2024-11-28 19:04:38.755535] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.744 [2024-11-28 19:04:38.766572] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.744 [2024-11-28 19:04:38.766599] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.744 [2024-11-28 19:04:38.779573] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.744 [2024-11-28 19:04:38.779600] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:17.744 [2024-11-28 19:04:38.790129] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:17.744 [2024-11-28 19:04:38.790159] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.004 [2024-11-28 19:04:38.800744] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.005 [2024-11-28 19:04:38.800775] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.005 [2024-11-28 19:04:38.813340] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.005 [2024-11-28 19:04:38.813372] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.005 [2024-11-28 19:04:38.823787] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.005 [2024-11-28 19:04:38.823817] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.005 [2024-11-28 19:04:38.834320] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.005 [2024-11-28 19:04:38.834351] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.005 [2024-11-28 19:04:38.845023] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.005 [2024-11-28 19:04:38.845053] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.005 [2024-11-28 19:04:38.856008] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.005 [2024-11-28 19:04:38.856038] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.005 [2024-11-28 19:04:38.867185] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.005 [2024-11-28 19:04:38.867215] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.005 [2024-11-28 19:04:38.877952] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.005 [2024-11-28 19:04:38.877982] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.005 [2024-11-28 19:04:38.888596] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.005 [2024-11-28 19:04:38.888624] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.005 [2024-11-28 19:04:38.899179] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.005 [2024-11-28 19:04:38.899209] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.005 [2024-11-28 19:04:38.912211] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.005 [2024-11-28 19:04:38.912241] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.005 [2024-11-28 19:04:38.922317] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.005 [2024-11-28 19:04:38.922348] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.005 [2024-11-28 19:04:38.933078] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.005 [2024-11-28 19:04:38.933109] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.005 [2024-11-28 19:04:38.946236] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.005 [2024-11-28 19:04:38.946274] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.005 [2024-11-28 19:04:38.956662] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.005 [2024-11-28 19:04:38.956706] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.005 [2024-11-28 19:04:38.967570] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.005 [2024-11-28 19:04:38.967613] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.005 [2024-11-28 19:04:38.980542] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.005 [2024-11-28 19:04:38.980570] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.005 [2024-11-28 19:04:38.990641] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.005 [2024-11-28 19:04:38.990686] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.005 [2024-11-28 19:04:39.001148] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.005 [2024-11-28 19:04:39.001179] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.005 [2024-11-28 19:04:39.011999] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.005 [2024-11-28 19:04:39.012029] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.005 [2024-11-28 19:04:39.022674] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.005 [2024-11-28 19:04:39.022719] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.005 [2024-11-28 19:04:39.033511] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.005 [2024-11-28 19:04:39.033539] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.005 [2024-11-28 19:04:39.044557] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.005 [2024-11-28 19:04:39.044584] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.264 [2024-11-28 19:04:39.055913] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.264 [2024-11-28 19:04:39.055943] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.264 [2024-11-28 19:04:39.066826] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.264 [2024-11-28 19:04:39.066856] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.264 [2024-11-28 19:04:39.077620] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.264 [2024-11-28 19:04:39.077647] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.264 [2024-11-28 19:04:39.088334] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.264 [2024-11-28 19:04:39.088364] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.264 [2024-11-28 19:04:39.100613] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.264 [2024-11-28 19:04:39.100640] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.264 [2024-11-28 19:04:39.110032] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.264 [2024-11-28 19:04:39.110061] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.264 [2024-11-28 19:04:39.121989] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.265 [2024-11-28 19:04:39.122020] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.265 [2024-11-28 19:04:39.132532] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.265 [2024-11-28 19:04:39.132573] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.265 [2024-11-28 19:04:39.143205] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.265 [2024-11-28 19:04:39.143236] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.265 [2024-11-28 19:04:39.155834] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.265 [2024-11-28 19:04:39.155866] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.265 [2024-11-28 19:04:39.168814] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.265 [2024-11-28 19:04:39.168844] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.265 [2024-11-28 19:04:39.178802] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.265 [2024-11-28 19:04:39.178832] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.265 [2024-11-28 19:04:39.189527] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.265 [2024-11-28 19:04:39.189554] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.265 [2024-11-28 19:04:39.200100] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.265 [2024-11-28 19:04:39.200131] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.265 [2024-11-28 19:04:39.210875] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.265 [2024-11-28 19:04:39.210906] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.265 [2024-11-28 19:04:39.221874] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.265 [2024-11-28 19:04:39.221904] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.265 [2024-11-28 19:04:39.232914] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.265 [2024-11-28 19:04:39.232944] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.265 [2024-11-28 19:04:39.245321] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.265 [2024-11-28 19:04:39.245351] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.265 [2024-11-28 19:04:39.254722] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.265 [2024-11-28 19:04:39.254753] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.265 [2024-11-28 19:04:39.267937] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.265 [2024-11-28 19:04:39.267967] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.265 [2024-11-28 19:04:39.278477] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.265 [2024-11-28 19:04:39.278518] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.265 [2024-11-28 19:04:39.289731] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.265 [2024-11-28 19:04:39.289761] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.265 [2024-11-28 19:04:39.302473] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.265 [2024-11-28 19:04:39.302500] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.528 [2024-11-28 19:04:39.313171] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.528 [2024-11-28 19:04:39.313201] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.528 [2024-11-28 19:04:39.324141] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.528 [2024-11-28 19:04:39.324172] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.528 [2024-11-28 19:04:39.334822] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.528 [2024-11-28 19:04:39.334852] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.528 [2024-11-28 19:04:39.345550] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.528 [2024-11-28 19:04:39.345593] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.528 [2024-11-28 19:04:39.358513] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.528 [2024-11-28 19:04:39.358540] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.528 [2024-11-28 19:04:39.368485] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.528 [2024-11-28 19:04:39.368512] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.528 [2024-11-28 19:04:39.379522] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.528 [2024-11-28 19:04:39.379549] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.528 [2024-11-28 19:04:39.390476] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.528 [2024-11-28 19:04:39.390503] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.528 [2024-11-28 19:04:39.401855] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.528 [2024-11-28 19:04:39.401885] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.528 [2024-11-28 19:04:39.412844] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.528 [2024-11-28 19:04:39.412874] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.528 [2024-11-28 19:04:39.424116] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.528 [2024-11-28 19:04:39.424146] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.528 [2024-11-28 19:04:39.435039] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.528 [2024-11-28 19:04:39.435068] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.528 [2024-11-28 19:04:39.445887] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.528 [2024-11-28 19:04:39.445917] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.528 [2024-11-28 19:04:39.458792] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.528 [2024-11-28 19:04:39.458822] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.528 [2024-11-28 19:04:39.468771] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.528 [2024-11-28 19:04:39.468801] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.528 [2024-11-28 19:04:39.479654] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.528 [2024-11-28 19:04:39.479698] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.528 [2024-11-28 19:04:39.492500] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.528 [2024-11-28 19:04:39.492527] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.528 [2024-11-28 19:04:39.502992] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.528 [2024-11-28 19:04:39.503022] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.528 [2024-11-28 19:04:39.514160] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.528 [2024-11-28 19:04:39.514190] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.528 [2024-11-28 19:04:39.527297] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.528 [2024-11-28 19:04:39.527326] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.528 [2024-11-28 19:04:39.537219] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.528 [2024-11-28 19:04:39.537249] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.528 [2024-11-28 19:04:39.547792] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.528 [2024-11-28 19:04:39.547822] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.528 [2024-11-28 19:04:39.558848] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.528 [2024-11-28 19:04:39.558878] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.528 [2024-11-28 19:04:39.571611] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.528 [2024-11-28 19:04:39.571638] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.791 [2024-11-28 19:04:39.581180] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.791 [2024-11-28 19:04:39.581210] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.791 [2024-11-28 19:04:39.593052] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.791 [2024-11-28 19:04:39.593083] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.791 [2024-11-28 19:04:39.603778] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.791 [2024-11-28 19:04:39.603808] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.791 [2024-11-28 19:04:39.614354] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.791 [2024-11-28 19:04:39.614383] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.791 [2024-11-28 19:04:39.625256] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.792 [2024-11-28 19:04:39.625285] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.792 [2024-11-28 19:04:39.635850] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.792 [2024-11-28 19:04:39.635880] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.792 [2024-11-28 19:04:39.646876] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.792 [2024-11-28 19:04:39.646906] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.792 [2024-11-28 19:04:39.657589] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.792 [2024-11-28 19:04:39.657616] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.792 [2024-11-28 19:04:39.668663] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.792 [2024-11-28 19:04:39.668691] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.792 [2024-11-28 19:04:39.681872] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.792 [2024-11-28 19:04:39.681902] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.792 [2024-11-28 19:04:39.692371] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.792 [2024-11-28 19:04:39.692410] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.792 [2024-11-28 19:04:39.702862] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.792 [2024-11-28 19:04:39.702892] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.792 [2024-11-28 19:04:39.713443] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.792 [2024-11-28 19:04:39.713486] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.792 [2024-11-28 19:04:39.724690] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.792 [2024-11-28 19:04:39.724734] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.792 [2024-11-28 19:04:39.738453] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.792 [2024-11-28 19:04:39.738480] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.792 [2024-11-28 19:04:39.749344] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.792 [2024-11-28 19:04:39.749375] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.792 [2024-11-28 19:04:39.760124] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.792 [2024-11-28 19:04:39.760154] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.792 [2024-11-28 19:04:39.771091] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.792 [2024-11-28 19:04:39.771121] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.792 [2024-11-28 19:04:39.783796] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.792 [2024-11-28 19:04:39.783834] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.792 [2024-11-28 19:04:39.793445] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.792 [2024-11-28 19:04:39.793473] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.792 [2024-11-28 19:04:39.804499] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.792 [2024-11-28 19:04:39.804527] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.792 [2024-11-28 19:04:39.815436] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.792 [2024-11-28 19:04:39.815479] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:18.792 [2024-11-28 19:04:39.826451] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:18.792 [2024-11-28 19:04:39.826478] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.054 [2024-11-28 19:04:39.840801] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.054 [2024-11-28 19:04:39.840832] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.054 [2024-11-28 19:04:39.851091] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.054 [2024-11-28 19:04:39.851121] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.054 [2024-11-28 19:04:39.861589] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.054 [2024-11-28 19:04:39.861616] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.054 [2024-11-28 19:04:39.872481] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.054 [2024-11-28 19:04:39.872509] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.054 [2024-11-28 19:04:39.883690] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.054 [2024-11-28 19:04:39.883721] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.054 [2024-11-28 19:04:39.896891] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.054 [2024-11-28 19:04:39.896921] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.054 [2024-11-28 19:04:39.907361] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.054 [2024-11-28 19:04:39.907391] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.054 [2024-11-28 19:04:39.918139] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.054 [2024-11-28 19:04:39.918169] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.054 [2024-11-28 19:04:39.930886] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.054 [2024-11-28 19:04:39.930916] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.054 [2024-11-28 19:04:39.940561] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.054 [2024-11-28 19:04:39.940589] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.054 [2024-11-28 19:04:39.952329] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.054 [2024-11-28 19:04:39.952359] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.054 [2024-11-28 19:04:39.964879] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.054 [2024-11-28 19:04:39.964910] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.054 [2024-11-28 19:04:39.975783] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.054 [2024-11-28 19:04:39.975813] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.054 [2024-11-28 19:04:39.987275] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.054 [2024-11-28 19:04:39.987305] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.054 [2024-11-28 19:04:39.998239] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.054 [2024-11-28 19:04:39.998277] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.054 [2024-11-28 19:04:40.011900] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.054 [2024-11-28 19:04:40.011938] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.054 [2024-11-28 19:04:40.020766] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.054 [2024-11-28 19:04:40.020805] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.054 [2024-11-28 19:04:40.036795] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.054 [2024-11-28 19:04:40.036836] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.054 [2024-11-28 19:04:40.048929] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.054 [2024-11-28 19:04:40.048964] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.054 [2024-11-28 19:04:40.059912] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.054 [2024-11-28 19:04:40.059943] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.054 [2024-11-28 19:04:40.071151] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.054 [2024-11-28 19:04:40.071181] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.054 [2024-11-28 19:04:40.082415] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.054 [2024-11-28 19:04:40.082466] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.054 [2024-11-28 19:04:40.095366] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.054 [2024-11-28 19:04:40.095408] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.314 [2024-11-28 19:04:40.105701] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.314 [2024-11-28 19:04:40.105732] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.314 [2024-11-28 19:04:40.116739] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.314 [2024-11-28 19:04:40.116769] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.314 [2024-11-28 19:04:40.128240] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.314 [2024-11-28 19:04:40.128270] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.314 [2024-11-28 19:04:40.139029] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.314 [2024-11-28 19:04:40.139059] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.314 [2024-11-28 19:04:40.149438] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.314 [2024-11-28 19:04:40.149465] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.314 [2024-11-28 19:04:40.160185] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.314 [2024-11-28 19:04:40.160215] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.314 [2024-11-28 19:04:40.170767] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.314 [2024-11-28 19:04:40.170797] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.314 [2024-11-28 19:04:40.181385] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.314 [2024-11-28 19:04:40.181424] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.314 [2024-11-28 19:04:40.192363] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.314 [2024-11-28 19:04:40.192405] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.314 [2024-11-28 19:04:40.205713] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.314 [2024-11-28 19:04:40.205743] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.314 [2024-11-28 19:04:40.216197] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.314 [2024-11-28 19:04:40.216237] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.314 [2024-11-28 19:04:40.226840] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.314 [2024-11-28 19:04:40.226870] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.314 [2024-11-28 19:04:40.237539] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.314 [2024-11-28 19:04:40.237566] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.314 [2024-11-28 19:04:40.248644] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.314 [2024-11-28 19:04:40.248686] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.315 [2024-11-28 19:04:40.261301] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.315 [2024-11-28 19:04:40.261331] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.315 [2024-11-28 19:04:40.271515] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.315 [2024-11-28 19:04:40.271542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.315 [2024-11-28 19:04:40.282769] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.315 [2024-11-28 19:04:40.282799] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.315 [2024-11-28 19:04:40.293494] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.315 [2024-11-28 19:04:40.293522] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.315 [2024-11-28 19:04:40.304963] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.315 [2024-11-28 19:04:40.304992] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.315 [2024-11-28 19:04:40.315663] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.315 [2024-11-28 19:04:40.315707] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.315 [2024-11-28 19:04:40.326288] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.315 [2024-11-28 19:04:40.326318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.315 [2024-11-28 19:04:40.337073] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.315 [2024-11-28 19:04:40.337103] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.315 [2024-11-28 19:04:40.347981] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.315 [2024-11-28 19:04:40.348011] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.315 [2024-11-28 19:04:40.359119] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.315 [2024-11-28 19:04:40.359149] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-28 19:04:40.370103] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-28 19:04:40.370133] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-28 19:04:40.382879] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-28 19:04:40.382909] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-28 19:04:40.393141] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-28 19:04:40.393170] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-28 19:04:40.403896] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-28 19:04:40.403926] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-28 19:04:40.415000] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-28 19:04:40.415030] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-28 19:04:40.426253] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-28 19:04:40.426291] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-28 19:04:40.439160] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-28 19:04:40.439190] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-28 19:04:40.449128] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-28 19:04:40.449159] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-28 19:04:40.459928] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-28 19:04:40.459958] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-28 19:04:40.470794] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-28 19:04:40.470824] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-28 19:04:40.481813] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-28 19:04:40.481843] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-28 19:04:40.492582] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-28 19:04:40.492609] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-28 19:04:40.503154] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-28 19:04:40.503184] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-28 19:04:40.515985] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-28 19:04:40.516015] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-28 19:04:40.526162] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-28 19:04:40.526192] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-28 19:04:40.536996] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-28 19:04:40.537025] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-28 19:04:40.547349] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-28 19:04:40.547379] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-28 19:04:40.558379] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-28 19:04:40.558419] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-28 19:04:40.569494] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-28 19:04:40.569521] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-28 19:04:40.580495] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-28 19:04:40.580523] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-28 19:04:40.591050] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-28 19:04:40.591081] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-28 19:04:40.601721] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-28 19:04:40.601751] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.574 [2024-11-28 19:04:40.612765] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.574 [2024-11-28 19:04:40.612795] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-28 19:04:40.626018] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-28 19:04:40.626049] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-28 19:04:40.635647] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-28 19:04:40.635699] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-28 19:04:40.647084] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-28 19:04:40.647113] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-28 19:04:40.657533] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-28 19:04:40.657559] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-28 19:04:40.668639] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-28 19:04:40.668685] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-28 19:04:40.681040] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-28 19:04:40.681069] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-28 19:04:40.691008] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-28 19:04:40.691037] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-28 19:04:40.701854] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-28 19:04:40.701884] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-28 19:04:40.714713] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-28 19:04:40.714743] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-28 19:04:40.724087] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-28 19:04:40.724117] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-28 19:04:40.735551] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-28 19:04:40.735578] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-28 19:04:40.748383] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-28 19:04:40.748425] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-28 19:04:40.758588] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-28 19:04:40.758615] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-28 19:04:40.769462] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-28 19:04:40.769489] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-28 19:04:40.782085] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-28 19:04:40.782115] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-28 19:04:40.791721] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-28 19:04:40.791751] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-28 19:04:40.802950] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-28 19:04:40.802981] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-28 19:04:40.813994] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-28 19:04:40.814024] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-28 19:04:40.825284] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-28 19:04:40.825314] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-28 19:04:40.837996] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-28 19:04:40.838026] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-28 19:04:40.848163] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-28 19:04:40.848192] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-28 19:04:40.859186] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-28 19:04:40.859216] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:19.833 [2024-11-28 19:04:40.872445] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:19.833 [2024-11-28 19:04:40.872489] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-28 19:04:40.882763] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-28 19:04:40.882794] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-28 19:04:40.893695] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-28 19:04:40.893726] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-28 19:04:40.904748] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-28 19:04:40.904778] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-28 19:04:40.915891] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-28 19:04:40.915921] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-28 19:04:40.929244] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-28 19:04:40.929274] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-28 19:04:40.940091] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-28 19:04:40.940122] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-28 19:04:40.950732] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-28 19:04:40.950763] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-28 19:04:40.961420] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-28 19:04:40.961462] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-28 19:04:40.972127] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-28 19:04:40.972157] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-28 19:04:40.983292] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-28 19:04:40.983321] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-28 19:04:40.994516] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-28 19:04:40.994543] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-28 19:04:41.005104] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-28 19:04:41.005134] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-28 19:04:41.016035] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-28 19:04:41.016065] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-28 19:04:41.026571] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-28 19:04:41.026597] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-28 19:04:41.037165] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-28 19:04:41.037195] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-28 19:04:41.048144] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-28 19:04:41.048174] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-28 19:04:41.060733] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-28 19:04:41.060764] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-28 19:04:41.071250] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-28 19:04:41.071280] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.092 [2024-11-28 19:04:41.081857] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.092 [2024-11-28 19:04:41.081888] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.093 [2024-11-28 19:04:41.092635] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.093 [2024-11-28 19:04:41.092664] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.093 [2024-11-28 19:04:41.103402] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.093 [2024-11-28 19:04:41.103447] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.093 [2024-11-28 19:04:41.116124] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.093 [2024-11-28 19:04:41.116155] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.093 [2024-11-28 19:04:41.126764] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.093 [2024-11-28 19:04:41.126795] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.093 [2024-11-28 19:04:41.137601] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.093 [2024-11-28 19:04:41.137628] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.353 [2024-11-28 19:04:41.150357] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.353 [2024-11-28 19:04:41.150387] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.353 [2024-11-28 19:04:41.160617] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.353 [2024-11-28 19:04:41.160644] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.353 [2024-11-28 19:04:41.171063] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.353 [2024-11-28 19:04:41.171094] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.353 [2024-11-28 19:04:41.181624] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.353 [2024-11-28 19:04:41.181660] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.353 [2024-11-28 19:04:41.192448] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.353 [2024-11-28 19:04:41.192475] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.353 [2024-11-28 19:04:41.205895] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.353 [2024-11-28 19:04:41.205926] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.353 [2024-11-28 19:04:41.216240] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.353 [2024-11-28 19:04:41.216269] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.353 [2024-11-28 19:04:41.226986] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.353 [2024-11-28 19:04:41.227016] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.353 [2024-11-28 19:04:41.241605] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.353 [2024-11-28 19:04:41.241632] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.353 [2024-11-28 19:04:41.251884] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.353 [2024-11-28 19:04:41.251915] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.353 [2024-11-28 19:04:41.262580] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.353 [2024-11-28 19:04:41.262608] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.353 [2024-11-28 19:04:41.273685] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.353 [2024-11-28 19:04:41.273715] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.353 [2024-11-28 19:04:41.284641] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.353 [2024-11-28 19:04:41.284684] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.353 [2024-11-28 19:04:41.296076] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.353 [2024-11-28 19:04:41.296106] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.353 [2024-11-28 19:04:41.306658] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.353 [2024-11-28 19:04:41.306701] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.353 [2024-11-28 19:04:41.317763] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.353 [2024-11-28 19:04:41.317793] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.353 [2024-11-28 19:04:41.330656] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.353 [2024-11-28 19:04:41.330700] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.353 [2024-11-28 19:04:41.340381] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.353 [2024-11-28 19:04:41.340419] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.353 [2024-11-28 19:04:41.351076] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.353 [2024-11-28 19:04:41.351107] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.353 [2024-11-28 19:04:41.363540] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.353 [2024-11-28 19:04:41.363568] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.353 [2024-11-28 19:04:41.373442] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.353 [2024-11-28 19:04:41.373469] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.353 [2024-11-28 19:04:41.384920] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.353 [2024-11-28 19:04:41.384949] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.353 [2024-11-28 19:04:41.395305] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.353 [2024-11-28 19:04:41.395335] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.614 [2024-11-28 19:04:41.406333] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.614 [2024-11-28 19:04:41.406364] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.614 [2024-11-28 19:04:41.419137] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.614 [2024-11-28 19:04:41.419167] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.614 [2024-11-28 19:04:41.429342] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.614 [2024-11-28 19:04:41.429372] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.614 [2024-11-28 19:04:41.440351] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.614 [2024-11-28 19:04:41.440381] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.614 [2024-11-28 19:04:41.451029] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.614 [2024-11-28 19:04:41.451059] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.614 [2024-11-28 19:04:41.461576] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.614 [2024-11-28 19:04:41.461602] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.614 [2024-11-28 19:04:41.472415] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.614 [2024-11-28 19:04:41.472465] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.614 [2024-11-28 19:04:41.483579] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.614 [2024-11-28 19:04:41.483607] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.614 [2024-11-28 19:04:41.496367] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.614 [2024-11-28 19:04:41.496408] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.614 [2024-11-28 19:04:41.506963] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.614 [2024-11-28 19:04:41.506993] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.614 [2024-11-28 19:04:41.517852] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.614 [2024-11-28 19:04:41.517883] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.614 [2024-11-28 19:04:41.535940] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.614 [2024-11-28 19:04:41.535972] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.614 [2024-11-28 19:04:41.546103] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.614 [2024-11-28 19:04:41.546133] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.614 [2024-11-28 19:04:41.556618] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.614 [2024-11-28 19:04:41.556645] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.614 [2024-11-28 19:04:41.567804] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.614 [2024-11-28 19:04:41.567834] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.614 [2024-11-28 19:04:41.578733] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.614 [2024-11-28 19:04:41.578763] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.614 [2024-11-28 19:04:41.591368] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.614 [2024-11-28 19:04:41.591410] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.614 [2024-11-28 19:04:41.601779] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.614 [2024-11-28 19:04:41.601809] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.614 [2024-11-28 19:04:41.612938] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.614 [2024-11-28 19:04:41.612969] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.614 [2024-11-28 19:04:41.625918] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.614 [2024-11-28 19:04:41.625948] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.614 [2024-11-28 19:04:41.636298] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.614 [2024-11-28 19:04:41.636328] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.614 [2024-11-28 19:04:41.647132] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.614 [2024-11-28 19:04:41.647162] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.614 [2024-11-28 19:04:41.658368] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.614 [2024-11-28 19:04:41.658409] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.873 [2024-11-28 19:04:41.668985] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.873 [2024-11-28 19:04:41.669015] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.873 00:16:20.873 Latency(us) 00:16:20.873 [2024-11-28T18:04:41.921Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:20.873 [2024-11-28T18:04:41.921Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:16:20.873 Nvme1n1 : 5.01 11653.69 91.04 0.00 0.00 10967.76 4805.97 22136.60 00:16:20.873 [2024-11-28T18:04:41.921Z] =================================================================================================================== 00:16:20.873 [2024-11-28T18:04:41.921Z] Total : 11653.69 91.04 0.00 0.00 10967.76 4805.97 22136.60 00:16:20.873 [2024-11-28 19:04:41.676688] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.873 [2024-11-28 19:04:41.676717] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.873 [2024-11-28 19:04:41.684710] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.873 [2024-11-28 19:04:41.684739] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.873 [2024-11-28 19:04:41.692731] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.873 [2024-11-28 19:04:41.692757] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.873 [2024-11-28 19:04:41.700793] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.873 [2024-11-28 19:04:41.700845] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.873 [2024-11-28 19:04:41.708814] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.873 [2024-11-28 19:04:41.708868] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.873 [2024-11-28 19:04:41.716836] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.873 [2024-11-28 19:04:41.716890] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.873 [2024-11-28 19:04:41.724849] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.873 [2024-11-28 19:04:41.724899] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.873 [2024-11-28 19:04:41.732873] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.873 [2024-11-28 19:04:41.732925] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.873 [2024-11-28 19:04:41.740900] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.873 [2024-11-28 19:04:41.740953] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.873 [2024-11-28 19:04:41.748919] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.873 [2024-11-28 19:04:41.748970] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.873 [2024-11-28 19:04:41.756946] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.873 [2024-11-28 19:04:41.756999] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.873 [2024-11-28 19:04:41.764972] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.873 [2024-11-28 19:04:41.765025] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.873 [2024-11-28 19:04:41.772982] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.873 [2024-11-28 19:04:41.773033] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.873 [2024-11-28 19:04:41.781030] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.873 [2024-11-28 19:04:41.781086] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.873 [2024-11-28 19:04:41.789028] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.873 [2024-11-28 19:04:41.789079] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.873 [2024-11-28 19:04:41.797048] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.873 [2024-11-28 19:04:41.797096] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.873 [2024-11-28 19:04:41.805076] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.873 [2024-11-28 19:04:41.805126] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.873 [2024-11-28 19:04:41.813097] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.873 [2024-11-28 19:04:41.813176] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.873 [2024-11-28 19:04:41.821098] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.873 [2024-11-28 19:04:41.821142] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.873 [2024-11-28 19:04:41.829094] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.873 [2024-11-28 19:04:41.829120] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.873 [2024-11-28 19:04:41.837115] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.873 [2024-11-28 19:04:41.837139] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.873 [2024-11-28 19:04:41.845139] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.873 [2024-11-28 19:04:41.845162] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.873 [2024-11-28 19:04:41.853167] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.873 [2024-11-28 19:04:41.853192] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.873 [2024-11-28 19:04:41.861230] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.873 [2024-11-28 19:04:41.861276] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.873 [2024-11-28 19:04:41.869251] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.873 [2024-11-28 19:04:41.869300] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.873 [2024-11-28 19:04:41.877270] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.873 [2024-11-28 19:04:41.877318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.873 [2024-11-28 19:04:41.885251] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.873 [2024-11-28 19:04:41.885275] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.873 [2024-11-28 19:04:41.893274] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.873 [2024-11-28 19:04:41.893298] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.873 [2024-11-28 19:04:41.901303] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.873 [2024-11-28 19:04:41.901332] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.874 [2024-11-28 19:04:41.909320] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.874 [2024-11-28 19:04:41.909346] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:20.874 [2024-11-28 19:04:41.917350] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:20.874 [2024-11-28 19:04:41.917391] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:21.131 [2024-11-28 19:04:41.925433] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:21.131 [2024-11-28 19:04:41.925490] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:21.131 [2024-11-28 19:04:41.933448] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:21.131 [2024-11-28 19:04:41.933492] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:21.131 [2024-11-28 19:04:41.941416] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:21.131 [2024-11-28 19:04:41.941449] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:21.131 [2024-11-28 19:04:41.949435] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:21.131 [2024-11-28 19:04:41.949469] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:21.131 [2024-11-28 19:04:41.957458] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:16:21.131 [2024-11-28 19:04:41.957482] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:21.132 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (204002) - No such process 00:16:21.132 19:04:41 -- target/zcopy.sh@49 -- # wait 204002 00:16:21.132 19:04:41 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:16:21.132 19:04:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:21.132 19:04:41 -- common/autotest_common.sh@10 -- # set +x 00:16:21.132 19:04:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:21.132 19:04:41 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:16:21.132 19:04:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:21.132 19:04:41 -- common/autotest_common.sh@10 -- # set +x 00:16:21.132 delay0 00:16:21.132 19:04:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:21.132 19:04:41 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:16:21.132 19:04:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:21.132 19:04:41 -- common/autotest_common.sh@10 -- # set +x 00:16:21.132 19:04:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:21.132 19:04:41 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:16:21.132 EAL: No free 2048 kB hugepages reported on node 1 00:16:21.132 [2024-11-28 19:04:42.120504] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:16:27.710 Initializing NVMe Controllers 00:16:27.710 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:16:27.710 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:16:27.710 Initialization complete. Launching workers. 00:16:27.710 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 320, failed: 741 00:16:27.710 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 1028, failed to submit 33 00:16:27.710 success 850, unsuccess 178, failed 0 00:16:27.710 19:04:48 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:16:27.710 19:04:48 -- target/zcopy.sh@60 -- # nvmftestfini 00:16:27.710 19:04:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:27.710 19:04:48 -- nvmf/common.sh@116 -- # sync 00:16:27.710 19:04:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:27.710 19:04:48 -- nvmf/common.sh@119 -- # set +e 00:16:27.710 19:04:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:27.710 19:04:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:27.710 rmmod nvme_tcp 00:16:27.710 rmmod nvme_fabrics 00:16:27.710 rmmod nvme_keyring 00:16:27.710 19:04:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:27.710 19:04:48 -- nvmf/common.sh@123 -- # set -e 00:16:27.710 19:04:48 -- nvmf/common.sh@124 -- # return 0 00:16:27.710 19:04:48 -- nvmf/common.sh@477 -- # '[' -n 202531 ']' 00:16:27.710 19:04:48 -- nvmf/common.sh@478 -- # killprocess 202531 00:16:27.710 19:04:48 -- common/autotest_common.sh@936 -- # '[' -z 202531 ']' 00:16:27.710 19:04:48 -- common/autotest_common.sh@940 -- # kill -0 202531 00:16:27.711 19:04:48 -- common/autotest_common.sh@941 -- # uname 00:16:27.711 19:04:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:27.711 19:04:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 202531 00:16:27.711 19:04:48 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:16:27.711 19:04:48 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:16:27.711 19:04:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 202531' 00:16:27.711 killing process with pid 202531 00:16:27.711 19:04:48 -- common/autotest_common.sh@955 -- # kill 202531 00:16:27.711 19:04:48 -- common/autotest_common.sh@960 -- # wait 202531 00:16:27.711 19:04:48 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:27.711 19:04:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:27.711 19:04:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:27.711 19:04:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:27.711 19:04:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:27.711 19:04:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:27.711 19:04:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:27.711 19:04:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:30.256 19:04:50 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:30.256 00:16:30.256 real 0m29.157s 00:16:30.256 user 0m43.478s 00:16:30.256 sys 0m7.732s 00:16:30.256 19:04:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:30.256 19:04:50 -- common/autotest_common.sh@10 -- # set +x 00:16:30.256 ************************************ 00:16:30.256 END TEST nvmf_zcopy 00:16:30.256 ************************************ 00:16:30.256 19:04:50 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:16:30.256 19:04:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:30.256 19:04:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:30.256 19:04:50 -- common/autotest_common.sh@10 -- # set +x 00:16:30.256 ************************************ 00:16:30.256 START TEST nvmf_nmic 00:16:30.256 ************************************ 00:16:30.256 19:04:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:16:30.256 * Looking for test storage... 00:16:30.256 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:30.256 19:04:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:30.256 19:04:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:30.256 19:04:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:30.256 19:04:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:30.256 19:04:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:30.256 19:04:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:30.256 19:04:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:30.256 19:04:50 -- scripts/common.sh@335 -- # IFS=.-: 00:16:30.256 19:04:50 -- scripts/common.sh@335 -- # read -ra ver1 00:16:30.256 19:04:50 -- scripts/common.sh@336 -- # IFS=.-: 00:16:30.256 19:04:50 -- scripts/common.sh@336 -- # read -ra ver2 00:16:30.256 19:04:50 -- scripts/common.sh@337 -- # local 'op=<' 00:16:30.256 19:04:50 -- scripts/common.sh@339 -- # ver1_l=2 00:16:30.256 19:04:50 -- scripts/common.sh@340 -- # ver2_l=1 00:16:30.256 19:04:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:30.256 19:04:50 -- scripts/common.sh@343 -- # case "$op" in 00:16:30.256 19:04:50 -- scripts/common.sh@344 -- # : 1 00:16:30.256 19:04:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:30.256 19:04:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:30.256 19:04:50 -- scripts/common.sh@364 -- # decimal 1 00:16:30.256 19:04:50 -- scripts/common.sh@352 -- # local d=1 00:16:30.256 19:04:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:30.256 19:04:50 -- scripts/common.sh@354 -- # echo 1 00:16:30.256 19:04:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:30.256 19:04:50 -- scripts/common.sh@365 -- # decimal 2 00:16:30.256 19:04:50 -- scripts/common.sh@352 -- # local d=2 00:16:30.256 19:04:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:30.256 19:04:50 -- scripts/common.sh@354 -- # echo 2 00:16:30.256 19:04:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:30.256 19:04:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:30.256 19:04:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:30.256 19:04:50 -- scripts/common.sh@367 -- # return 0 00:16:30.256 19:04:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:30.256 19:04:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:30.256 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:30.256 --rc genhtml_branch_coverage=1 00:16:30.256 --rc genhtml_function_coverage=1 00:16:30.256 --rc genhtml_legend=1 00:16:30.256 --rc geninfo_all_blocks=1 00:16:30.256 --rc geninfo_unexecuted_blocks=1 00:16:30.256 00:16:30.256 ' 00:16:30.256 19:04:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:30.256 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:30.256 --rc genhtml_branch_coverage=1 00:16:30.256 --rc genhtml_function_coverage=1 00:16:30.256 --rc genhtml_legend=1 00:16:30.256 --rc geninfo_all_blocks=1 00:16:30.256 --rc geninfo_unexecuted_blocks=1 00:16:30.256 00:16:30.256 ' 00:16:30.256 19:04:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:30.256 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:30.256 --rc genhtml_branch_coverage=1 00:16:30.256 --rc genhtml_function_coverage=1 00:16:30.256 --rc genhtml_legend=1 00:16:30.256 --rc geninfo_all_blocks=1 00:16:30.256 --rc geninfo_unexecuted_blocks=1 00:16:30.256 00:16:30.256 ' 00:16:30.256 19:04:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:30.256 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:30.256 --rc genhtml_branch_coverage=1 00:16:30.256 --rc genhtml_function_coverage=1 00:16:30.256 --rc genhtml_legend=1 00:16:30.256 --rc geninfo_all_blocks=1 00:16:30.256 --rc geninfo_unexecuted_blocks=1 00:16:30.256 00:16:30.256 ' 00:16:30.256 19:04:50 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:30.256 19:04:50 -- nvmf/common.sh@7 -- # uname -s 00:16:30.256 19:04:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:30.256 19:04:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:30.256 19:04:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:30.256 19:04:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:30.256 19:04:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:30.256 19:04:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:30.256 19:04:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:30.256 19:04:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:30.256 19:04:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:30.256 19:04:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:30.256 19:04:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:30.256 19:04:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:30.256 19:04:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:30.256 19:04:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:30.256 19:04:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:30.256 19:04:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:30.256 19:04:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:30.256 19:04:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:30.256 19:04:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:30.256 19:04:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:30.256 19:04:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:30.256 19:04:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:30.256 19:04:50 -- paths/export.sh@5 -- # export PATH 00:16:30.256 19:04:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:30.256 19:04:50 -- nvmf/common.sh@46 -- # : 0 00:16:30.256 19:04:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:30.256 19:04:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:30.256 19:04:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:30.256 19:04:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:30.256 19:04:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:30.256 19:04:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:30.256 19:04:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:30.256 19:04:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:30.256 19:04:50 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:30.256 19:04:50 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:30.256 19:04:50 -- target/nmic.sh@14 -- # nvmftestinit 00:16:30.257 19:04:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:30.257 19:04:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:30.257 19:04:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:30.257 19:04:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:30.257 19:04:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:30.257 19:04:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:30.257 19:04:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:30.257 19:04:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:30.257 19:04:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:30.257 19:04:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:30.257 19:04:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:30.257 19:04:50 -- common/autotest_common.sh@10 -- # set +x 00:16:32.285 19:04:53 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:32.285 19:04:53 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:32.285 19:04:53 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:32.285 19:04:53 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:32.285 19:04:53 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:32.285 19:04:53 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:32.285 19:04:53 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:32.285 19:04:53 -- nvmf/common.sh@294 -- # net_devs=() 00:16:32.285 19:04:53 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:32.285 19:04:53 -- nvmf/common.sh@295 -- # e810=() 00:16:32.285 19:04:53 -- nvmf/common.sh@295 -- # local -ga e810 00:16:32.285 19:04:53 -- nvmf/common.sh@296 -- # x722=() 00:16:32.285 19:04:53 -- nvmf/common.sh@296 -- # local -ga x722 00:16:32.285 19:04:53 -- nvmf/common.sh@297 -- # mlx=() 00:16:32.285 19:04:53 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:32.285 19:04:53 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:32.285 19:04:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:32.285 19:04:53 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:32.285 19:04:53 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:32.285 19:04:53 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:32.285 19:04:53 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:32.285 19:04:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:32.285 19:04:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:32.285 19:04:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:32.285 19:04:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:32.285 19:04:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:32.285 19:04:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:32.285 19:04:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:32.285 19:04:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:32.285 19:04:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:32.285 19:04:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:32.285 19:04:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:32.285 19:04:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:32.285 19:04:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:32.285 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:32.285 19:04:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:32.285 19:04:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:32.285 19:04:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:32.285 19:04:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:32.285 19:04:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:32.285 19:04:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:32.285 19:04:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:32.285 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:32.285 19:04:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:32.285 19:04:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:32.285 19:04:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:32.285 19:04:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:32.285 19:04:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:32.285 19:04:53 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:32.285 19:04:53 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:32.285 19:04:53 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:32.285 19:04:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:32.285 19:04:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:32.285 19:04:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:32.285 19:04:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:32.285 19:04:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:32.285 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:32.285 19:04:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:32.285 19:04:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:32.285 19:04:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:32.285 19:04:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:32.285 19:04:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:32.285 19:04:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:32.285 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:32.285 19:04:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:32.285 19:04:53 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:32.285 19:04:53 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:32.285 19:04:53 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:32.286 19:04:53 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:32.286 19:04:53 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:32.286 19:04:53 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:32.286 19:04:53 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:32.286 19:04:53 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:32.286 19:04:53 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:32.286 19:04:53 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:32.286 19:04:53 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:32.286 19:04:53 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:32.286 19:04:53 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:32.286 19:04:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:32.286 19:04:53 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:32.286 19:04:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:32.286 19:04:53 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:32.286 19:04:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:32.286 19:04:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:32.286 19:04:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:32.286 19:04:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:32.286 19:04:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:32.286 19:04:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:32.286 19:04:53 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:32.286 19:04:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:32.286 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:32.286 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.267 ms 00:16:32.286 00:16:32.286 --- 10.0.0.2 ping statistics --- 00:16:32.286 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:32.286 rtt min/avg/max/mdev = 0.267/0.267/0.267/0.000 ms 00:16:32.286 19:04:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:32.286 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:32.286 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.183 ms 00:16:32.286 00:16:32.286 --- 10.0.0.1 ping statistics --- 00:16:32.286 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:32.286 rtt min/avg/max/mdev = 0.183/0.183/0.183/0.000 ms 00:16:32.286 19:04:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:32.286 19:04:53 -- nvmf/common.sh@410 -- # return 0 00:16:32.286 19:04:53 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:32.286 19:04:53 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:32.286 19:04:53 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:32.286 19:04:53 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:32.286 19:04:53 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:32.286 19:04:53 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:32.286 19:04:53 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:32.286 19:04:53 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:16:32.286 19:04:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:32.286 19:04:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:32.286 19:04:53 -- common/autotest_common.sh@10 -- # set +x 00:16:32.286 19:04:53 -- nvmf/common.sh@469 -- # nvmfpid=207452 00:16:32.286 19:04:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:32.286 19:04:53 -- nvmf/common.sh@470 -- # waitforlisten 207452 00:16:32.286 19:04:53 -- common/autotest_common.sh@829 -- # '[' -z 207452 ']' 00:16:32.286 19:04:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:32.286 19:04:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:32.286 19:04:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:32.286 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:32.286 19:04:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:32.286 19:04:53 -- common/autotest_common.sh@10 -- # set +x 00:16:32.561 [2024-11-28 19:04:53.311932] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:32.561 [2024-11-28 19:04:53.311999] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:32.561 EAL: No free 2048 kB hugepages reported on node 1 00:16:32.561 [2024-11-28 19:04:53.379807] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:32.561 [2024-11-28 19:04:53.497514] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:32.561 [2024-11-28 19:04:53.497697] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:32.561 [2024-11-28 19:04:53.497727] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:32.561 [2024-11-28 19:04:53.497750] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:32.561 [2024-11-28 19:04:53.497850] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:32.561 [2024-11-28 19:04:53.497885] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:32.561 [2024-11-28 19:04:53.497939] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:32.561 [2024-11-28 19:04:53.497948] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:33.537 19:04:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:33.537 19:04:54 -- common/autotest_common.sh@862 -- # return 0 00:16:33.537 19:04:54 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:33.537 19:04:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:33.537 19:04:54 -- common/autotest_common.sh@10 -- # set +x 00:16:33.537 19:04:54 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:33.537 19:04:54 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:33.537 19:04:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.537 19:04:54 -- common/autotest_common.sh@10 -- # set +x 00:16:33.537 [2024-11-28 19:04:54.322999] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:33.537 19:04:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:33.537 19:04:54 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:33.537 19:04:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.537 19:04:54 -- common/autotest_common.sh@10 -- # set +x 00:16:33.537 Malloc0 00:16:33.537 19:04:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:33.537 19:04:54 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:33.537 19:04:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.537 19:04:54 -- common/autotest_common.sh@10 -- # set +x 00:16:33.537 19:04:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:33.537 19:04:54 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:33.537 19:04:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.537 19:04:54 -- common/autotest_common.sh@10 -- # set +x 00:16:33.537 19:04:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:33.537 19:04:54 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:33.537 19:04:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.537 19:04:54 -- common/autotest_common.sh@10 -- # set +x 00:16:33.537 [2024-11-28 19:04:54.374012] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:33.537 19:04:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:33.537 19:04:54 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:16:33.537 test case1: single bdev can't be used in multiple subsystems 00:16:33.537 19:04:54 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:16:33.537 19:04:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.537 19:04:54 -- common/autotest_common.sh@10 -- # set +x 00:16:33.537 19:04:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:33.537 19:04:54 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:16:33.537 19:04:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.537 19:04:54 -- common/autotest_common.sh@10 -- # set +x 00:16:33.537 19:04:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:33.537 19:04:54 -- target/nmic.sh@28 -- # nmic_status=0 00:16:33.537 19:04:54 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:16:33.537 19:04:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.537 19:04:54 -- common/autotest_common.sh@10 -- # set +x 00:16:33.537 [2024-11-28 19:04:54.397891] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:16:33.537 [2024-11-28 19:04:54.397921] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:16:33.537 [2024-11-28 19:04:54.397944] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:16:33.537 request: 00:16:33.537 { 00:16:33.537 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:16:33.537 "namespace": { 00:16:33.537 "bdev_name": "Malloc0" 00:16:33.537 }, 00:16:33.537 "method": "nvmf_subsystem_add_ns", 00:16:33.537 "req_id": 1 00:16:33.537 } 00:16:33.537 Got JSON-RPC error response 00:16:33.537 response: 00:16:33.537 { 00:16:33.537 "code": -32602, 00:16:33.537 "message": "Invalid parameters" 00:16:33.537 } 00:16:33.537 19:04:54 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:16:33.537 19:04:54 -- target/nmic.sh@29 -- # nmic_status=1 00:16:33.537 19:04:54 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:16:33.537 19:04:54 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:16:33.537 Adding namespace failed - expected result. 00:16:33.537 19:04:54 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:16:33.537 test case2: host connect to nvmf target in multiple paths 00:16:33.537 19:04:54 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:16:33.537 19:04:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:33.537 19:04:54 -- common/autotest_common.sh@10 -- # set +x 00:16:33.537 [2024-11-28 19:04:54.406023] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:16:33.537 19:04:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:33.537 19:04:54 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:34.111 19:04:55 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:16:35.049 19:04:55 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:16:35.049 19:04:55 -- common/autotest_common.sh@1187 -- # local i=0 00:16:35.049 19:04:55 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:16:35.049 19:04:55 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:16:35.049 19:04:55 -- common/autotest_common.sh@1194 -- # sleep 2 00:16:36.956 19:04:57 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:16:36.956 19:04:57 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:16:36.956 19:04:57 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:16:36.956 19:04:57 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:16:36.956 19:04:57 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:16:36.956 19:04:57 -- common/autotest_common.sh@1197 -- # return 0 00:16:36.956 19:04:57 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:36.956 [global] 00:16:36.956 thread=1 00:16:36.956 invalidate=1 00:16:36.956 rw=write 00:16:36.956 time_based=1 00:16:36.956 runtime=1 00:16:36.956 ioengine=libaio 00:16:36.956 direct=1 00:16:36.956 bs=4096 00:16:36.956 iodepth=1 00:16:36.956 norandommap=0 00:16:36.956 numjobs=1 00:16:36.956 00:16:36.956 verify_dump=1 00:16:36.956 verify_backlog=512 00:16:36.956 verify_state_save=0 00:16:36.956 do_verify=1 00:16:36.956 verify=crc32c-intel 00:16:36.956 [job0] 00:16:36.956 filename=/dev/nvme0n1 00:16:36.956 Could not set queue depth (nvme0n1) 00:16:37.525 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:37.525 fio-3.35 00:16:37.525 Starting 1 thread 00:16:38.461 00:16:38.461 job0: (groupid=0, jobs=1): err= 0: pid=208247: Thu Nov 28 19:04:59 2024 00:16:38.461 read: IOPS=2049, BW=8199KiB/s (8396kB/s)(8412KiB/1026msec) 00:16:38.461 slat (nsec): min=4089, max=50220, avg=8283.64, stdev=5867.42 00:16:38.461 clat (usec): min=166, max=42078, avg=271.47, stdev=1579.11 00:16:38.461 lat (usec): min=171, max=42092, avg=279.75, stdev=1579.39 00:16:38.461 clat percentiles (usec): 00:16:38.461 | 1.00th=[ 176], 5.00th=[ 182], 10.00th=[ 186], 20.00th=[ 190], 00:16:38.461 | 30.00th=[ 194], 40.00th=[ 198], 50.00th=[ 202], 60.00th=[ 206], 00:16:38.461 | 70.00th=[ 210], 80.00th=[ 219], 90.00th=[ 237], 95.00th=[ 265], 00:16:38.461 | 99.00th=[ 498], 99.50th=[ 510], 99.90th=[42206], 99.95th=[42206], 00:16:38.461 | 99.99th=[42206] 00:16:38.461 write: IOPS=2495, BW=9981KiB/s (10.2MB/s)(10.0MiB/1026msec); 0 zone resets 00:16:38.461 slat (nsec): min=5508, max=51935, avg=10570.24, stdev=5651.13 00:16:38.461 clat (usec): min=119, max=389, avg=155.28, stdev=20.67 00:16:38.461 lat (usec): min=125, max=441, avg=165.85, stdev=22.65 00:16:38.461 clat percentiles (usec): 00:16:38.461 | 1.00th=[ 128], 5.00th=[ 135], 10.00th=[ 137], 20.00th=[ 141], 00:16:38.461 | 30.00th=[ 145], 40.00th=[ 149], 50.00th=[ 153], 60.00th=[ 157], 00:16:38.461 | 70.00th=[ 163], 80.00th=[ 167], 90.00th=[ 174], 95.00th=[ 182], 00:16:38.461 | 99.00th=[ 227], 99.50th=[ 285], 99.90th=[ 379], 99.95th=[ 388], 00:16:38.461 | 99.99th=[ 392] 00:16:38.461 bw ( KiB/s): min= 8192, max=12288, per=100.00%, avg=10240.00, stdev=2896.31, samples=2 00:16:38.461 iops : min= 2048, max= 3072, avg=2560.00, stdev=724.08, samples=2 00:16:38.461 lat (usec) : 250=95.97%, 500=3.62%, 750=0.34% 00:16:38.461 lat (msec) : 50=0.06% 00:16:38.461 cpu : usr=3.12%, sys=3.61%, ctx=4663, majf=0, minf=1 00:16:38.461 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:38.461 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:38.461 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:38.461 issued rwts: total=2103,2560,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:38.461 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:38.461 00:16:38.461 Run status group 0 (all jobs): 00:16:38.461 READ: bw=8199KiB/s (8396kB/s), 8199KiB/s-8199KiB/s (8396kB/s-8396kB/s), io=8412KiB (8614kB), run=1026-1026msec 00:16:38.461 WRITE: bw=9981KiB/s (10.2MB/s), 9981KiB/s-9981KiB/s (10.2MB/s-10.2MB/s), io=10.0MiB (10.5MB), run=1026-1026msec 00:16:38.461 00:16:38.461 Disk stats (read/write): 00:16:38.461 nvme0n1: ios=2148/2560, merge=0/0, ticks=438/376, in_queue=814, util=91.38% 00:16:38.461 19:04:59 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:16:38.721 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:16:38.721 19:04:59 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:16:38.721 19:04:59 -- common/autotest_common.sh@1208 -- # local i=0 00:16:38.721 19:04:59 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:16:38.721 19:04:59 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:38.721 19:04:59 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:16:38.721 19:04:59 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:16:38.721 19:04:59 -- common/autotest_common.sh@1220 -- # return 0 00:16:38.721 19:04:59 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:16:38.721 19:04:59 -- target/nmic.sh@53 -- # nvmftestfini 00:16:38.721 19:04:59 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:38.721 19:04:59 -- nvmf/common.sh@116 -- # sync 00:16:38.721 19:04:59 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:38.721 19:04:59 -- nvmf/common.sh@119 -- # set +e 00:16:38.721 19:04:59 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:38.721 19:04:59 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:38.721 rmmod nvme_tcp 00:16:38.721 rmmod nvme_fabrics 00:16:38.721 rmmod nvme_keyring 00:16:38.721 19:04:59 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:38.721 19:04:59 -- nvmf/common.sh@123 -- # set -e 00:16:38.721 19:04:59 -- nvmf/common.sh@124 -- # return 0 00:16:38.721 19:04:59 -- nvmf/common.sh@477 -- # '[' -n 207452 ']' 00:16:38.721 19:04:59 -- nvmf/common.sh@478 -- # killprocess 207452 00:16:38.721 19:04:59 -- common/autotest_common.sh@936 -- # '[' -z 207452 ']' 00:16:38.721 19:04:59 -- common/autotest_common.sh@940 -- # kill -0 207452 00:16:38.721 19:04:59 -- common/autotest_common.sh@941 -- # uname 00:16:38.721 19:04:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:38.721 19:04:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 207452 00:16:38.721 19:04:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:38.721 19:04:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:38.721 19:04:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 207452' 00:16:38.721 killing process with pid 207452 00:16:38.721 19:04:59 -- common/autotest_common.sh@955 -- # kill 207452 00:16:38.721 19:04:59 -- common/autotest_common.sh@960 -- # wait 207452 00:16:38.983 19:05:00 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:38.983 19:05:00 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:38.983 19:05:00 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:38.983 19:05:00 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:38.983 19:05:00 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:38.983 19:05:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:38.983 19:05:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:38.983 19:05:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:41.520 19:05:02 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:41.520 00:16:41.520 real 0m11.289s 00:16:41.520 user 0m26.937s 00:16:41.520 sys 0m2.996s 00:16:41.520 19:05:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:41.520 19:05:02 -- common/autotest_common.sh@10 -- # set +x 00:16:41.520 ************************************ 00:16:41.520 END TEST nvmf_nmic 00:16:41.520 ************************************ 00:16:41.520 19:05:02 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:41.520 19:05:02 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:41.520 19:05:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:41.520 19:05:02 -- common/autotest_common.sh@10 -- # set +x 00:16:41.520 ************************************ 00:16:41.520 START TEST nvmf_fio_target 00:16:41.520 ************************************ 00:16:41.520 19:05:02 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:16:41.520 * Looking for test storage... 00:16:41.520 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:41.520 19:05:02 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:41.520 19:05:02 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:41.520 19:05:02 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:41.520 19:05:02 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:41.520 19:05:02 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:41.520 19:05:02 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:41.520 19:05:02 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:41.520 19:05:02 -- scripts/common.sh@335 -- # IFS=.-: 00:16:41.520 19:05:02 -- scripts/common.sh@335 -- # read -ra ver1 00:16:41.520 19:05:02 -- scripts/common.sh@336 -- # IFS=.-: 00:16:41.520 19:05:02 -- scripts/common.sh@336 -- # read -ra ver2 00:16:41.520 19:05:02 -- scripts/common.sh@337 -- # local 'op=<' 00:16:41.520 19:05:02 -- scripts/common.sh@339 -- # ver1_l=2 00:16:41.520 19:05:02 -- scripts/common.sh@340 -- # ver2_l=1 00:16:41.520 19:05:02 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:41.520 19:05:02 -- scripts/common.sh@343 -- # case "$op" in 00:16:41.520 19:05:02 -- scripts/common.sh@344 -- # : 1 00:16:41.520 19:05:02 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:41.520 19:05:02 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:41.520 19:05:02 -- scripts/common.sh@364 -- # decimal 1 00:16:41.520 19:05:02 -- scripts/common.sh@352 -- # local d=1 00:16:41.520 19:05:02 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:41.520 19:05:02 -- scripts/common.sh@354 -- # echo 1 00:16:41.520 19:05:02 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:41.520 19:05:02 -- scripts/common.sh@365 -- # decimal 2 00:16:41.520 19:05:02 -- scripts/common.sh@352 -- # local d=2 00:16:41.520 19:05:02 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:41.520 19:05:02 -- scripts/common.sh@354 -- # echo 2 00:16:41.520 19:05:02 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:41.520 19:05:02 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:41.520 19:05:02 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:41.520 19:05:02 -- scripts/common.sh@367 -- # return 0 00:16:41.520 19:05:02 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:41.520 19:05:02 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:41.520 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:41.520 --rc genhtml_branch_coverage=1 00:16:41.520 --rc genhtml_function_coverage=1 00:16:41.520 --rc genhtml_legend=1 00:16:41.520 --rc geninfo_all_blocks=1 00:16:41.520 --rc geninfo_unexecuted_blocks=1 00:16:41.520 00:16:41.520 ' 00:16:41.520 19:05:02 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:41.520 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:41.520 --rc genhtml_branch_coverage=1 00:16:41.520 --rc genhtml_function_coverage=1 00:16:41.520 --rc genhtml_legend=1 00:16:41.520 --rc geninfo_all_blocks=1 00:16:41.520 --rc geninfo_unexecuted_blocks=1 00:16:41.520 00:16:41.520 ' 00:16:41.520 19:05:02 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:41.520 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:41.521 --rc genhtml_branch_coverage=1 00:16:41.521 --rc genhtml_function_coverage=1 00:16:41.521 --rc genhtml_legend=1 00:16:41.521 --rc geninfo_all_blocks=1 00:16:41.521 --rc geninfo_unexecuted_blocks=1 00:16:41.521 00:16:41.521 ' 00:16:41.521 19:05:02 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:41.521 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:41.521 --rc genhtml_branch_coverage=1 00:16:41.521 --rc genhtml_function_coverage=1 00:16:41.521 --rc genhtml_legend=1 00:16:41.521 --rc geninfo_all_blocks=1 00:16:41.521 --rc geninfo_unexecuted_blocks=1 00:16:41.521 00:16:41.521 ' 00:16:41.521 19:05:02 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:41.521 19:05:02 -- nvmf/common.sh@7 -- # uname -s 00:16:41.521 19:05:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:41.521 19:05:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:41.521 19:05:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:41.521 19:05:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:41.521 19:05:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:41.521 19:05:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:41.521 19:05:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:41.521 19:05:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:41.521 19:05:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:41.521 19:05:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:41.521 19:05:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:41.521 19:05:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:41.521 19:05:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:41.521 19:05:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:41.521 19:05:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:41.521 19:05:02 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:41.521 19:05:02 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:41.521 19:05:02 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:41.521 19:05:02 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:41.521 19:05:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:41.521 19:05:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:41.521 19:05:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:41.521 19:05:02 -- paths/export.sh@5 -- # export PATH 00:16:41.521 19:05:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:41.521 19:05:02 -- nvmf/common.sh@46 -- # : 0 00:16:41.521 19:05:02 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:41.521 19:05:02 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:41.521 19:05:02 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:41.521 19:05:02 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:41.521 19:05:02 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:41.521 19:05:02 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:41.521 19:05:02 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:41.521 19:05:02 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:41.521 19:05:02 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:41.521 19:05:02 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:41.521 19:05:02 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:41.521 19:05:02 -- target/fio.sh@16 -- # nvmftestinit 00:16:41.521 19:05:02 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:41.521 19:05:02 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:41.521 19:05:02 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:41.521 19:05:02 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:41.521 19:05:02 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:41.521 19:05:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:41.521 19:05:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:41.521 19:05:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:41.521 19:05:02 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:41.521 19:05:02 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:41.521 19:05:02 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:41.521 19:05:02 -- common/autotest_common.sh@10 -- # set +x 00:16:43.427 19:05:04 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:43.427 19:05:04 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:43.427 19:05:04 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:43.427 19:05:04 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:43.427 19:05:04 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:43.427 19:05:04 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:43.427 19:05:04 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:43.427 19:05:04 -- nvmf/common.sh@294 -- # net_devs=() 00:16:43.427 19:05:04 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:43.427 19:05:04 -- nvmf/common.sh@295 -- # e810=() 00:16:43.427 19:05:04 -- nvmf/common.sh@295 -- # local -ga e810 00:16:43.427 19:05:04 -- nvmf/common.sh@296 -- # x722=() 00:16:43.427 19:05:04 -- nvmf/common.sh@296 -- # local -ga x722 00:16:43.427 19:05:04 -- nvmf/common.sh@297 -- # mlx=() 00:16:43.427 19:05:04 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:43.427 19:05:04 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:43.427 19:05:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:43.428 19:05:04 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:43.428 19:05:04 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:43.428 19:05:04 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:43.428 19:05:04 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:43.428 19:05:04 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:43.428 19:05:04 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:43.428 19:05:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:43.428 19:05:04 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:43.428 19:05:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:43.428 19:05:04 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:43.428 19:05:04 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:43.428 19:05:04 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:43.428 19:05:04 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:43.428 19:05:04 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:43.428 19:05:04 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:43.428 19:05:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:43.428 19:05:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:16:43.428 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:16:43.428 19:05:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:43.428 19:05:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:43.428 19:05:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:43.428 19:05:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:43.428 19:05:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:43.428 19:05:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:43.428 19:05:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:16:43.428 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:16:43.428 19:05:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:43.428 19:05:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:43.428 19:05:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:43.428 19:05:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:43.428 19:05:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:43.428 19:05:04 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:43.428 19:05:04 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:43.428 19:05:04 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:43.428 19:05:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:43.428 19:05:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:43.428 19:05:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:43.428 19:05:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:43.428 19:05:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:16:43.428 Found net devices under 0000:0a:00.0: cvl_0_0 00:16:43.428 19:05:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:43.428 19:05:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:43.428 19:05:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:43.428 19:05:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:43.428 19:05:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:43.428 19:05:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:16:43.428 Found net devices under 0000:0a:00.1: cvl_0_1 00:16:43.428 19:05:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:43.428 19:05:04 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:43.428 19:05:04 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:43.428 19:05:04 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:43.428 19:05:04 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:43.428 19:05:04 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:43.428 19:05:04 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:43.428 19:05:04 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:43.428 19:05:04 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:43.428 19:05:04 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:43.428 19:05:04 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:43.428 19:05:04 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:43.428 19:05:04 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:43.428 19:05:04 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:43.428 19:05:04 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:43.428 19:05:04 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:43.428 19:05:04 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:43.428 19:05:04 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:43.428 19:05:04 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:43.428 19:05:04 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:43.428 19:05:04 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:43.428 19:05:04 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:43.428 19:05:04 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:43.428 19:05:04 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:43.428 19:05:04 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:43.428 19:05:04 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:43.428 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:43.428 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.206 ms 00:16:43.428 00:16:43.428 --- 10.0.0.2 ping statistics --- 00:16:43.428 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:43.428 rtt min/avg/max/mdev = 0.206/0.206/0.206/0.000 ms 00:16:43.428 19:05:04 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:43.428 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:43.428 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.078 ms 00:16:43.428 00:16:43.428 --- 10.0.0.1 ping statistics --- 00:16:43.428 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:43.428 rtt min/avg/max/mdev = 0.078/0.078/0.078/0.000 ms 00:16:43.428 19:05:04 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:43.428 19:05:04 -- nvmf/common.sh@410 -- # return 0 00:16:43.428 19:05:04 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:43.428 19:05:04 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:43.428 19:05:04 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:43.428 19:05:04 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:43.428 19:05:04 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:43.428 19:05:04 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:43.428 19:05:04 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:43.428 19:05:04 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:16:43.428 19:05:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:43.428 19:05:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:43.428 19:05:04 -- common/autotest_common.sh@10 -- # set +x 00:16:43.428 19:05:04 -- nvmf/common.sh@469 -- # nvmfpid=210343 00:16:43.428 19:05:04 -- nvmf/common.sh@470 -- # waitforlisten 210343 00:16:43.428 19:05:04 -- common/autotest_common.sh@829 -- # '[' -z 210343 ']' 00:16:43.428 19:05:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:43.428 19:05:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:16:43.428 19:05:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:43.428 19:05:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:43.428 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:43.428 19:05:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:43.428 19:05:04 -- common/autotest_common.sh@10 -- # set +x 00:16:43.689 [2024-11-28 19:05:04.485434] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:43.689 [2024-11-28 19:05:04.485528] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:43.689 EAL: No free 2048 kB hugepages reported on node 1 00:16:43.689 [2024-11-28 19:05:04.557738] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:43.689 [2024-11-28 19:05:04.665475] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:43.689 [2024-11-28 19:05:04.665622] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:43.689 [2024-11-28 19:05:04.665639] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:43.689 [2024-11-28 19:05:04.665650] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:43.689 [2024-11-28 19:05:04.665705] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:43.689 [2024-11-28 19:05:04.665765] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:43.689 [2024-11-28 19:05:04.665831] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:43.689 [2024-11-28 19:05:04.665833] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:44.624 19:05:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:44.624 19:05:05 -- common/autotest_common.sh@862 -- # return 0 00:16:44.624 19:05:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:44.624 19:05:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:44.624 19:05:05 -- common/autotest_common.sh@10 -- # set +x 00:16:44.624 19:05:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:44.624 19:05:05 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:16:44.882 [2024-11-28 19:05:05.712746] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:44.882 19:05:05 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:45.141 19:05:06 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:16:45.141 19:05:06 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:45.400 19:05:06 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:16:45.400 19:05:06 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:45.659 19:05:06 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:16:45.659 19:05:06 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:45.917 19:05:06 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:16:45.917 19:05:06 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:16:46.176 19:05:07 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:46.434 19:05:07 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:16:46.434 19:05:07 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:46.693 19:05:07 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:16:46.693 19:05:07 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:16:46.952 19:05:07 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:16:46.952 19:05:07 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:16:47.211 19:05:08 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:16:47.470 19:05:08 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:47.470 19:05:08 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:47.729 19:05:08 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:16:47.729 19:05:08 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:16:47.988 19:05:08 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:48.247 [2024-11-28 19:05:09.151356] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:48.247 19:05:09 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:16:48.505 19:05:09 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:16:48.764 19:05:09 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:16:49.333 19:05:10 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:16:49.333 19:05:10 -- common/autotest_common.sh@1187 -- # local i=0 00:16:49.333 19:05:10 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:16:49.333 19:05:10 -- common/autotest_common.sh@1189 -- # [[ -n 4 ]] 00:16:49.333 19:05:10 -- common/autotest_common.sh@1190 -- # nvme_device_counter=4 00:16:49.333 19:05:10 -- common/autotest_common.sh@1194 -- # sleep 2 00:16:51.864 19:05:12 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:16:51.864 19:05:12 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:16:51.864 19:05:12 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:16:51.864 19:05:12 -- common/autotest_common.sh@1196 -- # nvme_devices=4 00:16:51.864 19:05:12 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:16:51.864 19:05:12 -- common/autotest_common.sh@1197 -- # return 0 00:16:51.864 19:05:12 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:16:51.864 [global] 00:16:51.864 thread=1 00:16:51.864 invalidate=1 00:16:51.864 rw=write 00:16:51.864 time_based=1 00:16:51.864 runtime=1 00:16:51.864 ioengine=libaio 00:16:51.864 direct=1 00:16:51.864 bs=4096 00:16:51.864 iodepth=1 00:16:51.864 norandommap=0 00:16:51.864 numjobs=1 00:16:51.864 00:16:51.864 verify_dump=1 00:16:51.864 verify_backlog=512 00:16:51.864 verify_state_save=0 00:16:51.864 do_verify=1 00:16:51.864 verify=crc32c-intel 00:16:51.864 [job0] 00:16:51.864 filename=/dev/nvme0n1 00:16:51.864 [job1] 00:16:51.864 filename=/dev/nvme0n2 00:16:51.864 [job2] 00:16:51.864 filename=/dev/nvme0n3 00:16:51.864 [job3] 00:16:51.864 filename=/dev/nvme0n4 00:16:51.864 Could not set queue depth (nvme0n1) 00:16:51.864 Could not set queue depth (nvme0n2) 00:16:51.864 Could not set queue depth (nvme0n3) 00:16:51.864 Could not set queue depth (nvme0n4) 00:16:51.864 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:51.864 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:51.864 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:51.865 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:51.865 fio-3.35 00:16:51.865 Starting 4 threads 00:16:52.802 00:16:52.802 job0: (groupid=0, jobs=1): err= 0: pid=211458: Thu Nov 28 19:05:13 2024 00:16:52.802 read: IOPS=1195, BW=4783KiB/s (4898kB/s)(4788KiB/1001msec) 00:16:52.802 slat (nsec): min=5948, max=52244, avg=14519.52, stdev=6086.84 00:16:52.802 clat (usec): min=178, max=41217, avg=551.64, stdev=3521.52 00:16:52.802 lat (usec): min=186, max=41236, avg=566.16, stdev=3523.04 00:16:52.802 clat percentiles (usec): 00:16:52.802 | 1.00th=[ 188], 5.00th=[ 200], 10.00th=[ 206], 20.00th=[ 217], 00:16:52.802 | 30.00th=[ 225], 40.00th=[ 231], 50.00th=[ 237], 60.00th=[ 247], 00:16:52.802 | 70.00th=[ 262], 80.00th=[ 277], 90.00th=[ 289], 95.00th=[ 310], 00:16:52.802 | 99.00th=[ 510], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:16:52.802 | 99.99th=[41157] 00:16:52.802 write: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec); 0 zone resets 00:16:52.802 slat (nsec): min=7929, max=64635, avg=16538.85, stdev=7148.32 00:16:52.802 clat (usec): min=133, max=1797, avg=183.63, stdev=61.10 00:16:52.802 lat (usec): min=141, max=1810, avg=200.17, stdev=62.22 00:16:52.802 clat percentiles (usec): 00:16:52.802 | 1.00th=[ 141], 5.00th=[ 145], 10.00th=[ 151], 20.00th=[ 157], 00:16:52.802 | 30.00th=[ 167], 40.00th=[ 174], 50.00th=[ 180], 60.00th=[ 186], 00:16:52.802 | 70.00th=[ 190], 80.00th=[ 198], 90.00th=[ 212], 95.00th=[ 229], 00:16:52.802 | 99.00th=[ 260], 99.50th=[ 379], 99.90th=[ 988], 99.95th=[ 1795], 00:16:52.802 | 99.99th=[ 1795] 00:16:52.802 bw ( KiB/s): min= 4096, max= 4096, per=17.38%, avg=4096.00, stdev= 0.00, samples=1 00:16:52.802 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:52.802 lat (usec) : 250=83.06%, 500=16.21%, 750=0.26%, 1000=0.11% 00:16:52.802 lat (msec) : 2=0.04%, 50=0.33% 00:16:52.802 cpu : usr=3.60%, sys=5.20%, ctx=2737, majf=0, minf=1 00:16:52.802 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:52.802 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.802 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.802 issued rwts: total=1197,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:52.802 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:52.802 job1: (groupid=0, jobs=1): err= 0: pid=211459: Thu Nov 28 19:05:13 2024 00:16:52.802 read: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec) 00:16:52.802 slat (nsec): min=5104, max=78087, avg=19420.74, stdev=10388.48 00:16:52.802 clat (usec): min=173, max=660, avg=313.88, stdev=79.26 00:16:52.802 lat (usec): min=190, max=678, avg=333.30, stdev=82.88 00:16:52.802 clat percentiles (usec): 00:16:52.802 | 1.00th=[ 196], 5.00th=[ 219], 10.00th=[ 239], 20.00th=[ 255], 00:16:52.802 | 30.00th=[ 265], 40.00th=[ 273], 50.00th=[ 289], 60.00th=[ 314], 00:16:52.802 | 70.00th=[ 338], 80.00th=[ 367], 90.00th=[ 429], 95.00th=[ 474], 00:16:52.802 | 99.00th=[ 570], 99.50th=[ 594], 99.90th=[ 660], 99.95th=[ 660], 00:16:52.802 | 99.99th=[ 660] 00:16:52.802 write: IOPS=1979, BW=7916KiB/s (8106kB/s)(7924KiB/1001msec); 0 zone resets 00:16:52.802 slat (usec): min=6, max=6466, avg=21.06, stdev=145.14 00:16:52.802 clat (usec): min=129, max=461, avg=214.73, stdev=53.47 00:16:52.802 lat (usec): min=142, max=6654, avg=235.78, stdev=154.69 00:16:52.802 clat percentiles (usec): 00:16:52.802 | 1.00th=[ 135], 5.00th=[ 149], 10.00th=[ 163], 20.00th=[ 176], 00:16:52.802 | 30.00th=[ 184], 40.00th=[ 194], 50.00th=[ 204], 60.00th=[ 217], 00:16:52.802 | 70.00th=[ 229], 80.00th=[ 245], 90.00th=[ 277], 95.00th=[ 338], 00:16:52.802 | 99.00th=[ 400], 99.50th=[ 416], 99.90th=[ 433], 99.95th=[ 461], 00:16:52.802 | 99.99th=[ 461] 00:16:52.802 bw ( KiB/s): min= 8192, max= 8192, per=34.75%, avg=8192.00, stdev= 0.00, samples=1 00:16:52.802 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:52.802 lat (usec) : 250=52.77%, 500=45.66%, 750=1.56% 00:16:52.802 cpu : usr=4.20%, sys=6.10%, ctx=3519, majf=0, minf=1 00:16:52.802 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:52.802 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.802 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.802 issued rwts: total=1536,1981,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:52.802 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:52.802 job2: (groupid=0, jobs=1): err= 0: pid=211460: Thu Nov 28 19:05:13 2024 00:16:52.802 read: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec) 00:16:52.802 slat (nsec): min=7525, max=56909, avg=16348.00, stdev=5994.72 00:16:52.802 clat (usec): min=211, max=662, avg=319.02, stdev=72.99 00:16:52.802 lat (usec): min=219, max=684, avg=335.37, stdev=74.88 00:16:52.802 clat percentiles (usec): 00:16:52.802 | 1.00th=[ 231], 5.00th=[ 245], 10.00th=[ 251], 20.00th=[ 265], 00:16:52.803 | 30.00th=[ 277], 40.00th=[ 289], 50.00th=[ 302], 60.00th=[ 314], 00:16:52.803 | 70.00th=[ 330], 80.00th=[ 355], 90.00th=[ 420], 95.00th=[ 482], 00:16:52.803 | 99.00th=[ 586], 99.50th=[ 619], 99.90th=[ 660], 99.95th=[ 660], 00:16:52.803 | 99.99th=[ 660] 00:16:52.803 write: IOPS=1874, BW=7497KiB/s (7676kB/s)(7504KiB/1001msec); 0 zone resets 00:16:52.803 slat (usec): min=7, max=28150, avg=39.44, stdev=678.83 00:16:52.803 clat (usec): min=133, max=469, avg=208.46, stdev=35.55 00:16:52.803 lat (usec): min=141, max=28478, avg=247.90, stdev=682.78 00:16:52.803 clat percentiles (usec): 00:16:52.803 | 1.00th=[ 153], 5.00th=[ 167], 10.00th=[ 172], 20.00th=[ 178], 00:16:52.803 | 30.00th=[ 184], 40.00th=[ 192], 50.00th=[ 200], 60.00th=[ 212], 00:16:52.803 | 70.00th=[ 225], 80.00th=[ 239], 90.00th=[ 258], 95.00th=[ 269], 00:16:52.803 | 99.00th=[ 322], 99.50th=[ 330], 99.90th=[ 400], 99.95th=[ 469], 00:16:52.803 | 99.99th=[ 469] 00:16:52.803 bw ( KiB/s): min= 8192, max= 8192, per=34.75%, avg=8192.00, stdev= 0.00, samples=1 00:16:52.803 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:16:52.803 lat (usec) : 250=51.61%, 500=46.78%, 750=1.61% 00:16:52.803 cpu : usr=5.40%, sys=7.30%, ctx=3416, majf=0, minf=1 00:16:52.803 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:52.803 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.803 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.803 issued rwts: total=1536,1876,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:52.803 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:52.803 job3: (groupid=0, jobs=1): err= 0: pid=211461: Thu Nov 28 19:05:13 2024 00:16:52.803 read: IOPS=21, BW=87.8KiB/s (89.9kB/s)(88.0KiB/1002msec) 00:16:52.803 slat (nsec): min=6862, max=34739, avg=25926.18, stdev=9791.61 00:16:52.803 clat (usec): min=16157, max=42000, avg=40120.00, stdev=5370.38 00:16:52.803 lat (usec): min=16191, max=42020, avg=40145.92, stdev=5368.60 00:16:52.803 clat percentiles (usec): 00:16:52.803 | 1.00th=[16188], 5.00th=[40633], 10.00th=[41157], 20.00th=[41157], 00:16:52.803 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:16:52.803 | 70.00th=[41157], 80.00th=[41681], 90.00th=[42206], 95.00th=[42206], 00:16:52.803 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:52.803 | 99.99th=[42206] 00:16:52.803 write: IOPS=510, BW=2044KiB/s (2093kB/s)(2048KiB/1002msec); 0 zone resets 00:16:52.803 slat (usec): min=6, max=707, avg=12.81, stdev=31.26 00:16:52.803 clat (usec): min=143, max=393, avg=209.73, stdev=43.12 00:16:52.803 lat (usec): min=150, max=928, avg=222.54, stdev=54.10 00:16:52.803 clat percentiles (usec): 00:16:52.803 | 1.00th=[ 155], 5.00th=[ 163], 10.00th=[ 169], 20.00th=[ 176], 00:16:52.803 | 30.00th=[ 182], 40.00th=[ 188], 50.00th=[ 196], 60.00th=[ 206], 00:16:52.803 | 70.00th=[ 221], 80.00th=[ 235], 90.00th=[ 285], 95.00th=[ 297], 00:16:52.803 | 99.00th=[ 338], 99.50th=[ 347], 99.90th=[ 396], 99.95th=[ 396], 00:16:52.803 | 99.99th=[ 396] 00:16:52.803 bw ( KiB/s): min= 4096, max= 4096, per=17.38%, avg=4096.00, stdev= 0.00, samples=1 00:16:52.803 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:52.803 lat (usec) : 250=80.52%, 500=15.36% 00:16:52.803 lat (msec) : 20=0.19%, 50=3.93% 00:16:52.803 cpu : usr=0.60%, sys=0.50%, ctx=537, majf=0, minf=1 00:16:52.803 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:52.803 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.803 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:52.803 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:52.803 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:52.803 00:16:52.803 Run status group 0 (all jobs): 00:16:52.803 READ: bw=16.7MiB/s (17.5MB/s), 87.8KiB/s-6138KiB/s (89.9kB/s-6285kB/s), io=16.8MiB (17.6MB), run=1001-1002msec 00:16:52.803 WRITE: bw=23.0MiB/s (24.1MB/s), 2044KiB/s-7916KiB/s (2093kB/s-8106kB/s), io=23.1MiB (24.2MB), run=1001-1002msec 00:16:52.803 00:16:52.803 Disk stats (read/write): 00:16:52.803 nvme0n1: ios=1050/1024, merge=0/0, ticks=673/172, in_queue=845, util=84.57% 00:16:52.803 nvme0n2: ios=1409/1536, merge=0/0, ticks=876/321, in_queue=1197, util=89.40% 00:16:52.803 nvme0n3: ios=1372/1536, merge=0/0, ticks=890/304, in_queue=1194, util=93.58% 00:16:52.803 nvme0n4: ios=74/512, merge=0/0, ticks=805/100, in_queue=905, util=94.06% 00:16:52.803 19:05:13 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:16:53.062 [global] 00:16:53.062 thread=1 00:16:53.062 invalidate=1 00:16:53.062 rw=randwrite 00:16:53.062 time_based=1 00:16:53.062 runtime=1 00:16:53.062 ioengine=libaio 00:16:53.062 direct=1 00:16:53.062 bs=4096 00:16:53.062 iodepth=1 00:16:53.062 norandommap=0 00:16:53.062 numjobs=1 00:16:53.062 00:16:53.062 verify_dump=1 00:16:53.062 verify_backlog=512 00:16:53.062 verify_state_save=0 00:16:53.062 do_verify=1 00:16:53.062 verify=crc32c-intel 00:16:53.062 [job0] 00:16:53.062 filename=/dev/nvme0n1 00:16:53.062 [job1] 00:16:53.062 filename=/dev/nvme0n2 00:16:53.062 [job2] 00:16:53.062 filename=/dev/nvme0n3 00:16:53.062 [job3] 00:16:53.062 filename=/dev/nvme0n4 00:16:53.062 Could not set queue depth (nvme0n1) 00:16:53.062 Could not set queue depth (nvme0n2) 00:16:53.062 Could not set queue depth (nvme0n3) 00:16:53.062 Could not set queue depth (nvme0n4) 00:16:53.062 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:53.062 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:53.062 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:53.062 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:53.062 fio-3.35 00:16:53.062 Starting 4 threads 00:16:54.442 00:16:54.442 job0: (groupid=0, jobs=1): err= 0: pid=211811: Thu Nov 28 19:05:15 2024 00:16:54.442 read: IOPS=492, BW=1971KiB/s (2018kB/s)(2032KiB/1031msec) 00:16:54.442 slat (nsec): min=7215, max=33896, avg=13313.52, stdev=5400.61 00:16:54.442 clat (usec): min=210, max=42163, avg=1828.28, stdev=7796.10 00:16:54.442 lat (usec): min=226, max=42180, avg=1841.60, stdev=7796.74 00:16:54.442 clat percentiles (usec): 00:16:54.442 | 1.00th=[ 219], 5.00th=[ 231], 10.00th=[ 239], 20.00th=[ 265], 00:16:54.442 | 30.00th=[ 273], 40.00th=[ 281], 50.00th=[ 285], 60.00th=[ 293], 00:16:54.442 | 70.00th=[ 310], 80.00th=[ 322], 90.00th=[ 371], 95.00th=[ 433], 00:16:54.442 | 99.00th=[41681], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:54.442 | 99.99th=[42206] 00:16:54.442 write: IOPS=496, BW=1986KiB/s (2034kB/s)(2048KiB/1031msec); 0 zone resets 00:16:54.442 slat (nsec): min=6636, max=33649, avg=8908.66, stdev=4034.21 00:16:54.442 clat (usec): min=134, max=2785, avg=168.43, stdev=122.15 00:16:54.442 lat (usec): min=142, max=2793, avg=177.34, stdev=122.28 00:16:54.442 clat percentiles (usec): 00:16:54.442 | 1.00th=[ 139], 5.00th=[ 143], 10.00th=[ 147], 20.00th=[ 151], 00:16:54.442 | 30.00th=[ 153], 40.00th=[ 157], 50.00th=[ 159], 60.00th=[ 163], 00:16:54.442 | 70.00th=[ 167], 80.00th=[ 172], 90.00th=[ 180], 95.00th=[ 186], 00:16:54.442 | 99.00th=[ 235], 99.50th=[ 437], 99.90th=[ 2802], 99.95th=[ 2802], 00:16:54.442 | 99.99th=[ 2802] 00:16:54.442 bw ( KiB/s): min= 4096, max= 4096, per=33.90%, avg=4096.00, stdev= 0.00, samples=1 00:16:54.442 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:54.442 lat (usec) : 250=56.37%, 500=41.18%, 750=0.29%, 1000=0.10% 00:16:54.442 lat (msec) : 2=0.10%, 4=0.10%, 50=1.86% 00:16:54.442 cpu : usr=0.78%, sys=1.55%, ctx=1020, majf=0, minf=1 00:16:54.442 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:54.442 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:54.442 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:54.442 issued rwts: total=508,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:54.442 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:54.442 job1: (groupid=0, jobs=1): err= 0: pid=211812: Thu Nov 28 19:05:15 2024 00:16:54.442 read: IOPS=503, BW=2014KiB/s (2062kB/s)(2068KiB/1027msec) 00:16:54.442 slat (nsec): min=4840, max=37064, avg=14430.09, stdev=7362.37 00:16:54.442 clat (usec): min=189, max=42053, avg=1484.82, stdev=6909.19 00:16:54.442 lat (usec): min=197, max=42072, avg=1499.25, stdev=6910.56 00:16:54.442 clat percentiles (usec): 00:16:54.442 | 1.00th=[ 196], 5.00th=[ 229], 10.00th=[ 251], 20.00th=[ 265], 00:16:54.442 | 30.00th=[ 269], 40.00th=[ 273], 50.00th=[ 277], 60.00th=[ 285], 00:16:54.442 | 70.00th=[ 297], 80.00th=[ 318], 90.00th=[ 375], 95.00th=[ 478], 00:16:54.442 | 99.00th=[41681], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:54.442 | 99.99th=[42206] 00:16:54.442 write: IOPS=997, BW=3988KiB/s (4084kB/s)(4096KiB/1027msec); 0 zone resets 00:16:54.442 slat (nsec): min=5932, max=40222, avg=12434.60, stdev=5004.89 00:16:54.442 clat (usec): min=122, max=2283, avg=227.12, stdev=105.15 00:16:54.442 lat (usec): min=130, max=2293, avg=239.55, stdev=105.33 00:16:54.442 clat percentiles (usec): 00:16:54.442 | 1.00th=[ 127], 5.00th=[ 133], 10.00th=[ 137], 20.00th=[ 149], 00:16:54.442 | 30.00th=[ 182], 40.00th=[ 188], 50.00th=[ 198], 60.00th=[ 212], 00:16:54.442 | 70.00th=[ 239], 80.00th=[ 293], 90.00th=[ 379], 95.00th=[ 388], 00:16:54.442 | 99.00th=[ 445], 99.50th=[ 453], 99.90th=[ 515], 99.95th=[ 2278], 00:16:54.442 | 99.99th=[ 2278] 00:16:54.442 bw ( KiB/s): min= 4096, max= 4096, per=33.90%, avg=4096.00, stdev= 0.00, samples=2 00:16:54.442 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=2 00:16:54.442 lat (usec) : 250=50.68%, 500=47.70%, 750=0.58% 00:16:54.442 lat (msec) : 4=0.06%, 50=0.97% 00:16:54.442 cpu : usr=1.46%, sys=1.66%, ctx=1543, majf=0, minf=1 00:16:54.442 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:54.442 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:54.442 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:54.442 issued rwts: total=517,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:54.442 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:54.442 job2: (groupid=0, jobs=1): err= 0: pid=211813: Thu Nov 28 19:05:15 2024 00:16:54.442 read: IOPS=426, BW=1705KiB/s (1746kB/s)(1744KiB/1023msec) 00:16:54.442 slat (nsec): min=5311, max=44195, avg=7698.98, stdev=5550.52 00:16:54.442 clat (usec): min=177, max=42096, avg=1986.98, stdev=8361.17 00:16:54.442 lat (usec): min=183, max=42114, avg=1994.68, stdev=8364.56 00:16:54.442 clat percentiles (usec): 00:16:54.442 | 1.00th=[ 186], 5.00th=[ 188], 10.00th=[ 192], 20.00th=[ 194], 00:16:54.443 | 30.00th=[ 196], 40.00th=[ 200], 50.00th=[ 202], 60.00th=[ 206], 00:16:54.443 | 70.00th=[ 210], 80.00th=[ 217], 90.00th=[ 229], 95.00th=[ 388], 00:16:54.443 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:16:54.443 | 99.99th=[42206] 00:16:54.443 write: IOPS=500, BW=2002KiB/s (2050kB/s)(2048KiB/1023msec); 0 zone resets 00:16:54.443 slat (nsec): min=7169, max=31470, avg=11144.17, stdev=4785.52 00:16:54.443 clat (usec): min=145, max=532, avg=281.39, stdev=74.51 00:16:54.443 lat (usec): min=155, max=547, avg=292.53, stdev=74.99 00:16:54.443 clat percentiles (usec): 00:16:54.443 | 1.00th=[ 178], 5.00th=[ 190], 10.00th=[ 198], 20.00th=[ 208], 00:16:54.443 | 30.00th=[ 219], 40.00th=[ 249], 50.00th=[ 269], 60.00th=[ 297], 00:16:54.443 | 70.00th=[ 322], 80.00th=[ 355], 90.00th=[ 396], 95.00th=[ 404], 00:16:54.443 | 99.00th=[ 445], 99.50th=[ 465], 99.90th=[ 537], 99.95th=[ 537], 00:16:54.443 | 99.99th=[ 537] 00:16:54.443 bw ( KiB/s): min= 4096, max= 4096, per=33.90%, avg=4096.00, stdev= 0.00, samples=1 00:16:54.443 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:54.443 lat (usec) : 250=64.56%, 500=33.33%, 750=0.11% 00:16:54.443 lat (msec) : 50=2.00% 00:16:54.443 cpu : usr=0.68%, sys=1.08%, ctx=949, majf=0, minf=1 00:16:54.443 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:54.443 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:54.443 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:54.443 issued rwts: total=436,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:54.443 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:54.443 job3: (groupid=0, jobs=1): err= 0: pid=211814: Thu Nov 28 19:05:15 2024 00:16:54.443 read: IOPS=1022, BW=4092KiB/s (4190kB/s)(4096KiB/1001msec) 00:16:54.443 slat (nsec): min=4437, max=61520, avg=14565.11, stdev=7969.27 00:16:54.443 clat (usec): min=175, max=41995, avg=678.56, stdev=4025.49 00:16:54.443 lat (usec): min=181, max=42028, avg=693.12, stdev=4026.52 00:16:54.443 clat percentiles (usec): 00:16:54.443 | 1.00th=[ 184], 5.00th=[ 196], 10.00th=[ 204], 20.00th=[ 225], 00:16:54.443 | 30.00th=[ 253], 40.00th=[ 269], 50.00th=[ 281], 60.00th=[ 293], 00:16:54.443 | 70.00th=[ 310], 80.00th=[ 322], 90.00th=[ 355], 95.00th=[ 371], 00:16:54.443 | 99.00th=[ 545], 99.50th=[41157], 99.90th=[41681], 99.95th=[42206], 00:16:54.443 | 99.99th=[42206] 00:16:54.443 write: IOPS=1064, BW=4260KiB/s (4362kB/s)(4264KiB/1001msec); 0 zone resets 00:16:54.443 slat (nsec): min=5613, max=50406, avg=12969.57, stdev=5888.67 00:16:54.443 clat (usec): min=128, max=490, avg=251.53, stdev=70.32 00:16:54.443 lat (usec): min=137, max=498, avg=264.50, stdev=69.34 00:16:54.443 clat percentiles (usec): 00:16:54.443 | 1.00th=[ 143], 5.00th=[ 165], 10.00th=[ 178], 20.00th=[ 186], 00:16:54.443 | 30.00th=[ 192], 40.00th=[ 206], 50.00th=[ 249], 60.00th=[ 269], 00:16:54.443 | 70.00th=[ 289], 80.00th=[ 314], 90.00th=[ 359], 95.00th=[ 379], 00:16:54.443 | 99.00th=[ 424], 99.50th=[ 441], 99.90th=[ 461], 99.95th=[ 490], 00:16:54.443 | 99.99th=[ 490] 00:16:54.443 bw ( KiB/s): min= 4096, max= 4096, per=33.90%, avg=4096.00, stdev= 0.00, samples=1 00:16:54.443 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:16:54.443 lat (usec) : 250=39.81%, 500=59.62%, 750=0.10% 00:16:54.443 lat (msec) : 50=0.48% 00:16:54.443 cpu : usr=1.80%, sys=2.80%, ctx=2091, majf=0, minf=1 00:16:54.443 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:16:54.443 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:54.443 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:54.443 issued rwts: total=1024,1066,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:54.443 latency : target=0, window=0, percentile=100.00%, depth=1 00:16:54.443 00:16:54.443 Run status group 0 (all jobs): 00:16:54.443 READ: bw=9641KiB/s (9873kB/s), 1705KiB/s-4092KiB/s (1746kB/s-4190kB/s), io=9940KiB (10.2MB), run=1001-1031msec 00:16:54.443 WRITE: bw=11.8MiB/s (12.4MB/s), 1986KiB/s-4260KiB/s (2034kB/s-4362kB/s), io=12.2MiB (12.8MB), run=1001-1031msec 00:16:54.443 00:16:54.443 Disk stats (read/write): 00:16:54.443 nvme0n1: ios=156/512, merge=0/0, ticks=746/81, in_queue=827, util=86.67% 00:16:54.443 nvme0n2: ios=562/1024, merge=0/0, ticks=805/221, in_queue=1026, util=98.07% 00:16:54.443 nvme0n3: ios=431/512, merge=0/0, ticks=650/137, in_queue=787, util=88.92% 00:16:54.443 nvme0n4: ios=559/1024, merge=0/0, ticks=560/247, in_queue=807, util=89.58% 00:16:54.443 19:05:15 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:16:54.443 [global] 00:16:54.443 thread=1 00:16:54.443 invalidate=1 00:16:54.443 rw=write 00:16:54.443 time_based=1 00:16:54.443 runtime=1 00:16:54.443 ioengine=libaio 00:16:54.443 direct=1 00:16:54.443 bs=4096 00:16:54.443 iodepth=128 00:16:54.443 norandommap=0 00:16:54.443 numjobs=1 00:16:54.443 00:16:54.443 verify_dump=1 00:16:54.443 verify_backlog=512 00:16:54.443 verify_state_save=0 00:16:54.443 do_verify=1 00:16:54.443 verify=crc32c-intel 00:16:54.443 [job0] 00:16:54.443 filename=/dev/nvme0n1 00:16:54.443 [job1] 00:16:54.443 filename=/dev/nvme0n2 00:16:54.443 [job2] 00:16:54.443 filename=/dev/nvme0n3 00:16:54.443 [job3] 00:16:54.443 filename=/dev/nvme0n4 00:16:54.443 Could not set queue depth (nvme0n1) 00:16:54.443 Could not set queue depth (nvme0n2) 00:16:54.443 Could not set queue depth (nvme0n3) 00:16:54.443 Could not set queue depth (nvme0n4) 00:16:54.701 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:54.701 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:54.701 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:54.701 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:54.701 fio-3.35 00:16:54.701 Starting 4 threads 00:16:56.084 00:16:56.084 job0: (groupid=0, jobs=1): err= 0: pid=212050: Thu Nov 28 19:05:16 2024 00:16:56.084 read: IOPS=5161, BW=20.2MiB/s (21.1MB/s)(20.3MiB/1007msec) 00:16:56.084 slat (usec): min=3, max=14118, avg=99.03, stdev=755.95 00:16:56.084 clat (usec): min=3843, max=36355, avg=12660.88, stdev=5351.66 00:16:56.084 lat (usec): min=3850, max=36361, avg=12759.90, stdev=5399.80 00:16:56.084 clat percentiles (usec): 00:16:56.084 | 1.00th=[ 5669], 5.00th=[ 7570], 10.00th=[ 8848], 20.00th=[ 9241], 00:16:56.084 | 30.00th=[ 9634], 40.00th=[ 9896], 50.00th=[10159], 60.00th=[11207], 00:16:56.084 | 70.00th=[13960], 80.00th=[17171], 90.00th=[18482], 95.00th=[25822], 00:16:56.084 | 99.00th=[34341], 99.50th=[34341], 99.90th=[34341], 99.95th=[36439], 00:16:56.084 | 99.99th=[36439] 00:16:56.084 write: IOPS=5592, BW=21.8MiB/s (22.9MB/s)(22.0MiB/1007msec); 0 zone resets 00:16:56.084 slat (usec): min=4, max=15657, avg=78.55, stdev=622.84 00:16:56.084 clat (usec): min=648, max=33633, avg=10988.42, stdev=3538.87 00:16:56.084 lat (usec): min=727, max=33648, avg=11066.97, stdev=3603.82 00:16:56.084 clat percentiles (usec): 00:16:56.084 | 1.00th=[ 3326], 5.00th=[ 5866], 10.00th=[ 6456], 20.00th=[ 8291], 00:16:56.084 | 30.00th=[ 9241], 40.00th=[10290], 50.00th=[10814], 60.00th=[11469], 00:16:56.084 | 70.00th=[11994], 80.00th=[12649], 90.00th=[16450], 95.00th=[18482], 00:16:56.084 | 99.00th=[19530], 99.50th=[19530], 99.90th=[29492], 99.95th=[32637], 00:16:56.084 | 99.99th=[33817] 00:16:56.084 bw ( KiB/s): min=20480, max=24184, per=33.88%, avg=22332.00, stdev=2619.12, samples=2 00:16:56.084 iops : min= 5120, max= 6046, avg=5583.00, stdev=654.78, samples=2 00:16:56.084 lat (usec) : 750=0.01%, 1000=0.02% 00:16:56.084 lat (msec) : 4=0.98%, 10=39.96%, 20=55.88%, 50=3.15% 00:16:56.084 cpu : usr=4.37%, sys=6.46%, ctx=453, majf=0, minf=1 00:16:56.084 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:16:56.084 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:56.084 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:56.084 issued rwts: total=5198,5632,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:56.084 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:56.084 job1: (groupid=0, jobs=1): err= 0: pid=212051: Thu Nov 28 19:05:16 2024 00:16:56.084 read: IOPS=3068, BW=12.0MiB/s (12.6MB/s)(12.0MiB/1001msec) 00:16:56.084 slat (usec): min=2, max=27055, avg=118.75, stdev=966.58 00:16:56.084 clat (usec): min=4260, max=69113, avg=14489.14, stdev=9093.80 00:16:56.084 lat (usec): min=4275, max=69148, avg=14607.89, stdev=9180.33 00:16:56.084 clat percentiles (usec): 00:16:56.084 | 1.00th=[ 4948], 5.00th=[ 8291], 10.00th=[10028], 20.00th=[10421], 00:16:56.084 | 30.00th=[10814], 40.00th=[10945], 50.00th=[11207], 60.00th=[11600], 00:16:56.084 | 70.00th=[11863], 80.00th=[14746], 90.00th=[26608], 95.00th=[42206], 00:16:56.084 | 99.00th=[45876], 99.50th=[46400], 99.90th=[46400], 99.95th=[61604], 00:16:56.084 | 99.99th=[68682] 00:16:56.084 write: IOPS=3073, BW=12.0MiB/s (12.6MB/s)(12.0MiB/1001msec); 0 zone resets 00:16:56.084 slat (usec): min=3, max=19505, avg=196.33, stdev=1204.13 00:16:56.084 clat (usec): min=416, max=203491, avg=26821.30, stdev=37417.83 00:16:56.084 lat (usec): min=760, max=203496, avg=27017.63, stdev=37662.81 00:16:56.084 clat percentiles (msec): 00:16:56.084 | 1.00th=[ 6], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 12], 00:16:56.084 | 30.00th=[ 12], 40.00th=[ 12], 50.00th=[ 12], 60.00th=[ 13], 00:16:56.084 | 70.00th=[ 22], 80.00th=[ 25], 90.00th=[ 56], 95.00th=[ 130], 00:16:56.084 | 99.00th=[ 186], 99.50th=[ 197], 99.90th=[ 205], 99.95th=[ 205], 00:16:56.084 | 99.99th=[ 205] 00:16:56.084 bw ( KiB/s): min= 7664, max= 7664, per=11.63%, avg=7664.00, stdev= 0.00, samples=1 00:16:56.084 iops : min= 1916, max= 1916, avg=1916.00, stdev= 0.00, samples=1 00:16:56.084 lat (usec) : 500=0.02%, 1000=0.08% 00:16:56.084 lat (msec) : 4=0.10%, 10=8.31%, 20=67.93%, 50=17.87%, 100=2.59% 00:16:56.084 lat (msec) : 250=3.11% 00:16:56.084 cpu : usr=4.10%, sys=6.20%, ctx=335, majf=0, minf=1 00:16:56.084 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:16:56.084 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:56.084 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:56.084 issued rwts: total=3072,3077,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:56.084 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:56.084 job2: (groupid=0, jobs=1): err= 0: pid=212052: Thu Nov 28 19:05:16 2024 00:16:56.084 read: IOPS=3739, BW=14.6MiB/s (15.3MB/s)(14.6MiB/1002msec) 00:16:56.084 slat (usec): min=3, max=23551, avg=116.08, stdev=710.73 00:16:56.084 clat (usec): min=773, max=90986, avg=15848.43, stdev=11381.70 00:16:56.085 lat (msec): min=4, max=100, avg=15.96, stdev=11.43 00:16:56.085 clat percentiles (usec): 00:16:56.085 | 1.00th=[ 8586], 5.00th=[10290], 10.00th=[10552], 20.00th=[10814], 00:16:56.085 | 30.00th=[11076], 40.00th=[11600], 50.00th=[11994], 60.00th=[12649], 00:16:56.085 | 70.00th=[13435], 80.00th=[14484], 90.00th=[28181], 95.00th=[34866], 00:16:56.085 | 99.00th=[76022], 99.50th=[79168], 99.90th=[86508], 99.95th=[90702], 00:16:56.085 | 99.99th=[90702] 00:16:56.085 write: IOPS=4087, BW=16.0MiB/s (16.7MB/s)(16.0MiB/1002msec); 0 zone resets 00:16:56.085 slat (usec): min=4, max=19646, avg=128.57, stdev=688.05 00:16:56.085 clat (usec): min=8091, max=90528, avg=15758.11, stdev=12771.22 00:16:56.085 lat (usec): min=8100, max=90562, avg=15886.69, stdev=12876.99 00:16:56.085 clat percentiles (usec): 00:16:56.085 | 1.00th=[ 8717], 5.00th=[ 9241], 10.00th=[10683], 20.00th=[11076], 00:16:56.085 | 30.00th=[11469], 40.00th=[11731], 50.00th=[11994], 60.00th=[12387], 00:16:56.085 | 70.00th=[13435], 80.00th=[14353], 90.00th=[25297], 95.00th=[32375], 00:16:56.085 | 99.00th=[80217], 99.50th=[83362], 99.90th=[85459], 99.95th=[85459], 00:16:56.085 | 99.99th=[90702] 00:16:56.085 bw ( KiB/s): min=16384, max=16384, per=24.86%, avg=16384.00, stdev= 0.00, samples=2 00:16:56.085 iops : min= 4096, max= 4096, avg=4096.00, stdev= 0.00, samples=2 00:16:56.085 lat (usec) : 1000=0.01% 00:16:56.085 lat (msec) : 10=6.81%, 20=79.42%, 50=10.44%, 100=3.32% 00:16:56.085 cpu : usr=4.60%, sys=8.19%, ctx=500, majf=0, minf=1 00:16:56.085 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:16:56.085 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:56.085 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:56.085 issued rwts: total=3747,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:56.085 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:56.085 job3: (groupid=0, jobs=1): err= 0: pid=212053: Thu Nov 28 19:05:16 2024 00:16:56.085 read: IOPS=3576, BW=14.0MiB/s (14.7MB/s)(14.0MiB/1002msec) 00:16:56.085 slat (usec): min=2, max=13011, avg=120.44, stdev=815.37 00:16:56.085 clat (usec): min=5572, max=31043, avg=15540.20, stdev=4192.29 00:16:56.085 lat (usec): min=5582, max=31050, avg=15660.64, stdev=4247.72 00:16:56.085 clat percentiles (usec): 00:16:56.085 | 1.00th=[ 7832], 5.00th=[10028], 10.00th=[11076], 20.00th=[12256], 00:16:56.085 | 30.00th=[13173], 40.00th=[13566], 50.00th=[14484], 60.00th=[16450], 00:16:56.085 | 70.00th=[17957], 80.00th=[18482], 90.00th=[20841], 95.00th=[22938], 00:16:56.085 | 99.00th=[29230], 99.50th=[31065], 99.90th=[31065], 99.95th=[31065], 00:16:56.085 | 99.99th=[31065] 00:16:56.085 write: IOPS=3781, BW=14.8MiB/s (15.5MB/s)(14.8MiB/1002msec); 0 zone resets 00:16:56.085 slat (usec): min=3, max=21751, avg=139.15, stdev=955.82 00:16:56.085 clat (usec): min=696, max=61493, avg=18671.28, stdev=10768.06 00:16:56.085 lat (usec): min=1317, max=61503, avg=18810.44, stdev=10844.95 00:16:56.085 clat percentiles (usec): 00:16:56.085 | 1.00th=[ 3916], 5.00th=[ 5800], 10.00th=[10028], 20.00th=[12387], 00:16:56.085 | 30.00th=[13829], 40.00th=[14615], 50.00th=[16319], 60.00th=[17957], 00:16:56.085 | 70.00th=[19530], 80.00th=[22676], 90.00th=[27919], 95.00th=[46924], 00:16:56.085 | 99.00th=[57934], 99.50th=[58983], 99.90th=[61604], 99.95th=[61604], 00:16:56.085 | 99.99th=[61604] 00:16:56.085 bw ( KiB/s): min=14128, max=15168, per=22.22%, avg=14648.00, stdev=735.39, samples=2 00:16:56.085 iops : min= 3532, max= 3792, avg=3662.00, stdev=183.85, samples=2 00:16:56.085 lat (usec) : 750=0.01% 00:16:56.085 lat (msec) : 2=0.27%, 4=0.30%, 10=6.82%, 20=70.93%, 50=19.50% 00:16:56.085 lat (msec) : 100=2.16% 00:16:56.085 cpu : usr=3.50%, sys=6.49%, ctx=352, majf=0, minf=1 00:16:56.085 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:16:56.085 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:56.085 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:56.085 issued rwts: total=3584,3789,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:56.085 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:56.085 00:16:56.085 Run status group 0 (all jobs): 00:16:56.085 READ: bw=60.5MiB/s (63.5MB/s), 12.0MiB/s-20.2MiB/s (12.6MB/s-21.1MB/s), io=60.9MiB (63.9MB), run=1001-1007msec 00:16:56.085 WRITE: bw=64.4MiB/s (67.5MB/s), 12.0MiB/s-21.8MiB/s (12.6MB/s-22.9MB/s), io=64.8MiB (68.0MB), run=1001-1007msec 00:16:56.085 00:16:56.085 Disk stats (read/write): 00:16:56.085 nvme0n1: ios=4395/4608, merge=0/0, ticks=55287/49760, in_queue=105047, util=86.87% 00:16:56.085 nvme0n2: ios=2605/2635, merge=0/0, ticks=22204/66146, in_queue=88350, util=99.39% 00:16:56.085 nvme0n3: ios=3094/3408, merge=0/0, ticks=12565/13662, in_queue=26227, util=98.02% 00:16:56.085 nvme0n4: ios=2998/3072, merge=0/0, ticks=32219/50537, in_queue=82756, util=99.06% 00:16:56.085 19:05:16 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:16:56.085 [global] 00:16:56.085 thread=1 00:16:56.085 invalidate=1 00:16:56.085 rw=randwrite 00:16:56.085 time_based=1 00:16:56.085 runtime=1 00:16:56.085 ioengine=libaio 00:16:56.085 direct=1 00:16:56.085 bs=4096 00:16:56.085 iodepth=128 00:16:56.085 norandommap=0 00:16:56.085 numjobs=1 00:16:56.085 00:16:56.085 verify_dump=1 00:16:56.085 verify_backlog=512 00:16:56.085 verify_state_save=0 00:16:56.085 do_verify=1 00:16:56.085 verify=crc32c-intel 00:16:56.085 [job0] 00:16:56.085 filename=/dev/nvme0n1 00:16:56.085 [job1] 00:16:56.085 filename=/dev/nvme0n2 00:16:56.085 [job2] 00:16:56.085 filename=/dev/nvme0n3 00:16:56.085 [job3] 00:16:56.085 filename=/dev/nvme0n4 00:16:56.085 Could not set queue depth (nvme0n1) 00:16:56.085 Could not set queue depth (nvme0n2) 00:16:56.085 Could not set queue depth (nvme0n3) 00:16:56.085 Could not set queue depth (nvme0n4) 00:16:56.085 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:56.085 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:56.085 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:56.085 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:16:56.085 fio-3.35 00:16:56.085 Starting 4 threads 00:16:57.466 00:16:57.466 job0: (groupid=0, jobs=1): err= 0: pid=212281: Thu Nov 28 19:05:18 2024 00:16:57.466 read: IOPS=3032, BW=11.8MiB/s (12.4MB/s)(12.0MiB/1013msec) 00:16:57.466 slat (usec): min=3, max=29272, avg=136.12, stdev=1137.97 00:16:57.466 clat (usec): min=6138, max=60762, avg=17008.61, stdev=8490.93 00:16:57.466 lat (usec): min=6155, max=60804, avg=17144.73, stdev=8599.64 00:16:57.466 clat percentiles (usec): 00:16:57.466 | 1.00th=[ 7570], 5.00th=[ 8979], 10.00th=[ 9765], 20.00th=[10683], 00:16:57.466 | 30.00th=[11469], 40.00th=[12256], 50.00th=[12649], 60.00th=[15533], 00:16:57.466 | 70.00th=[20579], 80.00th=[23462], 90.00th=[30802], 95.00th=[34866], 00:16:57.466 | 99.00th=[42730], 99.50th=[43254], 99.90th=[43779], 99.95th=[45351], 00:16:57.466 | 99.99th=[60556] 00:16:57.466 write: IOPS=3290, BW=12.9MiB/s (13.5MB/s)(13.0MiB/1013msec); 0 zone resets 00:16:57.466 slat (usec): min=4, max=35631, avg=160.91, stdev=1042.79 00:16:57.467 clat (usec): min=1104, max=61032, avg=22826.76, stdev=13574.94 00:16:57.467 lat (usec): min=1113, max=61054, avg=22987.68, stdev=13656.12 00:16:57.467 clat percentiles (usec): 00:16:57.467 | 1.00th=[ 3294], 5.00th=[ 5800], 10.00th=[ 8848], 20.00th=[10159], 00:16:57.467 | 30.00th=[14091], 40.00th=[16319], 50.00th=[20579], 60.00th=[22938], 00:16:57.467 | 70.00th=[26084], 80.00th=[35914], 90.00th=[44827], 95.00th=[51119], 00:16:57.467 | 99.00th=[56886], 99.50th=[57410], 99.90th=[61080], 99.95th=[61080], 00:16:57.467 | 99.99th=[61080] 00:16:57.467 bw ( KiB/s): min=12272, max=13368, per=21.11%, avg=12820.00, stdev=774.99, samples=2 00:16:57.467 iops : min= 3068, max= 3342, avg=3205.00, stdev=193.75, samples=2 00:16:57.467 lat (msec) : 2=0.30%, 4=0.47%, 10=12.15%, 20=44.25%, 50=39.69% 00:16:57.467 lat (msec) : 100=3.15% 00:16:57.467 cpu : usr=4.25%, sys=8.50%, ctx=302, majf=0, minf=1 00:16:57.467 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:16:57.467 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:57.467 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:57.467 issued rwts: total=3072,3333,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:57.467 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:57.467 job1: (groupid=0, jobs=1): err= 0: pid=212282: Thu Nov 28 19:05:18 2024 00:16:57.467 read: IOPS=1523, BW=6095KiB/s (6242kB/s)(6144KiB/1008msec) 00:16:57.467 slat (usec): min=2, max=29889, avg=234.40, stdev=1548.98 00:16:57.467 clat (msec): min=13, max=100, avg=27.54, stdev=17.08 00:16:57.467 lat (msec): min=13, max=100, avg=27.78, stdev=17.21 00:16:57.467 clat percentiles (msec): 00:16:57.467 | 1.00th=[ 15], 5.00th=[ 16], 10.00th=[ 16], 20.00th=[ 17], 00:16:57.467 | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 21], 60.00th=[ 25], 00:16:57.467 | 70.00th=[ 28], 80.00th=[ 33], 90.00th=[ 52], 95.00th=[ 80], 00:16:57.467 | 99.00th=[ 82], 99.50th=[ 82], 99.90th=[ 85], 99.95th=[ 101], 00:16:57.467 | 99.99th=[ 101] 00:16:57.467 write: IOPS=1684, BW=6738KiB/s (6900kB/s)(6792KiB/1008msec); 0 zone resets 00:16:57.467 slat (usec): min=2, max=32881, avg=369.70, stdev=2191.12 00:16:57.467 clat (msec): min=5, max=112, avg=48.89, stdev=22.43 00:16:57.467 lat (msec): min=11, max=112, avg=49.26, stdev=22.62 00:16:57.467 clat percentiles (msec): 00:16:57.467 | 1.00th=[ 13], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 21], 00:16:57.467 | 30.00th=[ 34], 40.00th=[ 44], 50.00th=[ 51], 60.00th=[ 55], 00:16:57.467 | 70.00th=[ 63], 80.00th=[ 70], 90.00th=[ 84], 95.00th=[ 85], 00:16:57.467 | 99.00th=[ 93], 99.50th=[ 96], 99.90th=[ 102], 99.95th=[ 113], 00:16:57.467 | 99.99th=[ 113] 00:16:57.467 bw ( KiB/s): min= 5712, max= 6848, per=10.34%, avg=6280.00, stdev=803.27, samples=2 00:16:57.467 iops : min= 1428, max= 1712, avg=1570.00, stdev=200.82, samples=2 00:16:57.467 lat (msec) : 10=0.03%, 20=28.70%, 50=39.49%, 100=31.66%, 250=0.12% 00:16:57.467 cpu : usr=1.49%, sys=2.88%, ctx=206, majf=0, minf=1 00:16:57.467 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.5%, 32=1.0%, >=64=98.1% 00:16:57.467 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:57.467 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:57.467 issued rwts: total=1536,1698,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:57.467 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:57.467 job2: (groupid=0, jobs=1): err= 0: pid=212285: Thu Nov 28 19:05:18 2024 00:16:57.467 read: IOPS=4589, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1004msec) 00:16:57.467 slat (usec): min=2, max=14421, avg=103.20, stdev=746.91 00:16:57.467 clat (usec): min=5511, max=42196, avg=14077.98, stdev=5103.55 00:16:57.467 lat (usec): min=5529, max=42210, avg=14181.17, stdev=5159.02 00:16:57.467 clat percentiles (usec): 00:16:57.467 | 1.00th=[ 6587], 5.00th=[10159], 10.00th=[10552], 20.00th=[11207], 00:16:57.467 | 30.00th=[11731], 40.00th=[12125], 50.00th=[12387], 60.00th=[12649], 00:16:57.467 | 70.00th=[13042], 80.00th=[14222], 90.00th=[22676], 95.00th=[25297], 00:16:57.467 | 99.00th=[28967], 99.50th=[36439], 99.90th=[41157], 99.95th=[41157], 00:16:57.467 | 99.99th=[42206] 00:16:57.467 write: IOPS=4891, BW=19.1MiB/s (20.0MB/s)(19.2MiB/1004msec); 0 zone resets 00:16:57.467 slat (usec): min=2, max=18211, avg=91.30, stdev=721.38 00:16:57.467 clat (usec): min=335, max=34605, avg=12735.64, stdev=3678.77 00:16:57.467 lat (usec): min=1895, max=34620, avg=12826.94, stdev=3723.24 00:16:57.467 clat percentiles (usec): 00:16:57.467 | 1.00th=[ 3687], 5.00th=[ 7177], 10.00th=[ 8979], 20.00th=[10421], 00:16:57.467 | 30.00th=[11207], 40.00th=[12256], 50.00th=[12780], 60.00th=[13304], 00:16:57.467 | 70.00th=[13698], 80.00th=[14353], 90.00th=[16450], 95.00th=[20055], 00:16:57.467 | 99.00th=[24511], 99.50th=[25822], 99.90th=[31065], 99.95th=[31065], 00:16:57.467 | 99.99th=[34866] 00:16:57.467 bw ( KiB/s): min=16384, max=21880, per=31.50%, avg=19132.00, stdev=3886.26, samples=2 00:16:57.467 iops : min= 4096, max= 5470, avg=4783.00, stdev=971.56, samples=2 00:16:57.467 lat (usec) : 500=0.01% 00:16:57.467 lat (msec) : 2=0.13%, 4=0.84%, 10=9.85%, 20=80.18%, 50=8.99% 00:16:57.467 cpu : usr=6.28%, sys=10.27%, ctx=264, majf=0, minf=1 00:16:57.467 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:16:57.467 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:57.467 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:57.467 issued rwts: total=4608,4911,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:57.467 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:57.467 job3: (groupid=0, jobs=1): err= 0: pid=212286: Thu Nov 28 19:05:18 2024 00:16:57.467 read: IOPS=5079, BW=19.8MiB/s (20.8MB/s)(20.0MiB/1008msec) 00:16:57.467 slat (usec): min=2, max=10464, avg=86.10, stdev=559.99 00:16:57.467 clat (usec): min=3776, max=22849, avg=11613.08, stdev=2609.20 00:16:57.467 lat (usec): min=3787, max=23327, avg=11699.18, stdev=2650.31 00:16:57.467 clat percentiles (usec): 00:16:57.467 | 1.00th=[ 6718], 5.00th=[ 8717], 10.00th=[ 8979], 20.00th=[10028], 00:16:57.467 | 30.00th=[10421], 40.00th=[10683], 50.00th=[10945], 60.00th=[11338], 00:16:57.467 | 70.00th=[11863], 80.00th=[13042], 90.00th=[15795], 95.00th=[17433], 00:16:57.467 | 99.00th=[20055], 99.50th=[21365], 99.90th=[22676], 99.95th=[22938], 00:16:57.467 | 99.99th=[22938] 00:16:57.467 write: IOPS=5395, BW=21.1MiB/s (22.1MB/s)(21.2MiB/1008msec); 0 zone resets 00:16:57.467 slat (usec): min=3, max=9538, avg=82.44, stdev=487.55 00:16:57.467 clat (usec): min=540, max=35662, avg=12481.16, stdev=4779.09 00:16:57.467 lat (usec): min=560, max=35708, avg=12563.60, stdev=4811.40 00:16:57.467 clat percentiles (usec): 00:16:57.467 | 1.00th=[ 3687], 5.00th=[ 6325], 10.00th=[ 7504], 20.00th=[10159], 00:16:57.467 | 30.00th=[10945], 40.00th=[11338], 50.00th=[11731], 60.00th=[11994], 00:16:57.467 | 70.00th=[12911], 80.00th=[13960], 90.00th=[17171], 95.00th=[22414], 00:16:57.467 | 99.00th=[34341], 99.50th=[35390], 99.90th=[35390], 99.95th=[35390], 00:16:57.467 | 99.99th=[35914] 00:16:57.467 bw ( KiB/s): min=20880, max=21616, per=34.99%, avg=21248.00, stdev=520.43, samples=2 00:16:57.467 iops : min= 5220, max= 5404, avg=5312.00, stdev=130.11, samples=2 00:16:57.467 lat (usec) : 750=0.01%, 1000=0.06% 00:16:57.467 lat (msec) : 4=0.53%, 10=18.00%, 20=77.91%, 50=3.49% 00:16:57.467 cpu : usr=4.37%, sys=7.75%, ctx=503, majf=0, minf=1 00:16:57.467 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:16:57.467 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:16:57.467 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:16:57.467 issued rwts: total=5120,5439,0,0 short=0,0,0,0 dropped=0,0,0,0 00:16:57.467 latency : target=0, window=0, percentile=100.00%, depth=128 00:16:57.467 00:16:57.467 Run status group 0 (all jobs): 00:16:57.467 READ: bw=55.3MiB/s (58.0MB/s), 6095KiB/s-19.8MiB/s (6242kB/s-20.8MB/s), io=56.0MiB (58.7MB), run=1004-1013msec 00:16:57.467 WRITE: bw=59.3MiB/s (62.2MB/s), 6738KiB/s-21.1MiB/s (6900kB/s-22.1MB/s), io=60.1MiB (63.0MB), run=1004-1013msec 00:16:57.467 00:16:57.467 Disk stats (read/write): 00:16:57.467 nvme0n1: ios=2607/2791, merge=0/0, ticks=43072/54255, in_queue=97327, util=86.17% 00:16:57.467 nvme0n2: ios=1074/1463, merge=0/0, ticks=9934/25038, in_queue=34972, util=90.96% 00:16:57.467 nvme0n3: ios=3825/4096, merge=0/0, ticks=35022/33586, in_queue=68608, util=94.99% 00:16:57.467 nvme0n4: ios=4308/4608, merge=0/0, ticks=31422/33256, in_queue=64678, util=94.11% 00:16:57.467 19:05:18 -- target/fio.sh@55 -- # sync 00:16:57.467 19:05:18 -- target/fio.sh@59 -- # fio_pid=212424 00:16:57.467 19:05:18 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:16:57.467 19:05:18 -- target/fio.sh@61 -- # sleep 3 00:16:57.467 [global] 00:16:57.467 thread=1 00:16:57.467 invalidate=1 00:16:57.467 rw=read 00:16:57.467 time_based=1 00:16:57.467 runtime=10 00:16:57.467 ioengine=libaio 00:16:57.467 direct=1 00:16:57.467 bs=4096 00:16:57.467 iodepth=1 00:16:57.467 norandommap=1 00:16:57.467 numjobs=1 00:16:57.467 00:16:57.467 [job0] 00:16:57.467 filename=/dev/nvme0n1 00:16:57.467 [job1] 00:16:57.467 filename=/dev/nvme0n2 00:16:57.467 [job2] 00:16:57.467 filename=/dev/nvme0n3 00:16:57.467 [job3] 00:16:57.467 filename=/dev/nvme0n4 00:16:57.467 Could not set queue depth (nvme0n1) 00:16:57.467 Could not set queue depth (nvme0n2) 00:16:57.467 Could not set queue depth (nvme0n3) 00:16:57.467 Could not set queue depth (nvme0n4) 00:16:57.467 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:57.467 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:57.467 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:57.467 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:16:57.467 fio-3.35 00:16:57.467 Starting 4 threads 00:17:00.759 19:05:21 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:17:00.759 19:05:21 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:17:00.759 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=17035264, buflen=4096 00:17:00.759 fio: pid=212614, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:17:01.018 19:05:21 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:01.018 19:05:21 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:17:01.018 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=9494528, buflen=4096 00:17:01.018 fio: pid=212603, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:17:01.276 19:05:22 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:01.276 19:05:22 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:17:01.276 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=35487744, buflen=4096 00:17:01.276 fio: pid=212551, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:17:01.535 fio: io_u error on file /dev/nvme0n2: Operation not supported: read offset=54304768, buflen=4096 00:17:01.535 fio: pid=212572, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:17:01.535 19:05:22 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:01.535 19:05:22 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:17:01.535 00:17:01.535 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=212551: Thu Nov 28 19:05:22 2024 00:17:01.535 read: IOPS=2478, BW=9913KiB/s (10.1MB/s)(33.8MiB/3496msec) 00:17:01.535 slat (usec): min=4, max=29709, avg=17.94, stdev=489.60 00:17:01.535 clat (usec): min=163, max=42027, avg=381.00, stdev=2607.49 00:17:01.535 lat (usec): min=168, max=42045, avg=398.94, stdev=2653.70 00:17:01.535 clat percentiles (usec): 00:17:01.535 | 1.00th=[ 176], 5.00th=[ 184], 10.00th=[ 188], 20.00th=[ 192], 00:17:01.535 | 30.00th=[ 198], 40.00th=[ 202], 50.00th=[ 206], 60.00th=[ 210], 00:17:01.535 | 70.00th=[ 217], 80.00th=[ 227], 90.00th=[ 260], 95.00th=[ 277], 00:17:01.535 | 99.00th=[ 367], 99.50th=[ 1090], 99.90th=[42206], 99.95th=[42206], 00:17:01.535 | 99.99th=[42206] 00:17:01.535 bw ( KiB/s): min= 1024, max=17088, per=35.22%, avg=10710.67, stdev=6684.91, samples=6 00:17:01.535 iops : min= 256, max= 4272, avg=2677.67, stdev=1671.23, samples=6 00:17:01.535 lat (usec) : 250=88.31%, 500=11.16%, 750=0.01% 00:17:01.535 lat (msec) : 2=0.08%, 4=0.02%, 50=0.40% 00:17:01.535 cpu : usr=0.83%, sys=2.40%, ctx=8672, majf=0, minf=1 00:17:01.535 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:01.535 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:01.535 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:01.535 issued rwts: total=8665,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:01.535 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:01.535 job1: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=212572: Thu Nov 28 19:05:22 2024 00:17:01.535 read: IOPS=3548, BW=13.9MiB/s (14.5MB/s)(51.8MiB/3736msec) 00:17:01.535 slat (usec): min=4, max=32115, avg=17.95, stdev=382.32 00:17:01.535 clat (usec): min=150, max=42047, avg=259.28, stdev=1009.12 00:17:01.535 lat (usec): min=159, max=42052, avg=277.23, stdev=1081.45 00:17:01.535 clat percentiles (usec): 00:17:01.535 | 1.00th=[ 167], 5.00th=[ 174], 10.00th=[ 178], 20.00th=[ 184], 00:17:01.535 | 30.00th=[ 190], 40.00th=[ 196], 50.00th=[ 206], 60.00th=[ 229], 00:17:01.535 | 70.00th=[ 251], 80.00th=[ 277], 90.00th=[ 326], 95.00th=[ 379], 00:17:01.535 | 99.00th=[ 478], 99.50th=[ 510], 99.90th=[ 1037], 99.95th=[40633], 00:17:01.535 | 99.99th=[42206] 00:17:01.535 bw ( KiB/s): min= 9632, max=19744, per=46.50%, avg=14139.00, stdev=3378.78, samples=7 00:17:01.535 iops : min= 2408, max= 4936, avg=3534.71, stdev=844.70, samples=7 00:17:01.535 lat (usec) : 250=69.35%, 500=30.03%, 750=0.49%, 1000=0.02% 00:17:01.535 lat (msec) : 2=0.04%, 10=0.01%, 50=0.06% 00:17:01.535 cpu : usr=1.66%, sys=4.66%, ctx=13266, majf=0, minf=1 00:17:01.535 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:01.535 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:01.535 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:01.535 issued rwts: total=13259,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:01.535 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:01.535 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=212603: Thu Nov 28 19:05:22 2024 00:17:01.535 read: IOPS=719, BW=2876KiB/s (2945kB/s)(9272KiB/3224msec) 00:17:01.535 slat (usec): min=5, max=14894, avg=19.45, stdev=309.08 00:17:01.535 clat (usec): min=183, max=42461, avg=1357.59, stdev=6578.77 00:17:01.535 lat (usec): min=189, max=56988, avg=1377.04, stdev=6626.73 00:17:01.535 clat percentiles (usec): 00:17:01.535 | 1.00th=[ 196], 5.00th=[ 204], 10.00th=[ 210], 20.00th=[ 221], 00:17:01.535 | 30.00th=[ 233], 40.00th=[ 251], 50.00th=[ 269], 60.00th=[ 306], 00:17:01.535 | 70.00th=[ 314], 80.00th=[ 326], 90.00th=[ 363], 95.00th=[ 388], 00:17:01.535 | 99.00th=[41681], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:17:01.535 | 99.99th=[42206] 00:17:01.535 bw ( KiB/s): min= 96, max= 6024, per=10.14%, avg=3084.00, stdev=2698.32, samples=6 00:17:01.535 iops : min= 24, max= 1506, avg=771.00, stdev=674.58, samples=6 00:17:01.535 lat (usec) : 250=39.84%, 500=57.48% 00:17:01.535 lat (msec) : 50=2.63% 00:17:01.535 cpu : usr=0.62%, sys=1.46%, ctx=2320, majf=0, minf=1 00:17:01.535 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:01.535 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:01.535 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:01.535 issued rwts: total=2319,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:01.535 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:01.535 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=212614: Thu Nov 28 19:05:22 2024 00:17:01.535 read: IOPS=1419, BW=5678KiB/s (5814kB/s)(16.2MiB/2930msec) 00:17:01.535 slat (nsec): min=4097, max=62301, avg=15698.36, stdev=9458.25 00:17:01.536 clat (usec): min=189, max=42060, avg=679.34, stdev=3922.58 00:17:01.536 lat (usec): min=199, max=42070, avg=695.03, stdev=3923.11 00:17:01.536 clat percentiles (usec): 00:17:01.536 | 1.00th=[ 204], 5.00th=[ 215], 10.00th=[ 219], 20.00th=[ 229], 00:17:01.536 | 30.00th=[ 241], 40.00th=[ 255], 50.00th=[ 281], 60.00th=[ 310], 00:17:01.536 | 70.00th=[ 338], 80.00th=[ 379], 90.00th=[ 445], 95.00th=[ 482], 00:17:01.536 | 99.00th=[ 611], 99.50th=[41681], 99.90th=[42206], 99.95th=[42206], 00:17:01.536 | 99.99th=[42206] 00:17:01.536 bw ( KiB/s): min= 96, max=13048, per=21.83%, avg=6638.40, stdev=6333.36, samples=5 00:17:01.536 iops : min= 24, max= 3262, avg=1659.60, stdev=1583.34, samples=5 00:17:01.536 lat (usec) : 250=37.84%, 500=58.87%, 750=2.33%, 1000=0.02% 00:17:01.536 lat (msec) : 50=0.91% 00:17:01.536 cpu : usr=0.85%, sys=2.73%, ctx=4160, majf=0, minf=2 00:17:01.536 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:01.536 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:01.536 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:01.536 issued rwts: total=4160,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:01.536 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:01.536 00:17:01.536 Run status group 0 (all jobs): 00:17:01.536 READ: bw=29.7MiB/s (31.1MB/s), 2876KiB/s-13.9MiB/s (2945kB/s-14.5MB/s), io=111MiB (116MB), run=2930-3736msec 00:17:01.536 00:17:01.536 Disk stats (read/write): 00:17:01.536 nvme0n1: ios=8694/0, merge=0/0, ticks=3564/0, in_queue=3564, util=96.82% 00:17:01.536 nvme0n2: ios=12704/0, merge=0/0, ticks=3241/0, in_queue=3241, util=94.00% 00:17:01.536 nvme0n3: ios=2315/0, merge=0/0, ticks=3004/0, in_queue=3004, util=96.32% 00:17:01.536 nvme0n4: ios=4157/0, merge=0/0, ticks=2690/0, in_queue=2690, util=96.74% 00:17:01.794 19:05:22 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:01.794 19:05:22 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:17:02.053 19:05:22 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:02.053 19:05:22 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:17:02.311 19:05:23 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:02.311 19:05:23 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:17:02.569 19:05:23 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:17:02.569 19:05:23 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:17:02.828 19:05:23 -- target/fio.sh@69 -- # fio_status=0 00:17:02.828 19:05:23 -- target/fio.sh@70 -- # wait 212424 00:17:02.828 19:05:23 -- target/fio.sh@70 -- # fio_status=4 00:17:02.828 19:05:23 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:17:02.828 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:17:02.828 19:05:23 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:17:02.828 19:05:23 -- common/autotest_common.sh@1208 -- # local i=0 00:17:02.828 19:05:23 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:17:02.828 19:05:23 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:17:02.828 19:05:23 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:17:02.828 19:05:23 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:17:02.828 19:05:23 -- common/autotest_common.sh@1220 -- # return 0 00:17:02.828 19:05:23 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:17:02.828 19:05:23 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:17:02.828 nvmf hotplug test: fio failed as expected 00:17:02.828 19:05:23 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:03.086 19:05:24 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:17:03.087 19:05:24 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:17:03.087 19:05:24 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:17:03.087 19:05:24 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:17:03.087 19:05:24 -- target/fio.sh@91 -- # nvmftestfini 00:17:03.087 19:05:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:03.087 19:05:24 -- nvmf/common.sh@116 -- # sync 00:17:03.087 19:05:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:03.087 19:05:24 -- nvmf/common.sh@119 -- # set +e 00:17:03.087 19:05:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:03.087 19:05:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:03.087 rmmod nvme_tcp 00:17:03.087 rmmod nvme_fabrics 00:17:03.087 rmmod nvme_keyring 00:17:03.347 19:05:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:03.347 19:05:24 -- nvmf/common.sh@123 -- # set -e 00:17:03.347 19:05:24 -- nvmf/common.sh@124 -- # return 0 00:17:03.347 19:05:24 -- nvmf/common.sh@477 -- # '[' -n 210343 ']' 00:17:03.347 19:05:24 -- nvmf/common.sh@478 -- # killprocess 210343 00:17:03.347 19:05:24 -- common/autotest_common.sh@936 -- # '[' -z 210343 ']' 00:17:03.347 19:05:24 -- common/autotest_common.sh@940 -- # kill -0 210343 00:17:03.347 19:05:24 -- common/autotest_common.sh@941 -- # uname 00:17:03.347 19:05:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:03.347 19:05:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 210343 00:17:03.347 19:05:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:03.347 19:05:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:03.347 19:05:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 210343' 00:17:03.347 killing process with pid 210343 00:17:03.347 19:05:24 -- common/autotest_common.sh@955 -- # kill 210343 00:17:03.347 19:05:24 -- common/autotest_common.sh@960 -- # wait 210343 00:17:03.607 19:05:24 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:03.607 19:05:24 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:03.607 19:05:24 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:03.607 19:05:24 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:03.607 19:05:24 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:03.607 19:05:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:03.607 19:05:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:03.607 19:05:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:05.527 19:05:26 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:05.527 00:17:05.527 real 0m24.429s 00:17:05.527 user 1m26.210s 00:17:05.527 sys 0m6.945s 00:17:05.527 19:05:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:05.527 19:05:26 -- common/autotest_common.sh@10 -- # set +x 00:17:05.527 ************************************ 00:17:05.527 END TEST nvmf_fio_target 00:17:05.527 ************************************ 00:17:05.527 19:05:26 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:17:05.527 19:05:26 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:05.527 19:05:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:05.527 19:05:26 -- common/autotest_common.sh@10 -- # set +x 00:17:05.527 ************************************ 00:17:05.527 START TEST nvmf_bdevio 00:17:05.527 ************************************ 00:17:05.527 19:05:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:17:05.786 * Looking for test storage... 00:17:05.786 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:05.786 19:05:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:05.786 19:05:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:05.786 19:05:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:05.786 19:05:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:05.786 19:05:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:05.786 19:05:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:05.786 19:05:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:05.786 19:05:26 -- scripts/common.sh@335 -- # IFS=.-: 00:17:05.786 19:05:26 -- scripts/common.sh@335 -- # read -ra ver1 00:17:05.786 19:05:26 -- scripts/common.sh@336 -- # IFS=.-: 00:17:05.786 19:05:26 -- scripts/common.sh@336 -- # read -ra ver2 00:17:05.786 19:05:26 -- scripts/common.sh@337 -- # local 'op=<' 00:17:05.786 19:05:26 -- scripts/common.sh@339 -- # ver1_l=2 00:17:05.786 19:05:26 -- scripts/common.sh@340 -- # ver2_l=1 00:17:05.786 19:05:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:05.786 19:05:26 -- scripts/common.sh@343 -- # case "$op" in 00:17:05.786 19:05:26 -- scripts/common.sh@344 -- # : 1 00:17:05.786 19:05:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:05.786 19:05:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:05.786 19:05:26 -- scripts/common.sh@364 -- # decimal 1 00:17:05.786 19:05:26 -- scripts/common.sh@352 -- # local d=1 00:17:05.786 19:05:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:05.786 19:05:26 -- scripts/common.sh@354 -- # echo 1 00:17:05.786 19:05:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:05.786 19:05:26 -- scripts/common.sh@365 -- # decimal 2 00:17:05.786 19:05:26 -- scripts/common.sh@352 -- # local d=2 00:17:05.786 19:05:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:05.786 19:05:26 -- scripts/common.sh@354 -- # echo 2 00:17:05.786 19:05:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:05.786 19:05:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:05.786 19:05:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:05.786 19:05:26 -- scripts/common.sh@367 -- # return 0 00:17:05.786 19:05:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:05.786 19:05:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:05.786 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:05.786 --rc genhtml_branch_coverage=1 00:17:05.786 --rc genhtml_function_coverage=1 00:17:05.786 --rc genhtml_legend=1 00:17:05.786 --rc geninfo_all_blocks=1 00:17:05.786 --rc geninfo_unexecuted_blocks=1 00:17:05.786 00:17:05.786 ' 00:17:05.786 19:05:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:05.786 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:05.786 --rc genhtml_branch_coverage=1 00:17:05.786 --rc genhtml_function_coverage=1 00:17:05.786 --rc genhtml_legend=1 00:17:05.786 --rc geninfo_all_blocks=1 00:17:05.786 --rc geninfo_unexecuted_blocks=1 00:17:05.786 00:17:05.786 ' 00:17:05.786 19:05:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:05.786 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:05.786 --rc genhtml_branch_coverage=1 00:17:05.786 --rc genhtml_function_coverage=1 00:17:05.786 --rc genhtml_legend=1 00:17:05.786 --rc geninfo_all_blocks=1 00:17:05.786 --rc geninfo_unexecuted_blocks=1 00:17:05.786 00:17:05.786 ' 00:17:05.786 19:05:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:05.786 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:05.786 --rc genhtml_branch_coverage=1 00:17:05.786 --rc genhtml_function_coverage=1 00:17:05.786 --rc genhtml_legend=1 00:17:05.786 --rc geninfo_all_blocks=1 00:17:05.786 --rc geninfo_unexecuted_blocks=1 00:17:05.786 00:17:05.786 ' 00:17:05.786 19:05:26 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:05.786 19:05:26 -- nvmf/common.sh@7 -- # uname -s 00:17:05.786 19:05:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:05.786 19:05:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:05.786 19:05:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:05.786 19:05:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:05.786 19:05:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:05.786 19:05:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:05.786 19:05:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:05.786 19:05:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:05.786 19:05:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:05.786 19:05:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:05.786 19:05:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:05.786 19:05:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:05.786 19:05:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:05.786 19:05:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:05.786 19:05:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:05.786 19:05:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:05.786 19:05:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:05.786 19:05:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:05.786 19:05:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:05.786 19:05:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:05.786 19:05:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:05.786 19:05:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:05.786 19:05:26 -- paths/export.sh@5 -- # export PATH 00:17:05.787 19:05:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:05.787 19:05:26 -- nvmf/common.sh@46 -- # : 0 00:17:05.787 19:05:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:05.787 19:05:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:05.787 19:05:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:05.787 19:05:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:05.787 19:05:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:05.787 19:05:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:05.787 19:05:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:05.787 19:05:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:05.787 19:05:26 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:05.787 19:05:26 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:05.787 19:05:26 -- target/bdevio.sh@14 -- # nvmftestinit 00:17:05.787 19:05:26 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:05.787 19:05:26 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:05.787 19:05:26 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:05.787 19:05:26 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:05.787 19:05:26 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:05.787 19:05:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:05.787 19:05:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:05.787 19:05:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:05.787 19:05:26 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:05.787 19:05:26 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:05.787 19:05:26 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:05.787 19:05:26 -- common/autotest_common.sh@10 -- # set +x 00:17:07.698 19:05:28 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:07.698 19:05:28 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:07.698 19:05:28 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:07.698 19:05:28 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:07.698 19:05:28 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:07.698 19:05:28 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:07.698 19:05:28 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:07.698 19:05:28 -- nvmf/common.sh@294 -- # net_devs=() 00:17:07.698 19:05:28 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:07.698 19:05:28 -- nvmf/common.sh@295 -- # e810=() 00:17:07.698 19:05:28 -- nvmf/common.sh@295 -- # local -ga e810 00:17:07.698 19:05:28 -- nvmf/common.sh@296 -- # x722=() 00:17:07.698 19:05:28 -- nvmf/common.sh@296 -- # local -ga x722 00:17:07.698 19:05:28 -- nvmf/common.sh@297 -- # mlx=() 00:17:07.698 19:05:28 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:07.698 19:05:28 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:07.698 19:05:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:07.698 19:05:28 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:07.698 19:05:28 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:07.698 19:05:28 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:07.698 19:05:28 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:07.698 19:05:28 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:07.698 19:05:28 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:07.698 19:05:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:07.698 19:05:28 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:07.698 19:05:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:07.698 19:05:28 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:07.698 19:05:28 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:07.698 19:05:28 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:07.698 19:05:28 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:07.698 19:05:28 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:07.698 19:05:28 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:07.698 19:05:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:07.698 19:05:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:07.698 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:07.698 19:05:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:07.698 19:05:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:07.698 19:05:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:07.698 19:05:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:07.698 19:05:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:07.698 19:05:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:07.698 19:05:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:07.698 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:07.698 19:05:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:07.698 19:05:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:07.698 19:05:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:07.698 19:05:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:07.698 19:05:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:07.698 19:05:28 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:07.698 19:05:28 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:07.698 19:05:28 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:07.698 19:05:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:07.698 19:05:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:07.698 19:05:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:07.698 19:05:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:07.698 19:05:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:07.698 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:07.698 19:05:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:07.698 19:05:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:07.698 19:05:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:07.698 19:05:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:07.698 19:05:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:07.698 19:05:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:07.698 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:07.698 19:05:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:07.698 19:05:28 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:07.698 19:05:28 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:07.698 19:05:28 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:07.698 19:05:28 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:07.698 19:05:28 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:07.698 19:05:28 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:07.698 19:05:28 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:07.698 19:05:28 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:07.698 19:05:28 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:07.698 19:05:28 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:07.698 19:05:28 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:07.698 19:05:28 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:07.698 19:05:28 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:07.698 19:05:28 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:07.698 19:05:28 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:07.698 19:05:28 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:07.698 19:05:28 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:07.698 19:05:28 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:07.698 19:05:28 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:07.698 19:05:28 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:07.958 19:05:28 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:07.958 19:05:28 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:07.958 19:05:28 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:07.958 19:05:28 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:07.958 19:05:28 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:07.958 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:07.958 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.245 ms 00:17:07.958 00:17:07.958 --- 10.0.0.2 ping statistics --- 00:17:07.958 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:07.958 rtt min/avg/max/mdev = 0.245/0.245/0.245/0.000 ms 00:17:07.958 19:05:28 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:07.958 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:07.958 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:17:07.958 00:17:07.959 --- 10.0.0.1 ping statistics --- 00:17:07.959 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:07.959 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:17:07.959 19:05:28 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:07.959 19:05:28 -- nvmf/common.sh@410 -- # return 0 00:17:07.959 19:05:28 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:07.959 19:05:28 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:07.959 19:05:28 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:07.959 19:05:28 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:07.959 19:05:28 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:07.959 19:05:28 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:07.959 19:05:28 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:07.959 19:05:28 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:17:07.959 19:05:28 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:07.959 19:05:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:07.959 19:05:28 -- common/autotest_common.sh@10 -- # set +x 00:17:07.959 19:05:28 -- nvmf/common.sh@469 -- # nvmfpid=215297 00:17:07.959 19:05:28 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:17:07.959 19:05:28 -- nvmf/common.sh@470 -- # waitforlisten 215297 00:17:07.959 19:05:28 -- common/autotest_common.sh@829 -- # '[' -z 215297 ']' 00:17:07.959 19:05:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:07.959 19:05:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:07.959 19:05:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:07.959 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:07.959 19:05:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:07.959 19:05:28 -- common/autotest_common.sh@10 -- # set +x 00:17:07.959 [2024-11-28 19:05:28.876605] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:07.959 [2024-11-28 19:05:28.876678] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:07.959 EAL: No free 2048 kB hugepages reported on node 1 00:17:07.959 [2024-11-28 19:05:28.945555] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:08.218 [2024-11-28 19:05:29.061339] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:08.218 [2024-11-28 19:05:29.061508] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:08.218 [2024-11-28 19:05:29.061538] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:08.218 [2024-11-28 19:05:29.061562] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:08.218 [2024-11-28 19:05:29.061668] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:08.218 [2024-11-28 19:05:29.061729] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:17:08.218 [2024-11-28 19:05:29.061784] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:17:08.218 [2024-11-28 19:05:29.061789] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:08.786 19:05:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:08.786 19:05:29 -- common/autotest_common.sh@862 -- # return 0 00:17:08.786 19:05:29 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:08.786 19:05:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:08.786 19:05:29 -- common/autotest_common.sh@10 -- # set +x 00:17:09.046 19:05:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:09.046 19:05:29 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:09.046 19:05:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:09.046 19:05:29 -- common/autotest_common.sh@10 -- # set +x 00:17:09.046 [2024-11-28 19:05:29.844849] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:09.046 19:05:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:09.046 19:05:29 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:09.046 19:05:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:09.046 19:05:29 -- common/autotest_common.sh@10 -- # set +x 00:17:09.046 Malloc0 00:17:09.046 19:05:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:09.046 19:05:29 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:09.046 19:05:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:09.046 19:05:29 -- common/autotest_common.sh@10 -- # set +x 00:17:09.046 19:05:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:09.046 19:05:29 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:09.046 19:05:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:09.046 19:05:29 -- common/autotest_common.sh@10 -- # set +x 00:17:09.046 19:05:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:09.046 19:05:29 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:09.046 19:05:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:09.046 19:05:29 -- common/autotest_common.sh@10 -- # set +x 00:17:09.046 [2024-11-28 19:05:29.897562] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:09.046 19:05:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:09.046 19:05:29 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:17:09.046 19:05:29 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:17:09.046 19:05:29 -- nvmf/common.sh@520 -- # config=() 00:17:09.046 19:05:29 -- nvmf/common.sh@520 -- # local subsystem config 00:17:09.046 19:05:29 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:09.046 19:05:29 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:09.046 { 00:17:09.046 "params": { 00:17:09.046 "name": "Nvme$subsystem", 00:17:09.046 "trtype": "$TEST_TRANSPORT", 00:17:09.046 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:09.046 "adrfam": "ipv4", 00:17:09.046 "trsvcid": "$NVMF_PORT", 00:17:09.046 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:09.046 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:09.046 "hdgst": ${hdgst:-false}, 00:17:09.046 "ddgst": ${ddgst:-false} 00:17:09.046 }, 00:17:09.046 "method": "bdev_nvme_attach_controller" 00:17:09.046 } 00:17:09.046 EOF 00:17:09.046 )") 00:17:09.046 19:05:29 -- nvmf/common.sh@542 -- # cat 00:17:09.046 19:05:29 -- nvmf/common.sh@544 -- # jq . 00:17:09.046 19:05:29 -- nvmf/common.sh@545 -- # IFS=, 00:17:09.047 19:05:29 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:09.047 "params": { 00:17:09.047 "name": "Nvme1", 00:17:09.047 "trtype": "tcp", 00:17:09.047 "traddr": "10.0.0.2", 00:17:09.047 "adrfam": "ipv4", 00:17:09.047 "trsvcid": "4420", 00:17:09.047 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:09.047 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:09.047 "hdgst": false, 00:17:09.047 "ddgst": false 00:17:09.047 }, 00:17:09.047 "method": "bdev_nvme_attach_controller" 00:17:09.047 }' 00:17:09.047 [2024-11-28 19:05:29.941334] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:09.047 [2024-11-28 19:05:29.941433] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid215424 ] 00:17:09.047 EAL: No free 2048 kB hugepages reported on node 1 00:17:09.047 [2024-11-28 19:05:30.003994] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:09.308 [2024-11-28 19:05:30.121485] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:09.308 [2024-11-28 19:05:30.121534] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:09.308 [2024-11-28 19:05:30.121538] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:09.308 [2024-11-28 19:05:30.298633] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:17:09.308 [2024-11-28 19:05:30.298701] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:17:09.308 I/O targets: 00:17:09.308 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:17:09.308 00:17:09.308 00:17:09.308 CUnit - A unit testing framework for C - Version 2.1-3 00:17:09.308 http://cunit.sourceforge.net/ 00:17:09.308 00:17:09.308 00:17:09.308 Suite: bdevio tests on: Nvme1n1 00:17:09.308 Test: blockdev write read block ...passed 00:17:09.568 Test: blockdev write zeroes read block ...passed 00:17:09.568 Test: blockdev write zeroes read no split ...passed 00:17:09.568 Test: blockdev write zeroes read split ...passed 00:17:09.568 Test: blockdev write zeroes read split partial ...passed 00:17:09.568 Test: blockdev reset ...[2024-11-28 19:05:30.454230] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:17:09.568 [2024-11-28 19:05:30.454340] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x8ddf20 (9): Bad file descriptor 00:17:09.568 [2024-11-28 19:05:30.509379] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:09.568 passed 00:17:09.568 Test: blockdev write read 8 blocks ...passed 00:17:09.568 Test: blockdev write read size > 128k ...passed 00:17:09.568 Test: blockdev write read invalid size ...passed 00:17:09.568 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:17:09.568 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:17:09.568 Test: blockdev write read max offset ...passed 00:17:09.828 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:17:09.828 Test: blockdev writev readv 8 blocks ...passed 00:17:09.828 Test: blockdev writev readv 30 x 1block ...passed 00:17:09.828 Test: blockdev writev readv block ...passed 00:17:09.828 Test: blockdev writev readv size > 128k ...passed 00:17:09.828 Test: blockdev writev readv size > 128k in two iovs ...passed 00:17:09.828 Test: blockdev comparev and writev ...[2024-11-28 19:05:30.764891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:09.828 [2024-11-28 19:05:30.764928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:17:09.828 [2024-11-28 19:05:30.764966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:09.828 [2024-11-28 19:05:30.764996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:17:09.828 [2024-11-28 19:05:30.765404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:09.828 [2024-11-28 19:05:30.765432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:17:09.828 [2024-11-28 19:05:30.765468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:09.828 [2024-11-28 19:05:30.765496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:17:09.828 [2024-11-28 19:05:30.765871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:09.828 [2024-11-28 19:05:30.765908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:17:09.828 [2024-11-28 19:05:30.765943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:09.828 [2024-11-28 19:05:30.765970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:17:09.828 [2024-11-28 19:05:30.766321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:09.828 [2024-11-28 19:05:30.766347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:17:09.828 [2024-11-28 19:05:30.766381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:09.828 [2024-11-28 19:05:30.766418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:17:09.828 passed 00:17:09.828 Test: blockdev nvme passthru rw ...passed 00:17:09.828 Test: blockdev nvme passthru vendor specific ...[2024-11-28 19:05:30.849655] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:09.828 [2024-11-28 19:05:30.849685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:17:09.828 [2024-11-28 19:05:30.849854] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:09.828 [2024-11-28 19:05:30.849880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:17:09.828 [2024-11-28 19:05:30.850047] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:09.828 [2024-11-28 19:05:30.850072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:17:09.828 [2024-11-28 19:05:30.850231] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:09.828 [2024-11-28 19:05:30.850257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:17:09.828 passed 00:17:09.828 Test: blockdev nvme admin passthru ...passed 00:17:10.089 Test: blockdev copy ...passed 00:17:10.089 00:17:10.089 Run Summary: Type Total Ran Passed Failed Inactive 00:17:10.089 suites 1 1 n/a 0 0 00:17:10.089 tests 23 23 23 0 0 00:17:10.089 asserts 152 152 152 0 n/a 00:17:10.089 00:17:10.089 Elapsed time = 1.214 seconds 00:17:10.089 19:05:31 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:10.089 19:05:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:10.089 19:05:31 -- common/autotest_common.sh@10 -- # set +x 00:17:10.350 19:05:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:10.350 19:05:31 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:17:10.350 19:05:31 -- target/bdevio.sh@30 -- # nvmftestfini 00:17:10.350 19:05:31 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:10.350 19:05:31 -- nvmf/common.sh@116 -- # sync 00:17:10.350 19:05:31 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:10.350 19:05:31 -- nvmf/common.sh@119 -- # set +e 00:17:10.350 19:05:31 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:10.350 19:05:31 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:10.350 rmmod nvme_tcp 00:17:10.350 rmmod nvme_fabrics 00:17:10.350 rmmod nvme_keyring 00:17:10.350 19:05:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:10.350 19:05:31 -- nvmf/common.sh@123 -- # set -e 00:17:10.350 19:05:31 -- nvmf/common.sh@124 -- # return 0 00:17:10.350 19:05:31 -- nvmf/common.sh@477 -- # '[' -n 215297 ']' 00:17:10.350 19:05:31 -- nvmf/common.sh@478 -- # killprocess 215297 00:17:10.350 19:05:31 -- common/autotest_common.sh@936 -- # '[' -z 215297 ']' 00:17:10.350 19:05:31 -- common/autotest_common.sh@940 -- # kill -0 215297 00:17:10.350 19:05:31 -- common/autotest_common.sh@941 -- # uname 00:17:10.350 19:05:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:10.350 19:05:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 215297 00:17:10.350 19:05:31 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:17:10.350 19:05:31 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:17:10.350 19:05:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 215297' 00:17:10.350 killing process with pid 215297 00:17:10.350 19:05:31 -- common/autotest_common.sh@955 -- # kill 215297 00:17:10.350 19:05:31 -- common/autotest_common.sh@960 -- # wait 215297 00:17:10.610 19:05:31 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:10.610 19:05:31 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:10.610 19:05:31 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:10.610 19:05:31 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:10.610 19:05:31 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:10.610 19:05:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:10.610 19:05:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:10.610 19:05:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:13.150 19:05:33 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:13.150 00:17:13.150 real 0m7.062s 00:17:13.150 user 0m12.975s 00:17:13.150 sys 0m2.059s 00:17:13.150 19:05:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:13.150 19:05:33 -- common/autotest_common.sh@10 -- # set +x 00:17:13.150 ************************************ 00:17:13.150 END TEST nvmf_bdevio 00:17:13.150 ************************************ 00:17:13.150 19:05:33 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:17:13.150 19:05:33 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:17:13.150 19:05:33 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:17:13.150 19:05:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:13.150 19:05:33 -- common/autotest_common.sh@10 -- # set +x 00:17:13.150 ************************************ 00:17:13.150 START TEST nvmf_bdevio_no_huge 00:17:13.150 ************************************ 00:17:13.150 19:05:33 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:17:13.150 * Looking for test storage... 00:17:13.150 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:13.150 19:05:33 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:13.150 19:05:33 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:13.150 19:05:33 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:13.150 19:05:33 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:13.150 19:05:33 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:13.150 19:05:33 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:13.150 19:05:33 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:13.151 19:05:33 -- scripts/common.sh@335 -- # IFS=.-: 00:17:13.151 19:05:33 -- scripts/common.sh@335 -- # read -ra ver1 00:17:13.151 19:05:33 -- scripts/common.sh@336 -- # IFS=.-: 00:17:13.151 19:05:33 -- scripts/common.sh@336 -- # read -ra ver2 00:17:13.151 19:05:33 -- scripts/common.sh@337 -- # local 'op=<' 00:17:13.151 19:05:33 -- scripts/common.sh@339 -- # ver1_l=2 00:17:13.151 19:05:33 -- scripts/common.sh@340 -- # ver2_l=1 00:17:13.151 19:05:33 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:13.151 19:05:33 -- scripts/common.sh@343 -- # case "$op" in 00:17:13.151 19:05:33 -- scripts/common.sh@344 -- # : 1 00:17:13.151 19:05:33 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:13.151 19:05:33 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:13.151 19:05:33 -- scripts/common.sh@364 -- # decimal 1 00:17:13.151 19:05:33 -- scripts/common.sh@352 -- # local d=1 00:17:13.151 19:05:33 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:13.151 19:05:33 -- scripts/common.sh@354 -- # echo 1 00:17:13.151 19:05:33 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:13.151 19:05:33 -- scripts/common.sh@365 -- # decimal 2 00:17:13.151 19:05:33 -- scripts/common.sh@352 -- # local d=2 00:17:13.151 19:05:33 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:13.151 19:05:33 -- scripts/common.sh@354 -- # echo 2 00:17:13.151 19:05:33 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:13.151 19:05:33 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:13.151 19:05:33 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:13.151 19:05:33 -- scripts/common.sh@367 -- # return 0 00:17:13.151 19:05:33 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:13.151 19:05:33 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:13.151 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:13.151 --rc genhtml_branch_coverage=1 00:17:13.151 --rc genhtml_function_coverage=1 00:17:13.151 --rc genhtml_legend=1 00:17:13.151 --rc geninfo_all_blocks=1 00:17:13.151 --rc geninfo_unexecuted_blocks=1 00:17:13.151 00:17:13.151 ' 00:17:13.151 19:05:33 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:13.151 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:13.151 --rc genhtml_branch_coverage=1 00:17:13.151 --rc genhtml_function_coverage=1 00:17:13.151 --rc genhtml_legend=1 00:17:13.151 --rc geninfo_all_blocks=1 00:17:13.151 --rc geninfo_unexecuted_blocks=1 00:17:13.151 00:17:13.151 ' 00:17:13.151 19:05:33 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:13.151 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:13.151 --rc genhtml_branch_coverage=1 00:17:13.151 --rc genhtml_function_coverage=1 00:17:13.151 --rc genhtml_legend=1 00:17:13.151 --rc geninfo_all_blocks=1 00:17:13.151 --rc geninfo_unexecuted_blocks=1 00:17:13.151 00:17:13.151 ' 00:17:13.151 19:05:33 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:13.151 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:13.151 --rc genhtml_branch_coverage=1 00:17:13.151 --rc genhtml_function_coverage=1 00:17:13.151 --rc genhtml_legend=1 00:17:13.151 --rc geninfo_all_blocks=1 00:17:13.151 --rc geninfo_unexecuted_blocks=1 00:17:13.151 00:17:13.151 ' 00:17:13.151 19:05:33 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:13.151 19:05:33 -- nvmf/common.sh@7 -- # uname -s 00:17:13.151 19:05:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:13.151 19:05:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:13.151 19:05:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:13.151 19:05:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:13.151 19:05:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:13.151 19:05:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:13.151 19:05:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:13.151 19:05:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:13.151 19:05:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:13.151 19:05:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:13.151 19:05:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:13.151 19:05:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:13.151 19:05:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:13.151 19:05:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:13.151 19:05:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:13.151 19:05:33 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:13.151 19:05:33 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:13.151 19:05:33 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:13.151 19:05:33 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:13.151 19:05:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:13.151 19:05:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:13.151 19:05:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:13.151 19:05:33 -- paths/export.sh@5 -- # export PATH 00:17:13.151 19:05:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:13.151 19:05:33 -- nvmf/common.sh@46 -- # : 0 00:17:13.151 19:05:33 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:13.151 19:05:33 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:13.151 19:05:33 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:13.151 19:05:33 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:13.151 19:05:33 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:13.151 19:05:33 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:13.151 19:05:33 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:13.151 19:05:33 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:13.151 19:05:33 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:13.151 19:05:33 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:13.151 19:05:33 -- target/bdevio.sh@14 -- # nvmftestinit 00:17:13.151 19:05:33 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:13.151 19:05:33 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:13.151 19:05:33 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:13.151 19:05:33 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:13.151 19:05:33 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:13.151 19:05:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:13.151 19:05:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:13.151 19:05:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:13.151 19:05:33 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:13.151 19:05:33 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:13.151 19:05:33 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:13.151 19:05:33 -- common/autotest_common.sh@10 -- # set +x 00:17:15.064 19:05:35 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:15.064 19:05:35 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:15.064 19:05:35 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:15.064 19:05:35 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:15.064 19:05:35 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:15.064 19:05:35 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:15.064 19:05:35 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:15.064 19:05:35 -- nvmf/common.sh@294 -- # net_devs=() 00:17:15.064 19:05:35 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:15.064 19:05:35 -- nvmf/common.sh@295 -- # e810=() 00:17:15.064 19:05:35 -- nvmf/common.sh@295 -- # local -ga e810 00:17:15.064 19:05:35 -- nvmf/common.sh@296 -- # x722=() 00:17:15.064 19:05:35 -- nvmf/common.sh@296 -- # local -ga x722 00:17:15.064 19:05:35 -- nvmf/common.sh@297 -- # mlx=() 00:17:15.064 19:05:35 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:15.064 19:05:35 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:15.064 19:05:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:15.064 19:05:35 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:15.064 19:05:35 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:15.064 19:05:35 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:15.064 19:05:35 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:15.064 19:05:35 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:15.064 19:05:35 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:15.064 19:05:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:15.064 19:05:35 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:15.064 19:05:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:15.064 19:05:35 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:15.064 19:05:35 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:15.064 19:05:35 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:15.064 19:05:35 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:15.064 19:05:35 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:15.064 19:05:35 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:15.064 19:05:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:15.064 19:05:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:15.064 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:15.064 19:05:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:15.064 19:05:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:15.064 19:05:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:15.064 19:05:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:15.064 19:05:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:15.064 19:05:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:15.064 19:05:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:15.064 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:15.064 19:05:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:15.064 19:05:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:15.064 19:05:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:15.064 19:05:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:15.064 19:05:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:15.064 19:05:35 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:15.064 19:05:35 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:15.064 19:05:35 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:15.064 19:05:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:15.064 19:05:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:15.064 19:05:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:15.064 19:05:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:15.064 19:05:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:15.064 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:15.064 19:05:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:15.064 19:05:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:15.064 19:05:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:15.064 19:05:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:15.064 19:05:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:15.064 19:05:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:15.064 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:15.064 19:05:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:15.064 19:05:35 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:15.064 19:05:35 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:15.064 19:05:35 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:15.064 19:05:35 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:15.064 19:05:35 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:15.064 19:05:35 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:15.064 19:05:35 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:15.064 19:05:35 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:15.064 19:05:35 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:15.064 19:05:35 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:15.064 19:05:35 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:15.064 19:05:35 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:15.064 19:05:35 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:15.064 19:05:35 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:15.064 19:05:35 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:15.064 19:05:35 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:15.064 19:05:35 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:15.064 19:05:35 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:15.064 19:05:35 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:15.064 19:05:35 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:15.064 19:05:35 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:15.064 19:05:35 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:15.064 19:05:35 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:15.064 19:05:35 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:15.064 19:05:35 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:15.064 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:15.064 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.345 ms 00:17:15.064 00:17:15.064 --- 10.0.0.2 ping statistics --- 00:17:15.064 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:15.064 rtt min/avg/max/mdev = 0.345/0.345/0.345/0.000 ms 00:17:15.064 19:05:35 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:15.064 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:15.064 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.098 ms 00:17:15.064 00:17:15.064 --- 10.0.0.1 ping statistics --- 00:17:15.064 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:15.064 rtt min/avg/max/mdev = 0.098/0.098/0.098/0.000 ms 00:17:15.064 19:05:35 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:15.064 19:05:35 -- nvmf/common.sh@410 -- # return 0 00:17:15.064 19:05:35 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:15.065 19:05:35 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:15.065 19:05:35 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:15.065 19:05:35 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:15.065 19:05:35 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:15.065 19:05:35 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:15.065 19:05:35 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:15.065 19:05:35 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:17:15.065 19:05:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:15.065 19:05:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:15.065 19:05:35 -- common/autotest_common.sh@10 -- # set +x 00:17:15.065 19:05:35 -- nvmf/common.sh@469 -- # nvmfpid=217547 00:17:15.065 19:05:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:17:15.065 19:05:35 -- nvmf/common.sh@470 -- # waitforlisten 217547 00:17:15.065 19:05:35 -- common/autotest_common.sh@829 -- # '[' -z 217547 ']' 00:17:15.065 19:05:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:15.065 19:05:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:15.065 19:05:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:15.065 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:15.065 19:05:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:15.065 19:05:35 -- common/autotest_common.sh@10 -- # set +x 00:17:15.065 [2024-11-28 19:05:35.855907] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:15.065 [2024-11-28 19:05:35.856003] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:17:15.065 [2024-11-28 19:05:35.941180] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:15.065 [2024-11-28 19:05:36.066026] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:15.065 [2024-11-28 19:05:36.066194] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:15.065 [2024-11-28 19:05:36.066213] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:15.065 [2024-11-28 19:05:36.066228] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:15.065 [2024-11-28 19:05:36.066318] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:15.065 [2024-11-28 19:05:36.066377] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:17:15.065 [2024-11-28 19:05:36.066420] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:17:15.065 [2024-11-28 19:05:36.066424] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:16.004 19:05:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:16.004 19:05:36 -- common/autotest_common.sh@862 -- # return 0 00:17:16.004 19:05:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:16.004 19:05:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:16.004 19:05:36 -- common/autotest_common.sh@10 -- # set +x 00:17:16.004 19:05:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:16.004 19:05:36 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:16.004 19:05:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:16.004 19:05:36 -- common/autotest_common.sh@10 -- # set +x 00:17:16.004 [2024-11-28 19:05:36.911086] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:16.004 19:05:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:16.004 19:05:36 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:16.004 19:05:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:16.004 19:05:36 -- common/autotest_common.sh@10 -- # set +x 00:17:16.004 Malloc0 00:17:16.004 19:05:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:16.004 19:05:36 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:17:16.004 19:05:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:16.004 19:05:36 -- common/autotest_common.sh@10 -- # set +x 00:17:16.004 19:05:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:16.004 19:05:36 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:16.004 19:05:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:16.004 19:05:36 -- common/autotest_common.sh@10 -- # set +x 00:17:16.004 19:05:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:16.004 19:05:36 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:16.004 19:05:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:16.004 19:05:36 -- common/autotest_common.sh@10 -- # set +x 00:17:16.004 [2024-11-28 19:05:36.949051] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:16.004 19:05:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:16.004 19:05:36 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:17:16.004 19:05:36 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:17:16.004 19:05:36 -- nvmf/common.sh@520 -- # config=() 00:17:16.004 19:05:36 -- nvmf/common.sh@520 -- # local subsystem config 00:17:16.004 19:05:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:16.004 19:05:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:16.004 { 00:17:16.004 "params": { 00:17:16.004 "name": "Nvme$subsystem", 00:17:16.004 "trtype": "$TEST_TRANSPORT", 00:17:16.004 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:16.004 "adrfam": "ipv4", 00:17:16.004 "trsvcid": "$NVMF_PORT", 00:17:16.004 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:16.004 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:16.004 "hdgst": ${hdgst:-false}, 00:17:16.004 "ddgst": ${ddgst:-false} 00:17:16.004 }, 00:17:16.004 "method": "bdev_nvme_attach_controller" 00:17:16.004 } 00:17:16.004 EOF 00:17:16.004 )") 00:17:16.004 19:05:36 -- nvmf/common.sh@542 -- # cat 00:17:16.004 19:05:36 -- nvmf/common.sh@544 -- # jq . 00:17:16.004 19:05:36 -- nvmf/common.sh@545 -- # IFS=, 00:17:16.004 19:05:36 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:16.004 "params": { 00:17:16.004 "name": "Nvme1", 00:17:16.004 "trtype": "tcp", 00:17:16.004 "traddr": "10.0.0.2", 00:17:16.004 "adrfam": "ipv4", 00:17:16.004 "trsvcid": "4420", 00:17:16.004 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:16.004 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:16.004 "hdgst": false, 00:17:16.004 "ddgst": false 00:17:16.004 }, 00:17:16.004 "method": "bdev_nvme_attach_controller" 00:17:16.004 }' 00:17:16.004 [2024-11-28 19:05:36.987542] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:16.004 [2024-11-28 19:05:36.987618] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid217708 ] 00:17:16.263 [2024-11-28 19:05:37.051946] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:16.263 [2024-11-28 19:05:37.163624] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:16.263 [2024-11-28 19:05:37.163671] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:16.263 [2024-11-28 19:05:37.163674] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:16.523 [2024-11-28 19:05:37.442813] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:17:16.523 [2024-11-28 19:05:37.442881] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:17:16.523 I/O targets: 00:17:16.523 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:17:16.523 00:17:16.523 00:17:16.523 CUnit - A unit testing framework for C - Version 2.1-3 00:17:16.523 http://cunit.sourceforge.net/ 00:17:16.523 00:17:16.523 00:17:16.523 Suite: bdevio tests on: Nvme1n1 00:17:16.523 Test: blockdev write read block ...passed 00:17:16.523 Test: blockdev write zeroes read block ...passed 00:17:16.523 Test: blockdev write zeroes read no split ...passed 00:17:16.783 Test: blockdev write zeroes read split ...passed 00:17:16.783 Test: blockdev write zeroes read split partial ...passed 00:17:16.783 Test: blockdev reset ...[2024-11-28 19:05:37.647739] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:17:16.783 [2024-11-28 19:05:37.647842] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x118f7d0 (9): Bad file descriptor 00:17:16.783 [2024-11-28 19:05:37.663716] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:16.783 passed 00:17:16.783 Test: blockdev write read 8 blocks ...passed 00:17:16.783 Test: blockdev write read size > 128k ...passed 00:17:16.783 Test: blockdev write read invalid size ...passed 00:17:16.783 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:17:16.783 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:17:16.783 Test: blockdev write read max offset ...passed 00:17:17.043 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:17:17.043 Test: blockdev writev readv 8 blocks ...passed 00:17:17.043 Test: blockdev writev readv 30 x 1block ...passed 00:17:17.043 Test: blockdev writev readv block ...passed 00:17:17.043 Test: blockdev writev readv size > 128k ...passed 00:17:17.043 Test: blockdev writev readv size > 128k in two iovs ...passed 00:17:17.043 Test: blockdev comparev and writev ...[2024-11-28 19:05:37.879211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:17.043 [2024-11-28 19:05:37.879248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:17:17.043 [2024-11-28 19:05:37.879286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:17.043 [2024-11-28 19:05:37.879315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:17:17.043 [2024-11-28 19:05:37.879675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:17.043 [2024-11-28 19:05:37.879703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:17:17.043 [2024-11-28 19:05:37.879739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:17.043 [2024-11-28 19:05:37.879767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:17:17.043 [2024-11-28 19:05:37.880116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:17.043 [2024-11-28 19:05:37.880145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:17:17.044 [2024-11-28 19:05:37.880179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:17.044 [2024-11-28 19:05:37.880205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:17:17.044 [2024-11-28 19:05:37.880574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:17.044 [2024-11-28 19:05:37.880600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:17:17.044 [2024-11-28 19:05:37.880635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:17:17.044 [2024-11-28 19:05:37.880661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:17:17.044 passed 00:17:17.044 Test: blockdev nvme passthru rw ...passed 00:17:17.044 Test: blockdev nvme passthru vendor specific ...[2024-11-28 19:05:37.964640] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:17.044 [2024-11-28 19:05:37.964674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:17:17.044 [2024-11-28 19:05:37.964838] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:17.044 [2024-11-28 19:05:37.964864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:17:17.044 [2024-11-28 19:05:37.965023] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:17.044 [2024-11-28 19:05:37.965049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:17:17.044 [2024-11-28 19:05:37.965206] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:17:17.044 [2024-11-28 19:05:37.965231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:17:17.044 passed 00:17:17.044 Test: blockdev nvme admin passthru ...passed 00:17:17.044 Test: blockdev copy ...passed 00:17:17.044 00:17:17.044 Run Summary: Type Total Ran Passed Failed Inactive 00:17:17.044 suites 1 1 n/a 0 0 00:17:17.044 tests 23 23 23 0 0 00:17:17.044 asserts 152 152 152 0 n/a 00:17:17.044 00:17:17.044 Elapsed time = 1.152 seconds 00:17:17.612 19:05:38 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:17:17.612 19:05:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:17.612 19:05:38 -- common/autotest_common.sh@10 -- # set +x 00:17:17.612 19:05:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:17.612 19:05:38 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:17:17.612 19:05:38 -- target/bdevio.sh@30 -- # nvmftestfini 00:17:17.612 19:05:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:17.612 19:05:38 -- nvmf/common.sh@116 -- # sync 00:17:17.612 19:05:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:17.612 19:05:38 -- nvmf/common.sh@119 -- # set +e 00:17:17.612 19:05:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:17.612 19:05:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:17.612 rmmod nvme_tcp 00:17:17.612 rmmod nvme_fabrics 00:17:17.612 rmmod nvme_keyring 00:17:17.612 19:05:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:17.612 19:05:38 -- nvmf/common.sh@123 -- # set -e 00:17:17.612 19:05:38 -- nvmf/common.sh@124 -- # return 0 00:17:17.612 19:05:38 -- nvmf/common.sh@477 -- # '[' -n 217547 ']' 00:17:17.612 19:05:38 -- nvmf/common.sh@478 -- # killprocess 217547 00:17:17.612 19:05:38 -- common/autotest_common.sh@936 -- # '[' -z 217547 ']' 00:17:17.612 19:05:38 -- common/autotest_common.sh@940 -- # kill -0 217547 00:17:17.612 19:05:38 -- common/autotest_common.sh@941 -- # uname 00:17:17.612 19:05:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:17.612 19:05:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 217547 00:17:17.612 19:05:38 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:17:17.612 19:05:38 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:17:17.612 19:05:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 217547' 00:17:17.612 killing process with pid 217547 00:17:17.612 19:05:38 -- common/autotest_common.sh@955 -- # kill 217547 00:17:17.612 19:05:38 -- common/autotest_common.sh@960 -- # wait 217547 00:17:18.180 19:05:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:18.180 19:05:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:18.180 19:05:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:18.180 19:05:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:18.180 19:05:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:18.180 19:05:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:18.181 19:05:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:18.181 19:05:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:20.088 19:05:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:20.088 00:17:20.088 real 0m7.324s 00:17:20.088 user 0m14.407s 00:17:20.088 sys 0m2.476s 00:17:20.088 19:05:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:20.088 19:05:40 -- common/autotest_common.sh@10 -- # set +x 00:17:20.088 ************************************ 00:17:20.088 END TEST nvmf_bdevio_no_huge 00:17:20.088 ************************************ 00:17:20.088 19:05:40 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:17:20.088 19:05:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:20.088 19:05:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:20.088 19:05:40 -- common/autotest_common.sh@10 -- # set +x 00:17:20.088 ************************************ 00:17:20.088 START TEST nvmf_tls 00:17:20.088 ************************************ 00:17:20.088 19:05:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:17:20.088 * Looking for test storage... 00:17:20.088 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:20.088 19:05:41 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:20.088 19:05:41 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:20.088 19:05:41 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:20.088 19:05:41 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:20.088 19:05:41 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:20.088 19:05:41 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:20.088 19:05:41 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:20.088 19:05:41 -- scripts/common.sh@335 -- # IFS=.-: 00:17:20.088 19:05:41 -- scripts/common.sh@335 -- # read -ra ver1 00:17:20.088 19:05:41 -- scripts/common.sh@336 -- # IFS=.-: 00:17:20.088 19:05:41 -- scripts/common.sh@336 -- # read -ra ver2 00:17:20.088 19:05:41 -- scripts/common.sh@337 -- # local 'op=<' 00:17:20.088 19:05:41 -- scripts/common.sh@339 -- # ver1_l=2 00:17:20.088 19:05:41 -- scripts/common.sh@340 -- # ver2_l=1 00:17:20.088 19:05:41 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:20.088 19:05:41 -- scripts/common.sh@343 -- # case "$op" in 00:17:20.088 19:05:41 -- scripts/common.sh@344 -- # : 1 00:17:20.088 19:05:41 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:20.088 19:05:41 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:20.088 19:05:41 -- scripts/common.sh@364 -- # decimal 1 00:17:20.088 19:05:41 -- scripts/common.sh@352 -- # local d=1 00:17:20.088 19:05:41 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:20.088 19:05:41 -- scripts/common.sh@354 -- # echo 1 00:17:20.088 19:05:41 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:20.088 19:05:41 -- scripts/common.sh@365 -- # decimal 2 00:17:20.088 19:05:41 -- scripts/common.sh@352 -- # local d=2 00:17:20.088 19:05:41 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:20.088 19:05:41 -- scripts/common.sh@354 -- # echo 2 00:17:20.088 19:05:41 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:20.088 19:05:41 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:20.088 19:05:41 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:20.088 19:05:41 -- scripts/common.sh@367 -- # return 0 00:17:20.088 19:05:41 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:20.088 19:05:41 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:20.088 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:20.088 --rc genhtml_branch_coverage=1 00:17:20.088 --rc genhtml_function_coverage=1 00:17:20.088 --rc genhtml_legend=1 00:17:20.088 --rc geninfo_all_blocks=1 00:17:20.088 --rc geninfo_unexecuted_blocks=1 00:17:20.088 00:17:20.088 ' 00:17:20.088 19:05:41 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:20.088 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:20.088 --rc genhtml_branch_coverage=1 00:17:20.088 --rc genhtml_function_coverage=1 00:17:20.088 --rc genhtml_legend=1 00:17:20.088 --rc geninfo_all_blocks=1 00:17:20.088 --rc geninfo_unexecuted_blocks=1 00:17:20.088 00:17:20.088 ' 00:17:20.088 19:05:41 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:20.088 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:20.088 --rc genhtml_branch_coverage=1 00:17:20.088 --rc genhtml_function_coverage=1 00:17:20.088 --rc genhtml_legend=1 00:17:20.088 --rc geninfo_all_blocks=1 00:17:20.088 --rc geninfo_unexecuted_blocks=1 00:17:20.088 00:17:20.088 ' 00:17:20.088 19:05:41 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:20.088 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:20.088 --rc genhtml_branch_coverage=1 00:17:20.088 --rc genhtml_function_coverage=1 00:17:20.088 --rc genhtml_legend=1 00:17:20.088 --rc geninfo_all_blocks=1 00:17:20.088 --rc geninfo_unexecuted_blocks=1 00:17:20.088 00:17:20.088 ' 00:17:20.088 19:05:41 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:20.088 19:05:41 -- nvmf/common.sh@7 -- # uname -s 00:17:20.348 19:05:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:20.348 19:05:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:20.348 19:05:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:20.348 19:05:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:20.348 19:05:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:20.348 19:05:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:20.348 19:05:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:20.348 19:05:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:20.348 19:05:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:20.348 19:05:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:20.348 19:05:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:20.348 19:05:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:20.348 19:05:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:20.348 19:05:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:20.348 19:05:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:20.348 19:05:41 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:20.348 19:05:41 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:20.348 19:05:41 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:20.348 19:05:41 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:20.348 19:05:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:20.348 19:05:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:20.348 19:05:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:20.348 19:05:41 -- paths/export.sh@5 -- # export PATH 00:17:20.348 19:05:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:20.348 19:05:41 -- nvmf/common.sh@46 -- # : 0 00:17:20.348 19:05:41 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:20.348 19:05:41 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:20.348 19:05:41 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:20.348 19:05:41 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:20.348 19:05:41 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:20.348 19:05:41 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:20.348 19:05:41 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:20.348 19:05:41 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:20.348 19:05:41 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:20.348 19:05:41 -- target/tls.sh@71 -- # nvmftestinit 00:17:20.348 19:05:41 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:20.348 19:05:41 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:20.348 19:05:41 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:20.348 19:05:41 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:20.348 19:05:41 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:20.348 19:05:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:20.348 19:05:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:20.348 19:05:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:20.348 19:05:41 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:20.348 19:05:41 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:20.348 19:05:41 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:20.348 19:05:41 -- common/autotest_common.sh@10 -- # set +x 00:17:22.255 19:05:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:22.255 19:05:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:22.255 19:05:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:22.255 19:05:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:22.255 19:05:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:22.255 19:05:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:22.255 19:05:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:22.255 19:05:43 -- nvmf/common.sh@294 -- # net_devs=() 00:17:22.255 19:05:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:22.255 19:05:43 -- nvmf/common.sh@295 -- # e810=() 00:17:22.255 19:05:43 -- nvmf/common.sh@295 -- # local -ga e810 00:17:22.255 19:05:43 -- nvmf/common.sh@296 -- # x722=() 00:17:22.255 19:05:43 -- nvmf/common.sh@296 -- # local -ga x722 00:17:22.255 19:05:43 -- nvmf/common.sh@297 -- # mlx=() 00:17:22.255 19:05:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:22.255 19:05:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:22.255 19:05:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:22.255 19:05:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:22.255 19:05:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:22.255 19:05:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:22.255 19:05:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:22.255 19:05:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:22.255 19:05:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:22.255 19:05:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:22.255 19:05:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:22.255 19:05:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:22.255 19:05:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:22.255 19:05:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:22.255 19:05:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:22.255 19:05:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:22.255 19:05:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:22.255 19:05:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:22.255 19:05:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:22.255 19:05:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:22.255 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:22.255 19:05:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:22.255 19:05:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:22.255 19:05:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:22.255 19:05:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:22.255 19:05:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:22.255 19:05:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:22.255 19:05:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:22.255 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:22.255 19:05:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:22.255 19:05:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:22.255 19:05:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:22.255 19:05:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:22.255 19:05:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:22.255 19:05:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:22.255 19:05:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:22.255 19:05:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:22.255 19:05:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:22.255 19:05:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:22.255 19:05:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:22.255 19:05:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:22.255 19:05:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:22.255 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:22.255 19:05:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:22.255 19:05:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:22.255 19:05:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:22.256 19:05:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:22.256 19:05:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:22.256 19:05:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:22.256 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:22.256 19:05:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:22.256 19:05:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:22.256 19:05:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:22.256 19:05:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:22.256 19:05:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:22.256 19:05:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:22.256 19:05:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:22.256 19:05:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:22.256 19:05:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:22.256 19:05:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:22.256 19:05:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:22.256 19:05:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:22.256 19:05:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:22.256 19:05:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:22.256 19:05:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:22.256 19:05:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:22.256 19:05:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:22.256 19:05:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:22.256 19:05:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:22.256 19:05:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:22.256 19:05:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:22.256 19:05:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:22.256 19:05:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:22.256 19:05:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:22.256 19:05:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:22.256 19:05:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:22.256 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:22.256 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.211 ms 00:17:22.256 00:17:22.256 --- 10.0.0.2 ping statistics --- 00:17:22.256 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:22.256 rtt min/avg/max/mdev = 0.211/0.211/0.211/0.000 ms 00:17:22.256 19:05:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:22.256 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:22.256 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.090 ms 00:17:22.256 00:17:22.256 --- 10.0.0.1 ping statistics --- 00:17:22.256 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:22.256 rtt min/avg/max/mdev = 0.090/0.090/0.090/0.000 ms 00:17:22.256 19:05:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:22.256 19:05:43 -- nvmf/common.sh@410 -- # return 0 00:17:22.256 19:05:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:22.256 19:05:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:22.256 19:05:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:22.256 19:05:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:22.256 19:05:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:22.256 19:05:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:22.256 19:05:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:22.256 19:05:43 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:17:22.256 19:05:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:22.256 19:05:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:22.256 19:05:43 -- common/autotest_common.sh@10 -- # set +x 00:17:22.256 19:05:43 -- nvmf/common.sh@469 -- # nvmfpid=219798 00:17:22.256 19:05:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:17:22.256 19:05:43 -- nvmf/common.sh@470 -- # waitforlisten 219798 00:17:22.256 19:05:43 -- common/autotest_common.sh@829 -- # '[' -z 219798 ']' 00:17:22.256 19:05:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:22.256 19:05:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:22.256 19:05:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:22.256 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:22.256 19:05:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:22.256 19:05:43 -- common/autotest_common.sh@10 -- # set +x 00:17:22.256 [2024-11-28 19:05:43.300865] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:22.256 [2024-11-28 19:05:43.300931] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:22.515 EAL: No free 2048 kB hugepages reported on node 1 00:17:22.515 [2024-11-28 19:05:43.368369] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:22.515 [2024-11-28 19:05:43.484894] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:22.515 [2024-11-28 19:05:43.485036] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:22.515 [2024-11-28 19:05:43.485054] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:22.515 [2024-11-28 19:05:43.485067] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:22.515 [2024-11-28 19:05:43.485110] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:22.515 19:05:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:22.515 19:05:43 -- common/autotest_common.sh@862 -- # return 0 00:17:22.515 19:05:43 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:22.515 19:05:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:22.515 19:05:43 -- common/autotest_common.sh@10 -- # set +x 00:17:22.515 19:05:43 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:22.515 19:05:43 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:17:22.515 19:05:43 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:17:22.773 true 00:17:22.774 19:05:43 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:22.774 19:05:43 -- target/tls.sh@82 -- # jq -r .tls_version 00:17:23.032 19:05:44 -- target/tls.sh@82 -- # version=0 00:17:23.032 19:05:44 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:17:23.032 19:05:44 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:17:23.291 19:05:44 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:23.291 19:05:44 -- target/tls.sh@90 -- # jq -r .tls_version 00:17:23.550 19:05:44 -- target/tls.sh@90 -- # version=13 00:17:23.550 19:05:44 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:17:23.550 19:05:44 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:17:24.116 19:05:44 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:24.116 19:05:44 -- target/tls.sh@98 -- # jq -r .tls_version 00:17:24.116 19:05:45 -- target/tls.sh@98 -- # version=7 00:17:24.116 19:05:45 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:17:24.116 19:05:45 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:24.116 19:05:45 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:17:24.374 19:05:45 -- target/tls.sh@105 -- # ktls=false 00:17:24.374 19:05:45 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:17:24.374 19:05:45 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:17:24.632 19:05:45 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:24.632 19:05:45 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:17:24.891 19:05:45 -- target/tls.sh@113 -- # ktls=true 00:17:24.891 19:05:45 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:17:24.891 19:05:45 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:17:25.149 19:05:46 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:17:25.149 19:05:46 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:17:25.407 19:05:46 -- target/tls.sh@121 -- # ktls=false 00:17:25.407 19:05:46 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:17:25.407 19:05:46 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:17:25.407 19:05:46 -- target/tls.sh@49 -- # local key hash crc 00:17:25.407 19:05:46 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:17:25.407 19:05:46 -- target/tls.sh@51 -- # hash=01 00:17:25.407 19:05:46 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:17:25.407 19:05:46 -- target/tls.sh@52 -- # gzip -1 -c 00:17:25.407 19:05:46 -- target/tls.sh@52 -- # tail -c8 00:17:25.407 19:05:46 -- target/tls.sh@52 -- # head -c 4 00:17:25.407 19:05:46 -- target/tls.sh@52 -- # crc='p$H�' 00:17:25.407 19:05:46 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:25.407 19:05:46 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:17:25.407 19:05:46 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:25.407 19:05:46 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:25.407 19:05:46 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:17:25.407 19:05:46 -- target/tls.sh@49 -- # local key hash crc 00:17:25.407 19:05:46 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:17:25.407 19:05:46 -- target/tls.sh@51 -- # hash=01 00:17:25.407 19:05:46 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:17:25.407 19:05:46 -- target/tls.sh@52 -- # gzip -1 -c 00:17:25.407 19:05:46 -- target/tls.sh@52 -- # tail -c8 00:17:25.407 19:05:46 -- target/tls.sh@52 -- # head -c 4 00:17:25.407 19:05:46 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:17:25.407 19:05:46 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:25.407 19:05:46 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:17:25.407 19:05:46 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:25.407 19:05:46 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:25.407 19:05:46 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:25.407 19:05:46 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:25.407 19:05:46 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:17:25.407 19:05:46 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:17:25.407 19:05:46 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:25.407 19:05:46 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:25.407 19:05:46 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:17:25.974 19:05:46 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:17:26.232 19:05:47 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:26.232 19:05:47 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:26.232 19:05:47 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:26.490 [2024-11-28 19:05:47.376785] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:26.490 19:05:47 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:26.748 19:05:47 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:27.007 [2024-11-28 19:05:47.930306] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:27.007 [2024-11-28 19:05:47.930587] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:27.007 19:05:47 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:27.265 malloc0 00:17:27.265 19:05:48 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:27.524 19:05:48 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:27.783 19:05:48 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:28.041 EAL: No free 2048 kB hugepages reported on node 1 00:17:38.014 Initializing NVMe Controllers 00:17:38.014 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:17:38.014 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:17:38.014 Initialization complete. Launching workers. 00:17:38.014 ======================================================== 00:17:38.014 Latency(us) 00:17:38.014 Device Information : IOPS MiB/s Average min max 00:17:38.014 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7698.20 30.07 8316.33 1345.36 9404.00 00:17:38.014 ======================================================== 00:17:38.014 Total : 7698.20 30.07 8316.33 1345.36 9404.00 00:17:38.014 00:17:38.014 19:05:58 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:38.014 19:05:58 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:38.014 19:05:58 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:38.014 19:05:58 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:38.014 19:05:58 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:38.014 19:05:58 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:38.014 19:05:58 -- target/tls.sh@28 -- # bdevperf_pid=221765 00:17:38.014 19:05:58 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:38.014 19:05:58 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:38.014 19:05:58 -- target/tls.sh@31 -- # waitforlisten 221765 /var/tmp/bdevperf.sock 00:17:38.014 19:05:58 -- common/autotest_common.sh@829 -- # '[' -z 221765 ']' 00:17:38.014 19:05:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:38.014 19:05:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:38.014 19:05:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:38.014 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:38.014 19:05:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:38.014 19:05:58 -- common/autotest_common.sh@10 -- # set +x 00:17:38.014 [2024-11-28 19:05:58.971621] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:38.015 [2024-11-28 19:05:58.971696] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid221765 ] 00:17:38.015 EAL: No free 2048 kB hugepages reported on node 1 00:17:38.015 [2024-11-28 19:05:59.028332] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:38.273 [2024-11-28 19:05:59.132579] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:39.222 19:05:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:39.222 19:05:59 -- common/autotest_common.sh@862 -- # return 0 00:17:39.222 19:05:59 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:39.222 [2024-11-28 19:06:00.197835] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:39.480 TLSTESTn1 00:17:39.480 19:06:00 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:17:39.480 Running I/O for 10 seconds... 00:17:49.452 00:17:49.452 Latency(us) 00:17:49.452 [2024-11-28T18:06:10.500Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:49.452 [2024-11-28T18:06:10.500Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:17:49.452 Verification LBA range: start 0x0 length 0x2000 00:17:49.452 TLSTESTn1 : 10.01 4195.60 16.39 0.00 0.00 30477.42 2560.76 47768.46 00:17:49.452 [2024-11-28T18:06:10.500Z] =================================================================================================================== 00:17:49.452 [2024-11-28T18:06:10.500Z] Total : 4195.60 16.39 0.00 0.00 30477.42 2560.76 47768.46 00:17:49.452 0 00:17:49.452 19:06:10 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:49.452 19:06:10 -- target/tls.sh@45 -- # killprocess 221765 00:17:49.452 19:06:10 -- common/autotest_common.sh@936 -- # '[' -z 221765 ']' 00:17:49.452 19:06:10 -- common/autotest_common.sh@940 -- # kill -0 221765 00:17:49.452 19:06:10 -- common/autotest_common.sh@941 -- # uname 00:17:49.452 19:06:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:49.452 19:06:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 221765 00:17:49.452 19:06:10 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:49.452 19:06:10 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:49.452 19:06:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 221765' 00:17:49.452 killing process with pid 221765 00:17:49.452 19:06:10 -- common/autotest_common.sh@955 -- # kill 221765 00:17:49.452 Received shutdown signal, test time was about 10.000000 seconds 00:17:49.452 00:17:49.452 Latency(us) 00:17:49.452 [2024-11-28T18:06:10.500Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:49.452 [2024-11-28T18:06:10.500Z] =================================================================================================================== 00:17:49.452 [2024-11-28T18:06:10.500Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:49.452 19:06:10 -- common/autotest_common.sh@960 -- # wait 221765 00:17:49.709 19:06:10 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:49.709 19:06:10 -- common/autotest_common.sh@650 -- # local es=0 00:17:49.710 19:06:10 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:49.710 19:06:10 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:49.710 19:06:10 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:49.710 19:06:10 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:49.968 19:06:10 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:49.968 19:06:10 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:49.968 19:06:10 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:49.968 19:06:10 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:49.968 19:06:10 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:49.968 19:06:10 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:17:49.968 19:06:10 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:49.968 19:06:10 -- target/tls.sh@28 -- # bdevperf_pid=223837 00:17:49.968 19:06:10 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:49.968 19:06:10 -- target/tls.sh@31 -- # waitforlisten 223837 /var/tmp/bdevperf.sock 00:17:49.968 19:06:10 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:49.968 19:06:10 -- common/autotest_common.sh@829 -- # '[' -z 223837 ']' 00:17:49.968 19:06:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:49.968 19:06:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:49.968 19:06:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:49.968 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:49.968 19:06:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:49.968 19:06:10 -- common/autotest_common.sh@10 -- # set +x 00:17:49.968 [2024-11-28 19:06:10.803679] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:49.968 [2024-11-28 19:06:10.803781] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid223837 ] 00:17:49.968 EAL: No free 2048 kB hugepages reported on node 1 00:17:49.968 [2024-11-28 19:06:10.864888] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:49.968 [2024-11-28 19:06:10.970484] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:50.904 19:06:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:50.904 19:06:11 -- common/autotest_common.sh@862 -- # return 0 00:17:50.904 19:06:11 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:17:51.162 [2024-11-28 19:06:12.061754] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:51.162 [2024-11-28 19:06:12.070150] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:51.162 [2024-11-28 19:06:12.070635] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd571f0 (107): Transport endpoint is not connected 00:17:51.162 [2024-11-28 19:06:12.071621] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd571f0 (9): Bad file descriptor 00:17:51.162 [2024-11-28 19:06:12.072619] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:51.162 [2024-11-28 19:06:12.072644] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:51.162 [2024-11-28 19:06:12.072666] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:51.162 request: 00:17:51.162 { 00:17:51.162 "name": "TLSTEST", 00:17:51.162 "trtype": "tcp", 00:17:51.162 "traddr": "10.0.0.2", 00:17:51.162 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:51.162 "adrfam": "ipv4", 00:17:51.162 "trsvcid": "4420", 00:17:51.162 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:51.162 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:17:51.162 "method": "bdev_nvme_attach_controller", 00:17:51.162 "req_id": 1 00:17:51.162 } 00:17:51.162 Got JSON-RPC error response 00:17:51.162 response: 00:17:51.162 { 00:17:51.162 "code": -32602, 00:17:51.162 "message": "Invalid parameters" 00:17:51.162 } 00:17:51.162 19:06:12 -- target/tls.sh@36 -- # killprocess 223837 00:17:51.162 19:06:12 -- common/autotest_common.sh@936 -- # '[' -z 223837 ']' 00:17:51.162 19:06:12 -- common/autotest_common.sh@940 -- # kill -0 223837 00:17:51.162 19:06:12 -- common/autotest_common.sh@941 -- # uname 00:17:51.162 19:06:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:51.162 19:06:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 223837 00:17:51.162 19:06:12 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:51.162 19:06:12 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:51.162 19:06:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 223837' 00:17:51.162 killing process with pid 223837 00:17:51.162 19:06:12 -- common/autotest_common.sh@955 -- # kill 223837 00:17:51.162 Received shutdown signal, test time was about 10.000000 seconds 00:17:51.162 00:17:51.162 Latency(us) 00:17:51.162 [2024-11-28T18:06:12.210Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:51.162 [2024-11-28T18:06:12.210Z] =================================================================================================================== 00:17:51.162 [2024-11-28T18:06:12.210Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:51.162 19:06:12 -- common/autotest_common.sh@960 -- # wait 223837 00:17:51.421 19:06:12 -- target/tls.sh@37 -- # return 1 00:17:51.421 19:06:12 -- common/autotest_common.sh@653 -- # es=1 00:17:51.421 19:06:12 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:51.421 19:06:12 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:51.421 19:06:12 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:51.421 19:06:12 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:51.421 19:06:12 -- common/autotest_common.sh@650 -- # local es=0 00:17:51.421 19:06:12 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:51.421 19:06:12 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:51.421 19:06:12 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:51.421 19:06:12 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:51.421 19:06:12 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:51.421 19:06:12 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:51.421 19:06:12 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:51.421 19:06:12 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:51.421 19:06:12 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:17:51.421 19:06:12 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:51.421 19:06:12 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:51.421 19:06:12 -- target/tls.sh@28 -- # bdevperf_pid=224022 00:17:51.421 19:06:12 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:51.421 19:06:12 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:51.421 19:06:12 -- target/tls.sh@31 -- # waitforlisten 224022 /var/tmp/bdevperf.sock 00:17:51.421 19:06:12 -- common/autotest_common.sh@829 -- # '[' -z 224022 ']' 00:17:51.421 19:06:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:51.421 19:06:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:51.421 19:06:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:51.421 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:51.421 19:06:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:51.421 19:06:12 -- common/autotest_common.sh@10 -- # set +x 00:17:51.421 [2024-11-28 19:06:12.422877] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:51.421 [2024-11-28 19:06:12.422953] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid224022 ] 00:17:51.421 EAL: No free 2048 kB hugepages reported on node 1 00:17:51.679 [2024-11-28 19:06:12.482997] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:51.679 [2024-11-28 19:06:12.590073] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:52.612 19:06:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:52.612 19:06:13 -- common/autotest_common.sh@862 -- # return 0 00:17:52.612 19:06:13 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:52.872 [2024-11-28 19:06:13.704081] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:52.872 [2024-11-28 19:06:13.714182] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:52.872 [2024-11-28 19:06:13.714210] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:17:52.872 [2024-11-28 19:06:13.714262] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:52.872 [2024-11-28 19:06:13.714941] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10261f0 (107): Transport endpoint is not connected 00:17:52.872 [2024-11-28 19:06:13.715925] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x10261f0 (9): Bad file descriptor 00:17:52.872 [2024-11-28 19:06:13.716924] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:52.872 [2024-11-28 19:06:13.716947] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:52.872 [2024-11-28 19:06:13.716967] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:52.872 request: 00:17:52.872 { 00:17:52.872 "name": "TLSTEST", 00:17:52.872 "trtype": "tcp", 00:17:52.872 "traddr": "10.0.0.2", 00:17:52.872 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:17:52.872 "adrfam": "ipv4", 00:17:52.872 "trsvcid": "4420", 00:17:52.872 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:52.872 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:52.872 "method": "bdev_nvme_attach_controller", 00:17:52.872 "req_id": 1 00:17:52.872 } 00:17:52.872 Got JSON-RPC error response 00:17:52.872 response: 00:17:52.872 { 00:17:52.872 "code": -32602, 00:17:52.872 "message": "Invalid parameters" 00:17:52.872 } 00:17:52.872 19:06:13 -- target/tls.sh@36 -- # killprocess 224022 00:17:52.872 19:06:13 -- common/autotest_common.sh@936 -- # '[' -z 224022 ']' 00:17:52.872 19:06:13 -- common/autotest_common.sh@940 -- # kill -0 224022 00:17:52.872 19:06:13 -- common/autotest_common.sh@941 -- # uname 00:17:52.872 19:06:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:52.872 19:06:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 224022 00:17:52.872 19:06:13 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:52.872 19:06:13 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:52.872 19:06:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 224022' 00:17:52.872 killing process with pid 224022 00:17:52.872 19:06:13 -- common/autotest_common.sh@955 -- # kill 224022 00:17:52.872 Received shutdown signal, test time was about 10.000000 seconds 00:17:52.872 00:17:52.872 Latency(us) 00:17:52.872 [2024-11-28T18:06:13.920Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:52.872 [2024-11-28T18:06:13.920Z] =================================================================================================================== 00:17:52.872 [2024-11-28T18:06:13.920Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:52.872 19:06:13 -- common/autotest_common.sh@960 -- # wait 224022 00:17:53.131 19:06:14 -- target/tls.sh@37 -- # return 1 00:17:53.131 19:06:14 -- common/autotest_common.sh@653 -- # es=1 00:17:53.131 19:06:14 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:53.131 19:06:14 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:53.131 19:06:14 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:53.131 19:06:14 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:53.131 19:06:14 -- common/autotest_common.sh@650 -- # local es=0 00:17:53.131 19:06:14 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:53.131 19:06:14 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:53.131 19:06:14 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:53.131 19:06:14 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:53.131 19:06:14 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:53.131 19:06:14 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:53.131 19:06:14 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:53.131 19:06:14 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:17:53.131 19:06:14 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:53.131 19:06:14 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:17:53.131 19:06:14 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:53.131 19:06:14 -- target/tls.sh@28 -- # bdevperf_pid=224175 00:17:53.131 19:06:14 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:53.131 19:06:14 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:53.131 19:06:14 -- target/tls.sh@31 -- # waitforlisten 224175 /var/tmp/bdevperf.sock 00:17:53.131 19:06:14 -- common/autotest_common.sh@829 -- # '[' -z 224175 ']' 00:17:53.131 19:06:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:53.131 19:06:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:53.131 19:06:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:53.131 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:53.131 19:06:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:53.131 19:06:14 -- common/autotest_common.sh@10 -- # set +x 00:17:53.131 [2024-11-28 19:06:14.047998] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:53.131 [2024-11-28 19:06:14.048075] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid224175 ] 00:17:53.131 EAL: No free 2048 kB hugepages reported on node 1 00:17:53.131 [2024-11-28 19:06:14.110299] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:53.390 [2024-11-28 19:06:14.218824] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:54.319 19:06:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:54.319 19:06:15 -- common/autotest_common.sh@862 -- # return 0 00:17:54.319 19:06:15 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:17:54.577 [2024-11-28 19:06:15.369032] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:17:54.577 [2024-11-28 19:06:15.378519] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:54.577 [2024-11-28 19:06:15.378551] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:17:54.577 [2024-11-28 19:06:15.378605] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:54.577 [2024-11-28 19:06:15.378962] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x8741f0 (107): Transport endpoint is not connected 00:17:54.577 [2024-11-28 19:06:15.379929] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x8741f0 (9): Bad file descriptor 00:17:54.577 [2024-11-28 19:06:15.380927] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:17:54.577 [2024-11-28 19:06:15.380950] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:54.577 [2024-11-28 19:06:15.380971] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:17:54.577 request: 00:17:54.577 { 00:17:54.577 "name": "TLSTEST", 00:17:54.577 "trtype": "tcp", 00:17:54.577 "traddr": "10.0.0.2", 00:17:54.577 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:54.577 "adrfam": "ipv4", 00:17:54.577 "trsvcid": "4420", 00:17:54.577 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:17:54.577 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:17:54.577 "method": "bdev_nvme_attach_controller", 00:17:54.577 "req_id": 1 00:17:54.577 } 00:17:54.577 Got JSON-RPC error response 00:17:54.577 response: 00:17:54.577 { 00:17:54.577 "code": -32602, 00:17:54.577 "message": "Invalid parameters" 00:17:54.577 } 00:17:54.577 19:06:15 -- target/tls.sh@36 -- # killprocess 224175 00:17:54.577 19:06:15 -- common/autotest_common.sh@936 -- # '[' -z 224175 ']' 00:17:54.577 19:06:15 -- common/autotest_common.sh@940 -- # kill -0 224175 00:17:54.577 19:06:15 -- common/autotest_common.sh@941 -- # uname 00:17:54.577 19:06:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:54.577 19:06:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 224175 00:17:54.577 19:06:15 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:54.577 19:06:15 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:54.577 19:06:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 224175' 00:17:54.577 killing process with pid 224175 00:17:54.577 19:06:15 -- common/autotest_common.sh@955 -- # kill 224175 00:17:54.577 Received shutdown signal, test time was about 10.000000 seconds 00:17:54.577 00:17:54.577 Latency(us) 00:17:54.577 [2024-11-28T18:06:15.625Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:54.577 [2024-11-28T18:06:15.625Z] =================================================================================================================== 00:17:54.577 [2024-11-28T18:06:15.625Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:54.577 19:06:15 -- common/autotest_common.sh@960 -- # wait 224175 00:17:54.835 19:06:15 -- target/tls.sh@37 -- # return 1 00:17:54.835 19:06:15 -- common/autotest_common.sh@653 -- # es=1 00:17:54.835 19:06:15 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:54.835 19:06:15 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:54.835 19:06:15 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:54.835 19:06:15 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:54.835 19:06:15 -- common/autotest_common.sh@650 -- # local es=0 00:17:54.835 19:06:15 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:54.835 19:06:15 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:17:54.835 19:06:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:54.835 19:06:15 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:17:54.835 19:06:15 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:54.835 19:06:15 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:17:54.835 19:06:15 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:54.835 19:06:15 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:54.835 19:06:15 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:54.835 19:06:15 -- target/tls.sh@23 -- # psk= 00:17:54.835 19:06:15 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:54.835 19:06:15 -- target/tls.sh@28 -- # bdevperf_pid=224449 00:17:54.835 19:06:15 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:54.835 19:06:15 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:54.835 19:06:15 -- target/tls.sh@31 -- # waitforlisten 224449 /var/tmp/bdevperf.sock 00:17:54.835 19:06:15 -- common/autotest_common.sh@829 -- # '[' -z 224449 ']' 00:17:54.835 19:06:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:54.835 19:06:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:54.835 19:06:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:54.835 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:54.835 19:06:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:54.835 19:06:15 -- common/autotest_common.sh@10 -- # set +x 00:17:54.835 [2024-11-28 19:06:15.749944] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:54.835 [2024-11-28 19:06:15.750018] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid224449 ] 00:17:54.835 EAL: No free 2048 kB hugepages reported on node 1 00:17:54.835 [2024-11-28 19:06:15.808103] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:55.092 [2024-11-28 19:06:15.916645] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:56.025 19:06:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:56.025 19:06:16 -- common/autotest_common.sh@862 -- # return 0 00:17:56.025 19:06:16 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:17:56.025 [2024-11-28 19:06:17.032932] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:17:56.025 [2024-11-28 19:06:17.034717] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd77050 (9): Bad file descriptor 00:17:56.025 [2024-11-28 19:06:17.035717] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:17:56.025 [2024-11-28 19:06:17.035742] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:17:56.025 [2024-11-28 19:06:17.035764] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:17:56.025 request: 00:17:56.025 { 00:17:56.025 "name": "TLSTEST", 00:17:56.025 "trtype": "tcp", 00:17:56.025 "traddr": "10.0.0.2", 00:17:56.025 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:56.025 "adrfam": "ipv4", 00:17:56.025 "trsvcid": "4420", 00:17:56.025 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:56.025 "method": "bdev_nvme_attach_controller", 00:17:56.025 "req_id": 1 00:17:56.025 } 00:17:56.025 Got JSON-RPC error response 00:17:56.025 response: 00:17:56.025 { 00:17:56.025 "code": -32602, 00:17:56.025 "message": "Invalid parameters" 00:17:56.025 } 00:17:56.025 19:06:17 -- target/tls.sh@36 -- # killprocess 224449 00:17:56.025 19:06:17 -- common/autotest_common.sh@936 -- # '[' -z 224449 ']' 00:17:56.025 19:06:17 -- common/autotest_common.sh@940 -- # kill -0 224449 00:17:56.025 19:06:17 -- common/autotest_common.sh@941 -- # uname 00:17:56.025 19:06:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:56.025 19:06:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 224449 00:17:56.283 19:06:17 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:17:56.283 19:06:17 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:17:56.283 19:06:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 224449' 00:17:56.283 killing process with pid 224449 00:17:56.283 19:06:17 -- common/autotest_common.sh@955 -- # kill 224449 00:17:56.283 Received shutdown signal, test time was about 10.000000 seconds 00:17:56.283 00:17:56.283 Latency(us) 00:17:56.283 [2024-11-28T18:06:17.331Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:56.283 [2024-11-28T18:06:17.331Z] =================================================================================================================== 00:17:56.283 [2024-11-28T18:06:17.331Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:17:56.283 19:06:17 -- common/autotest_common.sh@960 -- # wait 224449 00:17:56.541 19:06:17 -- target/tls.sh@37 -- # return 1 00:17:56.541 19:06:17 -- common/autotest_common.sh@653 -- # es=1 00:17:56.541 19:06:17 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:56.541 19:06:17 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:56.541 19:06:17 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:56.541 19:06:17 -- target/tls.sh@167 -- # killprocess 219798 00:17:56.541 19:06:17 -- common/autotest_common.sh@936 -- # '[' -z 219798 ']' 00:17:56.541 19:06:17 -- common/autotest_common.sh@940 -- # kill -0 219798 00:17:56.541 19:06:17 -- common/autotest_common.sh@941 -- # uname 00:17:56.541 19:06:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:56.541 19:06:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 219798 00:17:56.541 19:06:17 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:56.541 19:06:17 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:56.541 19:06:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 219798' 00:17:56.541 killing process with pid 219798 00:17:56.541 19:06:17 -- common/autotest_common.sh@955 -- # kill 219798 00:17:56.541 19:06:17 -- common/autotest_common.sh@960 -- # wait 219798 00:17:56.800 19:06:17 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:17:56.800 19:06:17 -- target/tls.sh@49 -- # local key hash crc 00:17:56.800 19:06:17 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:17:56.800 19:06:17 -- target/tls.sh@51 -- # hash=02 00:17:56.800 19:06:17 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:17:56.800 19:06:17 -- target/tls.sh@52 -- # gzip -1 -c 00:17:56.800 19:06:17 -- target/tls.sh@52 -- # tail -c8 00:17:56.800 19:06:17 -- target/tls.sh@52 -- # head -c 4 00:17:56.800 19:06:17 -- target/tls.sh@52 -- # crc='�e�'\''' 00:17:56.800 19:06:17 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:17:56.800 19:06:17 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:17:56.800 19:06:17 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:56.800 19:06:17 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:56.800 19:06:17 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:56.800 19:06:17 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:17:56.800 19:06:17 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:56.800 19:06:17 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:17:56.800 19:06:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:56.800 19:06:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:56.800 19:06:17 -- common/autotest_common.sh@10 -- # set +x 00:17:56.800 19:06:17 -- nvmf/common.sh@469 -- # nvmfpid=224741 00:17:56.800 19:06:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:17:56.800 19:06:17 -- nvmf/common.sh@470 -- # waitforlisten 224741 00:17:56.800 19:06:17 -- common/autotest_common.sh@829 -- # '[' -z 224741 ']' 00:17:56.800 19:06:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:56.800 19:06:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:56.800 19:06:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:56.800 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:56.800 19:06:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:56.800 19:06:17 -- common/autotest_common.sh@10 -- # set +x 00:17:56.800 [2024-11-28 19:06:17.740554] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:56.800 [2024-11-28 19:06:17.740647] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:56.800 EAL: No free 2048 kB hugepages reported on node 1 00:17:56.800 [2024-11-28 19:06:17.805198] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:57.059 [2024-11-28 19:06:17.913988] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:57.059 [2024-11-28 19:06:17.914151] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:57.059 [2024-11-28 19:06:17.914167] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:57.059 [2024-11-28 19:06:17.914180] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:57.060 [2024-11-28 19:06:17.914215] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:57.995 19:06:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:57.995 19:06:18 -- common/autotest_common.sh@862 -- # return 0 00:17:57.995 19:06:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:57.995 19:06:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:57.995 19:06:18 -- common/autotest_common.sh@10 -- # set +x 00:17:57.995 19:06:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:57.995 19:06:18 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:57.995 19:06:18 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:57.996 19:06:18 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:17:57.996 [2024-11-28 19:06:18.965311] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:57.996 19:06:18 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:17:58.254 19:06:19 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:17:58.821 [2024-11-28 19:06:19.562976] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:17:58.821 [2024-11-28 19:06:19.563220] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:58.821 19:06:19 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:17:59.079 malloc0 00:17:59.079 19:06:19 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:17:59.337 19:06:20 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:59.596 19:06:20 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:17:59.596 19:06:20 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:17:59.596 19:06:20 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:17:59.596 19:06:20 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:17:59.596 19:06:20 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:17:59.596 19:06:20 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:59.596 19:06:20 -- target/tls.sh@28 -- # bdevperf_pid=225050 00:17:59.596 19:06:20 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:17:59.596 19:06:20 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:17:59.596 19:06:20 -- target/tls.sh@31 -- # waitforlisten 225050 /var/tmp/bdevperf.sock 00:17:59.596 19:06:20 -- common/autotest_common.sh@829 -- # '[' -z 225050 ']' 00:17:59.596 19:06:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:59.596 19:06:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:59.596 19:06:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:59.596 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:59.596 19:06:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:59.596 19:06:20 -- common/autotest_common.sh@10 -- # set +x 00:17:59.596 [2024-11-28 19:06:20.498036] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:59.596 [2024-11-28 19:06:20.498125] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid225050 ] 00:17:59.596 EAL: No free 2048 kB hugepages reported on node 1 00:17:59.596 [2024-11-28 19:06:20.560019] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:59.855 [2024-11-28 19:06:20.672176] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:00.791 19:06:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:00.791 19:06:21 -- common/autotest_common.sh@862 -- # return 0 00:18:00.791 19:06:21 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:00.791 [2024-11-28 19:06:21.768916] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:01.049 TLSTESTn1 00:18:01.049 19:06:21 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:18:01.049 Running I/O for 10 seconds... 00:18:11.016 00:18:11.016 Latency(us) 00:18:11.016 [2024-11-28T18:06:32.064Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:11.016 [2024-11-28T18:06:32.064Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:11.016 Verification LBA range: start 0x0 length 0x2000 00:18:11.016 TLSTESTn1 : 10.03 3610.22 14.10 0.00 0.00 35398.93 7475.96 80002.47 00:18:11.016 [2024-11-28T18:06:32.064Z] =================================================================================================================== 00:18:11.016 [2024-11-28T18:06:32.064Z] Total : 3610.22 14.10 0.00 0.00 35398.93 7475.96 80002.47 00:18:11.016 0 00:18:11.016 19:06:32 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:11.016 19:06:32 -- target/tls.sh@45 -- # killprocess 225050 00:18:11.016 19:06:32 -- common/autotest_common.sh@936 -- # '[' -z 225050 ']' 00:18:11.016 19:06:32 -- common/autotest_common.sh@940 -- # kill -0 225050 00:18:11.016 19:06:32 -- common/autotest_common.sh@941 -- # uname 00:18:11.016 19:06:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:11.016 19:06:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 225050 00:18:11.274 19:06:32 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:11.274 19:06:32 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:11.274 19:06:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 225050' 00:18:11.274 killing process with pid 225050 00:18:11.274 19:06:32 -- common/autotest_common.sh@955 -- # kill 225050 00:18:11.274 Received shutdown signal, test time was about 10.000000 seconds 00:18:11.274 00:18:11.274 Latency(us) 00:18:11.274 [2024-11-28T18:06:32.322Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:11.274 [2024-11-28T18:06:32.322Z] =================================================================================================================== 00:18:11.274 [2024-11-28T18:06:32.322Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:11.274 19:06:32 -- common/autotest_common.sh@960 -- # wait 225050 00:18:11.531 19:06:32 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:11.532 19:06:32 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:11.532 19:06:32 -- common/autotest_common.sh@650 -- # local es=0 00:18:11.532 19:06:32 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:11.532 19:06:32 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:18:11.532 19:06:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:11.532 19:06:32 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:18:11.532 19:06:32 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:11.532 19:06:32 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:11.532 19:06:32 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:18:11.532 19:06:32 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:18:11.532 19:06:32 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:18:11.532 19:06:32 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:18:11.532 19:06:32 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:11.532 19:06:32 -- target/tls.sh@28 -- # bdevperf_pid=226495 00:18:11.532 19:06:32 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:11.532 19:06:32 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:11.532 19:06:32 -- target/tls.sh@31 -- # waitforlisten 226495 /var/tmp/bdevperf.sock 00:18:11.532 19:06:32 -- common/autotest_common.sh@829 -- # '[' -z 226495 ']' 00:18:11.532 19:06:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:11.532 19:06:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:11.532 19:06:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:11.532 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:11.532 19:06:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:11.532 19:06:32 -- common/autotest_common.sh@10 -- # set +x 00:18:11.532 [2024-11-28 19:06:32.395102] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:11.532 [2024-11-28 19:06:32.395177] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid226495 ] 00:18:11.532 EAL: No free 2048 kB hugepages reported on node 1 00:18:11.532 [2024-11-28 19:06:32.453174] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:11.532 [2024-11-28 19:06:32.557972] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:12.466 19:06:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:12.466 19:06:33 -- common/autotest_common.sh@862 -- # return 0 00:18:12.466 19:06:33 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:12.724 [2024-11-28 19:06:33.598924] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:12.724 [2024-11-28 19:06:33.598979] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:18:12.724 request: 00:18:12.724 { 00:18:12.724 "name": "TLSTEST", 00:18:12.724 "trtype": "tcp", 00:18:12.724 "traddr": "10.0.0.2", 00:18:12.724 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:12.724 "adrfam": "ipv4", 00:18:12.724 "trsvcid": "4420", 00:18:12.724 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:12.724 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:12.724 "method": "bdev_nvme_attach_controller", 00:18:12.724 "req_id": 1 00:18:12.724 } 00:18:12.724 Got JSON-RPC error response 00:18:12.724 response: 00:18:12.724 { 00:18:12.724 "code": -22, 00:18:12.724 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:12.724 } 00:18:12.724 19:06:33 -- target/tls.sh@36 -- # killprocess 226495 00:18:12.724 19:06:33 -- common/autotest_common.sh@936 -- # '[' -z 226495 ']' 00:18:12.724 19:06:33 -- common/autotest_common.sh@940 -- # kill -0 226495 00:18:12.724 19:06:33 -- common/autotest_common.sh@941 -- # uname 00:18:12.724 19:06:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:12.724 19:06:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 226495 00:18:12.724 19:06:33 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:12.724 19:06:33 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:12.724 19:06:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 226495' 00:18:12.724 killing process with pid 226495 00:18:12.724 19:06:33 -- common/autotest_common.sh@955 -- # kill 226495 00:18:12.724 Received shutdown signal, test time was about 10.000000 seconds 00:18:12.724 00:18:12.724 Latency(us) 00:18:12.724 [2024-11-28T18:06:33.772Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:12.724 [2024-11-28T18:06:33.772Z] =================================================================================================================== 00:18:12.724 [2024-11-28T18:06:33.772Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:18:12.724 19:06:33 -- common/autotest_common.sh@960 -- # wait 226495 00:18:12.981 19:06:33 -- target/tls.sh@37 -- # return 1 00:18:12.981 19:06:33 -- common/autotest_common.sh@653 -- # es=1 00:18:12.981 19:06:33 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:12.981 19:06:33 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:12.981 19:06:33 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:12.981 19:06:33 -- target/tls.sh@183 -- # killprocess 224741 00:18:12.981 19:06:33 -- common/autotest_common.sh@936 -- # '[' -z 224741 ']' 00:18:12.981 19:06:33 -- common/autotest_common.sh@940 -- # kill -0 224741 00:18:12.981 19:06:33 -- common/autotest_common.sh@941 -- # uname 00:18:12.981 19:06:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:12.981 19:06:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 224741 00:18:12.981 19:06:33 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:12.981 19:06:33 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:12.981 19:06:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 224741' 00:18:12.981 killing process with pid 224741 00:18:12.981 19:06:33 -- common/autotest_common.sh@955 -- # kill 224741 00:18:12.981 19:06:33 -- common/autotest_common.sh@960 -- # wait 224741 00:18:13.238 19:06:34 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:18:13.238 19:06:34 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:13.238 19:06:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:13.238 19:06:34 -- common/autotest_common.sh@10 -- # set +x 00:18:13.238 19:06:34 -- nvmf/common.sh@469 -- # nvmfpid=226701 00:18:13.238 19:06:34 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:13.238 19:06:34 -- nvmf/common.sh@470 -- # waitforlisten 226701 00:18:13.238 19:06:34 -- common/autotest_common.sh@829 -- # '[' -z 226701 ']' 00:18:13.238 19:06:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:13.238 19:06:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:13.238 19:06:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:13.238 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:13.238 19:06:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:13.238 19:06:34 -- common/autotest_common.sh@10 -- # set +x 00:18:13.497 [2024-11-28 19:06:34.295425] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:13.497 [2024-11-28 19:06:34.295499] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:13.497 EAL: No free 2048 kB hugepages reported on node 1 00:18:13.497 [2024-11-28 19:06:34.361468] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:13.497 [2024-11-28 19:06:34.477345] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:13.497 [2024-11-28 19:06:34.477525] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:13.497 [2024-11-28 19:06:34.477544] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:13.497 [2024-11-28 19:06:34.477557] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:13.497 [2024-11-28 19:06:34.477590] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:14.431 19:06:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:14.431 19:06:35 -- common/autotest_common.sh@862 -- # return 0 00:18:14.431 19:06:35 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:14.431 19:06:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:14.431 19:06:35 -- common/autotest_common.sh@10 -- # set +x 00:18:14.431 19:06:35 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:14.431 19:06:35 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:14.431 19:06:35 -- common/autotest_common.sh@650 -- # local es=0 00:18:14.431 19:06:35 -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:14.431 19:06:35 -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:18:14.431 19:06:35 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:14.431 19:06:35 -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:18:14.431 19:06:35 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:14.431 19:06:35 -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:14.431 19:06:35 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:14.431 19:06:35 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:18:14.689 [2024-11-28 19:06:35.605736] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:14.689 19:06:35 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:18:14.947 19:06:35 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:18:15.205 [2024-11-28 19:06:36.167256] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:15.205 [2024-11-28 19:06:36.167554] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:15.205 19:06:36 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:18:15.462 malloc0 00:18:15.462 19:06:36 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:15.721 19:06:36 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:15.980 [2024-11-28 19:06:36.981468] tcp.c:3551:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:18:15.980 [2024-11-28 19:06:36.981519] tcp.c:3620:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:18:15.980 [2024-11-28 19:06:36.981556] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:18:15.980 request: 00:18:15.980 { 00:18:15.980 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:15.980 "host": "nqn.2016-06.io.spdk:host1", 00:18:15.980 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:15.980 "method": "nvmf_subsystem_add_host", 00:18:15.980 "req_id": 1 00:18:15.980 } 00:18:15.980 Got JSON-RPC error response 00:18:15.980 response: 00:18:15.980 { 00:18:15.980 "code": -32603, 00:18:15.980 "message": "Internal error" 00:18:15.980 } 00:18:15.980 19:06:36 -- common/autotest_common.sh@653 -- # es=1 00:18:15.980 19:06:36 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:15.980 19:06:36 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:15.980 19:06:36 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:15.980 19:06:36 -- target/tls.sh@189 -- # killprocess 226701 00:18:15.980 19:06:36 -- common/autotest_common.sh@936 -- # '[' -z 226701 ']' 00:18:15.980 19:06:36 -- common/autotest_common.sh@940 -- # kill -0 226701 00:18:15.980 19:06:36 -- common/autotest_common.sh@941 -- # uname 00:18:15.980 19:06:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:15.980 19:06:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 226701 00:18:16.240 19:06:37 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:16.240 19:06:37 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:16.240 19:06:37 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 226701' 00:18:16.240 killing process with pid 226701 00:18:16.240 19:06:37 -- common/autotest_common.sh@955 -- # kill 226701 00:18:16.240 19:06:37 -- common/autotest_common.sh@960 -- # wait 226701 00:18:16.498 19:06:37 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:16.498 19:06:37 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:18:16.498 19:06:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:16.498 19:06:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:16.498 19:06:37 -- common/autotest_common.sh@10 -- # set +x 00:18:16.498 19:06:37 -- nvmf/common.sh@469 -- # nvmfpid=227134 00:18:16.498 19:06:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:16.498 19:06:37 -- nvmf/common.sh@470 -- # waitforlisten 227134 00:18:16.498 19:06:37 -- common/autotest_common.sh@829 -- # '[' -z 227134 ']' 00:18:16.498 19:06:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:16.498 19:06:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:16.498 19:06:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:16.498 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:16.498 19:06:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:16.498 19:06:37 -- common/autotest_common.sh@10 -- # set +x 00:18:16.498 [2024-11-28 19:06:37.379204] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:16.498 [2024-11-28 19:06:37.379280] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:16.498 EAL: No free 2048 kB hugepages reported on node 1 00:18:16.498 [2024-11-28 19:06:37.445012] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:16.757 [2024-11-28 19:06:37.548615] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:16.757 [2024-11-28 19:06:37.548754] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:16.757 [2024-11-28 19:06:37.548771] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:16.757 [2024-11-28 19:06:37.548784] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:16.757 [2024-11-28 19:06:37.548812] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:17.325 19:06:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:17.325 19:06:38 -- common/autotest_common.sh@862 -- # return 0 00:18:17.325 19:06:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:17.325 19:06:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:17.325 19:06:38 -- common/autotest_common.sh@10 -- # set +x 00:18:17.325 19:06:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:17.325 19:06:38 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:17.325 19:06:38 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:17.325 19:06:38 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:18:17.892 [2024-11-28 19:06:38.650251] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:17.892 19:06:38 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:18:18.150 19:06:38 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:18:18.150 [2024-11-28 19:06:39.191772] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:18.150 [2024-11-28 19:06:39.191992] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:18.410 19:06:39 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:18:18.410 malloc0 00:18:18.669 19:06:39 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:18.669 19:06:39 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:18.929 19:06:39 -- target/tls.sh@197 -- # bdevperf_pid=227440 00:18:18.929 19:06:39 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:18.929 19:06:39 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:18.929 19:06:39 -- target/tls.sh@200 -- # waitforlisten 227440 /var/tmp/bdevperf.sock 00:18:18.929 19:06:39 -- common/autotest_common.sh@829 -- # '[' -z 227440 ']' 00:18:18.929 19:06:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:18.929 19:06:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:18.929 19:06:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:18.929 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:18.929 19:06:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:18.929 19:06:39 -- common/autotest_common.sh@10 -- # set +x 00:18:19.188 [2024-11-28 19:06:39.993301] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:19.188 [2024-11-28 19:06:39.993371] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid227440 ] 00:18:19.188 EAL: No free 2048 kB hugepages reported on node 1 00:18:19.188 [2024-11-28 19:06:40.055271] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:19.188 [2024-11-28 19:06:40.161770] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:20.124 19:06:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:20.124 19:06:40 -- common/autotest_common.sh@862 -- # return 0 00:18:20.124 19:06:40 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:20.382 [2024-11-28 19:06:41.202403] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:20.382 TLSTESTn1 00:18:20.382 19:06:41 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:18:20.640 19:06:41 -- target/tls.sh@205 -- # tgtconf='{ 00:18:20.640 "subsystems": [ 00:18:20.640 { 00:18:20.640 "subsystem": "iobuf", 00:18:20.640 "config": [ 00:18:20.640 { 00:18:20.640 "method": "iobuf_set_options", 00:18:20.640 "params": { 00:18:20.640 "small_pool_count": 8192, 00:18:20.640 "large_pool_count": 1024, 00:18:20.640 "small_bufsize": 8192, 00:18:20.640 "large_bufsize": 135168 00:18:20.640 } 00:18:20.640 } 00:18:20.640 ] 00:18:20.640 }, 00:18:20.640 { 00:18:20.640 "subsystem": "sock", 00:18:20.640 "config": [ 00:18:20.640 { 00:18:20.640 "method": "sock_impl_set_options", 00:18:20.640 "params": { 00:18:20.640 "impl_name": "posix", 00:18:20.640 "recv_buf_size": 2097152, 00:18:20.641 "send_buf_size": 2097152, 00:18:20.641 "enable_recv_pipe": true, 00:18:20.641 "enable_quickack": false, 00:18:20.641 "enable_placement_id": 0, 00:18:20.641 "enable_zerocopy_send_server": true, 00:18:20.641 "enable_zerocopy_send_client": false, 00:18:20.641 "zerocopy_threshold": 0, 00:18:20.641 "tls_version": 0, 00:18:20.641 "enable_ktls": false 00:18:20.641 } 00:18:20.641 }, 00:18:20.641 { 00:18:20.641 "method": "sock_impl_set_options", 00:18:20.641 "params": { 00:18:20.641 "impl_name": "ssl", 00:18:20.641 "recv_buf_size": 4096, 00:18:20.641 "send_buf_size": 4096, 00:18:20.641 "enable_recv_pipe": true, 00:18:20.641 "enable_quickack": false, 00:18:20.641 "enable_placement_id": 0, 00:18:20.641 "enable_zerocopy_send_server": true, 00:18:20.641 "enable_zerocopy_send_client": false, 00:18:20.641 "zerocopy_threshold": 0, 00:18:20.641 "tls_version": 0, 00:18:20.641 "enable_ktls": false 00:18:20.641 } 00:18:20.641 } 00:18:20.641 ] 00:18:20.641 }, 00:18:20.641 { 00:18:20.641 "subsystem": "vmd", 00:18:20.641 "config": [] 00:18:20.641 }, 00:18:20.641 { 00:18:20.641 "subsystem": "accel", 00:18:20.641 "config": [ 00:18:20.641 { 00:18:20.641 "method": "accel_set_options", 00:18:20.641 "params": { 00:18:20.641 "small_cache_size": 128, 00:18:20.641 "large_cache_size": 16, 00:18:20.641 "task_count": 2048, 00:18:20.641 "sequence_count": 2048, 00:18:20.641 "buf_count": 2048 00:18:20.641 } 00:18:20.641 } 00:18:20.641 ] 00:18:20.641 }, 00:18:20.641 { 00:18:20.641 "subsystem": "bdev", 00:18:20.641 "config": [ 00:18:20.641 { 00:18:20.641 "method": "bdev_set_options", 00:18:20.641 "params": { 00:18:20.641 "bdev_io_pool_size": 65535, 00:18:20.641 "bdev_io_cache_size": 256, 00:18:20.641 "bdev_auto_examine": true, 00:18:20.641 "iobuf_small_cache_size": 128, 00:18:20.641 "iobuf_large_cache_size": 16 00:18:20.641 } 00:18:20.641 }, 00:18:20.641 { 00:18:20.641 "method": "bdev_raid_set_options", 00:18:20.641 "params": { 00:18:20.641 "process_window_size_kb": 1024 00:18:20.641 } 00:18:20.641 }, 00:18:20.641 { 00:18:20.641 "method": "bdev_iscsi_set_options", 00:18:20.641 "params": { 00:18:20.641 "timeout_sec": 30 00:18:20.641 } 00:18:20.641 }, 00:18:20.641 { 00:18:20.641 "method": "bdev_nvme_set_options", 00:18:20.641 "params": { 00:18:20.641 "action_on_timeout": "none", 00:18:20.641 "timeout_us": 0, 00:18:20.641 "timeout_admin_us": 0, 00:18:20.641 "keep_alive_timeout_ms": 10000, 00:18:20.641 "transport_retry_count": 4, 00:18:20.641 "arbitration_burst": 0, 00:18:20.641 "low_priority_weight": 0, 00:18:20.641 "medium_priority_weight": 0, 00:18:20.641 "high_priority_weight": 0, 00:18:20.641 "nvme_adminq_poll_period_us": 10000, 00:18:20.641 "nvme_ioq_poll_period_us": 0, 00:18:20.641 "io_queue_requests": 0, 00:18:20.641 "delay_cmd_submit": true, 00:18:20.641 "bdev_retry_count": 3, 00:18:20.641 "transport_ack_timeout": 0, 00:18:20.641 "ctrlr_loss_timeout_sec": 0, 00:18:20.641 "reconnect_delay_sec": 0, 00:18:20.641 "fast_io_fail_timeout_sec": 0, 00:18:20.641 "generate_uuids": false, 00:18:20.641 "transport_tos": 0, 00:18:20.641 "io_path_stat": false, 00:18:20.641 "allow_accel_sequence": false 00:18:20.641 } 00:18:20.641 }, 00:18:20.641 { 00:18:20.641 "method": "bdev_nvme_set_hotplug", 00:18:20.641 "params": { 00:18:20.641 "period_us": 100000, 00:18:20.641 "enable": false 00:18:20.641 } 00:18:20.641 }, 00:18:20.641 { 00:18:20.641 "method": "bdev_malloc_create", 00:18:20.641 "params": { 00:18:20.641 "name": "malloc0", 00:18:20.641 "num_blocks": 8192, 00:18:20.641 "block_size": 4096, 00:18:20.641 "physical_block_size": 4096, 00:18:20.641 "uuid": "2cbc4025-a31a-4371-858e-9d75e7f62755", 00:18:20.641 "optimal_io_boundary": 0 00:18:20.641 } 00:18:20.641 }, 00:18:20.641 { 00:18:20.641 "method": "bdev_wait_for_examine" 00:18:20.641 } 00:18:20.641 ] 00:18:20.641 }, 00:18:20.641 { 00:18:20.641 "subsystem": "nbd", 00:18:20.641 "config": [] 00:18:20.641 }, 00:18:20.641 { 00:18:20.641 "subsystem": "scheduler", 00:18:20.641 "config": [ 00:18:20.641 { 00:18:20.641 "method": "framework_set_scheduler", 00:18:20.641 "params": { 00:18:20.641 "name": "static" 00:18:20.641 } 00:18:20.641 } 00:18:20.641 ] 00:18:20.641 }, 00:18:20.641 { 00:18:20.641 "subsystem": "nvmf", 00:18:20.641 "config": [ 00:18:20.641 { 00:18:20.641 "method": "nvmf_set_config", 00:18:20.641 "params": { 00:18:20.641 "discovery_filter": "match_any", 00:18:20.641 "admin_cmd_passthru": { 00:18:20.641 "identify_ctrlr": false 00:18:20.641 } 00:18:20.641 } 00:18:20.641 }, 00:18:20.641 { 00:18:20.641 "method": "nvmf_set_max_subsystems", 00:18:20.641 "params": { 00:18:20.641 "max_subsystems": 1024 00:18:20.641 } 00:18:20.641 }, 00:18:20.641 { 00:18:20.641 "method": "nvmf_set_crdt", 00:18:20.641 "params": { 00:18:20.641 "crdt1": 0, 00:18:20.641 "crdt2": 0, 00:18:20.641 "crdt3": 0 00:18:20.641 } 00:18:20.641 }, 00:18:20.641 { 00:18:20.641 "method": "nvmf_create_transport", 00:18:20.641 "params": { 00:18:20.641 "trtype": "TCP", 00:18:20.641 "max_queue_depth": 128, 00:18:20.641 "max_io_qpairs_per_ctrlr": 127, 00:18:20.641 "in_capsule_data_size": 4096, 00:18:20.641 "max_io_size": 131072, 00:18:20.641 "io_unit_size": 131072, 00:18:20.641 "max_aq_depth": 128, 00:18:20.641 "num_shared_buffers": 511, 00:18:20.641 "buf_cache_size": 4294967295, 00:18:20.641 "dif_insert_or_strip": false, 00:18:20.641 "zcopy": false, 00:18:20.641 "c2h_success": false, 00:18:20.641 "sock_priority": 0, 00:18:20.641 "abort_timeout_sec": 1 00:18:20.641 } 00:18:20.641 }, 00:18:20.641 { 00:18:20.641 "method": "nvmf_create_subsystem", 00:18:20.641 "params": { 00:18:20.641 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:20.641 "allow_any_host": false, 00:18:20.641 "serial_number": "SPDK00000000000001", 00:18:20.641 "model_number": "SPDK bdev Controller", 00:18:20.641 "max_namespaces": 10, 00:18:20.641 "min_cntlid": 1, 00:18:20.642 "max_cntlid": 65519, 00:18:20.642 "ana_reporting": false 00:18:20.642 } 00:18:20.642 }, 00:18:20.642 { 00:18:20.642 "method": "nvmf_subsystem_add_host", 00:18:20.642 "params": { 00:18:20.642 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:20.642 "host": "nqn.2016-06.io.spdk:host1", 00:18:20.642 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:20.642 } 00:18:20.642 }, 00:18:20.642 { 00:18:20.642 "method": "nvmf_subsystem_add_ns", 00:18:20.642 "params": { 00:18:20.642 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:20.642 "namespace": { 00:18:20.642 "nsid": 1, 00:18:20.642 "bdev_name": "malloc0", 00:18:20.642 "nguid": "2CBC4025A31A4371858E9D75E7F62755", 00:18:20.642 "uuid": "2cbc4025-a31a-4371-858e-9d75e7f62755" 00:18:20.642 } 00:18:20.642 } 00:18:20.642 }, 00:18:20.642 { 00:18:20.642 "method": "nvmf_subsystem_add_listener", 00:18:20.642 "params": { 00:18:20.642 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:20.642 "listen_address": { 00:18:20.642 "trtype": "TCP", 00:18:20.642 "adrfam": "IPv4", 00:18:20.642 "traddr": "10.0.0.2", 00:18:20.642 "trsvcid": "4420" 00:18:20.642 }, 00:18:20.642 "secure_channel": true 00:18:20.642 } 00:18:20.642 } 00:18:20.642 ] 00:18:20.642 } 00:18:20.642 ] 00:18:20.642 }' 00:18:20.642 19:06:41 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:18:20.900 19:06:41 -- target/tls.sh@206 -- # bdevperfconf='{ 00:18:20.900 "subsystems": [ 00:18:20.900 { 00:18:20.900 "subsystem": "iobuf", 00:18:20.900 "config": [ 00:18:20.900 { 00:18:20.900 "method": "iobuf_set_options", 00:18:20.900 "params": { 00:18:20.900 "small_pool_count": 8192, 00:18:20.900 "large_pool_count": 1024, 00:18:20.900 "small_bufsize": 8192, 00:18:20.900 "large_bufsize": 135168 00:18:20.900 } 00:18:20.900 } 00:18:20.900 ] 00:18:20.900 }, 00:18:20.900 { 00:18:20.900 "subsystem": "sock", 00:18:20.900 "config": [ 00:18:20.900 { 00:18:20.900 "method": "sock_impl_set_options", 00:18:20.900 "params": { 00:18:20.900 "impl_name": "posix", 00:18:20.900 "recv_buf_size": 2097152, 00:18:20.900 "send_buf_size": 2097152, 00:18:20.900 "enable_recv_pipe": true, 00:18:20.900 "enable_quickack": false, 00:18:20.900 "enable_placement_id": 0, 00:18:20.900 "enable_zerocopy_send_server": true, 00:18:20.900 "enable_zerocopy_send_client": false, 00:18:20.900 "zerocopy_threshold": 0, 00:18:20.900 "tls_version": 0, 00:18:20.900 "enable_ktls": false 00:18:20.900 } 00:18:20.900 }, 00:18:20.900 { 00:18:20.900 "method": "sock_impl_set_options", 00:18:20.900 "params": { 00:18:20.900 "impl_name": "ssl", 00:18:20.900 "recv_buf_size": 4096, 00:18:20.900 "send_buf_size": 4096, 00:18:20.900 "enable_recv_pipe": true, 00:18:20.900 "enable_quickack": false, 00:18:20.900 "enable_placement_id": 0, 00:18:20.900 "enable_zerocopy_send_server": true, 00:18:20.900 "enable_zerocopy_send_client": false, 00:18:20.900 "zerocopy_threshold": 0, 00:18:20.900 "tls_version": 0, 00:18:20.900 "enable_ktls": false 00:18:20.900 } 00:18:20.900 } 00:18:20.900 ] 00:18:20.900 }, 00:18:20.900 { 00:18:20.900 "subsystem": "vmd", 00:18:20.900 "config": [] 00:18:20.900 }, 00:18:20.900 { 00:18:20.900 "subsystem": "accel", 00:18:20.900 "config": [ 00:18:20.900 { 00:18:20.900 "method": "accel_set_options", 00:18:20.900 "params": { 00:18:20.900 "small_cache_size": 128, 00:18:20.900 "large_cache_size": 16, 00:18:20.900 "task_count": 2048, 00:18:20.900 "sequence_count": 2048, 00:18:20.900 "buf_count": 2048 00:18:20.900 } 00:18:20.900 } 00:18:20.900 ] 00:18:20.900 }, 00:18:20.900 { 00:18:20.900 "subsystem": "bdev", 00:18:20.900 "config": [ 00:18:20.900 { 00:18:20.900 "method": "bdev_set_options", 00:18:20.900 "params": { 00:18:20.900 "bdev_io_pool_size": 65535, 00:18:20.900 "bdev_io_cache_size": 256, 00:18:20.900 "bdev_auto_examine": true, 00:18:20.900 "iobuf_small_cache_size": 128, 00:18:20.900 "iobuf_large_cache_size": 16 00:18:20.900 } 00:18:20.900 }, 00:18:20.900 { 00:18:20.900 "method": "bdev_raid_set_options", 00:18:20.900 "params": { 00:18:20.900 "process_window_size_kb": 1024 00:18:20.900 } 00:18:20.900 }, 00:18:20.900 { 00:18:20.901 "method": "bdev_iscsi_set_options", 00:18:20.901 "params": { 00:18:20.901 "timeout_sec": 30 00:18:20.901 } 00:18:20.901 }, 00:18:20.901 { 00:18:20.901 "method": "bdev_nvme_set_options", 00:18:20.901 "params": { 00:18:20.901 "action_on_timeout": "none", 00:18:20.901 "timeout_us": 0, 00:18:20.901 "timeout_admin_us": 0, 00:18:20.901 "keep_alive_timeout_ms": 10000, 00:18:20.901 "transport_retry_count": 4, 00:18:20.901 "arbitration_burst": 0, 00:18:20.901 "low_priority_weight": 0, 00:18:20.901 "medium_priority_weight": 0, 00:18:20.901 "high_priority_weight": 0, 00:18:20.901 "nvme_adminq_poll_period_us": 10000, 00:18:20.901 "nvme_ioq_poll_period_us": 0, 00:18:20.901 "io_queue_requests": 512, 00:18:20.901 "delay_cmd_submit": true, 00:18:20.901 "bdev_retry_count": 3, 00:18:20.901 "transport_ack_timeout": 0, 00:18:20.901 "ctrlr_loss_timeout_sec": 0, 00:18:20.901 "reconnect_delay_sec": 0, 00:18:20.901 "fast_io_fail_timeout_sec": 0, 00:18:20.901 "generate_uuids": false, 00:18:20.901 "transport_tos": 0, 00:18:20.901 "io_path_stat": false, 00:18:20.901 "allow_accel_sequence": false 00:18:20.901 } 00:18:20.901 }, 00:18:20.901 { 00:18:20.901 "method": "bdev_nvme_attach_controller", 00:18:20.901 "params": { 00:18:20.901 "name": "TLSTEST", 00:18:20.901 "trtype": "TCP", 00:18:20.901 "adrfam": "IPv4", 00:18:20.901 "traddr": "10.0.0.2", 00:18:20.901 "trsvcid": "4420", 00:18:20.901 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:20.901 "prchk_reftag": false, 00:18:20.901 "prchk_guard": false, 00:18:20.901 "ctrlr_loss_timeout_sec": 0, 00:18:20.901 "reconnect_delay_sec": 0, 00:18:20.901 "fast_io_fail_timeout_sec": 0, 00:18:20.901 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:20.901 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:20.901 "hdgst": false, 00:18:20.901 "ddgst": false 00:18:20.901 } 00:18:20.901 }, 00:18:20.901 { 00:18:20.901 "method": "bdev_nvme_set_hotplug", 00:18:20.901 "params": { 00:18:20.901 "period_us": 100000, 00:18:20.901 "enable": false 00:18:20.901 } 00:18:20.901 }, 00:18:20.901 { 00:18:20.901 "method": "bdev_wait_for_examine" 00:18:20.901 } 00:18:20.901 ] 00:18:20.901 }, 00:18:20.901 { 00:18:20.901 "subsystem": "nbd", 00:18:20.901 "config": [] 00:18:20.901 } 00:18:20.901 ] 00:18:20.901 }' 00:18:20.901 19:06:41 -- target/tls.sh@208 -- # killprocess 227440 00:18:20.901 19:06:41 -- common/autotest_common.sh@936 -- # '[' -z 227440 ']' 00:18:20.901 19:06:41 -- common/autotest_common.sh@940 -- # kill -0 227440 00:18:20.901 19:06:41 -- common/autotest_common.sh@941 -- # uname 00:18:20.901 19:06:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:20.901 19:06:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 227440 00:18:21.160 19:06:41 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:21.160 19:06:41 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:21.160 19:06:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 227440' 00:18:21.160 killing process with pid 227440 00:18:21.160 19:06:41 -- common/autotest_common.sh@955 -- # kill 227440 00:18:21.160 Received shutdown signal, test time was about 10.000000 seconds 00:18:21.160 00:18:21.160 Latency(us) 00:18:21.160 [2024-11-28T18:06:42.208Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:21.160 [2024-11-28T18:06:42.208Z] =================================================================================================================== 00:18:21.160 [2024-11-28T18:06:42.208Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:18:21.160 19:06:41 -- common/autotest_common.sh@960 -- # wait 227440 00:18:21.160 19:06:42 -- target/tls.sh@209 -- # killprocess 227134 00:18:21.160 19:06:42 -- common/autotest_common.sh@936 -- # '[' -z 227134 ']' 00:18:21.160 19:06:42 -- common/autotest_common.sh@940 -- # kill -0 227134 00:18:21.160 19:06:42 -- common/autotest_common.sh@941 -- # uname 00:18:21.160 19:06:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:21.160 19:06:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 227134 00:18:21.419 19:06:42 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:21.419 19:06:42 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:21.419 19:06:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 227134' 00:18:21.419 killing process with pid 227134 00:18:21.419 19:06:42 -- common/autotest_common.sh@955 -- # kill 227134 00:18:21.419 19:06:42 -- common/autotest_common.sh@960 -- # wait 227134 00:18:21.681 19:06:42 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:18:21.681 19:06:42 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:21.681 19:06:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:21.681 19:06:42 -- common/autotest_common.sh@10 -- # set +x 00:18:21.681 19:06:42 -- target/tls.sh@212 -- # echo '{ 00:18:21.681 "subsystems": [ 00:18:21.681 { 00:18:21.681 "subsystem": "iobuf", 00:18:21.681 "config": [ 00:18:21.681 { 00:18:21.681 "method": "iobuf_set_options", 00:18:21.681 "params": { 00:18:21.681 "small_pool_count": 8192, 00:18:21.681 "large_pool_count": 1024, 00:18:21.681 "small_bufsize": 8192, 00:18:21.681 "large_bufsize": 135168 00:18:21.681 } 00:18:21.681 } 00:18:21.681 ] 00:18:21.681 }, 00:18:21.681 { 00:18:21.681 "subsystem": "sock", 00:18:21.681 "config": [ 00:18:21.681 { 00:18:21.681 "method": "sock_impl_set_options", 00:18:21.681 "params": { 00:18:21.681 "impl_name": "posix", 00:18:21.681 "recv_buf_size": 2097152, 00:18:21.681 "send_buf_size": 2097152, 00:18:21.681 "enable_recv_pipe": true, 00:18:21.681 "enable_quickack": false, 00:18:21.681 "enable_placement_id": 0, 00:18:21.681 "enable_zerocopy_send_server": true, 00:18:21.681 "enable_zerocopy_send_client": false, 00:18:21.681 "zerocopy_threshold": 0, 00:18:21.681 "tls_version": 0, 00:18:21.681 "enable_ktls": false 00:18:21.681 } 00:18:21.681 }, 00:18:21.681 { 00:18:21.681 "method": "sock_impl_set_options", 00:18:21.681 "params": { 00:18:21.681 "impl_name": "ssl", 00:18:21.681 "recv_buf_size": 4096, 00:18:21.681 "send_buf_size": 4096, 00:18:21.681 "enable_recv_pipe": true, 00:18:21.681 "enable_quickack": false, 00:18:21.681 "enable_placement_id": 0, 00:18:21.681 "enable_zerocopy_send_server": true, 00:18:21.681 "enable_zerocopy_send_client": false, 00:18:21.681 "zerocopy_threshold": 0, 00:18:21.681 "tls_version": 0, 00:18:21.681 "enable_ktls": false 00:18:21.681 } 00:18:21.681 } 00:18:21.681 ] 00:18:21.681 }, 00:18:21.681 { 00:18:21.681 "subsystem": "vmd", 00:18:21.681 "config": [] 00:18:21.681 }, 00:18:21.681 { 00:18:21.681 "subsystem": "accel", 00:18:21.681 "config": [ 00:18:21.681 { 00:18:21.681 "method": "accel_set_options", 00:18:21.681 "params": { 00:18:21.681 "small_cache_size": 128, 00:18:21.681 "large_cache_size": 16, 00:18:21.681 "task_count": 2048, 00:18:21.681 "sequence_count": 2048, 00:18:21.681 "buf_count": 2048 00:18:21.681 } 00:18:21.681 } 00:18:21.681 ] 00:18:21.681 }, 00:18:21.681 { 00:18:21.681 "subsystem": "bdev", 00:18:21.681 "config": [ 00:18:21.681 { 00:18:21.681 "method": "bdev_set_options", 00:18:21.681 "params": { 00:18:21.681 "bdev_io_pool_size": 65535, 00:18:21.681 "bdev_io_cache_size": 256, 00:18:21.681 "bdev_auto_examine": true, 00:18:21.681 "iobuf_small_cache_size": 128, 00:18:21.681 "iobuf_large_cache_size": 16 00:18:21.681 } 00:18:21.681 }, 00:18:21.681 { 00:18:21.681 "method": "bdev_raid_set_options", 00:18:21.681 "params": { 00:18:21.681 "process_window_size_kb": 1024 00:18:21.681 } 00:18:21.681 }, 00:18:21.681 { 00:18:21.681 "method": "bdev_iscsi_set_options", 00:18:21.681 "params": { 00:18:21.681 "timeout_sec": 30 00:18:21.681 } 00:18:21.681 }, 00:18:21.681 { 00:18:21.681 "method": "bdev_nvme_set_options", 00:18:21.681 "params": { 00:18:21.681 "action_on_timeout": "none", 00:18:21.681 "timeout_us": 0, 00:18:21.681 "timeout_admin_us": 0, 00:18:21.681 "keep_alive_timeout_ms": 10000, 00:18:21.681 "transport_retry_count": 4, 00:18:21.681 "arbitration_burst": 0, 00:18:21.681 "low_priority_weight": 0, 00:18:21.681 "medium_priority_weight": 0, 00:18:21.681 "high_priority_weight": 0, 00:18:21.681 "nvme_adminq_poll_period_us": 10000, 00:18:21.681 "nvme_ioq_poll_period_us": 0, 00:18:21.681 "io_queue_requests": 0, 00:18:21.681 "delay_cmd_submit": true, 00:18:21.681 "bdev_retry_count": 3, 00:18:21.681 "transport_ack_timeout": 0, 00:18:21.681 "ctrlr_loss_timeout_sec": 0, 00:18:21.681 "reconnect_delay_sec": 0, 00:18:21.681 "fast_io_fail_timeout_sec": 0, 00:18:21.681 "generate_uuids": false, 00:18:21.681 "transport_tos": 0, 00:18:21.681 "io_path_stat": false, 00:18:21.681 "allow_accel_sequence": false 00:18:21.681 } 00:18:21.681 }, 00:18:21.681 { 00:18:21.681 "method": "bdev_nvme_set_hotplug", 00:18:21.681 "params": { 00:18:21.681 "period_us": 100000, 00:18:21.681 "enable": false 00:18:21.681 } 00:18:21.681 }, 00:18:21.681 { 00:18:21.681 "method": "bdev_malloc_create", 00:18:21.681 "params": { 00:18:21.681 "name": "malloc0", 00:18:21.681 "num_blocks": 8192, 00:18:21.681 "block_size": 4096, 00:18:21.681 "physical_block_size": 4096, 00:18:21.681 "uuid": "2cbc4025-a31a-4371-858e-9d75e7f62755", 00:18:21.681 "optimal_io_boundary": 0 00:18:21.681 } 00:18:21.681 }, 00:18:21.681 { 00:18:21.681 "method": "bdev_wait_for_examine" 00:18:21.681 } 00:18:21.681 ] 00:18:21.681 }, 00:18:21.681 { 00:18:21.681 "subsystem": "nbd", 00:18:21.681 "config": [] 00:18:21.681 }, 00:18:21.681 { 00:18:21.681 "subsystem": "scheduler", 00:18:21.681 "config": [ 00:18:21.681 { 00:18:21.681 "method": "framework_set_scheduler", 00:18:21.681 "params": { 00:18:21.681 "name": "static" 00:18:21.681 } 00:18:21.681 } 00:18:21.681 ] 00:18:21.681 }, 00:18:21.681 { 00:18:21.681 "subsystem": "nvmf", 00:18:21.681 "config": [ 00:18:21.681 { 00:18:21.681 "method": "nvmf_set_config", 00:18:21.681 "params": { 00:18:21.681 "discovery_filter": "match_any", 00:18:21.681 "admin_cmd_passthru": { 00:18:21.681 "identify_ctrlr": false 00:18:21.681 } 00:18:21.681 } 00:18:21.681 }, 00:18:21.681 { 00:18:21.681 "method": "nvmf_set_max_subsystems", 00:18:21.681 "params": { 00:18:21.681 "max_subsystems": 1024 00:18:21.681 } 00:18:21.681 }, 00:18:21.681 { 00:18:21.681 "method": "nvmf_set_crdt", 00:18:21.681 "params": { 00:18:21.681 "crdt1": 0, 00:18:21.681 "crdt2": 0, 00:18:21.681 "crdt3": 0 00:18:21.681 } 00:18:21.681 }, 00:18:21.681 { 00:18:21.681 "method": "nvmf_create_transport", 00:18:21.681 "params": { 00:18:21.681 "trtype": "TCP", 00:18:21.681 "max_queue_depth": 128, 00:18:21.681 "max_io_qpairs_per_ctrlr": 127, 00:18:21.681 "in_capsule_data_size": 4096, 00:18:21.681 "max_io_size": 131072, 00:18:21.681 "io_unit_size": 131072, 00:18:21.681 "max_aq_depth": 128, 00:18:21.681 "num_shared_buffers": 511, 00:18:21.681 "buf_cache_size": 4294967295, 00:18:21.681 "dif_insert_or_strip": false, 00:18:21.681 "zcopy": false, 00:18:21.681 "c2h_success": false, 00:18:21.681 "sock_priority": 0, 00:18:21.681 "abort_timeout_sec": 1 00:18:21.681 } 00:18:21.681 }, 00:18:21.681 { 00:18:21.681 "method": "nvmf_create_subsystem", 00:18:21.681 "params": { 00:18:21.681 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:21.681 "allow_any_host": false, 00:18:21.681 "serial_number": "SPDK00000000000001", 00:18:21.681 "model_number": "SPDK bdev Controller", 00:18:21.681 "max_namespaces": 10, 00:18:21.681 "min_cntlid": 1, 00:18:21.681 "max_cntlid": 65519, 00:18:21.681 "ana_reporting": false 00:18:21.681 } 00:18:21.681 }, 00:18:21.681 { 00:18:21.681 "method": "nvmf_subsystem_add_host", 00:18:21.681 "params": { 00:18:21.681 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:21.682 "host": "nqn.2016-06.io.spdk:host1", 00:18:21.682 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:18:21.682 } 00:18:21.682 }, 00:18:21.682 { 00:18:21.682 "method": "nvmf_subsystem_add_ns", 00:18:21.682 "params": { 00:18:21.682 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:21.682 "namespace": { 00:18:21.682 "nsid": 1, 00:18:21.682 "bdev_name": "malloc0", 00:18:21.682 "nguid": "2CBC4025A31A4371858E9D75E7F62755", 00:18:21.682 "uuid": "2cbc4025-a31a-4371-858e-9d75e7f62755" 00:18:21.682 } 00:18:21.682 } 00:18:21.682 }, 00:18:21.682 { 00:18:21.682 "method": "nvmf_subsystem_add_listener", 00:18:21.682 "params": { 00:18:21.682 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:18:21.682 "listen_address": { 00:18:21.682 "trtype": "TCP", 00:18:21.682 "adrfam": "IPv4", 00:18:21.682 "traddr": "10.0.0.2", 00:18:21.682 "trsvcid": "4420" 00:18:21.682 }, 00:18:21.682 "secure_channel": true 00:18:21.682 } 00:18:21.682 } 00:18:21.682 ] 00:18:21.682 } 00:18:21.682 ] 00:18:21.682 }' 00:18:21.682 19:06:42 -- nvmf/common.sh@469 -- # nvmfpid=227805 00:18:21.682 19:06:42 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:18:21.682 19:06:42 -- nvmf/common.sh@470 -- # waitforlisten 227805 00:18:21.682 19:06:42 -- common/autotest_common.sh@829 -- # '[' -z 227805 ']' 00:18:21.682 19:06:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:21.682 19:06:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:21.682 19:06:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:21.682 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:21.682 19:06:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:21.682 19:06:42 -- common/autotest_common.sh@10 -- # set +x 00:18:21.682 [2024-11-28 19:06:42.560311] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:21.682 [2024-11-28 19:06:42.560408] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:21.682 EAL: No free 2048 kB hugepages reported on node 1 00:18:21.682 [2024-11-28 19:06:42.626945] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:21.943 [2024-11-28 19:06:42.736243] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:21.943 [2024-11-28 19:06:42.736430] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:21.943 [2024-11-28 19:06:42.736466] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:21.943 [2024-11-28 19:06:42.736478] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:21.943 [2024-11-28 19:06:42.736508] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:21.943 [2024-11-28 19:06:42.968450] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:22.202 [2024-11-28 19:06:43.000479] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:22.202 [2024-11-28 19:06:43.000755] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:22.769 19:06:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:22.769 19:06:43 -- common/autotest_common.sh@862 -- # return 0 00:18:22.769 19:06:43 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:22.769 19:06:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:22.769 19:06:43 -- common/autotest_common.sh@10 -- # set +x 00:18:22.769 19:06:43 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:22.769 19:06:43 -- target/tls.sh@216 -- # bdevperf_pid=227895 00:18:22.769 19:06:43 -- target/tls.sh@217 -- # waitforlisten 227895 /var/tmp/bdevperf.sock 00:18:22.769 19:06:43 -- common/autotest_common.sh@829 -- # '[' -z 227895 ']' 00:18:22.769 19:06:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:22.769 19:06:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:22.769 19:06:43 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:18:22.769 19:06:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:22.769 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:22.769 19:06:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:22.769 19:06:43 -- target/tls.sh@213 -- # echo '{ 00:18:22.769 "subsystems": [ 00:18:22.769 { 00:18:22.769 "subsystem": "iobuf", 00:18:22.769 "config": [ 00:18:22.769 { 00:18:22.769 "method": "iobuf_set_options", 00:18:22.769 "params": { 00:18:22.769 "small_pool_count": 8192, 00:18:22.769 "large_pool_count": 1024, 00:18:22.769 "small_bufsize": 8192, 00:18:22.769 "large_bufsize": 135168 00:18:22.769 } 00:18:22.769 } 00:18:22.769 ] 00:18:22.769 }, 00:18:22.769 { 00:18:22.769 "subsystem": "sock", 00:18:22.769 "config": [ 00:18:22.769 { 00:18:22.769 "method": "sock_impl_set_options", 00:18:22.769 "params": { 00:18:22.769 "impl_name": "posix", 00:18:22.769 "recv_buf_size": 2097152, 00:18:22.769 "send_buf_size": 2097152, 00:18:22.769 "enable_recv_pipe": true, 00:18:22.769 "enable_quickack": false, 00:18:22.769 "enable_placement_id": 0, 00:18:22.769 "enable_zerocopy_send_server": true, 00:18:22.769 "enable_zerocopy_send_client": false, 00:18:22.769 "zerocopy_threshold": 0, 00:18:22.769 "tls_version": 0, 00:18:22.769 "enable_ktls": false 00:18:22.769 } 00:18:22.769 }, 00:18:22.769 { 00:18:22.769 "method": "sock_impl_set_options", 00:18:22.769 "params": { 00:18:22.769 "impl_name": "ssl", 00:18:22.769 "recv_buf_size": 4096, 00:18:22.769 "send_buf_size": 4096, 00:18:22.769 "enable_recv_pipe": true, 00:18:22.769 "enable_quickack": false, 00:18:22.769 "enable_placement_id": 0, 00:18:22.769 "enable_zerocopy_send_server": true, 00:18:22.769 "enable_zerocopy_send_client": false, 00:18:22.769 "zerocopy_threshold": 0, 00:18:22.769 "tls_version": 0, 00:18:22.769 "enable_ktls": false 00:18:22.769 } 00:18:22.769 } 00:18:22.769 ] 00:18:22.769 }, 00:18:22.769 { 00:18:22.769 "subsystem": "vmd", 00:18:22.769 "config": [] 00:18:22.769 }, 00:18:22.769 { 00:18:22.769 "subsystem": "accel", 00:18:22.769 "config": [ 00:18:22.769 { 00:18:22.769 "method": "accel_set_options", 00:18:22.769 "params": { 00:18:22.769 "small_cache_size": 128, 00:18:22.769 "large_cache_size": 16, 00:18:22.769 "task_count": 2048, 00:18:22.769 "sequence_count": 2048, 00:18:22.769 "buf_count": 2048 00:18:22.769 } 00:18:22.769 } 00:18:22.769 ] 00:18:22.769 }, 00:18:22.769 { 00:18:22.769 "subsystem": "bdev", 00:18:22.769 "config": [ 00:18:22.769 { 00:18:22.769 "method": "bdev_set_options", 00:18:22.769 "params": { 00:18:22.769 "bdev_io_pool_size": 65535, 00:18:22.769 "bdev_io_cache_size": 256, 00:18:22.769 "bdev_auto_examine": true, 00:18:22.769 "iobuf_small_cache_size": 128, 00:18:22.769 "iobuf_large_cache_size": 16 00:18:22.769 } 00:18:22.769 }, 00:18:22.769 { 00:18:22.769 "method": "bdev_raid_set_options", 00:18:22.769 "params": { 00:18:22.769 "process_window_size_kb": 1024 00:18:22.769 } 00:18:22.769 }, 00:18:22.769 { 00:18:22.769 "method": "bdev_iscsi_set_options", 00:18:22.769 "params": { 00:18:22.769 "timeout_sec": 30 00:18:22.769 } 00:18:22.769 }, 00:18:22.769 { 00:18:22.769 "method": "bdev_nvme_set_options", 00:18:22.769 "params": { 00:18:22.769 "action_on_timeout": "none", 00:18:22.769 "timeout_us": 0, 00:18:22.769 "timeout_admin_us": 0, 00:18:22.769 "keep_alive_timeout_ms": 10000, 00:18:22.769 "transport_retry_count": 4, 00:18:22.769 "arbitration_burst": 0, 00:18:22.769 "low_priority_weight": 0, 00:18:22.769 "medium_priority_weight": 0, 00:18:22.769 "high_priority_weight": 0, 00:18:22.769 "nvme_adminq_poll_period_us": 10000, 00:18:22.769 "nvme_ioq_poll_period_us": 0, 00:18:22.769 "io_queue_requests": 512, 00:18:22.769 "delay_cmd_submit": true, 00:18:22.769 "bdev_retry_count": 3, 00:18:22.769 "transport_ack_timeout": 0, 00:18:22.769 "ctrlr_loss_timeout_sec": 0, 00:18:22.769 "reconnect_delay_sec": 0, 00:18:22.769 "fast_io_fail_timeout_sec": 0, 00:18:22.769 "generate_uuids": false, 00:18:22.769 "transport_tos": 0, 00:18:22.769 "io_path_stat": false, 00:18:22.769 "allow_accel_sequence": false 00:18:22.769 } 00:18:22.769 }, 00:18:22.769 { 00:18:22.769 "method": "bdev_nvme_attach_controller", 00:18:22.769 "params": { 00:18:22.769 "name": "TLSTEST", 00:18:22.769 "trtype": "TCP", 00:18:22.769 "adrfam": "IPv4", 00:18:22.769 "traddr": "10.0.0.2", 00:18:22.769 "trsvcid": "4420", 00:18:22.769 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:22.769 "prchk_reftag": false, 00:18:22.769 "prchk_guard": false, 00:18:22.769 "ctrlr_loss_timeout_sec": 0, 00:18:22.769 "reconnect_delay_sec": 0, 00:18:22.769 "fast_io_fail_timeout_sec": 0, 00:18:22.769 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:18:22.769 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:22.769 "hdgst": false, 00:18:22.769 "ddgst": false 00:18:22.769 } 00:18:22.769 }, 00:18:22.769 { 00:18:22.769 "method": "bdev_nvme_set_hotplug", 00:18:22.769 "params": { 00:18:22.769 "period_us": 100000, 00:18:22.769 "enable": false 00:18:22.769 } 00:18:22.769 }, 00:18:22.769 { 00:18:22.769 "method": "bdev_wait_for_examine" 00:18:22.769 } 00:18:22.769 ] 00:18:22.769 }, 00:18:22.769 { 00:18:22.769 "subsystem": "nbd", 00:18:22.769 "config": [] 00:18:22.769 } 00:18:22.769 ] 00:18:22.769 }' 00:18:22.769 19:06:43 -- common/autotest_common.sh@10 -- # set +x 00:18:22.769 [2024-11-28 19:06:43.590980] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:22.769 [2024-11-28 19:06:43.591063] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid227895 ] 00:18:22.769 EAL: No free 2048 kB hugepages reported on node 1 00:18:22.769 [2024-11-28 19:06:43.654468] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:22.769 [2024-11-28 19:06:43.768705] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:23.030 [2024-11-28 19:06:43.919334] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:23.597 19:06:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:23.597 19:06:44 -- common/autotest_common.sh@862 -- # return 0 00:18:23.597 19:06:44 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:18:23.857 Running I/O for 10 seconds... 00:18:33.842 00:18:33.842 Latency(us) 00:18:33.842 [2024-11-28T18:06:54.890Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:33.842 [2024-11-28T18:06:54.890Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:33.842 Verification LBA range: start 0x0 length 0x2000 00:18:33.842 TLSTESTn1 : 10.02 3433.49 13.41 0.00 0.00 37230.42 5072.97 69516.71 00:18:33.842 [2024-11-28T18:06:54.890Z] =================================================================================================================== 00:18:33.842 [2024-11-28T18:06:54.890Z] Total : 3433.49 13.41 0.00 0.00 37230.42 5072.97 69516.71 00:18:33.842 0 00:18:33.842 19:06:54 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:33.842 19:06:54 -- target/tls.sh@223 -- # killprocess 227895 00:18:33.842 19:06:54 -- common/autotest_common.sh@936 -- # '[' -z 227895 ']' 00:18:33.842 19:06:54 -- common/autotest_common.sh@940 -- # kill -0 227895 00:18:33.842 19:06:54 -- common/autotest_common.sh@941 -- # uname 00:18:33.842 19:06:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:33.842 19:06:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 227895 00:18:33.842 19:06:54 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:33.842 19:06:54 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:33.842 19:06:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 227895' 00:18:33.842 killing process with pid 227895 00:18:33.842 19:06:54 -- common/autotest_common.sh@955 -- # kill 227895 00:18:33.842 Received shutdown signal, test time was about 10.000000 seconds 00:18:33.842 00:18:33.842 Latency(us) 00:18:33.842 [2024-11-28T18:06:54.890Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:33.842 [2024-11-28T18:06:54.890Z] =================================================================================================================== 00:18:33.842 [2024-11-28T18:06:54.890Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:33.842 19:06:54 -- common/autotest_common.sh@960 -- # wait 227895 00:18:34.101 19:06:55 -- target/tls.sh@224 -- # killprocess 227805 00:18:34.101 19:06:55 -- common/autotest_common.sh@936 -- # '[' -z 227805 ']' 00:18:34.101 19:06:55 -- common/autotest_common.sh@940 -- # kill -0 227805 00:18:34.101 19:06:55 -- common/autotest_common.sh@941 -- # uname 00:18:34.101 19:06:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:34.101 19:06:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 227805 00:18:34.101 19:06:55 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:34.101 19:06:55 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:34.101 19:06:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 227805' 00:18:34.101 killing process with pid 227805 00:18:34.101 19:06:55 -- common/autotest_common.sh@955 -- # kill 227805 00:18:34.101 19:06:55 -- common/autotest_common.sh@960 -- # wait 227805 00:18:34.360 19:06:55 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:18:34.360 19:06:55 -- target/tls.sh@227 -- # cleanup 00:18:34.360 19:06:55 -- target/tls.sh@15 -- # process_shm --id 0 00:18:34.360 19:06:55 -- common/autotest_common.sh@806 -- # type=--id 00:18:34.360 19:06:55 -- common/autotest_common.sh@807 -- # id=0 00:18:34.360 19:06:55 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:34.360 19:06:55 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:34.360 19:06:55 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:34.360 19:06:55 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:34.360 19:06:55 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:34.360 19:06:55 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:34.360 nvmf_trace.0 00:18:34.360 19:06:55 -- common/autotest_common.sh@821 -- # return 0 00:18:34.360 19:06:55 -- target/tls.sh@16 -- # killprocess 227895 00:18:34.360 19:06:55 -- common/autotest_common.sh@936 -- # '[' -z 227895 ']' 00:18:34.360 19:06:55 -- common/autotest_common.sh@940 -- # kill -0 227895 00:18:34.360 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (227895) - No such process 00:18:34.360 19:06:55 -- common/autotest_common.sh@963 -- # echo 'Process with pid 227895 is not found' 00:18:34.360 Process with pid 227895 is not found 00:18:34.360 19:06:55 -- target/tls.sh@17 -- # nvmftestfini 00:18:34.360 19:06:55 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:34.360 19:06:55 -- nvmf/common.sh@116 -- # sync 00:18:34.360 19:06:55 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:34.360 19:06:55 -- nvmf/common.sh@119 -- # set +e 00:18:34.360 19:06:55 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:34.360 19:06:55 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:34.360 rmmod nvme_tcp 00:18:34.619 rmmod nvme_fabrics 00:18:34.619 rmmod nvme_keyring 00:18:34.619 19:06:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:34.619 19:06:55 -- nvmf/common.sh@123 -- # set -e 00:18:34.619 19:06:55 -- nvmf/common.sh@124 -- # return 0 00:18:34.619 19:06:55 -- nvmf/common.sh@477 -- # '[' -n 227805 ']' 00:18:34.619 19:06:55 -- nvmf/common.sh@478 -- # killprocess 227805 00:18:34.619 19:06:55 -- common/autotest_common.sh@936 -- # '[' -z 227805 ']' 00:18:34.619 19:06:55 -- common/autotest_common.sh@940 -- # kill -0 227805 00:18:34.619 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (227805) - No such process 00:18:34.619 19:06:55 -- common/autotest_common.sh@963 -- # echo 'Process with pid 227805 is not found' 00:18:34.619 Process with pid 227805 is not found 00:18:34.619 19:06:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:34.619 19:06:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:34.619 19:06:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:34.619 19:06:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:34.619 19:06:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:34.619 19:06:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:34.619 19:06:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:34.619 19:06:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:36.529 19:06:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:36.529 19:06:57 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:18:36.529 00:18:36.529 real 1m16.494s 00:18:36.529 user 2m0.286s 00:18:36.529 sys 0m24.206s 00:18:36.529 19:06:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:36.529 19:06:57 -- common/autotest_common.sh@10 -- # set +x 00:18:36.529 ************************************ 00:18:36.529 END TEST nvmf_tls 00:18:36.529 ************************************ 00:18:36.529 19:06:57 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:18:36.529 19:06:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:36.529 19:06:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:36.529 19:06:57 -- common/autotest_common.sh@10 -- # set +x 00:18:36.529 ************************************ 00:18:36.529 START TEST nvmf_fips 00:18:36.529 ************************************ 00:18:36.529 19:06:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:18:36.529 * Looking for test storage... 00:18:36.529 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:18:36.529 19:06:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:36.529 19:06:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:36.529 19:06:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:36.788 19:06:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:36.788 19:06:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:36.788 19:06:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:36.788 19:06:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:36.788 19:06:57 -- scripts/common.sh@335 -- # IFS=.-: 00:18:36.788 19:06:57 -- scripts/common.sh@335 -- # read -ra ver1 00:18:36.788 19:06:57 -- scripts/common.sh@336 -- # IFS=.-: 00:18:36.788 19:06:57 -- scripts/common.sh@336 -- # read -ra ver2 00:18:36.788 19:06:57 -- scripts/common.sh@337 -- # local 'op=<' 00:18:36.788 19:06:57 -- scripts/common.sh@339 -- # ver1_l=2 00:18:36.788 19:06:57 -- scripts/common.sh@340 -- # ver2_l=1 00:18:36.788 19:06:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:36.789 19:06:57 -- scripts/common.sh@343 -- # case "$op" in 00:18:36.789 19:06:57 -- scripts/common.sh@344 -- # : 1 00:18:36.789 19:06:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:36.789 19:06:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:36.789 19:06:57 -- scripts/common.sh@364 -- # decimal 1 00:18:36.789 19:06:57 -- scripts/common.sh@352 -- # local d=1 00:18:36.789 19:06:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:36.789 19:06:57 -- scripts/common.sh@354 -- # echo 1 00:18:36.789 19:06:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:36.789 19:06:57 -- scripts/common.sh@365 -- # decimal 2 00:18:36.789 19:06:57 -- scripts/common.sh@352 -- # local d=2 00:18:36.789 19:06:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:36.789 19:06:57 -- scripts/common.sh@354 -- # echo 2 00:18:36.789 19:06:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:36.789 19:06:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:36.789 19:06:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:36.789 19:06:57 -- scripts/common.sh@367 -- # return 0 00:18:36.789 19:06:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:36.789 19:06:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:36.789 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:36.789 --rc genhtml_branch_coverage=1 00:18:36.789 --rc genhtml_function_coverage=1 00:18:36.789 --rc genhtml_legend=1 00:18:36.789 --rc geninfo_all_blocks=1 00:18:36.789 --rc geninfo_unexecuted_blocks=1 00:18:36.789 00:18:36.789 ' 00:18:36.789 19:06:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:36.789 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:36.789 --rc genhtml_branch_coverage=1 00:18:36.789 --rc genhtml_function_coverage=1 00:18:36.789 --rc genhtml_legend=1 00:18:36.789 --rc geninfo_all_blocks=1 00:18:36.789 --rc geninfo_unexecuted_blocks=1 00:18:36.789 00:18:36.789 ' 00:18:36.789 19:06:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:36.789 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:36.789 --rc genhtml_branch_coverage=1 00:18:36.789 --rc genhtml_function_coverage=1 00:18:36.789 --rc genhtml_legend=1 00:18:36.789 --rc geninfo_all_blocks=1 00:18:36.789 --rc geninfo_unexecuted_blocks=1 00:18:36.789 00:18:36.789 ' 00:18:36.789 19:06:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:36.789 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:36.789 --rc genhtml_branch_coverage=1 00:18:36.789 --rc genhtml_function_coverage=1 00:18:36.789 --rc genhtml_legend=1 00:18:36.789 --rc geninfo_all_blocks=1 00:18:36.789 --rc geninfo_unexecuted_blocks=1 00:18:36.789 00:18:36.789 ' 00:18:36.789 19:06:57 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:36.789 19:06:57 -- nvmf/common.sh@7 -- # uname -s 00:18:36.789 19:06:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:36.789 19:06:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:36.789 19:06:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:36.789 19:06:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:36.789 19:06:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:36.789 19:06:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:36.789 19:06:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:36.789 19:06:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:36.789 19:06:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:36.789 19:06:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:36.789 19:06:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:36.789 19:06:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:36.789 19:06:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:36.789 19:06:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:36.789 19:06:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:36.789 19:06:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:36.789 19:06:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:36.789 19:06:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:36.789 19:06:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:36.789 19:06:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:36.789 19:06:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:36.789 19:06:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:36.789 19:06:57 -- paths/export.sh@5 -- # export PATH 00:18:36.789 19:06:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:36.789 19:06:57 -- nvmf/common.sh@46 -- # : 0 00:18:36.789 19:06:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:36.789 19:06:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:36.789 19:06:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:36.789 19:06:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:36.789 19:06:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:36.789 19:06:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:36.789 19:06:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:36.789 19:06:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:36.789 19:06:57 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:36.789 19:06:57 -- fips/fips.sh@89 -- # check_openssl_version 00:18:36.789 19:06:57 -- fips/fips.sh@83 -- # local target=3.0.0 00:18:36.789 19:06:57 -- fips/fips.sh@85 -- # openssl version 00:18:36.789 19:06:57 -- fips/fips.sh@85 -- # awk '{print $2}' 00:18:36.789 19:06:57 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:18:36.789 19:06:57 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:18:36.789 19:06:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:36.789 19:06:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:36.789 19:06:57 -- scripts/common.sh@335 -- # IFS=.-: 00:18:36.789 19:06:57 -- scripts/common.sh@335 -- # read -ra ver1 00:18:36.789 19:06:57 -- scripts/common.sh@336 -- # IFS=.-: 00:18:36.789 19:06:57 -- scripts/common.sh@336 -- # read -ra ver2 00:18:36.789 19:06:57 -- scripts/common.sh@337 -- # local 'op=>=' 00:18:36.789 19:06:57 -- scripts/common.sh@339 -- # ver1_l=3 00:18:36.789 19:06:57 -- scripts/common.sh@340 -- # ver2_l=3 00:18:36.790 19:06:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:36.790 19:06:57 -- scripts/common.sh@343 -- # case "$op" in 00:18:36.790 19:06:57 -- scripts/common.sh@347 -- # : 1 00:18:36.790 19:06:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:36.790 19:06:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:36.790 19:06:57 -- scripts/common.sh@364 -- # decimal 3 00:18:36.790 19:06:57 -- scripts/common.sh@352 -- # local d=3 00:18:36.790 19:06:57 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:18:36.790 19:06:57 -- scripts/common.sh@354 -- # echo 3 00:18:36.790 19:06:57 -- scripts/common.sh@364 -- # ver1[v]=3 00:18:36.790 19:06:57 -- scripts/common.sh@365 -- # decimal 3 00:18:36.790 19:06:57 -- scripts/common.sh@352 -- # local d=3 00:18:36.790 19:06:57 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:18:36.790 19:06:57 -- scripts/common.sh@354 -- # echo 3 00:18:36.790 19:06:57 -- scripts/common.sh@365 -- # ver2[v]=3 00:18:36.790 19:06:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:36.790 19:06:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:36.790 19:06:57 -- scripts/common.sh@363 -- # (( v++ )) 00:18:36.790 19:06:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:36.790 19:06:57 -- scripts/common.sh@364 -- # decimal 1 00:18:36.790 19:06:57 -- scripts/common.sh@352 -- # local d=1 00:18:36.790 19:06:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:36.790 19:06:57 -- scripts/common.sh@354 -- # echo 1 00:18:36.790 19:06:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:36.790 19:06:57 -- scripts/common.sh@365 -- # decimal 0 00:18:36.790 19:06:57 -- scripts/common.sh@352 -- # local d=0 00:18:36.790 19:06:57 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:18:36.790 19:06:57 -- scripts/common.sh@354 -- # echo 0 00:18:36.790 19:06:57 -- scripts/common.sh@365 -- # ver2[v]=0 00:18:36.790 19:06:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:36.790 19:06:57 -- scripts/common.sh@366 -- # return 0 00:18:36.790 19:06:57 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:18:36.790 19:06:57 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:18:36.790 19:06:57 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:18:36.790 19:06:57 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:18:36.790 19:06:57 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:18:36.790 19:06:57 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:18:36.790 19:06:57 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:18:36.790 19:06:57 -- fips/fips.sh@113 -- # build_openssl_config 00:18:36.790 19:06:57 -- fips/fips.sh@37 -- # cat 00:18:36.790 19:06:57 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:18:36.790 19:06:57 -- fips/fips.sh@58 -- # cat - 00:18:36.790 19:06:57 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:18:36.790 19:06:57 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:18:36.790 19:06:57 -- fips/fips.sh@116 -- # mapfile -t providers 00:18:36.790 19:06:57 -- fips/fips.sh@116 -- # openssl list -providers 00:18:36.790 19:06:57 -- fips/fips.sh@116 -- # grep name 00:18:37.049 19:06:57 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:18:37.049 19:06:57 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:18:37.049 19:06:57 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:18:37.049 19:06:57 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:18:37.049 19:06:57 -- fips/fips.sh@127 -- # : 00:18:37.049 19:06:57 -- common/autotest_common.sh@650 -- # local es=0 00:18:37.049 19:06:57 -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:18:37.049 19:06:57 -- common/autotest_common.sh@638 -- # local arg=openssl 00:18:37.049 19:06:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:37.049 19:06:57 -- common/autotest_common.sh@642 -- # type -t openssl 00:18:37.049 19:06:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:37.049 19:06:57 -- common/autotest_common.sh@644 -- # type -P openssl 00:18:37.049 19:06:57 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:37.049 19:06:57 -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:18:37.049 19:06:57 -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:18:37.049 19:06:57 -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:18:37.049 Error setting digest 00:18:37.049 4092167F467F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:18:37.049 4092167F467F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:18:37.049 19:06:57 -- common/autotest_common.sh@653 -- # es=1 00:18:37.049 19:06:57 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:37.049 19:06:57 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:37.049 19:06:57 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:37.049 19:06:57 -- fips/fips.sh@130 -- # nvmftestinit 00:18:37.049 19:06:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:37.049 19:06:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:37.049 19:06:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:37.049 19:06:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:37.049 19:06:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:37.049 19:06:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:37.049 19:06:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:37.049 19:06:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:37.049 19:06:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:37.049 19:06:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:37.049 19:06:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:37.049 19:06:57 -- common/autotest_common.sh@10 -- # set +x 00:18:38.959 19:06:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:38.959 19:06:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:38.959 19:06:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:38.959 19:06:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:38.959 19:06:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:38.959 19:06:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:38.959 19:06:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:38.959 19:06:59 -- nvmf/common.sh@294 -- # net_devs=() 00:18:38.959 19:06:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:38.959 19:06:59 -- nvmf/common.sh@295 -- # e810=() 00:18:38.959 19:06:59 -- nvmf/common.sh@295 -- # local -ga e810 00:18:38.959 19:06:59 -- nvmf/common.sh@296 -- # x722=() 00:18:38.959 19:06:59 -- nvmf/common.sh@296 -- # local -ga x722 00:18:38.959 19:06:59 -- nvmf/common.sh@297 -- # mlx=() 00:18:38.959 19:06:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:38.959 19:06:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:38.959 19:06:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:38.959 19:06:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:38.959 19:06:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:38.959 19:06:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:38.959 19:06:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:38.959 19:06:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:38.959 19:06:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:38.959 19:06:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:38.959 19:06:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:38.959 19:06:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:38.959 19:06:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:38.959 19:06:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:38.959 19:06:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:38.959 19:06:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:38.959 19:06:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:38.959 19:06:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:38.959 19:06:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:38.959 19:06:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:38.959 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:38.959 19:06:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:38.959 19:06:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:38.959 19:06:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:38.959 19:06:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:38.960 19:06:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:38.960 19:06:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:38.960 19:06:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:38.960 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:38.960 19:06:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:38.960 19:06:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:38.960 19:06:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:38.960 19:06:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:38.960 19:06:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:38.960 19:06:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:38.960 19:06:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:38.960 19:06:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:38.960 19:06:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:38.960 19:06:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:38.960 19:06:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:38.960 19:06:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:38.960 19:06:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:38.960 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:38.960 19:06:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:38.960 19:06:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:38.960 19:06:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:38.960 19:06:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:38.960 19:06:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:38.960 19:06:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:38.960 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:38.960 19:06:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:38.960 19:06:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:38.960 19:06:59 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:38.960 19:06:59 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:38.960 19:06:59 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:38.960 19:06:59 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:38.960 19:06:59 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:38.960 19:06:59 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:38.960 19:06:59 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:38.960 19:06:59 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:38.960 19:06:59 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:38.960 19:06:59 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:38.960 19:06:59 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:38.960 19:06:59 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:38.960 19:06:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:38.960 19:06:59 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:38.960 19:06:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:38.960 19:06:59 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:38.960 19:06:59 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:38.960 19:06:59 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:38.960 19:06:59 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:38.960 19:06:59 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:38.960 19:06:59 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:38.960 19:06:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:38.960 19:06:59 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:38.960 19:06:59 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:38.960 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:38.960 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.212 ms 00:18:38.960 00:18:38.960 --- 10.0.0.2 ping statistics --- 00:18:38.960 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:38.960 rtt min/avg/max/mdev = 0.212/0.212/0.212/0.000 ms 00:18:38.960 19:06:59 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:38.960 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:38.960 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.126 ms 00:18:38.960 00:18:38.960 --- 10.0.0.1 ping statistics --- 00:18:38.960 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:38.960 rtt min/avg/max/mdev = 0.126/0.126/0.126/0.000 ms 00:18:38.960 19:06:59 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:38.960 19:06:59 -- nvmf/common.sh@410 -- # return 0 00:18:38.960 19:06:59 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:38.960 19:06:59 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:38.960 19:06:59 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:38.960 19:06:59 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:38.960 19:06:59 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:38.960 19:06:59 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:38.960 19:06:59 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:38.960 19:06:59 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:18:38.960 19:06:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:38.960 19:06:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:38.960 19:06:59 -- common/autotest_common.sh@10 -- # set +x 00:18:38.960 19:06:59 -- nvmf/common.sh@469 -- # nvmfpid=231348 00:18:38.960 19:06:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:38.960 19:06:59 -- nvmf/common.sh@470 -- # waitforlisten 231348 00:18:38.960 19:06:59 -- common/autotest_common.sh@829 -- # '[' -z 231348 ']' 00:18:38.960 19:06:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:38.960 19:06:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:38.960 19:06:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:38.960 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:38.960 19:06:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:38.960 19:06:59 -- common/autotest_common.sh@10 -- # set +x 00:18:39.225 [2024-11-28 19:07:00.042664] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:39.225 [2024-11-28 19:07:00.042764] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:39.225 EAL: No free 2048 kB hugepages reported on node 1 00:18:39.225 [2024-11-28 19:07:00.113097] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:39.225 [2024-11-28 19:07:00.227053] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:39.225 [2024-11-28 19:07:00.227217] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:39.225 [2024-11-28 19:07:00.227237] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:39.225 [2024-11-28 19:07:00.227251] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:39.225 [2024-11-28 19:07:00.227291] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:40.162 19:07:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:40.162 19:07:01 -- common/autotest_common.sh@862 -- # return 0 00:18:40.162 19:07:01 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:40.162 19:07:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:40.162 19:07:01 -- common/autotest_common.sh@10 -- # set +x 00:18:40.162 19:07:01 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:40.162 19:07:01 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:18:40.162 19:07:01 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:40.162 19:07:01 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:40.162 19:07:01 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:18:40.162 19:07:01 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:40.162 19:07:01 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:40.162 19:07:01 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:40.162 19:07:01 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:40.421 [2024-11-28 19:07:01.307896] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:40.421 [2024-11-28 19:07:01.323892] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:40.421 [2024-11-28 19:07:01.324110] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:40.421 malloc0 00:18:40.421 19:07:01 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:40.421 19:07:01 -- fips/fips.sh@147 -- # bdevperf_pid=231508 00:18:40.421 19:07:01 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:40.421 19:07:01 -- fips/fips.sh@148 -- # waitforlisten 231508 /var/tmp/bdevperf.sock 00:18:40.421 19:07:01 -- common/autotest_common.sh@829 -- # '[' -z 231508 ']' 00:18:40.421 19:07:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:40.421 19:07:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:40.421 19:07:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:40.421 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:40.421 19:07:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:40.421 19:07:01 -- common/autotest_common.sh@10 -- # set +x 00:18:40.421 [2024-11-28 19:07:01.435071] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:40.421 [2024-11-28 19:07:01.435148] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid231508 ] 00:18:40.421 EAL: No free 2048 kB hugepages reported on node 1 00:18:40.680 [2024-11-28 19:07:01.497321] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:40.680 [2024-11-28 19:07:01.600503] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:41.618 19:07:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:41.618 19:07:02 -- common/autotest_common.sh@862 -- # return 0 00:18:41.618 19:07:02 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:41.618 [2024-11-28 19:07:02.583504] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:41.618 TLSTESTn1 00:18:41.877 19:07:02 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:41.877 Running I/O for 10 seconds... 00:18:51.878 00:18:51.878 Latency(us) 00:18:51.878 [2024-11-28T18:07:12.926Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:51.878 [2024-11-28T18:07:12.926Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:51.878 Verification LBA range: start 0x0 length 0x2000 00:18:51.878 TLSTESTn1 : 10.02 4443.84 17.36 0.00 0.00 28766.38 5048.70 46991.74 00:18:51.878 [2024-11-28T18:07:12.926Z] =================================================================================================================== 00:18:51.878 [2024-11-28T18:07:12.926Z] Total : 4443.84 17.36 0.00 0.00 28766.38 5048.70 46991.74 00:18:51.878 0 00:18:51.878 19:07:12 -- fips/fips.sh@1 -- # cleanup 00:18:51.878 19:07:12 -- fips/fips.sh@15 -- # process_shm --id 0 00:18:51.878 19:07:12 -- common/autotest_common.sh@806 -- # type=--id 00:18:51.878 19:07:12 -- common/autotest_common.sh@807 -- # id=0 00:18:51.878 19:07:12 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:51.878 19:07:12 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:51.878 19:07:12 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:51.878 19:07:12 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:51.878 19:07:12 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:51.878 19:07:12 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:51.878 nvmf_trace.0 00:18:51.878 19:07:12 -- common/autotest_common.sh@821 -- # return 0 00:18:51.878 19:07:12 -- fips/fips.sh@16 -- # killprocess 231508 00:18:51.878 19:07:12 -- common/autotest_common.sh@936 -- # '[' -z 231508 ']' 00:18:51.878 19:07:12 -- common/autotest_common.sh@940 -- # kill -0 231508 00:18:51.878 19:07:12 -- common/autotest_common.sh@941 -- # uname 00:18:51.878 19:07:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:51.878 19:07:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 231508 00:18:51.878 19:07:12 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:51.878 19:07:12 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:51.878 19:07:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 231508' 00:18:51.878 killing process with pid 231508 00:18:51.878 19:07:12 -- common/autotest_common.sh@955 -- # kill 231508 00:18:51.878 Received shutdown signal, test time was about 10.000000 seconds 00:18:51.878 00:18:51.878 Latency(us) 00:18:51.878 [2024-11-28T18:07:12.926Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:51.879 [2024-11-28T18:07:12.927Z] =================================================================================================================== 00:18:51.879 [2024-11-28T18:07:12.927Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:51.879 19:07:12 -- common/autotest_common.sh@960 -- # wait 231508 00:18:52.138 19:07:13 -- fips/fips.sh@17 -- # nvmftestfini 00:18:52.138 19:07:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:52.138 19:07:13 -- nvmf/common.sh@116 -- # sync 00:18:52.397 19:07:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:52.398 19:07:13 -- nvmf/common.sh@119 -- # set +e 00:18:52.398 19:07:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:52.398 19:07:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:52.398 rmmod nvme_tcp 00:18:52.398 rmmod nvme_fabrics 00:18:52.398 rmmod nvme_keyring 00:18:52.398 19:07:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:52.398 19:07:13 -- nvmf/common.sh@123 -- # set -e 00:18:52.398 19:07:13 -- nvmf/common.sh@124 -- # return 0 00:18:52.398 19:07:13 -- nvmf/common.sh@477 -- # '[' -n 231348 ']' 00:18:52.398 19:07:13 -- nvmf/common.sh@478 -- # killprocess 231348 00:18:52.398 19:07:13 -- common/autotest_common.sh@936 -- # '[' -z 231348 ']' 00:18:52.398 19:07:13 -- common/autotest_common.sh@940 -- # kill -0 231348 00:18:52.398 19:07:13 -- common/autotest_common.sh@941 -- # uname 00:18:52.398 19:07:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:52.398 19:07:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 231348 00:18:52.398 19:07:13 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:52.398 19:07:13 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:52.398 19:07:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 231348' 00:18:52.398 killing process with pid 231348 00:18:52.398 19:07:13 -- common/autotest_common.sh@955 -- # kill 231348 00:18:52.398 19:07:13 -- common/autotest_common.sh@960 -- # wait 231348 00:18:52.657 19:07:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:52.657 19:07:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:52.657 19:07:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:52.657 19:07:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:52.657 19:07:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:52.657 19:07:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:52.657 19:07:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:52.657 19:07:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:55.198 19:07:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:55.198 19:07:15 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:18:55.198 00:18:55.198 real 0m18.120s 00:18:55.198 user 0m24.389s 00:18:55.198 sys 0m5.213s 00:18:55.198 19:07:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:55.198 19:07:15 -- common/autotest_common.sh@10 -- # set +x 00:18:55.198 ************************************ 00:18:55.198 END TEST nvmf_fips 00:18:55.198 ************************************ 00:18:55.198 19:07:15 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:18:55.198 19:07:15 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:55.198 19:07:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:55.198 19:07:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:55.198 19:07:15 -- common/autotest_common.sh@10 -- # set +x 00:18:55.198 ************************************ 00:18:55.198 START TEST nvmf_fuzz 00:18:55.198 ************************************ 00:18:55.198 19:07:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:18:55.198 * Looking for test storage... 00:18:55.198 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:55.198 19:07:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:55.198 19:07:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:55.198 19:07:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:55.198 19:07:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:55.198 19:07:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:55.198 19:07:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:55.198 19:07:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:55.198 19:07:15 -- scripts/common.sh@335 -- # IFS=.-: 00:18:55.198 19:07:15 -- scripts/common.sh@335 -- # read -ra ver1 00:18:55.198 19:07:15 -- scripts/common.sh@336 -- # IFS=.-: 00:18:55.198 19:07:15 -- scripts/common.sh@336 -- # read -ra ver2 00:18:55.198 19:07:15 -- scripts/common.sh@337 -- # local 'op=<' 00:18:55.198 19:07:15 -- scripts/common.sh@339 -- # ver1_l=2 00:18:55.198 19:07:15 -- scripts/common.sh@340 -- # ver2_l=1 00:18:55.198 19:07:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:55.198 19:07:15 -- scripts/common.sh@343 -- # case "$op" in 00:18:55.198 19:07:15 -- scripts/common.sh@344 -- # : 1 00:18:55.199 19:07:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:55.199 19:07:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:55.199 19:07:15 -- scripts/common.sh@364 -- # decimal 1 00:18:55.199 19:07:15 -- scripts/common.sh@352 -- # local d=1 00:18:55.199 19:07:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:55.199 19:07:15 -- scripts/common.sh@354 -- # echo 1 00:18:55.199 19:07:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:55.199 19:07:15 -- scripts/common.sh@365 -- # decimal 2 00:18:55.199 19:07:15 -- scripts/common.sh@352 -- # local d=2 00:18:55.199 19:07:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:55.199 19:07:15 -- scripts/common.sh@354 -- # echo 2 00:18:55.199 19:07:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:55.199 19:07:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:55.199 19:07:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:55.199 19:07:15 -- scripts/common.sh@367 -- # return 0 00:18:55.199 19:07:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:55.199 19:07:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:55.199 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:55.199 --rc genhtml_branch_coverage=1 00:18:55.199 --rc genhtml_function_coverage=1 00:18:55.199 --rc genhtml_legend=1 00:18:55.199 --rc geninfo_all_blocks=1 00:18:55.199 --rc geninfo_unexecuted_blocks=1 00:18:55.199 00:18:55.199 ' 00:18:55.199 19:07:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:55.199 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:55.199 --rc genhtml_branch_coverage=1 00:18:55.199 --rc genhtml_function_coverage=1 00:18:55.199 --rc genhtml_legend=1 00:18:55.199 --rc geninfo_all_blocks=1 00:18:55.199 --rc geninfo_unexecuted_blocks=1 00:18:55.199 00:18:55.199 ' 00:18:55.199 19:07:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:55.199 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:55.199 --rc genhtml_branch_coverage=1 00:18:55.199 --rc genhtml_function_coverage=1 00:18:55.199 --rc genhtml_legend=1 00:18:55.199 --rc geninfo_all_blocks=1 00:18:55.199 --rc geninfo_unexecuted_blocks=1 00:18:55.199 00:18:55.199 ' 00:18:55.199 19:07:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:55.199 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:55.199 --rc genhtml_branch_coverage=1 00:18:55.199 --rc genhtml_function_coverage=1 00:18:55.199 --rc genhtml_legend=1 00:18:55.199 --rc geninfo_all_blocks=1 00:18:55.199 --rc geninfo_unexecuted_blocks=1 00:18:55.199 00:18:55.199 ' 00:18:55.199 19:07:15 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:55.199 19:07:15 -- nvmf/common.sh@7 -- # uname -s 00:18:55.199 19:07:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:55.199 19:07:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:55.199 19:07:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:55.199 19:07:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:55.199 19:07:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:55.199 19:07:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:55.199 19:07:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:55.199 19:07:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:55.199 19:07:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:55.199 19:07:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:55.199 19:07:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:55.199 19:07:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:55.199 19:07:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:55.199 19:07:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:55.199 19:07:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:55.199 19:07:15 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:55.199 19:07:15 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:55.199 19:07:15 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:55.199 19:07:15 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:55.199 19:07:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:55.199 19:07:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:55.199 19:07:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:55.199 19:07:15 -- paths/export.sh@5 -- # export PATH 00:18:55.199 19:07:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:55.199 19:07:15 -- nvmf/common.sh@46 -- # : 0 00:18:55.199 19:07:15 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:55.199 19:07:15 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:55.199 19:07:15 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:55.199 19:07:15 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:55.199 19:07:15 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:55.199 19:07:15 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:55.199 19:07:15 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:55.199 19:07:15 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:55.199 19:07:15 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:18:55.199 19:07:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:55.199 19:07:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:55.199 19:07:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:55.199 19:07:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:55.199 19:07:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:55.199 19:07:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:55.199 19:07:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:55.199 19:07:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:55.199 19:07:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:55.199 19:07:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:55.199 19:07:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:55.199 19:07:15 -- common/autotest_common.sh@10 -- # set +x 00:18:57.104 19:07:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:57.104 19:07:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:57.104 19:07:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:57.104 19:07:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:57.104 19:07:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:57.104 19:07:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:57.104 19:07:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:57.104 19:07:17 -- nvmf/common.sh@294 -- # net_devs=() 00:18:57.104 19:07:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:57.104 19:07:17 -- nvmf/common.sh@295 -- # e810=() 00:18:57.105 19:07:17 -- nvmf/common.sh@295 -- # local -ga e810 00:18:57.105 19:07:17 -- nvmf/common.sh@296 -- # x722=() 00:18:57.105 19:07:17 -- nvmf/common.sh@296 -- # local -ga x722 00:18:57.105 19:07:17 -- nvmf/common.sh@297 -- # mlx=() 00:18:57.105 19:07:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:57.105 19:07:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:57.105 19:07:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:57.105 19:07:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:57.105 19:07:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:57.105 19:07:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:57.105 19:07:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:57.105 19:07:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:57.105 19:07:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:57.105 19:07:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:57.105 19:07:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:57.105 19:07:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:57.105 19:07:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:57.105 19:07:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:57.105 19:07:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:57.105 19:07:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:57.105 19:07:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:57.105 19:07:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:57.105 19:07:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:57.105 19:07:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:57.105 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:57.105 19:07:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:57.105 19:07:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:57.105 19:07:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:57.105 19:07:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:57.105 19:07:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:57.105 19:07:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:57.105 19:07:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:57.105 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:57.105 19:07:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:57.105 19:07:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:57.105 19:07:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:57.105 19:07:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:57.105 19:07:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:57.105 19:07:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:57.105 19:07:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:57.105 19:07:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:57.105 19:07:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:57.105 19:07:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:57.105 19:07:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:57.105 19:07:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:57.105 19:07:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:57.105 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:57.105 19:07:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:57.105 19:07:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:57.105 19:07:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:57.105 19:07:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:57.105 19:07:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:57.105 19:07:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:57.105 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:57.105 19:07:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:57.105 19:07:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:57.105 19:07:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:57.105 19:07:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:57.105 19:07:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:57.105 19:07:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:57.105 19:07:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:57.105 19:07:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:57.105 19:07:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:57.105 19:07:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:57.105 19:07:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:57.105 19:07:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:57.105 19:07:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:57.105 19:07:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:57.105 19:07:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:57.105 19:07:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:57.105 19:07:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:57.105 19:07:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:57.105 19:07:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:57.105 19:07:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:57.105 19:07:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:57.105 19:07:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:57.105 19:07:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:57.105 19:07:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:57.105 19:07:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:57.105 19:07:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:57.105 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:57.105 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.314 ms 00:18:57.105 00:18:57.105 --- 10.0.0.2 ping statistics --- 00:18:57.105 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:57.105 rtt min/avg/max/mdev = 0.314/0.314/0.314/0.000 ms 00:18:57.105 19:07:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:57.105 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:57.105 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.152 ms 00:18:57.105 00:18:57.105 --- 10.0.0.1 ping statistics --- 00:18:57.105 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:57.105 rtt min/avg/max/mdev = 0.152/0.152/0.152/0.000 ms 00:18:57.105 19:07:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:57.105 19:07:17 -- nvmf/common.sh@410 -- # return 0 00:18:57.105 19:07:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:57.105 19:07:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:57.105 19:07:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:57.105 19:07:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:57.105 19:07:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:57.105 19:07:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:57.105 19:07:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:57.105 19:07:17 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=234949 00:18:57.105 19:07:17 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:57.105 19:07:17 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:18:57.105 19:07:17 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 234949 00:18:57.105 19:07:17 -- common/autotest_common.sh@829 -- # '[' -z 234949 ']' 00:18:57.105 19:07:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:57.105 19:07:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:57.105 19:07:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:57.105 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:57.106 19:07:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:57.106 19:07:17 -- common/autotest_common.sh@10 -- # set +x 00:18:58.043 19:07:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:58.043 19:07:18 -- common/autotest_common.sh@862 -- # return 0 00:18:58.044 19:07:18 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:58.044 19:07:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:58.044 19:07:18 -- common/autotest_common.sh@10 -- # set +x 00:18:58.044 19:07:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:58.044 19:07:19 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:18:58.044 19:07:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:58.044 19:07:19 -- common/autotest_common.sh@10 -- # set +x 00:18:58.044 Malloc0 00:18:58.044 19:07:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:58.044 19:07:19 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:58.044 19:07:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:58.044 19:07:19 -- common/autotest_common.sh@10 -- # set +x 00:18:58.044 19:07:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:58.044 19:07:19 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:58.044 19:07:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:58.044 19:07:19 -- common/autotest_common.sh@10 -- # set +x 00:18:58.044 19:07:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:58.044 19:07:19 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:58.044 19:07:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:58.044 19:07:19 -- common/autotest_common.sh@10 -- # set +x 00:18:58.044 19:07:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:58.044 19:07:19 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:18:58.044 19:07:19 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:19:30.151 Fuzzing completed. Shutting down the fuzz application 00:19:30.151 00:19:30.151 Dumping successful admin opcodes: 00:19:30.151 8, 9, 10, 24, 00:19:30.151 Dumping successful io opcodes: 00:19:30.151 0, 9, 00:19:30.151 NS: 0x200003aeff00 I/O qp, Total commands completed: 485181, total successful commands: 2795, random_seed: 1587650432 00:19:30.151 NS: 0x200003aeff00 admin qp, Total commands completed: 57760, total successful commands: 462, random_seed: 3550052928 00:19:30.151 19:07:49 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:19:30.151 Fuzzing completed. Shutting down the fuzz application 00:19:30.151 00:19:30.151 Dumping successful admin opcodes: 00:19:30.151 24, 00:19:30.151 Dumping successful io opcodes: 00:19:30.151 00:19:30.151 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 300653274 00:19:30.151 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 300789273 00:19:30.151 19:07:51 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:30.151 19:07:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:30.151 19:07:51 -- common/autotest_common.sh@10 -- # set +x 00:19:30.151 19:07:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:30.151 19:07:51 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:19:30.151 19:07:51 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:19:30.151 19:07:51 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:30.151 19:07:51 -- nvmf/common.sh@116 -- # sync 00:19:30.151 19:07:51 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:30.151 19:07:51 -- nvmf/common.sh@119 -- # set +e 00:19:30.151 19:07:51 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:30.151 19:07:51 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:30.151 rmmod nvme_tcp 00:19:30.151 rmmod nvme_fabrics 00:19:30.151 rmmod nvme_keyring 00:19:30.151 19:07:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:30.151 19:07:51 -- nvmf/common.sh@123 -- # set -e 00:19:30.151 19:07:51 -- nvmf/common.sh@124 -- # return 0 00:19:30.151 19:07:51 -- nvmf/common.sh@477 -- # '[' -n 234949 ']' 00:19:30.151 19:07:51 -- nvmf/common.sh@478 -- # killprocess 234949 00:19:30.151 19:07:51 -- common/autotest_common.sh@936 -- # '[' -z 234949 ']' 00:19:30.151 19:07:51 -- common/autotest_common.sh@940 -- # kill -0 234949 00:19:30.151 19:07:51 -- common/autotest_common.sh@941 -- # uname 00:19:30.151 19:07:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:30.151 19:07:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 234949 00:19:30.152 19:07:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:30.152 19:07:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:30.152 19:07:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 234949' 00:19:30.152 killing process with pid 234949 00:19:30.152 19:07:51 -- common/autotest_common.sh@955 -- # kill 234949 00:19:30.152 19:07:51 -- common/autotest_common.sh@960 -- # wait 234949 00:19:30.721 19:07:51 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:30.721 19:07:51 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:30.721 19:07:51 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:30.721 19:07:51 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:30.721 19:07:51 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:30.721 19:07:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:30.721 19:07:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:30.721 19:07:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:32.627 19:07:53 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:32.627 19:07:53 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:19:32.627 00:19:32.627 real 0m37.871s 00:19:32.627 user 0m53.076s 00:19:32.627 sys 0m14.041s 00:19:32.627 19:07:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:32.627 19:07:53 -- common/autotest_common.sh@10 -- # set +x 00:19:32.627 ************************************ 00:19:32.627 END TEST nvmf_fuzz 00:19:32.627 ************************************ 00:19:32.627 19:07:53 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:19:32.627 19:07:53 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:32.627 19:07:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:32.627 19:07:53 -- common/autotest_common.sh@10 -- # set +x 00:19:32.627 ************************************ 00:19:32.627 START TEST nvmf_multiconnection 00:19:32.627 ************************************ 00:19:32.627 19:07:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:19:32.627 * Looking for test storage... 00:19:32.627 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:32.627 19:07:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:32.627 19:07:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:32.627 19:07:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:32.886 19:07:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:32.886 19:07:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:32.886 19:07:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:32.886 19:07:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:32.886 19:07:53 -- scripts/common.sh@335 -- # IFS=.-: 00:19:32.886 19:07:53 -- scripts/common.sh@335 -- # read -ra ver1 00:19:32.886 19:07:53 -- scripts/common.sh@336 -- # IFS=.-: 00:19:32.886 19:07:53 -- scripts/common.sh@336 -- # read -ra ver2 00:19:32.886 19:07:53 -- scripts/common.sh@337 -- # local 'op=<' 00:19:32.886 19:07:53 -- scripts/common.sh@339 -- # ver1_l=2 00:19:32.886 19:07:53 -- scripts/common.sh@340 -- # ver2_l=1 00:19:32.886 19:07:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:32.886 19:07:53 -- scripts/common.sh@343 -- # case "$op" in 00:19:32.886 19:07:53 -- scripts/common.sh@344 -- # : 1 00:19:32.886 19:07:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:32.886 19:07:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:32.886 19:07:53 -- scripts/common.sh@364 -- # decimal 1 00:19:32.886 19:07:53 -- scripts/common.sh@352 -- # local d=1 00:19:32.886 19:07:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:32.886 19:07:53 -- scripts/common.sh@354 -- # echo 1 00:19:32.886 19:07:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:32.886 19:07:53 -- scripts/common.sh@365 -- # decimal 2 00:19:32.886 19:07:53 -- scripts/common.sh@352 -- # local d=2 00:19:32.886 19:07:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:32.886 19:07:53 -- scripts/common.sh@354 -- # echo 2 00:19:32.886 19:07:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:32.886 19:07:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:32.886 19:07:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:32.886 19:07:53 -- scripts/common.sh@367 -- # return 0 00:19:32.886 19:07:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:32.886 19:07:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:32.886 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:32.886 --rc genhtml_branch_coverage=1 00:19:32.886 --rc genhtml_function_coverage=1 00:19:32.886 --rc genhtml_legend=1 00:19:32.886 --rc geninfo_all_blocks=1 00:19:32.886 --rc geninfo_unexecuted_blocks=1 00:19:32.886 00:19:32.886 ' 00:19:32.886 19:07:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:32.886 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:32.886 --rc genhtml_branch_coverage=1 00:19:32.886 --rc genhtml_function_coverage=1 00:19:32.886 --rc genhtml_legend=1 00:19:32.886 --rc geninfo_all_blocks=1 00:19:32.886 --rc geninfo_unexecuted_blocks=1 00:19:32.886 00:19:32.886 ' 00:19:32.886 19:07:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:32.886 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:32.886 --rc genhtml_branch_coverage=1 00:19:32.886 --rc genhtml_function_coverage=1 00:19:32.886 --rc genhtml_legend=1 00:19:32.886 --rc geninfo_all_blocks=1 00:19:32.886 --rc geninfo_unexecuted_blocks=1 00:19:32.886 00:19:32.886 ' 00:19:32.886 19:07:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:32.886 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:32.886 --rc genhtml_branch_coverage=1 00:19:32.886 --rc genhtml_function_coverage=1 00:19:32.886 --rc genhtml_legend=1 00:19:32.886 --rc geninfo_all_blocks=1 00:19:32.886 --rc geninfo_unexecuted_blocks=1 00:19:32.886 00:19:32.886 ' 00:19:32.886 19:07:53 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:32.886 19:07:53 -- nvmf/common.sh@7 -- # uname -s 00:19:32.886 19:07:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:32.886 19:07:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:32.886 19:07:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:32.886 19:07:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:32.886 19:07:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:32.886 19:07:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:32.886 19:07:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:32.886 19:07:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:32.886 19:07:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:32.886 19:07:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:32.886 19:07:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:32.886 19:07:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:32.887 19:07:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:32.887 19:07:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:32.887 19:07:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:32.887 19:07:53 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:32.887 19:07:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:32.887 19:07:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:32.887 19:07:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:32.887 19:07:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:32.887 19:07:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:32.887 19:07:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:32.887 19:07:53 -- paths/export.sh@5 -- # export PATH 00:19:32.887 19:07:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:32.887 19:07:53 -- nvmf/common.sh@46 -- # : 0 00:19:32.887 19:07:53 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:32.887 19:07:53 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:32.887 19:07:53 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:32.887 19:07:53 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:32.887 19:07:53 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:32.887 19:07:53 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:32.887 19:07:53 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:32.887 19:07:53 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:32.887 19:07:53 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:32.887 19:07:53 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:32.887 19:07:53 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:19:32.887 19:07:53 -- target/multiconnection.sh@16 -- # nvmftestinit 00:19:32.887 19:07:53 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:32.887 19:07:53 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:32.887 19:07:53 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:32.887 19:07:53 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:32.887 19:07:53 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:32.887 19:07:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:32.887 19:07:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:32.887 19:07:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:32.887 19:07:53 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:32.887 19:07:53 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:32.887 19:07:53 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:32.887 19:07:53 -- common/autotest_common.sh@10 -- # set +x 00:19:34.796 19:07:55 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:34.796 19:07:55 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:34.796 19:07:55 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:34.796 19:07:55 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:34.796 19:07:55 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:34.796 19:07:55 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:34.796 19:07:55 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:34.796 19:07:55 -- nvmf/common.sh@294 -- # net_devs=() 00:19:34.796 19:07:55 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:34.796 19:07:55 -- nvmf/common.sh@295 -- # e810=() 00:19:34.796 19:07:55 -- nvmf/common.sh@295 -- # local -ga e810 00:19:34.796 19:07:55 -- nvmf/common.sh@296 -- # x722=() 00:19:34.796 19:07:55 -- nvmf/common.sh@296 -- # local -ga x722 00:19:34.796 19:07:55 -- nvmf/common.sh@297 -- # mlx=() 00:19:34.796 19:07:55 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:34.796 19:07:55 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:34.796 19:07:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:34.796 19:07:55 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:34.796 19:07:55 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:34.796 19:07:55 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:34.796 19:07:55 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:34.796 19:07:55 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:34.796 19:07:55 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:34.796 19:07:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:34.796 19:07:55 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:34.796 19:07:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:34.796 19:07:55 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:34.796 19:07:55 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:34.796 19:07:55 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:34.796 19:07:55 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:34.796 19:07:55 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:34.796 19:07:55 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:34.796 19:07:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:34.796 19:07:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:34.796 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:34.796 19:07:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:34.797 19:07:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:34.797 19:07:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:34.797 19:07:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:34.797 19:07:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:34.797 19:07:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:34.797 19:07:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:34.797 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:34.797 19:07:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:34.797 19:07:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:34.797 19:07:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:34.797 19:07:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:34.797 19:07:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:34.797 19:07:55 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:34.797 19:07:55 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:34.797 19:07:55 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:34.797 19:07:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:34.797 19:07:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:34.797 19:07:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:34.797 19:07:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:34.797 19:07:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:34.797 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:34.797 19:07:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:34.797 19:07:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:34.797 19:07:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:34.797 19:07:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:34.797 19:07:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:34.797 19:07:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:34.797 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:34.797 19:07:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:34.797 19:07:55 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:34.797 19:07:55 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:34.797 19:07:55 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:34.797 19:07:55 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:34.797 19:07:55 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:34.797 19:07:55 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:34.797 19:07:55 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:34.797 19:07:55 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:34.797 19:07:55 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:34.797 19:07:55 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:34.797 19:07:55 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:34.797 19:07:55 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:34.797 19:07:55 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:34.797 19:07:55 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:34.797 19:07:55 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:34.797 19:07:55 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:34.797 19:07:55 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:34.797 19:07:55 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:34.797 19:07:55 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:34.797 19:07:55 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:34.797 19:07:55 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:34.797 19:07:55 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:35.055 19:07:55 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:35.055 19:07:55 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:35.055 19:07:55 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:35.055 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:35.055 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.292 ms 00:19:35.055 00:19:35.055 --- 10.0.0.2 ping statistics --- 00:19:35.055 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:35.055 rtt min/avg/max/mdev = 0.292/0.292/0.292/0.000 ms 00:19:35.055 19:07:55 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:35.055 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:35.055 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.101 ms 00:19:35.055 00:19:35.055 --- 10.0.0.1 ping statistics --- 00:19:35.055 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:35.055 rtt min/avg/max/mdev = 0.101/0.101/0.101/0.000 ms 00:19:35.055 19:07:55 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:35.055 19:07:55 -- nvmf/common.sh@410 -- # return 0 00:19:35.055 19:07:55 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:35.055 19:07:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:35.055 19:07:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:35.055 19:07:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:35.055 19:07:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:35.055 19:07:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:35.055 19:07:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:35.055 19:07:55 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:19:35.055 19:07:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:35.055 19:07:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:35.055 19:07:55 -- common/autotest_common.sh@10 -- # set +x 00:19:35.055 19:07:55 -- nvmf/common.sh@469 -- # nvmfpid=240835 00:19:35.055 19:07:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:35.055 19:07:55 -- nvmf/common.sh@470 -- # waitforlisten 240835 00:19:35.055 19:07:55 -- common/autotest_common.sh@829 -- # '[' -z 240835 ']' 00:19:35.055 19:07:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:35.055 19:07:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:35.055 19:07:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:35.055 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:35.055 19:07:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:35.055 19:07:55 -- common/autotest_common.sh@10 -- # set +x 00:19:35.055 [2024-11-28 19:07:55.939209] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:35.055 [2024-11-28 19:07:55.939291] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:35.055 EAL: No free 2048 kB hugepages reported on node 1 00:19:35.055 [2024-11-28 19:07:56.005876] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:35.313 [2024-11-28 19:07:56.122902] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:35.313 [2024-11-28 19:07:56.123059] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:35.313 [2024-11-28 19:07:56.123078] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:35.313 [2024-11-28 19:07:56.123093] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:35.313 [2024-11-28 19:07:56.123173] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:35.313 [2024-11-28 19:07:56.123230] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:35.313 [2024-11-28 19:07:56.123293] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:35.313 [2024-11-28 19:07:56.123290] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:35.884 19:07:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:35.884 19:07:56 -- common/autotest_common.sh@862 -- # return 0 00:19:36.143 19:07:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:36.143 19:07:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:36.143 19:07:56 -- common/autotest_common.sh@10 -- # set +x 00:19:36.143 19:07:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:36.143 19:07:56 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:36.143 19:07:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.143 19:07:56 -- common/autotest_common.sh@10 -- # set +x 00:19:36.143 [2024-11-28 19:07:56.954995] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:36.143 19:07:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.143 19:07:56 -- target/multiconnection.sh@21 -- # seq 1 11 00:19:36.143 19:07:56 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:36.143 19:07:56 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:19:36.143 19:07:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.143 19:07:56 -- common/autotest_common.sh@10 -- # set +x 00:19:36.143 Malloc1 00:19:36.143 19:07:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.143 19:07:56 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:19:36.143 19:07:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.143 19:07:56 -- common/autotest_common.sh@10 -- # set +x 00:19:36.143 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.143 19:07:57 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:36.143 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.143 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.143 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.143 19:07:57 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:36.143 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.143 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.143 [2024-11-28 19:07:57.012526] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:36.143 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.143 19:07:57 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:36.143 19:07:57 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:19:36.143 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.143 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.143 Malloc2 00:19:36.143 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.143 19:07:57 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:19:36.143 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.143 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.143 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.143 19:07:57 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:19:36.143 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.143 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.143 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.143 19:07:57 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:19:36.143 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.143 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.143 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.143 19:07:57 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:36.143 19:07:57 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:19:36.143 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.143 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.143 Malloc3 00:19:36.143 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.143 19:07:57 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:19:36.143 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.143 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.143 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.143 19:07:57 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:19:36.143 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.143 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.143 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.143 19:07:57 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:19:36.143 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.143 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.143 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.143 19:07:57 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:36.143 19:07:57 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:19:36.143 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.143 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.143 Malloc4 00:19:36.143 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.143 19:07:57 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:19:36.143 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.143 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.143 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.143 19:07:57 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:19:36.143 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.143 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.143 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.143 19:07:57 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:19:36.143 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.143 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.143 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.143 19:07:57 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:36.143 19:07:57 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:19:36.143 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.143 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.143 Malloc5 00:19:36.143 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.143 19:07:57 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:19:36.143 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.143 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.143 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.143 19:07:57 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:19:36.143 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.143 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.402 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.402 19:07:57 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:19:36.402 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.402 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.402 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.402 19:07:57 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:36.402 19:07:57 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:19:36.402 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.402 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.402 Malloc6 00:19:36.402 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.402 19:07:57 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:19:36.402 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.402 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.402 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.402 19:07:57 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:19:36.402 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.402 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.402 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.402 19:07:57 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:19:36.402 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.402 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.402 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.402 19:07:57 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:36.402 19:07:57 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:19:36.402 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.402 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.402 Malloc7 00:19:36.402 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.402 19:07:57 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:19:36.402 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.402 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.402 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.402 19:07:57 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:19:36.402 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.402 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.402 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.402 19:07:57 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:19:36.402 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.402 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.402 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.402 19:07:57 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:36.402 19:07:57 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:19:36.402 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.402 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.402 Malloc8 00:19:36.402 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.402 19:07:57 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:19:36.403 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.403 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.403 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.403 19:07:57 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:19:36.403 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.403 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.403 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.403 19:07:57 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:19:36.403 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.403 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.403 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.403 19:07:57 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:36.403 19:07:57 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:19:36.403 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.403 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.403 Malloc9 00:19:36.403 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.403 19:07:57 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:19:36.403 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.403 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.403 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.403 19:07:57 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:19:36.403 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.403 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.403 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.403 19:07:57 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:19:36.403 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.403 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.403 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.403 19:07:57 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:36.403 19:07:57 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:19:36.403 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.403 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.403 Malloc10 00:19:36.403 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.403 19:07:57 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:19:36.403 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.403 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.403 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.403 19:07:57 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:19:36.403 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.403 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.403 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.403 19:07:57 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:19:36.403 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.403 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.403 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.403 19:07:57 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:36.403 19:07:57 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:19:36.403 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.403 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.663 Malloc11 00:19:36.663 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.663 19:07:57 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:19:36.663 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.663 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.663 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.663 19:07:57 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:19:36.663 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.663 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.663 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.663 19:07:57 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:19:36.663 19:07:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:36.663 19:07:57 -- common/autotest_common.sh@10 -- # set +x 00:19:36.663 19:07:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:36.663 19:07:57 -- target/multiconnection.sh@28 -- # seq 1 11 00:19:36.663 19:07:57 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:36.663 19:07:57 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:37.235 19:07:58 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:19:37.235 19:07:58 -- common/autotest_common.sh@1187 -- # local i=0 00:19:37.235 19:07:58 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:37.235 19:07:58 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:37.235 19:07:58 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:39.775 19:08:00 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:39.775 19:08:00 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:39.775 19:08:00 -- common/autotest_common.sh@1196 -- # grep -c SPDK1 00:19:39.775 19:08:00 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:39.775 19:08:00 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:39.776 19:08:00 -- common/autotest_common.sh@1197 -- # return 0 00:19:39.776 19:08:00 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:39.776 19:08:00 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:19:40.036 19:08:00 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:19:40.036 19:08:00 -- common/autotest_common.sh@1187 -- # local i=0 00:19:40.036 19:08:00 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:40.036 19:08:00 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:40.036 19:08:00 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:41.947 19:08:02 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:41.947 19:08:02 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:41.947 19:08:02 -- common/autotest_common.sh@1196 -- # grep -c SPDK2 00:19:41.947 19:08:02 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:41.947 19:08:02 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:41.947 19:08:02 -- common/autotest_common.sh@1197 -- # return 0 00:19:41.947 19:08:02 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:41.947 19:08:02 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:19:42.882 19:08:03 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:19:42.882 19:08:03 -- common/autotest_common.sh@1187 -- # local i=0 00:19:42.882 19:08:03 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:42.882 19:08:03 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:42.882 19:08:03 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:44.810 19:08:05 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:44.810 19:08:05 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:44.810 19:08:05 -- common/autotest_common.sh@1196 -- # grep -c SPDK3 00:19:44.810 19:08:05 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:44.810 19:08:05 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:44.810 19:08:05 -- common/autotest_common.sh@1197 -- # return 0 00:19:44.810 19:08:05 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:44.810 19:08:05 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:19:45.493 19:08:06 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:19:45.493 19:08:06 -- common/autotest_common.sh@1187 -- # local i=0 00:19:45.493 19:08:06 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:45.493 19:08:06 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:45.493 19:08:06 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:47.525 19:08:08 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:47.525 19:08:08 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:47.525 19:08:08 -- common/autotest_common.sh@1196 -- # grep -c SPDK4 00:19:47.525 19:08:08 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:47.525 19:08:08 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:47.525 19:08:08 -- common/autotest_common.sh@1197 -- # return 0 00:19:47.525 19:08:08 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:47.525 19:08:08 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:19:48.160 19:08:09 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:19:48.160 19:08:09 -- common/autotest_common.sh@1187 -- # local i=0 00:19:48.160 19:08:09 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:48.160 19:08:09 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:48.160 19:08:09 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:50.696 19:08:11 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:50.696 19:08:11 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:50.696 19:08:11 -- common/autotest_common.sh@1196 -- # grep -c SPDK5 00:19:50.696 19:08:11 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:50.696 19:08:11 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:50.696 19:08:11 -- common/autotest_common.sh@1197 -- # return 0 00:19:50.696 19:08:11 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:50.696 19:08:11 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:19:51.265 19:08:12 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:19:51.265 19:08:12 -- common/autotest_common.sh@1187 -- # local i=0 00:19:51.265 19:08:12 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:51.265 19:08:12 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:51.265 19:08:12 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:53.171 19:08:14 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:53.171 19:08:14 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:53.171 19:08:14 -- common/autotest_common.sh@1196 -- # grep -c SPDK6 00:19:53.171 19:08:14 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:53.171 19:08:14 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:53.171 19:08:14 -- common/autotest_common.sh@1197 -- # return 0 00:19:53.171 19:08:14 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:53.171 19:08:14 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:19:53.740 19:08:14 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:19:53.740 19:08:14 -- common/autotest_common.sh@1187 -- # local i=0 00:19:53.740 19:08:14 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:53.740 19:08:14 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:53.740 19:08:14 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:56.276 19:08:16 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:56.276 19:08:16 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:56.276 19:08:16 -- common/autotest_common.sh@1196 -- # grep -c SPDK7 00:19:56.276 19:08:16 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:56.276 19:08:16 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:56.276 19:08:16 -- common/autotest_common.sh@1197 -- # return 0 00:19:56.276 19:08:16 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:56.276 19:08:16 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:19:56.844 19:08:17 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:19:56.844 19:08:17 -- common/autotest_common.sh@1187 -- # local i=0 00:19:56.844 19:08:17 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:56.844 19:08:17 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:56.844 19:08:17 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:58.750 19:08:19 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:58.750 19:08:19 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:58.750 19:08:19 -- common/autotest_common.sh@1196 -- # grep -c SPDK8 00:19:58.750 19:08:19 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:58.750 19:08:19 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:58.750 19:08:19 -- common/autotest_common.sh@1197 -- # return 0 00:19:58.750 19:08:19 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:19:58.750 19:08:19 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:19:59.694 19:08:20 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:19:59.694 19:08:20 -- common/autotest_common.sh@1187 -- # local i=0 00:19:59.694 19:08:20 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:59.694 19:08:20 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:59.694 19:08:20 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:01.591 19:08:22 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:01.591 19:08:22 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:01.591 19:08:22 -- common/autotest_common.sh@1196 -- # grep -c SPDK9 00:20:01.592 19:08:22 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:01.592 19:08:22 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:01.592 19:08:22 -- common/autotest_common.sh@1197 -- # return 0 00:20:01.592 19:08:22 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:01.592 19:08:22 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:20:02.969 19:08:23 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:20:02.969 19:08:23 -- common/autotest_common.sh@1187 -- # local i=0 00:20:02.969 19:08:23 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:02.969 19:08:23 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:20:02.969 19:08:23 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:04.874 19:08:25 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:04.874 19:08:25 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:04.874 19:08:25 -- common/autotest_common.sh@1196 -- # grep -c SPDK10 00:20:04.874 19:08:25 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:04.874 19:08:25 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:04.874 19:08:25 -- common/autotest_common.sh@1197 -- # return 0 00:20:04.874 19:08:25 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:04.874 19:08:25 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:20:05.441 19:08:26 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:20:05.441 19:08:26 -- common/autotest_common.sh@1187 -- # local i=0 00:20:05.441 19:08:26 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:05.441 19:08:26 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:20:05.441 19:08:26 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:07.975 19:08:28 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:07.975 19:08:28 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:07.975 19:08:28 -- common/autotest_common.sh@1196 -- # grep -c SPDK11 00:20:07.975 19:08:28 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:07.975 19:08:28 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:07.975 19:08:28 -- common/autotest_common.sh@1197 -- # return 0 00:20:07.975 19:08:28 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:20:07.975 [global] 00:20:07.975 thread=1 00:20:07.975 invalidate=1 00:20:07.975 rw=read 00:20:07.975 time_based=1 00:20:07.975 runtime=10 00:20:07.975 ioengine=libaio 00:20:07.975 direct=1 00:20:07.975 bs=262144 00:20:07.975 iodepth=64 00:20:07.975 norandommap=1 00:20:07.975 numjobs=1 00:20:07.975 00:20:07.975 [job0] 00:20:07.975 filename=/dev/nvme0n1 00:20:07.975 [job1] 00:20:07.975 filename=/dev/nvme10n1 00:20:07.975 [job2] 00:20:07.975 filename=/dev/nvme1n1 00:20:07.975 [job3] 00:20:07.975 filename=/dev/nvme2n1 00:20:07.975 [job4] 00:20:07.975 filename=/dev/nvme3n1 00:20:07.976 [job5] 00:20:07.976 filename=/dev/nvme4n1 00:20:07.976 [job6] 00:20:07.976 filename=/dev/nvme5n1 00:20:07.976 [job7] 00:20:07.976 filename=/dev/nvme6n1 00:20:07.976 [job8] 00:20:07.976 filename=/dev/nvme7n1 00:20:07.976 [job9] 00:20:07.976 filename=/dev/nvme8n1 00:20:07.976 [job10] 00:20:07.976 filename=/dev/nvme9n1 00:20:07.976 Could not set queue depth (nvme0n1) 00:20:07.976 Could not set queue depth (nvme10n1) 00:20:07.976 Could not set queue depth (nvme1n1) 00:20:07.976 Could not set queue depth (nvme2n1) 00:20:07.976 Could not set queue depth (nvme3n1) 00:20:07.976 Could not set queue depth (nvme4n1) 00:20:07.976 Could not set queue depth (nvme5n1) 00:20:07.976 Could not set queue depth (nvme6n1) 00:20:07.976 Could not set queue depth (nvme7n1) 00:20:07.976 Could not set queue depth (nvme8n1) 00:20:07.976 Could not set queue depth (nvme9n1) 00:20:07.976 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:07.976 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:07.976 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:07.976 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:07.976 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:07.976 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:07.976 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:07.976 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:07.976 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:07.976 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:07.976 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:07.976 fio-3.35 00:20:07.976 Starting 11 threads 00:20:20.187 00:20:20.187 job0: (groupid=0, jobs=1): err= 0: pid=245375: Thu Nov 28 19:08:39 2024 00:20:20.187 read: IOPS=677, BW=169MiB/s (178MB/s)(1707MiB/10070msec) 00:20:20.187 slat (usec): min=10, max=109903, avg=1255.55, stdev=4877.86 00:20:20.187 clat (usec): min=860, max=272817, avg=93086.36, stdev=47102.58 00:20:20.187 lat (usec): min=924, max=288852, avg=94341.91, stdev=47811.56 00:20:20.187 clat percentiles (msec): 00:20:20.187 | 1.00th=[ 6], 5.00th=[ 17], 10.00th=[ 29], 20.00th=[ 47], 00:20:20.187 | 30.00th=[ 68], 40.00th=[ 81], 50.00th=[ 92], 60.00th=[ 105], 00:20:20.187 | 70.00th=[ 117], 80.00th=[ 138], 90.00th=[ 161], 95.00th=[ 171], 00:20:20.187 | 99.00th=[ 184], 99.50th=[ 192], 99.90th=[ 215], 99.95th=[ 257], 00:20:20.187 | 99.99th=[ 275] 00:20:20.187 bw ( KiB/s): min=81408, max=298496, per=8.43%, avg=173149.15, stdev=56230.57, samples=20 00:20:20.187 iops : min= 318, max= 1166, avg=676.35, stdev=219.65, samples=20 00:20:20.187 lat (usec) : 1000=0.01% 00:20:20.187 lat (msec) : 2=0.01%, 4=0.41%, 10=2.86%, 20=3.65%, 50=14.09% 00:20:20.187 lat (msec) : 100=35.32%, 250=43.58%, 500=0.06% 00:20:20.187 cpu : usr=0.35%, sys=2.48%, ctx=1384, majf=0, minf=4097 00:20:20.187 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:20:20.187 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:20.187 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:20.187 issued rwts: total=6826,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:20.187 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:20.187 job1: (groupid=0, jobs=1): err= 0: pid=245376: Thu Nov 28 19:08:39 2024 00:20:20.187 read: IOPS=572, BW=143MiB/s (150MB/s)(1449MiB/10114msec) 00:20:20.187 slat (usec): min=13, max=60926, avg=1574.05, stdev=4572.87 00:20:20.187 clat (msec): min=16, max=277, avg=110.05, stdev=38.37 00:20:20.187 lat (msec): min=16, max=277, avg=111.62, stdev=38.90 00:20:20.187 clat percentiles (msec): 00:20:20.187 | 1.00th=[ 27], 5.00th=[ 59], 10.00th=[ 69], 20.00th=[ 78], 00:20:20.187 | 30.00th=[ 87], 40.00th=[ 95], 50.00th=[ 104], 60.00th=[ 113], 00:20:20.187 | 70.00th=[ 127], 80.00th=[ 146], 90.00th=[ 167], 95.00th=[ 180], 00:20:20.187 | 99.00th=[ 205], 99.50th=[ 230], 99.90th=[ 266], 99.95th=[ 266], 00:20:20.187 | 99.99th=[ 279] 00:20:20.187 bw ( KiB/s): min=90112, max=213504, per=7.14%, avg=146725.35, stdev=36774.30, samples=20 00:20:20.187 iops : min= 352, max= 834, avg=573.10, stdev=143.69, samples=20 00:20:20.187 lat (msec) : 20=0.12%, 50=2.66%, 100=44.32%, 250=52.73%, 500=0.17% 00:20:20.187 cpu : usr=0.48%, sys=2.01%, ctx=1215, majf=0, minf=4097 00:20:20.187 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:20:20.187 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:20.187 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:20.188 issued rwts: total=5794,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:20.188 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:20.188 job2: (groupid=0, jobs=1): err= 0: pid=245378: Thu Nov 28 19:08:39 2024 00:20:20.188 read: IOPS=653, BW=163MiB/s (171MB/s)(1651MiB/10109msec) 00:20:20.188 slat (usec): min=8, max=78450, avg=870.31, stdev=4166.32 00:20:20.188 clat (usec): min=1244, max=258697, avg=97051.89, stdev=46126.63 00:20:20.188 lat (usec): min=1267, max=258726, avg=97922.20, stdev=46725.15 00:20:20.188 clat percentiles (msec): 00:20:20.188 | 1.00th=[ 8], 5.00th=[ 23], 10.00th=[ 36], 20.00th=[ 56], 00:20:20.188 | 30.00th=[ 72], 40.00th=[ 82], 50.00th=[ 94], 60.00th=[ 108], 00:20:20.188 | 70.00th=[ 122], 80.00th=[ 148], 90.00th=[ 163], 95.00th=[ 171], 00:20:20.188 | 99.00th=[ 184], 99.50th=[ 188], 99.90th=[ 236], 99.95th=[ 259], 00:20:20.188 | 99.99th=[ 259] 00:20:20.188 bw ( KiB/s): min=92672, max=305664, per=8.15%, avg=167372.80, stdev=55124.29, samples=20 00:20:20.188 iops : min= 362, max= 1194, avg=653.80, stdev=215.33, samples=20 00:20:20.188 lat (msec) : 2=0.02%, 4=0.15%, 10=1.45%, 20=2.39%, 50=12.97% 00:20:20.188 lat (msec) : 100=37.46%, 250=45.47%, 500=0.09% 00:20:20.188 cpu : usr=0.37%, sys=1.75%, ctx=1520, majf=0, minf=4097 00:20:20.188 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:20:20.188 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:20.188 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:20.188 issued rwts: total=6602,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:20.188 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:20.188 job3: (groupid=0, jobs=1): err= 0: pid=245384: Thu Nov 28 19:08:39 2024 00:20:20.188 read: IOPS=818, BW=205MiB/s (214MB/s)(2069MiB/10114msec) 00:20:20.188 slat (usec): min=9, max=77962, avg=919.60, stdev=3681.53 00:20:20.188 clat (msec): min=2, max=288, avg=77.24, stdev=47.68 00:20:20.188 lat (msec): min=2, max=296, avg=78.16, stdev=48.34 00:20:20.188 clat percentiles (msec): 00:20:20.188 | 1.00th=[ 6], 5.00th=[ 16], 10.00th=[ 27], 20.00th=[ 36], 00:20:20.188 | 30.00th=[ 48], 40.00th=[ 55], 50.00th=[ 62], 60.00th=[ 72], 00:20:20.188 | 70.00th=[ 103], 80.00th=[ 125], 90.00th=[ 153], 95.00th=[ 169], 00:20:20.188 | 99.00th=[ 186], 99.50th=[ 194], 99.90th=[ 275], 99.95th=[ 275], 00:20:20.188 | 99.99th=[ 288] 00:20:20.188 bw ( KiB/s): min=88576, max=462848, per=10.24%, avg=210201.60, stdev=105765.98, samples=20 00:20:20.188 iops : min= 346, max= 1808, avg=821.10, stdev=413.15, samples=20 00:20:20.188 lat (msec) : 4=0.19%, 10=1.52%, 20=4.86%, 50=26.48%, 100=36.17% 00:20:20.188 lat (msec) : 250=30.64%, 500=0.13% 00:20:20.188 cpu : usr=0.38%, sys=2.59%, ctx=1604, majf=0, minf=3721 00:20:20.188 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:20:20.188 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:20.188 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:20.188 issued rwts: total=8274,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:20.188 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:20.188 job4: (groupid=0, jobs=1): err= 0: pid=245385: Thu Nov 28 19:08:39 2024 00:20:20.188 read: IOPS=837, BW=209MiB/s (219MB/s)(2107MiB/10069msec) 00:20:20.188 slat (usec): min=8, max=84295, avg=845.69, stdev=3315.86 00:20:20.188 clat (usec): min=1724, max=267158, avg=75552.60, stdev=37572.07 00:20:20.188 lat (usec): min=1796, max=267173, avg=76398.29, stdev=38050.77 00:20:20.188 clat percentiles (msec): 00:20:20.188 | 1.00th=[ 13], 5.00th=[ 25], 10.00th=[ 32], 20.00th=[ 44], 00:20:20.188 | 30.00th=[ 54], 40.00th=[ 62], 50.00th=[ 70], 60.00th=[ 81], 00:20:20.188 | 70.00th=[ 89], 80.00th=[ 104], 90.00th=[ 129], 95.00th=[ 150], 00:20:20.188 | 99.00th=[ 184], 99.50th=[ 197], 99.90th=[ 209], 99.95th=[ 228], 00:20:20.188 | 99.99th=[ 268] 00:20:20.188 bw ( KiB/s): min=111104, max=395264, per=10.43%, avg=214156.20, stdev=73964.54, samples=20 00:20:20.188 iops : min= 434, max= 1544, avg=836.50, stdev=288.98, samples=20 00:20:20.188 lat (msec) : 2=0.01%, 4=0.06%, 10=0.50%, 20=2.67%, 50=22.64% 00:20:20.188 lat (msec) : 100=52.08%, 250=22.02%, 500=0.02% 00:20:20.188 cpu : usr=0.43%, sys=2.62%, ctx=1818, majf=0, minf=4097 00:20:20.188 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:20:20.188 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:20.188 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:20.188 issued rwts: total=8429,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:20.188 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:20.188 job5: (groupid=0, jobs=1): err= 0: pid=245386: Thu Nov 28 19:08:39 2024 00:20:20.188 read: IOPS=719, BW=180MiB/s (189MB/s)(1819MiB/10109msec) 00:20:20.188 slat (usec): min=9, max=84575, avg=787.88, stdev=4055.56 00:20:20.188 clat (usec): min=1387, max=311238, avg=88078.83, stdev=52099.18 00:20:20.188 lat (usec): min=1418, max=311257, avg=88866.70, stdev=52703.25 00:20:20.188 clat percentiles (msec): 00:20:20.188 | 1.00th=[ 5], 5.00th=[ 15], 10.00th=[ 23], 20.00th=[ 30], 00:20:20.188 | 30.00th=[ 51], 40.00th=[ 71], 50.00th=[ 88], 60.00th=[ 106], 00:20:20.188 | 70.00th=[ 118], 80.00th=[ 134], 90.00th=[ 161], 95.00th=[ 176], 00:20:20.188 | 99.00th=[ 197], 99.50th=[ 213], 99.90th=[ 247], 99.95th=[ 271], 00:20:20.188 | 99.99th=[ 313] 00:20:20.188 bw ( KiB/s): min=92672, max=470016, per=8.99%, avg=184601.60, stdev=84135.84, samples=20 00:20:20.188 iops : min= 362, max= 1836, avg=721.10, stdev=328.66, samples=20 00:20:20.188 lat (msec) : 2=0.18%, 4=0.71%, 10=2.16%, 20=5.61%, 50=21.28% 00:20:20.188 lat (msec) : 100=26.88%, 250=43.10%, 500=0.08% 00:20:20.188 cpu : usr=0.37%, sys=1.94%, ctx=1739, majf=0, minf=4097 00:20:20.188 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:20:20.188 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:20.188 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:20.188 issued rwts: total=7274,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:20.188 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:20.188 job6: (groupid=0, jobs=1): err= 0: pid=245389: Thu Nov 28 19:08:39 2024 00:20:20.188 read: IOPS=1061, BW=265MiB/s (278MB/s)(2658MiB/10012msec) 00:20:20.188 slat (usec): min=9, max=73139, avg=819.87, stdev=2903.69 00:20:20.188 clat (usec): min=1695, max=210185, avg=59414.47, stdev=39571.09 00:20:20.188 lat (usec): min=1713, max=236194, avg=60234.34, stdev=40131.63 00:20:20.188 clat percentiles (msec): 00:20:20.188 | 1.00th=[ 7], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 29], 00:20:20.188 | 30.00th=[ 31], 40.00th=[ 35], 50.00th=[ 46], 60.00th=[ 57], 00:20:20.188 | 70.00th=[ 71], 80.00th=[ 93], 90.00th=[ 121], 95.00th=[ 144], 00:20:20.188 | 99.00th=[ 178], 99.50th=[ 184], 99.90th=[ 194], 99.95th=[ 207], 00:20:20.188 | 99.99th=[ 211] 00:20:20.188 bw ( KiB/s): min=113664, max=539136, per=13.17%, avg=270501.75, stdev=138508.60, samples=20 00:20:20.188 iops : min= 444, max= 2106, avg=1056.60, stdev=541.10, samples=20 00:20:20.188 lat (msec) : 2=0.01%, 4=0.28%, 10=1.53%, 20=2.27%, 50=49.63% 00:20:20.188 lat (msec) : 100=28.68%, 250=17.59% 00:20:20.188 cpu : usr=0.47%, sys=3.39%, ctx=2040, majf=0, minf=4097 00:20:20.188 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:20:20.188 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:20.188 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:20.188 issued rwts: total=10630,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:20.188 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:20.188 job7: (groupid=0, jobs=1): err= 0: pid=245390: Thu Nov 28 19:08:39 2024 00:20:20.188 read: IOPS=741, BW=185MiB/s (194MB/s)(1856MiB/10013msec) 00:20:20.188 slat (usec): min=9, max=71341, avg=1086.34, stdev=3764.31 00:20:20.188 clat (msec): min=10, max=233, avg=85.16, stdev=42.47 00:20:20.188 lat (msec): min=13, max=233, avg=86.24, stdev=43.04 00:20:20.188 clat percentiles (msec): 00:20:20.188 | 1.00th=[ 24], 5.00th=[ 28], 10.00th=[ 31], 20.00th=[ 36], 00:20:20.188 | 30.00th=[ 57], 40.00th=[ 70], 50.00th=[ 88], 60.00th=[ 101], 00:20:20.188 | 70.00th=[ 110], 80.00th=[ 122], 90.00th=[ 144], 95.00th=[ 161], 00:20:20.188 | 99.00th=[ 178], 99.50th=[ 184], 99.90th=[ 207], 99.95th=[ 226], 00:20:20.188 | 99.99th=[ 234] 00:20:20.188 bw ( KiB/s): min=101888, max=503808, per=9.18%, avg=188467.20, stdev=105472.77, samples=20 00:20:20.188 iops : min= 398, max= 1968, avg=736.20, stdev=412.00, samples=20 00:20:20.188 lat (msec) : 20=0.39%, 50=27.11%, 100=31.77%, 250=40.73% 00:20:20.188 cpu : usr=0.50%, sys=2.04%, ctx=1491, majf=0, minf=4097 00:20:20.188 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:20:20.188 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:20.188 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:20.188 issued rwts: total=7425,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:20.188 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:20.188 job8: (groupid=0, jobs=1): err= 0: pid=245391: Thu Nov 28 19:08:39 2024 00:20:20.188 read: IOPS=771, BW=193MiB/s (202MB/s)(1943MiB/10069msec) 00:20:20.188 slat (usec): min=10, max=71172, avg=1157.56, stdev=3589.03 00:20:20.188 clat (msec): min=2, max=241, avg=81.71, stdev=39.00 00:20:20.188 lat (msec): min=2, max=241, avg=82.87, stdev=39.46 00:20:20.188 clat percentiles (msec): 00:20:20.188 | 1.00th=[ 10], 5.00th=[ 31], 10.00th=[ 35], 20.00th=[ 52], 00:20:20.188 | 30.00th=[ 58], 40.00th=[ 65], 50.00th=[ 74], 60.00th=[ 86], 00:20:20.188 | 70.00th=[ 100], 80.00th=[ 113], 90.00th=[ 134], 95.00th=[ 159], 00:20:20.188 | 99.00th=[ 186], 99.50th=[ 201], 99.90th=[ 239], 99.95th=[ 241], 00:20:20.188 | 99.99th=[ 243] 00:20:20.188 bw ( KiB/s): min=106496, max=372736, per=9.61%, avg=197320.10, stdev=75257.14, samples=20 00:20:20.188 iops : min= 416, max= 1456, avg=770.75, stdev=293.97, samples=20 00:20:20.188 lat (msec) : 4=0.19%, 10=0.85%, 20=1.04%, 50=16.76%, 100=51.65% 00:20:20.188 lat (msec) : 250=29.51% 00:20:20.188 cpu : usr=0.49%, sys=2.42%, ctx=1481, majf=0, minf=4097 00:20:20.188 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:20:20.188 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:20.188 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:20.188 issued rwts: total=7770,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:20.188 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:20.188 job9: (groupid=0, jobs=1): err= 0: pid=245394: Thu Nov 28 19:08:39 2024 00:20:20.188 read: IOPS=613, BW=153MiB/s (161MB/s)(1545MiB/10074msec) 00:20:20.188 slat (usec): min=13, max=44426, avg=1355.04, stdev=4077.85 00:20:20.188 clat (msec): min=5, max=209, avg=102.91, stdev=40.45 00:20:20.188 lat (msec): min=5, max=210, avg=104.26, stdev=40.97 00:20:20.188 clat percentiles (msec): 00:20:20.189 | 1.00th=[ 20], 5.00th=[ 32], 10.00th=[ 40], 20.00th=[ 69], 00:20:20.189 | 30.00th=[ 83], 40.00th=[ 95], 50.00th=[ 104], 60.00th=[ 113], 00:20:20.189 | 70.00th=[ 125], 80.00th=[ 142], 90.00th=[ 159], 95.00th=[ 167], 00:20:20.189 | 99.00th=[ 186], 99.50th=[ 190], 99.90th=[ 201], 99.95th=[ 201], 00:20:20.189 | 99.99th=[ 209] 00:20:20.189 bw ( KiB/s): min=103424, max=254464, per=7.62%, avg=156544.00, stdev=49028.30, samples=20 00:20:20.189 iops : min= 404, max= 994, avg=611.50, stdev=191.52, samples=20 00:20:20.189 lat (msec) : 10=0.06%, 20=0.97%, 50=10.52%, 100=34.38%, 250=54.06% 00:20:20.189 cpu : usr=0.41%, sys=2.12%, ctx=1333, majf=0, minf=4097 00:20:20.189 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:20:20.189 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:20.189 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:20.189 issued rwts: total=6178,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:20.189 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:20.189 job10: (groupid=0, jobs=1): err= 0: pid=245395: Thu Nov 28 19:08:39 2024 00:20:20.189 read: IOPS=586, BW=147MiB/s (154MB/s)(1483MiB/10108msec) 00:20:20.189 slat (usec): min=9, max=79897, avg=1412.71, stdev=4498.77 00:20:20.189 clat (msec): min=8, max=264, avg=107.55, stdev=40.54 00:20:20.189 lat (msec): min=8, max=292, avg=108.96, stdev=41.19 00:20:20.189 clat percentiles (msec): 00:20:20.189 | 1.00th=[ 27], 5.00th=[ 45], 10.00th=[ 56], 20.00th=[ 72], 00:20:20.189 | 30.00th=[ 84], 40.00th=[ 94], 50.00th=[ 106], 60.00th=[ 117], 00:20:20.189 | 70.00th=[ 130], 80.00th=[ 146], 90.00th=[ 165], 95.00th=[ 178], 00:20:20.189 | 99.00th=[ 190], 99.50th=[ 201], 99.90th=[ 255], 99.95th=[ 266], 00:20:20.189 | 99.99th=[ 266] 00:20:20.189 bw ( KiB/s): min=95232, max=240128, per=7.32%, avg=150258.10, stdev=42198.09, samples=20 00:20:20.189 iops : min= 372, max= 938, avg=586.90, stdev=164.87, samples=20 00:20:20.189 lat (msec) : 10=0.02%, 20=0.57%, 50=6.61%, 100=38.15%, 250=54.52% 00:20:20.189 lat (msec) : 500=0.13% 00:20:20.189 cpu : usr=0.47%, sys=1.93%, ctx=1374, majf=0, minf=4097 00:20:20.189 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:20:20.189 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:20.189 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:20.189 issued rwts: total=5932,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:20.189 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:20.189 00:20:20.189 Run status group 0 (all jobs): 00:20:20.189 READ: bw=2005MiB/s (2103MB/s), 143MiB/s-265MiB/s (150MB/s-278MB/s), io=19.8GiB (21.3GB), run=10012-10114msec 00:20:20.189 00:20:20.189 Disk stats (read/write): 00:20:20.189 nvme0n1: ios=13381/0, merge=0/0, ticks=1234938/0, in_queue=1234938, util=97.06% 00:20:20.189 nvme10n1: ios=11418/0, merge=0/0, ticks=1226715/0, in_queue=1226715, util=97.29% 00:20:20.189 nvme1n1: ios=12978/0, merge=0/0, ticks=1233774/0, in_queue=1233774, util=97.60% 00:20:20.189 nvme2n1: ios=16354/0, merge=0/0, ticks=1228904/0, in_queue=1228904, util=97.76% 00:20:20.189 nvme3n1: ios=16648/0, merge=0/0, ticks=1237831/0, in_queue=1237831, util=97.82% 00:20:20.189 nvme4n1: ios=14393/0, merge=0/0, ticks=1237370/0, in_queue=1237370, util=98.20% 00:20:20.189 nvme5n1: ios=20854/0, merge=0/0, ticks=1237622/0, in_queue=1237622, util=98.33% 00:20:20.189 nvme6n1: ios=14456/0, merge=0/0, ticks=1239201/0, in_queue=1239201, util=98.46% 00:20:20.189 nvme7n1: ios=15318/0, merge=0/0, ticks=1232820/0, in_queue=1232820, util=98.89% 00:20:20.189 nvme8n1: ios=12159/0, merge=0/0, ticks=1231688/0, in_queue=1231688, util=99.10% 00:20:20.189 nvme9n1: ios=11653/0, merge=0/0, ticks=1227442/0, in_queue=1227442, util=99.24% 00:20:20.189 19:08:39 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:20:20.189 [global] 00:20:20.189 thread=1 00:20:20.189 invalidate=1 00:20:20.189 rw=randwrite 00:20:20.189 time_based=1 00:20:20.189 runtime=10 00:20:20.189 ioengine=libaio 00:20:20.189 direct=1 00:20:20.189 bs=262144 00:20:20.189 iodepth=64 00:20:20.189 norandommap=1 00:20:20.189 numjobs=1 00:20:20.189 00:20:20.189 [job0] 00:20:20.189 filename=/dev/nvme0n1 00:20:20.189 [job1] 00:20:20.189 filename=/dev/nvme10n1 00:20:20.189 [job2] 00:20:20.189 filename=/dev/nvme1n1 00:20:20.189 [job3] 00:20:20.189 filename=/dev/nvme2n1 00:20:20.189 [job4] 00:20:20.189 filename=/dev/nvme3n1 00:20:20.189 [job5] 00:20:20.189 filename=/dev/nvme4n1 00:20:20.189 [job6] 00:20:20.189 filename=/dev/nvme5n1 00:20:20.189 [job7] 00:20:20.189 filename=/dev/nvme6n1 00:20:20.189 [job8] 00:20:20.189 filename=/dev/nvme7n1 00:20:20.189 [job9] 00:20:20.189 filename=/dev/nvme8n1 00:20:20.189 [job10] 00:20:20.189 filename=/dev/nvme9n1 00:20:20.189 Could not set queue depth (nvme0n1) 00:20:20.189 Could not set queue depth (nvme10n1) 00:20:20.189 Could not set queue depth (nvme1n1) 00:20:20.189 Could not set queue depth (nvme2n1) 00:20:20.189 Could not set queue depth (nvme3n1) 00:20:20.189 Could not set queue depth (nvme4n1) 00:20:20.189 Could not set queue depth (nvme5n1) 00:20:20.189 Could not set queue depth (nvme6n1) 00:20:20.189 Could not set queue depth (nvme7n1) 00:20:20.189 Could not set queue depth (nvme8n1) 00:20:20.189 Could not set queue depth (nvme9n1) 00:20:20.189 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:20.189 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:20.189 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:20.189 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:20.189 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:20.189 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:20.189 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:20.189 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:20.189 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:20.189 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:20.189 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:20:20.189 fio-3.35 00:20:20.189 Starting 11 threads 00:20:30.163 00:20:30.163 job0: (groupid=0, jobs=1): err= 0: pid=246586: Thu Nov 28 19:08:50 2024 00:20:30.163 write: IOPS=624, BW=156MiB/s (164MB/s)(1586MiB/10157msec); 0 zone resets 00:20:30.163 slat (usec): min=16, max=63479, avg=1267.12, stdev=2935.05 00:20:30.163 clat (usec): min=943, max=307839, avg=101104.11, stdev=46546.90 00:20:30.163 lat (usec): min=1015, max=318983, avg=102371.23, stdev=47051.77 00:20:30.163 clat percentiles (msec): 00:20:30.163 | 1.00th=[ 9], 5.00th=[ 40], 10.00th=[ 42], 20.00th=[ 54], 00:20:30.163 | 30.00th=[ 74], 40.00th=[ 85], 50.00th=[ 107], 60.00th=[ 114], 00:20:30.163 | 70.00th=[ 123], 80.00th=[ 142], 90.00th=[ 159], 95.00th=[ 180], 00:20:30.163 | 99.00th=[ 228], 99.50th=[ 243], 99.90th=[ 300], 99.95th=[ 309], 00:20:30.163 | 99.99th=[ 309] 00:20:30.163 bw ( KiB/s): min=91318, max=286720, per=10.27%, avg=160708.95, stdev=59682.60, samples=20 00:20:30.163 iops : min= 356, max= 1120, avg=627.65, stdev=233.20, samples=20 00:20:30.163 lat (usec) : 1000=0.02% 00:20:30.163 lat (msec) : 2=0.09%, 4=0.27%, 10=0.68%, 20=0.74%, 50=16.93% 00:20:30.163 lat (msec) : 100=27.39%, 250=53.48%, 500=0.39% 00:20:30.163 cpu : usr=1.87%, sys=1.74%, ctx=2588, majf=0, minf=1 00:20:30.163 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:20:30.163 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:30.163 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:30.163 issued rwts: total=0,6342,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:30.163 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:30.163 job1: (groupid=0, jobs=1): err= 0: pid=246598: Thu Nov 28 19:08:50 2024 00:20:30.163 write: IOPS=544, BW=136MiB/s (143MB/s)(1385MiB/10170msec); 0 zone resets 00:20:30.163 slat (usec): min=14, max=56029, avg=1218.98, stdev=3176.14 00:20:30.163 clat (usec): min=1519, max=335902, avg=116219.80, stdev=52021.79 00:20:30.163 lat (usec): min=1579, max=335990, avg=117438.78, stdev=52637.31 00:20:30.163 clat percentiles (msec): 00:20:30.163 | 1.00th=[ 16], 5.00th=[ 31], 10.00th=[ 47], 20.00th=[ 74], 00:20:30.163 | 30.00th=[ 89], 40.00th=[ 105], 50.00th=[ 117], 60.00th=[ 125], 00:20:30.163 | 70.00th=[ 138], 80.00th=[ 159], 90.00th=[ 186], 95.00th=[ 207], 00:20:30.163 | 99.00th=[ 253], 99.50th=[ 271], 99.90th=[ 330], 99.95th=[ 334], 00:20:30.163 | 99.99th=[ 338] 00:20:30.163 bw ( KiB/s): min=79872, max=196608, per=8.96%, avg=140197.30, stdev=32430.44, samples=20 00:20:30.163 iops : min= 312, max= 768, avg=547.60, stdev=126.68, samples=20 00:20:30.163 lat (msec) : 2=0.02%, 4=0.05%, 10=0.45%, 20=1.48%, 50=9.01% 00:20:30.163 lat (msec) : 100=25.94%, 250=61.84%, 500=1.21% 00:20:30.163 cpu : usr=1.59%, sys=1.63%, ctx=3060, majf=0, minf=1 00:20:30.163 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:20:30.163 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:30.163 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:30.163 issued rwts: total=0,5540,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:30.163 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:30.163 job2: (groupid=0, jobs=1): err= 0: pid=246599: Thu Nov 28 19:08:50 2024 00:20:30.163 write: IOPS=470, BW=118MiB/s (123MB/s)(1192MiB/10142msec); 0 zone resets 00:20:30.163 slat (usec): min=19, max=179410, avg=1634.98, stdev=4993.62 00:20:30.163 clat (usec): min=1867, max=398333, avg=134432.10, stdev=59153.02 00:20:30.163 lat (usec): min=1906, max=398380, avg=136067.08, stdev=59940.96 00:20:30.163 clat percentiles (msec): 00:20:30.163 | 1.00th=[ 10], 5.00th=[ 27], 10.00th=[ 46], 20.00th=[ 89], 00:20:30.163 | 30.00th=[ 114], 40.00th=[ 125], 50.00th=[ 140], 60.00th=[ 150], 00:20:30.163 | 70.00th=[ 163], 80.00th=[ 178], 90.00th=[ 201], 95.00th=[ 232], 00:20:30.163 | 99.00th=[ 292], 99.50th=[ 338], 99.90th=[ 388], 99.95th=[ 393], 00:20:30.163 | 99.99th=[ 397] 00:20:30.163 bw ( KiB/s): min=69632, max=220160, per=7.69%, avg=120385.65, stdev=38789.07, samples=20 00:20:30.163 iops : min= 272, max= 860, avg=470.25, stdev=151.52, samples=20 00:20:30.163 lat (msec) : 2=0.02%, 4=0.08%, 10=0.99%, 20=2.50%, 50=7.49% 00:20:30.163 lat (msec) : 100=11.41%, 250=75.18%, 500=2.33% 00:20:30.163 cpu : usr=1.46%, sys=1.39%, ctx=2386, majf=0, minf=1 00:20:30.163 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:20:30.163 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:30.163 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:30.163 issued rwts: total=0,4767,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:30.163 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:30.163 job3: (groupid=0, jobs=1): err= 0: pid=246601: Thu Nov 28 19:08:50 2024 00:20:30.163 write: IOPS=583, BW=146MiB/s (153MB/s)(1468MiB/10056msec); 0 zone resets 00:20:30.163 slat (usec): min=16, max=43201, avg=1059.96, stdev=3145.66 00:20:30.163 clat (usec): min=817, max=268512, avg=108483.72, stdev=59977.52 00:20:30.163 lat (usec): min=853, max=270149, avg=109543.69, stdev=60691.40 00:20:30.163 clat percentiles (msec): 00:20:30.163 | 1.00th=[ 4], 5.00th=[ 14], 10.00th=[ 26], 20.00th=[ 57], 00:20:30.163 | 30.00th=[ 75], 40.00th=[ 87], 50.00th=[ 108], 60.00th=[ 123], 00:20:30.163 | 70.00th=[ 142], 80.00th=[ 159], 90.00th=[ 188], 95.00th=[ 220], 00:20:30.163 | 99.00th=[ 255], 99.50th=[ 257], 99.90th=[ 266], 99.95th=[ 268], 00:20:30.163 | 99.99th=[ 271] 00:20:30.163 bw ( KiB/s): min=71536, max=235520, per=9.50%, avg=148639.15, stdev=48364.93, samples=20 00:20:30.163 iops : min= 279, max= 920, avg=580.55, stdev=188.92, samples=20 00:20:30.163 lat (usec) : 1000=0.07% 00:20:30.163 lat (msec) : 2=0.32%, 4=0.70%, 10=2.59%, 20=4.74%, 50=9.44% 00:20:30.163 lat (msec) : 100=28.22%, 250=52.55%, 500=1.38% 00:20:30.163 cpu : usr=1.71%, sys=2.01%, ctx=3552, majf=0, minf=1 00:20:30.163 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:20:30.163 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:30.163 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:30.163 issued rwts: total=0,5871,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:30.163 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:30.163 job4: (groupid=0, jobs=1): err= 0: pid=246603: Thu Nov 28 19:08:50 2024 00:20:30.163 write: IOPS=601, BW=150MiB/s (158MB/s)(1519MiB/10104msec); 0 zone resets 00:20:30.163 slat (usec): min=15, max=92953, avg=1159.98, stdev=3457.88 00:20:30.163 clat (usec): min=803, max=344051, avg=105249.12, stdev=58130.58 00:20:30.163 lat (usec): min=835, max=344078, avg=106409.11, stdev=58764.06 00:20:30.163 clat percentiles (msec): 00:20:30.163 | 1.00th=[ 10], 5.00th=[ 27], 10.00th=[ 39], 20.00th=[ 56], 00:20:30.163 | 30.00th=[ 75], 40.00th=[ 83], 50.00th=[ 90], 60.00th=[ 104], 00:20:30.163 | 70.00th=[ 131], 80.00th=[ 155], 90.00th=[ 186], 95.00th=[ 211], 00:20:30.163 | 99.00th=[ 275], 99.50th=[ 300], 99.90th=[ 334], 99.95th=[ 342], 00:20:30.163 | 99.99th=[ 347] 00:20:30.163 bw ( KiB/s): min=90112, max=305152, per=9.83%, avg=153877.45, stdev=56162.53, samples=20 00:20:30.163 iops : min= 352, max= 1192, avg=600.95, stdev=219.43, samples=20 00:20:30.163 lat (usec) : 1000=0.05% 00:20:30.163 lat (msec) : 2=0.10%, 4=0.20%, 10=0.91%, 20=2.27%, 50=10.77% 00:20:30.163 lat (msec) : 100=44.28%, 250=39.36%, 500=2.07% 00:20:30.163 cpu : usr=1.80%, sys=2.14%, ctx=3109, majf=0, minf=1 00:20:30.163 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:20:30.163 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:30.163 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:30.163 issued rwts: total=0,6075,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:30.163 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:30.163 job5: (groupid=0, jobs=1): err= 0: pid=246604: Thu Nov 28 19:08:50 2024 00:20:30.163 write: IOPS=573, BW=143MiB/s (150MB/s)(1454MiB/10140msec); 0 zone resets 00:20:30.163 slat (usec): min=18, max=49346, avg=1433.68, stdev=3227.61 00:20:30.163 clat (usec): min=781, max=313463, avg=109638.24, stdev=49770.45 00:20:30.163 lat (usec): min=808, max=313522, avg=111071.92, stdev=50417.80 00:20:30.163 clat percentiles (msec): 00:20:30.163 | 1.00th=[ 7], 5.00th=[ 26], 10.00th=[ 56], 20.00th=[ 75], 00:20:30.163 | 30.00th=[ 80], 40.00th=[ 93], 50.00th=[ 106], 60.00th=[ 113], 00:20:30.163 | 70.00th=[ 127], 80.00th=[ 150], 90.00th=[ 174], 95.00th=[ 207], 00:20:30.163 | 99.00th=[ 241], 99.50th=[ 275], 99.90th=[ 305], 99.95th=[ 309], 00:20:30.163 | 99.99th=[ 313] 00:20:30.163 bw ( KiB/s): min=75776, max=212992, per=9.41%, avg=147203.50, stdev=41081.67, samples=20 00:20:30.164 iops : min= 296, max= 832, avg=574.95, stdev=160.47, samples=20 00:20:30.164 lat (usec) : 1000=0.07% 00:20:30.164 lat (msec) : 2=0.15%, 4=0.45%, 10=0.98%, 20=2.41%, 50=4.73% 00:20:30.164 lat (msec) : 100=36.31%, 250=54.08%, 500=0.83% 00:20:30.164 cpu : usr=1.84%, sys=1.83%, ctx=2390, majf=0, minf=1 00:20:30.164 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:20:30.164 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:30.164 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:30.164 issued rwts: total=0,5814,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:30.164 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:30.164 job6: (groupid=0, jobs=1): err= 0: pid=246605: Thu Nov 28 19:08:50 2024 00:20:30.164 write: IOPS=695, BW=174MiB/s (182MB/s)(1771MiB/10182msec); 0 zone resets 00:20:30.164 slat (usec): min=14, max=125629, avg=918.65, stdev=3136.12 00:20:30.164 clat (usec): min=828, max=341265, avg=90948.32, stdev=55088.31 00:20:30.164 lat (usec): min=858, max=341316, avg=91866.96, stdev=55688.87 00:20:30.164 clat percentiles (msec): 00:20:30.164 | 1.00th=[ 4], 5.00th=[ 12], 10.00th=[ 23], 20.00th=[ 41], 00:20:30.164 | 30.00th=[ 51], 40.00th=[ 70], 50.00th=[ 84], 60.00th=[ 109], 00:20:30.164 | 70.00th=[ 124], 80.00th=[ 140], 90.00th=[ 167], 95.00th=[ 184], 00:20:30.164 | 99.00th=[ 218], 99.50th=[ 257], 99.90th=[ 321], 99.95th=[ 330], 00:20:30.164 | 99.99th=[ 342] 00:20:30.164 bw ( KiB/s): min=94208, max=347976, per=11.48%, avg=179657.75, stdev=72417.97, samples=20 00:20:30.164 iops : min= 368, max= 1359, avg=701.75, stdev=282.84, samples=20 00:20:30.164 lat (usec) : 1000=0.10% 00:20:30.164 lat (msec) : 2=0.49%, 4=0.58%, 10=2.98%, 20=4.59%, 50=21.09% 00:20:30.164 lat (msec) : 100=27.15%, 250=42.49%, 500=0.54% 00:20:30.164 cpu : usr=2.18%, sys=2.33%, ctx=4123, majf=0, minf=1 00:20:30.164 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:20:30.164 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:30.164 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:30.164 issued rwts: total=0,7084,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:30.164 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:30.164 job7: (groupid=0, jobs=1): err= 0: pid=246606: Thu Nov 28 19:08:50 2024 00:20:30.164 write: IOPS=507, BW=127MiB/s (133MB/s)(1289MiB/10148msec); 0 zone resets 00:20:30.164 slat (usec): min=16, max=46746, avg=1376.63, stdev=3609.79 00:20:30.164 clat (msec): min=3, max=273, avg=124.55, stdev=60.19 00:20:30.164 lat (msec): min=4, max=273, avg=125.93, stdev=60.99 00:20:30.164 clat percentiles (msec): 00:20:30.164 | 1.00th=[ 10], 5.00th=[ 21], 10.00th=[ 32], 20.00th=[ 63], 00:20:30.164 | 30.00th=[ 101], 40.00th=[ 117], 50.00th=[ 130], 60.00th=[ 148], 00:20:30.164 | 70.00th=[ 161], 80.00th=[ 180], 90.00th=[ 199], 95.00th=[ 211], 00:20:30.164 | 99.00th=[ 251], 99.50th=[ 262], 99.90th=[ 275], 99.95th=[ 275], 00:20:30.164 | 99.99th=[ 275] 00:20:30.164 bw ( KiB/s): min=90805, max=226304, per=8.33%, avg=130333.75, stdev=41695.64, samples=20 00:20:30.164 iops : min= 354, max= 884, avg=509.05, stdev=162.93, samples=20 00:20:30.164 lat (msec) : 4=0.08%, 10=0.99%, 20=3.94%, 50=11.89%, 100=13.25% 00:20:30.164 lat (msec) : 250=68.87%, 500=0.99% 00:20:30.164 cpu : usr=1.59%, sys=1.71%, ctx=2945, majf=0, minf=1 00:20:30.164 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:30.164 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:30.164 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:30.164 issued rwts: total=0,5155,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:30.164 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:30.164 job8: (groupid=0, jobs=1): err= 0: pid=246607: Thu Nov 28 19:08:50 2024 00:20:30.164 write: IOPS=487, BW=122MiB/s (128MB/s)(1237MiB/10158msec); 0 zone resets 00:20:30.164 slat (usec): min=23, max=85390, avg=1750.82, stdev=4365.77 00:20:30.164 clat (msec): min=6, max=307, avg=129.00, stdev=53.00 00:20:30.164 lat (msec): min=6, max=307, avg=130.75, stdev=53.63 00:20:30.164 clat percentiles (msec): 00:20:30.164 | 1.00th=[ 16], 5.00th=[ 47], 10.00th=[ 57], 20.00th=[ 88], 00:20:30.164 | 30.00th=[ 100], 40.00th=[ 117], 50.00th=[ 125], 60.00th=[ 138], 00:20:30.164 | 70.00th=[ 150], 80.00th=[ 165], 90.00th=[ 201], 95.00th=[ 236], 00:20:30.164 | 99.00th=[ 262], 99.50th=[ 266], 99.90th=[ 279], 99.95th=[ 284], 00:20:30.164 | 99.99th=[ 309] 00:20:30.164 bw ( KiB/s): min=59904, max=242688, per=7.99%, avg=125018.70, stdev=40272.15, samples=20 00:20:30.164 iops : min= 234, max= 948, avg=488.35, stdev=157.31, samples=20 00:20:30.164 lat (msec) : 10=0.63%, 20=0.69%, 50=7.14%, 100=22.30%, 250=66.50% 00:20:30.164 lat (msec) : 500=2.75% 00:20:30.164 cpu : usr=1.64%, sys=1.56%, ctx=1829, majf=0, minf=1 00:20:30.164 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:20:30.164 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:30.164 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:30.164 issued rwts: total=0,4947,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:30.164 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:30.164 job9: (groupid=0, jobs=1): err= 0: pid=246608: Thu Nov 28 19:08:50 2024 00:20:30.164 write: IOPS=517, BW=129MiB/s (136MB/s)(1316MiB/10176msec); 0 zone resets 00:20:30.164 slat (usec): min=13, max=129094, avg=1477.26, stdev=4233.42 00:20:30.164 clat (usec): min=787, max=340936, avg=122230.61, stdev=71379.29 00:20:30.164 lat (usec): min=822, max=340974, avg=123707.87, stdev=72427.07 00:20:30.164 clat percentiles (msec): 00:20:30.164 | 1.00th=[ 5], 5.00th=[ 18], 10.00th=[ 31], 20.00th=[ 48], 00:20:30.164 | 30.00th=[ 77], 40.00th=[ 86], 50.00th=[ 125], 60.00th=[ 150], 00:20:30.164 | 70.00th=[ 165], 80.00th=[ 184], 90.00th=[ 218], 95.00th=[ 249], 00:20:30.164 | 99.00th=[ 284], 99.50th=[ 305], 99.90th=[ 330], 99.95th=[ 330], 00:20:30.164 | 99.99th=[ 342] 00:20:30.164 bw ( KiB/s): min=67584, max=259072, per=8.50%, avg=133069.05, stdev=62325.84, samples=20 00:20:30.164 iops : min= 264, max= 1012, avg=519.80, stdev=243.46, samples=20 00:20:30.164 lat (usec) : 1000=0.08% 00:20:30.164 lat (msec) : 2=0.23%, 4=0.53%, 10=1.84%, 20=3.17%, 50=15.09% 00:20:30.164 lat (msec) : 100=22.94%, 250=51.52%, 500=4.60% 00:20:30.164 cpu : usr=1.28%, sys=1.75%, ctx=2748, majf=0, minf=1 00:20:30.164 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:30.164 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:30.164 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:30.164 issued rwts: total=0,5262,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:30.164 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:30.164 job10: (groupid=0, jobs=1): err= 0: pid=246613: Thu Nov 28 19:08:50 2024 00:20:30.164 write: IOPS=529, BW=132MiB/s (139MB/s)(1344MiB/10142msec); 0 zone resets 00:20:30.164 slat (usec): min=15, max=58445, avg=1261.57, stdev=3611.19 00:20:30.164 clat (usec): min=1363, max=284491, avg=119446.03, stdev=60934.88 00:20:30.164 lat (usec): min=1414, max=284533, avg=120707.61, stdev=61791.70 00:20:30.164 clat percentiles (msec): 00:20:30.164 | 1.00th=[ 11], 5.00th=[ 24], 10.00th=[ 37], 20.00th=[ 66], 00:20:30.164 | 30.00th=[ 77], 40.00th=[ 101], 50.00th=[ 116], 60.00th=[ 138], 00:20:30.164 | 70.00th=[ 155], 80.00th=[ 174], 90.00th=[ 201], 95.00th=[ 224], 00:20:30.164 | 99.00th=[ 257], 99.50th=[ 279], 99.90th=[ 284], 99.95th=[ 284], 00:20:30.164 | 99.99th=[ 284] 00:20:30.164 bw ( KiB/s): min=75776, max=219648, per=8.69%, avg=135957.85, stdev=42329.92, samples=20 00:20:30.164 iops : min= 296, max= 858, avg=530.95, stdev=165.40, samples=20 00:20:30.164 lat (msec) : 2=0.04%, 4=0.20%, 10=0.71%, 20=3.11%, 50=9.62% 00:20:30.164 lat (msec) : 100=26.46%, 250=58.34%, 500=1.53% 00:20:30.164 cpu : usr=1.71%, sys=1.60%, ctx=2978, majf=0, minf=2 00:20:30.164 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:20:30.164 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:20:30.164 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:20:30.164 issued rwts: total=0,5375,0,0 short=0,0,0,0 dropped=0,0,0,0 00:20:30.164 latency : target=0, window=0, percentile=100.00%, depth=64 00:20:30.164 00:20:30.164 Run status group 0 (all jobs): 00:20:30.164 WRITE: bw=1528MiB/s (1602MB/s), 118MiB/s-174MiB/s (123MB/s-182MB/s), io=15.2GiB (16.3GB), run=10056-10182msec 00:20:30.164 00:20:30.164 Disk stats (read/write): 00:20:30.164 nvme0n1: ios=54/12473, merge=0/0, ticks=1120/1213452, in_queue=1214572, util=100.00% 00:20:30.164 nvme10n1: ios=38/10904, merge=0/0, ticks=46/1220867, in_queue=1220913, util=97.52% 00:20:30.164 nvme1n1: ios=46/9352, merge=0/0, ticks=2957/1191618, in_queue=1194575, util=100.00% 00:20:30.164 nvme2n1: ios=47/11503, merge=0/0, ticks=2420/1224608, in_queue=1227028, util=100.00% 00:20:30.164 nvme3n1: ios=0/11967, merge=0/0, ticks=0/1217735, in_queue=1217735, util=97.87% 00:20:30.164 nvme4n1: ios=44/11450, merge=0/0, ticks=725/1205357, in_queue=1206082, util=100.00% 00:20:30.164 nvme5n1: ios=38/13999, merge=0/0, ticks=775/1201797, in_queue=1202572, util=100.00% 00:20:30.164 nvme6n1: ios=0/10111, merge=0/0, ticks=0/1219059, in_queue=1219059, util=98.45% 00:20:30.164 nvme7n1: ios=45/9642, merge=0/0, ticks=1763/1199798, in_queue=1201561, util=100.00% 00:20:30.164 nvme8n1: ios=0/10355, merge=0/0, ticks=0/1214816, in_queue=1214816, util=98.94% 00:20:30.164 nvme9n1: ios=0/10535, merge=0/0, ticks=0/1223711, in_queue=1223711, util=99.12% 00:20:30.164 19:08:50 -- target/multiconnection.sh@36 -- # sync 00:20:30.164 19:08:50 -- target/multiconnection.sh@37 -- # seq 1 11 00:20:30.164 19:08:50 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:30.164 19:08:50 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:20:30.165 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:20:30.165 19:08:50 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:20:30.165 19:08:50 -- common/autotest_common.sh@1208 -- # local i=0 00:20:30.165 19:08:50 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:30.165 19:08:50 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK1 00:20:30.165 19:08:50 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:30.165 19:08:50 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK1 00:20:30.165 19:08:50 -- common/autotest_common.sh@1220 -- # return 0 00:20:30.165 19:08:50 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:30.165 19:08:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:30.165 19:08:50 -- common/autotest_common.sh@10 -- # set +x 00:20:30.165 19:08:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:30.165 19:08:50 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:30.165 19:08:50 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:20:30.165 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:20:30.165 19:08:50 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:20:30.165 19:08:50 -- common/autotest_common.sh@1208 -- # local i=0 00:20:30.165 19:08:50 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:30.165 19:08:50 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK2 00:20:30.165 19:08:50 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:30.165 19:08:50 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK2 00:20:30.165 19:08:50 -- common/autotest_common.sh@1220 -- # return 0 00:20:30.165 19:08:50 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:20:30.165 19:08:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:30.165 19:08:50 -- common/autotest_common.sh@10 -- # set +x 00:20:30.165 19:08:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:30.165 19:08:50 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:30.165 19:08:50 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:20:30.423 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:20:30.423 19:08:51 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:20:30.423 19:08:51 -- common/autotest_common.sh@1208 -- # local i=0 00:20:30.423 19:08:51 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:30.423 19:08:51 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK3 00:20:30.423 19:08:51 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:30.423 19:08:51 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK3 00:20:30.423 19:08:51 -- common/autotest_common.sh@1220 -- # return 0 00:20:30.423 19:08:51 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:20:30.423 19:08:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:30.423 19:08:51 -- common/autotest_common.sh@10 -- # set +x 00:20:30.423 19:08:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:30.423 19:08:51 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:30.423 19:08:51 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:20:30.682 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:20:30.682 19:08:51 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:20:30.682 19:08:51 -- common/autotest_common.sh@1208 -- # local i=0 00:20:30.682 19:08:51 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:30.682 19:08:51 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK4 00:20:30.682 19:08:51 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:30.682 19:08:51 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK4 00:20:30.682 19:08:51 -- common/autotest_common.sh@1220 -- # return 0 00:20:30.682 19:08:51 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:20:30.682 19:08:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:30.682 19:08:51 -- common/autotest_common.sh@10 -- # set +x 00:20:30.682 19:08:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:30.682 19:08:51 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:30.682 19:08:51 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:20:30.682 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:20:30.682 19:08:51 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:20:30.682 19:08:51 -- common/autotest_common.sh@1208 -- # local i=0 00:20:30.682 19:08:51 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:30.682 19:08:51 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK5 00:20:30.682 19:08:51 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:30.682 19:08:51 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK5 00:20:30.682 19:08:51 -- common/autotest_common.sh@1220 -- # return 0 00:20:30.682 19:08:51 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:20:30.682 19:08:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:30.682 19:08:51 -- common/autotest_common.sh@10 -- # set +x 00:20:30.682 19:08:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:30.682 19:08:51 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:30.682 19:08:51 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:20:30.941 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:20:30.941 19:08:51 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:20:30.941 19:08:51 -- common/autotest_common.sh@1208 -- # local i=0 00:20:30.941 19:08:51 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:30.941 19:08:51 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK6 00:20:30.941 19:08:51 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:30.941 19:08:51 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK6 00:20:30.941 19:08:51 -- common/autotest_common.sh@1220 -- # return 0 00:20:30.941 19:08:51 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:20:30.941 19:08:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:30.941 19:08:51 -- common/autotest_common.sh@10 -- # set +x 00:20:30.941 19:08:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:30.941 19:08:51 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:30.941 19:08:51 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:20:30.941 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:20:30.941 19:08:51 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:20:30.941 19:08:51 -- common/autotest_common.sh@1208 -- # local i=0 00:20:30.941 19:08:51 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:30.941 19:08:51 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK7 00:20:31.200 19:08:51 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:31.200 19:08:51 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK7 00:20:31.200 19:08:52 -- common/autotest_common.sh@1220 -- # return 0 00:20:31.200 19:08:52 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:20:31.200 19:08:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:31.200 19:08:52 -- common/autotest_common.sh@10 -- # set +x 00:20:31.200 19:08:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:31.200 19:08:52 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:31.200 19:08:52 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:20:31.200 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:20:31.200 19:08:52 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:20:31.200 19:08:52 -- common/autotest_common.sh@1208 -- # local i=0 00:20:31.200 19:08:52 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:31.200 19:08:52 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK8 00:20:31.460 19:08:52 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:31.460 19:08:52 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK8 00:20:31.460 19:08:52 -- common/autotest_common.sh@1220 -- # return 0 00:20:31.460 19:08:52 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:20:31.460 19:08:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:31.460 19:08:52 -- common/autotest_common.sh@10 -- # set +x 00:20:31.460 19:08:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:31.460 19:08:52 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:31.460 19:08:52 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:20:31.460 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:20:31.460 19:08:52 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:20:31.460 19:08:52 -- common/autotest_common.sh@1208 -- # local i=0 00:20:31.460 19:08:52 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:31.460 19:08:52 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK9 00:20:31.460 19:08:52 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:31.460 19:08:52 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK9 00:20:31.460 19:08:52 -- common/autotest_common.sh@1220 -- # return 0 00:20:31.460 19:08:52 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:20:31.460 19:08:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:31.460 19:08:52 -- common/autotest_common.sh@10 -- # set +x 00:20:31.460 19:08:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:31.460 19:08:52 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:31.460 19:08:52 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:20:31.460 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:20:31.460 19:08:52 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:20:31.460 19:08:52 -- common/autotest_common.sh@1208 -- # local i=0 00:20:31.460 19:08:52 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:31.460 19:08:52 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK10 00:20:31.460 19:08:52 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:31.460 19:08:52 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK10 00:20:31.460 19:08:52 -- common/autotest_common.sh@1220 -- # return 0 00:20:31.460 19:08:52 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:20:31.460 19:08:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:31.460 19:08:52 -- common/autotest_common.sh@10 -- # set +x 00:20:31.460 19:08:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:31.460 19:08:52 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:31.460 19:08:52 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:20:31.721 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:20:31.721 19:08:52 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:20:31.721 19:08:52 -- common/autotest_common.sh@1208 -- # local i=0 00:20:31.721 19:08:52 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:20:31.721 19:08:52 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK11 00:20:31.721 19:08:52 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:20:31.721 19:08:52 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK11 00:20:31.721 19:08:52 -- common/autotest_common.sh@1220 -- # return 0 00:20:31.721 19:08:52 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:20:31.721 19:08:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:31.721 19:08:52 -- common/autotest_common.sh@10 -- # set +x 00:20:31.721 19:08:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:31.721 19:08:52 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:20:31.721 19:08:52 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:20:31.721 19:08:52 -- target/multiconnection.sh@47 -- # nvmftestfini 00:20:31.721 19:08:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:31.721 19:08:52 -- nvmf/common.sh@116 -- # sync 00:20:31.721 19:08:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:31.721 19:08:52 -- nvmf/common.sh@119 -- # set +e 00:20:31.721 19:08:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:31.721 19:08:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:31.721 rmmod nvme_tcp 00:20:31.721 rmmod nvme_fabrics 00:20:31.721 rmmod nvme_keyring 00:20:31.721 19:08:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:31.721 19:08:52 -- nvmf/common.sh@123 -- # set -e 00:20:31.721 19:08:52 -- nvmf/common.sh@124 -- # return 0 00:20:31.721 19:08:52 -- nvmf/common.sh@477 -- # '[' -n 240835 ']' 00:20:31.721 19:08:52 -- nvmf/common.sh@478 -- # killprocess 240835 00:20:31.721 19:08:52 -- common/autotest_common.sh@936 -- # '[' -z 240835 ']' 00:20:31.721 19:08:52 -- common/autotest_common.sh@940 -- # kill -0 240835 00:20:31.721 19:08:52 -- common/autotest_common.sh@941 -- # uname 00:20:31.721 19:08:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:31.721 19:08:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 240835 00:20:31.721 19:08:52 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:20:31.721 19:08:52 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:20:31.721 19:08:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 240835' 00:20:31.721 killing process with pid 240835 00:20:31.721 19:08:52 -- common/autotest_common.sh@955 -- # kill 240835 00:20:31.721 19:08:52 -- common/autotest_common.sh@960 -- # wait 240835 00:20:32.290 19:08:53 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:32.290 19:08:53 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:32.290 19:08:53 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:32.290 19:08:53 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:32.290 19:08:53 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:32.290 19:08:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:32.290 19:08:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:32.290 19:08:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:34.832 19:08:55 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:34.832 00:20:34.832 real 1m1.773s 00:20:34.832 user 3m32.539s 00:20:34.832 sys 0m24.725s 00:20:34.832 19:08:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:34.832 19:08:55 -- common/autotest_common.sh@10 -- # set +x 00:20:34.832 ************************************ 00:20:34.832 END TEST nvmf_multiconnection 00:20:34.832 ************************************ 00:20:34.832 19:08:55 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:20:34.832 19:08:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:34.832 19:08:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:34.832 19:08:55 -- common/autotest_common.sh@10 -- # set +x 00:20:34.832 ************************************ 00:20:34.832 START TEST nvmf_initiator_timeout 00:20:34.832 ************************************ 00:20:34.832 19:08:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:20:34.832 * Looking for test storage... 00:20:34.832 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:34.832 19:08:55 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:34.832 19:08:55 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:34.832 19:08:55 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:34.832 19:08:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:34.832 19:08:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:34.832 19:08:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:34.832 19:08:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:34.832 19:08:55 -- scripts/common.sh@335 -- # IFS=.-: 00:20:34.832 19:08:55 -- scripts/common.sh@335 -- # read -ra ver1 00:20:34.832 19:08:55 -- scripts/common.sh@336 -- # IFS=.-: 00:20:34.832 19:08:55 -- scripts/common.sh@336 -- # read -ra ver2 00:20:34.832 19:08:55 -- scripts/common.sh@337 -- # local 'op=<' 00:20:34.832 19:08:55 -- scripts/common.sh@339 -- # ver1_l=2 00:20:34.832 19:08:55 -- scripts/common.sh@340 -- # ver2_l=1 00:20:34.832 19:08:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:34.832 19:08:55 -- scripts/common.sh@343 -- # case "$op" in 00:20:34.832 19:08:55 -- scripts/common.sh@344 -- # : 1 00:20:34.832 19:08:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:34.832 19:08:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:34.832 19:08:55 -- scripts/common.sh@364 -- # decimal 1 00:20:34.832 19:08:55 -- scripts/common.sh@352 -- # local d=1 00:20:34.832 19:08:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:34.832 19:08:55 -- scripts/common.sh@354 -- # echo 1 00:20:34.832 19:08:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:34.832 19:08:55 -- scripts/common.sh@365 -- # decimal 2 00:20:34.832 19:08:55 -- scripts/common.sh@352 -- # local d=2 00:20:34.832 19:08:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:34.832 19:08:55 -- scripts/common.sh@354 -- # echo 2 00:20:34.832 19:08:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:34.832 19:08:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:34.832 19:08:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:34.832 19:08:55 -- scripts/common.sh@367 -- # return 0 00:20:34.832 19:08:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:34.832 19:08:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:34.832 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:34.832 --rc genhtml_branch_coverage=1 00:20:34.832 --rc genhtml_function_coverage=1 00:20:34.832 --rc genhtml_legend=1 00:20:34.832 --rc geninfo_all_blocks=1 00:20:34.832 --rc geninfo_unexecuted_blocks=1 00:20:34.832 00:20:34.832 ' 00:20:34.832 19:08:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:34.832 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:34.832 --rc genhtml_branch_coverage=1 00:20:34.832 --rc genhtml_function_coverage=1 00:20:34.832 --rc genhtml_legend=1 00:20:34.832 --rc geninfo_all_blocks=1 00:20:34.832 --rc geninfo_unexecuted_blocks=1 00:20:34.832 00:20:34.832 ' 00:20:34.832 19:08:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:34.832 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:34.832 --rc genhtml_branch_coverage=1 00:20:34.832 --rc genhtml_function_coverage=1 00:20:34.832 --rc genhtml_legend=1 00:20:34.832 --rc geninfo_all_blocks=1 00:20:34.832 --rc geninfo_unexecuted_blocks=1 00:20:34.832 00:20:34.832 ' 00:20:34.832 19:08:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:34.832 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:34.832 --rc genhtml_branch_coverage=1 00:20:34.832 --rc genhtml_function_coverage=1 00:20:34.832 --rc genhtml_legend=1 00:20:34.832 --rc geninfo_all_blocks=1 00:20:34.832 --rc geninfo_unexecuted_blocks=1 00:20:34.832 00:20:34.832 ' 00:20:34.832 19:08:55 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:34.832 19:08:55 -- nvmf/common.sh@7 -- # uname -s 00:20:34.832 19:08:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:34.832 19:08:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:34.832 19:08:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:34.832 19:08:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:34.832 19:08:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:34.832 19:08:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:34.832 19:08:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:34.832 19:08:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:34.832 19:08:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:34.832 19:08:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:34.832 19:08:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:34.832 19:08:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:34.832 19:08:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:34.832 19:08:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:34.832 19:08:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:34.832 19:08:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:34.832 19:08:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:34.832 19:08:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:34.832 19:08:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:34.832 19:08:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:34.833 19:08:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:34.833 19:08:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:34.833 19:08:55 -- paths/export.sh@5 -- # export PATH 00:20:34.833 19:08:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:34.833 19:08:55 -- nvmf/common.sh@46 -- # : 0 00:20:34.833 19:08:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:34.833 19:08:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:34.833 19:08:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:34.833 19:08:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:34.833 19:08:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:34.833 19:08:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:34.833 19:08:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:34.833 19:08:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:34.833 19:08:55 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:34.833 19:08:55 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:34.833 19:08:55 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:20:34.833 19:08:55 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:34.833 19:08:55 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:34.833 19:08:55 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:34.833 19:08:55 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:34.833 19:08:55 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:34.833 19:08:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:34.833 19:08:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:34.833 19:08:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:34.833 19:08:55 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:34.833 19:08:55 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:34.833 19:08:55 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:34.833 19:08:55 -- common/autotest_common.sh@10 -- # set +x 00:20:36.746 19:08:57 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:36.746 19:08:57 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:36.746 19:08:57 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:36.746 19:08:57 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:36.746 19:08:57 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:36.746 19:08:57 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:36.746 19:08:57 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:36.746 19:08:57 -- nvmf/common.sh@294 -- # net_devs=() 00:20:36.746 19:08:57 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:36.746 19:08:57 -- nvmf/common.sh@295 -- # e810=() 00:20:36.746 19:08:57 -- nvmf/common.sh@295 -- # local -ga e810 00:20:36.746 19:08:57 -- nvmf/common.sh@296 -- # x722=() 00:20:36.746 19:08:57 -- nvmf/common.sh@296 -- # local -ga x722 00:20:36.746 19:08:57 -- nvmf/common.sh@297 -- # mlx=() 00:20:36.746 19:08:57 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:36.746 19:08:57 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:36.746 19:08:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:36.746 19:08:57 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:36.746 19:08:57 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:36.746 19:08:57 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:36.746 19:08:57 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:36.746 19:08:57 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:36.746 19:08:57 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:36.746 19:08:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:36.746 19:08:57 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:36.746 19:08:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:36.746 19:08:57 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:36.746 19:08:57 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:36.746 19:08:57 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:36.746 19:08:57 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:36.746 19:08:57 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:36.747 19:08:57 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:36.747 19:08:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:36.747 19:08:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:36.747 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:36.747 19:08:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:36.747 19:08:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:36.747 19:08:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:36.747 19:08:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:36.747 19:08:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:36.747 19:08:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:36.747 19:08:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:36.747 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:36.747 19:08:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:36.747 19:08:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:36.747 19:08:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:36.747 19:08:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:36.747 19:08:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:36.747 19:08:57 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:36.747 19:08:57 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:36.747 19:08:57 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:36.747 19:08:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:36.747 19:08:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:36.747 19:08:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:36.747 19:08:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:36.747 19:08:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:36.747 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:36.747 19:08:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:36.747 19:08:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:36.747 19:08:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:36.747 19:08:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:36.747 19:08:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:36.747 19:08:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:36.747 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:36.747 19:08:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:36.747 19:08:57 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:36.747 19:08:57 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:36.747 19:08:57 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:36.747 19:08:57 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:36.747 19:08:57 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:36.747 19:08:57 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:36.747 19:08:57 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:36.747 19:08:57 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:36.747 19:08:57 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:36.747 19:08:57 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:36.747 19:08:57 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:36.747 19:08:57 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:36.747 19:08:57 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:36.747 19:08:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:36.747 19:08:57 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:36.747 19:08:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:36.747 19:08:57 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:36.747 19:08:57 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:36.747 19:08:57 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:36.747 19:08:57 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:36.747 19:08:57 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:36.747 19:08:57 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:36.747 19:08:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:36.747 19:08:57 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:36.747 19:08:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:36.747 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:36.747 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.201 ms 00:20:36.747 00:20:36.747 --- 10.0.0.2 ping statistics --- 00:20:36.747 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:36.747 rtt min/avg/max/mdev = 0.201/0.201/0.201/0.000 ms 00:20:36.747 19:08:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:36.747 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:36.747 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.095 ms 00:20:36.747 00:20:36.747 --- 10.0.0.1 ping statistics --- 00:20:36.747 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:36.747 rtt min/avg/max/mdev = 0.095/0.095/0.095/0.000 ms 00:20:36.747 19:08:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:36.747 19:08:57 -- nvmf/common.sh@410 -- # return 0 00:20:36.747 19:08:57 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:36.747 19:08:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:36.747 19:08:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:36.747 19:08:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:36.747 19:08:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:36.747 19:08:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:36.747 19:08:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:36.747 19:08:57 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:20:36.747 19:08:57 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:36.747 19:08:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:36.747 19:08:57 -- common/autotest_common.sh@10 -- # set +x 00:20:36.747 19:08:57 -- nvmf/common.sh@469 -- # nvmfpid=250035 00:20:36.747 19:08:57 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:20:36.747 19:08:57 -- nvmf/common.sh@470 -- # waitforlisten 250035 00:20:36.747 19:08:57 -- common/autotest_common.sh@829 -- # '[' -z 250035 ']' 00:20:36.747 19:08:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:36.747 19:08:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:36.747 19:08:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:36.747 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:36.747 19:08:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:36.747 19:08:57 -- common/autotest_common.sh@10 -- # set +x 00:20:36.747 [2024-11-28 19:08:57.746518] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:36.747 [2024-11-28 19:08:57.746590] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:36.747 EAL: No free 2048 kB hugepages reported on node 1 00:20:37.007 [2024-11-28 19:08:57.816584] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:37.007 [2024-11-28 19:08:57.937219] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:37.007 [2024-11-28 19:08:57.937376] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:37.007 [2024-11-28 19:08:57.937404] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:37.007 [2024-11-28 19:08:57.937419] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:37.007 [2024-11-28 19:08:57.937475] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:37.007 [2024-11-28 19:08:57.937503] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:37.007 [2024-11-28 19:08:57.937565] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:37.007 [2024-11-28 19:08:57.937567] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:37.944 19:08:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:37.944 19:08:58 -- common/autotest_common.sh@862 -- # return 0 00:20:37.944 19:08:58 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:37.944 19:08:58 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:37.944 19:08:58 -- common/autotest_common.sh@10 -- # set +x 00:20:37.944 19:08:58 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:37.944 19:08:58 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:20:37.944 19:08:58 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:20:37.944 19:08:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:37.944 19:08:58 -- common/autotest_common.sh@10 -- # set +x 00:20:37.944 Malloc0 00:20:37.944 19:08:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:37.944 19:08:58 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:20:37.944 19:08:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:37.944 19:08:58 -- common/autotest_common.sh@10 -- # set +x 00:20:37.944 Delay0 00:20:37.944 19:08:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:37.944 19:08:58 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:20:37.944 19:08:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:37.944 19:08:58 -- common/autotest_common.sh@10 -- # set +x 00:20:37.944 [2024-11-28 19:08:58.755815] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:37.944 19:08:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:37.944 19:08:58 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:20:37.944 19:08:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:37.944 19:08:58 -- common/autotest_common.sh@10 -- # set +x 00:20:37.944 19:08:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:37.944 19:08:58 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:20:37.944 19:08:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:37.944 19:08:58 -- common/autotest_common.sh@10 -- # set +x 00:20:37.944 19:08:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:37.944 19:08:58 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:37.944 19:08:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:37.944 19:08:58 -- common/autotest_common.sh@10 -- # set +x 00:20:37.944 [2024-11-28 19:08:58.784084] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:37.944 19:08:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:37.944 19:08:58 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:20:38.514 19:08:59 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:20:38.514 19:08:59 -- common/autotest_common.sh@1187 -- # local i=0 00:20:38.514 19:08:59 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:38.514 19:08:59 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:20:38.514 19:08:59 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:41.049 19:09:01 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:41.049 19:09:01 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:41.049 19:09:01 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:20:41.049 19:09:01 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:41.049 19:09:01 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:41.049 19:09:01 -- common/autotest_common.sh@1197 -- # return 0 00:20:41.049 19:09:01 -- target/initiator_timeout.sh@35 -- # fio_pid=250666 00:20:41.049 19:09:01 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:20:41.049 19:09:01 -- target/initiator_timeout.sh@37 -- # sleep 3 00:20:41.049 [global] 00:20:41.049 thread=1 00:20:41.049 invalidate=1 00:20:41.049 rw=write 00:20:41.049 time_based=1 00:20:41.049 runtime=60 00:20:41.049 ioengine=libaio 00:20:41.049 direct=1 00:20:41.049 bs=4096 00:20:41.049 iodepth=1 00:20:41.049 norandommap=0 00:20:41.049 numjobs=1 00:20:41.049 00:20:41.049 verify_dump=1 00:20:41.049 verify_backlog=512 00:20:41.049 verify_state_save=0 00:20:41.049 do_verify=1 00:20:41.049 verify=crc32c-intel 00:20:41.049 [job0] 00:20:41.049 filename=/dev/nvme0n1 00:20:41.049 Could not set queue depth (nvme0n1) 00:20:41.049 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:20:41.049 fio-3.35 00:20:41.049 Starting 1 thread 00:20:43.587 19:09:04 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:20:43.587 19:09:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:43.587 19:09:04 -- common/autotest_common.sh@10 -- # set +x 00:20:43.587 true 00:20:43.587 19:09:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:43.587 19:09:04 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:20:43.587 19:09:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:43.587 19:09:04 -- common/autotest_common.sh@10 -- # set +x 00:20:43.587 true 00:20:43.587 19:09:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:43.587 19:09:04 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:20:43.587 19:09:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:43.587 19:09:04 -- common/autotest_common.sh@10 -- # set +x 00:20:43.587 true 00:20:43.587 19:09:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:43.587 19:09:04 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:20:43.587 19:09:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:43.587 19:09:04 -- common/autotest_common.sh@10 -- # set +x 00:20:43.587 true 00:20:43.587 19:09:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:43.587 19:09:04 -- target/initiator_timeout.sh@45 -- # sleep 3 00:20:46.877 19:09:07 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:20:46.877 19:09:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:46.877 19:09:07 -- common/autotest_common.sh@10 -- # set +x 00:20:46.877 true 00:20:46.877 19:09:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:46.877 19:09:07 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:20:46.877 19:09:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:46.877 19:09:07 -- common/autotest_common.sh@10 -- # set +x 00:20:46.877 true 00:20:46.877 19:09:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:46.877 19:09:07 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:20:46.877 19:09:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:46.877 19:09:07 -- common/autotest_common.sh@10 -- # set +x 00:20:46.877 true 00:20:46.877 19:09:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:46.877 19:09:07 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:20:46.877 19:09:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:46.877 19:09:07 -- common/autotest_common.sh@10 -- # set +x 00:20:46.877 true 00:20:46.877 19:09:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:46.877 19:09:07 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:20:46.877 19:09:07 -- target/initiator_timeout.sh@54 -- # wait 250666 00:21:43.119 00:21:43.119 job0: (groupid=0, jobs=1): err= 0: pid=250753: Thu Nov 28 19:10:01 2024 00:21:43.120 read: IOPS=22, BW=89.1KiB/s (91.2kB/s)(5348KiB/60039msec) 00:21:43.120 slat (nsec): min=5039, max=36906, avg=10324.66, stdev=4398.73 00:21:43.120 clat (usec): min=216, max=40879k, avg=44633.12, stdev=1117751.81 00:21:43.120 lat (usec): min=222, max=40879k, avg=44643.45, stdev=1117751.95 00:21:43.120 clat percentiles (usec): 00:21:43.120 | 1.00th=[ 229], 5.00th=[ 237], 10.00th=[ 241], 00:21:43.120 | 20.00th=[ 249], 30.00th=[ 255], 40.00th=[ 265], 00:21:43.120 | 50.00th=[ 273], 60.00th=[ 310], 70.00th=[ 41157], 00:21:43.120 | 80.00th=[ 41157], 90.00th=[ 42206], 95.00th=[ 42206], 00:21:43.120 | 99.00th=[ 42206], 99.50th=[ 42206], 99.90th=[ 43254], 00:21:43.120 | 99.95th=[17112761], 99.99th=[17112761] 00:21:43.120 write: IOPS=25, BW=102KiB/s (105kB/s)(6144KiB/60039msec); 0 zone resets 00:21:43.120 slat (nsec): min=6242, max=43473, avg=8787.29, stdev=2259.85 00:21:43.120 clat (usec): min=168, max=367, avg=214.37, stdev=33.35 00:21:43.120 lat (usec): min=176, max=397, avg=223.16, stdev=33.83 00:21:43.120 clat percentiles (usec): 00:21:43.120 | 1.00th=[ 176], 5.00th=[ 180], 10.00th=[ 184], 20.00th=[ 190], 00:21:43.120 | 30.00th=[ 196], 40.00th=[ 200], 50.00th=[ 206], 60.00th=[ 212], 00:21:43.120 | 70.00th=[ 219], 80.00th=[ 233], 90.00th=[ 260], 95.00th=[ 297], 00:21:43.120 | 99.00th=[ 326], 99.50th=[ 334], 99.90th=[ 363], 99.95th=[ 367], 00:21:43.120 | 99.99th=[ 367] 00:21:43.120 bw ( KiB/s): min= 224, max= 7968, per=100.00%, avg=4096.00, stdev=3872.00, samples=3 00:21:43.120 iops : min= 56, max= 1992, avg=1024.00, stdev=968.00, samples=3 00:21:43.120 lat (usec) : 250=58.23%, 500=26.11% 00:21:43.120 lat (msec) : 50=15.63%, >=2000=0.03% 00:21:43.120 cpu : usr=0.02%, sys=0.05%, ctx=2875, majf=0, minf=1 00:21:43.120 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:21:43.120 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:43.120 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:43.120 issued rwts: total=1337,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:43.120 latency : target=0, window=0, percentile=100.00%, depth=1 00:21:43.120 00:21:43.120 Run status group 0 (all jobs): 00:21:43.120 READ: bw=89.1KiB/s (91.2kB/s), 89.1KiB/s-89.1KiB/s (91.2kB/s-91.2kB/s), io=5348KiB (5476kB), run=60039-60039msec 00:21:43.120 WRITE: bw=102KiB/s (105kB/s), 102KiB/s-102KiB/s (105kB/s-105kB/s), io=6144KiB (6291kB), run=60039-60039msec 00:21:43.120 00:21:43.120 Disk stats (read/write): 00:21:43.120 nvme0n1: ios=1432/1536, merge=0/0, ticks=19023/322, in_queue=19345, util=99.76% 00:21:43.120 19:10:01 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:21:43.120 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:21:43.120 19:10:01 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:21:43.120 19:10:01 -- common/autotest_common.sh@1208 -- # local i=0 00:21:43.120 19:10:01 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:21:43.120 19:10:01 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:43.120 19:10:02 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:21:43.120 19:10:02 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:21:43.120 19:10:02 -- common/autotest_common.sh@1220 -- # return 0 00:21:43.120 19:10:02 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:21:43.120 19:10:02 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:21:43.120 nvmf hotplug test: fio successful as expected 00:21:43.120 19:10:02 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:43.120 19:10:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:43.120 19:10:02 -- common/autotest_common.sh@10 -- # set +x 00:21:43.120 19:10:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:43.120 19:10:02 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:21:43.120 19:10:02 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:21:43.120 19:10:02 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:21:43.120 19:10:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:43.120 19:10:02 -- nvmf/common.sh@116 -- # sync 00:21:43.120 19:10:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:43.120 19:10:02 -- nvmf/common.sh@119 -- # set +e 00:21:43.120 19:10:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:43.120 19:10:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:43.120 rmmod nvme_tcp 00:21:43.120 rmmod nvme_fabrics 00:21:43.120 rmmod nvme_keyring 00:21:43.120 19:10:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:43.120 19:10:02 -- nvmf/common.sh@123 -- # set -e 00:21:43.120 19:10:02 -- nvmf/common.sh@124 -- # return 0 00:21:43.120 19:10:02 -- nvmf/common.sh@477 -- # '[' -n 250035 ']' 00:21:43.120 19:10:02 -- nvmf/common.sh@478 -- # killprocess 250035 00:21:43.120 19:10:02 -- common/autotest_common.sh@936 -- # '[' -z 250035 ']' 00:21:43.120 19:10:02 -- common/autotest_common.sh@940 -- # kill -0 250035 00:21:43.120 19:10:02 -- common/autotest_common.sh@941 -- # uname 00:21:43.120 19:10:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:43.120 19:10:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 250035 00:21:43.120 19:10:02 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:43.120 19:10:02 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:43.120 19:10:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 250035' 00:21:43.120 killing process with pid 250035 00:21:43.120 19:10:02 -- common/autotest_common.sh@955 -- # kill 250035 00:21:43.120 19:10:02 -- common/autotest_common.sh@960 -- # wait 250035 00:21:43.120 19:10:02 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:43.120 19:10:02 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:43.120 19:10:02 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:43.120 19:10:02 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:43.120 19:10:02 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:43.120 19:10:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:43.120 19:10:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:43.120 19:10:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:43.688 19:10:04 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:43.688 00:21:43.688 real 1m9.105s 00:21:43.688 user 4m14.180s 00:21:43.688 sys 0m6.520s 00:21:43.688 19:10:04 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:43.688 19:10:04 -- common/autotest_common.sh@10 -- # set +x 00:21:43.688 ************************************ 00:21:43.688 END TEST nvmf_initiator_timeout 00:21:43.688 ************************************ 00:21:43.688 19:10:04 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:21:43.688 19:10:04 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:21:43.688 19:10:04 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:21:43.688 19:10:04 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:43.688 19:10:04 -- common/autotest_common.sh@10 -- # set +x 00:21:45.595 19:10:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:45.595 19:10:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:45.595 19:10:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:45.595 19:10:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:45.595 19:10:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:45.595 19:10:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:45.595 19:10:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:45.595 19:10:06 -- nvmf/common.sh@294 -- # net_devs=() 00:21:45.595 19:10:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:45.595 19:10:06 -- nvmf/common.sh@295 -- # e810=() 00:21:45.595 19:10:06 -- nvmf/common.sh@295 -- # local -ga e810 00:21:45.595 19:10:06 -- nvmf/common.sh@296 -- # x722=() 00:21:45.595 19:10:06 -- nvmf/common.sh@296 -- # local -ga x722 00:21:45.595 19:10:06 -- nvmf/common.sh@297 -- # mlx=() 00:21:45.595 19:10:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:45.595 19:10:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:45.595 19:10:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:45.595 19:10:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:45.595 19:10:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:45.595 19:10:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:45.595 19:10:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:45.595 19:10:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:45.595 19:10:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:45.595 19:10:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:45.595 19:10:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:45.595 19:10:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:45.595 19:10:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:45.595 19:10:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:45.595 19:10:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:45.595 19:10:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:45.595 19:10:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:45.595 19:10:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:45.595 19:10:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:45.595 19:10:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:45.595 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:45.595 19:10:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:45.595 19:10:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:45.595 19:10:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:45.595 19:10:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:45.595 19:10:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:45.595 19:10:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:45.595 19:10:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:45.595 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:45.595 19:10:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:45.595 19:10:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:45.595 19:10:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:45.595 19:10:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:45.595 19:10:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:45.595 19:10:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:45.595 19:10:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:45.595 19:10:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:45.595 19:10:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:45.595 19:10:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:45.595 19:10:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:45.595 19:10:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:45.595 19:10:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:45.595 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:45.595 19:10:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:45.595 19:10:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:45.596 19:10:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:45.596 19:10:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:45.596 19:10:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:45.596 19:10:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:45.596 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:45.596 19:10:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:45.596 19:10:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:45.596 19:10:06 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:45.596 19:10:06 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:21:45.596 19:10:06 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:45.596 19:10:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:45.596 19:10:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:45.596 19:10:06 -- common/autotest_common.sh@10 -- # set +x 00:21:45.596 ************************************ 00:21:45.596 START TEST nvmf_perf_adq 00:21:45.596 ************************************ 00:21:45.596 19:10:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:21:45.596 * Looking for test storage... 00:21:45.596 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:45.596 19:10:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:45.596 19:10:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:45.596 19:10:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:45.596 19:10:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:45.596 19:10:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:45.596 19:10:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:45.596 19:10:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:45.596 19:10:06 -- scripts/common.sh@335 -- # IFS=.-: 00:21:45.596 19:10:06 -- scripts/common.sh@335 -- # read -ra ver1 00:21:45.596 19:10:06 -- scripts/common.sh@336 -- # IFS=.-: 00:21:45.596 19:10:06 -- scripts/common.sh@336 -- # read -ra ver2 00:21:45.596 19:10:06 -- scripts/common.sh@337 -- # local 'op=<' 00:21:45.596 19:10:06 -- scripts/common.sh@339 -- # ver1_l=2 00:21:45.596 19:10:06 -- scripts/common.sh@340 -- # ver2_l=1 00:21:45.596 19:10:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:45.596 19:10:06 -- scripts/common.sh@343 -- # case "$op" in 00:21:45.596 19:10:06 -- scripts/common.sh@344 -- # : 1 00:21:45.596 19:10:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:45.596 19:10:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:45.596 19:10:06 -- scripts/common.sh@364 -- # decimal 1 00:21:45.596 19:10:06 -- scripts/common.sh@352 -- # local d=1 00:21:45.596 19:10:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:45.596 19:10:06 -- scripts/common.sh@354 -- # echo 1 00:21:45.596 19:10:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:45.596 19:10:06 -- scripts/common.sh@365 -- # decimal 2 00:21:45.596 19:10:06 -- scripts/common.sh@352 -- # local d=2 00:21:45.596 19:10:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:45.596 19:10:06 -- scripts/common.sh@354 -- # echo 2 00:21:45.596 19:10:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:45.596 19:10:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:45.596 19:10:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:45.596 19:10:06 -- scripts/common.sh@367 -- # return 0 00:21:45.596 19:10:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:45.596 19:10:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:45.596 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:45.596 --rc genhtml_branch_coverage=1 00:21:45.596 --rc genhtml_function_coverage=1 00:21:45.596 --rc genhtml_legend=1 00:21:45.596 --rc geninfo_all_blocks=1 00:21:45.596 --rc geninfo_unexecuted_blocks=1 00:21:45.596 00:21:45.596 ' 00:21:45.596 19:10:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:45.596 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:45.596 --rc genhtml_branch_coverage=1 00:21:45.596 --rc genhtml_function_coverage=1 00:21:45.596 --rc genhtml_legend=1 00:21:45.596 --rc geninfo_all_blocks=1 00:21:45.596 --rc geninfo_unexecuted_blocks=1 00:21:45.596 00:21:45.596 ' 00:21:45.596 19:10:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:45.596 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:45.596 --rc genhtml_branch_coverage=1 00:21:45.596 --rc genhtml_function_coverage=1 00:21:45.596 --rc genhtml_legend=1 00:21:45.596 --rc geninfo_all_blocks=1 00:21:45.596 --rc geninfo_unexecuted_blocks=1 00:21:45.596 00:21:45.596 ' 00:21:45.596 19:10:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:45.596 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:45.596 --rc genhtml_branch_coverage=1 00:21:45.596 --rc genhtml_function_coverage=1 00:21:45.596 --rc genhtml_legend=1 00:21:45.596 --rc geninfo_all_blocks=1 00:21:45.596 --rc geninfo_unexecuted_blocks=1 00:21:45.596 00:21:45.596 ' 00:21:45.596 19:10:06 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:45.596 19:10:06 -- nvmf/common.sh@7 -- # uname -s 00:21:45.596 19:10:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:45.596 19:10:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:45.596 19:10:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:45.596 19:10:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:45.596 19:10:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:45.596 19:10:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:45.596 19:10:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:45.596 19:10:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:45.596 19:10:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:45.596 19:10:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:45.596 19:10:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:45.596 19:10:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:45.596 19:10:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:45.596 19:10:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:45.596 19:10:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:45.596 19:10:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:45.596 19:10:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:45.596 19:10:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:45.596 19:10:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:45.596 19:10:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:45.596 19:10:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:45.596 19:10:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:45.596 19:10:06 -- paths/export.sh@5 -- # export PATH 00:21:45.596 19:10:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:45.596 19:10:06 -- nvmf/common.sh@46 -- # : 0 00:21:45.596 19:10:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:45.596 19:10:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:45.596 19:10:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:45.596 19:10:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:45.596 19:10:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:45.596 19:10:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:45.596 19:10:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:45.596 19:10:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:45.596 19:10:06 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:21:45.596 19:10:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:45.596 19:10:06 -- common/autotest_common.sh@10 -- # set +x 00:21:47.503 19:10:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:47.503 19:10:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:47.503 19:10:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:47.503 19:10:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:47.503 19:10:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:47.503 19:10:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:47.503 19:10:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:47.503 19:10:08 -- nvmf/common.sh@294 -- # net_devs=() 00:21:47.503 19:10:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:47.503 19:10:08 -- nvmf/common.sh@295 -- # e810=() 00:21:47.503 19:10:08 -- nvmf/common.sh@295 -- # local -ga e810 00:21:47.503 19:10:08 -- nvmf/common.sh@296 -- # x722=() 00:21:47.503 19:10:08 -- nvmf/common.sh@296 -- # local -ga x722 00:21:47.503 19:10:08 -- nvmf/common.sh@297 -- # mlx=() 00:21:47.503 19:10:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:47.503 19:10:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:47.503 19:10:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:47.503 19:10:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:47.503 19:10:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:47.503 19:10:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:47.503 19:10:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:47.503 19:10:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:47.503 19:10:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:47.503 19:10:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:47.503 19:10:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:47.503 19:10:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:47.503 19:10:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:47.503 19:10:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:47.503 19:10:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:47.503 19:10:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:47.503 19:10:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:47.503 19:10:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:47.503 19:10:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:47.503 19:10:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:47.503 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:47.503 19:10:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:47.503 19:10:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:47.503 19:10:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:47.503 19:10:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:47.503 19:10:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:47.503 19:10:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:47.503 19:10:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:47.503 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:47.503 19:10:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:47.503 19:10:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:47.503 19:10:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:47.503 19:10:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:47.503 19:10:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:47.503 19:10:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:47.503 19:10:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:47.503 19:10:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:47.503 19:10:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:47.503 19:10:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:47.503 19:10:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:47.503 19:10:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:47.503 19:10:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:47.503 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:47.503 19:10:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:47.503 19:10:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:47.503 19:10:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:47.503 19:10:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:47.503 19:10:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:47.503 19:10:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:47.503 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:47.503 19:10:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:47.503 19:10:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:47.503 19:10:08 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:47.503 19:10:08 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:21:47.503 19:10:08 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:21:47.503 19:10:08 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:21:47.503 19:10:08 -- target/perf_adq.sh@52 -- # rmmod ice 00:21:48.443 19:10:09 -- target/perf_adq.sh@53 -- # modprobe ice 00:21:52.636 19:10:12 -- target/perf_adq.sh@54 -- # sleep 5 00:21:56.838 19:10:17 -- target/perf_adq.sh@67 -- # nvmftestinit 00:21:56.838 19:10:17 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:56.838 19:10:17 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:56.838 19:10:17 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:56.838 19:10:17 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:56.838 19:10:17 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:56.838 19:10:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:56.838 19:10:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:56.838 19:10:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:56.838 19:10:17 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:56.838 19:10:17 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:56.838 19:10:17 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:56.838 19:10:17 -- common/autotest_common.sh@10 -- # set +x 00:21:56.838 19:10:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:56.838 19:10:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:56.838 19:10:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:56.838 19:10:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:56.838 19:10:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:56.838 19:10:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:56.838 19:10:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:56.838 19:10:17 -- nvmf/common.sh@294 -- # net_devs=() 00:21:56.838 19:10:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:56.838 19:10:17 -- nvmf/common.sh@295 -- # e810=() 00:21:56.838 19:10:17 -- nvmf/common.sh@295 -- # local -ga e810 00:21:56.838 19:10:17 -- nvmf/common.sh@296 -- # x722=() 00:21:56.838 19:10:17 -- nvmf/common.sh@296 -- # local -ga x722 00:21:56.838 19:10:17 -- nvmf/common.sh@297 -- # mlx=() 00:21:56.838 19:10:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:56.838 19:10:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:56.838 19:10:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:56.838 19:10:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:56.838 19:10:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:56.838 19:10:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:56.838 19:10:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:56.838 19:10:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:56.838 19:10:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:56.838 19:10:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:56.838 19:10:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:56.838 19:10:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:56.838 19:10:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:56.838 19:10:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:56.838 19:10:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:56.838 19:10:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:56.838 19:10:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:56.838 19:10:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:56.838 19:10:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:56.838 19:10:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:56.838 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:56.838 19:10:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:56.838 19:10:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:56.838 19:10:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:56.838 19:10:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:56.838 19:10:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:56.838 19:10:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:56.838 19:10:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:56.838 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:56.838 19:10:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:56.838 19:10:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:56.838 19:10:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:56.838 19:10:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:56.838 19:10:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:56.838 19:10:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:56.838 19:10:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:56.838 19:10:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:56.838 19:10:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:56.838 19:10:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:56.838 19:10:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:56.838 19:10:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:56.838 19:10:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:56.838 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:56.838 19:10:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:56.838 19:10:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:56.838 19:10:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:56.839 19:10:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:56.839 19:10:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:56.839 19:10:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:56.839 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:56.839 19:10:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:56.839 19:10:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:56.839 19:10:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:56.839 19:10:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:56.839 19:10:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:56.839 19:10:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:56.839 19:10:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:56.839 19:10:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:56.839 19:10:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:56.839 19:10:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:56.839 19:10:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:56.839 19:10:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:56.839 19:10:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:56.839 19:10:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:56.839 19:10:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:56.839 19:10:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:56.839 19:10:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:56.839 19:10:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:56.839 19:10:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:57.097 19:10:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:57.097 19:10:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:57.098 19:10:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:57.098 19:10:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:57.098 19:10:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:57.098 19:10:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:57.098 19:10:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:57.098 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:57.098 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.232 ms 00:21:57.098 00:21:57.098 --- 10.0.0.2 ping statistics --- 00:21:57.098 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:57.098 rtt min/avg/max/mdev = 0.232/0.232/0.232/0.000 ms 00:21:57.098 19:10:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:57.098 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:57.098 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.083 ms 00:21:57.098 00:21:57.098 --- 10.0.0.1 ping statistics --- 00:21:57.098 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:57.098 rtt min/avg/max/mdev = 0.083/0.083/0.083/0.000 ms 00:21:57.098 19:10:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:57.098 19:10:17 -- nvmf/common.sh@410 -- # return 0 00:21:57.098 19:10:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:57.098 19:10:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:57.098 19:10:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:57.098 19:10:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:57.098 19:10:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:57.098 19:10:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:57.098 19:10:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:57.098 19:10:18 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:21:57.098 19:10:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:57.098 19:10:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:57.098 19:10:18 -- common/autotest_common.sh@10 -- # set +x 00:21:57.098 19:10:18 -- nvmf/common.sh@469 -- # nvmfpid=263324 00:21:57.098 19:10:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:21:57.098 19:10:18 -- nvmf/common.sh@470 -- # waitforlisten 263324 00:21:57.098 19:10:18 -- common/autotest_common.sh@829 -- # '[' -z 263324 ']' 00:21:57.098 19:10:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:57.098 19:10:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:57.098 19:10:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:57.098 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:57.098 19:10:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:57.098 19:10:18 -- common/autotest_common.sh@10 -- # set +x 00:21:57.098 [2024-11-28 19:10:18.051822] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:57.098 [2024-11-28 19:10:18.051894] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:57.098 EAL: No free 2048 kB hugepages reported on node 1 00:21:57.098 [2024-11-28 19:10:18.117754] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:57.357 [2024-11-28 19:10:18.226165] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:57.357 [2024-11-28 19:10:18.226342] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:57.357 [2024-11-28 19:10:18.226360] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:57.357 [2024-11-28 19:10:18.226373] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:57.358 [2024-11-28 19:10:18.226434] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:57.358 [2024-11-28 19:10:18.226465] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:57.358 [2024-11-28 19:10:18.226525] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:57.358 [2024-11-28 19:10:18.226825] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:57.358 19:10:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:57.358 19:10:18 -- common/autotest_common.sh@862 -- # return 0 00:21:57.358 19:10:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:57.358 19:10:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:57.358 19:10:18 -- common/autotest_common.sh@10 -- # set +x 00:21:57.358 19:10:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:57.358 19:10:18 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:21:57.358 19:10:18 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:21:57.358 19:10:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:57.358 19:10:18 -- common/autotest_common.sh@10 -- # set +x 00:21:57.358 19:10:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:57.358 19:10:18 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:21:57.358 19:10:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:57.358 19:10:18 -- common/autotest_common.sh@10 -- # set +x 00:21:57.617 19:10:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:57.617 19:10:18 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:21:57.617 19:10:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:57.617 19:10:18 -- common/autotest_common.sh@10 -- # set +x 00:21:57.617 [2024-11-28 19:10:18.425391] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:57.618 19:10:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:57.618 19:10:18 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:21:57.618 19:10:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:57.618 19:10:18 -- common/autotest_common.sh@10 -- # set +x 00:21:57.618 Malloc1 00:21:57.618 19:10:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:57.618 19:10:18 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:57.618 19:10:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:57.618 19:10:18 -- common/autotest_common.sh@10 -- # set +x 00:21:57.618 19:10:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:57.618 19:10:18 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:21:57.618 19:10:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:57.618 19:10:18 -- common/autotest_common.sh@10 -- # set +x 00:21:57.618 19:10:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:57.618 19:10:18 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:57.618 19:10:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:57.618 19:10:18 -- common/autotest_common.sh@10 -- # set +x 00:21:57.618 [2024-11-28 19:10:18.478686] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:57.618 19:10:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:57.618 19:10:18 -- target/perf_adq.sh@73 -- # perfpid=263361 00:21:57.618 19:10:18 -- target/perf_adq.sh@74 -- # sleep 2 00:21:57.618 19:10:18 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:21:57.618 EAL: No free 2048 kB hugepages reported on node 1 00:21:59.522 19:10:20 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:21:59.522 19:10:20 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:21:59.522 19:10:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:59.522 19:10:20 -- target/perf_adq.sh@76 -- # wc -l 00:21:59.522 19:10:20 -- common/autotest_common.sh@10 -- # set +x 00:21:59.522 19:10:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:59.522 19:10:20 -- target/perf_adq.sh@76 -- # count=4 00:21:59.522 19:10:20 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:21:59.522 19:10:20 -- target/perf_adq.sh@81 -- # wait 263361 00:22:07.635 Initializing NVMe Controllers 00:22:07.635 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:07.635 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:22:07.635 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:22:07.635 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:22:07.635 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:22:07.635 Initialization complete. Launching workers. 00:22:07.635 ======================================================== 00:22:07.635 Latency(us) 00:22:07.635 Device Information : IOPS MiB/s Average min max 00:22:07.635 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 11366.90 44.40 5630.12 1836.74 9376.99 00:22:07.635 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 10979.70 42.89 5830.57 1754.64 9656.93 00:22:07.635 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 11291.50 44.11 5679.15 1805.20 46635.73 00:22:07.635 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 11089.20 43.32 5773.44 1783.77 9354.56 00:22:07.635 ======================================================== 00:22:07.635 Total : 44727.30 174.72 5727.24 1754.64 46635.73 00:22:07.635 00:22:07.635 19:10:28 -- target/perf_adq.sh@82 -- # nvmftestfini 00:22:07.635 19:10:28 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:07.635 19:10:28 -- nvmf/common.sh@116 -- # sync 00:22:07.635 19:10:28 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:07.635 19:10:28 -- nvmf/common.sh@119 -- # set +e 00:22:07.635 19:10:28 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:07.635 19:10:28 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:07.635 rmmod nvme_tcp 00:22:07.635 rmmod nvme_fabrics 00:22:07.893 rmmod nvme_keyring 00:22:07.893 19:10:28 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:07.893 19:10:28 -- nvmf/common.sh@123 -- # set -e 00:22:07.893 19:10:28 -- nvmf/common.sh@124 -- # return 0 00:22:07.893 19:10:28 -- nvmf/common.sh@477 -- # '[' -n 263324 ']' 00:22:07.893 19:10:28 -- nvmf/common.sh@478 -- # killprocess 263324 00:22:07.893 19:10:28 -- common/autotest_common.sh@936 -- # '[' -z 263324 ']' 00:22:07.893 19:10:28 -- common/autotest_common.sh@940 -- # kill -0 263324 00:22:07.893 19:10:28 -- common/autotest_common.sh@941 -- # uname 00:22:07.893 19:10:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:07.893 19:10:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 263324 00:22:07.893 19:10:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:07.893 19:10:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:07.893 19:10:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 263324' 00:22:07.893 killing process with pid 263324 00:22:07.893 19:10:28 -- common/autotest_common.sh@955 -- # kill 263324 00:22:07.893 19:10:28 -- common/autotest_common.sh@960 -- # wait 263324 00:22:08.151 19:10:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:08.151 19:10:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:08.151 19:10:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:08.151 19:10:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:08.151 19:10:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:08.151 19:10:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:08.151 19:10:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:08.151 19:10:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:10.056 19:10:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:10.056 19:10:31 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:22:10.056 19:10:31 -- target/perf_adq.sh@52 -- # rmmod ice 00:22:10.990 19:10:31 -- target/perf_adq.sh@53 -- # modprobe ice 00:22:13.529 19:10:34 -- target/perf_adq.sh@54 -- # sleep 5 00:22:18.795 19:10:39 -- target/perf_adq.sh@87 -- # nvmftestinit 00:22:18.795 19:10:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:18.795 19:10:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:18.795 19:10:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:18.795 19:10:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:18.795 19:10:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:18.795 19:10:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:18.795 19:10:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:18.795 19:10:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:18.795 19:10:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:18.795 19:10:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:18.795 19:10:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:18.795 19:10:39 -- common/autotest_common.sh@10 -- # set +x 00:22:18.795 19:10:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:18.795 19:10:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:18.795 19:10:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:18.795 19:10:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:18.795 19:10:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:18.795 19:10:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:18.795 19:10:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:18.795 19:10:39 -- nvmf/common.sh@294 -- # net_devs=() 00:22:18.795 19:10:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:18.795 19:10:39 -- nvmf/common.sh@295 -- # e810=() 00:22:18.795 19:10:39 -- nvmf/common.sh@295 -- # local -ga e810 00:22:18.795 19:10:39 -- nvmf/common.sh@296 -- # x722=() 00:22:18.795 19:10:39 -- nvmf/common.sh@296 -- # local -ga x722 00:22:18.795 19:10:39 -- nvmf/common.sh@297 -- # mlx=() 00:22:18.795 19:10:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:18.795 19:10:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:18.795 19:10:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:18.795 19:10:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:18.795 19:10:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:18.795 19:10:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:18.795 19:10:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:18.795 19:10:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:18.795 19:10:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:18.795 19:10:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:18.795 19:10:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:18.795 19:10:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:18.795 19:10:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:18.795 19:10:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:18.795 19:10:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:18.795 19:10:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:18.795 19:10:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:18.795 19:10:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:18.795 19:10:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:18.795 19:10:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:18.795 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:18.795 19:10:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:18.795 19:10:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:18.795 19:10:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:18.795 19:10:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:18.795 19:10:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:18.795 19:10:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:18.795 19:10:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:18.795 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:18.795 19:10:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:18.795 19:10:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:18.795 19:10:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:18.795 19:10:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:18.795 19:10:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:18.795 19:10:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:18.795 19:10:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:18.795 19:10:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:18.795 19:10:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:18.795 19:10:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:18.795 19:10:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:18.795 19:10:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:18.795 19:10:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:18.795 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:18.795 19:10:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:18.795 19:10:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:18.795 19:10:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:18.795 19:10:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:18.795 19:10:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:18.795 19:10:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:18.795 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:18.795 19:10:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:18.795 19:10:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:18.795 19:10:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:18.795 19:10:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:18.795 19:10:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:18.795 19:10:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:18.795 19:10:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:18.795 19:10:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:18.795 19:10:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:18.795 19:10:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:18.795 19:10:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:18.795 19:10:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:18.795 19:10:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:18.795 19:10:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:18.795 19:10:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:18.795 19:10:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:18.795 19:10:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:18.795 19:10:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:18.795 19:10:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:18.795 19:10:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:18.795 19:10:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:18.795 19:10:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:18.795 19:10:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:18.795 19:10:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:18.795 19:10:39 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:18.795 19:10:39 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:18.795 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:18.795 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.263 ms 00:22:18.795 00:22:18.795 --- 10.0.0.2 ping statistics --- 00:22:18.795 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:18.795 rtt min/avg/max/mdev = 0.263/0.263/0.263/0.000 ms 00:22:18.795 19:10:39 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:18.795 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:18.795 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.083 ms 00:22:18.795 00:22:18.795 --- 10.0.0.1 ping statistics --- 00:22:18.795 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:18.795 rtt min/avg/max/mdev = 0.083/0.083/0.083/0.000 ms 00:22:18.795 19:10:39 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:18.795 19:10:39 -- nvmf/common.sh@410 -- # return 0 00:22:18.795 19:10:39 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:18.795 19:10:39 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:18.795 19:10:39 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:18.795 19:10:39 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:18.796 19:10:39 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:18.796 19:10:39 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:18.796 19:10:39 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:18.796 19:10:39 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:22:18.796 19:10:39 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:22:18.796 19:10:39 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:22:18.796 19:10:39 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:22:18.796 net.core.busy_poll = 1 00:22:18.796 19:10:39 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:22:18.796 net.core.busy_read = 1 00:22:18.796 19:10:39 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:22:18.796 19:10:39 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:22:18.796 19:10:39 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:22:18.796 19:10:39 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:22:18.796 19:10:39 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:22:18.796 19:10:39 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:22:18.796 19:10:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:18.796 19:10:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:18.796 19:10:39 -- common/autotest_common.sh@10 -- # set +x 00:22:18.796 19:10:39 -- nvmf/common.sh@469 -- # nvmfpid=266176 00:22:18.796 19:10:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:22:18.796 19:10:39 -- nvmf/common.sh@470 -- # waitforlisten 266176 00:22:18.796 19:10:39 -- common/autotest_common.sh@829 -- # '[' -z 266176 ']' 00:22:18.796 19:10:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:18.796 19:10:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:18.796 19:10:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:18.796 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:18.796 19:10:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:18.796 19:10:39 -- common/autotest_common.sh@10 -- # set +x 00:22:18.796 [2024-11-28 19:10:39.649091] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:18.796 [2024-11-28 19:10:39.649181] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:18.796 EAL: No free 2048 kB hugepages reported on node 1 00:22:18.796 [2024-11-28 19:10:39.714547] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:18.796 [2024-11-28 19:10:39.823863] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:18.796 [2024-11-28 19:10:39.824024] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:18.796 [2024-11-28 19:10:39.824042] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:18.796 [2024-11-28 19:10:39.824054] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:18.796 [2024-11-28 19:10:39.824113] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:18.796 [2024-11-28 19:10:39.824170] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:18.796 [2024-11-28 19:10:39.824236] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:18.796 [2024-11-28 19:10:39.824238] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:19.054 19:10:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:19.054 19:10:39 -- common/autotest_common.sh@862 -- # return 0 00:22:19.054 19:10:39 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:19.054 19:10:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:19.054 19:10:39 -- common/autotest_common.sh@10 -- # set +x 00:22:19.054 19:10:39 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:19.054 19:10:39 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:22:19.054 19:10:39 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:22:19.054 19:10:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.054 19:10:39 -- common/autotest_common.sh@10 -- # set +x 00:22:19.054 19:10:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.054 19:10:39 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:22:19.054 19:10:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.054 19:10:39 -- common/autotest_common.sh@10 -- # set +x 00:22:19.054 19:10:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.054 19:10:40 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:22:19.054 19:10:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.054 19:10:40 -- common/autotest_common.sh@10 -- # set +x 00:22:19.054 [2024-11-28 19:10:40.007320] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:19.054 19:10:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.054 19:10:40 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:19.054 19:10:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.054 19:10:40 -- common/autotest_common.sh@10 -- # set +x 00:22:19.054 Malloc1 00:22:19.054 19:10:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.054 19:10:40 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:22:19.054 19:10:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.054 19:10:40 -- common/autotest_common.sh@10 -- # set +x 00:22:19.054 19:10:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.055 19:10:40 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:22:19.055 19:10:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.055 19:10:40 -- common/autotest_common.sh@10 -- # set +x 00:22:19.055 19:10:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.055 19:10:40 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:19.055 19:10:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:19.055 19:10:40 -- common/autotest_common.sh@10 -- # set +x 00:22:19.055 [2024-11-28 19:10:40.061306] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:19.055 19:10:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:19.055 19:10:40 -- target/perf_adq.sh@94 -- # perfpid=266209 00:22:19.055 19:10:40 -- target/perf_adq.sh@95 -- # sleep 2 00:22:19.055 19:10:40 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:22:19.055 EAL: No free 2048 kB hugepages reported on node 1 00:22:21.585 19:10:42 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:22:21.585 19:10:42 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:22:21.585 19:10:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:21.585 19:10:42 -- target/perf_adq.sh@97 -- # wc -l 00:22:21.585 19:10:42 -- common/autotest_common.sh@10 -- # set +x 00:22:21.585 19:10:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:21.585 19:10:42 -- target/perf_adq.sh@97 -- # count=2 00:22:21.585 19:10:42 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:22:21.585 19:10:42 -- target/perf_adq.sh@103 -- # wait 266209 00:22:29.703 Initializing NVMe Controllers 00:22:29.703 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:22:29.703 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:22:29.703 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:22:29.703 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:22:29.703 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:22:29.703 Initialization complete. Launching workers. 00:22:29.703 ======================================================== 00:22:29.703 Latency(us) 00:22:29.703 Device Information : IOPS MiB/s Average min max 00:22:29.703 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 7266.00 28.38 8812.24 1309.43 53017.76 00:22:29.703 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 6999.00 27.34 9144.68 1623.91 54033.31 00:22:29.703 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 6792.60 26.53 9426.27 1468.99 53400.64 00:22:29.703 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 6377.20 24.91 10074.10 1698.91 54557.87 00:22:29.703 ======================================================== 00:22:29.703 Total : 27434.80 107.17 9342.40 1309.43 54557.87 00:22:29.703 00:22:29.703 19:10:50 -- target/perf_adq.sh@104 -- # nvmftestfini 00:22:29.703 19:10:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:29.703 19:10:50 -- nvmf/common.sh@116 -- # sync 00:22:29.703 19:10:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:29.703 19:10:50 -- nvmf/common.sh@119 -- # set +e 00:22:29.703 19:10:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:29.703 19:10:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:29.703 rmmod nvme_tcp 00:22:29.703 rmmod nvme_fabrics 00:22:29.703 rmmod nvme_keyring 00:22:29.703 19:10:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:29.703 19:10:50 -- nvmf/common.sh@123 -- # set -e 00:22:29.703 19:10:50 -- nvmf/common.sh@124 -- # return 0 00:22:29.703 19:10:50 -- nvmf/common.sh@477 -- # '[' -n 266176 ']' 00:22:29.703 19:10:50 -- nvmf/common.sh@478 -- # killprocess 266176 00:22:29.703 19:10:50 -- common/autotest_common.sh@936 -- # '[' -z 266176 ']' 00:22:29.703 19:10:50 -- common/autotest_common.sh@940 -- # kill -0 266176 00:22:29.703 19:10:50 -- common/autotest_common.sh@941 -- # uname 00:22:29.703 19:10:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:29.703 19:10:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 266176 00:22:29.703 19:10:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:29.704 19:10:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:29.704 19:10:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 266176' 00:22:29.704 killing process with pid 266176 00:22:29.704 19:10:50 -- common/autotest_common.sh@955 -- # kill 266176 00:22:29.704 19:10:50 -- common/autotest_common.sh@960 -- # wait 266176 00:22:29.704 19:10:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:29.704 19:10:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:29.704 19:10:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:29.704 19:10:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:29.704 19:10:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:29.704 19:10:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:29.704 19:10:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:29.704 19:10:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:32.997 19:10:53 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:32.997 19:10:53 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:22:32.997 00:22:32.997 real 0m47.239s 00:22:32.997 user 2m37.910s 00:22:32.997 sys 0m11.437s 00:22:32.997 19:10:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:32.997 19:10:53 -- common/autotest_common.sh@10 -- # set +x 00:22:32.997 ************************************ 00:22:32.997 END TEST nvmf_perf_adq 00:22:32.997 ************************************ 00:22:32.997 19:10:53 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:22:32.997 19:10:53 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:32.997 19:10:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:32.997 19:10:53 -- common/autotest_common.sh@10 -- # set +x 00:22:32.997 ************************************ 00:22:32.997 START TEST nvmf_shutdown 00:22:32.997 ************************************ 00:22:32.997 19:10:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:22:32.997 * Looking for test storage... 00:22:32.997 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:32.997 19:10:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:32.997 19:10:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:32.997 19:10:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:32.997 19:10:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:32.997 19:10:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:32.997 19:10:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:32.997 19:10:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:32.998 19:10:53 -- scripts/common.sh@335 -- # IFS=.-: 00:22:32.998 19:10:53 -- scripts/common.sh@335 -- # read -ra ver1 00:22:32.998 19:10:53 -- scripts/common.sh@336 -- # IFS=.-: 00:22:32.998 19:10:53 -- scripts/common.sh@336 -- # read -ra ver2 00:22:32.998 19:10:53 -- scripts/common.sh@337 -- # local 'op=<' 00:22:32.998 19:10:53 -- scripts/common.sh@339 -- # ver1_l=2 00:22:32.998 19:10:53 -- scripts/common.sh@340 -- # ver2_l=1 00:22:32.998 19:10:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:32.998 19:10:53 -- scripts/common.sh@343 -- # case "$op" in 00:22:32.998 19:10:53 -- scripts/common.sh@344 -- # : 1 00:22:32.998 19:10:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:32.998 19:10:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:32.998 19:10:53 -- scripts/common.sh@364 -- # decimal 1 00:22:32.998 19:10:53 -- scripts/common.sh@352 -- # local d=1 00:22:32.998 19:10:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:32.998 19:10:53 -- scripts/common.sh@354 -- # echo 1 00:22:32.998 19:10:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:32.998 19:10:53 -- scripts/common.sh@365 -- # decimal 2 00:22:32.998 19:10:53 -- scripts/common.sh@352 -- # local d=2 00:22:32.998 19:10:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:32.998 19:10:53 -- scripts/common.sh@354 -- # echo 2 00:22:32.998 19:10:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:32.998 19:10:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:32.998 19:10:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:32.998 19:10:53 -- scripts/common.sh@367 -- # return 0 00:22:32.998 19:10:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:32.998 19:10:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:32.998 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:32.998 --rc genhtml_branch_coverage=1 00:22:32.998 --rc genhtml_function_coverage=1 00:22:32.998 --rc genhtml_legend=1 00:22:32.998 --rc geninfo_all_blocks=1 00:22:32.998 --rc geninfo_unexecuted_blocks=1 00:22:32.998 00:22:32.998 ' 00:22:32.998 19:10:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:32.998 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:32.998 --rc genhtml_branch_coverage=1 00:22:32.998 --rc genhtml_function_coverage=1 00:22:32.998 --rc genhtml_legend=1 00:22:32.998 --rc geninfo_all_blocks=1 00:22:32.998 --rc geninfo_unexecuted_blocks=1 00:22:32.998 00:22:32.998 ' 00:22:32.998 19:10:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:32.998 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:32.998 --rc genhtml_branch_coverage=1 00:22:32.998 --rc genhtml_function_coverage=1 00:22:32.998 --rc genhtml_legend=1 00:22:32.998 --rc geninfo_all_blocks=1 00:22:32.998 --rc geninfo_unexecuted_blocks=1 00:22:32.998 00:22:32.998 ' 00:22:32.998 19:10:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:32.998 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:32.998 --rc genhtml_branch_coverage=1 00:22:32.998 --rc genhtml_function_coverage=1 00:22:32.998 --rc genhtml_legend=1 00:22:32.998 --rc geninfo_all_blocks=1 00:22:32.998 --rc geninfo_unexecuted_blocks=1 00:22:32.998 00:22:32.998 ' 00:22:32.998 19:10:53 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:32.998 19:10:53 -- nvmf/common.sh@7 -- # uname -s 00:22:32.998 19:10:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:32.998 19:10:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:32.998 19:10:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:32.998 19:10:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:32.998 19:10:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:32.998 19:10:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:32.998 19:10:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:32.998 19:10:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:32.998 19:10:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:32.998 19:10:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:32.998 19:10:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:32.998 19:10:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:32.998 19:10:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:32.998 19:10:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:32.998 19:10:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:32.998 19:10:53 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:32.998 19:10:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:32.998 19:10:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:32.998 19:10:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:32.998 19:10:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:32.998 19:10:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:32.998 19:10:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:32.998 19:10:53 -- paths/export.sh@5 -- # export PATH 00:22:32.998 19:10:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:32.998 19:10:53 -- nvmf/common.sh@46 -- # : 0 00:22:32.998 19:10:53 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:32.998 19:10:53 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:32.998 19:10:53 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:32.998 19:10:53 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:32.998 19:10:53 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:32.998 19:10:53 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:32.998 19:10:53 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:32.998 19:10:53 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:32.998 19:10:53 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:32.998 19:10:53 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:32.998 19:10:53 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:22:32.998 19:10:53 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:32.998 19:10:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:32.998 19:10:53 -- common/autotest_common.sh@10 -- # set +x 00:22:32.998 ************************************ 00:22:32.998 START TEST nvmf_shutdown_tc1 00:22:32.998 ************************************ 00:22:32.998 19:10:53 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc1 00:22:32.998 19:10:53 -- target/shutdown.sh@74 -- # starttarget 00:22:32.998 19:10:53 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:32.998 19:10:53 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:32.998 19:10:53 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:32.998 19:10:53 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:32.998 19:10:53 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:32.998 19:10:53 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:32.998 19:10:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:32.998 19:10:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:32.998 19:10:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:32.998 19:10:53 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:32.998 19:10:53 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:32.998 19:10:53 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:32.998 19:10:53 -- common/autotest_common.sh@10 -- # set +x 00:22:34.901 19:10:55 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:34.901 19:10:55 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:34.901 19:10:55 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:34.901 19:10:55 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:34.901 19:10:55 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:34.901 19:10:55 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:34.901 19:10:55 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:34.901 19:10:55 -- nvmf/common.sh@294 -- # net_devs=() 00:22:34.901 19:10:55 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:34.901 19:10:55 -- nvmf/common.sh@295 -- # e810=() 00:22:35.159 19:10:55 -- nvmf/common.sh@295 -- # local -ga e810 00:22:35.159 19:10:55 -- nvmf/common.sh@296 -- # x722=() 00:22:35.159 19:10:55 -- nvmf/common.sh@296 -- # local -ga x722 00:22:35.159 19:10:55 -- nvmf/common.sh@297 -- # mlx=() 00:22:35.159 19:10:55 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:35.159 19:10:55 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:35.159 19:10:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:35.159 19:10:55 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:35.159 19:10:55 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:35.159 19:10:55 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:35.159 19:10:55 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:35.159 19:10:55 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:35.159 19:10:55 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:35.159 19:10:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:35.159 19:10:55 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:35.159 19:10:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:35.160 19:10:55 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:35.160 19:10:55 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:35.160 19:10:55 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:35.160 19:10:55 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:35.160 19:10:55 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:35.160 19:10:55 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:35.160 19:10:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:35.160 19:10:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:35.160 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:35.160 19:10:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:35.160 19:10:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:35.160 19:10:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:35.160 19:10:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:35.160 19:10:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:35.160 19:10:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:35.160 19:10:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:35.160 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:35.160 19:10:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:35.160 19:10:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:35.160 19:10:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:35.160 19:10:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:35.160 19:10:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:35.160 19:10:55 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:35.160 19:10:55 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:35.160 19:10:55 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:35.160 19:10:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:35.160 19:10:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:35.160 19:10:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:35.160 19:10:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:35.160 19:10:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:35.160 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:35.160 19:10:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:35.160 19:10:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:35.160 19:10:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:35.160 19:10:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:35.160 19:10:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:35.160 19:10:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:35.160 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:35.160 19:10:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:35.160 19:10:55 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:35.160 19:10:55 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:35.160 19:10:55 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:35.160 19:10:55 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:35.160 19:10:55 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:35.160 19:10:55 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:35.160 19:10:55 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:35.160 19:10:55 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:35.160 19:10:55 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:35.160 19:10:55 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:35.160 19:10:55 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:35.160 19:10:55 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:35.160 19:10:55 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:35.160 19:10:55 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:35.160 19:10:55 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:35.160 19:10:55 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:35.160 19:10:55 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:35.160 19:10:55 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:35.160 19:10:56 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:35.160 19:10:56 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:35.160 19:10:56 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:35.160 19:10:56 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:35.160 19:10:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:35.160 19:10:56 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:35.419 19:10:56 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:35.419 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:35.419 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.353 ms 00:22:35.419 00:22:35.419 --- 10.0.0.2 ping statistics --- 00:22:35.419 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:35.419 rtt min/avg/max/mdev = 0.353/0.353/0.353/0.000 ms 00:22:35.419 19:10:56 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:35.419 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:35.419 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.136 ms 00:22:35.419 00:22:35.419 --- 10.0.0.1 ping statistics --- 00:22:35.419 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:35.419 rtt min/avg/max/mdev = 0.136/0.136/0.136/0.000 ms 00:22:35.419 19:10:56 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:35.419 19:10:56 -- nvmf/common.sh@410 -- # return 0 00:22:35.419 19:10:56 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:35.419 19:10:56 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:35.419 19:10:56 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:35.419 19:10:56 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:35.419 19:10:56 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:35.419 19:10:56 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:35.419 19:10:56 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:35.419 19:10:56 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:35.419 19:10:56 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:35.419 19:10:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:35.419 19:10:56 -- common/autotest_common.sh@10 -- # set +x 00:22:35.419 19:10:56 -- nvmf/common.sh@469 -- # nvmfpid=269556 00:22:35.419 19:10:56 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:35.419 19:10:56 -- nvmf/common.sh@470 -- # waitforlisten 269556 00:22:35.419 19:10:56 -- common/autotest_common.sh@829 -- # '[' -z 269556 ']' 00:22:35.419 19:10:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:35.419 19:10:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:35.419 19:10:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:35.419 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:35.419 19:10:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:35.419 19:10:56 -- common/autotest_common.sh@10 -- # set +x 00:22:35.419 [2024-11-28 19:10:56.286897] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:35.419 [2024-11-28 19:10:56.286975] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:35.419 EAL: No free 2048 kB hugepages reported on node 1 00:22:35.419 [2024-11-28 19:10:56.354385] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:35.419 [2024-11-28 19:10:56.461676] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:35.419 [2024-11-28 19:10:56.461832] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:35.419 [2024-11-28 19:10:56.461850] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:35.419 [2024-11-28 19:10:56.461863] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:35.419 [2024-11-28 19:10:56.461969] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:35.419 [2024-11-28 19:10:56.462002] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:35.419 [2024-11-28 19:10:56.462063] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:35.419 [2024-11-28 19:10:56.462065] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:36.357 19:10:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:36.357 19:10:57 -- common/autotest_common.sh@862 -- # return 0 00:22:36.357 19:10:57 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:36.357 19:10:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:36.357 19:10:57 -- common/autotest_common.sh@10 -- # set +x 00:22:36.357 19:10:57 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:36.357 19:10:57 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:36.357 19:10:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:36.357 19:10:57 -- common/autotest_common.sh@10 -- # set +x 00:22:36.357 [2024-11-28 19:10:57.305033] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:36.357 19:10:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:36.357 19:10:57 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:36.357 19:10:57 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:36.357 19:10:57 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:36.357 19:10:57 -- common/autotest_common.sh@10 -- # set +x 00:22:36.357 19:10:57 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:36.357 19:10:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:36.357 19:10:57 -- target/shutdown.sh@28 -- # cat 00:22:36.357 19:10:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:36.357 19:10:57 -- target/shutdown.sh@28 -- # cat 00:22:36.357 19:10:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:36.357 19:10:57 -- target/shutdown.sh@28 -- # cat 00:22:36.357 19:10:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:36.357 19:10:57 -- target/shutdown.sh@28 -- # cat 00:22:36.357 19:10:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:36.357 19:10:57 -- target/shutdown.sh@28 -- # cat 00:22:36.357 19:10:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:36.357 19:10:57 -- target/shutdown.sh@28 -- # cat 00:22:36.357 19:10:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:36.357 19:10:57 -- target/shutdown.sh@28 -- # cat 00:22:36.357 19:10:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:36.357 19:10:57 -- target/shutdown.sh@28 -- # cat 00:22:36.357 19:10:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:36.357 19:10:57 -- target/shutdown.sh@28 -- # cat 00:22:36.357 19:10:57 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:36.357 19:10:57 -- target/shutdown.sh@28 -- # cat 00:22:36.357 19:10:57 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:36.357 19:10:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:36.357 19:10:57 -- common/autotest_common.sh@10 -- # set +x 00:22:36.357 Malloc1 00:22:36.357 [2024-11-28 19:10:57.379959] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:36.617 Malloc2 00:22:36.617 Malloc3 00:22:36.617 Malloc4 00:22:36.617 Malloc5 00:22:36.617 Malloc6 00:22:36.617 Malloc7 00:22:36.876 Malloc8 00:22:36.876 Malloc9 00:22:36.876 Malloc10 00:22:36.876 19:10:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:36.876 19:10:57 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:36.876 19:10:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:36.876 19:10:57 -- common/autotest_common.sh@10 -- # set +x 00:22:36.876 19:10:57 -- target/shutdown.sh@78 -- # perfpid=269870 00:22:36.876 19:10:57 -- target/shutdown.sh@79 -- # waitforlisten 269870 /var/tmp/bdevperf.sock 00:22:36.876 19:10:57 -- common/autotest_common.sh@829 -- # '[' -z 269870 ']' 00:22:36.876 19:10:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:36.876 19:10:57 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:22:36.876 19:10:57 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:36.876 19:10:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:36.876 19:10:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:36.876 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:36.876 19:10:57 -- nvmf/common.sh@520 -- # config=() 00:22:36.876 19:10:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:36.876 19:10:57 -- nvmf/common.sh@520 -- # local subsystem config 00:22:36.876 19:10:57 -- common/autotest_common.sh@10 -- # set +x 00:22:36.876 19:10:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:36.876 19:10:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:36.876 { 00:22:36.876 "params": { 00:22:36.876 "name": "Nvme$subsystem", 00:22:36.876 "trtype": "$TEST_TRANSPORT", 00:22:36.876 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:36.876 "adrfam": "ipv4", 00:22:36.876 "trsvcid": "$NVMF_PORT", 00:22:36.876 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:36.876 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:36.876 "hdgst": ${hdgst:-false}, 00:22:36.876 "ddgst": ${ddgst:-false} 00:22:36.876 }, 00:22:36.876 "method": "bdev_nvme_attach_controller" 00:22:36.876 } 00:22:36.876 EOF 00:22:36.876 )") 00:22:36.876 19:10:57 -- nvmf/common.sh@542 -- # cat 00:22:36.876 19:10:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:36.876 19:10:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:36.876 { 00:22:36.876 "params": { 00:22:36.876 "name": "Nvme$subsystem", 00:22:36.876 "trtype": "$TEST_TRANSPORT", 00:22:36.876 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:36.876 "adrfam": "ipv4", 00:22:36.876 "trsvcid": "$NVMF_PORT", 00:22:36.876 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:36.876 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:36.876 "hdgst": ${hdgst:-false}, 00:22:36.876 "ddgst": ${ddgst:-false} 00:22:36.876 }, 00:22:36.876 "method": "bdev_nvme_attach_controller" 00:22:36.876 } 00:22:36.876 EOF 00:22:36.876 )") 00:22:36.876 19:10:57 -- nvmf/common.sh@542 -- # cat 00:22:36.876 19:10:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:36.876 19:10:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:36.876 { 00:22:36.876 "params": { 00:22:36.876 "name": "Nvme$subsystem", 00:22:36.876 "trtype": "$TEST_TRANSPORT", 00:22:36.876 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:36.876 "adrfam": "ipv4", 00:22:36.876 "trsvcid": "$NVMF_PORT", 00:22:36.876 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:36.876 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:36.876 "hdgst": ${hdgst:-false}, 00:22:36.876 "ddgst": ${ddgst:-false} 00:22:36.876 }, 00:22:36.876 "method": "bdev_nvme_attach_controller" 00:22:36.876 } 00:22:36.876 EOF 00:22:36.876 )") 00:22:36.876 19:10:57 -- nvmf/common.sh@542 -- # cat 00:22:36.876 19:10:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:36.876 19:10:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:36.876 { 00:22:36.876 "params": { 00:22:36.876 "name": "Nvme$subsystem", 00:22:36.876 "trtype": "$TEST_TRANSPORT", 00:22:36.876 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:36.876 "adrfam": "ipv4", 00:22:36.876 "trsvcid": "$NVMF_PORT", 00:22:36.876 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:36.876 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:36.876 "hdgst": ${hdgst:-false}, 00:22:36.877 "ddgst": ${ddgst:-false} 00:22:36.877 }, 00:22:36.877 "method": "bdev_nvme_attach_controller" 00:22:36.877 } 00:22:36.877 EOF 00:22:36.877 )") 00:22:36.877 19:10:57 -- nvmf/common.sh@542 -- # cat 00:22:36.877 19:10:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:36.877 19:10:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:36.877 { 00:22:36.877 "params": { 00:22:36.877 "name": "Nvme$subsystem", 00:22:36.877 "trtype": "$TEST_TRANSPORT", 00:22:36.877 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:36.877 "adrfam": "ipv4", 00:22:36.877 "trsvcid": "$NVMF_PORT", 00:22:36.877 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:36.877 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:36.877 "hdgst": ${hdgst:-false}, 00:22:36.877 "ddgst": ${ddgst:-false} 00:22:36.877 }, 00:22:36.877 "method": "bdev_nvme_attach_controller" 00:22:36.877 } 00:22:36.877 EOF 00:22:36.877 )") 00:22:36.877 19:10:57 -- nvmf/common.sh@542 -- # cat 00:22:36.877 19:10:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:36.877 19:10:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:36.877 { 00:22:36.877 "params": { 00:22:36.877 "name": "Nvme$subsystem", 00:22:36.877 "trtype": "$TEST_TRANSPORT", 00:22:36.877 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:36.877 "adrfam": "ipv4", 00:22:36.877 "trsvcid": "$NVMF_PORT", 00:22:36.877 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:36.877 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:36.877 "hdgst": ${hdgst:-false}, 00:22:36.877 "ddgst": ${ddgst:-false} 00:22:36.877 }, 00:22:36.877 "method": "bdev_nvme_attach_controller" 00:22:36.877 } 00:22:36.877 EOF 00:22:36.877 )") 00:22:36.877 19:10:57 -- nvmf/common.sh@542 -- # cat 00:22:36.877 19:10:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:36.877 19:10:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:36.877 { 00:22:36.877 "params": { 00:22:36.877 "name": "Nvme$subsystem", 00:22:36.877 "trtype": "$TEST_TRANSPORT", 00:22:36.877 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:36.877 "adrfam": "ipv4", 00:22:36.877 "trsvcid": "$NVMF_PORT", 00:22:36.877 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:36.877 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:36.877 "hdgst": ${hdgst:-false}, 00:22:36.877 "ddgst": ${ddgst:-false} 00:22:36.877 }, 00:22:36.877 "method": "bdev_nvme_attach_controller" 00:22:36.877 } 00:22:36.877 EOF 00:22:36.877 )") 00:22:36.877 19:10:57 -- nvmf/common.sh@542 -- # cat 00:22:36.877 19:10:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:36.877 19:10:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:36.877 { 00:22:36.877 "params": { 00:22:36.877 "name": "Nvme$subsystem", 00:22:36.877 "trtype": "$TEST_TRANSPORT", 00:22:36.877 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:36.877 "adrfam": "ipv4", 00:22:36.877 "trsvcid": "$NVMF_PORT", 00:22:36.877 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:36.877 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:36.877 "hdgst": ${hdgst:-false}, 00:22:36.877 "ddgst": ${ddgst:-false} 00:22:36.877 }, 00:22:36.877 "method": "bdev_nvme_attach_controller" 00:22:36.877 } 00:22:36.877 EOF 00:22:36.877 )") 00:22:36.877 19:10:57 -- nvmf/common.sh@542 -- # cat 00:22:36.877 19:10:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:36.877 19:10:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:36.877 { 00:22:36.877 "params": { 00:22:36.877 "name": "Nvme$subsystem", 00:22:36.877 "trtype": "$TEST_TRANSPORT", 00:22:36.877 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:36.877 "adrfam": "ipv4", 00:22:36.877 "trsvcid": "$NVMF_PORT", 00:22:36.877 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:36.877 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:36.877 "hdgst": ${hdgst:-false}, 00:22:36.877 "ddgst": ${ddgst:-false} 00:22:36.877 }, 00:22:36.877 "method": "bdev_nvme_attach_controller" 00:22:36.877 } 00:22:36.877 EOF 00:22:36.877 )") 00:22:36.877 19:10:57 -- nvmf/common.sh@542 -- # cat 00:22:36.877 19:10:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:36.877 19:10:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:36.877 { 00:22:36.877 "params": { 00:22:36.877 "name": "Nvme$subsystem", 00:22:36.877 "trtype": "$TEST_TRANSPORT", 00:22:36.877 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:36.877 "adrfam": "ipv4", 00:22:36.877 "trsvcid": "$NVMF_PORT", 00:22:36.877 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:36.877 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:36.877 "hdgst": ${hdgst:-false}, 00:22:36.877 "ddgst": ${ddgst:-false} 00:22:36.877 }, 00:22:36.877 "method": "bdev_nvme_attach_controller" 00:22:36.877 } 00:22:36.877 EOF 00:22:36.877 )") 00:22:36.877 19:10:57 -- nvmf/common.sh@542 -- # cat 00:22:36.877 19:10:57 -- nvmf/common.sh@544 -- # jq . 00:22:36.877 19:10:57 -- nvmf/common.sh@545 -- # IFS=, 00:22:36.877 19:10:57 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:36.877 "params": { 00:22:36.877 "name": "Nvme1", 00:22:36.877 "trtype": "tcp", 00:22:36.877 "traddr": "10.0.0.2", 00:22:36.877 "adrfam": "ipv4", 00:22:36.877 "trsvcid": "4420", 00:22:36.877 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:36.877 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:36.877 "hdgst": false, 00:22:36.877 "ddgst": false 00:22:36.877 }, 00:22:36.877 "method": "bdev_nvme_attach_controller" 00:22:36.877 },{ 00:22:36.877 "params": { 00:22:36.877 "name": "Nvme2", 00:22:36.877 "trtype": "tcp", 00:22:36.877 "traddr": "10.0.0.2", 00:22:36.877 "adrfam": "ipv4", 00:22:36.877 "trsvcid": "4420", 00:22:36.877 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:36.877 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:36.877 "hdgst": false, 00:22:36.877 "ddgst": false 00:22:36.877 }, 00:22:36.877 "method": "bdev_nvme_attach_controller" 00:22:36.877 },{ 00:22:36.877 "params": { 00:22:36.877 "name": "Nvme3", 00:22:36.877 "trtype": "tcp", 00:22:36.877 "traddr": "10.0.0.2", 00:22:36.877 "adrfam": "ipv4", 00:22:36.877 "trsvcid": "4420", 00:22:36.877 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:36.877 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:36.877 "hdgst": false, 00:22:36.877 "ddgst": false 00:22:36.877 }, 00:22:36.877 "method": "bdev_nvme_attach_controller" 00:22:36.877 },{ 00:22:36.877 "params": { 00:22:36.877 "name": "Nvme4", 00:22:36.877 "trtype": "tcp", 00:22:36.877 "traddr": "10.0.0.2", 00:22:36.877 "adrfam": "ipv4", 00:22:36.877 "trsvcid": "4420", 00:22:36.877 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:36.877 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:36.877 "hdgst": false, 00:22:36.877 "ddgst": false 00:22:36.877 }, 00:22:36.877 "method": "bdev_nvme_attach_controller" 00:22:36.877 },{ 00:22:36.877 "params": { 00:22:36.877 "name": "Nvme5", 00:22:36.877 "trtype": "tcp", 00:22:36.877 "traddr": "10.0.0.2", 00:22:36.877 "adrfam": "ipv4", 00:22:36.877 "trsvcid": "4420", 00:22:36.877 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:36.877 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:36.877 "hdgst": false, 00:22:36.877 "ddgst": false 00:22:36.877 }, 00:22:36.877 "method": "bdev_nvme_attach_controller" 00:22:36.877 },{ 00:22:36.877 "params": { 00:22:36.877 "name": "Nvme6", 00:22:36.877 "trtype": "tcp", 00:22:36.877 "traddr": "10.0.0.2", 00:22:36.877 "adrfam": "ipv4", 00:22:36.877 "trsvcid": "4420", 00:22:36.877 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:36.877 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:36.877 "hdgst": false, 00:22:36.877 "ddgst": false 00:22:36.877 }, 00:22:36.877 "method": "bdev_nvme_attach_controller" 00:22:36.877 },{ 00:22:36.877 "params": { 00:22:36.877 "name": "Nvme7", 00:22:36.877 "trtype": "tcp", 00:22:36.877 "traddr": "10.0.0.2", 00:22:36.877 "adrfam": "ipv4", 00:22:36.877 "trsvcid": "4420", 00:22:36.877 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:36.877 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:36.877 "hdgst": false, 00:22:36.877 "ddgst": false 00:22:36.877 }, 00:22:36.877 "method": "bdev_nvme_attach_controller" 00:22:36.877 },{ 00:22:36.877 "params": { 00:22:36.877 "name": "Nvme8", 00:22:36.877 "trtype": "tcp", 00:22:36.877 "traddr": "10.0.0.2", 00:22:36.877 "adrfam": "ipv4", 00:22:36.877 "trsvcid": "4420", 00:22:36.877 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:36.877 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:36.877 "hdgst": false, 00:22:36.877 "ddgst": false 00:22:36.877 }, 00:22:36.877 "method": "bdev_nvme_attach_controller" 00:22:36.877 },{ 00:22:36.877 "params": { 00:22:36.877 "name": "Nvme9", 00:22:36.877 "trtype": "tcp", 00:22:36.877 "traddr": "10.0.0.2", 00:22:36.877 "adrfam": "ipv4", 00:22:36.877 "trsvcid": "4420", 00:22:36.877 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:36.877 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:36.877 "hdgst": false, 00:22:36.877 "ddgst": false 00:22:36.877 }, 00:22:36.877 "method": "bdev_nvme_attach_controller" 00:22:36.877 },{ 00:22:36.877 "params": { 00:22:36.877 "name": "Nvme10", 00:22:36.877 "trtype": "tcp", 00:22:36.877 "traddr": "10.0.0.2", 00:22:36.877 "adrfam": "ipv4", 00:22:36.877 "trsvcid": "4420", 00:22:36.877 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:36.877 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:36.877 "hdgst": false, 00:22:36.877 "ddgst": false 00:22:36.878 }, 00:22:36.878 "method": "bdev_nvme_attach_controller" 00:22:36.878 }' 00:22:36.878 [2024-11-28 19:10:57.885905] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:36.878 [2024-11-28 19:10:57.885971] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:22:36.878 EAL: No free 2048 kB hugepages reported on node 1 00:22:37.135 [2024-11-28 19:10:57.948620] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:37.135 [2024-11-28 19:10:58.056268] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:39.040 19:10:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:39.040 19:10:59 -- common/autotest_common.sh@862 -- # return 0 00:22:39.040 19:10:59 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:39.040 19:10:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:39.040 19:10:59 -- common/autotest_common.sh@10 -- # set +x 00:22:39.040 19:10:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:39.040 19:10:59 -- target/shutdown.sh@83 -- # kill -9 269870 00:22:39.040 19:10:59 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:22:39.040 19:10:59 -- target/shutdown.sh@87 -- # sleep 1 00:22:39.607 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 269870 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:22:39.607 19:11:00 -- target/shutdown.sh@88 -- # kill -0 269556 00:22:39.607 19:11:00 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:22:39.607 19:11:00 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:39.607 19:11:00 -- nvmf/common.sh@520 -- # config=() 00:22:39.607 19:11:00 -- nvmf/common.sh@520 -- # local subsystem config 00:22:39.607 19:11:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:39.607 19:11:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:39.607 { 00:22:39.607 "params": { 00:22:39.607 "name": "Nvme$subsystem", 00:22:39.607 "trtype": "$TEST_TRANSPORT", 00:22:39.607 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:39.607 "adrfam": "ipv4", 00:22:39.607 "trsvcid": "$NVMF_PORT", 00:22:39.607 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:39.607 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:39.607 "hdgst": ${hdgst:-false}, 00:22:39.607 "ddgst": ${ddgst:-false} 00:22:39.607 }, 00:22:39.607 "method": "bdev_nvme_attach_controller" 00:22:39.607 } 00:22:39.607 EOF 00:22:39.607 )") 00:22:39.607 19:11:00 -- nvmf/common.sh@542 -- # cat 00:22:39.607 19:11:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:39.607 19:11:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:39.607 { 00:22:39.607 "params": { 00:22:39.607 "name": "Nvme$subsystem", 00:22:39.607 "trtype": "$TEST_TRANSPORT", 00:22:39.607 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:39.607 "adrfam": "ipv4", 00:22:39.607 "trsvcid": "$NVMF_PORT", 00:22:39.607 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:39.607 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:39.607 "hdgst": ${hdgst:-false}, 00:22:39.607 "ddgst": ${ddgst:-false} 00:22:39.607 }, 00:22:39.607 "method": "bdev_nvme_attach_controller" 00:22:39.607 } 00:22:39.607 EOF 00:22:39.607 )") 00:22:39.607 19:11:00 -- nvmf/common.sh@542 -- # cat 00:22:39.607 19:11:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:39.607 19:11:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:39.607 { 00:22:39.607 "params": { 00:22:39.607 "name": "Nvme$subsystem", 00:22:39.607 "trtype": "$TEST_TRANSPORT", 00:22:39.607 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:39.607 "adrfam": "ipv4", 00:22:39.607 "trsvcid": "$NVMF_PORT", 00:22:39.607 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:39.607 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:39.607 "hdgst": ${hdgst:-false}, 00:22:39.607 "ddgst": ${ddgst:-false} 00:22:39.607 }, 00:22:39.607 "method": "bdev_nvme_attach_controller" 00:22:39.607 } 00:22:39.607 EOF 00:22:39.607 )") 00:22:39.607 19:11:00 -- nvmf/common.sh@542 -- # cat 00:22:39.607 19:11:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:39.607 19:11:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:39.607 { 00:22:39.607 "params": { 00:22:39.608 "name": "Nvme$subsystem", 00:22:39.608 "trtype": "$TEST_TRANSPORT", 00:22:39.608 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:39.608 "adrfam": "ipv4", 00:22:39.608 "trsvcid": "$NVMF_PORT", 00:22:39.608 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:39.608 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:39.608 "hdgst": ${hdgst:-false}, 00:22:39.608 "ddgst": ${ddgst:-false} 00:22:39.608 }, 00:22:39.608 "method": "bdev_nvme_attach_controller" 00:22:39.608 } 00:22:39.608 EOF 00:22:39.608 )") 00:22:39.608 19:11:00 -- nvmf/common.sh@542 -- # cat 00:22:39.608 19:11:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:39.608 19:11:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:39.608 { 00:22:39.608 "params": { 00:22:39.608 "name": "Nvme$subsystem", 00:22:39.608 "trtype": "$TEST_TRANSPORT", 00:22:39.608 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:39.608 "adrfam": "ipv4", 00:22:39.608 "trsvcid": "$NVMF_PORT", 00:22:39.608 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:39.608 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:39.608 "hdgst": ${hdgst:-false}, 00:22:39.608 "ddgst": ${ddgst:-false} 00:22:39.608 }, 00:22:39.608 "method": "bdev_nvme_attach_controller" 00:22:39.608 } 00:22:39.608 EOF 00:22:39.608 )") 00:22:39.608 19:11:00 -- nvmf/common.sh@542 -- # cat 00:22:39.608 19:11:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:39.608 19:11:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:39.608 { 00:22:39.608 "params": { 00:22:39.608 "name": "Nvme$subsystem", 00:22:39.608 "trtype": "$TEST_TRANSPORT", 00:22:39.608 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:39.608 "adrfam": "ipv4", 00:22:39.608 "trsvcid": "$NVMF_PORT", 00:22:39.608 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:39.608 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:39.608 "hdgst": ${hdgst:-false}, 00:22:39.608 "ddgst": ${ddgst:-false} 00:22:39.608 }, 00:22:39.608 "method": "bdev_nvme_attach_controller" 00:22:39.608 } 00:22:39.608 EOF 00:22:39.608 )") 00:22:39.608 19:11:00 -- nvmf/common.sh@542 -- # cat 00:22:39.608 19:11:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:39.608 19:11:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:39.608 { 00:22:39.608 "params": { 00:22:39.608 "name": "Nvme$subsystem", 00:22:39.608 "trtype": "$TEST_TRANSPORT", 00:22:39.608 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:39.608 "adrfam": "ipv4", 00:22:39.608 "trsvcid": "$NVMF_PORT", 00:22:39.608 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:39.608 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:39.608 "hdgst": ${hdgst:-false}, 00:22:39.608 "ddgst": ${ddgst:-false} 00:22:39.608 }, 00:22:39.608 "method": "bdev_nvme_attach_controller" 00:22:39.608 } 00:22:39.608 EOF 00:22:39.608 )") 00:22:39.608 19:11:00 -- nvmf/common.sh@542 -- # cat 00:22:39.608 19:11:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:39.608 19:11:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:39.608 { 00:22:39.608 "params": { 00:22:39.608 "name": "Nvme$subsystem", 00:22:39.608 "trtype": "$TEST_TRANSPORT", 00:22:39.608 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:39.608 "adrfam": "ipv4", 00:22:39.608 "trsvcid": "$NVMF_PORT", 00:22:39.608 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:39.608 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:39.608 "hdgst": ${hdgst:-false}, 00:22:39.608 "ddgst": ${ddgst:-false} 00:22:39.608 }, 00:22:39.608 "method": "bdev_nvme_attach_controller" 00:22:39.608 } 00:22:39.608 EOF 00:22:39.608 )") 00:22:39.608 19:11:00 -- nvmf/common.sh@542 -- # cat 00:22:39.608 19:11:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:39.608 19:11:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:39.608 { 00:22:39.608 "params": { 00:22:39.608 "name": "Nvme$subsystem", 00:22:39.608 "trtype": "$TEST_TRANSPORT", 00:22:39.608 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:39.608 "adrfam": "ipv4", 00:22:39.608 "trsvcid": "$NVMF_PORT", 00:22:39.608 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:39.608 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:39.608 "hdgst": ${hdgst:-false}, 00:22:39.608 "ddgst": ${ddgst:-false} 00:22:39.608 }, 00:22:39.608 "method": "bdev_nvme_attach_controller" 00:22:39.608 } 00:22:39.608 EOF 00:22:39.608 )") 00:22:39.608 19:11:00 -- nvmf/common.sh@542 -- # cat 00:22:39.608 19:11:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:39.608 19:11:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:39.608 { 00:22:39.608 "params": { 00:22:39.608 "name": "Nvme$subsystem", 00:22:39.608 "trtype": "$TEST_TRANSPORT", 00:22:39.608 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:39.608 "adrfam": "ipv4", 00:22:39.608 "trsvcid": "$NVMF_PORT", 00:22:39.608 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:39.608 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:39.608 "hdgst": ${hdgst:-false}, 00:22:39.608 "ddgst": ${ddgst:-false} 00:22:39.608 }, 00:22:39.608 "method": "bdev_nvme_attach_controller" 00:22:39.608 } 00:22:39.608 EOF 00:22:39.608 )") 00:22:39.608 19:11:00 -- nvmf/common.sh@542 -- # cat 00:22:39.867 19:11:00 -- nvmf/common.sh@544 -- # jq . 00:22:39.867 19:11:00 -- nvmf/common.sh@545 -- # IFS=, 00:22:39.867 19:11:00 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:39.867 "params": { 00:22:39.867 "name": "Nvme1", 00:22:39.867 "trtype": "tcp", 00:22:39.867 "traddr": "10.0.0.2", 00:22:39.867 "adrfam": "ipv4", 00:22:39.867 "trsvcid": "4420", 00:22:39.867 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:39.867 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:39.867 "hdgst": false, 00:22:39.867 "ddgst": false 00:22:39.867 }, 00:22:39.867 "method": "bdev_nvme_attach_controller" 00:22:39.867 },{ 00:22:39.867 "params": { 00:22:39.867 "name": "Nvme2", 00:22:39.867 "trtype": "tcp", 00:22:39.867 "traddr": "10.0.0.2", 00:22:39.867 "adrfam": "ipv4", 00:22:39.867 "trsvcid": "4420", 00:22:39.867 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:39.867 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:39.867 "hdgst": false, 00:22:39.867 "ddgst": false 00:22:39.867 }, 00:22:39.867 "method": "bdev_nvme_attach_controller" 00:22:39.867 },{ 00:22:39.867 "params": { 00:22:39.867 "name": "Nvme3", 00:22:39.867 "trtype": "tcp", 00:22:39.867 "traddr": "10.0.0.2", 00:22:39.867 "adrfam": "ipv4", 00:22:39.867 "trsvcid": "4420", 00:22:39.867 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:39.867 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:39.867 "hdgst": false, 00:22:39.867 "ddgst": false 00:22:39.867 }, 00:22:39.867 "method": "bdev_nvme_attach_controller" 00:22:39.867 },{ 00:22:39.867 "params": { 00:22:39.867 "name": "Nvme4", 00:22:39.867 "trtype": "tcp", 00:22:39.867 "traddr": "10.0.0.2", 00:22:39.867 "adrfam": "ipv4", 00:22:39.867 "trsvcid": "4420", 00:22:39.867 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:39.867 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:39.867 "hdgst": false, 00:22:39.867 "ddgst": false 00:22:39.867 }, 00:22:39.867 "method": "bdev_nvme_attach_controller" 00:22:39.867 },{ 00:22:39.867 "params": { 00:22:39.867 "name": "Nvme5", 00:22:39.867 "trtype": "tcp", 00:22:39.867 "traddr": "10.0.0.2", 00:22:39.867 "adrfam": "ipv4", 00:22:39.867 "trsvcid": "4420", 00:22:39.868 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:39.868 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:39.868 "hdgst": false, 00:22:39.868 "ddgst": false 00:22:39.868 }, 00:22:39.868 "method": "bdev_nvme_attach_controller" 00:22:39.868 },{ 00:22:39.868 "params": { 00:22:39.868 "name": "Nvme6", 00:22:39.868 "trtype": "tcp", 00:22:39.868 "traddr": "10.0.0.2", 00:22:39.868 "adrfam": "ipv4", 00:22:39.868 "trsvcid": "4420", 00:22:39.868 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:39.868 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:39.868 "hdgst": false, 00:22:39.868 "ddgst": false 00:22:39.868 }, 00:22:39.868 "method": "bdev_nvme_attach_controller" 00:22:39.868 },{ 00:22:39.868 "params": { 00:22:39.868 "name": "Nvme7", 00:22:39.868 "trtype": "tcp", 00:22:39.868 "traddr": "10.0.0.2", 00:22:39.868 "adrfam": "ipv4", 00:22:39.868 "trsvcid": "4420", 00:22:39.868 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:39.868 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:39.868 "hdgst": false, 00:22:39.868 "ddgst": false 00:22:39.868 }, 00:22:39.868 "method": "bdev_nvme_attach_controller" 00:22:39.868 },{ 00:22:39.868 "params": { 00:22:39.868 "name": "Nvme8", 00:22:39.868 "trtype": "tcp", 00:22:39.868 "traddr": "10.0.0.2", 00:22:39.868 "adrfam": "ipv4", 00:22:39.868 "trsvcid": "4420", 00:22:39.868 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:39.868 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:39.868 "hdgst": false, 00:22:39.868 "ddgst": false 00:22:39.868 }, 00:22:39.868 "method": "bdev_nvme_attach_controller" 00:22:39.868 },{ 00:22:39.868 "params": { 00:22:39.868 "name": "Nvme9", 00:22:39.868 "trtype": "tcp", 00:22:39.868 "traddr": "10.0.0.2", 00:22:39.868 "adrfam": "ipv4", 00:22:39.868 "trsvcid": "4420", 00:22:39.868 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:39.868 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:39.868 "hdgst": false, 00:22:39.868 "ddgst": false 00:22:39.868 }, 00:22:39.868 "method": "bdev_nvme_attach_controller" 00:22:39.868 },{ 00:22:39.868 "params": { 00:22:39.868 "name": "Nvme10", 00:22:39.868 "trtype": "tcp", 00:22:39.868 "traddr": "10.0.0.2", 00:22:39.868 "adrfam": "ipv4", 00:22:39.868 "trsvcid": "4420", 00:22:39.868 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:39.868 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:39.868 "hdgst": false, 00:22:39.868 "ddgst": false 00:22:39.868 }, 00:22:39.868 "method": "bdev_nvme_attach_controller" 00:22:39.868 }' 00:22:39.868 [2024-11-28 19:11:00.661368] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:39.868 [2024-11-28 19:11:00.661479] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid270180 ] 00:22:39.868 EAL: No free 2048 kB hugepages reported on node 1 00:22:39.868 [2024-11-28 19:11:00.725950] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:39.868 [2024-11-28 19:11:00.834652] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:41.248 Running I/O for 1 seconds... 00:22:42.626 00:22:42.626 Latency(us) 00:22:42.626 [2024-11-28T18:11:03.674Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:42.626 [2024-11-28T18:11:03.674Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:42.626 Verification LBA range: start 0x0 length 0x400 00:22:42.626 Nvme1n1 : 1.08 368.77 23.05 0.00 0.00 169603.53 18835.53 155344.59 00:22:42.626 [2024-11-28T18:11:03.674Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:42.626 Verification LBA range: start 0x0 length 0x400 00:22:42.626 Nvme2n1 : 1.10 395.44 24.71 0.00 0.00 157647.58 20388.98 125829.12 00:22:42.626 [2024-11-28T18:11:03.674Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:42.626 Verification LBA range: start 0x0 length 0x400 00:22:42.626 Nvme3n1 : 1.10 394.59 24.66 0.00 0.00 156847.82 20680.25 120392.06 00:22:42.626 [2024-11-28T18:11:03.674Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:42.626 Verification LBA range: start 0x0 length 0x400 00:22:42.626 Nvme4n1 : 1.10 393.22 24.58 0.00 0.00 156162.14 22136.60 120392.06 00:22:42.626 [2024-11-28T18:11:03.674Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:42.626 Verification LBA range: start 0x0 length 0x400 00:22:42.626 Nvme5n1 : 1.11 389.99 24.37 0.00 0.00 156773.77 18932.62 124275.67 00:22:42.626 [2024-11-28T18:11:03.674Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:42.626 Verification LBA range: start 0x0 length 0x400 00:22:42.626 Nvme6n1 : 1.11 392.01 24.50 0.00 0.00 154649.19 20194.80 118838.61 00:22:42.626 [2024-11-28T18:11:03.674Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:42.626 Verification LBA range: start 0x0 length 0x400 00:22:42.626 Nvme7n1 : 1.11 390.98 24.44 0.00 0.00 154136.44 18835.53 124275.67 00:22:42.626 [2024-11-28T18:11:03.674Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:42.626 Verification LBA range: start 0x0 length 0x400 00:22:42.626 Nvme8n1 : 1.11 389.47 24.34 0.00 0.00 153665.53 18835.53 126605.84 00:22:42.626 [2024-11-28T18:11:03.674Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:42.626 Verification LBA range: start 0x0 length 0x400 00:22:42.626 Nvme9n1 : 1.12 391.94 24.50 0.00 0.00 152893.72 7621.59 129712.73 00:22:42.626 [2024-11-28T18:11:03.674Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:42.626 Verification LBA range: start 0x0 length 0x400 00:22:42.626 Nvme10n1 : 1.12 388.47 24.28 0.00 0.00 152452.80 14951.92 128159.29 00:22:42.626 [2024-11-28T18:11:03.674Z] =================================================================================================================== 00:22:42.626 [2024-11-28T18:11:03.674Z] Total : 3894.87 243.43 0.00 0.00 156375.61 7621.59 155344.59 00:22:42.884 19:11:03 -- target/shutdown.sh@93 -- # stoptarget 00:22:42.884 19:11:03 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:42.884 19:11:03 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:42.885 19:11:03 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:42.885 19:11:03 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:42.885 19:11:03 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:42.885 19:11:03 -- nvmf/common.sh@116 -- # sync 00:22:42.885 19:11:03 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:42.885 19:11:03 -- nvmf/common.sh@119 -- # set +e 00:22:42.885 19:11:03 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:42.885 19:11:03 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:42.885 rmmod nvme_tcp 00:22:42.885 rmmod nvme_fabrics 00:22:42.885 rmmod nvme_keyring 00:22:42.885 19:11:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:42.885 19:11:03 -- nvmf/common.sh@123 -- # set -e 00:22:42.885 19:11:03 -- nvmf/common.sh@124 -- # return 0 00:22:42.885 19:11:03 -- nvmf/common.sh@477 -- # '[' -n 269556 ']' 00:22:42.885 19:11:03 -- nvmf/common.sh@478 -- # killprocess 269556 00:22:42.885 19:11:03 -- common/autotest_common.sh@936 -- # '[' -z 269556 ']' 00:22:42.885 19:11:03 -- common/autotest_common.sh@940 -- # kill -0 269556 00:22:42.885 19:11:03 -- common/autotest_common.sh@941 -- # uname 00:22:42.885 19:11:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:42.885 19:11:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 269556 00:22:42.885 19:11:03 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:42.885 19:11:03 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:42.885 19:11:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 269556' 00:22:42.885 killing process with pid 269556 00:22:42.885 19:11:03 -- common/autotest_common.sh@955 -- # kill 269556 00:22:42.885 19:11:03 -- common/autotest_common.sh@960 -- # wait 269556 00:22:43.454 19:11:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:43.454 19:11:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:43.454 19:11:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:43.454 19:11:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:43.454 19:11:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:43.454 19:11:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:43.454 19:11:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:43.454 19:11:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:45.361 19:11:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:45.361 00:22:45.361 real 0m12.526s 00:22:45.361 user 0m36.154s 00:22:45.361 sys 0m3.362s 00:22:45.361 19:11:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:45.361 19:11:06 -- common/autotest_common.sh@10 -- # set +x 00:22:45.361 ************************************ 00:22:45.361 END TEST nvmf_shutdown_tc1 00:22:45.361 ************************************ 00:22:45.361 19:11:06 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:22:45.361 19:11:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:45.361 19:11:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:45.361 19:11:06 -- common/autotest_common.sh@10 -- # set +x 00:22:45.361 ************************************ 00:22:45.361 START TEST nvmf_shutdown_tc2 00:22:45.361 ************************************ 00:22:45.361 19:11:06 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc2 00:22:45.361 19:11:06 -- target/shutdown.sh@98 -- # starttarget 00:22:45.361 19:11:06 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:45.361 19:11:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:45.361 19:11:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:45.361 19:11:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:45.361 19:11:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:45.361 19:11:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:45.361 19:11:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:45.361 19:11:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:45.361 19:11:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:45.361 19:11:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:45.361 19:11:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:45.361 19:11:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:45.361 19:11:06 -- common/autotest_common.sh@10 -- # set +x 00:22:45.361 19:11:06 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:45.361 19:11:06 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:45.361 19:11:06 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:45.361 19:11:06 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:45.361 19:11:06 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:45.361 19:11:06 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:45.361 19:11:06 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:45.361 19:11:06 -- nvmf/common.sh@294 -- # net_devs=() 00:22:45.361 19:11:06 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:45.361 19:11:06 -- nvmf/common.sh@295 -- # e810=() 00:22:45.361 19:11:06 -- nvmf/common.sh@295 -- # local -ga e810 00:22:45.361 19:11:06 -- nvmf/common.sh@296 -- # x722=() 00:22:45.361 19:11:06 -- nvmf/common.sh@296 -- # local -ga x722 00:22:45.361 19:11:06 -- nvmf/common.sh@297 -- # mlx=() 00:22:45.361 19:11:06 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:45.361 19:11:06 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:45.361 19:11:06 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:45.361 19:11:06 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:45.361 19:11:06 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:45.361 19:11:06 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:45.361 19:11:06 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:45.361 19:11:06 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:45.361 19:11:06 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:45.361 19:11:06 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:45.361 19:11:06 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:45.361 19:11:06 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:45.361 19:11:06 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:45.361 19:11:06 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:45.361 19:11:06 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:45.361 19:11:06 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:45.361 19:11:06 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:45.361 19:11:06 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:45.361 19:11:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:45.361 19:11:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:45.361 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:45.361 19:11:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:45.361 19:11:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:45.361 19:11:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:45.361 19:11:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:45.361 19:11:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:45.361 19:11:06 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:45.361 19:11:06 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:45.361 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:45.361 19:11:06 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:45.361 19:11:06 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:45.361 19:11:06 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:45.361 19:11:06 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:45.361 19:11:06 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:45.361 19:11:06 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:45.361 19:11:06 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:45.361 19:11:06 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:45.361 19:11:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:45.361 19:11:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:45.361 19:11:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:45.361 19:11:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:45.361 19:11:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:45.362 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:45.362 19:11:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:45.362 19:11:06 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:45.362 19:11:06 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:45.362 19:11:06 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:45.362 19:11:06 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:45.362 19:11:06 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:45.362 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:45.362 19:11:06 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:45.362 19:11:06 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:45.362 19:11:06 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:45.362 19:11:06 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:45.362 19:11:06 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:45.362 19:11:06 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:45.362 19:11:06 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:45.362 19:11:06 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:45.362 19:11:06 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:45.362 19:11:06 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:45.362 19:11:06 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:45.362 19:11:06 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:45.362 19:11:06 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:45.362 19:11:06 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:45.362 19:11:06 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:45.362 19:11:06 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:45.362 19:11:06 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:45.362 19:11:06 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:45.362 19:11:06 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:45.621 19:11:06 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:45.621 19:11:06 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:45.621 19:11:06 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:45.621 19:11:06 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:45.621 19:11:06 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:45.621 19:11:06 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:45.621 19:11:06 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:45.621 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:45.621 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.251 ms 00:22:45.621 00:22:45.621 --- 10.0.0.2 ping statistics --- 00:22:45.621 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:45.621 rtt min/avg/max/mdev = 0.251/0.251/0.251/0.000 ms 00:22:45.621 19:11:06 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:45.621 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:45.621 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.101 ms 00:22:45.621 00:22:45.621 --- 10.0.0.1 ping statistics --- 00:22:45.621 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:45.621 rtt min/avg/max/mdev = 0.101/0.101/0.101/0.000 ms 00:22:45.621 19:11:06 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:45.621 19:11:06 -- nvmf/common.sh@410 -- # return 0 00:22:45.621 19:11:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:45.621 19:11:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:45.621 19:11:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:45.621 19:11:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:45.621 19:11:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:45.621 19:11:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:45.621 19:11:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:45.621 19:11:06 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:45.621 19:11:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:45.621 19:11:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:45.621 19:11:06 -- common/autotest_common.sh@10 -- # set +x 00:22:45.621 19:11:06 -- nvmf/common.sh@469 -- # nvmfpid=270963 00:22:45.621 19:11:06 -- nvmf/common.sh@470 -- # waitforlisten 270963 00:22:45.621 19:11:06 -- common/autotest_common.sh@829 -- # '[' -z 270963 ']' 00:22:45.621 19:11:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:45.621 19:11:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:45.621 19:11:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:45.621 19:11:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:45.621 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:45.621 19:11:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:45.621 19:11:06 -- common/autotest_common.sh@10 -- # set +x 00:22:45.621 [2024-11-28 19:11:06.593788] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:45.621 [2024-11-28 19:11:06.593875] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:45.621 EAL: No free 2048 kB hugepages reported on node 1 00:22:45.621 [2024-11-28 19:11:06.664338] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:45.881 [2024-11-28 19:11:06.781356] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:45.881 [2024-11-28 19:11:06.781524] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:45.881 [2024-11-28 19:11:06.781544] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:45.881 [2024-11-28 19:11:06.781559] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:45.881 [2024-11-28 19:11:06.781664] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:45.881 [2024-11-28 19:11:06.781761] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:45.881 [2024-11-28 19:11:06.781842] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:45.881 [2024-11-28 19:11:06.781846] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:46.818 19:11:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:46.818 19:11:07 -- common/autotest_common.sh@862 -- # return 0 00:22:46.818 19:11:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:46.818 19:11:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:46.818 19:11:07 -- common/autotest_common.sh@10 -- # set +x 00:22:46.818 19:11:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:46.818 19:11:07 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:46.818 19:11:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:46.818 19:11:07 -- common/autotest_common.sh@10 -- # set +x 00:22:46.818 [2024-11-28 19:11:07.583926] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:46.818 19:11:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:46.819 19:11:07 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:46.819 19:11:07 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:46.819 19:11:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:46.819 19:11:07 -- common/autotest_common.sh@10 -- # set +x 00:22:46.819 19:11:07 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:46.819 19:11:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:46.819 19:11:07 -- target/shutdown.sh@28 -- # cat 00:22:46.819 19:11:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:46.819 19:11:07 -- target/shutdown.sh@28 -- # cat 00:22:46.819 19:11:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:46.819 19:11:07 -- target/shutdown.sh@28 -- # cat 00:22:46.819 19:11:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:46.819 19:11:07 -- target/shutdown.sh@28 -- # cat 00:22:46.819 19:11:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:46.819 19:11:07 -- target/shutdown.sh@28 -- # cat 00:22:46.819 19:11:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:46.819 19:11:07 -- target/shutdown.sh@28 -- # cat 00:22:46.819 19:11:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:46.819 19:11:07 -- target/shutdown.sh@28 -- # cat 00:22:46.819 19:11:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:46.819 19:11:07 -- target/shutdown.sh@28 -- # cat 00:22:46.819 19:11:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:46.819 19:11:07 -- target/shutdown.sh@28 -- # cat 00:22:46.819 19:11:07 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:46.819 19:11:07 -- target/shutdown.sh@28 -- # cat 00:22:46.819 19:11:07 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:46.819 19:11:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:46.819 19:11:07 -- common/autotest_common.sh@10 -- # set +x 00:22:46.819 Malloc1 00:22:46.819 [2024-11-28 19:11:07.658890] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:46.819 Malloc2 00:22:46.819 Malloc3 00:22:46.819 Malloc4 00:22:46.819 Malloc5 00:22:47.078 Malloc6 00:22:47.078 Malloc7 00:22:47.078 Malloc8 00:22:47.078 Malloc9 00:22:47.078 Malloc10 00:22:47.078 19:11:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:47.078 19:11:08 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:47.078 19:11:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:47.078 19:11:08 -- common/autotest_common.sh@10 -- # set +x 00:22:47.338 19:11:08 -- target/shutdown.sh@102 -- # perfpid=271278 00:22:47.338 19:11:08 -- target/shutdown.sh@103 -- # waitforlisten 271278 /var/tmp/bdevperf.sock 00:22:47.338 19:11:08 -- common/autotest_common.sh@829 -- # '[' -z 271278 ']' 00:22:47.338 19:11:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:47.338 19:11:08 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:47.338 19:11:08 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:47.338 19:11:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:47.338 19:11:08 -- nvmf/common.sh@520 -- # config=() 00:22:47.338 19:11:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:47.338 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:47.338 19:11:08 -- nvmf/common.sh@520 -- # local subsystem config 00:22:47.338 19:11:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:47.338 19:11:08 -- common/autotest_common.sh@10 -- # set +x 00:22:47.338 19:11:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:47.338 19:11:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:47.338 { 00:22:47.338 "params": { 00:22:47.338 "name": "Nvme$subsystem", 00:22:47.338 "trtype": "$TEST_TRANSPORT", 00:22:47.338 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:47.338 "adrfam": "ipv4", 00:22:47.338 "trsvcid": "$NVMF_PORT", 00:22:47.338 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:47.338 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:47.338 "hdgst": ${hdgst:-false}, 00:22:47.338 "ddgst": ${ddgst:-false} 00:22:47.338 }, 00:22:47.338 "method": "bdev_nvme_attach_controller" 00:22:47.338 } 00:22:47.338 EOF 00:22:47.338 )") 00:22:47.338 19:11:08 -- nvmf/common.sh@542 -- # cat 00:22:47.338 19:11:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:47.338 19:11:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:47.338 { 00:22:47.338 "params": { 00:22:47.338 "name": "Nvme$subsystem", 00:22:47.338 "trtype": "$TEST_TRANSPORT", 00:22:47.338 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:47.338 "adrfam": "ipv4", 00:22:47.338 "trsvcid": "$NVMF_PORT", 00:22:47.338 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:47.338 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:47.338 "hdgst": ${hdgst:-false}, 00:22:47.338 "ddgst": ${ddgst:-false} 00:22:47.338 }, 00:22:47.338 "method": "bdev_nvme_attach_controller" 00:22:47.338 } 00:22:47.338 EOF 00:22:47.338 )") 00:22:47.338 19:11:08 -- nvmf/common.sh@542 -- # cat 00:22:47.338 19:11:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:47.338 19:11:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:47.338 { 00:22:47.338 "params": { 00:22:47.338 "name": "Nvme$subsystem", 00:22:47.338 "trtype": "$TEST_TRANSPORT", 00:22:47.338 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:47.338 "adrfam": "ipv4", 00:22:47.338 "trsvcid": "$NVMF_PORT", 00:22:47.338 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:47.338 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:47.338 "hdgst": ${hdgst:-false}, 00:22:47.338 "ddgst": ${ddgst:-false} 00:22:47.338 }, 00:22:47.338 "method": "bdev_nvme_attach_controller" 00:22:47.338 } 00:22:47.338 EOF 00:22:47.338 )") 00:22:47.338 19:11:08 -- nvmf/common.sh@542 -- # cat 00:22:47.338 19:11:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:47.338 19:11:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:47.338 { 00:22:47.338 "params": { 00:22:47.338 "name": "Nvme$subsystem", 00:22:47.338 "trtype": "$TEST_TRANSPORT", 00:22:47.338 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:47.338 "adrfam": "ipv4", 00:22:47.338 "trsvcid": "$NVMF_PORT", 00:22:47.338 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:47.338 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:47.338 "hdgst": ${hdgst:-false}, 00:22:47.338 "ddgst": ${ddgst:-false} 00:22:47.338 }, 00:22:47.338 "method": "bdev_nvme_attach_controller" 00:22:47.338 } 00:22:47.338 EOF 00:22:47.338 )") 00:22:47.338 19:11:08 -- nvmf/common.sh@542 -- # cat 00:22:47.338 19:11:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:47.338 19:11:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:47.338 { 00:22:47.338 "params": { 00:22:47.338 "name": "Nvme$subsystem", 00:22:47.338 "trtype": "$TEST_TRANSPORT", 00:22:47.338 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:47.338 "adrfam": "ipv4", 00:22:47.338 "trsvcid": "$NVMF_PORT", 00:22:47.338 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:47.338 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:47.338 "hdgst": ${hdgst:-false}, 00:22:47.338 "ddgst": ${ddgst:-false} 00:22:47.338 }, 00:22:47.338 "method": "bdev_nvme_attach_controller" 00:22:47.338 } 00:22:47.338 EOF 00:22:47.338 )") 00:22:47.338 19:11:08 -- nvmf/common.sh@542 -- # cat 00:22:47.338 19:11:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:47.338 19:11:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:47.338 { 00:22:47.338 "params": { 00:22:47.338 "name": "Nvme$subsystem", 00:22:47.338 "trtype": "$TEST_TRANSPORT", 00:22:47.338 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:47.338 "adrfam": "ipv4", 00:22:47.338 "trsvcid": "$NVMF_PORT", 00:22:47.338 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:47.338 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:47.338 "hdgst": ${hdgst:-false}, 00:22:47.338 "ddgst": ${ddgst:-false} 00:22:47.338 }, 00:22:47.338 "method": "bdev_nvme_attach_controller" 00:22:47.338 } 00:22:47.338 EOF 00:22:47.338 )") 00:22:47.338 19:11:08 -- nvmf/common.sh@542 -- # cat 00:22:47.338 19:11:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:47.338 19:11:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:47.338 { 00:22:47.338 "params": { 00:22:47.338 "name": "Nvme$subsystem", 00:22:47.338 "trtype": "$TEST_TRANSPORT", 00:22:47.338 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:47.338 "adrfam": "ipv4", 00:22:47.338 "trsvcid": "$NVMF_PORT", 00:22:47.338 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:47.338 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:47.338 "hdgst": ${hdgst:-false}, 00:22:47.338 "ddgst": ${ddgst:-false} 00:22:47.338 }, 00:22:47.338 "method": "bdev_nvme_attach_controller" 00:22:47.338 } 00:22:47.338 EOF 00:22:47.338 )") 00:22:47.338 19:11:08 -- nvmf/common.sh@542 -- # cat 00:22:47.338 19:11:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:47.338 19:11:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:47.338 { 00:22:47.338 "params": { 00:22:47.338 "name": "Nvme$subsystem", 00:22:47.338 "trtype": "$TEST_TRANSPORT", 00:22:47.338 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:47.338 "adrfam": "ipv4", 00:22:47.338 "trsvcid": "$NVMF_PORT", 00:22:47.338 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:47.338 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:47.338 "hdgst": ${hdgst:-false}, 00:22:47.338 "ddgst": ${ddgst:-false} 00:22:47.338 }, 00:22:47.338 "method": "bdev_nvme_attach_controller" 00:22:47.338 } 00:22:47.338 EOF 00:22:47.338 )") 00:22:47.338 19:11:08 -- nvmf/common.sh@542 -- # cat 00:22:47.338 19:11:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:47.338 19:11:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:47.338 { 00:22:47.338 "params": { 00:22:47.338 "name": "Nvme$subsystem", 00:22:47.338 "trtype": "$TEST_TRANSPORT", 00:22:47.338 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:47.338 "adrfam": "ipv4", 00:22:47.338 "trsvcid": "$NVMF_PORT", 00:22:47.339 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:47.339 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:47.339 "hdgst": ${hdgst:-false}, 00:22:47.339 "ddgst": ${ddgst:-false} 00:22:47.339 }, 00:22:47.339 "method": "bdev_nvme_attach_controller" 00:22:47.339 } 00:22:47.339 EOF 00:22:47.339 )") 00:22:47.339 19:11:08 -- nvmf/common.sh@542 -- # cat 00:22:47.339 19:11:08 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:47.339 19:11:08 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:47.339 { 00:22:47.339 "params": { 00:22:47.339 "name": "Nvme$subsystem", 00:22:47.339 "trtype": "$TEST_TRANSPORT", 00:22:47.339 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:47.339 "adrfam": "ipv4", 00:22:47.339 "trsvcid": "$NVMF_PORT", 00:22:47.339 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:47.339 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:47.339 "hdgst": ${hdgst:-false}, 00:22:47.339 "ddgst": ${ddgst:-false} 00:22:47.339 }, 00:22:47.339 "method": "bdev_nvme_attach_controller" 00:22:47.339 } 00:22:47.339 EOF 00:22:47.339 )") 00:22:47.339 19:11:08 -- nvmf/common.sh@542 -- # cat 00:22:47.339 19:11:08 -- nvmf/common.sh@544 -- # jq . 00:22:47.339 19:11:08 -- nvmf/common.sh@545 -- # IFS=, 00:22:47.339 19:11:08 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:47.339 "params": { 00:22:47.339 "name": "Nvme1", 00:22:47.339 "trtype": "tcp", 00:22:47.339 "traddr": "10.0.0.2", 00:22:47.339 "adrfam": "ipv4", 00:22:47.339 "trsvcid": "4420", 00:22:47.339 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:47.339 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:47.339 "hdgst": false, 00:22:47.339 "ddgst": false 00:22:47.339 }, 00:22:47.339 "method": "bdev_nvme_attach_controller" 00:22:47.339 },{ 00:22:47.339 "params": { 00:22:47.339 "name": "Nvme2", 00:22:47.339 "trtype": "tcp", 00:22:47.339 "traddr": "10.0.0.2", 00:22:47.339 "adrfam": "ipv4", 00:22:47.339 "trsvcid": "4420", 00:22:47.339 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:47.339 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:47.339 "hdgst": false, 00:22:47.339 "ddgst": false 00:22:47.339 }, 00:22:47.339 "method": "bdev_nvme_attach_controller" 00:22:47.339 },{ 00:22:47.339 "params": { 00:22:47.339 "name": "Nvme3", 00:22:47.339 "trtype": "tcp", 00:22:47.339 "traddr": "10.0.0.2", 00:22:47.339 "adrfam": "ipv4", 00:22:47.339 "trsvcid": "4420", 00:22:47.339 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:47.339 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:47.339 "hdgst": false, 00:22:47.339 "ddgst": false 00:22:47.339 }, 00:22:47.339 "method": "bdev_nvme_attach_controller" 00:22:47.339 },{ 00:22:47.339 "params": { 00:22:47.339 "name": "Nvme4", 00:22:47.339 "trtype": "tcp", 00:22:47.339 "traddr": "10.0.0.2", 00:22:47.339 "adrfam": "ipv4", 00:22:47.339 "trsvcid": "4420", 00:22:47.339 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:47.339 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:47.339 "hdgst": false, 00:22:47.339 "ddgst": false 00:22:47.339 }, 00:22:47.339 "method": "bdev_nvme_attach_controller" 00:22:47.339 },{ 00:22:47.339 "params": { 00:22:47.339 "name": "Nvme5", 00:22:47.339 "trtype": "tcp", 00:22:47.339 "traddr": "10.0.0.2", 00:22:47.339 "adrfam": "ipv4", 00:22:47.339 "trsvcid": "4420", 00:22:47.339 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:47.339 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:47.339 "hdgst": false, 00:22:47.339 "ddgst": false 00:22:47.339 }, 00:22:47.339 "method": "bdev_nvme_attach_controller" 00:22:47.339 },{ 00:22:47.339 "params": { 00:22:47.339 "name": "Nvme6", 00:22:47.339 "trtype": "tcp", 00:22:47.339 "traddr": "10.0.0.2", 00:22:47.339 "adrfam": "ipv4", 00:22:47.339 "trsvcid": "4420", 00:22:47.339 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:47.339 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:47.339 "hdgst": false, 00:22:47.339 "ddgst": false 00:22:47.339 }, 00:22:47.339 "method": "bdev_nvme_attach_controller" 00:22:47.339 },{ 00:22:47.339 "params": { 00:22:47.339 "name": "Nvme7", 00:22:47.339 "trtype": "tcp", 00:22:47.339 "traddr": "10.0.0.2", 00:22:47.339 "adrfam": "ipv4", 00:22:47.339 "trsvcid": "4420", 00:22:47.339 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:47.339 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:47.339 "hdgst": false, 00:22:47.339 "ddgst": false 00:22:47.339 }, 00:22:47.339 "method": "bdev_nvme_attach_controller" 00:22:47.339 },{ 00:22:47.339 "params": { 00:22:47.339 "name": "Nvme8", 00:22:47.339 "trtype": "tcp", 00:22:47.339 "traddr": "10.0.0.2", 00:22:47.339 "adrfam": "ipv4", 00:22:47.339 "trsvcid": "4420", 00:22:47.339 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:47.339 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:47.339 "hdgst": false, 00:22:47.339 "ddgst": false 00:22:47.339 }, 00:22:47.339 "method": "bdev_nvme_attach_controller" 00:22:47.339 },{ 00:22:47.339 "params": { 00:22:47.339 "name": "Nvme9", 00:22:47.339 "trtype": "tcp", 00:22:47.339 "traddr": "10.0.0.2", 00:22:47.339 "adrfam": "ipv4", 00:22:47.339 "trsvcid": "4420", 00:22:47.339 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:47.339 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:47.339 "hdgst": false, 00:22:47.339 "ddgst": false 00:22:47.339 }, 00:22:47.339 "method": "bdev_nvme_attach_controller" 00:22:47.339 },{ 00:22:47.339 "params": { 00:22:47.339 "name": "Nvme10", 00:22:47.339 "trtype": "tcp", 00:22:47.339 "traddr": "10.0.0.2", 00:22:47.339 "adrfam": "ipv4", 00:22:47.339 "trsvcid": "4420", 00:22:47.339 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:47.339 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:47.339 "hdgst": false, 00:22:47.339 "ddgst": false 00:22:47.339 }, 00:22:47.339 "method": "bdev_nvme_attach_controller" 00:22:47.339 }' 00:22:47.339 [2024-11-28 19:11:08.167982] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:47.339 [2024-11-28 19:11:08.168053] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid271278 ] 00:22:47.339 EAL: No free 2048 kB hugepages reported on node 1 00:22:47.339 [2024-11-28 19:11:08.230487] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:47.339 [2024-11-28 19:11:08.337737] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:49.243 Running I/O for 10 seconds... 00:22:49.243 19:11:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:49.243 19:11:09 -- common/autotest_common.sh@862 -- # return 0 00:22:49.243 19:11:09 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:49.243 19:11:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:49.243 19:11:09 -- common/autotest_common.sh@10 -- # set +x 00:22:49.243 19:11:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:49.243 19:11:09 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:49.243 19:11:09 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:49.243 19:11:09 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:49.243 19:11:09 -- target/shutdown.sh@57 -- # local ret=1 00:22:49.243 19:11:09 -- target/shutdown.sh@58 -- # local i 00:22:49.244 19:11:09 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:49.244 19:11:09 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:49.244 19:11:09 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:49.244 19:11:09 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:49.244 19:11:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:49.244 19:11:09 -- common/autotest_common.sh@10 -- # set +x 00:22:49.244 19:11:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:49.244 19:11:10 -- target/shutdown.sh@60 -- # read_io_count=3 00:22:49.244 19:11:10 -- target/shutdown.sh@63 -- # '[' 3 -ge 100 ']' 00:22:49.244 19:11:10 -- target/shutdown.sh@67 -- # sleep 0.25 00:22:49.244 19:11:10 -- target/shutdown.sh@59 -- # (( i-- )) 00:22:49.244 19:11:10 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:49.244 19:11:10 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:49.244 19:11:10 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:49.244 19:11:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:49.244 19:11:10 -- common/autotest_common.sh@10 -- # set +x 00:22:49.502 19:11:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:49.502 19:11:10 -- target/shutdown.sh@60 -- # read_io_count=129 00:22:49.502 19:11:10 -- target/shutdown.sh@63 -- # '[' 129 -ge 100 ']' 00:22:49.502 19:11:10 -- target/shutdown.sh@64 -- # ret=0 00:22:49.502 19:11:10 -- target/shutdown.sh@65 -- # break 00:22:49.502 19:11:10 -- target/shutdown.sh@69 -- # return 0 00:22:49.502 19:11:10 -- target/shutdown.sh@109 -- # killprocess 271278 00:22:49.502 19:11:10 -- common/autotest_common.sh@936 -- # '[' -z 271278 ']' 00:22:49.502 19:11:10 -- common/autotest_common.sh@940 -- # kill -0 271278 00:22:49.502 19:11:10 -- common/autotest_common.sh@941 -- # uname 00:22:49.502 19:11:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:49.502 19:11:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 271278 00:22:49.502 19:11:10 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:49.503 19:11:10 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:49.503 19:11:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 271278' 00:22:49.503 killing process with pid 271278 00:22:49.503 19:11:10 -- common/autotest_common.sh@955 -- # kill 271278 00:22:49.503 19:11:10 -- common/autotest_common.sh@960 -- # wait 271278 00:22:49.503 Received shutdown signal, test time was about 0.541191 seconds 00:22:49.503 00:22:49.503 Latency(us) 00:22:49.503 [2024-11-28T18:11:10.551Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:49.503 [2024-11-28T18:11:10.551Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:49.503 Verification LBA range: start 0x0 length 0x400 00:22:49.503 Nvme1n1 : 0.54 424.53 26.53 0.00 0.00 146125.69 16893.72 121168.78 00:22:49.503 [2024-11-28T18:11:10.551Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:49.503 Verification LBA range: start 0x0 length 0x400 00:22:49.503 Nvme2n1 : 0.53 428.48 26.78 0.00 0.00 143936.69 10777.03 119615.34 00:22:49.503 [2024-11-28T18:11:10.551Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:49.503 Verification LBA range: start 0x0 length 0x400 00:22:49.503 Nvme3n1 : 0.53 427.16 26.70 0.00 0.00 142203.96 11019.76 118061.89 00:22:49.503 [2024-11-28T18:11:10.551Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:49.503 Verification LBA range: start 0x0 length 0x400 00:22:49.503 Nvme4n1 : 0.54 426.07 26.63 0.00 0.00 140497.43 10874.12 118838.61 00:22:49.503 [2024-11-28T18:11:10.551Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:49.503 Verification LBA range: start 0x0 length 0x400 00:22:49.503 Nvme5n1 : 0.54 421.97 26.37 0.00 0.00 139187.14 13689.74 118838.61 00:22:49.503 [2024-11-28T18:11:10.551Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:49.503 Verification LBA range: start 0x0 length 0x400 00:22:49.503 Nvme6n1 : 0.50 377.25 23.58 0.00 0.00 150385.83 25243.50 118838.61 00:22:49.503 [2024-11-28T18:11:10.551Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:49.503 Verification LBA range: start 0x0 length 0x400 00:22:49.503 Nvme7n1 : 0.51 376.09 23.51 0.00 0.00 148367.37 25437.68 122722.23 00:22:49.503 [2024-11-28T18:11:10.551Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:49.503 Verification LBA range: start 0x0 length 0x400 00:22:49.503 Nvme8n1 : 0.51 373.14 23.32 0.00 0.00 146966.20 26214.40 122722.23 00:22:49.503 [2024-11-28T18:11:10.551Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:49.503 Verification LBA range: start 0x0 length 0x400 00:22:49.503 Nvme9n1 : 0.51 370.41 23.15 0.00 0.00 145872.66 25631.86 125829.12 00:22:49.503 [2024-11-28T18:11:10.551Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:49.503 Verification LBA range: start 0x0 length 0x400 00:22:49.503 Nvme10n1 : 0.52 368.00 23.00 0.00 0.00 144683.05 24855.13 126605.84 00:22:49.503 [2024-11-28T18:11:10.551Z] =================================================================================================================== 00:22:49.503 [2024-11-28T18:11:10.551Z] Total : 3993.11 249.57 0.00 0.00 144601.47 10777.03 126605.84 00:22:49.761 19:11:10 -- target/shutdown.sh@112 -- # sleep 1 00:22:50.697 19:11:11 -- target/shutdown.sh@113 -- # kill -0 270963 00:22:50.697 19:11:11 -- target/shutdown.sh@115 -- # stoptarget 00:22:50.697 19:11:11 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:50.697 19:11:11 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:50.697 19:11:11 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:50.697 19:11:11 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:50.697 19:11:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:50.697 19:11:11 -- nvmf/common.sh@116 -- # sync 00:22:50.697 19:11:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:50.697 19:11:11 -- nvmf/common.sh@119 -- # set +e 00:22:50.697 19:11:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:50.697 19:11:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:50.697 rmmod nvme_tcp 00:22:50.697 rmmod nvme_fabrics 00:22:50.957 rmmod nvme_keyring 00:22:50.957 19:11:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:50.957 19:11:11 -- nvmf/common.sh@123 -- # set -e 00:22:50.957 19:11:11 -- nvmf/common.sh@124 -- # return 0 00:22:50.957 19:11:11 -- nvmf/common.sh@477 -- # '[' -n 270963 ']' 00:22:50.957 19:11:11 -- nvmf/common.sh@478 -- # killprocess 270963 00:22:50.957 19:11:11 -- common/autotest_common.sh@936 -- # '[' -z 270963 ']' 00:22:50.957 19:11:11 -- common/autotest_common.sh@940 -- # kill -0 270963 00:22:50.957 19:11:11 -- common/autotest_common.sh@941 -- # uname 00:22:50.957 19:11:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:50.957 19:11:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 270963 00:22:50.957 19:11:11 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:50.957 19:11:11 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:50.957 19:11:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 270963' 00:22:50.957 killing process with pid 270963 00:22:50.957 19:11:11 -- common/autotest_common.sh@955 -- # kill 270963 00:22:50.957 19:11:11 -- common/autotest_common.sh@960 -- # wait 270963 00:22:51.523 19:11:12 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:51.523 19:11:12 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:51.523 19:11:12 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:51.523 19:11:12 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:51.523 19:11:12 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:51.523 19:11:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:51.523 19:11:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:51.523 19:11:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:53.428 19:11:14 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:53.428 00:22:53.428 real 0m8.020s 00:22:53.428 user 0m24.682s 00:22:53.428 sys 0m1.415s 00:22:53.428 19:11:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:53.428 19:11:14 -- common/autotest_common.sh@10 -- # set +x 00:22:53.428 ************************************ 00:22:53.428 END TEST nvmf_shutdown_tc2 00:22:53.428 ************************************ 00:22:53.428 19:11:14 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:22:53.428 19:11:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:22:53.428 19:11:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:53.428 19:11:14 -- common/autotest_common.sh@10 -- # set +x 00:22:53.428 ************************************ 00:22:53.428 START TEST nvmf_shutdown_tc3 00:22:53.428 ************************************ 00:22:53.428 19:11:14 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc3 00:22:53.428 19:11:14 -- target/shutdown.sh@120 -- # starttarget 00:22:53.428 19:11:14 -- target/shutdown.sh@15 -- # nvmftestinit 00:22:53.428 19:11:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:53.428 19:11:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:53.428 19:11:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:53.428 19:11:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:53.428 19:11:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:53.428 19:11:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:53.428 19:11:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:53.428 19:11:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:53.428 19:11:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:53.428 19:11:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:53.428 19:11:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:53.428 19:11:14 -- common/autotest_common.sh@10 -- # set +x 00:22:53.428 19:11:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:53.428 19:11:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:53.428 19:11:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:53.428 19:11:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:53.428 19:11:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:53.428 19:11:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:53.428 19:11:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:53.428 19:11:14 -- nvmf/common.sh@294 -- # net_devs=() 00:22:53.428 19:11:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:53.428 19:11:14 -- nvmf/common.sh@295 -- # e810=() 00:22:53.428 19:11:14 -- nvmf/common.sh@295 -- # local -ga e810 00:22:53.428 19:11:14 -- nvmf/common.sh@296 -- # x722=() 00:22:53.428 19:11:14 -- nvmf/common.sh@296 -- # local -ga x722 00:22:53.428 19:11:14 -- nvmf/common.sh@297 -- # mlx=() 00:22:53.428 19:11:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:53.428 19:11:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:53.428 19:11:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:53.428 19:11:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:53.428 19:11:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:53.428 19:11:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:53.428 19:11:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:53.428 19:11:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:53.428 19:11:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:53.428 19:11:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:53.428 19:11:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:53.428 19:11:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:53.428 19:11:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:53.428 19:11:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:53.428 19:11:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:53.428 19:11:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:53.428 19:11:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:53.428 19:11:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:53.428 19:11:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:53.428 19:11:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:53.428 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:53.428 19:11:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:53.428 19:11:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:53.428 19:11:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:53.428 19:11:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:53.428 19:11:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:53.428 19:11:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:53.428 19:11:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:53.428 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:53.428 19:11:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:53.428 19:11:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:53.428 19:11:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:53.428 19:11:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:53.428 19:11:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:53.428 19:11:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:53.428 19:11:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:53.428 19:11:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:53.428 19:11:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:53.428 19:11:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:53.428 19:11:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:53.428 19:11:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:53.428 19:11:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:53.428 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:53.428 19:11:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:53.428 19:11:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:53.428 19:11:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:53.428 19:11:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:53.428 19:11:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:53.428 19:11:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:53.428 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:53.428 19:11:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:53.428 19:11:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:53.428 19:11:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:53.428 19:11:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:53.428 19:11:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:53.428 19:11:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:53.428 19:11:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:53.428 19:11:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:53.428 19:11:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:53.428 19:11:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:53.428 19:11:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:53.428 19:11:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:53.428 19:11:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:53.428 19:11:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:53.428 19:11:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:53.428 19:11:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:53.428 19:11:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:53.428 19:11:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:53.428 19:11:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:53.686 19:11:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:53.686 19:11:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:53.686 19:11:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:53.686 19:11:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:53.686 19:11:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:53.686 19:11:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:53.686 19:11:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:53.686 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:53.686 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.286 ms 00:22:53.686 00:22:53.686 --- 10.0.0.2 ping statistics --- 00:22:53.686 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:53.686 rtt min/avg/max/mdev = 0.286/0.286/0.286/0.000 ms 00:22:53.686 19:11:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:53.686 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:53.686 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.054 ms 00:22:53.686 00:22:53.686 --- 10.0.0.1 ping statistics --- 00:22:53.686 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:53.686 rtt min/avg/max/mdev = 0.054/0.054/0.054/0.000 ms 00:22:53.686 19:11:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:53.686 19:11:14 -- nvmf/common.sh@410 -- # return 0 00:22:53.686 19:11:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:53.686 19:11:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:53.686 19:11:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:53.686 19:11:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:53.686 19:11:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:53.686 19:11:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:53.686 19:11:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:53.686 19:11:14 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:22:53.686 19:11:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:53.686 19:11:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:53.686 19:11:14 -- common/autotest_common.sh@10 -- # set +x 00:22:53.686 19:11:14 -- nvmf/common.sh@469 -- # nvmfpid=272169 00:22:53.686 19:11:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:22:53.687 19:11:14 -- nvmf/common.sh@470 -- # waitforlisten 272169 00:22:53.687 19:11:14 -- common/autotest_common.sh@829 -- # '[' -z 272169 ']' 00:22:53.687 19:11:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:53.687 19:11:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:53.687 19:11:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:53.687 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:53.687 19:11:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:53.687 19:11:14 -- common/autotest_common.sh@10 -- # set +x 00:22:53.687 [2024-11-28 19:11:14.628012] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:53.687 [2024-11-28 19:11:14.628093] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:53.687 EAL: No free 2048 kB hugepages reported on node 1 00:22:53.687 [2024-11-28 19:11:14.696610] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:53.946 [2024-11-28 19:11:14.812106] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:53.946 [2024-11-28 19:11:14.812265] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:53.946 [2024-11-28 19:11:14.812285] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:53.946 [2024-11-28 19:11:14.812299] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:53.946 [2024-11-28 19:11:14.812412] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:53.946 [2024-11-28 19:11:14.812499] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:53.946 [2024-11-28 19:11:14.812555] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:22:53.946 [2024-11-28 19:11:14.812558] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:54.880 19:11:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:54.880 19:11:15 -- common/autotest_common.sh@862 -- # return 0 00:22:54.880 19:11:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:54.880 19:11:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:54.880 19:11:15 -- common/autotest_common.sh@10 -- # set +x 00:22:54.880 19:11:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:54.880 19:11:15 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:54.880 19:11:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:54.880 19:11:15 -- common/autotest_common.sh@10 -- # set +x 00:22:54.880 [2024-11-28 19:11:15.599885] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:54.880 19:11:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:54.880 19:11:15 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:22:54.880 19:11:15 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:22:54.880 19:11:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:54.880 19:11:15 -- common/autotest_common.sh@10 -- # set +x 00:22:54.880 19:11:15 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:54.880 19:11:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:54.880 19:11:15 -- target/shutdown.sh@28 -- # cat 00:22:54.880 19:11:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:54.880 19:11:15 -- target/shutdown.sh@28 -- # cat 00:22:54.880 19:11:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:54.880 19:11:15 -- target/shutdown.sh@28 -- # cat 00:22:54.880 19:11:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:54.880 19:11:15 -- target/shutdown.sh@28 -- # cat 00:22:54.880 19:11:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:54.880 19:11:15 -- target/shutdown.sh@28 -- # cat 00:22:54.880 19:11:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:54.880 19:11:15 -- target/shutdown.sh@28 -- # cat 00:22:54.880 19:11:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:54.880 19:11:15 -- target/shutdown.sh@28 -- # cat 00:22:54.880 19:11:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:54.880 19:11:15 -- target/shutdown.sh@28 -- # cat 00:22:54.881 19:11:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:54.881 19:11:15 -- target/shutdown.sh@28 -- # cat 00:22:54.881 19:11:15 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:22:54.881 19:11:15 -- target/shutdown.sh@28 -- # cat 00:22:54.881 19:11:15 -- target/shutdown.sh@35 -- # rpc_cmd 00:22:54.881 19:11:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:54.881 19:11:15 -- common/autotest_common.sh@10 -- # set +x 00:22:54.881 Malloc1 00:22:54.881 [2024-11-28 19:11:15.675906] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:54.881 Malloc2 00:22:54.881 Malloc3 00:22:54.881 Malloc4 00:22:54.881 Malloc5 00:22:54.881 Malloc6 00:22:55.139 Malloc7 00:22:55.139 Malloc8 00:22:55.139 Malloc9 00:22:55.139 Malloc10 00:22:55.139 19:11:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:55.140 19:11:16 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:22:55.140 19:11:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:55.140 19:11:16 -- common/autotest_common.sh@10 -- # set +x 00:22:55.140 19:11:16 -- target/shutdown.sh@124 -- # perfpid=272401 00:22:55.140 19:11:16 -- target/shutdown.sh@125 -- # waitforlisten 272401 /var/tmp/bdevperf.sock 00:22:55.140 19:11:16 -- common/autotest_common.sh@829 -- # '[' -z 272401 ']' 00:22:55.140 19:11:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:22:55.140 19:11:16 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:22:55.140 19:11:16 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:22:55.140 19:11:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:55.140 19:11:16 -- nvmf/common.sh@520 -- # config=() 00:22:55.140 19:11:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:22:55.140 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:22:55.140 19:11:16 -- nvmf/common.sh@520 -- # local subsystem config 00:22:55.140 19:11:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:55.140 19:11:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:55.140 19:11:16 -- common/autotest_common.sh@10 -- # set +x 00:22:55.140 19:11:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:55.140 { 00:22:55.140 "params": { 00:22:55.140 "name": "Nvme$subsystem", 00:22:55.140 "trtype": "$TEST_TRANSPORT", 00:22:55.140 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:55.140 "adrfam": "ipv4", 00:22:55.140 "trsvcid": "$NVMF_PORT", 00:22:55.140 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:55.140 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:55.140 "hdgst": ${hdgst:-false}, 00:22:55.140 "ddgst": ${ddgst:-false} 00:22:55.140 }, 00:22:55.140 "method": "bdev_nvme_attach_controller" 00:22:55.140 } 00:22:55.140 EOF 00:22:55.140 )") 00:22:55.140 19:11:16 -- nvmf/common.sh@542 -- # cat 00:22:55.140 19:11:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:55.140 19:11:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:55.140 { 00:22:55.140 "params": { 00:22:55.140 "name": "Nvme$subsystem", 00:22:55.140 "trtype": "$TEST_TRANSPORT", 00:22:55.140 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:55.140 "adrfam": "ipv4", 00:22:55.140 "trsvcid": "$NVMF_PORT", 00:22:55.140 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:55.140 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:55.140 "hdgst": ${hdgst:-false}, 00:22:55.140 "ddgst": ${ddgst:-false} 00:22:55.140 }, 00:22:55.140 "method": "bdev_nvme_attach_controller" 00:22:55.140 } 00:22:55.140 EOF 00:22:55.140 )") 00:22:55.140 19:11:16 -- nvmf/common.sh@542 -- # cat 00:22:55.140 19:11:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:55.140 19:11:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:55.140 { 00:22:55.140 "params": { 00:22:55.140 "name": "Nvme$subsystem", 00:22:55.140 "trtype": "$TEST_TRANSPORT", 00:22:55.140 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:55.140 "adrfam": "ipv4", 00:22:55.140 "trsvcid": "$NVMF_PORT", 00:22:55.140 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:55.140 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:55.140 "hdgst": ${hdgst:-false}, 00:22:55.140 "ddgst": ${ddgst:-false} 00:22:55.140 }, 00:22:55.140 "method": "bdev_nvme_attach_controller" 00:22:55.140 } 00:22:55.140 EOF 00:22:55.140 )") 00:22:55.140 19:11:16 -- nvmf/common.sh@542 -- # cat 00:22:55.140 19:11:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:55.140 19:11:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:55.140 { 00:22:55.140 "params": { 00:22:55.140 "name": "Nvme$subsystem", 00:22:55.140 "trtype": "$TEST_TRANSPORT", 00:22:55.140 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:55.140 "adrfam": "ipv4", 00:22:55.140 "trsvcid": "$NVMF_PORT", 00:22:55.140 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:55.140 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:55.140 "hdgst": ${hdgst:-false}, 00:22:55.140 "ddgst": ${ddgst:-false} 00:22:55.140 }, 00:22:55.140 "method": "bdev_nvme_attach_controller" 00:22:55.140 } 00:22:55.140 EOF 00:22:55.140 )") 00:22:55.140 19:11:16 -- nvmf/common.sh@542 -- # cat 00:22:55.140 19:11:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:55.140 19:11:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:55.140 { 00:22:55.140 "params": { 00:22:55.140 "name": "Nvme$subsystem", 00:22:55.140 "trtype": "$TEST_TRANSPORT", 00:22:55.140 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:55.140 "adrfam": "ipv4", 00:22:55.140 "trsvcid": "$NVMF_PORT", 00:22:55.140 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:55.140 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:55.140 "hdgst": ${hdgst:-false}, 00:22:55.140 "ddgst": ${ddgst:-false} 00:22:55.140 }, 00:22:55.140 "method": "bdev_nvme_attach_controller" 00:22:55.140 } 00:22:55.140 EOF 00:22:55.140 )") 00:22:55.140 19:11:16 -- nvmf/common.sh@542 -- # cat 00:22:55.140 19:11:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:55.140 19:11:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:55.140 { 00:22:55.140 "params": { 00:22:55.140 "name": "Nvme$subsystem", 00:22:55.140 "trtype": "$TEST_TRANSPORT", 00:22:55.140 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:55.140 "adrfam": "ipv4", 00:22:55.140 "trsvcid": "$NVMF_PORT", 00:22:55.140 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:55.140 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:55.140 "hdgst": ${hdgst:-false}, 00:22:55.140 "ddgst": ${ddgst:-false} 00:22:55.140 }, 00:22:55.140 "method": "bdev_nvme_attach_controller" 00:22:55.140 } 00:22:55.140 EOF 00:22:55.140 )") 00:22:55.140 19:11:16 -- nvmf/common.sh@542 -- # cat 00:22:55.140 19:11:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:55.140 19:11:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:55.140 { 00:22:55.141 "params": { 00:22:55.141 "name": "Nvme$subsystem", 00:22:55.141 "trtype": "$TEST_TRANSPORT", 00:22:55.141 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:55.141 "adrfam": "ipv4", 00:22:55.141 "trsvcid": "$NVMF_PORT", 00:22:55.141 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:55.141 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:55.141 "hdgst": ${hdgst:-false}, 00:22:55.141 "ddgst": ${ddgst:-false} 00:22:55.141 }, 00:22:55.141 "method": "bdev_nvme_attach_controller" 00:22:55.141 } 00:22:55.141 EOF 00:22:55.141 )") 00:22:55.141 19:11:16 -- nvmf/common.sh@542 -- # cat 00:22:55.141 19:11:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:55.141 19:11:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:55.141 { 00:22:55.141 "params": { 00:22:55.141 "name": "Nvme$subsystem", 00:22:55.141 "trtype": "$TEST_TRANSPORT", 00:22:55.141 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:55.141 "adrfam": "ipv4", 00:22:55.141 "trsvcid": "$NVMF_PORT", 00:22:55.141 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:55.141 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:55.141 "hdgst": ${hdgst:-false}, 00:22:55.141 "ddgst": ${ddgst:-false} 00:22:55.141 }, 00:22:55.141 "method": "bdev_nvme_attach_controller" 00:22:55.141 } 00:22:55.141 EOF 00:22:55.141 )") 00:22:55.141 19:11:16 -- nvmf/common.sh@542 -- # cat 00:22:55.141 19:11:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:55.141 19:11:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:55.141 { 00:22:55.141 "params": { 00:22:55.141 "name": "Nvme$subsystem", 00:22:55.141 "trtype": "$TEST_TRANSPORT", 00:22:55.141 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:55.141 "adrfam": "ipv4", 00:22:55.141 "trsvcid": "$NVMF_PORT", 00:22:55.141 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:55.141 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:55.141 "hdgst": ${hdgst:-false}, 00:22:55.141 "ddgst": ${ddgst:-false} 00:22:55.141 }, 00:22:55.141 "method": "bdev_nvme_attach_controller" 00:22:55.141 } 00:22:55.141 EOF 00:22:55.141 )") 00:22:55.141 19:11:16 -- nvmf/common.sh@542 -- # cat 00:22:55.141 19:11:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:22:55.141 19:11:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:22:55.141 { 00:22:55.141 "params": { 00:22:55.141 "name": "Nvme$subsystem", 00:22:55.141 "trtype": "$TEST_TRANSPORT", 00:22:55.141 "traddr": "$NVMF_FIRST_TARGET_IP", 00:22:55.141 "adrfam": "ipv4", 00:22:55.141 "trsvcid": "$NVMF_PORT", 00:22:55.141 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:22:55.141 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:22:55.141 "hdgst": ${hdgst:-false}, 00:22:55.141 "ddgst": ${ddgst:-false} 00:22:55.141 }, 00:22:55.141 "method": "bdev_nvme_attach_controller" 00:22:55.141 } 00:22:55.141 EOF 00:22:55.141 )") 00:22:55.141 19:11:16 -- nvmf/common.sh@542 -- # cat 00:22:55.141 19:11:16 -- nvmf/common.sh@544 -- # jq . 00:22:55.141 19:11:16 -- nvmf/common.sh@545 -- # IFS=, 00:22:55.141 19:11:16 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:22:55.141 "params": { 00:22:55.141 "name": "Nvme1", 00:22:55.141 "trtype": "tcp", 00:22:55.141 "traddr": "10.0.0.2", 00:22:55.141 "adrfam": "ipv4", 00:22:55.141 "trsvcid": "4420", 00:22:55.141 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:22:55.141 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:22:55.141 "hdgst": false, 00:22:55.141 "ddgst": false 00:22:55.141 }, 00:22:55.141 "method": "bdev_nvme_attach_controller" 00:22:55.141 },{ 00:22:55.141 "params": { 00:22:55.141 "name": "Nvme2", 00:22:55.141 "trtype": "tcp", 00:22:55.141 "traddr": "10.0.0.2", 00:22:55.141 "adrfam": "ipv4", 00:22:55.141 "trsvcid": "4420", 00:22:55.141 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:22:55.141 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:22:55.141 "hdgst": false, 00:22:55.141 "ddgst": false 00:22:55.141 }, 00:22:55.141 "method": "bdev_nvme_attach_controller" 00:22:55.141 },{ 00:22:55.141 "params": { 00:22:55.141 "name": "Nvme3", 00:22:55.141 "trtype": "tcp", 00:22:55.141 "traddr": "10.0.0.2", 00:22:55.141 "adrfam": "ipv4", 00:22:55.141 "trsvcid": "4420", 00:22:55.141 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:22:55.141 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:22:55.141 "hdgst": false, 00:22:55.141 "ddgst": false 00:22:55.141 }, 00:22:55.141 "method": "bdev_nvme_attach_controller" 00:22:55.141 },{ 00:22:55.141 "params": { 00:22:55.141 "name": "Nvme4", 00:22:55.141 "trtype": "tcp", 00:22:55.141 "traddr": "10.0.0.2", 00:22:55.141 "adrfam": "ipv4", 00:22:55.141 "trsvcid": "4420", 00:22:55.141 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:22:55.141 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:22:55.141 "hdgst": false, 00:22:55.141 "ddgst": false 00:22:55.141 }, 00:22:55.141 "method": "bdev_nvme_attach_controller" 00:22:55.141 },{ 00:22:55.141 "params": { 00:22:55.141 "name": "Nvme5", 00:22:55.141 "trtype": "tcp", 00:22:55.141 "traddr": "10.0.0.2", 00:22:55.141 "adrfam": "ipv4", 00:22:55.141 "trsvcid": "4420", 00:22:55.141 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:22:55.141 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:22:55.141 "hdgst": false, 00:22:55.141 "ddgst": false 00:22:55.141 }, 00:22:55.141 "method": "bdev_nvme_attach_controller" 00:22:55.141 },{ 00:22:55.141 "params": { 00:22:55.141 "name": "Nvme6", 00:22:55.141 "trtype": "tcp", 00:22:55.141 "traddr": "10.0.0.2", 00:22:55.141 "adrfam": "ipv4", 00:22:55.141 "trsvcid": "4420", 00:22:55.141 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:22:55.141 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:22:55.141 "hdgst": false, 00:22:55.142 "ddgst": false 00:22:55.142 }, 00:22:55.142 "method": "bdev_nvme_attach_controller" 00:22:55.142 },{ 00:22:55.142 "params": { 00:22:55.142 "name": "Nvme7", 00:22:55.142 "trtype": "tcp", 00:22:55.142 "traddr": "10.0.0.2", 00:22:55.142 "adrfam": "ipv4", 00:22:55.142 "trsvcid": "4420", 00:22:55.142 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:22:55.142 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:22:55.142 "hdgst": false, 00:22:55.142 "ddgst": false 00:22:55.142 }, 00:22:55.142 "method": "bdev_nvme_attach_controller" 00:22:55.142 },{ 00:22:55.142 "params": { 00:22:55.142 "name": "Nvme8", 00:22:55.142 "trtype": "tcp", 00:22:55.142 "traddr": "10.0.0.2", 00:22:55.142 "adrfam": "ipv4", 00:22:55.142 "trsvcid": "4420", 00:22:55.142 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:22:55.142 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:22:55.142 "hdgst": false, 00:22:55.142 "ddgst": false 00:22:55.142 }, 00:22:55.142 "method": "bdev_nvme_attach_controller" 00:22:55.142 },{ 00:22:55.142 "params": { 00:22:55.142 "name": "Nvme9", 00:22:55.142 "trtype": "tcp", 00:22:55.142 "traddr": "10.0.0.2", 00:22:55.142 "adrfam": "ipv4", 00:22:55.142 "trsvcid": "4420", 00:22:55.142 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:22:55.142 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:22:55.142 "hdgst": false, 00:22:55.142 "ddgst": false 00:22:55.142 }, 00:22:55.142 "method": "bdev_nvme_attach_controller" 00:22:55.142 },{ 00:22:55.142 "params": { 00:22:55.142 "name": "Nvme10", 00:22:55.142 "trtype": "tcp", 00:22:55.142 "traddr": "10.0.0.2", 00:22:55.142 "adrfam": "ipv4", 00:22:55.142 "trsvcid": "4420", 00:22:55.142 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:22:55.142 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:22:55.142 "hdgst": false, 00:22:55.142 "ddgst": false 00:22:55.142 }, 00:22:55.142 "method": "bdev_nvme_attach_controller" 00:22:55.142 }' 00:22:55.142 [2024-11-28 19:11:16.163305] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:55.142 [2024-11-28 19:11:16.163406] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid272401 ] 00:22:55.402 EAL: No free 2048 kB hugepages reported on node 1 00:22:55.402 [2024-11-28 19:11:16.227893] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:22:55.402 [2024-11-28 19:11:16.335823] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:57.309 Running I/O for 10 seconds... 00:22:57.902 19:11:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:57.902 19:11:18 -- common/autotest_common.sh@862 -- # return 0 00:22:57.902 19:11:18 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:22:57.902 19:11:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.902 19:11:18 -- common/autotest_common.sh@10 -- # set +x 00:22:57.902 19:11:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.902 19:11:18 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:22:57.902 19:11:18 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:22:57.902 19:11:18 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:22:57.902 19:11:18 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:22:57.902 19:11:18 -- target/shutdown.sh@57 -- # local ret=1 00:22:57.902 19:11:18 -- target/shutdown.sh@58 -- # local i 00:22:57.902 19:11:18 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:22:57.902 19:11:18 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:22:57.902 19:11:18 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:22:57.902 19:11:18 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:22:57.902 19:11:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:57.902 19:11:18 -- common/autotest_common.sh@10 -- # set +x 00:22:57.902 19:11:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:57.902 19:11:18 -- target/shutdown.sh@60 -- # read_io_count=254 00:22:57.902 19:11:18 -- target/shutdown.sh@63 -- # '[' 254 -ge 100 ']' 00:22:57.902 19:11:18 -- target/shutdown.sh@64 -- # ret=0 00:22:57.902 19:11:18 -- target/shutdown.sh@65 -- # break 00:22:57.902 19:11:18 -- target/shutdown.sh@69 -- # return 0 00:22:57.902 19:11:18 -- target/shutdown.sh@134 -- # killprocess 272169 00:22:57.902 19:11:18 -- common/autotest_common.sh@936 -- # '[' -z 272169 ']' 00:22:57.902 19:11:18 -- common/autotest_common.sh@940 -- # kill -0 272169 00:22:57.902 19:11:18 -- common/autotest_common.sh@941 -- # uname 00:22:57.902 19:11:18 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:57.902 19:11:18 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 272169 00:22:57.902 19:11:18 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:22:57.902 19:11:18 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:22:57.902 19:11:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 272169' 00:22:57.902 killing process with pid 272169 00:22:57.902 19:11:18 -- common/autotest_common.sh@955 -- # kill 272169 00:22:57.902 19:11:18 -- common/autotest_common.sh@960 -- # wait 272169 00:22:57.902 [2024-11-28 19:11:18.826747] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22102e0 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.827822] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.827857] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.827873] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.827885] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.827897] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.827910] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.827922] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.827934] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.827946] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.827960] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.827982] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.827996] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.828008] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.828020] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.828033] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.828044] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.828056] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.828069] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.828081] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.828092] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.828104] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.828116] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.828128] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.828139] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.828151] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.828163] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.828175] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.828187] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.828199] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.828211] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.828223] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.828235] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.828247] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.828259] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.828270] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.828282] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.828294] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.828310] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.828322] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.828334] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.828346] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.828358] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.828369] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.828381] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.902 [2024-11-28 19:11:18.828399] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.828413] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.828426] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.828447] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.828459] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.828471] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.828482] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212c90 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.829863] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.829888] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.829902] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.829914] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.829926] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.829937] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.829949] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.829961] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.829973] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.829984] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.829996] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830008] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830020] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830037] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830050] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830061] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830073] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830085] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830097] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830109] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830121] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830133] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830145] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830157] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830169] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830181] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830192] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830205] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830217] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830229] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830240] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830252] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830264] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830276] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830288] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830299] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830311] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830323] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830334] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830347] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830362] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830374] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830386] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830406] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830420] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830440] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830452] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830464] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830476] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830488] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830500] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830512] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830523] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830535] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830547] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830559] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830571] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830590] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830602] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830615] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830627] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830639] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.830651] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210790 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.832492] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.903 [2024-11-28 19:11:18.832533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.903 [2024-11-28 19:11:18.832551] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.903 [2024-11-28 19:11:18.832567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.903 [2024-11-28 19:11:18.832588] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.903 [2024-11-28 19:11:18.832603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.903 [2024-11-28 19:11:18.832617] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.903 [2024-11-28 19:11:18.832631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.903 [2024-11-28 19:11:18.832644] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf00600 is same with the state(5) to be set 00:22:57.903 [2024-11-28 19:11:18.832713] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.903 [2024-11-28 19:11:18.832735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.903 [2024-11-28 19:11:18.832751] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.903 [2024-11-28 19:11:18.832764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.903 [2024-11-28 19:11:18.832778] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.904 [2024-11-28 19:11:18.832791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.832805] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.904 [2024-11-28 19:11:18.832818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.832832] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd39f70 is same with the state(5) to be set 00:22:57.904 [2024-11-28 19:11:18.832888] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.904 [2024-11-28 19:11:18.832909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.832925] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.904 [2024-11-28 19:11:18.832938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.832953] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.904 [2024-11-28 19:11:18.832966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.832979] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.904 [2024-11-28 19:11:18.832992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.833006] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd92590 is same with the state(5) to be set 00:22:57.904 [2024-11-28 19:11:18.834321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.904 [2024-11-28 19:11:18.834349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.834387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.904 [2024-11-28 19:11:18.834413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.834432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.904 [2024-11-28 19:11:18.834458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.834473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.904 [2024-11-28 19:11:18.834488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.834504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.904 [2024-11-28 19:11:18.834518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.834534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.904 [2024-11-28 19:11:18.834548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.834563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.904 [2024-11-28 19:11:18.834577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.834593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.904 [2024-11-28 19:11:18.834607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.834622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.904 [2024-11-28 19:11:18.834636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.834651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.904 [2024-11-28 19:11:18.834665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.834683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.904 [2024-11-28 19:11:18.834697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.834712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.904 [2024-11-28 19:11:18.834726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.834748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.904 [2024-11-28 19:11:18.834762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.834777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.904 [2024-11-28 19:11:18.834795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.834812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.904 [2024-11-28 19:11:18.834826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.834841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.904 [2024-11-28 19:11:18.834855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.834871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.904 [2024-11-28 19:11:18.834885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.834900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.904 [2024-11-28 19:11:18.834914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.834929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.904 [2024-11-28 19:11:18.834943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.834959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.904 [2024-11-28 19:11:18.834972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.834988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.904 [2024-11-28 19:11:18.835002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.835017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.904 [2024-11-28 19:11:18.835031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.835047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.904 [2024-11-28 19:11:18.835061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.835077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.904 [2024-11-28 19:11:18.835091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.835106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.904 [2024-11-28 19:11:18.835120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.835135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.904 [2024-11-28 19:11:18.835149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.835165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.904 [2024-11-28 19:11:18.835183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.835200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.904 [2024-11-28 19:11:18.835214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.835230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.904 [2024-11-28 19:11:18.835244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.835259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.904 [2024-11-28 19:11:18.835273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.835289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.904 [2024-11-28 19:11:18.835303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.835318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.904 [2024-11-28 19:11:18.835331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.835347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.904 [2024-11-28 19:11:18.835360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.904 [2024-11-28 19:11:18.835376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.905 [2024-11-28 19:11:18.835391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.905 [2024-11-28 19:11:18.835417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.905 [2024-11-28 19:11:18.835443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.905 [2024-11-28 19:11:18.835459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.905 [2024-11-28 19:11:18.835473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.905 [2024-11-28 19:11:18.835488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.905 [2024-11-28 19:11:18.835502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.905 [2024-11-28 19:11:18.835518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.905 [2024-11-28 19:11:18.835532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.905 [2024-11-28 19:11:18.835547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.905 [2024-11-28 19:11:18.835562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.905 [2024-11-28 19:11:18.835581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.905 [2024-11-28 19:11:18.835595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.905 [2024-11-28 19:11:18.835610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.905 [2024-11-28 19:11:18.835624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.905 [2024-11-28 19:11:18.835639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.905 [2024-11-28 19:11:18.835654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.905 [2024-11-28 19:11:18.835669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.905 [2024-11-28 19:11:18.835688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.905 [2024-11-28 19:11:18.835703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.905 [2024-11-28 19:11:18.835717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.905 [2024-11-28 19:11:18.835732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.905 [2024-11-28 19:11:18.835746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.905 [2024-11-28 19:11:18.835762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.905 [2024-11-28 19:11:18.835776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.905 [2024-11-28 19:11:18.835792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.905 [2024-11-28 19:11:18.835806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.905 [2024-11-28 19:11:18.835821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.905 [2024-11-28 19:11:18.835835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.905 [2024-11-28 19:11:18.835850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.905 [2024-11-28 19:11:18.835864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.905 [2024-11-28 19:11:18.835880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.905 [2024-11-28 19:11:18.835894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.905 [2024-11-28 19:11:18.835910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.905 [2024-11-28 19:11:18.835924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.905 [2024-11-28 19:11:18.835939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.905 [2024-11-28 19:11:18.835962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.905 [2024-11-28 19:11:18.835978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.905 [2024-11-28 19:11:18.835993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.905 [2024-11-28 19:11:18.836009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.905 [2024-11-28 19:11:18.836023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.905 [2024-11-28 19:11:18.836039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.905 [2024-11-28 19:11:18.836053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.905 [2024-11-28 19:11:18.836068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.905 [2024-11-28 19:11:18.836082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.905 [2024-11-28 19:11:18.836097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.905 [2024-11-28 19:11:18.836112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.905 [2024-11-28 19:11:18.836127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.905 [2024-11-28 19:11:18.836141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.905 [2024-11-28 19:11:18.836157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.905 [2024-11-28 19:11:18.836171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.905 [2024-11-28 19:11:18.836186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.905 [2024-11-28 19:11:18.836200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.905 [2024-11-28 19:11:18.836216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.905 [2024-11-28 19:11:18.836230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.905 [2024-11-28 19:11:18.836246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.905 [2024-11-28 19:11:18.836260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.905 [2024-11-28 19:11:18.836275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.905 [2024-11-28 19:11:18.836290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.905 [2024-11-28 19:11:18.836306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.905 [2024-11-28 19:11:18.836319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.905 [2024-11-28 19:11:18.836887] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xf905b0 was disconnected and freed. reset controller. 00:22:57.905 [2024-11-28 19:11:18.838189] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.905 [2024-11-28 19:11:18.838225] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.905 [2024-11-28 19:11:18.838240] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.905 [2024-11-28 19:11:18.838252] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.905 [2024-11-28 19:11:18.838265] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.905 [2024-11-28 19:11:18.838278] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.905 [2024-11-28 19:11:18.838290] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.905 [2024-11-28 19:11:18.838302] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.905 [2024-11-28 19:11:18.838314] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.905 [2024-11-28 19:11:18.838327] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.905 [2024-11-28 19:11:18.838339] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.905 [2024-11-28 19:11:18.838350] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.905 [2024-11-28 19:11:18.838362] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.905 [2024-11-28 19:11:18.838374] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.905 [2024-11-28 19:11:18.838386] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.905 [2024-11-28 19:11:18.838409] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.905 [2024-11-28 19:11:18.838423] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838444] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838456] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838468] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838480] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838492] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838504] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838516] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838528] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838540] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838558] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838572] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838585] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838596] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838609] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838621] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838632] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838644] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838655] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838667] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838680] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838701] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838714] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838726] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838737] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838749] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838761] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838773] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838785] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838797] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838809] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838821] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838833] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838845] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838857] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838869] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838880] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838896] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838908] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838920] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838932] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838944] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838956] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838967] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838979] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.838998] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.839011] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2210c40 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.840246] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.840280] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.840295] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.840307] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.840320] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.840332] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.840344] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.840357] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.840368] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.840381] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.840399] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.840413] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.840425] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.840441] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.840452] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.840464] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.840476] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.840494] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.840507] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.840518] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.840530] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.906 [2024-11-28 19:11:18.840542] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.840554] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.840565] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.840578] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.840590] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.840602] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.840613] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.840625] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.840637] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.840649] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.840660] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.840672] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.840685] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.840697] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.840709] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.840720] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.840732] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.840750] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.840762] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.840774] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.840786] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.840798] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.840809] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.840824] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.840837] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.840849] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.840860] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.840872] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.840883] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.840895] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.840907] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.840918] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.840930] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.840942] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.840953] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.840966] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.840978] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.840990] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.841001] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.841013] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.841024] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.841036] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22110d0 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.841730] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.841760] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.841775] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.841787] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.841799] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.841811] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.841823] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.841834] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.841852] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.841865] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.841877] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.841888] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.841900] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.841911] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.841924] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.841936] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.841948] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.841959] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.841971] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.841983] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.841994] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.842006] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.842018] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.842029] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.842041] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.842053] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.842064] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.842075] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.842087] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.842099] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.842110] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.842122] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.842133] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.842145] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.842156] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.842172] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.842184] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.842196] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.842207] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.842219] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.842231] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.842243] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.842254] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.907 [2024-11-28 19:11:18.842265] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.842277] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.842289] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.842302] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.842314] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.842326] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.842337] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.842349] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.842361] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.842373] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.842384] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.842405] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.842418] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.842441] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.842453] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.842465] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.842477] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.842488] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.842500] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.842519] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211560 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843470] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843498] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843512] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843524] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843536] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843548] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843561] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843573] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843584] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843596] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843608] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843620] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843632] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843644] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843655] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843667] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843688] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843699] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843711] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843723] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843734] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843751] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843763] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843775] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843787] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843799] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843811] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843828] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843840] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843852] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843863] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843875] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843887] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843899] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843911] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843922] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843934] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843945] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843958] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843969] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843981] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.843993] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.844005] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.844017] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.844029] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.844041] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.844053] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.844065] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.844077] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.844089] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.844100] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.844112] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.844124] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.844136] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.844151] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.844163] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.844175] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.844187] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.844199] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.844210] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.844222] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.844234] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.844245] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211a10 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.845501] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.908 [2024-11-28 19:11:18.845530] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.845545] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.845558] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.845570] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.845582] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.845594] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.845606] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.845618] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.845630] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.845642] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.845654] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.845666] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.845688] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.845700] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.845712] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.845723] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.845735] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.845763] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.845776] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.845788] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.845800] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.845812] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.845825] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.845837] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.845848] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.845860] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.845872] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.845884] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.845897] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.845908] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.845920] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.845932] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.845945] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.845957] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.845969] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.845981] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.845992] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.846004] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.846016] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.846027] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.846039] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.846052] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.846063] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.846075] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.846091] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.846103] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.846116] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.846127] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.846139] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.846151] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.846163] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.846175] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.846177] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controll[2024-11-28 19:11:18.846187] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with er 00:22:57.909 the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.846203] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.846216] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.846221] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd92590 (9): Bad file descriptor 00:22:57.909 [2024-11-28 19:11:18.846228] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.846240] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.846252] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.846264] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.846276] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.846287] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 ns[2024-11-28 19:11:18.846293] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with id:0 cdw10:00000000 cdw11:00000000 00:22:57.909 the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.846309] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2211ec0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.846311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.909 [2024-11-28 19:11:18.846327] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.909 [2024-11-28 19:11:18.846341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.909 [2024-11-28 19:11:18.846354] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.909 [2024-11-28 19:11:18.846368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.909 [2024-11-28 19:11:18.846382] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.909 [2024-11-28 19:11:18.846408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.909 [2024-11-28 19:11:18.846424] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xeeaa60 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.846474] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.909 [2024-11-28 19:11:18.846495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.909 [2024-11-28 19:11:18.846510] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.909 [2024-11-28 19:11:18.846524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.909 [2024-11-28 19:11:18.846537] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.909 [2024-11-28 19:11:18.846550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.909 [2024-11-28 19:11:18.846564] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.909 [2024-11-28 19:11:18.846577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.909 [2024-11-28 19:11:18.846591] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xedb0a0 is same with the state(5) to be set 00:22:57.909 [2024-11-28 19:11:18.846637] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.909 [2024-11-28 19:11:18.846657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.909 [2024-11-28 19:11:18.846684] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.910 [2024-11-28 19:11:18.846698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.910 [2024-11-28 19:11:18.846712] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.910 [2024-11-28 19:11:18.846725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.910 [2024-11-28 19:11:18.846749] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.910 [2024-11-28 19:11:18.846761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.910 [2024-11-28 19:11:18.846774] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd65690 is same with the state(5) to be set 00:22:57.910 [2024-11-28 19:11:18.846817] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.910 [2024-11-28 19:11:18.846837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.910 [2024-11-28 19:11:18.846853] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.910 [2024-11-28 19:11:18.846866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.910 [2024-11-28 19:11:18.846880] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.910 [2024-11-28 19:11:18.846898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.910 [2024-11-28 19:11:18.846913] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.910 [2024-11-28 19:11:18.846927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.910 [2024-11-28 19:11:18.846939] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xef0150 is same with the state(5) to be set 00:22:57.910 [2024-11-28 19:11:18.846967] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf00600 (9): Bad file descriptor 00:22:57.910 [2024-11-28 19:11:18.847015] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.910 [2024-11-28 19:11:18.847036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.910 [2024-11-28 19:11:18.847051] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.910 [2024-11-28 19:11:18.847064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.910 [2024-11-28 19:11:18.847078] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.910 [2024-11-28 19:11:18.847091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.910 [2024-11-28 19:11:18.847104] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.910 [2024-11-28 19:11:18.847117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.910 [2024-11-28 19:11:18.847129] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd5c1b0 is same with the state(5) to be set 00:22:57.910 [2024-11-28 19:11:18.847155] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd39f70 (9): Bad file descriptor 00:22:57.910 [2024-11-28 19:11:18.847202] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.910 [2024-11-28 19:11:18.847223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.910 [2024-11-28 19:11:18.847238] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.910 [2024-11-28 19:11:18.847251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.910 [2024-11-28 19:11:18.847265] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.910 [2024-11-28 19:11:18.847278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.910 [2024-11-28 19:11:18.847291] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.910 [2024-11-28 19:11:18.847290] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.910 [2024-11-28 19:11:18.847304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.910 [2024-11-28 19:11:18.847317] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xeefc70 is same w[2024-11-28 19:11:18.847316] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with ith the state(5) to be set 00:22:57.910 the state(5) to be set 00:22:57.910 [2024-11-28 19:11:18.847336] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.910 [2024-11-28 19:11:18.847349] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.910 [2024-11-28 19:11:18.847362] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.910 [2024-11-28 19:11:18.847373] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.910 [2024-11-28 19:11:18.847385] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.910 [2024-11-28 19:11:18.847404] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.910 [2024-11-28 19:11:18.847401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.910 [2024-11-28 19:11:18.847417] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.910 [2024-11-28 19:11:18.847425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.910 [2024-11-28 19:11:18.847429] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.910 [2024-11-28 19:11:18.847442] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.910 [2024-11-28 19:11:18.847445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.910 [2024-11-28 19:11:18.847453] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.910 [2024-11-28 19:11:18.847461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.910 [2024-11-28 19:11:18.847465] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.910 [2024-11-28 19:11:18.847477] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.910 [2024-11-28 19:11:18.847478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.910 [2024-11-28 19:11:18.847489] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.910 [2024-11-28 19:11:18.847493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.910 [2024-11-28 19:11:18.847501] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.910 [2024-11-28 19:11:18.847509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.910 [2024-11-28 19:11:18.847513] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.910 [2024-11-28 19:11:18.847523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 19:11:18.847525] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.910 the state(5) to be set 00:22:57.910 [2024-11-28 19:11:18.847538] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.910 [2024-11-28 19:11:18.847541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.910 [2024-11-28 19:11:18.847550] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with [2024-11-28 19:11:18.847555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:57.910 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.910 [2024-11-28 19:11:18.847569] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.910 [2024-11-28 19:11:18.847572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.910 [2024-11-28 19:11:18.847582] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.910 [2024-11-28 19:11:18.847586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.910 [2024-11-28 19:11:18.847594] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.910 [2024-11-28 19:11:18.847602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.910 [2024-11-28 19:11:18.847606] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.910 [2024-11-28 19:11:18.847616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 19:11:18.847618] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.910 the state(5) to be set 00:22:57.910 [2024-11-28 19:11:18.847631] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.910 [2024-11-28 19:11:18.847634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.910 [2024-11-28 19:11:18.847643] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.910 [2024-11-28 19:11:18.847648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.910 [2024-11-28 19:11:18.847654] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.910 [2024-11-28 19:11:18.847664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:40960 len:12[2024-11-28 19:11:18.847666] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.910 the state(5) to be set 00:22:57.910 [2024-11-28 19:11:18.847679] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with [2024-11-28 19:11:18.847679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:57.911 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.911 [2024-11-28 19:11:18.847693] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.911 [2024-11-28 19:11:18.847697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.911 [2024-11-28 19:11:18.847705] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.911 [2024-11-28 19:11:18.847712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.911 [2024-11-28 19:11:18.847717] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.911 [2024-11-28 19:11:18.847728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:41216 len:128[2024-11-28 19:11:18.847730] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.911 the state(5) to be set 00:22:57.911 [2024-11-28 19:11:18.847747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 19:11:18.847747] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.911 the state(5) to be set 00:22:57.911 [2024-11-28 19:11:18.847762] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.911 [2024-11-28 19:11:18.847764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.911 [2024-11-28 19:11:18.847774] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.911 [2024-11-28 19:11:18.847778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.911 [2024-11-28 19:11:18.847786] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.911 [2024-11-28 19:11:18.847794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.911 [2024-11-28 19:11:18.847798] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.911 [2024-11-28 19:11:18.847808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 19:11:18.847810] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.911 the state(5) to be set 00:22:57.911 [2024-11-28 19:11:18.847823] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.911 [2024-11-28 19:11:18.847825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.911 [2024-11-28 19:11:18.847835] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.911 [2024-11-28 19:11:18.847839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.911 [2024-11-28 19:11:18.847847] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.911 [2024-11-28 19:11:18.847854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.911 [2024-11-28 19:11:18.847859] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.911 [2024-11-28 19:11:18.847868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.911 [2024-11-28 19:11:18.847871] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.911 [2024-11-28 19:11:18.847883] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.911 [2024-11-28 19:11:18.847884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.911 [2024-11-28 19:11:18.847895] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.911 [2024-11-28 19:11:18.847899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.911 [2024-11-28 19:11:18.847907] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.911 [2024-11-28 19:11:18.847914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:36864 len:12[2024-11-28 19:11:18.847919] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.911 the state(5) to be set 00:22:57.911 [2024-11-28 19:11:18.847934] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with [2024-11-28 19:11:18.847935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:57.911 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.911 [2024-11-28 19:11:18.847948] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.911 [2024-11-28 19:11:18.847952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.911 [2024-11-28 19:11:18.847960] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.911 [2024-11-28 19:11:18.847966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.911 [2024-11-28 19:11:18.847972] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.911 [2024-11-28 19:11:18.847982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:37248 len:12[2024-11-28 19:11:18.847984] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.911 the state(5) to be set 00:22:57.911 [2024-11-28 19:11:18.847998] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with [2024-11-28 19:11:18.847998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:57.911 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.911 [2024-11-28 19:11:18.848012] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.911 [2024-11-28 19:11:18.848016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.911 [2024-11-28 19:11:18.848024] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.911 [2024-11-28 19:11:18.848030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.911 [2024-11-28 19:11:18.848037] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.911 [2024-11-28 19:11:18.848045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.911 [2024-11-28 19:11:18.848049] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.911 [2024-11-28 19:11:18.848059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 19:11:18.848061] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.911 the state(5) to be set 00:22:57.911 [2024-11-28 19:11:18.848074] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.911 [2024-11-28 19:11:18.848077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.911 [2024-11-28 19:11:18.848086] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.911 [2024-11-28 19:11:18.848090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.911 [2024-11-28 19:11:18.848098] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2212350 is same with the state(5) to be set 00:22:57.911 [2024-11-28 19:11:18.848106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.911 [2024-11-28 19:11:18.848120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.911 [2024-11-28 19:11:18.848135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.911 [2024-11-28 19:11:18.848152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.911 [2024-11-28 19:11:18.848177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.911 [2024-11-28 19:11:18.848193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.911 [2024-11-28 19:11:18.848208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.911 [2024-11-28 19:11:18.848222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.911 [2024-11-28 19:11:18.848238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.911 [2024-11-28 19:11:18.848253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.911 [2024-11-28 19:11:18.848268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.911 [2024-11-28 19:11:18.848282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.912 [2024-11-28 19:11:18.848297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.912 [2024-11-28 19:11:18.848311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.912 [2024-11-28 19:11:18.848326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.912 [2024-11-28 19:11:18.848340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.912 [2024-11-28 19:11:18.848355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.912 [2024-11-28 19:11:18.848369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.912 [2024-11-28 19:11:18.848385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.912 [2024-11-28 19:11:18.848407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.912 [2024-11-28 19:11:18.848424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.912 [2024-11-28 19:11:18.848440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.912 [2024-11-28 19:11:18.848455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.912 [2024-11-28 19:11:18.848470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.912 [2024-11-28 19:11:18.848485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.912 [2024-11-28 19:11:18.848504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.912 [2024-11-28 19:11:18.848520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.912 [2024-11-28 19:11:18.848534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.912 [2024-11-28 19:11:18.848549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.912 [2024-11-28 19:11:18.848563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.912 [2024-11-28 19:11:18.848578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.912 [2024-11-28 19:11:18.848591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.912 [2024-11-28 19:11:18.848606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.912 [2024-11-28 19:11:18.848621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.912 [2024-11-28 19:11:18.848636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.912 [2024-11-28 19:11:18.848650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.912 [2024-11-28 19:11:18.848665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.912 [2024-11-28 19:11:18.848678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.912 [2024-11-28 19:11:18.848694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.912 [2024-11-28 19:11:18.848708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.912 [2024-11-28 19:11:18.848723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.912 [2024-11-28 19:11:18.848737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.912 [2024-11-28 19:11:18.848752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.912 [2024-11-28 19:11:18.848766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.912 [2024-11-28 19:11:18.848781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.912 [2024-11-28 19:11:18.848795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.912 [2024-11-28 19:11:18.848801] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with [2024-11-28 19:11:18.848810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:43008 len:1the state(5) to be set 00:22:57.912 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.912 [2024-11-28 19:11:18.848828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.912 [2024-11-28 19:11:18.848830] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.912 [2024-11-28 19:11:18.848844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.912 [2024-11-28 19:11:18.848850] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.912 [2024-11-28 19:11:18.848859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.912 [2024-11-28 19:11:18.848863] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.912 [2024-11-28 19:11:18.848874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:43264 len:1[2024-11-28 19:11:18.848876] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.912 the state(5) to be set 00:22:57.912 [2024-11-28 19:11:18.848891] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with [2024-11-28 19:11:18.848891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:22:57.912 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.912 [2024-11-28 19:11:18.848906] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.912 [2024-11-28 19:11:18.848910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.912 [2024-11-28 19:11:18.848918] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.912 [2024-11-28 19:11:18.848924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.912 [2024-11-28 19:11:18.848931] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.912 [2024-11-28 19:11:18.848940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.912 [2024-11-28 19:11:18.848943] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.912 [2024-11-28 19:11:18.848954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 19:11:18.848956] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.912 the state(5) to be set 00:22:57.912 [2024-11-28 19:11:18.848970] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.912 [2024-11-28 19:11:18.848972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.912 [2024-11-28 19:11:18.848981] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.912 [2024-11-28 19:11:18.848992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 19:11:18.848994] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.912 the state(5) to be set 00:22:57.912 [2024-11-28 19:11:18.849007] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.912 [2024-11-28 19:11:18.849010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.912 [2024-11-28 19:11:18.849019] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.912 [2024-11-28 19:11:18.849025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.912 [2024-11-28 19:11:18.849031] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.912 [2024-11-28 19:11:18.849043] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.912 [2024-11-28 19:11:18.849044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.912 [2024-11-28 19:11:18.849056] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.912 [2024-11-28 19:11:18.849060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.912 [2024-11-28 19:11:18.849068] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.912 [2024-11-28 19:11:18.849076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.912 [2024-11-28 19:11:18.849081] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.912 [2024-11-28 19:11:18.849090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.912 [2024-11-28 19:11:18.849093] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.912 [2024-11-28 19:11:18.849105] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.912 [2024-11-28 19:11:18.849106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.912 [2024-11-28 19:11:18.849117] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.912 [2024-11-28 19:11:18.849121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.912 [2024-11-28 19:11:18.849130] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.912 [2024-11-28 19:11:18.849136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.912 [2024-11-28 19:11:18.849142] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.849150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.913 [2024-11-28 19:11:18.849154] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.849166] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with [2024-11-28 19:11:18.849166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:44416 len:1the state(5) to be set 00:22:57.913 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.913 [2024-11-28 19:11:18.849180] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.849182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.913 [2024-11-28 19:11:18.849192] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.849199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.913 [2024-11-28 19:11:18.849205] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.849213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 19:11:18.849217] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.913 the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.849231] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.849234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.913 [2024-11-28 19:11:18.849249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 19:11:18.849249] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.913 the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.849264] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.849267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.913 [2024-11-28 19:11:18.849277] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.849281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.913 [2024-11-28 19:11:18.849290] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.849297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.913 [2024-11-28 19:11:18.849302] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.849311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.913 [2024-11-28 19:11:18.849314] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.849326] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.849327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.913 [2024-11-28 19:11:18.849339] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.849342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.913 [2024-11-28 19:11:18.849351] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.849358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.913 [2024-11-28 19:11:18.849363] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.849373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.913 [2024-11-28 19:11:18.849375] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.849388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:45312 len:12[2024-11-28 19:11:18.849388] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.913 the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.849412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-28 19:11:18.849413] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.913 the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.849431] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.849433] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf7e260 is same with the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.849443] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.849455] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.849466] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.849478] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.849490] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.849498] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xf7e260 was disconnected and fre[2024-11-28 19:11:18.849502] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with ed. reset controller. 00:22:57.913 the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.849516] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.849528] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.849539] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.849551] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.849563] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.849574] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.849585] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.849597] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.849609] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.849620] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x22127e0 is same with the state(5) to be set 00:22:57.913 [2024-11-28 19:11:18.851488] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:57.913 [2024-11-28 19:11:18.851653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.913 [2024-11-28 19:11:18.851676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.913 [2024-11-28 19:11:18.851701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.913 [2024-11-28 19:11:18.851729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.913 [2024-11-28 19:11:18.851759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.913 [2024-11-28 19:11:18.851785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.913 [2024-11-28 19:11:18.851819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.913 [2024-11-28 19:11:18.851835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.913 [2024-11-28 19:11:18.851851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.913 [2024-11-28 19:11:18.851864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.913 [2024-11-28 19:11:18.851880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.913 [2024-11-28 19:11:18.851894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.913 [2024-11-28 19:11:18.851909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.913 [2024-11-28 19:11:18.851923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.913 [2024-11-28 19:11:18.851939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.913 [2024-11-28 19:11:18.851953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.913 [2024-11-28 19:11:18.851968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.913 [2024-11-28 19:11:18.851982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.913 [2024-11-28 19:11:18.851997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.913 [2024-11-28 19:11:18.852011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.913 [2024-11-28 19:11:18.852027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.913 [2024-11-28 19:11:18.852040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.913 [2024-11-28 19:11:18.852055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.913 [2024-11-28 19:11:18.852069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.913 [2024-11-28 19:11:18.852085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.852098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.852113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.852127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.852143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.852157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.852172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.852189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.852205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.852220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.852235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.852249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.852264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.852278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.852294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.852308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.852323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.852337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.852353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.852366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.852382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.852405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.852423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.852444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.852459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.852473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.852489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.852503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.852519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.852533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.852549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.852562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.852582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.852596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.852612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.852626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.852641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.852655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.852671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.852684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.852700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.852714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.852729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.852742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.852757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.852771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.852786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.852800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.852815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.852829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.852844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.852858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.852873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.852887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.852902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.852917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.852932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.852950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.852966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.852980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.852996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.853010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.853025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.853039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.853054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.853068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.853083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.853097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.853112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.853126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.853141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.853155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.853171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.853185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.853200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.853214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.853230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.914 [2024-11-28 19:11:18.853244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.914 [2024-11-28 19:11:18.853259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.915 [2024-11-28 19:11:18.853272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.915 [2024-11-28 19:11:18.853288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.915 [2024-11-28 19:11:18.853302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.915 [2024-11-28 19:11:18.853323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.915 [2024-11-28 19:11:18.853338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.915 [2024-11-28 19:11:18.853353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.915 [2024-11-28 19:11:18.853367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.915 [2024-11-28 19:11:18.853383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.915 [2024-11-28 19:11:18.853404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.915 [2024-11-28 19:11:18.853421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.915 [2024-11-28 19:11:18.853435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.915 [2024-11-28 19:11:18.853450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.915 [2024-11-28 19:11:18.853464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.915 [2024-11-28 19:11:18.853479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.915 [2024-11-28 19:11:18.853494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.915 [2024-11-28 19:11:18.853509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.915 [2024-11-28 19:11:18.853523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.915 [2024-11-28 19:11:18.853537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.915 [2024-11-28 19:11:18.853551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.915 [2024-11-28 19:11:18.853567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.915 [2024-11-28 19:11:18.853581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.915 [2024-11-28 19:11:18.853596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.915 [2024-11-28 19:11:18.853610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.915 [2024-11-28 19:11:18.853625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.915 [2024-11-28 19:11:18.853639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.915 [2024-11-28 19:11:18.853731] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xf89950 was disconnected and freed. reset controller. 00:22:57.915 [2024-11-28 19:11:18.854263] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:57.915 [2024-11-28 19:11:18.854432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:57.915 [2024-11-28 19:11:18.854529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:57.915 [2024-11-28 19:11:18.854559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd92590 with addr=10.0.0.2, port=4420 00:22:57.915 [2024-11-28 19:11:18.854576] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd92590 is same with the state(5) to be set 00:22:57.915 [2024-11-28 19:11:18.856098] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:22:57.915 [2024-11-28 19:11:18.856133] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xef0150 (9): Bad file descriptor 00:22:57.915 [2024-11-28 19:11:18.856227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:57.915 [2024-11-28 19:11:18.856319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:57.915 [2024-11-28 19:11:18.856343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd39f70 with addr=10.0.0.2, port=4420 00:22:57.915 [2024-11-28 19:11:18.856358] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd39f70 is same with the state(5) to be set 00:22:57.915 [2024-11-28 19:11:18.856377] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd92590 (9): Bad file descriptor 00:22:57.915 [2024-11-28 19:11:18.856744] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:57.915 [2024-11-28 19:11:18.856813] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:57.915 [2024-11-28 19:11:18.856911] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:57.915 [2024-11-28 19:11:18.857989] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd39f70 (9): Bad file descriptor 00:22:57.915 [2024-11-28 19:11:18.858016] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:57.915 [2024-11-28 19:11:18.858030] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:57.915 [2024-11-28 19:11:18.858046] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:57.915 [2024-11-28 19:11:18.858075] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xeeaa60 (9): Bad file descriptor 00:22:57.915 [2024-11-28 19:11:18.858110] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xedb0a0 (9): Bad file descriptor 00:22:57.915 [2024-11-28 19:11:18.858141] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd65690 (9): Bad file descriptor 00:22:57.915 [2024-11-28 19:11:18.858182] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd5c1b0 (9): Bad file descriptor 00:22:57.915 [2024-11-28 19:11:18.858214] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xeefc70 (9): Bad file descriptor 00:22:57.915 [2024-11-28 19:11:18.858272] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.915 [2024-11-28 19:11:18.858299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.915 [2024-11-28 19:11:18.858318] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.915 [2024-11-28 19:11:18.858332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.915 [2024-11-28 19:11:18.858346] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.915 [2024-11-28 19:11:18.858359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.915 [2024-11-28 19:11:18.858373] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:22:57.915 [2024-11-28 19:11:18.858386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.915 [2024-11-28 19:11:18.858418] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd87490 is same with the state(5) to be set 00:22:57.915 [2024-11-28 19:11:18.858855] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:57.915 [2024-11-28 19:11:18.858972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.915 [2024-11-28 19:11:18.858995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.915 [2024-11-28 19:11:18.859017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.915 [2024-11-28 19:11:18.859033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.915 [2024-11-28 19:11:18.859051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.915 [2024-11-28 19:11:18.859065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.915 [2024-11-28 19:11:18.859081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.915 [2024-11-28 19:11:18.859096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.915 [2024-11-28 19:11:18.859111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.915 [2024-11-28 19:11:18.859125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.915 [2024-11-28 19:11:18.859141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.915 [2024-11-28 19:11:18.859155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.915 [2024-11-28 19:11:18.859170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.915 [2024-11-28 19:11:18.859184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.916 [2024-11-28 19:11:18.859199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.916 [2024-11-28 19:11:18.859214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.916 [2024-11-28 19:11:18.859230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.916 [2024-11-28 19:11:18.859243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.916 [2024-11-28 19:11:18.859259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.916 [2024-11-28 19:11:18.859273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.916 [2024-11-28 19:11:18.859289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.916 [2024-11-28 19:11:18.859303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.916 [2024-11-28 19:11:18.859318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.916 [2024-11-28 19:11:18.859338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.916 [2024-11-28 19:11:18.859354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.916 [2024-11-28 19:11:18.859369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.916 [2024-11-28 19:11:18.859385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.916 [2024-11-28 19:11:18.859408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.916 [2024-11-28 19:11:18.859425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.916 [2024-11-28 19:11:18.859450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.916 [2024-11-28 19:11:18.859466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.916 [2024-11-28 19:11:18.859481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.916 [2024-11-28 19:11:18.859496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.916 [2024-11-28 19:11:18.859510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.916 [2024-11-28 19:11:18.859526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.916 [2024-11-28 19:11:18.859539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.916 [2024-11-28 19:11:18.859555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.916 [2024-11-28 19:11:18.859569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.916 [2024-11-28 19:11:18.859584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.916 [2024-11-28 19:11:18.859598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.916 [2024-11-28 19:11:18.859613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.916 [2024-11-28 19:11:18.859627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.916 [2024-11-28 19:11:18.859642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.916 [2024-11-28 19:11:18.859657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.916 [2024-11-28 19:11:18.859672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.916 [2024-11-28 19:11:18.859687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.916 [2024-11-28 19:11:18.859703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.916 [2024-11-28 19:11:18.859717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.916 [2024-11-28 19:11:18.859737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.916 [2024-11-28 19:11:18.859751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.916 [2024-11-28 19:11:18.859767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.916 [2024-11-28 19:11:18.859781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.916 [2024-11-28 19:11:18.859797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.916 [2024-11-28 19:11:18.859811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.916 [2024-11-28 19:11:18.859825] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8d9c0 is same with the state(5) to be set 00:22:57.916 [2024-11-28 19:11:18.859906] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xf8d9c0 was disconnected and freed. reset controller. 00:22:57.916 [2024-11-28 19:11:18.860002] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:57.916 [2024-11-28 19:11:18.860123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:57.916 [2024-11-28 19:11:18.860213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:57.916 [2024-11-28 19:11:18.860238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xef0150 with addr=10.0.0.2, port=4420 00:22:57.916 [2024-11-28 19:11:18.860255] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xef0150 is same with the state(5) to be set 00:22:57.916 [2024-11-28 19:11:18.860270] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:57.916 [2024-11-28 19:11:18.860284] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:57.916 [2024-11-28 19:11:18.860297] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:57.916 [2024-11-28 19:11:18.860360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.916 [2024-11-28 19:11:18.860382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.916 [2024-11-28 19:11:18.860412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.916 [2024-11-28 19:11:18.860430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.916 [2024-11-28 19:11:18.860456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.916 [2024-11-28 19:11:18.860470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.916 [2024-11-28 19:11:18.860486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.916 [2024-11-28 19:11:18.860500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.916 [2024-11-28 19:11:18.860515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.916 [2024-11-28 19:11:18.860530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.916 [2024-11-28 19:11:18.860546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.916 [2024-11-28 19:11:18.860565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.916 [2024-11-28 19:11:18.860582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.916 [2024-11-28 19:11:18.860597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.916 [2024-11-28 19:11:18.860612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.916 [2024-11-28 19:11:18.860626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.916 [2024-11-28 19:11:18.860642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.916 [2024-11-28 19:11:18.860656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.916 [2024-11-28 19:11:18.860672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.916 [2024-11-28 19:11:18.860686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.916 [2024-11-28 19:11:18.860704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.916 [2024-11-28 19:11:18.860719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.916 [2024-11-28 19:11:18.860734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.916 [2024-11-28 19:11:18.860748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.916 [2024-11-28 19:11:18.860764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.916 [2024-11-28 19:11:18.860778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.916 [2024-11-28 19:11:18.860793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.916 [2024-11-28 19:11:18.860808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.916 [2024-11-28 19:11:18.860824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.916 [2024-11-28 19:11:18.860838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.916 [2024-11-28 19:11:18.860853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.860867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.860883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.860896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.860912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.860926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.860946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.860960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.860975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.860990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.861005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.861019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.861034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.861048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.861064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.861078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.861093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.861106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.861122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.861136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.861151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.861165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.861180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.861194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.861209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.861224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.861239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.861253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.861267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.861282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.861298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.861316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.861332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.861346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.861362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.861376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.861399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.861415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.861431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.861454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.861470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.861484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.861500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.861514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.861529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.861543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.861558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.861572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.861588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.861601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.861617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.861631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.861646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.861660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.861675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.861688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.861718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.861733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.861748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.861762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.861777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.861792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.861807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.861822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.861837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.861851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.861866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.861881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.861896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.861910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.861925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.861939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.861955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.861969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.861984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.861997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.862013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.862027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.917 [2024-11-28 19:11:18.862043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.917 [2024-11-28 19:11:18.862056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.918 [2024-11-28 19:11:18.862072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.918 [2024-11-28 19:11:18.862089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.918 [2024-11-28 19:11:18.862105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.918 [2024-11-28 19:11:18.862120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.918 [2024-11-28 19:11:18.862135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.918 [2024-11-28 19:11:18.862149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.918 [2024-11-28 19:11:18.862164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.918 [2024-11-28 19:11:18.862178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.918 [2024-11-28 19:11:18.862193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.918 [2024-11-28 19:11:18.862207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.918 [2024-11-28 19:11:18.862222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.918 [2024-11-28 19:11:18.862236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.918 [2024-11-28 19:11:18.862252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.918 [2024-11-28 19:11:18.862266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.918 [2024-11-28 19:11:18.862281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.918 [2024-11-28 19:11:18.862295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.918 [2024-11-28 19:11:18.862310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.918 [2024-11-28 19:11:18.862324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.918 [2024-11-28 19:11:18.862339] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd2a550 is same with the state(5) to be set 00:22:57.918 [2024-11-28 19:11:18.864618] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:22:57.918 [2024-11-28 19:11:18.864654] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:57.918 [2024-11-28 19:11:18.864673] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:57.918 [2024-11-28 19:11:18.864697] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:22:57.918 [2024-11-28 19:11:18.864746] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xef0150 (9): Bad file descriptor 00:22:57.918 [2024-11-28 19:11:18.864986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:57.918 [2024-11-28 19:11:18.865079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:57.918 [2024-11-28 19:11:18.865104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf00600 with addr=10.0.0.2, port=4420 00:22:57.918 [2024-11-28 19:11:18.865122] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf00600 is same with the state(5) to be set 00:22:57.918 [2024-11-28 19:11:18.865208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:57.918 [2024-11-28 19:11:18.865290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:57.918 [2024-11-28 19:11:18.865313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xeefc70 with addr=10.0.0.2, port=4420 00:22:57.918 [2024-11-28 19:11:18.865329] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xeefc70 is same with the state(5) to be set 00:22:57.918 [2024-11-28 19:11:18.865344] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:22:57.918 [2024-11-28 19:11:18.865356] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:22:57.918 [2024-11-28 19:11:18.865371] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:22:57.918 [2024-11-28 19:11:18.865972] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:57.918 [2024-11-28 19:11:18.865998] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:57.918 [2024-11-28 19:11:18.866015] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:57.918 [2024-11-28 19:11:18.866047] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf00600 (9): Bad file descriptor 00:22:57.918 [2024-11-28 19:11:18.866069] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xeefc70 (9): Bad file descriptor 00:22:57.918 [2024-11-28 19:11:18.866209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:57.918 [2024-11-28 19:11:18.866315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:57.918 [2024-11-28 19:11:18.866339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd92590 with addr=10.0.0.2, port=4420 00:22:57.918 [2024-11-28 19:11:18.866354] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd92590 is same with the state(5) to be set 00:22:57.918 [2024-11-28 19:11:18.866458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:57.918 [2024-11-28 19:11:18.866535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:57.918 [2024-11-28 19:11:18.866558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd39f70 with addr=10.0.0.2, port=4420 00:22:57.918 [2024-11-28 19:11:18.866574] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd39f70 is same with the state(5) to be set 00:22:57.918 [2024-11-28 19:11:18.866588] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:57.918 [2024-11-28 19:11:18.866600] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:57.918 [2024-11-28 19:11:18.866613] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:57.918 [2024-11-28 19:11:18.866633] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:22:57.918 [2024-11-28 19:11:18.866647] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:22:57.918 [2024-11-28 19:11:18.866660] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:22:57.918 [2024-11-28 19:11:18.866724] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:57.918 [2024-11-28 19:11:18.866743] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:57.918 [2024-11-28 19:11:18.866760] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd92590 (9): Bad file descriptor 00:22:57.918 [2024-11-28 19:11:18.866777] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd39f70 (9): Bad file descriptor 00:22:57.918 [2024-11-28 19:11:18.866823] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:57.918 [2024-11-28 19:11:18.866844] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:57.918 [2024-11-28 19:11:18.866858] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:57.918 [2024-11-28 19:11:18.866876] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:57.918 [2024-11-28 19:11:18.866890] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:57.918 [2024-11-28 19:11:18.866902] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:57.918 [2024-11-28 19:11:18.866950] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:57.918 [2024-11-28 19:11:18.866967] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:57.918 [2024-11-28 19:11:18.868028] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd87490 (9): Bad file descriptor 00:22:57.918 [2024-11-28 19:11:18.868160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.918 [2024-11-28 19:11:18.868185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.918 [2024-11-28 19:11:18.868209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.918 [2024-11-28 19:11:18.868224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.918 [2024-11-28 19:11:18.868240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.918 [2024-11-28 19:11:18.868255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.918 [2024-11-28 19:11:18.868270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.918 [2024-11-28 19:11:18.868284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.918 [2024-11-28 19:11:18.868299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.918 [2024-11-28 19:11:18.868313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.918 [2024-11-28 19:11:18.868329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.918 [2024-11-28 19:11:18.868343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.918 [2024-11-28 19:11:18.868358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.918 [2024-11-28 19:11:18.868371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.918 [2024-11-28 19:11:18.868386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.918 [2024-11-28 19:11:18.868409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.918 [2024-11-28 19:11:18.868426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.918 [2024-11-28 19:11:18.868440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.918 [2024-11-28 19:11:18.868455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.918 [2024-11-28 19:11:18.868474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.868490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.868505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.868521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.868535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.868550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.868563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.868579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.868592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.868608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.868621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.868636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.868650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.868666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.868679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.868703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.868716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.868731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.868745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.868760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.868774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.868789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.868802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.868818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.868832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.868851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.868865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.868880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.868893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.868909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.868922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.868938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.868951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.868966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.868980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.868996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.869009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.869025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.869038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.869054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.869068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.869083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.869097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.869113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.869126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.869142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.869156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.869172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.869187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.869202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.869220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.869236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.869250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.869265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.869279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.869295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.869309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.869325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.869339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.869354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.869368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.869383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.869403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.869421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.869445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.869460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.869474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.869490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.869504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.869520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.869534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.869550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.869563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.869578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.869592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.869616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.869631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.869647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.869660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.919 [2024-11-28 19:11:18.869676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.919 [2024-11-28 19:11:18.869698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.920 [2024-11-28 19:11:18.869714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.920 [2024-11-28 19:11:18.869728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.920 [2024-11-28 19:11:18.869743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.920 [2024-11-28 19:11:18.869756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.920 [2024-11-28 19:11:18.869772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.920 [2024-11-28 19:11:18.869786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.920 [2024-11-28 19:11:18.869801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.920 [2024-11-28 19:11:18.869816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.920 [2024-11-28 19:11:18.869831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.920 [2024-11-28 19:11:18.869845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.920 [2024-11-28 19:11:18.869860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.920 [2024-11-28 19:11:18.869875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.920 [2024-11-28 19:11:18.869890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.920 [2024-11-28 19:11:18.869904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.920 [2024-11-28 19:11:18.869919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.920 [2024-11-28 19:11:18.869933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.920 [2024-11-28 19:11:18.869949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.920 [2024-11-28 19:11:18.869963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.920 [2024-11-28 19:11:18.869979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.920 [2024-11-28 19:11:18.869996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.920 [2024-11-28 19:11:18.870013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.920 [2024-11-28 19:11:18.870028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.920 [2024-11-28 19:11:18.870043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.920 [2024-11-28 19:11:18.870057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.920 [2024-11-28 19:11:18.870072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.920 [2024-11-28 19:11:18.870086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.920 [2024-11-28 19:11:18.870101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.920 [2024-11-28 19:11:18.870115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.920 [2024-11-28 19:11:18.870129] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec61a0 is same with the state(5) to be set 00:22:57.920 [2024-11-28 19:11:18.871377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.920 [2024-11-28 19:11:18.871409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.920 [2024-11-28 19:11:18.871431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.920 [2024-11-28 19:11:18.871447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.920 [2024-11-28 19:11:18.871463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.920 [2024-11-28 19:11:18.871477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.920 [2024-11-28 19:11:18.871493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.920 [2024-11-28 19:11:18.871506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.920 [2024-11-28 19:11:18.871522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.920 [2024-11-28 19:11:18.871535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.920 [2024-11-28 19:11:18.871551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.920 [2024-11-28 19:11:18.871565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.920 [2024-11-28 19:11:18.871581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.920 [2024-11-28 19:11:18.871594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.920 [2024-11-28 19:11:18.871609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.920 [2024-11-28 19:11:18.871628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.920 [2024-11-28 19:11:18.871644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.920 [2024-11-28 19:11:18.871658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.920 [2024-11-28 19:11:18.871674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.920 [2024-11-28 19:11:18.871687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.920 [2024-11-28 19:11:18.871704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.920 [2024-11-28 19:11:18.871717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.920 [2024-11-28 19:11:18.871733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.920 [2024-11-28 19:11:18.871746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.920 [2024-11-28 19:11:18.871761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.920 [2024-11-28 19:11:18.871774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.920 [2024-11-28 19:11:18.871790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.920 [2024-11-28 19:11:18.871804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.920 [2024-11-28 19:11:18.871819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.920 [2024-11-28 19:11:18.871833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.920 [2024-11-28 19:11:18.871847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.920 [2024-11-28 19:11:18.871861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.920 [2024-11-28 19:11:18.871876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.920 [2024-11-28 19:11:18.871890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.920 [2024-11-28 19:11:18.871905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.920 [2024-11-28 19:11:18.871919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.920 [2024-11-28 19:11:18.871934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.920 [2024-11-28 19:11:18.871948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.871964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.871978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.871997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.872012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.872027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.872041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.872057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.872071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.872086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.872100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.872116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.872130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.872146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.872160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.872175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.872189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.872205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.872219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.872234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.872248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.872264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.872278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.872294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.872307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.872323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.872337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.872353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.872370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.872386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.872410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.872427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.872441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.872456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.872470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.872487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.872501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.872517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.872531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.872547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.872562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.872578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.872591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.872607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.872621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.872637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.872651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.872666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.872680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.872695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.872709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.872726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.872740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.872760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.872775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.872790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.872805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.872821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.872834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.872860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.872873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.872889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.872903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.872919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.872933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.872948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.872962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.872978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.872992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.873008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.873022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.873038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.873052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.873068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.873082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.873098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.873112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.873127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.921 [2024-11-28 19:11:18.873145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.921 [2024-11-28 19:11:18.873161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.873176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.873191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.873205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.873221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.873235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.873250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.873264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.873279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.873294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.873310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.873324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.873338] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xec76f0 is same with the state(5) to be set 00:22:57.922 [2024-11-28 19:11:18.874572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.874595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.874615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.874631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.874649] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.874664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.874691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.874705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.874720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.874733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.874749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.874769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.874787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.874801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.874822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.874836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.874851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.874865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.874880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.874906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.874921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.874935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.874980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.874994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.875010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.875024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.875039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.875053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.875068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.875082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.875098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.875112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.875127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.875142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.875157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.875170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.875190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.875205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.875220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.875240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.875255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.875269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.875284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.875305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.875320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.875334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.875350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.875364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.875379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.875398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.875416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.875435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.875450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.875463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.875478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.875492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.875509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.875523] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.875539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.875552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.875568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.875586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.875602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.875616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.875630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.875644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.922 [2024-11-28 19:11:18.875659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.922 [2024-11-28 19:11:18.875674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.875697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.875710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.875725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.875739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.875754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.875768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.875783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.875796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.875811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.875825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.875842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.875856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.875871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.875885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.875900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.875915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.875930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.875945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.875960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.875978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.875994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.876009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.876024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.876038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.876054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.876069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.876084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.876098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.876114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.876128] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.876144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.876160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.876175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.876190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.876206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.876221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.876236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.876250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.876265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.876279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.876299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.876313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.876329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.876345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.876361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.876374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.876390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.876419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.876435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.876457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.876472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.876486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.876501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.876515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.876530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.876544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.876560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.876574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.876589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.876603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.876617] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8ae00 is same with the state(5) to be set 00:22:57.923 [2024-11-28 19:11:18.877863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.877887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.877906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.877922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.877938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.877952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.877968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.877982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.878003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.878018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.878034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.878047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.878063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.878076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.878093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.878107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.878122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.923 [2024-11-28 19:11:18.878136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.923 [2024-11-28 19:11:18.878151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.924 [2024-11-28 19:11:18.878165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.924 [2024-11-28 19:11:18.878181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.924 [2024-11-28 19:11:18.878194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.924 [2024-11-28 19:11:18.878210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.924 [2024-11-28 19:11:18.878223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.924 [2024-11-28 19:11:18.878239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.924 [2024-11-28 19:11:18.878253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.924 [2024-11-28 19:11:18.878268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.924 [2024-11-28 19:11:18.878282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.924 [2024-11-28 19:11:18.878297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.924 [2024-11-28 19:11:18.878311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.924 [2024-11-28 19:11:18.878327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.924 [2024-11-28 19:11:18.878340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.924 [2024-11-28 19:11:18.878355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.924 [2024-11-28 19:11:18.878372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.924 [2024-11-28 19:11:18.878388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.924 [2024-11-28 19:11:18.878411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.924 [2024-11-28 19:11:18.878427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.924 [2024-11-28 19:11:18.878450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.924 [2024-11-28 19:11:18.878465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.924 [2024-11-28 19:11:18.878478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.924 [2024-11-28 19:11:18.878494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.924 [2024-11-28 19:11:18.878508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.924 [2024-11-28 19:11:18.878524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.924 [2024-11-28 19:11:18.878537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.924 [2024-11-28 19:11:18.878553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.924 [2024-11-28 19:11:18.878567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.924 [2024-11-28 19:11:18.878582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.924 [2024-11-28 19:11:18.878596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.924 [2024-11-28 19:11:18.878611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.924 [2024-11-28 19:11:18.878624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.924 [2024-11-28 19:11:18.878639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.924 [2024-11-28 19:11:18.878653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.924 [2024-11-28 19:11:18.878669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.924 [2024-11-28 19:11:18.878682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.924 [2024-11-28 19:11:18.878698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.924 [2024-11-28 19:11:18.878712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.924 [2024-11-28 19:11:18.878728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.924 [2024-11-28 19:11:18.878741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.924 [2024-11-28 19:11:18.878760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.924 [2024-11-28 19:11:18.878775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.924 [2024-11-28 19:11:18.878790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.924 [2024-11-28 19:11:18.878804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.924 [2024-11-28 19:11:18.878819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.924 [2024-11-28 19:11:18.878833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.924 [2024-11-28 19:11:18.878849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.924 [2024-11-28 19:11:18.878862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.924 [2024-11-28 19:11:18.878878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.924 [2024-11-28 19:11:18.878892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.924 [2024-11-28 19:11:18.878907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.924 [2024-11-28 19:11:18.878921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.924 [2024-11-28 19:11:18.878936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.924 [2024-11-28 19:11:18.878950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.924 [2024-11-28 19:11:18.878965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.924 [2024-11-28 19:11:18.878979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.924 [2024-11-28 19:11:18.878995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.924 [2024-11-28 19:11:18.879008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.924 [2024-11-28 19:11:18.879023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.924 [2024-11-28 19:11:18.879037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.924 [2024-11-28 19:11:18.879052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.924 [2024-11-28 19:11:18.879066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.924 [2024-11-28 19:11:18.879081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.924 [2024-11-28 19:11:18.879094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.924 [2024-11-28 19:11:18.879110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.924 [2024-11-28 19:11:18.879131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.924 [2024-11-28 19:11:18.879148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.924 [2024-11-28 19:11:18.879162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.924 [2024-11-28 19:11:18.879177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.924 [2024-11-28 19:11:18.879190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.924 [2024-11-28 19:11:18.879206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.925 [2024-11-28 19:11:18.879220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.925 [2024-11-28 19:11:18.879235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.925 [2024-11-28 19:11:18.879248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.925 [2024-11-28 19:11:18.879263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.925 [2024-11-28 19:11:18.879278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.925 [2024-11-28 19:11:18.879293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.925 [2024-11-28 19:11:18.879307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.925 [2024-11-28 19:11:18.879322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.925 [2024-11-28 19:11:18.879336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.925 [2024-11-28 19:11:18.879351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.925 [2024-11-28 19:11:18.879365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.925 [2024-11-28 19:11:18.879380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.925 [2024-11-28 19:11:18.879399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.925 [2024-11-28 19:11:18.879416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.925 [2024-11-28 19:11:18.879430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.925 [2024-11-28 19:11:18.879450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.925 [2024-11-28 19:11:18.879464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.925 [2024-11-28 19:11:18.879479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.925 [2024-11-28 19:11:18.879493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.925 [2024-11-28 19:11:18.879512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.925 [2024-11-28 19:11:18.879527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.925 [2024-11-28 19:11:18.879542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.925 [2024-11-28 19:11:18.879556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.925 [2024-11-28 19:11:18.879571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.925 [2024-11-28 19:11:18.879585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.925 [2024-11-28 19:11:18.879600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.925 [2024-11-28 19:11:18.879613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.925 [2024-11-28 19:11:18.879628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.925 [2024-11-28 19:11:18.879642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.925 [2024-11-28 19:11:18.879657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.925 [2024-11-28 19:11:18.879671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.925 [2024-11-28 19:11:18.879686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.925 [2024-11-28 19:11:18.879699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.925 [2024-11-28 19:11:18.879714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.925 [2024-11-28 19:11:18.879728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.925 [2024-11-28 19:11:18.879743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.925 [2024-11-28 19:11:18.879757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.925 [2024-11-28 19:11:18.879772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.925 [2024-11-28 19:11:18.879785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.925 [2024-11-28 19:11:18.879799] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8c3e0 is same with the state(5) to be set 00:22:57.925 [2024-11-28 19:11:18.881018] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:22:57.925 [2024-11-28 19:11:18.881049] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:22:57.925 [2024-11-28 19:11:18.881068] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:22:57.925 [2024-11-28 19:11:18.881180] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:57.925 [2024-11-28 19:11:18.881219] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:57.925 [2024-11-28 19:11:18.881308] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:22:57.925 [2024-11-28 19:11:18.881333] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:22:57.925 [2024-11-28 19:11:18.881572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:57.925 [2024-11-28 19:11:18.881664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:57.925 [2024-11-28 19:11:18.881690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd5c1b0 with addr=10.0.0.2, port=4420 00:22:57.925 [2024-11-28 19:11:18.881716] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd5c1b0 is same with the state(5) to be set 00:22:57.925 [2024-11-28 19:11:18.881802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:57.925 [2024-11-28 19:11:18.881885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:57.925 [2024-11-28 19:11:18.881909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd65690 with addr=10.0.0.2, port=4420 00:22:57.925 [2024-11-28 19:11:18.881925] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd65690 is same with the state(5) to be set 00:22:57.925 [2024-11-28 19:11:18.882006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:57.925 [2024-11-28 19:11:18.882112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:57.925 [2024-11-28 19:11:18.882135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xedb0a0 with addr=10.0.0.2, port=4420 00:22:57.925 [2024-11-28 19:11:18.882150] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xedb0a0 is same with the state(5) to be set 00:22:57.925 [2024-11-28 19:11:18.883283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.925 [2024-11-28 19:11:18.883309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.925 [2024-11-28 19:11:18.883332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.925 [2024-11-28 19:11:18.883348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.925 [2024-11-28 19:11:18.883365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.925 [2024-11-28 19:11:18.883379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.925 [2024-11-28 19:11:18.883402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.925 [2024-11-28 19:11:18.883419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.925 [2024-11-28 19:11:18.883435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.925 [2024-11-28 19:11:18.883457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.925 [2024-11-28 19:11:18.883472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.925 [2024-11-28 19:11:18.883486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.925 [2024-11-28 19:11:18.883502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.925 [2024-11-28 19:11:18.883516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.925 [2024-11-28 19:11:18.883536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.925 [2024-11-28 19:11:18.883551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.925 [2024-11-28 19:11:18.883567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.925 [2024-11-28 19:11:18.883580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.925 [2024-11-28 19:11:18.883596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.925 [2024-11-28 19:11:18.883610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.925 [2024-11-28 19:11:18.883626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.925 [2024-11-28 19:11:18.883640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.925 [2024-11-28 19:11:18.883655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.925 [2024-11-28 19:11:18.883669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.883685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.883699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.883714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.883727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.883743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.883756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.883772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.883786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.883802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.883815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.883831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.883845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.883860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.883874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.883888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.883907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.883923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.883937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.883953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.883967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.883982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.883996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.884011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.884025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.884040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.884054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.884069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.884083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.884099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.884112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.884128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.884141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.884158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.884171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.884187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.884200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.884216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.884229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.884245] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.884259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.884279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.884293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.884309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.884324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.884339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.884353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.884369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.884383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.884410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.884427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.884443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.884458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.884473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.884486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.884501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.884516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.884531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.884545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.884560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.884574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.884590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.884603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.884619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.884633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.884648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.884666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.884682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.884696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.884711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.884725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.884740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.884755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.884770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.884784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.884800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.884814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.884829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.926 [2024-11-28 19:11:18.884843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.926 [2024-11-28 19:11:18.884859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.927 [2024-11-28 19:11:18.884873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.927 [2024-11-28 19:11:18.884889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.927 [2024-11-28 19:11:18.884903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.927 [2024-11-28 19:11:18.884919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.927 [2024-11-28 19:11:18.884944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.927 [2024-11-28 19:11:18.884959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.927 [2024-11-28 19:11:18.884973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.927 [2024-11-28 19:11:18.884989] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.927 [2024-11-28 19:11:18.885003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.927 [2024-11-28 19:11:18.885018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.927 [2024-11-28 19:11:18.885032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.927 [2024-11-28 19:11:18.885051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.927 [2024-11-28 19:11:18.885066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.927 [2024-11-28 19:11:18.885082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.927 [2024-11-28 19:11:18.885096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.927 [2024-11-28 19:11:18.885111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.927 [2024-11-28 19:11:18.885126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.927 [2024-11-28 19:11:18.885141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.927 [2024-11-28 19:11:18.885155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.927 [2024-11-28 19:11:18.885170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.927 [2024-11-28 19:11:18.885184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.927 [2024-11-28 19:11:18.885199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.927 [2024-11-28 19:11:18.885213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.927 [2024-11-28 19:11:18.885229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:22:57.927 [2024-11-28 19:11:18.885244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:22:57.927 [2024-11-28 19:11:18.885258] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf8efa0 is same with the state(5) to be set 00:22:57.927 [2024-11-28 19:11:18.886948] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:22:57.927 [2024-11-28 19:11:18.886980] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:22:57.927 [2024-11-28 19:11:18.887002] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:22:57.927 [2024-11-28 19:11:18.887019] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:22:57.927 task offset: 34816 on job bdev=Nvme10n1 fails 00:22:57.927 00:22:57.927 Latency(us) 00:22:57.927 [2024-11-28T18:11:18.975Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:22:57.927 [2024-11-28T18:11:18.975Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:57.927 [2024-11-28T18:11:18.975Z] Job: Nvme1n1 ended in about 0.84 seconds with error 00:22:57.927 Verification LBA range: start 0x0 length 0x400 00:22:57.927 Nvme1n1 : 0.84 345.33 21.58 75.95 0.00 150965.13 6213.78 153014.42 00:22:57.927 [2024-11-28T18:11:18.975Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:57.927 [2024-11-28T18:11:18.975Z] Job: Nvme2n1 ended in about 0.85 seconds with error 00:22:57.927 Verification LBA range: start 0x0 length 0x400 00:22:57.927 Nvme2n1 : 0.85 340.48 21.28 74.88 0.00 151782.06 77283.93 121945.51 00:22:57.927 [2024-11-28T18:11:18.975Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:57.927 [2024-11-28T18:11:18.975Z] Job: Nvme3n1 ended in about 0.86 seconds with error 00:22:57.927 Verification LBA range: start 0x0 length 0x400 00:22:57.927 Nvme3n1 : 0.86 337.42 21.09 74.21 0.00 151807.77 77672.30 121168.78 00:22:57.927 [2024-11-28T18:11:18.975Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:57.927 [2024-11-28T18:11:18.975Z] Job: Nvme4n1 ended in about 0.87 seconds with error 00:22:57.927 Verification LBA range: start 0x0 length 0x400 00:22:57.927 Nvme4n1 : 0.87 336.17 21.01 73.93 0.00 151056.75 71846.87 119615.34 00:22:57.927 [2024-11-28T18:11:18.975Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:57.927 [2024-11-28T18:11:18.975Z] Job: Nvme5n1 ended in about 0.85 seconds with error 00:22:57.927 Verification LBA range: start 0x0 length 0x400 00:22:57.927 Nvme5n1 : 0.85 343.54 21.47 75.56 0.00 146338.16 23301.69 137479.96 00:22:57.927 [2024-11-28T18:11:18.975Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:57.927 [2024-11-28T18:11:18.975Z] Job: Nvme6n1 ended in about 0.87 seconds with error 00:22:57.927 Verification LBA range: start 0x0 length 0x400 00:22:57.927 Nvme6n1 : 0.87 334.91 20.93 73.66 0.00 148949.76 66409.81 117285.17 00:22:57.927 [2024-11-28T18:11:18.975Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:57.927 [2024-11-28T18:11:18.975Z] Job: Nvme7n1 ended in about 0.87 seconds with error 00:22:57.927 Verification LBA range: start 0x0 length 0x400 00:22:57.927 Nvme7n1 : 0.87 333.69 20.86 73.39 0.00 148154.98 59419.31 116508.44 00:22:57.927 [2024-11-28T18:11:18.975Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:57.927 [2024-11-28T18:11:18.975Z] Job: Nvme8n1 ended in about 0.86 seconds with error 00:22:57.927 Verification LBA range: start 0x0 length 0x400 00:22:57.927 Nvme8n1 : 0.86 336.55 21.03 31.55 0.00 161406.81 6068.15 125829.12 00:22:57.927 [2024-11-28T18:11:18.975Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:57.927 [2024-11-28T18:11:18.975Z] Job: Nvme9n1 ended in about 0.88 seconds with error 00:22:57.927 Verification LBA range: start 0x0 length 0x400 00:22:57.927 Nvme9n1 : 0.88 286.03 17.88 72.93 0.00 165042.53 100197.26 126605.84 00:22:57.927 [2024-11-28T18:11:18.975Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:22:57.927 [2024-11-28T18:11:18.975Z] Job: Nvme10n1 ended in about 0.84 seconds with error 00:22:57.927 Verification LBA range: start 0x0 length 0x400 00:22:57.927 Nvme10n1 : 0.84 299.74 18.73 76.43 0.00 155440.76 90876.59 125829.12 00:22:57.927 [2024-11-28T18:11:18.975Z] =================================================================================================================== 00:22:57.927 [2024-11-28T18:11:18.975Z] Total : 3293.86 205.87 702.49 0.00 152830.84 6068.15 153014.42 00:22:57.927 [2024-11-28 19:11:18.913564] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:22:57.927 [2024-11-28 19:11:18.913651] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:22:57.927 [2024-11-28 19:11:18.913929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:57.927 [2024-11-28 19:11:18.914032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:57.927 [2024-11-28 19:11:18.914059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xeeaa60 with addr=10.0.0.2, port=4420 00:22:57.927 [2024-11-28 19:11:18.914079] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xeeaa60 is same with the state(5) to be set 00:22:57.927 [2024-11-28 19:11:18.914185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:57.927 [2024-11-28 19:11:18.914284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:57.927 [2024-11-28 19:11:18.914310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xef0150 with addr=10.0.0.2, port=4420 00:22:57.927 [2024-11-28 19:11:18.914327] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xef0150 is same with the state(5) to be set 00:22:57.927 [2024-11-28 19:11:18.914354] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd5c1b0 (9): Bad file descriptor 00:22:57.927 [2024-11-28 19:11:18.914376] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd65690 (9): Bad file descriptor 00:22:57.927 [2024-11-28 19:11:18.914402] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xedb0a0 (9): Bad file descriptor 00:22:57.927 [2024-11-28 19:11:18.914693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:57.927 [2024-11-28 19:11:18.914796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:57.927 [2024-11-28 19:11:18.914823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xeefc70 with addr=10.0.0.2, port=4420 00:22:57.927 [2024-11-28 19:11:18.914839] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xeefc70 is same with the state(5) to be set 00:22:57.927 [2024-11-28 19:11:18.914919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:57.927 [2024-11-28 19:11:18.915009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:57.927 [2024-11-28 19:11:18.915037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xf00600 with addr=10.0.0.2, port=4420 00:22:57.927 [2024-11-28 19:11:18.915053] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf00600 is same with the state(5) to be set 00:22:57.927 [2024-11-28 19:11:18.915128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:57.927 [2024-11-28 19:11:18.915213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:57.927 [2024-11-28 19:11:18.915237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd39f70 with addr=10.0.0.2, port=4420 00:22:57.927 [2024-11-28 19:11:18.915253] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd39f70 is same with the state(5) to be set 00:22:57.927 [2024-11-28 19:11:18.915319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:57.928 [2024-11-28 19:11:18.915408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:57.928 [2024-11-28 19:11:18.915440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd92590 with addr=10.0.0.2, port=4420 00:22:57.928 [2024-11-28 19:11:18.915455] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd92590 is same with the state(5) to be set 00:22:57.928 [2024-11-28 19:11:18.915530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:57.928 [2024-11-28 19:11:18.915606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:22:57.928 [2024-11-28 19:11:18.915631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0xd87490 with addr=10.0.0.2, port=4420 00:22:57.928 [2024-11-28 19:11:18.915646] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xd87490 is same with the state(5) to be set 00:22:57.928 [2024-11-28 19:11:18.915664] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xeeaa60 (9): Bad file descriptor 00:22:57.928 [2024-11-28 19:11:18.915682] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xef0150 (9): Bad file descriptor 00:22:57.928 [2024-11-28 19:11:18.915698] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:22:57.928 [2024-11-28 19:11:18.915719] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:22:57.928 [2024-11-28 19:11:18.915735] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:22:57.928 [2024-11-28 19:11:18.915754] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:22:57.928 [2024-11-28 19:11:18.915769] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:22:57.928 [2024-11-28 19:11:18.915781] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:22:57.928 [2024-11-28 19:11:18.915798] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:22:57.928 [2024-11-28 19:11:18.915811] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:22:57.928 [2024-11-28 19:11:18.915824] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:22:57.928 [2024-11-28 19:11:18.915867] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:57.928 [2024-11-28 19:11:18.915897] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:57.928 [2024-11-28 19:11:18.915916] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:57.928 [2024-11-28 19:11:18.915937] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:57.928 [2024-11-28 19:11:18.915956] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:22:57.928 [2024-11-28 19:11:18.916325] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:57.928 [2024-11-28 19:11:18.916349] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:57.928 [2024-11-28 19:11:18.916362] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:57.928 [2024-11-28 19:11:18.916378] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xeefc70 (9): Bad file descriptor 00:22:57.928 [2024-11-28 19:11:18.916405] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf00600 (9): Bad file descriptor 00:22:57.928 [2024-11-28 19:11:18.916426] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd39f70 (9): Bad file descriptor 00:22:57.928 [2024-11-28 19:11:18.916451] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd92590 (9): Bad file descriptor 00:22:57.928 [2024-11-28 19:11:18.916468] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd87490 (9): Bad file descriptor 00:22:57.928 [2024-11-28 19:11:18.916483] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:22:57.928 [2024-11-28 19:11:18.916496] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:22:57.928 [2024-11-28 19:11:18.916509] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:22:57.928 [2024-11-28 19:11:18.916527] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:22:57.928 [2024-11-28 19:11:18.916540] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:22:57.928 [2024-11-28 19:11:18.916553] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:22:57.928 [2024-11-28 19:11:18.916604] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:57.928 [2024-11-28 19:11:18.916622] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:57.928 [2024-11-28 19:11:18.916636] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:22:57.928 [2024-11-28 19:11:18.916648] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:22:57.928 [2024-11-28 19:11:18.916661] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:22:57.928 [2024-11-28 19:11:18.916677] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:22:57.928 [2024-11-28 19:11:18.916691] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:22:57.928 [2024-11-28 19:11:18.916703] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:22:57.928 [2024-11-28 19:11:18.916719] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:22:57.928 [2024-11-28 19:11:18.916733] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:22:57.928 [2024-11-28 19:11:18.916745] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:22:57.928 [2024-11-28 19:11:18.916761] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:22:57.928 [2024-11-28 19:11:18.916780] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:22:57.928 [2024-11-28 19:11:18.916793] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:22:57.928 [2024-11-28 19:11:18.916809] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:22:57.928 [2024-11-28 19:11:18.916823] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:22:57.928 [2024-11-28 19:11:18.916836] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:22:57.928 [2024-11-28 19:11:18.916884] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:57.928 [2024-11-28 19:11:18.916903] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:57.928 [2024-11-28 19:11:18.916915] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:57.928 [2024-11-28 19:11:18.916926] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:57.928 [2024-11-28 19:11:18.916938] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:22:58.495 19:11:19 -- target/shutdown.sh@135 -- # nvmfpid= 00:22:58.495 19:11:19 -- target/shutdown.sh@138 -- # sleep 1 00:22:59.434 19:11:20 -- target/shutdown.sh@141 -- # kill -9 272401 00:22:59.434 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (272401) - No such process 00:22:59.434 19:11:20 -- target/shutdown.sh@141 -- # true 00:22:59.434 19:11:20 -- target/shutdown.sh@143 -- # stoptarget 00:22:59.434 19:11:20 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:22:59.434 19:11:20 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:22:59.434 19:11:20 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:22:59.434 19:11:20 -- target/shutdown.sh@45 -- # nvmftestfini 00:22:59.434 19:11:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:59.434 19:11:20 -- nvmf/common.sh@116 -- # sync 00:22:59.434 19:11:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:59.434 19:11:20 -- nvmf/common.sh@119 -- # set +e 00:22:59.434 19:11:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:59.434 19:11:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:59.434 rmmod nvme_tcp 00:22:59.434 rmmod nvme_fabrics 00:22:59.434 rmmod nvme_keyring 00:22:59.434 19:11:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:59.434 19:11:20 -- nvmf/common.sh@123 -- # set -e 00:22:59.434 19:11:20 -- nvmf/common.sh@124 -- # return 0 00:22:59.434 19:11:20 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:22:59.434 19:11:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:59.434 19:11:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:59.434 19:11:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:59.434 19:11:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:59.434 19:11:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:59.434 19:11:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:59.434 19:11:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:59.434 19:11:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:01.973 19:11:22 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:01.973 00:23:01.973 real 0m8.091s 00:23:01.973 user 0m21.329s 00:23:01.973 sys 0m1.475s 00:23:01.973 19:11:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:01.973 19:11:22 -- common/autotest_common.sh@10 -- # set +x 00:23:01.973 ************************************ 00:23:01.973 END TEST nvmf_shutdown_tc3 00:23:01.973 ************************************ 00:23:01.973 19:11:22 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:23:01.973 00:23:01.973 real 0m28.859s 00:23:01.973 user 1m22.286s 00:23:01.973 sys 0m6.374s 00:23:01.973 19:11:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:01.973 19:11:22 -- common/autotest_common.sh@10 -- # set +x 00:23:01.973 ************************************ 00:23:01.973 END TEST nvmf_shutdown 00:23:01.973 ************************************ 00:23:01.973 19:11:22 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:23:01.973 19:11:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:01.973 19:11:22 -- common/autotest_common.sh@10 -- # set +x 00:23:01.973 19:11:22 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:23:01.973 19:11:22 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:01.973 19:11:22 -- common/autotest_common.sh@10 -- # set +x 00:23:01.973 19:11:22 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:23:01.973 19:11:22 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:23:01.973 19:11:22 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:01.973 19:11:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:01.973 19:11:22 -- common/autotest_common.sh@10 -- # set +x 00:23:01.973 ************************************ 00:23:01.973 START TEST nvmf_multicontroller 00:23:01.973 ************************************ 00:23:01.973 19:11:22 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:23:01.973 * Looking for test storage... 00:23:01.973 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:01.973 19:11:22 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:01.973 19:11:22 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:01.973 19:11:22 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:01.973 19:11:22 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:01.973 19:11:22 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:01.973 19:11:22 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:01.973 19:11:22 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:01.973 19:11:22 -- scripts/common.sh@335 -- # IFS=.-: 00:23:01.973 19:11:22 -- scripts/common.sh@335 -- # read -ra ver1 00:23:01.973 19:11:22 -- scripts/common.sh@336 -- # IFS=.-: 00:23:01.973 19:11:22 -- scripts/common.sh@336 -- # read -ra ver2 00:23:01.973 19:11:22 -- scripts/common.sh@337 -- # local 'op=<' 00:23:01.973 19:11:22 -- scripts/common.sh@339 -- # ver1_l=2 00:23:01.973 19:11:22 -- scripts/common.sh@340 -- # ver2_l=1 00:23:01.973 19:11:22 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:01.973 19:11:22 -- scripts/common.sh@343 -- # case "$op" in 00:23:01.973 19:11:22 -- scripts/common.sh@344 -- # : 1 00:23:01.973 19:11:22 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:01.973 19:11:22 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:01.973 19:11:22 -- scripts/common.sh@364 -- # decimal 1 00:23:01.973 19:11:22 -- scripts/common.sh@352 -- # local d=1 00:23:01.973 19:11:22 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:01.973 19:11:22 -- scripts/common.sh@354 -- # echo 1 00:23:01.973 19:11:22 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:01.973 19:11:22 -- scripts/common.sh@365 -- # decimal 2 00:23:01.973 19:11:22 -- scripts/common.sh@352 -- # local d=2 00:23:01.973 19:11:22 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:01.973 19:11:22 -- scripts/common.sh@354 -- # echo 2 00:23:01.973 19:11:22 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:01.973 19:11:22 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:01.973 19:11:22 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:01.973 19:11:22 -- scripts/common.sh@367 -- # return 0 00:23:01.973 19:11:22 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:01.973 19:11:22 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:01.973 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:01.973 --rc genhtml_branch_coverage=1 00:23:01.973 --rc genhtml_function_coverage=1 00:23:01.973 --rc genhtml_legend=1 00:23:01.973 --rc geninfo_all_blocks=1 00:23:01.973 --rc geninfo_unexecuted_blocks=1 00:23:01.973 00:23:01.973 ' 00:23:01.973 19:11:22 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:01.973 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:01.973 --rc genhtml_branch_coverage=1 00:23:01.973 --rc genhtml_function_coverage=1 00:23:01.973 --rc genhtml_legend=1 00:23:01.973 --rc geninfo_all_blocks=1 00:23:01.973 --rc geninfo_unexecuted_blocks=1 00:23:01.973 00:23:01.973 ' 00:23:01.973 19:11:22 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:01.973 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:01.973 --rc genhtml_branch_coverage=1 00:23:01.973 --rc genhtml_function_coverage=1 00:23:01.973 --rc genhtml_legend=1 00:23:01.973 --rc geninfo_all_blocks=1 00:23:01.973 --rc geninfo_unexecuted_blocks=1 00:23:01.973 00:23:01.973 ' 00:23:01.973 19:11:22 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:01.973 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:01.973 --rc genhtml_branch_coverage=1 00:23:01.973 --rc genhtml_function_coverage=1 00:23:01.973 --rc genhtml_legend=1 00:23:01.973 --rc geninfo_all_blocks=1 00:23:01.973 --rc geninfo_unexecuted_blocks=1 00:23:01.973 00:23:01.973 ' 00:23:01.973 19:11:22 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:01.973 19:11:22 -- nvmf/common.sh@7 -- # uname -s 00:23:01.973 19:11:22 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:01.973 19:11:22 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:01.973 19:11:22 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:01.973 19:11:22 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:01.973 19:11:22 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:01.973 19:11:22 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:01.973 19:11:22 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:01.973 19:11:22 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:01.973 19:11:22 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:01.973 19:11:22 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:01.973 19:11:22 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:01.974 19:11:22 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:01.974 19:11:22 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:01.974 19:11:22 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:01.974 19:11:22 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:01.974 19:11:22 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:01.974 19:11:22 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:01.974 19:11:22 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:01.974 19:11:22 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:01.974 19:11:22 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:01.974 19:11:22 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:01.974 19:11:22 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:01.974 19:11:22 -- paths/export.sh@5 -- # export PATH 00:23:01.974 19:11:22 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:01.974 19:11:22 -- nvmf/common.sh@46 -- # : 0 00:23:01.974 19:11:22 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:01.974 19:11:22 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:01.974 19:11:22 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:01.974 19:11:22 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:01.974 19:11:22 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:01.974 19:11:22 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:01.974 19:11:22 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:01.974 19:11:22 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:01.974 19:11:22 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:01.974 19:11:22 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:01.974 19:11:22 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:23:01.974 19:11:22 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:23:01.974 19:11:22 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:23:01.974 19:11:22 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:23:01.974 19:11:22 -- host/multicontroller.sh@23 -- # nvmftestinit 00:23:01.974 19:11:22 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:01.974 19:11:22 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:01.974 19:11:22 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:01.974 19:11:22 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:01.974 19:11:22 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:01.974 19:11:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:01.974 19:11:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:01.974 19:11:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:01.974 19:11:22 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:01.974 19:11:22 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:01.974 19:11:22 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:01.974 19:11:22 -- common/autotest_common.sh@10 -- # set +x 00:23:03.879 19:11:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:03.879 19:11:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:03.879 19:11:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:03.879 19:11:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:03.879 19:11:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:03.879 19:11:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:03.879 19:11:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:03.879 19:11:24 -- nvmf/common.sh@294 -- # net_devs=() 00:23:03.879 19:11:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:03.879 19:11:24 -- nvmf/common.sh@295 -- # e810=() 00:23:03.879 19:11:24 -- nvmf/common.sh@295 -- # local -ga e810 00:23:03.879 19:11:24 -- nvmf/common.sh@296 -- # x722=() 00:23:03.879 19:11:24 -- nvmf/common.sh@296 -- # local -ga x722 00:23:03.879 19:11:24 -- nvmf/common.sh@297 -- # mlx=() 00:23:03.879 19:11:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:03.879 19:11:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:03.879 19:11:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:03.879 19:11:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:03.879 19:11:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:03.879 19:11:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:03.879 19:11:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:03.879 19:11:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:03.879 19:11:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:03.879 19:11:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:03.879 19:11:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:03.879 19:11:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:03.879 19:11:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:03.879 19:11:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:03.879 19:11:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:03.879 19:11:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:03.879 19:11:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:03.879 19:11:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:03.879 19:11:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:03.879 19:11:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:03.879 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:03.879 19:11:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:03.879 19:11:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:03.879 19:11:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:03.879 19:11:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:03.879 19:11:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:03.879 19:11:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:03.879 19:11:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:03.879 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:03.879 19:11:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:03.879 19:11:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:03.879 19:11:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:03.879 19:11:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:03.879 19:11:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:03.879 19:11:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:03.879 19:11:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:03.879 19:11:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:03.879 19:11:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:03.879 19:11:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:03.879 19:11:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:03.880 19:11:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:03.880 19:11:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:03.880 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:03.880 19:11:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:03.880 19:11:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:03.880 19:11:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:03.880 19:11:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:03.880 19:11:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:03.880 19:11:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:03.880 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:03.880 19:11:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:03.880 19:11:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:03.880 19:11:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:03.880 19:11:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:03.880 19:11:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:03.880 19:11:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:03.880 19:11:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:03.880 19:11:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:03.880 19:11:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:03.880 19:11:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:03.880 19:11:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:03.880 19:11:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:03.880 19:11:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:03.880 19:11:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:03.880 19:11:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:03.880 19:11:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:03.880 19:11:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:03.880 19:11:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:03.880 19:11:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:03.880 19:11:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:03.880 19:11:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:03.880 19:11:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:03.880 19:11:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:03.880 19:11:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:03.880 19:11:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:03.880 19:11:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:03.880 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:03.880 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.296 ms 00:23:03.880 00:23:03.880 --- 10.0.0.2 ping statistics --- 00:23:03.880 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:03.880 rtt min/avg/max/mdev = 0.296/0.296/0.296/0.000 ms 00:23:03.880 19:11:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:03.880 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:03.880 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.069 ms 00:23:03.880 00:23:03.880 --- 10.0.0.1 ping statistics --- 00:23:03.880 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:03.880 rtt min/avg/max/mdev = 0.069/0.069/0.069/0.000 ms 00:23:03.880 19:11:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:03.880 19:11:24 -- nvmf/common.sh@410 -- # return 0 00:23:03.880 19:11:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:03.880 19:11:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:03.880 19:11:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:03.880 19:11:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:03.880 19:11:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:03.880 19:11:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:03.880 19:11:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:03.880 19:11:24 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:23:03.880 19:11:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:03.880 19:11:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:03.880 19:11:24 -- common/autotest_common.sh@10 -- # set +x 00:23:03.880 19:11:24 -- nvmf/common.sh@469 -- # nvmfpid=274948 00:23:03.880 19:11:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:23:03.880 19:11:24 -- nvmf/common.sh@470 -- # waitforlisten 274948 00:23:03.880 19:11:24 -- common/autotest_common.sh@829 -- # '[' -z 274948 ']' 00:23:03.880 19:11:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:03.880 19:11:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:03.880 19:11:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:03.880 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:03.880 19:11:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:03.880 19:11:24 -- common/autotest_common.sh@10 -- # set +x 00:23:04.139 [2024-11-28 19:11:24.962551] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:04.139 [2024-11-28 19:11:24.962621] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:04.139 EAL: No free 2048 kB hugepages reported on node 1 00:23:04.139 [2024-11-28 19:11:25.030774] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:23:04.139 [2024-11-28 19:11:25.145099] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:04.139 [2024-11-28 19:11:25.145248] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:04.139 [2024-11-28 19:11:25.145267] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:04.139 [2024-11-28 19:11:25.145281] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:04.139 [2024-11-28 19:11:25.145386] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:04.139 [2024-11-28 19:11:25.145438] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:04.139 [2024-11-28 19:11:25.145443] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:05.077 19:11:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:05.077 19:11:25 -- common/autotest_common.sh@862 -- # return 0 00:23:05.077 19:11:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:05.077 19:11:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:05.077 19:11:25 -- common/autotest_common.sh@10 -- # set +x 00:23:05.077 19:11:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:05.077 19:11:25 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:05.077 19:11:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.077 19:11:25 -- common/autotest_common.sh@10 -- # set +x 00:23:05.077 [2024-11-28 19:11:25.950974] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:05.077 19:11:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.077 19:11:25 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:05.077 19:11:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.077 19:11:25 -- common/autotest_common.sh@10 -- # set +x 00:23:05.077 Malloc0 00:23:05.077 19:11:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.077 19:11:25 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:05.077 19:11:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.077 19:11:25 -- common/autotest_common.sh@10 -- # set +x 00:23:05.077 19:11:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.077 19:11:26 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:05.077 19:11:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.077 19:11:26 -- common/autotest_common.sh@10 -- # set +x 00:23:05.077 19:11:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.077 19:11:26 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:05.077 19:11:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.077 19:11:26 -- common/autotest_common.sh@10 -- # set +x 00:23:05.077 [2024-11-28 19:11:26.016219] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:05.077 19:11:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.077 19:11:26 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:23:05.077 19:11:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.077 19:11:26 -- common/autotest_common.sh@10 -- # set +x 00:23:05.077 [2024-11-28 19:11:26.024134] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:23:05.077 19:11:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.077 19:11:26 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:23:05.077 19:11:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.077 19:11:26 -- common/autotest_common.sh@10 -- # set +x 00:23:05.077 Malloc1 00:23:05.077 19:11:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.077 19:11:26 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:23:05.077 19:11:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.077 19:11:26 -- common/autotest_common.sh@10 -- # set +x 00:23:05.077 19:11:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.077 19:11:26 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:23:05.077 19:11:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.077 19:11:26 -- common/autotest_common.sh@10 -- # set +x 00:23:05.077 19:11:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.077 19:11:26 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:23:05.077 19:11:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.077 19:11:26 -- common/autotest_common.sh@10 -- # set +x 00:23:05.077 19:11:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.077 19:11:26 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:23:05.077 19:11:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:05.077 19:11:26 -- common/autotest_common.sh@10 -- # set +x 00:23:05.077 19:11:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:05.077 19:11:26 -- host/multicontroller.sh@44 -- # bdevperf_pid=275105 00:23:05.077 19:11:26 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:23:05.077 19:11:26 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:23:05.077 19:11:26 -- host/multicontroller.sh@47 -- # waitforlisten 275105 /var/tmp/bdevperf.sock 00:23:05.077 19:11:26 -- common/autotest_common.sh@829 -- # '[' -z 275105 ']' 00:23:05.077 19:11:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:23:05.078 19:11:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:05.078 19:11:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:23:05.078 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:23:05.078 19:11:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:05.078 19:11:26 -- common/autotest_common.sh@10 -- # set +x 00:23:06.455 19:11:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:06.455 19:11:27 -- common/autotest_common.sh@862 -- # return 0 00:23:06.455 19:11:27 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:23:06.455 19:11:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:06.455 19:11:27 -- common/autotest_common.sh@10 -- # set +x 00:23:06.455 NVMe0n1 00:23:06.455 19:11:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:06.455 19:11:27 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:23:06.455 19:11:27 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:23:06.455 19:11:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:06.455 19:11:27 -- common/autotest_common.sh@10 -- # set +x 00:23:06.455 19:11:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:06.455 1 00:23:06.455 19:11:27 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:23:06.455 19:11:27 -- common/autotest_common.sh@650 -- # local es=0 00:23:06.455 19:11:27 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:23:06.455 19:11:27 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:23:06.455 19:11:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:06.455 19:11:27 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:23:06.455 19:11:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:06.455 19:11:27 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:23:06.455 19:11:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:06.455 19:11:27 -- common/autotest_common.sh@10 -- # set +x 00:23:06.455 request: 00:23:06.455 { 00:23:06.455 "name": "NVMe0", 00:23:06.455 "trtype": "tcp", 00:23:06.455 "traddr": "10.0.0.2", 00:23:06.455 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:23:06.455 "hostaddr": "10.0.0.2", 00:23:06.455 "hostsvcid": "60000", 00:23:06.455 "adrfam": "ipv4", 00:23:06.455 "trsvcid": "4420", 00:23:06.455 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:23:06.455 "method": "bdev_nvme_attach_controller", 00:23:06.455 "req_id": 1 00:23:06.455 } 00:23:06.455 Got JSON-RPC error response 00:23:06.455 response: 00:23:06.455 { 00:23:06.455 "code": -114, 00:23:06.455 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:23:06.455 } 00:23:06.455 19:11:27 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:23:06.455 19:11:27 -- common/autotest_common.sh@653 -- # es=1 00:23:06.455 19:11:27 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:23:06.455 19:11:27 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:23:06.455 19:11:27 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:23:06.455 19:11:27 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:23:06.455 19:11:27 -- common/autotest_common.sh@650 -- # local es=0 00:23:06.455 19:11:27 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:23:06.455 19:11:27 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:23:06.455 19:11:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:06.455 19:11:27 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:23:06.455 19:11:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:06.455 19:11:27 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:23:06.455 19:11:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:06.455 19:11:27 -- common/autotest_common.sh@10 -- # set +x 00:23:06.455 request: 00:23:06.455 { 00:23:06.455 "name": "NVMe0", 00:23:06.455 "trtype": "tcp", 00:23:06.455 "traddr": "10.0.0.2", 00:23:06.455 "hostaddr": "10.0.0.2", 00:23:06.455 "hostsvcid": "60000", 00:23:06.455 "adrfam": "ipv4", 00:23:06.455 "trsvcid": "4420", 00:23:06.455 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:23:06.455 "method": "bdev_nvme_attach_controller", 00:23:06.455 "req_id": 1 00:23:06.455 } 00:23:06.455 Got JSON-RPC error response 00:23:06.455 response: 00:23:06.455 { 00:23:06.455 "code": -114, 00:23:06.455 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:23:06.455 } 00:23:06.455 19:11:27 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:23:06.455 19:11:27 -- common/autotest_common.sh@653 -- # es=1 00:23:06.455 19:11:27 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:23:06.455 19:11:27 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:23:06.455 19:11:27 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:23:06.455 19:11:27 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:23:06.455 19:11:27 -- common/autotest_common.sh@650 -- # local es=0 00:23:06.455 19:11:27 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:23:06.455 19:11:27 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:23:06.455 19:11:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:06.455 19:11:27 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:23:06.455 19:11:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:06.455 19:11:27 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:23:06.455 19:11:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:06.455 19:11:27 -- common/autotest_common.sh@10 -- # set +x 00:23:06.455 request: 00:23:06.455 { 00:23:06.455 "name": "NVMe0", 00:23:06.455 "trtype": "tcp", 00:23:06.455 "traddr": "10.0.0.2", 00:23:06.455 "hostaddr": "10.0.0.2", 00:23:06.455 "hostsvcid": "60000", 00:23:06.455 "adrfam": "ipv4", 00:23:06.455 "trsvcid": "4420", 00:23:06.455 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:23:06.455 "multipath": "disable", 00:23:06.455 "method": "bdev_nvme_attach_controller", 00:23:06.455 "req_id": 1 00:23:06.455 } 00:23:06.455 Got JSON-RPC error response 00:23:06.455 response: 00:23:06.455 { 00:23:06.455 "code": -114, 00:23:06.455 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:23:06.455 } 00:23:06.455 19:11:27 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:23:06.455 19:11:27 -- common/autotest_common.sh@653 -- # es=1 00:23:06.455 19:11:27 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:23:06.455 19:11:27 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:23:06.455 19:11:27 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:23:06.455 19:11:27 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:23:06.455 19:11:27 -- common/autotest_common.sh@650 -- # local es=0 00:23:06.455 19:11:27 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:23:06.455 19:11:27 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:23:06.455 19:11:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:06.455 19:11:27 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:23:06.455 19:11:27 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:23:06.455 19:11:27 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:23:06.455 19:11:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:06.455 19:11:27 -- common/autotest_common.sh@10 -- # set +x 00:23:06.455 request: 00:23:06.455 { 00:23:06.455 "name": "NVMe0", 00:23:06.455 "trtype": "tcp", 00:23:06.455 "traddr": "10.0.0.2", 00:23:06.455 "hostaddr": "10.0.0.2", 00:23:06.455 "hostsvcid": "60000", 00:23:06.455 "adrfam": "ipv4", 00:23:06.455 "trsvcid": "4420", 00:23:06.456 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:23:06.456 "multipath": "failover", 00:23:06.456 "method": "bdev_nvme_attach_controller", 00:23:06.456 "req_id": 1 00:23:06.456 } 00:23:06.456 Got JSON-RPC error response 00:23:06.456 response: 00:23:06.456 { 00:23:06.456 "code": -114, 00:23:06.456 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:23:06.456 } 00:23:06.456 19:11:27 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:23:06.456 19:11:27 -- common/autotest_common.sh@653 -- # es=1 00:23:06.456 19:11:27 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:23:06.456 19:11:27 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:23:06.456 19:11:27 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:23:06.456 19:11:27 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:23:06.456 19:11:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:06.456 19:11:27 -- common/autotest_common.sh@10 -- # set +x 00:23:06.456 00:23:06.456 19:11:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:06.456 19:11:27 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:23:06.456 19:11:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:06.456 19:11:27 -- common/autotest_common.sh@10 -- # set +x 00:23:06.456 19:11:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:06.456 19:11:27 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:23:06.456 19:11:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:06.456 19:11:27 -- common/autotest_common.sh@10 -- # set +x 00:23:06.714 00:23:06.714 19:11:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:06.714 19:11:27 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:23:06.714 19:11:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:06.714 19:11:27 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:23:06.714 19:11:27 -- common/autotest_common.sh@10 -- # set +x 00:23:06.714 19:11:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:06.714 19:11:27 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:23:06.714 19:11:27 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:23:08.091 0 00:23:08.091 19:11:28 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:23:08.091 19:11:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:08.091 19:11:28 -- common/autotest_common.sh@10 -- # set +x 00:23:08.091 19:11:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:08.091 19:11:28 -- host/multicontroller.sh@100 -- # killprocess 275105 00:23:08.091 19:11:28 -- common/autotest_common.sh@936 -- # '[' -z 275105 ']' 00:23:08.091 19:11:28 -- common/autotest_common.sh@940 -- # kill -0 275105 00:23:08.091 19:11:28 -- common/autotest_common.sh@941 -- # uname 00:23:08.091 19:11:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:08.091 19:11:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 275105 00:23:08.091 19:11:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:08.091 19:11:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:08.091 19:11:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 275105' 00:23:08.091 killing process with pid 275105 00:23:08.091 19:11:28 -- common/autotest_common.sh@955 -- # kill 275105 00:23:08.091 19:11:28 -- common/autotest_common.sh@960 -- # wait 275105 00:23:08.091 19:11:29 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:08.091 19:11:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:08.091 19:11:29 -- common/autotest_common.sh@10 -- # set +x 00:23:08.091 19:11:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:08.091 19:11:29 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:23:08.091 19:11:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:08.091 19:11:29 -- common/autotest_common.sh@10 -- # set +x 00:23:08.351 19:11:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:08.352 19:11:29 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:23:08.352 19:11:29 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:23:08.352 19:11:29 -- common/autotest_common.sh@1607 -- # read -r file 00:23:08.352 19:11:29 -- common/autotest_common.sh@1606 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:23:08.352 19:11:29 -- common/autotest_common.sh@1606 -- # sort -u 00:23:08.352 19:11:29 -- common/autotest_common.sh@1608 -- # cat 00:23:08.352 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:23:08.352 [2024-11-28 19:11:26.117029] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:08.352 [2024-11-28 19:11:26.117111] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid275105 ] 00:23:08.352 EAL: No free 2048 kB hugepages reported on node 1 00:23:08.352 [2024-11-28 19:11:26.179361] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:23:08.352 [2024-11-28 19:11:26.286941] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:08.352 [2024-11-28 19:11:27.656171] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name 6974d2db-1a13-4421-98f5-929b48990e4f already exists 00:23:08.352 [2024-11-28 19:11:27.656213] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:6974d2db-1a13-4421-98f5-929b48990e4f alias for bdev NVMe1n1 00:23:08.352 [2024-11-28 19:11:27.656247] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:23:08.352 Running I/O for 1 seconds... 00:23:08.352 00:23:08.352 Latency(us) 00:23:08.352 [2024-11-28T18:11:29.400Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:23:08.352 [2024-11-28T18:11:29.400Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:23:08.352 NVMe0n1 : 1.01 19515.66 76.23 0.00 0.00 6549.25 2524.35 11893.57 00:23:08.352 [2024-11-28T18:11:29.400Z] =================================================================================================================== 00:23:08.352 [2024-11-28T18:11:29.400Z] Total : 19515.66 76.23 0.00 0.00 6549.25 2524.35 11893.57 00:23:08.352 Received shutdown signal, test time was about 1.000000 seconds 00:23:08.352 00:23:08.352 Latency(us) 00:23:08.352 [2024-11-28T18:11:29.400Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:23:08.352 [2024-11-28T18:11:29.400Z] =================================================================================================================== 00:23:08.352 [2024-11-28T18:11:29.400Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:23:08.352 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:23:08.352 19:11:29 -- common/autotest_common.sh@1613 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:23:08.352 19:11:29 -- common/autotest_common.sh@1607 -- # read -r file 00:23:08.352 19:11:29 -- host/multicontroller.sh@108 -- # nvmftestfini 00:23:08.352 19:11:29 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:08.352 19:11:29 -- nvmf/common.sh@116 -- # sync 00:23:08.352 19:11:29 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:08.352 19:11:29 -- nvmf/common.sh@119 -- # set +e 00:23:08.352 19:11:29 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:08.352 19:11:29 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:08.352 rmmod nvme_tcp 00:23:08.352 rmmod nvme_fabrics 00:23:08.352 rmmod nvme_keyring 00:23:08.352 19:11:29 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:08.352 19:11:29 -- nvmf/common.sh@123 -- # set -e 00:23:08.352 19:11:29 -- nvmf/common.sh@124 -- # return 0 00:23:08.352 19:11:29 -- nvmf/common.sh@477 -- # '[' -n 274948 ']' 00:23:08.352 19:11:29 -- nvmf/common.sh@478 -- # killprocess 274948 00:23:08.352 19:11:29 -- common/autotest_common.sh@936 -- # '[' -z 274948 ']' 00:23:08.352 19:11:29 -- common/autotest_common.sh@940 -- # kill -0 274948 00:23:08.352 19:11:29 -- common/autotest_common.sh@941 -- # uname 00:23:08.352 19:11:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:08.352 19:11:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 274948 00:23:08.352 19:11:29 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:23:08.352 19:11:29 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:23:08.352 19:11:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 274948' 00:23:08.352 killing process with pid 274948 00:23:08.352 19:11:29 -- common/autotest_common.sh@955 -- # kill 274948 00:23:08.352 19:11:29 -- common/autotest_common.sh@960 -- # wait 274948 00:23:08.611 19:11:29 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:08.611 19:11:29 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:08.611 19:11:29 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:08.611 19:11:29 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:08.611 19:11:29 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:08.611 19:11:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:08.611 19:11:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:08.611 19:11:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:11.152 19:11:31 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:11.152 00:23:11.152 real 0m9.037s 00:23:11.152 user 0m17.439s 00:23:11.152 sys 0m2.382s 00:23:11.152 19:11:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:11.152 19:11:31 -- common/autotest_common.sh@10 -- # set +x 00:23:11.152 ************************************ 00:23:11.152 END TEST nvmf_multicontroller 00:23:11.152 ************************************ 00:23:11.152 19:11:31 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:23:11.152 19:11:31 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:11.152 19:11:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:11.152 19:11:31 -- common/autotest_common.sh@10 -- # set +x 00:23:11.152 ************************************ 00:23:11.152 START TEST nvmf_aer 00:23:11.152 ************************************ 00:23:11.152 19:11:31 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:23:11.152 * Looking for test storage... 00:23:11.152 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:11.152 19:11:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:11.152 19:11:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:11.152 19:11:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:11.152 19:11:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:11.152 19:11:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:11.152 19:11:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:11.152 19:11:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:11.152 19:11:31 -- scripts/common.sh@335 -- # IFS=.-: 00:23:11.152 19:11:31 -- scripts/common.sh@335 -- # read -ra ver1 00:23:11.152 19:11:31 -- scripts/common.sh@336 -- # IFS=.-: 00:23:11.152 19:11:31 -- scripts/common.sh@336 -- # read -ra ver2 00:23:11.152 19:11:31 -- scripts/common.sh@337 -- # local 'op=<' 00:23:11.152 19:11:31 -- scripts/common.sh@339 -- # ver1_l=2 00:23:11.152 19:11:31 -- scripts/common.sh@340 -- # ver2_l=1 00:23:11.152 19:11:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:11.152 19:11:31 -- scripts/common.sh@343 -- # case "$op" in 00:23:11.152 19:11:31 -- scripts/common.sh@344 -- # : 1 00:23:11.152 19:11:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:11.152 19:11:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:11.152 19:11:31 -- scripts/common.sh@364 -- # decimal 1 00:23:11.152 19:11:31 -- scripts/common.sh@352 -- # local d=1 00:23:11.152 19:11:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:11.152 19:11:31 -- scripts/common.sh@354 -- # echo 1 00:23:11.152 19:11:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:11.152 19:11:31 -- scripts/common.sh@365 -- # decimal 2 00:23:11.152 19:11:31 -- scripts/common.sh@352 -- # local d=2 00:23:11.152 19:11:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:11.152 19:11:31 -- scripts/common.sh@354 -- # echo 2 00:23:11.152 19:11:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:11.152 19:11:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:11.152 19:11:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:11.152 19:11:31 -- scripts/common.sh@367 -- # return 0 00:23:11.152 19:11:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:11.152 19:11:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:11.152 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:11.152 --rc genhtml_branch_coverage=1 00:23:11.152 --rc genhtml_function_coverage=1 00:23:11.152 --rc genhtml_legend=1 00:23:11.152 --rc geninfo_all_blocks=1 00:23:11.152 --rc geninfo_unexecuted_blocks=1 00:23:11.152 00:23:11.152 ' 00:23:11.152 19:11:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:11.152 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:11.152 --rc genhtml_branch_coverage=1 00:23:11.152 --rc genhtml_function_coverage=1 00:23:11.152 --rc genhtml_legend=1 00:23:11.152 --rc geninfo_all_blocks=1 00:23:11.152 --rc geninfo_unexecuted_blocks=1 00:23:11.152 00:23:11.152 ' 00:23:11.152 19:11:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:11.152 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:11.152 --rc genhtml_branch_coverage=1 00:23:11.152 --rc genhtml_function_coverage=1 00:23:11.152 --rc genhtml_legend=1 00:23:11.152 --rc geninfo_all_blocks=1 00:23:11.152 --rc geninfo_unexecuted_blocks=1 00:23:11.152 00:23:11.152 ' 00:23:11.152 19:11:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:11.152 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:11.152 --rc genhtml_branch_coverage=1 00:23:11.152 --rc genhtml_function_coverage=1 00:23:11.152 --rc genhtml_legend=1 00:23:11.152 --rc geninfo_all_blocks=1 00:23:11.152 --rc geninfo_unexecuted_blocks=1 00:23:11.152 00:23:11.152 ' 00:23:11.152 19:11:31 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:11.152 19:11:31 -- nvmf/common.sh@7 -- # uname -s 00:23:11.152 19:11:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:11.152 19:11:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:11.152 19:11:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:11.152 19:11:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:11.152 19:11:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:11.152 19:11:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:11.152 19:11:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:11.152 19:11:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:11.152 19:11:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:11.152 19:11:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:11.152 19:11:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:11.152 19:11:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:11.152 19:11:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:11.152 19:11:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:11.152 19:11:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:11.152 19:11:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:11.152 19:11:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:11.152 19:11:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:11.152 19:11:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:11.152 19:11:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:11.153 19:11:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:11.153 19:11:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:11.153 19:11:31 -- paths/export.sh@5 -- # export PATH 00:23:11.153 19:11:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:11.153 19:11:31 -- nvmf/common.sh@46 -- # : 0 00:23:11.153 19:11:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:11.153 19:11:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:11.153 19:11:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:11.153 19:11:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:11.153 19:11:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:11.153 19:11:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:11.153 19:11:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:11.153 19:11:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:11.153 19:11:31 -- host/aer.sh@11 -- # nvmftestinit 00:23:11.153 19:11:31 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:11.153 19:11:31 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:11.153 19:11:31 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:11.153 19:11:31 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:11.153 19:11:31 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:11.153 19:11:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:11.153 19:11:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:11.153 19:11:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:11.153 19:11:31 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:11.153 19:11:31 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:11.153 19:11:31 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:11.153 19:11:31 -- common/autotest_common.sh@10 -- # set +x 00:23:13.136 19:11:33 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:13.136 19:11:33 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:13.136 19:11:33 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:13.136 19:11:33 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:13.136 19:11:33 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:13.136 19:11:33 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:13.136 19:11:33 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:13.136 19:11:33 -- nvmf/common.sh@294 -- # net_devs=() 00:23:13.136 19:11:33 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:13.136 19:11:33 -- nvmf/common.sh@295 -- # e810=() 00:23:13.136 19:11:33 -- nvmf/common.sh@295 -- # local -ga e810 00:23:13.136 19:11:33 -- nvmf/common.sh@296 -- # x722=() 00:23:13.136 19:11:33 -- nvmf/common.sh@296 -- # local -ga x722 00:23:13.136 19:11:33 -- nvmf/common.sh@297 -- # mlx=() 00:23:13.136 19:11:33 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:13.136 19:11:33 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:13.136 19:11:33 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:13.136 19:11:33 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:13.136 19:11:33 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:13.136 19:11:33 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:13.136 19:11:33 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:13.136 19:11:33 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:13.136 19:11:33 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:13.136 19:11:33 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:13.136 19:11:33 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:13.136 19:11:33 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:13.136 19:11:33 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:13.136 19:11:33 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:13.136 19:11:33 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:13.136 19:11:33 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:13.136 19:11:33 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:13.136 19:11:33 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:13.136 19:11:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:13.136 19:11:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:13.136 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:13.136 19:11:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:13.136 19:11:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:13.136 19:11:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:13.136 19:11:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:13.136 19:11:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:13.136 19:11:33 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:13.136 19:11:33 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:13.136 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:13.136 19:11:33 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:13.136 19:11:33 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:13.136 19:11:33 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:13.136 19:11:33 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:13.136 19:11:33 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:13.136 19:11:33 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:13.136 19:11:33 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:13.136 19:11:33 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:13.136 19:11:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:13.136 19:11:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:13.136 19:11:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:13.136 19:11:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:13.136 19:11:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:13.136 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:13.136 19:11:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:13.136 19:11:33 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:13.136 19:11:33 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:13.136 19:11:33 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:13.136 19:11:33 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:13.136 19:11:33 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:13.136 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:13.136 19:11:33 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:13.136 19:11:33 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:13.136 19:11:33 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:13.136 19:11:33 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:13.136 19:11:33 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:13.136 19:11:33 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:13.136 19:11:33 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:13.136 19:11:33 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:13.136 19:11:33 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:13.136 19:11:33 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:13.136 19:11:33 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:13.136 19:11:33 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:13.136 19:11:33 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:13.136 19:11:33 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:13.136 19:11:33 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:13.136 19:11:33 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:13.136 19:11:33 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:13.136 19:11:33 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:13.136 19:11:33 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:13.136 19:11:33 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:13.136 19:11:33 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:13.136 19:11:33 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:13.136 19:11:33 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:13.136 19:11:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:13.136 19:11:33 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:13.136 19:11:33 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:13.136 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:13.136 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.262 ms 00:23:13.136 00:23:13.136 --- 10.0.0.2 ping statistics --- 00:23:13.136 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:13.136 rtt min/avg/max/mdev = 0.262/0.262/0.262/0.000 ms 00:23:13.136 19:11:33 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:13.136 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:13.136 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.066 ms 00:23:13.136 00:23:13.136 --- 10.0.0.1 ping statistics --- 00:23:13.136 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:13.136 rtt min/avg/max/mdev = 0.066/0.066/0.066/0.000 ms 00:23:13.136 19:11:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:13.136 19:11:33 -- nvmf/common.sh@410 -- # return 0 00:23:13.136 19:11:33 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:13.136 19:11:33 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:13.136 19:11:33 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:13.136 19:11:33 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:13.136 19:11:33 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:13.136 19:11:33 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:13.136 19:11:33 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:13.136 19:11:33 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:23:13.136 19:11:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:13.136 19:11:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:13.136 19:11:33 -- common/autotest_common.sh@10 -- # set +x 00:23:13.136 19:11:33 -- nvmf/common.sh@469 -- # nvmfpid=277481 00:23:13.137 19:11:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:13.137 19:11:33 -- nvmf/common.sh@470 -- # waitforlisten 277481 00:23:13.137 19:11:33 -- common/autotest_common.sh@829 -- # '[' -z 277481 ']' 00:23:13.137 19:11:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:13.137 19:11:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:13.137 19:11:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:13.137 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:13.137 19:11:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:13.137 19:11:33 -- common/autotest_common.sh@10 -- # set +x 00:23:13.137 [2024-11-28 19:11:34.026721] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:13.137 [2024-11-28 19:11:34.026827] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:13.137 EAL: No free 2048 kB hugepages reported on node 1 00:23:13.137 [2024-11-28 19:11:34.095757] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:13.415 [2024-11-28 19:11:34.212107] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:13.415 [2024-11-28 19:11:34.212273] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:13.415 [2024-11-28 19:11:34.212293] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:13.415 [2024-11-28 19:11:34.212307] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:13.415 [2024-11-28 19:11:34.212546] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:13.415 [2024-11-28 19:11:34.212572] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:13.415 [2024-11-28 19:11:34.212630] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:13.415 [2024-11-28 19:11:34.212633] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:14.036 19:11:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:14.036 19:11:34 -- common/autotest_common.sh@862 -- # return 0 00:23:14.036 19:11:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:14.036 19:11:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:14.036 19:11:34 -- common/autotest_common.sh@10 -- # set +x 00:23:14.036 19:11:35 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:14.036 19:11:35 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:14.036 19:11:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.036 19:11:35 -- common/autotest_common.sh@10 -- # set +x 00:23:14.036 [2024-11-28 19:11:35.018923] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:14.036 19:11:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.036 19:11:35 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:23:14.036 19:11:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.036 19:11:35 -- common/autotest_common.sh@10 -- # set +x 00:23:14.036 Malloc0 00:23:14.036 19:11:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.036 19:11:35 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:23:14.036 19:11:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.036 19:11:35 -- common/autotest_common.sh@10 -- # set +x 00:23:14.036 19:11:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.036 19:11:35 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:14.036 19:11:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.036 19:11:35 -- common/autotest_common.sh@10 -- # set +x 00:23:14.321 19:11:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.321 19:11:35 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:14.321 19:11:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.321 19:11:35 -- common/autotest_common.sh@10 -- # set +x 00:23:14.321 [2024-11-28 19:11:35.070217] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:14.321 19:11:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.321 19:11:35 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:23:14.321 19:11:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.321 19:11:35 -- common/autotest_common.sh@10 -- # set +x 00:23:14.321 [2024-11-28 19:11:35.077967] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:23:14.321 [ 00:23:14.321 { 00:23:14.321 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:14.321 "subtype": "Discovery", 00:23:14.321 "listen_addresses": [], 00:23:14.321 "allow_any_host": true, 00:23:14.321 "hosts": [] 00:23:14.321 }, 00:23:14.321 { 00:23:14.321 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:14.321 "subtype": "NVMe", 00:23:14.321 "listen_addresses": [ 00:23:14.321 { 00:23:14.321 "transport": "TCP", 00:23:14.321 "trtype": "TCP", 00:23:14.321 "adrfam": "IPv4", 00:23:14.321 "traddr": "10.0.0.2", 00:23:14.321 "trsvcid": "4420" 00:23:14.321 } 00:23:14.321 ], 00:23:14.321 "allow_any_host": true, 00:23:14.321 "hosts": [], 00:23:14.321 "serial_number": "SPDK00000000000001", 00:23:14.321 "model_number": "SPDK bdev Controller", 00:23:14.321 "max_namespaces": 2, 00:23:14.321 "min_cntlid": 1, 00:23:14.321 "max_cntlid": 65519, 00:23:14.321 "namespaces": [ 00:23:14.321 { 00:23:14.321 "nsid": 1, 00:23:14.321 "bdev_name": "Malloc0", 00:23:14.321 "name": "Malloc0", 00:23:14.321 "nguid": "28533E193EFF410EB3D9E726F4BA35A2", 00:23:14.321 "uuid": "28533e19-3eff-410e-b3d9-e726f4ba35a2" 00:23:14.321 } 00:23:14.321 ] 00:23:14.321 } 00:23:14.321 ] 00:23:14.321 19:11:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.321 19:11:35 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:23:14.321 19:11:35 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:23:14.321 19:11:35 -- host/aer.sh@33 -- # aerpid=277651 00:23:14.321 19:11:35 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:23:14.321 19:11:35 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:23:14.321 19:11:35 -- common/autotest_common.sh@1254 -- # local i=0 00:23:14.321 19:11:35 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:14.321 19:11:35 -- common/autotest_common.sh@1256 -- # '[' 0 -lt 200 ']' 00:23:14.321 19:11:35 -- common/autotest_common.sh@1257 -- # i=1 00:23:14.321 19:11:35 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:23:14.322 EAL: No free 2048 kB hugepages reported on node 1 00:23:14.322 19:11:35 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:14.322 19:11:35 -- common/autotest_common.sh@1256 -- # '[' 1 -lt 200 ']' 00:23:14.322 19:11:35 -- common/autotest_common.sh@1257 -- # i=2 00:23:14.322 19:11:35 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:23:14.322 19:11:35 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:14.322 19:11:35 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:23:14.322 19:11:35 -- common/autotest_common.sh@1265 -- # return 0 00:23:14.322 19:11:35 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:23:14.322 19:11:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.322 19:11:35 -- common/autotest_common.sh@10 -- # set +x 00:23:14.322 Malloc1 00:23:14.322 19:11:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.322 19:11:35 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:23:14.322 19:11:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.322 19:11:35 -- common/autotest_common.sh@10 -- # set +x 00:23:14.322 19:11:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.322 19:11:35 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:23:14.322 19:11:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.322 19:11:35 -- common/autotest_common.sh@10 -- # set +x 00:23:14.582 Asynchronous Event Request test 00:23:14.582 Attaching to 10.0.0.2 00:23:14.582 Attached to 10.0.0.2 00:23:14.582 Registering asynchronous event callbacks... 00:23:14.582 Starting namespace attribute notice tests for all controllers... 00:23:14.582 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:23:14.582 aer_cb - Changed Namespace 00:23:14.582 Cleaning up... 00:23:14.582 [ 00:23:14.582 { 00:23:14.582 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:14.582 "subtype": "Discovery", 00:23:14.582 "listen_addresses": [], 00:23:14.582 "allow_any_host": true, 00:23:14.582 "hosts": [] 00:23:14.582 }, 00:23:14.582 { 00:23:14.582 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:14.582 "subtype": "NVMe", 00:23:14.582 "listen_addresses": [ 00:23:14.582 { 00:23:14.582 "transport": "TCP", 00:23:14.582 "trtype": "TCP", 00:23:14.582 "adrfam": "IPv4", 00:23:14.582 "traddr": "10.0.0.2", 00:23:14.582 "trsvcid": "4420" 00:23:14.582 } 00:23:14.582 ], 00:23:14.582 "allow_any_host": true, 00:23:14.582 "hosts": [], 00:23:14.582 "serial_number": "SPDK00000000000001", 00:23:14.582 "model_number": "SPDK bdev Controller", 00:23:14.582 "max_namespaces": 2, 00:23:14.582 "min_cntlid": 1, 00:23:14.582 "max_cntlid": 65519, 00:23:14.582 "namespaces": [ 00:23:14.582 { 00:23:14.582 "nsid": 1, 00:23:14.582 "bdev_name": "Malloc0", 00:23:14.582 "name": "Malloc0", 00:23:14.582 "nguid": "28533E193EFF410EB3D9E726F4BA35A2", 00:23:14.582 "uuid": "28533e19-3eff-410e-b3d9-e726f4ba35a2" 00:23:14.582 }, 00:23:14.582 { 00:23:14.582 "nsid": 2, 00:23:14.582 "bdev_name": "Malloc1", 00:23:14.582 "name": "Malloc1", 00:23:14.582 "nguid": "5DDDE6FB3F6547418A8DE46F27CB435D", 00:23:14.582 "uuid": "5ddde6fb-3f65-4741-8a8d-e46f27cb435d" 00:23:14.582 } 00:23:14.582 ] 00:23:14.582 } 00:23:14.582 ] 00:23:14.582 19:11:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.582 19:11:35 -- host/aer.sh@43 -- # wait 277651 00:23:14.582 19:11:35 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:23:14.582 19:11:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.582 19:11:35 -- common/autotest_common.sh@10 -- # set +x 00:23:14.582 19:11:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.582 19:11:35 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:23:14.582 19:11:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.582 19:11:35 -- common/autotest_common.sh@10 -- # set +x 00:23:14.582 19:11:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.582 19:11:35 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:14.582 19:11:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:14.582 19:11:35 -- common/autotest_common.sh@10 -- # set +x 00:23:14.582 19:11:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:14.582 19:11:35 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:23:14.582 19:11:35 -- host/aer.sh@51 -- # nvmftestfini 00:23:14.582 19:11:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:14.582 19:11:35 -- nvmf/common.sh@116 -- # sync 00:23:14.582 19:11:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:14.582 19:11:35 -- nvmf/common.sh@119 -- # set +e 00:23:14.582 19:11:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:14.582 19:11:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:14.582 rmmod nvme_tcp 00:23:14.582 rmmod nvme_fabrics 00:23:14.582 rmmod nvme_keyring 00:23:14.582 19:11:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:14.582 19:11:35 -- nvmf/common.sh@123 -- # set -e 00:23:14.582 19:11:35 -- nvmf/common.sh@124 -- # return 0 00:23:14.582 19:11:35 -- nvmf/common.sh@477 -- # '[' -n 277481 ']' 00:23:14.582 19:11:35 -- nvmf/common.sh@478 -- # killprocess 277481 00:23:14.582 19:11:35 -- common/autotest_common.sh@936 -- # '[' -z 277481 ']' 00:23:14.582 19:11:35 -- common/autotest_common.sh@940 -- # kill -0 277481 00:23:14.582 19:11:35 -- common/autotest_common.sh@941 -- # uname 00:23:14.582 19:11:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:14.582 19:11:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 277481 00:23:14.582 19:11:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:14.582 19:11:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:14.582 19:11:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 277481' 00:23:14.582 killing process with pid 277481 00:23:14.582 19:11:35 -- common/autotest_common.sh@955 -- # kill 277481 00:23:14.582 [2024-11-28 19:11:35.542655] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:23:14.582 19:11:35 -- common/autotest_common.sh@960 -- # wait 277481 00:23:14.843 19:11:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:14.843 19:11:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:14.843 19:11:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:14.843 19:11:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:14.843 19:11:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:14.843 19:11:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:14.843 19:11:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:14.843 19:11:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:17.379 19:11:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:17.379 00:23:17.379 real 0m6.216s 00:23:17.379 user 0m7.246s 00:23:17.379 sys 0m1.957s 00:23:17.379 19:11:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:17.379 19:11:37 -- common/autotest_common.sh@10 -- # set +x 00:23:17.379 ************************************ 00:23:17.379 END TEST nvmf_aer 00:23:17.379 ************************************ 00:23:17.379 19:11:37 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:23:17.379 19:11:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:17.379 19:11:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:17.379 19:11:37 -- common/autotest_common.sh@10 -- # set +x 00:23:17.379 ************************************ 00:23:17.379 START TEST nvmf_async_init 00:23:17.379 ************************************ 00:23:17.379 19:11:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:23:17.379 * Looking for test storage... 00:23:17.379 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:17.379 19:11:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:17.379 19:11:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:17.379 19:11:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:17.379 19:11:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:17.379 19:11:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:17.379 19:11:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:17.379 19:11:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:17.379 19:11:38 -- scripts/common.sh@335 -- # IFS=.-: 00:23:17.379 19:11:38 -- scripts/common.sh@335 -- # read -ra ver1 00:23:17.379 19:11:38 -- scripts/common.sh@336 -- # IFS=.-: 00:23:17.379 19:11:38 -- scripts/common.sh@336 -- # read -ra ver2 00:23:17.379 19:11:38 -- scripts/common.sh@337 -- # local 'op=<' 00:23:17.379 19:11:38 -- scripts/common.sh@339 -- # ver1_l=2 00:23:17.379 19:11:38 -- scripts/common.sh@340 -- # ver2_l=1 00:23:17.379 19:11:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:17.379 19:11:38 -- scripts/common.sh@343 -- # case "$op" in 00:23:17.379 19:11:38 -- scripts/common.sh@344 -- # : 1 00:23:17.379 19:11:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:17.379 19:11:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:17.379 19:11:38 -- scripts/common.sh@364 -- # decimal 1 00:23:17.379 19:11:38 -- scripts/common.sh@352 -- # local d=1 00:23:17.379 19:11:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:17.379 19:11:38 -- scripts/common.sh@354 -- # echo 1 00:23:17.379 19:11:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:17.379 19:11:38 -- scripts/common.sh@365 -- # decimal 2 00:23:17.379 19:11:38 -- scripts/common.sh@352 -- # local d=2 00:23:17.379 19:11:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:17.379 19:11:38 -- scripts/common.sh@354 -- # echo 2 00:23:17.379 19:11:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:17.379 19:11:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:17.379 19:11:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:17.379 19:11:38 -- scripts/common.sh@367 -- # return 0 00:23:17.379 19:11:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:17.379 19:11:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:17.379 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:17.379 --rc genhtml_branch_coverage=1 00:23:17.379 --rc genhtml_function_coverage=1 00:23:17.379 --rc genhtml_legend=1 00:23:17.379 --rc geninfo_all_blocks=1 00:23:17.379 --rc geninfo_unexecuted_blocks=1 00:23:17.379 00:23:17.379 ' 00:23:17.379 19:11:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:17.379 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:17.379 --rc genhtml_branch_coverage=1 00:23:17.379 --rc genhtml_function_coverage=1 00:23:17.379 --rc genhtml_legend=1 00:23:17.379 --rc geninfo_all_blocks=1 00:23:17.379 --rc geninfo_unexecuted_blocks=1 00:23:17.379 00:23:17.379 ' 00:23:17.379 19:11:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:17.379 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:17.379 --rc genhtml_branch_coverage=1 00:23:17.379 --rc genhtml_function_coverage=1 00:23:17.379 --rc genhtml_legend=1 00:23:17.379 --rc geninfo_all_blocks=1 00:23:17.379 --rc geninfo_unexecuted_blocks=1 00:23:17.379 00:23:17.379 ' 00:23:17.379 19:11:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:17.379 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:17.379 --rc genhtml_branch_coverage=1 00:23:17.379 --rc genhtml_function_coverage=1 00:23:17.379 --rc genhtml_legend=1 00:23:17.380 --rc geninfo_all_blocks=1 00:23:17.380 --rc geninfo_unexecuted_blocks=1 00:23:17.380 00:23:17.380 ' 00:23:17.380 19:11:38 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:17.380 19:11:38 -- nvmf/common.sh@7 -- # uname -s 00:23:17.380 19:11:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:17.380 19:11:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:17.380 19:11:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:17.380 19:11:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:17.380 19:11:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:17.380 19:11:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:17.380 19:11:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:17.380 19:11:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:17.380 19:11:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:17.380 19:11:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:17.380 19:11:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:17.380 19:11:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:17.380 19:11:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:17.380 19:11:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:17.380 19:11:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:17.380 19:11:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:17.380 19:11:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:17.380 19:11:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:17.380 19:11:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:17.380 19:11:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:17.380 19:11:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:17.380 19:11:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:17.380 19:11:38 -- paths/export.sh@5 -- # export PATH 00:23:17.380 19:11:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:17.380 19:11:38 -- nvmf/common.sh@46 -- # : 0 00:23:17.380 19:11:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:17.380 19:11:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:17.380 19:11:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:17.380 19:11:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:17.380 19:11:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:17.380 19:11:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:17.380 19:11:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:17.380 19:11:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:17.380 19:11:38 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:23:17.380 19:11:38 -- host/async_init.sh@14 -- # null_block_size=512 00:23:17.380 19:11:38 -- host/async_init.sh@15 -- # null_bdev=null0 00:23:17.380 19:11:38 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:23:17.380 19:11:38 -- host/async_init.sh@20 -- # uuidgen 00:23:17.380 19:11:38 -- host/async_init.sh@20 -- # tr -d - 00:23:17.380 19:11:38 -- host/async_init.sh@20 -- # nguid=7b8f968f4cc84bc1b43230f4a33ba9f2 00:23:17.380 19:11:38 -- host/async_init.sh@22 -- # nvmftestinit 00:23:17.380 19:11:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:17.380 19:11:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:17.380 19:11:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:17.380 19:11:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:17.380 19:11:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:17.380 19:11:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:17.380 19:11:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:17.380 19:11:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:17.380 19:11:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:17.380 19:11:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:17.380 19:11:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:17.380 19:11:38 -- common/autotest_common.sh@10 -- # set +x 00:23:19.282 19:11:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:19.282 19:11:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:19.282 19:11:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:19.282 19:11:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:19.282 19:11:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:19.282 19:11:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:19.282 19:11:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:19.282 19:11:39 -- nvmf/common.sh@294 -- # net_devs=() 00:23:19.282 19:11:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:19.282 19:11:39 -- nvmf/common.sh@295 -- # e810=() 00:23:19.282 19:11:39 -- nvmf/common.sh@295 -- # local -ga e810 00:23:19.282 19:11:39 -- nvmf/common.sh@296 -- # x722=() 00:23:19.282 19:11:39 -- nvmf/common.sh@296 -- # local -ga x722 00:23:19.282 19:11:39 -- nvmf/common.sh@297 -- # mlx=() 00:23:19.282 19:11:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:19.282 19:11:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:19.282 19:11:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:19.282 19:11:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:19.282 19:11:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:19.282 19:11:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:19.282 19:11:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:19.282 19:11:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:19.282 19:11:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:19.282 19:11:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:19.282 19:11:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:19.282 19:11:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:19.283 19:11:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:19.283 19:11:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:19.283 19:11:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:19.283 19:11:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:19.283 19:11:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:19.283 19:11:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:19.283 19:11:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:19.283 19:11:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:19.283 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:19.283 19:11:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:19.283 19:11:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:19.283 19:11:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:19.283 19:11:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:19.283 19:11:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:19.283 19:11:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:19.283 19:11:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:19.283 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:19.283 19:11:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:19.283 19:11:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:19.283 19:11:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:19.283 19:11:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:19.283 19:11:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:19.283 19:11:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:19.283 19:11:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:19.283 19:11:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:19.283 19:11:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:19.283 19:11:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:19.283 19:11:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:19.283 19:11:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:19.283 19:11:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:19.283 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:19.283 19:11:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:19.283 19:11:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:19.283 19:11:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:19.283 19:11:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:19.283 19:11:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:19.283 19:11:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:19.283 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:19.283 19:11:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:19.283 19:11:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:19.283 19:11:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:19.283 19:11:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:19.283 19:11:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:19.283 19:11:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:19.283 19:11:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:19.283 19:11:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:19.283 19:11:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:19.283 19:11:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:19.283 19:11:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:19.283 19:11:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:19.283 19:11:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:19.283 19:11:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:19.283 19:11:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:19.283 19:11:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:19.283 19:11:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:19.283 19:11:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:19.283 19:11:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:19.283 19:11:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:19.283 19:11:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:19.283 19:11:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:19.283 19:11:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:19.283 19:11:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:19.283 19:11:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:19.283 19:11:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:19.283 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:19.283 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.271 ms 00:23:19.283 00:23:19.283 --- 10.0.0.2 ping statistics --- 00:23:19.283 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:19.283 rtt min/avg/max/mdev = 0.271/0.271/0.271/0.000 ms 00:23:19.283 19:11:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:19.283 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:19.283 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.076 ms 00:23:19.283 00:23:19.283 --- 10.0.0.1 ping statistics --- 00:23:19.283 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:19.283 rtt min/avg/max/mdev = 0.076/0.076/0.076/0.000 ms 00:23:19.283 19:11:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:19.283 19:11:40 -- nvmf/common.sh@410 -- # return 0 00:23:19.283 19:11:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:19.283 19:11:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:19.283 19:11:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:19.283 19:11:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:19.283 19:11:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:19.283 19:11:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:19.283 19:11:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:19.283 19:11:40 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:23:19.283 19:11:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:19.283 19:11:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:19.283 19:11:40 -- common/autotest_common.sh@10 -- # set +x 00:23:19.283 19:11:40 -- nvmf/common.sh@469 -- # nvmfpid=279605 00:23:19.283 19:11:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:23:19.283 19:11:40 -- nvmf/common.sh@470 -- # waitforlisten 279605 00:23:19.283 19:11:40 -- common/autotest_common.sh@829 -- # '[' -z 279605 ']' 00:23:19.283 19:11:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:19.283 19:11:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:19.283 19:11:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:19.283 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:19.283 19:11:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:19.283 19:11:40 -- common/autotest_common.sh@10 -- # set +x 00:23:19.283 [2024-11-28 19:11:40.318403] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:19.283 [2024-11-28 19:11:40.318472] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:19.542 EAL: No free 2048 kB hugepages reported on node 1 00:23:19.542 [2024-11-28 19:11:40.392277] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:23:19.542 [2024-11-28 19:11:40.508141] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:19.542 [2024-11-28 19:11:40.508304] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:19.542 [2024-11-28 19:11:40.508324] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:19.542 [2024-11-28 19:11:40.508339] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:19.542 [2024-11-28 19:11:40.508387] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:20.478 19:11:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:20.478 19:11:41 -- common/autotest_common.sh@862 -- # return 0 00:23:20.478 19:11:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:20.478 19:11:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:20.478 19:11:41 -- common/autotest_common.sh@10 -- # set +x 00:23:20.478 19:11:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:20.478 19:11:41 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:23:20.478 19:11:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.478 19:11:41 -- common/autotest_common.sh@10 -- # set +x 00:23:20.478 [2024-11-28 19:11:41.389262] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:20.478 19:11:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.478 19:11:41 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:23:20.478 19:11:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.478 19:11:41 -- common/autotest_common.sh@10 -- # set +x 00:23:20.478 null0 00:23:20.478 19:11:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.478 19:11:41 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:23:20.478 19:11:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.478 19:11:41 -- common/autotest_common.sh@10 -- # set +x 00:23:20.478 19:11:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.478 19:11:41 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:23:20.478 19:11:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.478 19:11:41 -- common/autotest_common.sh@10 -- # set +x 00:23:20.478 19:11:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.478 19:11:41 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 7b8f968f4cc84bc1b43230f4a33ba9f2 00:23:20.478 19:11:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.478 19:11:41 -- common/autotest_common.sh@10 -- # set +x 00:23:20.478 19:11:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.478 19:11:41 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:23:20.478 19:11:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.478 19:11:41 -- common/autotest_common.sh@10 -- # set +x 00:23:20.478 [2024-11-28 19:11:41.429510] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:20.478 19:11:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.478 19:11:41 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:23:20.478 19:11:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.478 19:11:41 -- common/autotest_common.sh@10 -- # set +x 00:23:20.737 nvme0n1 00:23:20.737 19:11:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.737 19:11:41 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:20.737 19:11:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.737 19:11:41 -- common/autotest_common.sh@10 -- # set +x 00:23:20.737 [ 00:23:20.737 { 00:23:20.737 "name": "nvme0n1", 00:23:20.737 "aliases": [ 00:23:20.737 "7b8f968f-4cc8-4bc1-b432-30f4a33ba9f2" 00:23:20.737 ], 00:23:20.737 "product_name": "NVMe disk", 00:23:20.737 "block_size": 512, 00:23:20.737 "num_blocks": 2097152, 00:23:20.737 "uuid": "7b8f968f-4cc8-4bc1-b432-30f4a33ba9f2", 00:23:20.737 "assigned_rate_limits": { 00:23:20.737 "rw_ios_per_sec": 0, 00:23:20.737 "rw_mbytes_per_sec": 0, 00:23:20.737 "r_mbytes_per_sec": 0, 00:23:20.737 "w_mbytes_per_sec": 0 00:23:20.737 }, 00:23:20.737 "claimed": false, 00:23:20.737 "zoned": false, 00:23:20.737 "supported_io_types": { 00:23:20.737 "read": true, 00:23:20.737 "write": true, 00:23:20.737 "unmap": false, 00:23:20.737 "write_zeroes": true, 00:23:20.737 "flush": true, 00:23:20.737 "reset": true, 00:23:20.737 "compare": true, 00:23:20.737 "compare_and_write": true, 00:23:20.737 "abort": true, 00:23:20.737 "nvme_admin": true, 00:23:20.737 "nvme_io": true 00:23:20.737 }, 00:23:20.737 "driver_specific": { 00:23:20.737 "nvme": [ 00:23:20.737 { 00:23:20.737 "trid": { 00:23:20.737 "trtype": "TCP", 00:23:20.737 "adrfam": "IPv4", 00:23:20.737 "traddr": "10.0.0.2", 00:23:20.737 "trsvcid": "4420", 00:23:20.737 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:20.737 }, 00:23:20.737 "ctrlr_data": { 00:23:20.737 "cntlid": 1, 00:23:20.737 "vendor_id": "0x8086", 00:23:20.737 "model_number": "SPDK bdev Controller", 00:23:20.737 "serial_number": "00000000000000000000", 00:23:20.737 "firmware_revision": "24.01.1", 00:23:20.737 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:20.737 "oacs": { 00:23:20.737 "security": 0, 00:23:20.737 "format": 0, 00:23:20.737 "firmware": 0, 00:23:20.737 "ns_manage": 0 00:23:20.737 }, 00:23:20.737 "multi_ctrlr": true, 00:23:20.737 "ana_reporting": false 00:23:20.737 }, 00:23:20.737 "vs": { 00:23:20.737 "nvme_version": "1.3" 00:23:20.737 }, 00:23:20.737 "ns_data": { 00:23:20.737 "id": 1, 00:23:20.737 "can_share": true 00:23:20.737 } 00:23:20.737 } 00:23:20.737 ], 00:23:20.737 "mp_policy": "active_passive" 00:23:20.737 } 00:23:20.737 } 00:23:20.737 ] 00:23:20.737 19:11:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.737 19:11:41 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:23:20.737 19:11:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.737 19:11:41 -- common/autotest_common.sh@10 -- # set +x 00:23:20.737 [2024-11-28 19:11:41.678045] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:23:20.737 [2024-11-28 19:11:41.678137] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x958ba0 (9): Bad file descriptor 00:23:20.996 [2024-11-28 19:11:41.810564] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:23:20.996 19:11:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.996 19:11:41 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:20.996 19:11:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.996 19:11:41 -- common/autotest_common.sh@10 -- # set +x 00:23:20.996 [ 00:23:20.996 { 00:23:20.996 "name": "nvme0n1", 00:23:20.996 "aliases": [ 00:23:20.996 "7b8f968f-4cc8-4bc1-b432-30f4a33ba9f2" 00:23:20.996 ], 00:23:20.996 "product_name": "NVMe disk", 00:23:20.996 "block_size": 512, 00:23:20.996 "num_blocks": 2097152, 00:23:20.996 "uuid": "7b8f968f-4cc8-4bc1-b432-30f4a33ba9f2", 00:23:20.996 "assigned_rate_limits": { 00:23:20.996 "rw_ios_per_sec": 0, 00:23:20.996 "rw_mbytes_per_sec": 0, 00:23:20.996 "r_mbytes_per_sec": 0, 00:23:20.996 "w_mbytes_per_sec": 0 00:23:20.996 }, 00:23:20.996 "claimed": false, 00:23:20.996 "zoned": false, 00:23:20.996 "supported_io_types": { 00:23:20.996 "read": true, 00:23:20.996 "write": true, 00:23:20.996 "unmap": false, 00:23:20.996 "write_zeroes": true, 00:23:20.996 "flush": true, 00:23:20.996 "reset": true, 00:23:20.996 "compare": true, 00:23:20.996 "compare_and_write": true, 00:23:20.997 "abort": true, 00:23:20.997 "nvme_admin": true, 00:23:20.997 "nvme_io": true 00:23:20.997 }, 00:23:20.997 "driver_specific": { 00:23:20.997 "nvme": [ 00:23:20.997 { 00:23:20.997 "trid": { 00:23:20.997 "trtype": "TCP", 00:23:20.997 "adrfam": "IPv4", 00:23:20.997 "traddr": "10.0.0.2", 00:23:20.997 "trsvcid": "4420", 00:23:20.997 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:20.997 }, 00:23:20.997 "ctrlr_data": { 00:23:20.997 "cntlid": 2, 00:23:20.997 "vendor_id": "0x8086", 00:23:20.997 "model_number": "SPDK bdev Controller", 00:23:20.997 "serial_number": "00000000000000000000", 00:23:20.997 "firmware_revision": "24.01.1", 00:23:20.997 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:20.997 "oacs": { 00:23:20.997 "security": 0, 00:23:20.997 "format": 0, 00:23:20.997 "firmware": 0, 00:23:20.997 "ns_manage": 0 00:23:20.997 }, 00:23:20.997 "multi_ctrlr": true, 00:23:20.997 "ana_reporting": false 00:23:20.997 }, 00:23:20.997 "vs": { 00:23:20.997 "nvme_version": "1.3" 00:23:20.997 }, 00:23:20.997 "ns_data": { 00:23:20.997 "id": 1, 00:23:20.997 "can_share": true 00:23:20.997 } 00:23:20.997 } 00:23:20.997 ], 00:23:20.997 "mp_policy": "active_passive" 00:23:20.997 } 00:23:20.997 } 00:23:20.997 ] 00:23:20.997 19:11:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.997 19:11:41 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:20.997 19:11:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.997 19:11:41 -- common/autotest_common.sh@10 -- # set +x 00:23:20.997 19:11:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.997 19:11:41 -- host/async_init.sh@53 -- # mktemp 00:23:20.997 19:11:41 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.k98sW4ImyO 00:23:20.997 19:11:41 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:23:20.997 19:11:41 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.k98sW4ImyO 00:23:20.997 19:11:41 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:23:20.997 19:11:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.997 19:11:41 -- common/autotest_common.sh@10 -- # set +x 00:23:20.997 19:11:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.997 19:11:41 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:23:20.997 19:11:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.997 19:11:41 -- common/autotest_common.sh@10 -- # set +x 00:23:20.997 [2024-11-28 19:11:41.862686] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:23:20.997 [2024-11-28 19:11:41.862867] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:23:20.997 19:11:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.997 19:11:41 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.k98sW4ImyO 00:23:20.997 19:11:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.997 19:11:41 -- common/autotest_common.sh@10 -- # set +x 00:23:20.997 19:11:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.997 19:11:41 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.k98sW4ImyO 00:23:20.997 19:11:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.997 19:11:41 -- common/autotest_common.sh@10 -- # set +x 00:23:20.997 [2024-11-28 19:11:41.878719] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:23:20.997 nvme0n1 00:23:20.997 19:11:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.997 19:11:41 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:23:20.997 19:11:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.997 19:11:41 -- common/autotest_common.sh@10 -- # set +x 00:23:20.997 [ 00:23:20.997 { 00:23:20.997 "name": "nvme0n1", 00:23:20.997 "aliases": [ 00:23:20.997 "7b8f968f-4cc8-4bc1-b432-30f4a33ba9f2" 00:23:20.997 ], 00:23:20.997 "product_name": "NVMe disk", 00:23:20.997 "block_size": 512, 00:23:20.997 "num_blocks": 2097152, 00:23:20.997 "uuid": "7b8f968f-4cc8-4bc1-b432-30f4a33ba9f2", 00:23:20.997 "assigned_rate_limits": { 00:23:20.997 "rw_ios_per_sec": 0, 00:23:20.997 "rw_mbytes_per_sec": 0, 00:23:20.997 "r_mbytes_per_sec": 0, 00:23:20.997 "w_mbytes_per_sec": 0 00:23:20.997 }, 00:23:20.997 "claimed": false, 00:23:20.997 "zoned": false, 00:23:20.997 "supported_io_types": { 00:23:20.997 "read": true, 00:23:20.997 "write": true, 00:23:20.997 "unmap": false, 00:23:20.997 "write_zeroes": true, 00:23:20.997 "flush": true, 00:23:20.997 "reset": true, 00:23:20.997 "compare": true, 00:23:20.997 "compare_and_write": true, 00:23:20.997 "abort": true, 00:23:20.997 "nvme_admin": true, 00:23:20.997 "nvme_io": true 00:23:20.997 }, 00:23:20.997 "driver_specific": { 00:23:20.997 "nvme": [ 00:23:20.997 { 00:23:20.997 "trid": { 00:23:20.997 "trtype": "TCP", 00:23:20.997 "adrfam": "IPv4", 00:23:20.997 "traddr": "10.0.0.2", 00:23:20.997 "trsvcid": "4421", 00:23:20.997 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:23:20.997 }, 00:23:20.997 "ctrlr_data": { 00:23:20.997 "cntlid": 3, 00:23:20.997 "vendor_id": "0x8086", 00:23:20.997 "model_number": "SPDK bdev Controller", 00:23:20.997 "serial_number": "00000000000000000000", 00:23:20.997 "firmware_revision": "24.01.1", 00:23:20.997 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:23:20.997 "oacs": { 00:23:20.997 "security": 0, 00:23:20.997 "format": 0, 00:23:20.997 "firmware": 0, 00:23:20.997 "ns_manage": 0 00:23:20.997 }, 00:23:20.997 "multi_ctrlr": true, 00:23:20.997 "ana_reporting": false 00:23:20.997 }, 00:23:20.997 "vs": { 00:23:20.997 "nvme_version": "1.3" 00:23:20.997 }, 00:23:20.997 "ns_data": { 00:23:20.997 "id": 1, 00:23:20.997 "can_share": true 00:23:20.997 } 00:23:20.997 } 00:23:20.997 ], 00:23:20.997 "mp_policy": "active_passive" 00:23:20.997 } 00:23:20.997 } 00:23:20.997 ] 00:23:20.997 19:11:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.997 19:11:41 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:23:20.997 19:11:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:20.997 19:11:41 -- common/autotest_common.sh@10 -- # set +x 00:23:20.997 19:11:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:20.997 19:11:41 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.k98sW4ImyO 00:23:20.997 19:11:41 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:23:20.997 19:11:41 -- host/async_init.sh@78 -- # nvmftestfini 00:23:20.997 19:11:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:20.997 19:11:41 -- nvmf/common.sh@116 -- # sync 00:23:20.997 19:11:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:20.997 19:11:41 -- nvmf/common.sh@119 -- # set +e 00:23:20.997 19:11:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:20.997 19:11:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:20.997 rmmod nvme_tcp 00:23:20.997 rmmod nvme_fabrics 00:23:20.997 rmmod nvme_keyring 00:23:20.997 19:11:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:20.997 19:11:42 -- nvmf/common.sh@123 -- # set -e 00:23:20.997 19:11:42 -- nvmf/common.sh@124 -- # return 0 00:23:20.997 19:11:42 -- nvmf/common.sh@477 -- # '[' -n 279605 ']' 00:23:20.997 19:11:42 -- nvmf/common.sh@478 -- # killprocess 279605 00:23:20.997 19:11:42 -- common/autotest_common.sh@936 -- # '[' -z 279605 ']' 00:23:20.997 19:11:42 -- common/autotest_common.sh@940 -- # kill -0 279605 00:23:20.997 19:11:42 -- common/autotest_common.sh@941 -- # uname 00:23:20.997 19:11:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:20.997 19:11:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 279605 00:23:21.257 19:11:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:21.257 19:11:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:21.257 19:11:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 279605' 00:23:21.257 killing process with pid 279605 00:23:21.257 19:11:42 -- common/autotest_common.sh@955 -- # kill 279605 00:23:21.257 19:11:42 -- common/autotest_common.sh@960 -- # wait 279605 00:23:21.519 19:11:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:21.519 19:11:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:21.519 19:11:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:21.519 19:11:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:21.519 19:11:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:21.519 19:11:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:21.519 19:11:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:21.519 19:11:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:23.421 19:11:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:23.421 00:23:23.421 real 0m6.459s 00:23:23.421 user 0m3.224s 00:23:23.421 sys 0m1.826s 00:23:23.421 19:11:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:23.421 19:11:44 -- common/autotest_common.sh@10 -- # set +x 00:23:23.421 ************************************ 00:23:23.421 END TEST nvmf_async_init 00:23:23.421 ************************************ 00:23:23.421 19:11:44 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:23:23.421 19:11:44 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:23.421 19:11:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:23.421 19:11:44 -- common/autotest_common.sh@10 -- # set +x 00:23:23.421 ************************************ 00:23:23.421 START TEST dma 00:23:23.421 ************************************ 00:23:23.421 19:11:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:23:23.421 * Looking for test storage... 00:23:23.421 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:23.421 19:11:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:23.421 19:11:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:23.421 19:11:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:23.679 19:11:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:23.679 19:11:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:23.679 19:11:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:23.679 19:11:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:23.679 19:11:44 -- scripts/common.sh@335 -- # IFS=.-: 00:23:23.679 19:11:44 -- scripts/common.sh@335 -- # read -ra ver1 00:23:23.679 19:11:44 -- scripts/common.sh@336 -- # IFS=.-: 00:23:23.679 19:11:44 -- scripts/common.sh@336 -- # read -ra ver2 00:23:23.679 19:11:44 -- scripts/common.sh@337 -- # local 'op=<' 00:23:23.679 19:11:44 -- scripts/common.sh@339 -- # ver1_l=2 00:23:23.679 19:11:44 -- scripts/common.sh@340 -- # ver2_l=1 00:23:23.679 19:11:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:23.679 19:11:44 -- scripts/common.sh@343 -- # case "$op" in 00:23:23.679 19:11:44 -- scripts/common.sh@344 -- # : 1 00:23:23.679 19:11:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:23.679 19:11:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:23.679 19:11:44 -- scripts/common.sh@364 -- # decimal 1 00:23:23.679 19:11:44 -- scripts/common.sh@352 -- # local d=1 00:23:23.679 19:11:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:23.679 19:11:44 -- scripts/common.sh@354 -- # echo 1 00:23:23.679 19:11:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:23.679 19:11:44 -- scripts/common.sh@365 -- # decimal 2 00:23:23.679 19:11:44 -- scripts/common.sh@352 -- # local d=2 00:23:23.679 19:11:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:23.679 19:11:44 -- scripts/common.sh@354 -- # echo 2 00:23:23.679 19:11:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:23.679 19:11:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:23.679 19:11:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:23.679 19:11:44 -- scripts/common.sh@367 -- # return 0 00:23:23.679 19:11:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:23.679 19:11:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:23.679 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:23.679 --rc genhtml_branch_coverage=1 00:23:23.679 --rc genhtml_function_coverage=1 00:23:23.679 --rc genhtml_legend=1 00:23:23.679 --rc geninfo_all_blocks=1 00:23:23.679 --rc geninfo_unexecuted_blocks=1 00:23:23.679 00:23:23.679 ' 00:23:23.679 19:11:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:23.679 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:23.679 --rc genhtml_branch_coverage=1 00:23:23.679 --rc genhtml_function_coverage=1 00:23:23.679 --rc genhtml_legend=1 00:23:23.679 --rc geninfo_all_blocks=1 00:23:23.679 --rc geninfo_unexecuted_blocks=1 00:23:23.679 00:23:23.679 ' 00:23:23.679 19:11:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:23.679 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:23.679 --rc genhtml_branch_coverage=1 00:23:23.679 --rc genhtml_function_coverage=1 00:23:23.679 --rc genhtml_legend=1 00:23:23.679 --rc geninfo_all_blocks=1 00:23:23.679 --rc geninfo_unexecuted_blocks=1 00:23:23.679 00:23:23.679 ' 00:23:23.679 19:11:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:23.679 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:23.679 --rc genhtml_branch_coverage=1 00:23:23.679 --rc genhtml_function_coverage=1 00:23:23.679 --rc genhtml_legend=1 00:23:23.679 --rc geninfo_all_blocks=1 00:23:23.679 --rc geninfo_unexecuted_blocks=1 00:23:23.679 00:23:23.679 ' 00:23:23.679 19:11:44 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:23.679 19:11:44 -- nvmf/common.sh@7 -- # uname -s 00:23:23.679 19:11:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:23.679 19:11:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:23.679 19:11:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:23.679 19:11:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:23.679 19:11:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:23.679 19:11:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:23.679 19:11:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:23.679 19:11:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:23.679 19:11:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:23.679 19:11:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:23.679 19:11:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:23.679 19:11:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:23.679 19:11:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:23.679 19:11:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:23.679 19:11:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:23.679 19:11:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:23.679 19:11:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:23.679 19:11:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:23.679 19:11:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:23.680 19:11:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:23.680 19:11:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:23.680 19:11:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:23.680 19:11:44 -- paths/export.sh@5 -- # export PATH 00:23:23.680 19:11:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:23.680 19:11:44 -- nvmf/common.sh@46 -- # : 0 00:23:23.680 19:11:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:23.680 19:11:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:23.680 19:11:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:23.680 19:11:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:23.680 19:11:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:23.680 19:11:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:23.680 19:11:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:23.680 19:11:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:23.680 19:11:44 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:23:23.680 19:11:44 -- host/dma.sh@13 -- # exit 0 00:23:23.680 00:23:23.680 real 0m0.175s 00:23:23.680 user 0m0.121s 00:23:23.680 sys 0m0.063s 00:23:23.680 19:11:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:23.680 19:11:44 -- common/autotest_common.sh@10 -- # set +x 00:23:23.680 ************************************ 00:23:23.680 END TEST dma 00:23:23.680 ************************************ 00:23:23.680 19:11:44 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:23:23.680 19:11:44 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:23.680 19:11:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:23.680 19:11:44 -- common/autotest_common.sh@10 -- # set +x 00:23:23.680 ************************************ 00:23:23.680 START TEST nvmf_identify 00:23:23.680 ************************************ 00:23:23.680 19:11:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:23:23.680 * Looking for test storage... 00:23:23.680 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:23.680 19:11:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:23.680 19:11:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:23.680 19:11:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:23.680 19:11:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:23.680 19:11:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:23.680 19:11:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:23.680 19:11:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:23.680 19:11:44 -- scripts/common.sh@335 -- # IFS=.-: 00:23:23.680 19:11:44 -- scripts/common.sh@335 -- # read -ra ver1 00:23:23.680 19:11:44 -- scripts/common.sh@336 -- # IFS=.-: 00:23:23.680 19:11:44 -- scripts/common.sh@336 -- # read -ra ver2 00:23:23.680 19:11:44 -- scripts/common.sh@337 -- # local 'op=<' 00:23:23.680 19:11:44 -- scripts/common.sh@339 -- # ver1_l=2 00:23:23.680 19:11:44 -- scripts/common.sh@340 -- # ver2_l=1 00:23:23.680 19:11:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:23.680 19:11:44 -- scripts/common.sh@343 -- # case "$op" in 00:23:23.680 19:11:44 -- scripts/common.sh@344 -- # : 1 00:23:23.680 19:11:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:23.680 19:11:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:23.680 19:11:44 -- scripts/common.sh@364 -- # decimal 1 00:23:23.680 19:11:44 -- scripts/common.sh@352 -- # local d=1 00:23:23.680 19:11:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:23.680 19:11:44 -- scripts/common.sh@354 -- # echo 1 00:23:23.680 19:11:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:23.680 19:11:44 -- scripts/common.sh@365 -- # decimal 2 00:23:23.938 19:11:44 -- scripts/common.sh@352 -- # local d=2 00:23:23.938 19:11:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:23.938 19:11:44 -- scripts/common.sh@354 -- # echo 2 00:23:23.938 19:11:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:23.938 19:11:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:23.938 19:11:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:23.938 19:11:44 -- scripts/common.sh@367 -- # return 0 00:23:23.938 19:11:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:23.938 19:11:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:23.938 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:23.938 --rc genhtml_branch_coverage=1 00:23:23.938 --rc genhtml_function_coverage=1 00:23:23.938 --rc genhtml_legend=1 00:23:23.938 --rc geninfo_all_blocks=1 00:23:23.938 --rc geninfo_unexecuted_blocks=1 00:23:23.938 00:23:23.938 ' 00:23:23.938 19:11:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:23.938 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:23.938 --rc genhtml_branch_coverage=1 00:23:23.938 --rc genhtml_function_coverage=1 00:23:23.938 --rc genhtml_legend=1 00:23:23.938 --rc geninfo_all_blocks=1 00:23:23.938 --rc geninfo_unexecuted_blocks=1 00:23:23.938 00:23:23.938 ' 00:23:23.938 19:11:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:23.938 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:23.938 --rc genhtml_branch_coverage=1 00:23:23.938 --rc genhtml_function_coverage=1 00:23:23.938 --rc genhtml_legend=1 00:23:23.939 --rc geninfo_all_blocks=1 00:23:23.939 --rc geninfo_unexecuted_blocks=1 00:23:23.939 00:23:23.939 ' 00:23:23.939 19:11:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:23.939 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:23.939 --rc genhtml_branch_coverage=1 00:23:23.939 --rc genhtml_function_coverage=1 00:23:23.939 --rc genhtml_legend=1 00:23:23.939 --rc geninfo_all_blocks=1 00:23:23.939 --rc geninfo_unexecuted_blocks=1 00:23:23.939 00:23:23.939 ' 00:23:23.939 19:11:44 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:23.939 19:11:44 -- nvmf/common.sh@7 -- # uname -s 00:23:23.939 19:11:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:23.939 19:11:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:23.939 19:11:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:23.939 19:11:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:23.939 19:11:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:23.939 19:11:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:23.939 19:11:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:23.939 19:11:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:23.939 19:11:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:23.939 19:11:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:23.939 19:11:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:23.939 19:11:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:23.939 19:11:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:23.939 19:11:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:23.939 19:11:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:23.939 19:11:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:23.939 19:11:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:23.939 19:11:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:23.939 19:11:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:23.939 19:11:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:23.939 19:11:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:23.939 19:11:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:23.939 19:11:44 -- paths/export.sh@5 -- # export PATH 00:23:23.939 19:11:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:23.939 19:11:44 -- nvmf/common.sh@46 -- # : 0 00:23:23.939 19:11:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:23.939 19:11:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:23.939 19:11:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:23.939 19:11:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:23.939 19:11:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:23.939 19:11:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:23.939 19:11:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:23.939 19:11:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:23.939 19:11:44 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:23.939 19:11:44 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:23.939 19:11:44 -- host/identify.sh@14 -- # nvmftestinit 00:23:23.939 19:11:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:23.939 19:11:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:23.939 19:11:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:23.939 19:11:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:23.939 19:11:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:23.939 19:11:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:23.939 19:11:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:23.939 19:11:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:23.939 19:11:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:23.939 19:11:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:23.939 19:11:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:23.939 19:11:44 -- common/autotest_common.sh@10 -- # set +x 00:23:25.838 19:11:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:25.838 19:11:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:25.838 19:11:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:25.838 19:11:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:25.838 19:11:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:25.838 19:11:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:25.838 19:11:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:25.838 19:11:46 -- nvmf/common.sh@294 -- # net_devs=() 00:23:25.838 19:11:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:25.838 19:11:46 -- nvmf/common.sh@295 -- # e810=() 00:23:25.838 19:11:46 -- nvmf/common.sh@295 -- # local -ga e810 00:23:25.838 19:11:46 -- nvmf/common.sh@296 -- # x722=() 00:23:25.838 19:11:46 -- nvmf/common.sh@296 -- # local -ga x722 00:23:25.838 19:11:46 -- nvmf/common.sh@297 -- # mlx=() 00:23:25.838 19:11:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:25.838 19:11:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:25.838 19:11:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:25.838 19:11:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:25.838 19:11:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:25.838 19:11:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:25.838 19:11:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:25.838 19:11:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:25.838 19:11:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:25.838 19:11:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:25.838 19:11:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:25.838 19:11:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:25.838 19:11:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:25.838 19:11:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:25.838 19:11:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:25.838 19:11:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:25.838 19:11:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:25.838 19:11:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:25.838 19:11:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:25.838 19:11:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:25.838 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:25.839 19:11:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:25.839 19:11:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:25.839 19:11:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:25.839 19:11:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:25.839 19:11:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:25.839 19:11:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:25.839 19:11:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:25.839 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:25.839 19:11:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:25.839 19:11:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:25.839 19:11:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:25.839 19:11:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:25.839 19:11:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:25.839 19:11:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:25.839 19:11:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:25.839 19:11:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:25.839 19:11:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:25.839 19:11:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:25.839 19:11:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:25.839 19:11:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:25.839 19:11:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:25.839 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:25.839 19:11:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:25.839 19:11:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:25.839 19:11:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:25.839 19:11:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:25.839 19:11:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:25.839 19:11:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:25.839 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:25.839 19:11:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:25.839 19:11:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:25.839 19:11:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:25.839 19:11:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:25.839 19:11:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:25.839 19:11:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:25.839 19:11:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:25.839 19:11:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:25.839 19:11:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:25.839 19:11:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:25.839 19:11:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:25.839 19:11:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:25.839 19:11:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:25.839 19:11:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:25.839 19:11:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:25.839 19:11:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:25.839 19:11:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:25.839 19:11:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:25.839 19:11:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:25.839 19:11:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:25.839 19:11:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:25.839 19:11:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:25.839 19:11:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:25.839 19:11:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:25.839 19:11:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:25.839 19:11:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:25.839 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:25.839 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.211 ms 00:23:25.839 00:23:25.839 --- 10.0.0.2 ping statistics --- 00:23:25.839 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:25.839 rtt min/avg/max/mdev = 0.211/0.211/0.211/0.000 ms 00:23:25.839 19:11:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:25.839 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:25.839 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.076 ms 00:23:25.839 00:23:25.839 --- 10.0.0.1 ping statistics --- 00:23:25.839 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:25.839 rtt min/avg/max/mdev = 0.076/0.076/0.076/0.000 ms 00:23:25.839 19:11:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:25.839 19:11:46 -- nvmf/common.sh@410 -- # return 0 00:23:25.839 19:11:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:25.839 19:11:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:25.839 19:11:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:25.839 19:11:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:25.839 19:11:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:25.839 19:11:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:25.839 19:11:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:25.839 19:11:46 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:23:25.839 19:11:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:25.839 19:11:46 -- common/autotest_common.sh@10 -- # set +x 00:23:25.839 19:11:46 -- host/identify.sh@19 -- # nvmfpid=281894 00:23:25.839 19:11:46 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:25.839 19:11:46 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:23:25.839 19:11:46 -- host/identify.sh@23 -- # waitforlisten 281894 00:23:25.839 19:11:46 -- common/autotest_common.sh@829 -- # '[' -z 281894 ']' 00:23:25.839 19:11:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:25.839 19:11:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:25.839 19:11:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:25.839 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:25.839 19:11:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:25.839 19:11:46 -- common/autotest_common.sh@10 -- # set +x 00:23:25.839 [2024-11-28 19:11:46.881125] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:25.839 [2024-11-28 19:11:46.881214] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:26.099 EAL: No free 2048 kB hugepages reported on node 1 00:23:26.099 [2024-11-28 19:11:46.944772] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:26.099 [2024-11-28 19:11:47.051398] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:26.099 [2024-11-28 19:11:47.051545] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:26.099 [2024-11-28 19:11:47.051561] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:26.099 [2024-11-28 19:11:47.051572] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:26.099 [2024-11-28 19:11:47.051795] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:26.099 [2024-11-28 19:11:47.051856] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:26.099 [2024-11-28 19:11:47.051923] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:26.099 [2024-11-28 19:11:47.051925] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:27.037 19:11:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:27.037 19:11:47 -- common/autotest_common.sh@862 -- # return 0 00:23:27.037 19:11:47 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:27.037 19:11:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:27.037 19:11:47 -- common/autotest_common.sh@10 -- # set +x 00:23:27.037 [2024-11-28 19:11:47.833866] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:27.037 19:11:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:27.038 19:11:47 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:23:27.038 19:11:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:27.038 19:11:47 -- common/autotest_common.sh@10 -- # set +x 00:23:27.038 19:11:47 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:27.038 19:11:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:27.038 19:11:47 -- common/autotest_common.sh@10 -- # set +x 00:23:27.038 Malloc0 00:23:27.038 19:11:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:27.038 19:11:47 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:27.038 19:11:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:27.038 19:11:47 -- common/autotest_common.sh@10 -- # set +x 00:23:27.038 19:11:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:27.038 19:11:47 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:23:27.038 19:11:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:27.038 19:11:47 -- common/autotest_common.sh@10 -- # set +x 00:23:27.038 19:11:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:27.038 19:11:47 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:27.038 19:11:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:27.038 19:11:47 -- common/autotest_common.sh@10 -- # set +x 00:23:27.038 [2024-11-28 19:11:47.915663] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:27.038 19:11:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:27.038 19:11:47 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:27.038 19:11:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:27.038 19:11:47 -- common/autotest_common.sh@10 -- # set +x 00:23:27.038 19:11:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:27.038 19:11:47 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:23:27.038 19:11:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:27.038 19:11:47 -- common/autotest_common.sh@10 -- # set +x 00:23:27.038 [2024-11-28 19:11:47.931386] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:23:27.038 [ 00:23:27.038 { 00:23:27.038 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:23:27.038 "subtype": "Discovery", 00:23:27.038 "listen_addresses": [ 00:23:27.038 { 00:23:27.038 "transport": "TCP", 00:23:27.038 "trtype": "TCP", 00:23:27.038 "adrfam": "IPv4", 00:23:27.038 "traddr": "10.0.0.2", 00:23:27.038 "trsvcid": "4420" 00:23:27.038 } 00:23:27.038 ], 00:23:27.038 "allow_any_host": true, 00:23:27.038 "hosts": [] 00:23:27.038 }, 00:23:27.038 { 00:23:27.038 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:23:27.038 "subtype": "NVMe", 00:23:27.038 "listen_addresses": [ 00:23:27.038 { 00:23:27.038 "transport": "TCP", 00:23:27.038 "trtype": "TCP", 00:23:27.038 "adrfam": "IPv4", 00:23:27.038 "traddr": "10.0.0.2", 00:23:27.038 "trsvcid": "4420" 00:23:27.038 } 00:23:27.038 ], 00:23:27.038 "allow_any_host": true, 00:23:27.038 "hosts": [], 00:23:27.038 "serial_number": "SPDK00000000000001", 00:23:27.038 "model_number": "SPDK bdev Controller", 00:23:27.038 "max_namespaces": 32, 00:23:27.038 "min_cntlid": 1, 00:23:27.038 "max_cntlid": 65519, 00:23:27.038 "namespaces": [ 00:23:27.038 { 00:23:27.038 "nsid": 1, 00:23:27.038 "bdev_name": "Malloc0", 00:23:27.038 "name": "Malloc0", 00:23:27.038 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:23:27.038 "eui64": "ABCDEF0123456789", 00:23:27.038 "uuid": "abc1eb83-770c-42df-93f2-d3b7135d5411" 00:23:27.038 } 00:23:27.038 ] 00:23:27.038 } 00:23:27.038 ] 00:23:27.038 19:11:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:27.038 19:11:47 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:23:27.038 [2024-11-28 19:11:47.957645] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:27.038 [2024-11-28 19:11:47.957687] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid282050 ] 00:23:27.038 EAL: No free 2048 kB hugepages reported on node 1 00:23:27.038 [2024-11-28 19:11:47.993722] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:23:27.038 [2024-11-28 19:11:47.993781] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:23:27.038 [2024-11-28 19:11:47.993796] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:23:27.038 [2024-11-28 19:11:47.993815] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:23:27.038 [2024-11-28 19:11:47.993828] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:23:27.038 [2024-11-28 19:11:47.994098] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:23:27.038 [2024-11-28 19:11:47.994165] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x22bee10 0 00:23:27.038 [2024-11-28 19:11:48.000415] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:23:27.038 [2024-11-28 19:11:48.000436] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:23:27.038 [2024-11-28 19:11:48.000445] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:23:27.038 [2024-11-28 19:11:48.000451] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:23:27.038 [2024-11-28 19:11:48.000502] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.038 [2024-11-28 19:11:48.000515] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.038 [2024-11-28 19:11:48.000522] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x22bee10) 00:23:27.038 [2024-11-28 19:11:48.000541] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:23:27.038 [2024-11-28 19:11:48.000568] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x233eb30, cid 0, qid 0 00:23:27.038 [2024-11-28 19:11:48.008405] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.038 [2024-11-28 19:11:48.008423] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.038 [2024-11-28 19:11:48.008430] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.038 [2024-11-28 19:11:48.008438] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x233eb30) on tqpair=0x22bee10 00:23:27.038 [2024-11-28 19:11:48.008459] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:23:27.038 [2024-11-28 19:11:48.008471] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:23:27.038 [2024-11-28 19:11:48.008480] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:23:27.038 [2024-11-28 19:11:48.008500] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.038 [2024-11-28 19:11:48.008509] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.038 [2024-11-28 19:11:48.008515] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x22bee10) 00:23:27.038 [2024-11-28 19:11:48.008527] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.038 [2024-11-28 19:11:48.008550] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x233eb30, cid 0, qid 0 00:23:27.038 [2024-11-28 19:11:48.008645] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.038 [2024-11-28 19:11:48.008657] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.038 [2024-11-28 19:11:48.008664] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.038 [2024-11-28 19:11:48.008670] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x233eb30) on tqpair=0x22bee10 00:23:27.038 [2024-11-28 19:11:48.008680] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:23:27.038 [2024-11-28 19:11:48.008693] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:23:27.038 [2024-11-28 19:11:48.008705] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.038 [2024-11-28 19:11:48.008712] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.038 [2024-11-28 19:11:48.008718] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x22bee10) 00:23:27.038 [2024-11-28 19:11:48.008734] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.038 [2024-11-28 19:11:48.008755] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x233eb30, cid 0, qid 0 00:23:27.038 [2024-11-28 19:11:48.008842] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.038 [2024-11-28 19:11:48.008856] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.038 [2024-11-28 19:11:48.008862] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.038 [2024-11-28 19:11:48.008869] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x233eb30) on tqpair=0x22bee10 00:23:27.038 [2024-11-28 19:11:48.008878] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:23:27.038 [2024-11-28 19:11:48.008892] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:23:27.038 [2024-11-28 19:11:48.008903] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.038 [2024-11-28 19:11:48.008910] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.038 [2024-11-28 19:11:48.008917] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x22bee10) 00:23:27.038 [2024-11-28 19:11:48.008927] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.038 [2024-11-28 19:11:48.008948] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x233eb30, cid 0, qid 0 00:23:27.038 [2024-11-28 19:11:48.009028] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.038 [2024-11-28 19:11:48.009042] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.038 [2024-11-28 19:11:48.009048] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.038 [2024-11-28 19:11:48.009055] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x233eb30) on tqpair=0x22bee10 00:23:27.038 [2024-11-28 19:11:48.009065] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:23:27.038 [2024-11-28 19:11:48.009081] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.039 [2024-11-28 19:11:48.009090] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.039 [2024-11-28 19:11:48.009096] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x22bee10) 00:23:27.039 [2024-11-28 19:11:48.009106] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.039 [2024-11-28 19:11:48.009127] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x233eb30, cid 0, qid 0 00:23:27.039 [2024-11-28 19:11:48.009203] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.039 [2024-11-28 19:11:48.009216] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.039 [2024-11-28 19:11:48.009223] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.039 [2024-11-28 19:11:48.009229] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x233eb30) on tqpair=0x22bee10 00:23:27.039 [2024-11-28 19:11:48.009239] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:23:27.039 [2024-11-28 19:11:48.009247] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:23:27.039 [2024-11-28 19:11:48.009260] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:23:27.039 [2024-11-28 19:11:48.009370] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:23:27.039 [2024-11-28 19:11:48.009378] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:23:27.039 [2024-11-28 19:11:48.009406] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.039 [2024-11-28 19:11:48.009416] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.039 [2024-11-28 19:11:48.009423] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x22bee10) 00:23:27.039 [2024-11-28 19:11:48.009433] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.039 [2024-11-28 19:11:48.009455] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x233eb30, cid 0, qid 0 00:23:27.039 [2024-11-28 19:11:48.009540] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.039 [2024-11-28 19:11:48.009552] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.039 [2024-11-28 19:11:48.009558] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.039 [2024-11-28 19:11:48.009564] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x233eb30) on tqpair=0x22bee10 00:23:27.039 [2024-11-28 19:11:48.009574] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:23:27.039 [2024-11-28 19:11:48.009589] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.039 [2024-11-28 19:11:48.009598] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.039 [2024-11-28 19:11:48.009604] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x22bee10) 00:23:27.039 [2024-11-28 19:11:48.009614] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.039 [2024-11-28 19:11:48.009634] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x233eb30, cid 0, qid 0 00:23:27.039 [2024-11-28 19:11:48.009708] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.039 [2024-11-28 19:11:48.009719] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.039 [2024-11-28 19:11:48.009726] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.039 [2024-11-28 19:11:48.009732] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x233eb30) on tqpair=0x22bee10 00:23:27.039 [2024-11-28 19:11:48.009741] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:23:27.039 [2024-11-28 19:11:48.009749] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:23:27.039 [2024-11-28 19:11:48.009761] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:23:27.039 [2024-11-28 19:11:48.009780] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:23:27.039 [2024-11-28 19:11:48.009795] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.039 [2024-11-28 19:11:48.009803] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.039 [2024-11-28 19:11:48.009810] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x22bee10) 00:23:27.039 [2024-11-28 19:11:48.009820] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.039 [2024-11-28 19:11:48.009841] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x233eb30, cid 0, qid 0 00:23:27.039 [2024-11-28 19:11:48.009949] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:27.039 [2024-11-28 19:11:48.009961] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:27.039 [2024-11-28 19:11:48.009970] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:27.039 [2024-11-28 19:11:48.009979] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x22bee10): datao=0, datal=4096, cccid=0 00:23:27.039 [2024-11-28 19:11:48.009987] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x233eb30) on tqpair(0x22bee10): expected_datao=0, payload_size=4096 00:23:27.039 [2024-11-28 19:11:48.010012] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:27.039 [2024-11-28 19:11:48.010022] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:27.039 [2024-11-28 19:11:48.010035] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.039 [2024-11-28 19:11:48.010044] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.039 [2024-11-28 19:11:48.010051] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.039 [2024-11-28 19:11:48.010057] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x233eb30) on tqpair=0x22bee10 00:23:27.039 [2024-11-28 19:11:48.010070] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:23:27.039 [2024-11-28 19:11:48.010079] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:23:27.039 [2024-11-28 19:11:48.010086] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:23:27.039 [2024-11-28 19:11:48.010094] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:23:27.039 [2024-11-28 19:11:48.010102] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:23:27.039 [2024-11-28 19:11:48.010109] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:23:27.039 [2024-11-28 19:11:48.010128] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:23:27.039 [2024-11-28 19:11:48.010142] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.039 [2024-11-28 19:11:48.010150] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.039 [2024-11-28 19:11:48.010156] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x22bee10) 00:23:27.039 [2024-11-28 19:11:48.010167] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:27.039 [2024-11-28 19:11:48.010188] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x233eb30, cid 0, qid 0 00:23:27.039 [2024-11-28 19:11:48.010270] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.039 [2024-11-28 19:11:48.010281] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.039 [2024-11-28 19:11:48.010288] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.039 [2024-11-28 19:11:48.010294] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x233eb30) on tqpair=0x22bee10 00:23:27.039 [2024-11-28 19:11:48.010307] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.039 [2024-11-28 19:11:48.010314] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.039 [2024-11-28 19:11:48.010320] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x22bee10) 00:23:27.039 [2024-11-28 19:11:48.010330] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:27.039 [2024-11-28 19:11:48.010340] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.039 [2024-11-28 19:11:48.010346] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.039 [2024-11-28 19:11:48.010352] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x22bee10) 00:23:27.039 [2024-11-28 19:11:48.010361] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:27.039 [2024-11-28 19:11:48.010371] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.039 [2024-11-28 19:11:48.010377] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.039 [2024-11-28 19:11:48.010383] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x22bee10) 00:23:27.039 [2024-11-28 19:11:48.010400] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:27.039 [2024-11-28 19:11:48.010416] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.039 [2024-11-28 19:11:48.010424] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.039 [2024-11-28 19:11:48.010430] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x22bee10) 00:23:27.039 [2024-11-28 19:11:48.010439] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:27.039 [2024-11-28 19:11:48.010447] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:23:27.039 [2024-11-28 19:11:48.010466] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:23:27.039 [2024-11-28 19:11:48.010479] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.039 [2024-11-28 19:11:48.010485] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.039 [2024-11-28 19:11:48.010491] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x22bee10) 00:23:27.039 [2024-11-28 19:11:48.010502] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.039 [2024-11-28 19:11:48.010524] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x233eb30, cid 0, qid 0 00:23:27.039 [2024-11-28 19:11:48.010535] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x233ec90, cid 1, qid 0 00:23:27.039 [2024-11-28 19:11:48.010543] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x233edf0, cid 2, qid 0 00:23:27.039 [2024-11-28 19:11:48.010550] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x233ef50, cid 3, qid 0 00:23:27.039 [2024-11-28 19:11:48.010558] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x233f0b0, cid 4, qid 0 00:23:27.039 [2024-11-28 19:11:48.010702] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.039 [2024-11-28 19:11:48.010714] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.039 [2024-11-28 19:11:48.010721] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.040 [2024-11-28 19:11:48.010727] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x233f0b0) on tqpair=0x22bee10 00:23:27.040 [2024-11-28 19:11:48.010737] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:23:27.040 [2024-11-28 19:11:48.010745] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:23:27.040 [2024-11-28 19:11:48.010762] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.040 [2024-11-28 19:11:48.010771] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.040 [2024-11-28 19:11:48.010777] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x22bee10) 00:23:27.040 [2024-11-28 19:11:48.010787] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.040 [2024-11-28 19:11:48.010808] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x233f0b0, cid 4, qid 0 00:23:27.040 [2024-11-28 19:11:48.010900] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:27.040 [2024-11-28 19:11:48.010915] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:27.040 [2024-11-28 19:11:48.010922] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:27.040 [2024-11-28 19:11:48.010928] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x22bee10): datao=0, datal=4096, cccid=4 00:23:27.040 [2024-11-28 19:11:48.010936] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x233f0b0) on tqpair(0x22bee10): expected_datao=0, payload_size=4096 00:23:27.040 [2024-11-28 19:11:48.010953] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:27.040 [2024-11-28 19:11:48.010962] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:27.040 [2024-11-28 19:11:48.052408] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.040 [2024-11-28 19:11:48.052426] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.040 [2024-11-28 19:11:48.052433] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.040 [2024-11-28 19:11:48.052440] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x233f0b0) on tqpair=0x22bee10 00:23:27.040 [2024-11-28 19:11:48.052461] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:23:27.040 [2024-11-28 19:11:48.052498] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.040 [2024-11-28 19:11:48.052508] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.040 [2024-11-28 19:11:48.052515] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x22bee10) 00:23:27.040 [2024-11-28 19:11:48.052526] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.040 [2024-11-28 19:11:48.052537] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.040 [2024-11-28 19:11:48.052544] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.040 [2024-11-28 19:11:48.052550] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x22bee10) 00:23:27.040 [2024-11-28 19:11:48.052558] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:23:27.040 [2024-11-28 19:11:48.052585] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x233f0b0, cid 4, qid 0 00:23:27.040 [2024-11-28 19:11:48.052613] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x233f210, cid 5, qid 0 00:23:27.040 [2024-11-28 19:11:48.052760] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:27.040 [2024-11-28 19:11:48.052774] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:27.040 [2024-11-28 19:11:48.052781] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:27.040 [2024-11-28 19:11:48.052787] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x22bee10): datao=0, datal=1024, cccid=4 00:23:27.040 [2024-11-28 19:11:48.052794] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x233f0b0) on tqpair(0x22bee10): expected_datao=0, payload_size=1024 00:23:27.040 [2024-11-28 19:11:48.052805] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:27.040 [2024-11-28 19:11:48.052812] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:27.040 [2024-11-28 19:11:48.052821] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.040 [2024-11-28 19:11:48.052829] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.040 [2024-11-28 19:11:48.052835] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.040 [2024-11-28 19:11:48.052842] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x233f210) on tqpair=0x22bee10 00:23:27.306 [2024-11-28 19:11:48.097423] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.306 [2024-11-28 19:11:48.097441] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.306 [2024-11-28 19:11:48.097449] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.306 [2024-11-28 19:11:48.097455] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x233f0b0) on tqpair=0x22bee10 00:23:27.306 [2024-11-28 19:11:48.097474] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.306 [2024-11-28 19:11:48.097483] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.306 [2024-11-28 19:11:48.097489] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x22bee10) 00:23:27.306 [2024-11-28 19:11:48.097500] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.306 [2024-11-28 19:11:48.097530] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x233f0b0, cid 4, qid 0 00:23:27.306 [2024-11-28 19:11:48.097794] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:27.306 [2024-11-28 19:11:48.097814] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:27.306 [2024-11-28 19:11:48.097822] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:27.306 [2024-11-28 19:11:48.097828] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x22bee10): datao=0, datal=3072, cccid=4 00:23:27.306 [2024-11-28 19:11:48.097836] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x233f0b0) on tqpair(0x22bee10): expected_datao=0, payload_size=3072 00:23:27.306 [2024-11-28 19:11:48.097847] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:27.306 [2024-11-28 19:11:48.097854] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:27.306 [2024-11-28 19:11:48.097866] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.306 [2024-11-28 19:11:48.097876] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.306 [2024-11-28 19:11:48.097882] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.306 [2024-11-28 19:11:48.097889] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x233f0b0) on tqpair=0x22bee10 00:23:27.306 [2024-11-28 19:11:48.097905] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.306 [2024-11-28 19:11:48.097914] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.306 [2024-11-28 19:11:48.097920] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x22bee10) 00:23:27.306 [2024-11-28 19:11:48.097931] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.306 [2024-11-28 19:11:48.097960] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x233f0b0, cid 4, qid 0 00:23:27.306 [2024-11-28 19:11:48.098056] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:27.306 [2024-11-28 19:11:48.098068] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:27.306 [2024-11-28 19:11:48.098074] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:27.306 [2024-11-28 19:11:48.098081] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x22bee10): datao=0, datal=8, cccid=4 00:23:27.306 [2024-11-28 19:11:48.098088] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x233f0b0) on tqpair(0x22bee10): expected_datao=0, payload_size=8 00:23:27.306 [2024-11-28 19:11:48.098098] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:27.306 [2024-11-28 19:11:48.098106] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:27.306 [2024-11-28 19:11:48.138534] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.306 [2024-11-28 19:11:48.138552] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.306 [2024-11-28 19:11:48.138559] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.306 [2024-11-28 19:11:48.138566] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x233f0b0) on tqpair=0x22bee10 00:23:27.306 ===================================================== 00:23:27.306 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:23:27.306 ===================================================== 00:23:27.306 Controller Capabilities/Features 00:23:27.306 ================================ 00:23:27.306 Vendor ID: 0000 00:23:27.306 Subsystem Vendor ID: 0000 00:23:27.306 Serial Number: .................... 00:23:27.306 Model Number: ........................................ 00:23:27.306 Firmware Version: 24.01.1 00:23:27.306 Recommended Arb Burst: 0 00:23:27.306 IEEE OUI Identifier: 00 00 00 00:23:27.306 Multi-path I/O 00:23:27.306 May have multiple subsystem ports: No 00:23:27.306 May have multiple controllers: No 00:23:27.306 Associated with SR-IOV VF: No 00:23:27.306 Max Data Transfer Size: 131072 00:23:27.306 Max Number of Namespaces: 0 00:23:27.306 Max Number of I/O Queues: 1024 00:23:27.306 NVMe Specification Version (VS): 1.3 00:23:27.306 NVMe Specification Version (Identify): 1.3 00:23:27.306 Maximum Queue Entries: 128 00:23:27.306 Contiguous Queues Required: Yes 00:23:27.306 Arbitration Mechanisms Supported 00:23:27.306 Weighted Round Robin: Not Supported 00:23:27.306 Vendor Specific: Not Supported 00:23:27.306 Reset Timeout: 15000 ms 00:23:27.306 Doorbell Stride: 4 bytes 00:23:27.306 NVM Subsystem Reset: Not Supported 00:23:27.306 Command Sets Supported 00:23:27.306 NVM Command Set: Supported 00:23:27.306 Boot Partition: Not Supported 00:23:27.306 Memory Page Size Minimum: 4096 bytes 00:23:27.306 Memory Page Size Maximum: 4096 bytes 00:23:27.306 Persistent Memory Region: Not Supported 00:23:27.306 Optional Asynchronous Events Supported 00:23:27.306 Namespace Attribute Notices: Not Supported 00:23:27.306 Firmware Activation Notices: Not Supported 00:23:27.307 ANA Change Notices: Not Supported 00:23:27.307 PLE Aggregate Log Change Notices: Not Supported 00:23:27.307 LBA Status Info Alert Notices: Not Supported 00:23:27.307 EGE Aggregate Log Change Notices: Not Supported 00:23:27.307 Normal NVM Subsystem Shutdown event: Not Supported 00:23:27.307 Zone Descriptor Change Notices: Not Supported 00:23:27.307 Discovery Log Change Notices: Supported 00:23:27.307 Controller Attributes 00:23:27.307 128-bit Host Identifier: Not Supported 00:23:27.307 Non-Operational Permissive Mode: Not Supported 00:23:27.307 NVM Sets: Not Supported 00:23:27.307 Read Recovery Levels: Not Supported 00:23:27.307 Endurance Groups: Not Supported 00:23:27.307 Predictable Latency Mode: Not Supported 00:23:27.307 Traffic Based Keep ALive: Not Supported 00:23:27.307 Namespace Granularity: Not Supported 00:23:27.307 SQ Associations: Not Supported 00:23:27.307 UUID List: Not Supported 00:23:27.307 Multi-Domain Subsystem: Not Supported 00:23:27.307 Fixed Capacity Management: Not Supported 00:23:27.307 Variable Capacity Management: Not Supported 00:23:27.307 Delete Endurance Group: Not Supported 00:23:27.307 Delete NVM Set: Not Supported 00:23:27.307 Extended LBA Formats Supported: Not Supported 00:23:27.307 Flexible Data Placement Supported: Not Supported 00:23:27.307 00:23:27.307 Controller Memory Buffer Support 00:23:27.307 ================================ 00:23:27.307 Supported: No 00:23:27.307 00:23:27.307 Persistent Memory Region Support 00:23:27.307 ================================ 00:23:27.307 Supported: No 00:23:27.307 00:23:27.307 Admin Command Set Attributes 00:23:27.307 ============================ 00:23:27.307 Security Send/Receive: Not Supported 00:23:27.307 Format NVM: Not Supported 00:23:27.307 Firmware Activate/Download: Not Supported 00:23:27.307 Namespace Management: Not Supported 00:23:27.307 Device Self-Test: Not Supported 00:23:27.307 Directives: Not Supported 00:23:27.307 NVMe-MI: Not Supported 00:23:27.307 Virtualization Management: Not Supported 00:23:27.307 Doorbell Buffer Config: Not Supported 00:23:27.307 Get LBA Status Capability: Not Supported 00:23:27.307 Command & Feature Lockdown Capability: Not Supported 00:23:27.307 Abort Command Limit: 1 00:23:27.307 Async Event Request Limit: 4 00:23:27.307 Number of Firmware Slots: N/A 00:23:27.307 Firmware Slot 1 Read-Only: N/A 00:23:27.307 Firmware Activation Without Reset: N/A 00:23:27.307 Multiple Update Detection Support: N/A 00:23:27.307 Firmware Update Granularity: No Information Provided 00:23:27.307 Per-Namespace SMART Log: No 00:23:27.307 Asymmetric Namespace Access Log Page: Not Supported 00:23:27.307 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:23:27.307 Command Effects Log Page: Not Supported 00:23:27.307 Get Log Page Extended Data: Supported 00:23:27.307 Telemetry Log Pages: Not Supported 00:23:27.307 Persistent Event Log Pages: Not Supported 00:23:27.307 Supported Log Pages Log Page: May Support 00:23:27.307 Commands Supported & Effects Log Page: Not Supported 00:23:27.307 Feature Identifiers & Effects Log Page:May Support 00:23:27.307 NVMe-MI Commands & Effects Log Page: May Support 00:23:27.307 Data Area 4 for Telemetry Log: Not Supported 00:23:27.307 Error Log Page Entries Supported: 128 00:23:27.307 Keep Alive: Not Supported 00:23:27.307 00:23:27.307 NVM Command Set Attributes 00:23:27.307 ========================== 00:23:27.307 Submission Queue Entry Size 00:23:27.307 Max: 1 00:23:27.307 Min: 1 00:23:27.307 Completion Queue Entry Size 00:23:27.307 Max: 1 00:23:27.307 Min: 1 00:23:27.307 Number of Namespaces: 0 00:23:27.307 Compare Command: Not Supported 00:23:27.307 Write Uncorrectable Command: Not Supported 00:23:27.307 Dataset Management Command: Not Supported 00:23:27.307 Write Zeroes Command: Not Supported 00:23:27.307 Set Features Save Field: Not Supported 00:23:27.307 Reservations: Not Supported 00:23:27.307 Timestamp: Not Supported 00:23:27.307 Copy: Not Supported 00:23:27.307 Volatile Write Cache: Not Present 00:23:27.307 Atomic Write Unit (Normal): 1 00:23:27.307 Atomic Write Unit (PFail): 1 00:23:27.307 Atomic Compare & Write Unit: 1 00:23:27.307 Fused Compare & Write: Supported 00:23:27.307 Scatter-Gather List 00:23:27.307 SGL Command Set: Supported 00:23:27.307 SGL Keyed: Supported 00:23:27.307 SGL Bit Bucket Descriptor: Not Supported 00:23:27.307 SGL Metadata Pointer: Not Supported 00:23:27.307 Oversized SGL: Not Supported 00:23:27.307 SGL Metadata Address: Not Supported 00:23:27.307 SGL Offset: Supported 00:23:27.307 Transport SGL Data Block: Not Supported 00:23:27.307 Replay Protected Memory Block: Not Supported 00:23:27.307 00:23:27.307 Firmware Slot Information 00:23:27.307 ========================= 00:23:27.307 Active slot: 0 00:23:27.307 00:23:27.307 00:23:27.307 Error Log 00:23:27.307 ========= 00:23:27.307 00:23:27.307 Active Namespaces 00:23:27.307 ================= 00:23:27.307 Discovery Log Page 00:23:27.307 ================== 00:23:27.307 Generation Counter: 2 00:23:27.307 Number of Records: 2 00:23:27.307 Record Format: 0 00:23:27.307 00:23:27.307 Discovery Log Entry 0 00:23:27.307 ---------------------- 00:23:27.307 Transport Type: 3 (TCP) 00:23:27.307 Address Family: 1 (IPv4) 00:23:27.307 Subsystem Type: 3 (Current Discovery Subsystem) 00:23:27.307 Entry Flags: 00:23:27.307 Duplicate Returned Information: 1 00:23:27.307 Explicit Persistent Connection Support for Discovery: 1 00:23:27.307 Transport Requirements: 00:23:27.307 Secure Channel: Not Required 00:23:27.307 Port ID: 0 (0x0000) 00:23:27.307 Controller ID: 65535 (0xffff) 00:23:27.307 Admin Max SQ Size: 128 00:23:27.307 Transport Service Identifier: 4420 00:23:27.307 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:23:27.307 Transport Address: 10.0.0.2 00:23:27.307 Discovery Log Entry 1 00:23:27.307 ---------------------- 00:23:27.307 Transport Type: 3 (TCP) 00:23:27.307 Address Family: 1 (IPv4) 00:23:27.307 Subsystem Type: 2 (NVM Subsystem) 00:23:27.307 Entry Flags: 00:23:27.307 Duplicate Returned Information: 0 00:23:27.307 Explicit Persistent Connection Support for Discovery: 0 00:23:27.307 Transport Requirements: 00:23:27.307 Secure Channel: Not Required 00:23:27.307 Port ID: 0 (0x0000) 00:23:27.307 Controller ID: 65535 (0xffff) 00:23:27.307 Admin Max SQ Size: 128 00:23:27.307 Transport Service Identifier: 4420 00:23:27.307 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:23:27.307 Transport Address: 10.0.0.2 [2024-11-28 19:11:48.138692] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:23:27.307 [2024-11-28 19:11:48.138716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:27.307 [2024-11-28 19:11:48.138728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:27.307 [2024-11-28 19:11:48.138737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:27.307 [2024-11-28 19:11:48.138746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:27.307 [2024-11-28 19:11:48.138759] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.307 [2024-11-28 19:11:48.138766] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.307 [2024-11-28 19:11:48.138773] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x22bee10) 00:23:27.307 [2024-11-28 19:11:48.138784] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.307 [2024-11-28 19:11:48.138828] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x233ef50, cid 3, qid 0 00:23:27.307 [2024-11-28 19:11:48.139008] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.307 [2024-11-28 19:11:48.139020] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.307 [2024-11-28 19:11:48.139027] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.307 [2024-11-28 19:11:48.139033] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x233ef50) on tqpair=0x22bee10 00:23:27.307 [2024-11-28 19:11:48.139046] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.307 [2024-11-28 19:11:48.139053] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.307 [2024-11-28 19:11:48.139059] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x22bee10) 00:23:27.307 [2024-11-28 19:11:48.139070] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.307 [2024-11-28 19:11:48.139095] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x233ef50, cid 3, qid 0 00:23:27.307 [2024-11-28 19:11:48.139219] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.307 [2024-11-28 19:11:48.139233] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.307 [2024-11-28 19:11:48.139239] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.307 [2024-11-28 19:11:48.139246] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x233ef50) on tqpair=0x22bee10 00:23:27.307 [2024-11-28 19:11:48.139255] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:23:27.308 [2024-11-28 19:11:48.139263] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:23:27.308 [2024-11-28 19:11:48.139279] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.308 [2024-11-28 19:11:48.139287] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.308 [2024-11-28 19:11:48.139293] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x22bee10) 00:23:27.308 [2024-11-28 19:11:48.139304] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.308 [2024-11-28 19:11:48.139324] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x233ef50, cid 3, qid 0 00:23:27.308 [2024-11-28 19:11:48.139414] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.308 [2024-11-28 19:11:48.139428] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.308 [2024-11-28 19:11:48.139434] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.308 [2024-11-28 19:11:48.139441] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x233ef50) on tqpair=0x22bee10 00:23:27.308 [2024-11-28 19:11:48.139459] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.308 [2024-11-28 19:11:48.139467] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.308 [2024-11-28 19:11:48.139474] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x22bee10) 00:23:27.308 [2024-11-28 19:11:48.139484] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.308 [2024-11-28 19:11:48.139505] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x233ef50, cid 3, qid 0 00:23:27.308 [2024-11-28 19:11:48.139631] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.308 [2024-11-28 19:11:48.139645] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.308 [2024-11-28 19:11:48.139651] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.308 [2024-11-28 19:11:48.139658] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x233ef50) on tqpair=0x22bee10 00:23:27.308 [2024-11-28 19:11:48.139675] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.308 [2024-11-28 19:11:48.139683] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.308 [2024-11-28 19:11:48.139694] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x22bee10) 00:23:27.308 [2024-11-28 19:11:48.139705] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.308 [2024-11-28 19:11:48.139725] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x233ef50, cid 3, qid 0 00:23:27.308 [2024-11-28 19:11:48.139829] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.308 [2024-11-28 19:11:48.139841] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.308 [2024-11-28 19:11:48.139847] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.308 [2024-11-28 19:11:48.139854] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x233ef50) on tqpair=0x22bee10 00:23:27.308 [2024-11-28 19:11:48.139870] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.308 [2024-11-28 19:11:48.139879] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.308 [2024-11-28 19:11:48.139885] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x22bee10) 00:23:27.308 [2024-11-28 19:11:48.139896] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.308 [2024-11-28 19:11:48.139916] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x233ef50, cid 3, qid 0 00:23:27.308 [2024-11-28 19:11:48.139994] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.308 [2024-11-28 19:11:48.140007] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.308 [2024-11-28 19:11:48.140013] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.308 [2024-11-28 19:11:48.140020] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x233ef50) on tqpair=0x22bee10 00:23:27.308 [2024-11-28 19:11:48.140037] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.308 [2024-11-28 19:11:48.140046] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.308 [2024-11-28 19:11:48.140052] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x22bee10) 00:23:27.308 [2024-11-28 19:11:48.140062] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.308 [2024-11-28 19:11:48.140082] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x233ef50, cid 3, qid 0 00:23:27.308 [2024-11-28 19:11:48.140195] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.308 [2024-11-28 19:11:48.140209] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.308 [2024-11-28 19:11:48.140215] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.308 [2024-11-28 19:11:48.140222] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x233ef50) on tqpair=0x22bee10 00:23:27.308 [2024-11-28 19:11:48.140239] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.308 [2024-11-28 19:11:48.140247] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.308 [2024-11-28 19:11:48.140254] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x22bee10) 00:23:27.308 [2024-11-28 19:11:48.140264] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.308 [2024-11-28 19:11:48.140284] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x233ef50, cid 3, qid 0 00:23:27.308 [2024-11-28 19:11:48.140404] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.308 [2024-11-28 19:11:48.140419] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.308 [2024-11-28 19:11:48.140425] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.308 [2024-11-28 19:11:48.140432] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x233ef50) on tqpair=0x22bee10 00:23:27.308 [2024-11-28 19:11:48.140449] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.308 [2024-11-28 19:11:48.140458] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.308 [2024-11-28 19:11:48.140464] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x22bee10) 00:23:27.308 [2024-11-28 19:11:48.140479] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.308 [2024-11-28 19:11:48.140500] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x233ef50, cid 3, qid 0 00:23:27.308 [2024-11-28 19:11:48.140597] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.308 [2024-11-28 19:11:48.140611] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.308 [2024-11-28 19:11:48.140617] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.308 [2024-11-28 19:11:48.140624] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x233ef50) on tqpair=0x22bee10 00:23:27.308 [2024-11-28 19:11:48.140641] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.308 [2024-11-28 19:11:48.140650] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.308 [2024-11-28 19:11:48.140656] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x22bee10) 00:23:27.308 [2024-11-28 19:11:48.140666] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.308 [2024-11-28 19:11:48.140686] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x233ef50, cid 3, qid 0 00:23:27.308 [2024-11-28 19:11:48.140764] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.308 [2024-11-28 19:11:48.140777] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.308 [2024-11-28 19:11:48.140783] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.308 [2024-11-28 19:11:48.140790] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x233ef50) on tqpair=0x22bee10 00:23:27.308 [2024-11-28 19:11:48.140807] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.308 [2024-11-28 19:11:48.140816] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.308 [2024-11-28 19:11:48.140822] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x22bee10) 00:23:27.308 [2024-11-28 19:11:48.140832] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.308 [2024-11-28 19:11:48.140852] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x233ef50, cid 3, qid 0 00:23:27.308 [2024-11-28 19:11:48.140950] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.308 [2024-11-28 19:11:48.140963] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.308 [2024-11-28 19:11:48.140969] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.308 [2024-11-28 19:11:48.140976] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x233ef50) on tqpair=0x22bee10 00:23:27.308 [2024-11-28 19:11:48.140992] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.308 [2024-11-28 19:11:48.141001] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.308 [2024-11-28 19:11:48.141008] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x22bee10) 00:23:27.308 [2024-11-28 19:11:48.141018] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.308 [2024-11-28 19:11:48.141038] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x233ef50, cid 3, qid 0 00:23:27.308 [2024-11-28 19:11:48.141150] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.308 [2024-11-28 19:11:48.141164] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.308 [2024-11-28 19:11:48.141170] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.308 [2024-11-28 19:11:48.141176] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x233ef50) on tqpair=0x22bee10 00:23:27.308 [2024-11-28 19:11:48.141193] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.308 [2024-11-28 19:11:48.141202] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.308 [2024-11-28 19:11:48.141209] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x22bee10) 00:23:27.308 [2024-11-28 19:11:48.141219] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.308 [2024-11-28 19:11:48.141244] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x233ef50, cid 3, qid 0 00:23:27.308 [2024-11-28 19:11:48.141319] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.308 [2024-11-28 19:11:48.141330] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.308 [2024-11-28 19:11:48.141337] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.308 [2024-11-28 19:11:48.141343] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x233ef50) on tqpair=0x22bee10 00:23:27.308 [2024-11-28 19:11:48.141360] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.308 [2024-11-28 19:11:48.141368] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.308 [2024-11-28 19:11:48.141375] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x22bee10) 00:23:27.308 [2024-11-28 19:11:48.141385] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.308 [2024-11-28 19:11:48.145441] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x233ef50, cid 3, qid 0 00:23:27.308 [2024-11-28 19:11:48.145589] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.309 [2024-11-28 19:11:48.145605] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.309 [2024-11-28 19:11:48.145611] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.309 [2024-11-28 19:11:48.145618] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x233ef50) on tqpair=0x22bee10 00:23:27.309 [2024-11-28 19:11:48.145633] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 6 milliseconds 00:23:27.309 00:23:27.309 19:11:48 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:23:27.309 [2024-11-28 19:11:48.178688] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:27.309 [2024-11-28 19:11:48.178730] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid282052 ] 00:23:27.309 EAL: No free 2048 kB hugepages reported on node 1 00:23:27.309 [2024-11-28 19:11:48.211146] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:23:27.309 [2024-11-28 19:11:48.211193] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:23:27.309 [2024-11-28 19:11:48.211203] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:23:27.309 [2024-11-28 19:11:48.211218] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:23:27.309 [2024-11-28 19:11:48.211229] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:23:27.309 [2024-11-28 19:11:48.214442] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:23:27.309 [2024-11-28 19:11:48.214486] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x4c0e10 0 00:23:27.309 [2024-11-28 19:11:48.221404] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:23:27.309 [2024-11-28 19:11:48.221424] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:23:27.309 [2024-11-28 19:11:48.221432] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:23:27.309 [2024-11-28 19:11:48.221438] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:23:27.309 [2024-11-28 19:11:48.221491] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.309 [2024-11-28 19:11:48.221507] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.309 [2024-11-28 19:11:48.221514] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x4c0e10) 00:23:27.309 [2024-11-28 19:11:48.221529] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:23:27.309 [2024-11-28 19:11:48.221555] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x540b30, cid 0, qid 0 00:23:27.309 [2024-11-28 19:11:48.229409] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.309 [2024-11-28 19:11:48.229425] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.309 [2024-11-28 19:11:48.229433] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.309 [2024-11-28 19:11:48.229440] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x540b30) on tqpair=0x4c0e10 00:23:27.309 [2024-11-28 19:11:48.229471] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:23:27.309 [2024-11-28 19:11:48.229483] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:23:27.309 [2024-11-28 19:11:48.229492] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:23:27.309 [2024-11-28 19:11:48.229508] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.309 [2024-11-28 19:11:48.229517] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.309 [2024-11-28 19:11:48.229524] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x4c0e10) 00:23:27.309 [2024-11-28 19:11:48.229535] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.309 [2024-11-28 19:11:48.229559] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x540b30, cid 0, qid 0 00:23:27.309 [2024-11-28 19:11:48.229684] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.309 [2024-11-28 19:11:48.229698] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.309 [2024-11-28 19:11:48.229705] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.309 [2024-11-28 19:11:48.229711] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x540b30) on tqpair=0x4c0e10 00:23:27.309 [2024-11-28 19:11:48.229720] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:23:27.309 [2024-11-28 19:11:48.229733] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:23:27.309 [2024-11-28 19:11:48.229745] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.309 [2024-11-28 19:11:48.229753] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.309 [2024-11-28 19:11:48.229759] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x4c0e10) 00:23:27.309 [2024-11-28 19:11:48.229769] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.309 [2024-11-28 19:11:48.229791] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x540b30, cid 0, qid 0 00:23:27.309 [2024-11-28 19:11:48.229865] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.309 [2024-11-28 19:11:48.229878] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.309 [2024-11-28 19:11:48.229885] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.309 [2024-11-28 19:11:48.229892] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x540b30) on tqpair=0x4c0e10 00:23:27.309 [2024-11-28 19:11:48.229900] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:23:27.309 [2024-11-28 19:11:48.229914] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:23:27.309 [2024-11-28 19:11:48.229926] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.309 [2024-11-28 19:11:48.229933] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.309 [2024-11-28 19:11:48.229943] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x4c0e10) 00:23:27.309 [2024-11-28 19:11:48.229954] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.309 [2024-11-28 19:11:48.229975] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x540b30, cid 0, qid 0 00:23:27.309 [2024-11-28 19:11:48.230058] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.309 [2024-11-28 19:11:48.230072] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.309 [2024-11-28 19:11:48.230078] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.309 [2024-11-28 19:11:48.230085] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x540b30) on tqpair=0x4c0e10 00:23:27.309 [2024-11-28 19:11:48.230093] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:23:27.309 [2024-11-28 19:11:48.230110] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.309 [2024-11-28 19:11:48.230119] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.309 [2024-11-28 19:11:48.230126] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x4c0e10) 00:23:27.309 [2024-11-28 19:11:48.230136] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.309 [2024-11-28 19:11:48.230157] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x540b30, cid 0, qid 0 00:23:27.309 [2024-11-28 19:11:48.230235] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.309 [2024-11-28 19:11:48.230249] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.309 [2024-11-28 19:11:48.230256] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.309 [2024-11-28 19:11:48.230262] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x540b30) on tqpair=0x4c0e10 00:23:27.309 [2024-11-28 19:11:48.230270] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:23:27.309 [2024-11-28 19:11:48.230278] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:23:27.309 [2024-11-28 19:11:48.230291] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:23:27.309 [2024-11-28 19:11:48.230401] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:23:27.309 [2024-11-28 19:11:48.230410] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:23:27.309 [2024-11-28 19:11:48.230422] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.309 [2024-11-28 19:11:48.230430] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.309 [2024-11-28 19:11:48.230436] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x4c0e10) 00:23:27.309 [2024-11-28 19:11:48.230446] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.309 [2024-11-28 19:11:48.230467] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x540b30, cid 0, qid 0 00:23:27.309 [2024-11-28 19:11:48.230577] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.309 [2024-11-28 19:11:48.230590] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.309 [2024-11-28 19:11:48.230597] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.309 [2024-11-28 19:11:48.230603] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x540b30) on tqpair=0x4c0e10 00:23:27.309 [2024-11-28 19:11:48.230611] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:23:27.309 [2024-11-28 19:11:48.230628] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.309 [2024-11-28 19:11:48.230637] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.309 [2024-11-28 19:11:48.230647] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x4c0e10) 00:23:27.309 [2024-11-28 19:11:48.230658] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.309 [2024-11-28 19:11:48.230678] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x540b30, cid 0, qid 0 00:23:27.309 [2024-11-28 19:11:48.230755] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.309 [2024-11-28 19:11:48.230769] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.309 [2024-11-28 19:11:48.230775] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.309 [2024-11-28 19:11:48.230782] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x540b30) on tqpair=0x4c0e10 00:23:27.309 [2024-11-28 19:11:48.230789] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:23:27.309 [2024-11-28 19:11:48.230797] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:23:27.310 [2024-11-28 19:11:48.230810] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:23:27.310 [2024-11-28 19:11:48.230824] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:23:27.310 [2024-11-28 19:11:48.230838] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.310 [2024-11-28 19:11:48.230846] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.310 [2024-11-28 19:11:48.230852] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x4c0e10) 00:23:27.310 [2024-11-28 19:11:48.230863] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.310 [2024-11-28 19:11:48.230884] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x540b30, cid 0, qid 0 00:23:27.310 [2024-11-28 19:11:48.231011] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:27.310 [2024-11-28 19:11:48.231024] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:27.310 [2024-11-28 19:11:48.231030] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:27.310 [2024-11-28 19:11:48.231036] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x4c0e10): datao=0, datal=4096, cccid=0 00:23:27.310 [2024-11-28 19:11:48.231043] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x540b30) on tqpair(0x4c0e10): expected_datao=0, payload_size=4096 00:23:27.310 [2024-11-28 19:11:48.231061] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:27.310 [2024-11-28 19:11:48.231070] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:27.310 [2024-11-28 19:11:48.271501] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.310 [2024-11-28 19:11:48.271520] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.310 [2024-11-28 19:11:48.271527] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.310 [2024-11-28 19:11:48.271534] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x540b30) on tqpair=0x4c0e10 00:23:27.310 [2024-11-28 19:11:48.271546] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:23:27.310 [2024-11-28 19:11:48.271554] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:23:27.310 [2024-11-28 19:11:48.271562] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:23:27.310 [2024-11-28 19:11:48.271568] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:23:27.310 [2024-11-28 19:11:48.271576] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:23:27.310 [2024-11-28 19:11:48.271584] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:23:27.310 [2024-11-28 19:11:48.271607] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:23:27.310 [2024-11-28 19:11:48.271621] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.310 [2024-11-28 19:11:48.271628] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.310 [2024-11-28 19:11:48.271635] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x4c0e10) 00:23:27.310 [2024-11-28 19:11:48.271646] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:27.310 [2024-11-28 19:11:48.271669] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x540b30, cid 0, qid 0 00:23:27.310 [2024-11-28 19:11:48.271742] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.310 [2024-11-28 19:11:48.271755] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.310 [2024-11-28 19:11:48.271761] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.310 [2024-11-28 19:11:48.271767] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x540b30) on tqpair=0x4c0e10 00:23:27.310 [2024-11-28 19:11:48.271777] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.310 [2024-11-28 19:11:48.271785] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.310 [2024-11-28 19:11:48.271791] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x4c0e10) 00:23:27.310 [2024-11-28 19:11:48.271801] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:23:27.310 [2024-11-28 19:11:48.271811] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.310 [2024-11-28 19:11:48.271817] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.310 [2024-11-28 19:11:48.271823] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x4c0e10) 00:23:27.310 [2024-11-28 19:11:48.271832] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:23:27.310 [2024-11-28 19:11:48.271841] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.310 [2024-11-28 19:11:48.271848] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.310 [2024-11-28 19:11:48.271854] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x4c0e10) 00:23:27.310 [2024-11-28 19:11:48.271862] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:23:27.310 [2024-11-28 19:11:48.271872] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.310 [2024-11-28 19:11:48.271878] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.310 [2024-11-28 19:11:48.271884] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x4c0e10) 00:23:27.310 [2024-11-28 19:11:48.271893] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:23:27.310 [2024-11-28 19:11:48.271901] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:23:27.310 [2024-11-28 19:11:48.271919] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:23:27.310 [2024-11-28 19:11:48.271932] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.310 [2024-11-28 19:11:48.271939] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.310 [2024-11-28 19:11:48.271945] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x4c0e10) 00:23:27.310 [2024-11-28 19:11:48.271971] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.310 [2024-11-28 19:11:48.271993] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x540b30, cid 0, qid 0 00:23:27.310 [2024-11-28 19:11:48.272007] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x540c90, cid 1, qid 0 00:23:27.310 [2024-11-28 19:11:48.272030] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x540df0, cid 2, qid 0 00:23:27.310 [2024-11-28 19:11:48.272038] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x540f50, cid 3, qid 0 00:23:27.310 [2024-11-28 19:11:48.272045] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5410b0, cid 4, qid 0 00:23:27.310 [2024-11-28 19:11:48.272188] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.310 [2024-11-28 19:11:48.272202] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.310 [2024-11-28 19:11:48.272209] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.310 [2024-11-28 19:11:48.272215] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x5410b0) on tqpair=0x4c0e10 00:23:27.310 [2024-11-28 19:11:48.272223] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:23:27.310 [2024-11-28 19:11:48.272232] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:23:27.310 [2024-11-28 19:11:48.272245] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:23:27.310 [2024-11-28 19:11:48.272260] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:23:27.310 [2024-11-28 19:11:48.272272] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.310 [2024-11-28 19:11:48.272280] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.310 [2024-11-28 19:11:48.272286] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x4c0e10) 00:23:27.310 [2024-11-28 19:11:48.272296] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:23:27.310 [2024-11-28 19:11:48.272317] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5410b0, cid 4, qid 0 00:23:27.310 [2024-11-28 19:11:48.272511] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.310 [2024-11-28 19:11:48.272527] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.310 [2024-11-28 19:11:48.272533] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.310 [2024-11-28 19:11:48.272540] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x5410b0) on tqpair=0x4c0e10 00:23:27.310 [2024-11-28 19:11:48.272604] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:23:27.310 [2024-11-28 19:11:48.272623] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:23:27.310 [2024-11-28 19:11:48.272637] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.310 [2024-11-28 19:11:48.272644] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.310 [2024-11-28 19:11:48.272650] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x4c0e10) 00:23:27.310 [2024-11-28 19:11:48.272661] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.310 [2024-11-28 19:11:48.272682] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5410b0, cid 4, qid 0 00:23:27.310 [2024-11-28 19:11:48.272783] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:27.310 [2024-11-28 19:11:48.272795] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:27.310 [2024-11-28 19:11:48.272802] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:27.310 [2024-11-28 19:11:48.272808] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x4c0e10): datao=0, datal=4096, cccid=4 00:23:27.310 [2024-11-28 19:11:48.272815] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x5410b0) on tqpair(0x4c0e10): expected_datao=0, payload_size=4096 00:23:27.310 [2024-11-28 19:11:48.272830] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:27.310 [2024-11-28 19:11:48.272839] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:27.310 [2024-11-28 19:11:48.272851] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.310 [2024-11-28 19:11:48.272860] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.310 [2024-11-28 19:11:48.272866] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.311 [2024-11-28 19:11:48.272873] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x5410b0) on tqpair=0x4c0e10 00:23:27.311 [2024-11-28 19:11:48.272892] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:23:27.311 [2024-11-28 19:11:48.272912] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:23:27.311 [2024-11-28 19:11:48.272930] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:23:27.311 [2024-11-28 19:11:48.272943] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.311 [2024-11-28 19:11:48.272951] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.311 [2024-11-28 19:11:48.272957] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x4c0e10) 00:23:27.311 [2024-11-28 19:11:48.272968] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.311 [2024-11-28 19:11:48.272989] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5410b0, cid 4, qid 0 00:23:27.311 [2024-11-28 19:11:48.273094] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:27.311 [2024-11-28 19:11:48.273109] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:27.311 [2024-11-28 19:11:48.273116] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:27.311 [2024-11-28 19:11:48.273122] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x4c0e10): datao=0, datal=4096, cccid=4 00:23:27.311 [2024-11-28 19:11:48.273129] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x5410b0) on tqpair(0x4c0e10): expected_datao=0, payload_size=4096 00:23:27.311 [2024-11-28 19:11:48.273140] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:27.311 [2024-11-28 19:11:48.273147] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:27.311 [2024-11-28 19:11:48.273159] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.311 [2024-11-28 19:11:48.273168] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.311 [2024-11-28 19:11:48.273175] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.311 [2024-11-28 19:11:48.273181] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x5410b0) on tqpair=0x4c0e10 00:23:27.311 [2024-11-28 19:11:48.273203] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:23:27.311 [2024-11-28 19:11:48.273222] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:23:27.311 [2024-11-28 19:11:48.273236] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.311 [2024-11-28 19:11:48.273244] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.311 [2024-11-28 19:11:48.273250] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x4c0e10) 00:23:27.311 [2024-11-28 19:11:48.273260] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.311 [2024-11-28 19:11:48.273281] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5410b0, cid 4, qid 0 00:23:27.311 [2024-11-28 19:11:48.273378] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:27.311 [2024-11-28 19:11:48.277400] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:27.311 [2024-11-28 19:11:48.277414] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:27.311 [2024-11-28 19:11:48.277424] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x4c0e10): datao=0, datal=4096, cccid=4 00:23:27.311 [2024-11-28 19:11:48.277433] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x5410b0) on tqpair(0x4c0e10): expected_datao=0, payload_size=4096 00:23:27.311 [2024-11-28 19:11:48.277444] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:27.311 [2024-11-28 19:11:48.277451] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:27.311 [2024-11-28 19:11:48.277464] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.311 [2024-11-28 19:11:48.277474] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.311 [2024-11-28 19:11:48.277480] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.311 [2024-11-28 19:11:48.277486] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x5410b0) on tqpair=0x4c0e10 00:23:27.311 [2024-11-28 19:11:48.277500] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:23:27.311 [2024-11-28 19:11:48.277515] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:23:27.311 [2024-11-28 19:11:48.277531] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:23:27.311 [2024-11-28 19:11:48.277542] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:23:27.311 [2024-11-28 19:11:48.277551] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:23:27.311 [2024-11-28 19:11:48.277559] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:23:27.311 [2024-11-28 19:11:48.277566] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:23:27.311 [2024-11-28 19:11:48.277574] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:23:27.311 [2024-11-28 19:11:48.277593] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.311 [2024-11-28 19:11:48.277602] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.311 [2024-11-28 19:11:48.277608] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x4c0e10) 00:23:27.311 [2024-11-28 19:11:48.277619] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.311 [2024-11-28 19:11:48.277631] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.311 [2024-11-28 19:11:48.277638] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.311 [2024-11-28 19:11:48.277644] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x4c0e10) 00:23:27.311 [2024-11-28 19:11:48.277653] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:23:27.311 [2024-11-28 19:11:48.277678] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5410b0, cid 4, qid 0 00:23:27.311 [2024-11-28 19:11:48.277690] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x541210, cid 5, qid 0 00:23:27.311 [2024-11-28 19:11:48.277834] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.311 [2024-11-28 19:11:48.277848] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.311 [2024-11-28 19:11:48.277855] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.311 [2024-11-28 19:11:48.277861] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x5410b0) on tqpair=0x4c0e10 00:23:27.311 [2024-11-28 19:11:48.277873] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.311 [2024-11-28 19:11:48.277882] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.311 [2024-11-28 19:11:48.277888] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.311 [2024-11-28 19:11:48.277898] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x541210) on tqpair=0x4c0e10 00:23:27.311 [2024-11-28 19:11:48.277915] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.311 [2024-11-28 19:11:48.277923] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.311 [2024-11-28 19:11:48.277930] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x4c0e10) 00:23:27.311 [2024-11-28 19:11:48.277940] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.311 [2024-11-28 19:11:48.277961] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x541210, cid 5, qid 0 00:23:27.311 [2024-11-28 19:11:48.278054] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.311 [2024-11-28 19:11:48.278066] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.311 [2024-11-28 19:11:48.278072] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.311 [2024-11-28 19:11:48.278078] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x541210) on tqpair=0x4c0e10 00:23:27.311 [2024-11-28 19:11:48.278094] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.311 [2024-11-28 19:11:48.278102] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.311 [2024-11-28 19:11:48.278108] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x4c0e10) 00:23:27.311 [2024-11-28 19:11:48.278119] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.311 [2024-11-28 19:11:48.278139] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x541210, cid 5, qid 0 00:23:27.311 [2024-11-28 19:11:48.278220] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.311 [2024-11-28 19:11:48.278233] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.311 [2024-11-28 19:11:48.278240] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.311 [2024-11-28 19:11:48.278246] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x541210) on tqpair=0x4c0e10 00:23:27.311 [2024-11-28 19:11:48.278262] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.311 [2024-11-28 19:11:48.278271] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.311 [2024-11-28 19:11:48.278278] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x4c0e10) 00:23:27.311 [2024-11-28 19:11:48.278288] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.311 [2024-11-28 19:11:48.278308] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x541210, cid 5, qid 0 00:23:27.311 [2024-11-28 19:11:48.278404] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.311 [2024-11-28 19:11:48.278418] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.311 [2024-11-28 19:11:48.278424] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.312 [2024-11-28 19:11:48.278431] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x541210) on tqpair=0x4c0e10 00:23:27.312 [2024-11-28 19:11:48.278451] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.312 [2024-11-28 19:11:48.278461] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.312 [2024-11-28 19:11:48.278467] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x4c0e10) 00:23:27.312 [2024-11-28 19:11:48.278477] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.312 [2024-11-28 19:11:48.278490] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.312 [2024-11-28 19:11:48.278497] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.312 [2024-11-28 19:11:48.278503] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x4c0e10) 00:23:27.312 [2024-11-28 19:11:48.278512] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.312 [2024-11-28 19:11:48.278529] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.312 [2024-11-28 19:11:48.278537] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.312 [2024-11-28 19:11:48.278543] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x4c0e10) 00:23:27.312 [2024-11-28 19:11:48.278552] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.312 [2024-11-28 19:11:48.278565] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.312 [2024-11-28 19:11:48.278572] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.312 [2024-11-28 19:11:48.278578] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x4c0e10) 00:23:27.312 [2024-11-28 19:11:48.278587] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.312 [2024-11-28 19:11:48.278610] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x541210, cid 5, qid 0 00:23:27.312 [2024-11-28 19:11:48.278621] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5410b0, cid 4, qid 0 00:23:27.312 [2024-11-28 19:11:48.278628] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x541370, cid 6, qid 0 00:23:27.312 [2024-11-28 19:11:48.278635] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5414d0, cid 7, qid 0 00:23:27.312 [2024-11-28 19:11:48.278829] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:27.312 [2024-11-28 19:11:48.278844] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:27.312 [2024-11-28 19:11:48.278850] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:27.312 [2024-11-28 19:11:48.278856] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x4c0e10): datao=0, datal=8192, cccid=5 00:23:27.312 [2024-11-28 19:11:48.278864] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x541210) on tqpair(0x4c0e10): expected_datao=0, payload_size=8192 00:23:27.312 [2024-11-28 19:11:48.278884] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:27.312 [2024-11-28 19:11:48.278894] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:27.312 [2024-11-28 19:11:48.278906] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:27.312 [2024-11-28 19:11:48.278916] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:27.312 [2024-11-28 19:11:48.278922] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:27.312 [2024-11-28 19:11:48.278928] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x4c0e10): datao=0, datal=512, cccid=4 00:23:27.312 [2024-11-28 19:11:48.278935] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x5410b0) on tqpair(0x4c0e10): expected_datao=0, payload_size=512 00:23:27.312 [2024-11-28 19:11:48.278945] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:27.312 [2024-11-28 19:11:48.278952] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:27.312 [2024-11-28 19:11:48.278961] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:27.312 [2024-11-28 19:11:48.278969] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:27.312 [2024-11-28 19:11:48.278975] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:27.312 [2024-11-28 19:11:48.278981] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x4c0e10): datao=0, datal=512, cccid=6 00:23:27.312 [2024-11-28 19:11:48.278988] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x541370) on tqpair(0x4c0e10): expected_datao=0, payload_size=512 00:23:27.312 [2024-11-28 19:11:48.278998] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:27.312 [2024-11-28 19:11:48.279005] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:27.312 [2024-11-28 19:11:48.279013] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:23:27.312 [2024-11-28 19:11:48.279021] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:23:27.312 [2024-11-28 19:11:48.279031] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:23:27.312 [2024-11-28 19:11:48.279038] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x4c0e10): datao=0, datal=4096, cccid=7 00:23:27.312 [2024-11-28 19:11:48.279045] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x5414d0) on tqpair(0x4c0e10): expected_datao=0, payload_size=4096 00:23:27.312 [2024-11-28 19:11:48.279055] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:23:27.312 [2024-11-28 19:11:48.279063] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:23:27.312 [2024-11-28 19:11:48.279074] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.312 [2024-11-28 19:11:48.279083] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.312 [2024-11-28 19:11:48.279089] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.312 [2024-11-28 19:11:48.279095] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x541210) on tqpair=0x4c0e10 00:23:27.312 [2024-11-28 19:11:48.279115] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.312 [2024-11-28 19:11:48.279126] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.312 [2024-11-28 19:11:48.279133] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.312 [2024-11-28 19:11:48.279139] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x5410b0) on tqpair=0x4c0e10 00:23:27.312 [2024-11-28 19:11:48.279153] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.312 [2024-11-28 19:11:48.279164] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.312 [2024-11-28 19:11:48.279170] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.312 [2024-11-28 19:11:48.279176] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x541370) on tqpair=0x4c0e10 00:23:27.312 [2024-11-28 19:11:48.279187] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.312 [2024-11-28 19:11:48.279196] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.312 [2024-11-28 19:11:48.279202] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.312 [2024-11-28 19:11:48.279224] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x5414d0) on tqpair=0x4c0e10 00:23:27.312 ===================================================== 00:23:27.312 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:27.312 ===================================================== 00:23:27.312 Controller Capabilities/Features 00:23:27.312 ================================ 00:23:27.312 Vendor ID: 8086 00:23:27.312 Subsystem Vendor ID: 8086 00:23:27.312 Serial Number: SPDK00000000000001 00:23:27.312 Model Number: SPDK bdev Controller 00:23:27.312 Firmware Version: 24.01.1 00:23:27.312 Recommended Arb Burst: 6 00:23:27.312 IEEE OUI Identifier: e4 d2 5c 00:23:27.312 Multi-path I/O 00:23:27.312 May have multiple subsystem ports: Yes 00:23:27.312 May have multiple controllers: Yes 00:23:27.312 Associated with SR-IOV VF: No 00:23:27.312 Max Data Transfer Size: 131072 00:23:27.312 Max Number of Namespaces: 32 00:23:27.312 Max Number of I/O Queues: 127 00:23:27.312 NVMe Specification Version (VS): 1.3 00:23:27.312 NVMe Specification Version (Identify): 1.3 00:23:27.312 Maximum Queue Entries: 128 00:23:27.312 Contiguous Queues Required: Yes 00:23:27.312 Arbitration Mechanisms Supported 00:23:27.312 Weighted Round Robin: Not Supported 00:23:27.312 Vendor Specific: Not Supported 00:23:27.312 Reset Timeout: 15000 ms 00:23:27.312 Doorbell Stride: 4 bytes 00:23:27.312 NVM Subsystem Reset: Not Supported 00:23:27.312 Command Sets Supported 00:23:27.312 NVM Command Set: Supported 00:23:27.312 Boot Partition: Not Supported 00:23:27.312 Memory Page Size Minimum: 4096 bytes 00:23:27.312 Memory Page Size Maximum: 4096 bytes 00:23:27.312 Persistent Memory Region: Not Supported 00:23:27.312 Optional Asynchronous Events Supported 00:23:27.312 Namespace Attribute Notices: Supported 00:23:27.312 Firmware Activation Notices: Not Supported 00:23:27.312 ANA Change Notices: Not Supported 00:23:27.312 PLE Aggregate Log Change Notices: Not Supported 00:23:27.312 LBA Status Info Alert Notices: Not Supported 00:23:27.312 EGE Aggregate Log Change Notices: Not Supported 00:23:27.312 Normal NVM Subsystem Shutdown event: Not Supported 00:23:27.312 Zone Descriptor Change Notices: Not Supported 00:23:27.312 Discovery Log Change Notices: Not Supported 00:23:27.312 Controller Attributes 00:23:27.312 128-bit Host Identifier: Supported 00:23:27.312 Non-Operational Permissive Mode: Not Supported 00:23:27.312 NVM Sets: Not Supported 00:23:27.312 Read Recovery Levels: Not Supported 00:23:27.312 Endurance Groups: Not Supported 00:23:27.312 Predictable Latency Mode: Not Supported 00:23:27.312 Traffic Based Keep ALive: Not Supported 00:23:27.312 Namespace Granularity: Not Supported 00:23:27.312 SQ Associations: Not Supported 00:23:27.312 UUID List: Not Supported 00:23:27.312 Multi-Domain Subsystem: Not Supported 00:23:27.312 Fixed Capacity Management: Not Supported 00:23:27.312 Variable Capacity Management: Not Supported 00:23:27.312 Delete Endurance Group: Not Supported 00:23:27.312 Delete NVM Set: Not Supported 00:23:27.312 Extended LBA Formats Supported: Not Supported 00:23:27.312 Flexible Data Placement Supported: Not Supported 00:23:27.312 00:23:27.312 Controller Memory Buffer Support 00:23:27.312 ================================ 00:23:27.312 Supported: No 00:23:27.312 00:23:27.312 Persistent Memory Region Support 00:23:27.312 ================================ 00:23:27.312 Supported: No 00:23:27.312 00:23:27.312 Admin Command Set Attributes 00:23:27.312 ============================ 00:23:27.312 Security Send/Receive: Not Supported 00:23:27.313 Format NVM: Not Supported 00:23:27.313 Firmware Activate/Download: Not Supported 00:23:27.313 Namespace Management: Not Supported 00:23:27.313 Device Self-Test: Not Supported 00:23:27.313 Directives: Not Supported 00:23:27.313 NVMe-MI: Not Supported 00:23:27.313 Virtualization Management: Not Supported 00:23:27.313 Doorbell Buffer Config: Not Supported 00:23:27.313 Get LBA Status Capability: Not Supported 00:23:27.313 Command & Feature Lockdown Capability: Not Supported 00:23:27.313 Abort Command Limit: 4 00:23:27.313 Async Event Request Limit: 4 00:23:27.313 Number of Firmware Slots: N/A 00:23:27.313 Firmware Slot 1 Read-Only: N/A 00:23:27.313 Firmware Activation Without Reset: N/A 00:23:27.313 Multiple Update Detection Support: N/A 00:23:27.313 Firmware Update Granularity: No Information Provided 00:23:27.313 Per-Namespace SMART Log: No 00:23:27.313 Asymmetric Namespace Access Log Page: Not Supported 00:23:27.313 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:23:27.313 Command Effects Log Page: Supported 00:23:27.313 Get Log Page Extended Data: Supported 00:23:27.313 Telemetry Log Pages: Not Supported 00:23:27.313 Persistent Event Log Pages: Not Supported 00:23:27.313 Supported Log Pages Log Page: May Support 00:23:27.313 Commands Supported & Effects Log Page: Not Supported 00:23:27.313 Feature Identifiers & Effects Log Page:May Support 00:23:27.313 NVMe-MI Commands & Effects Log Page: May Support 00:23:27.313 Data Area 4 for Telemetry Log: Not Supported 00:23:27.313 Error Log Page Entries Supported: 128 00:23:27.313 Keep Alive: Supported 00:23:27.313 Keep Alive Granularity: 10000 ms 00:23:27.313 00:23:27.313 NVM Command Set Attributes 00:23:27.313 ========================== 00:23:27.313 Submission Queue Entry Size 00:23:27.313 Max: 64 00:23:27.313 Min: 64 00:23:27.313 Completion Queue Entry Size 00:23:27.313 Max: 16 00:23:27.313 Min: 16 00:23:27.313 Number of Namespaces: 32 00:23:27.313 Compare Command: Supported 00:23:27.313 Write Uncorrectable Command: Not Supported 00:23:27.313 Dataset Management Command: Supported 00:23:27.313 Write Zeroes Command: Supported 00:23:27.313 Set Features Save Field: Not Supported 00:23:27.313 Reservations: Supported 00:23:27.313 Timestamp: Not Supported 00:23:27.313 Copy: Supported 00:23:27.313 Volatile Write Cache: Present 00:23:27.313 Atomic Write Unit (Normal): 1 00:23:27.313 Atomic Write Unit (PFail): 1 00:23:27.313 Atomic Compare & Write Unit: 1 00:23:27.313 Fused Compare & Write: Supported 00:23:27.313 Scatter-Gather List 00:23:27.313 SGL Command Set: Supported 00:23:27.313 SGL Keyed: Supported 00:23:27.313 SGL Bit Bucket Descriptor: Not Supported 00:23:27.313 SGL Metadata Pointer: Not Supported 00:23:27.313 Oversized SGL: Not Supported 00:23:27.313 SGL Metadata Address: Not Supported 00:23:27.313 SGL Offset: Supported 00:23:27.313 Transport SGL Data Block: Not Supported 00:23:27.313 Replay Protected Memory Block: Not Supported 00:23:27.313 00:23:27.313 Firmware Slot Information 00:23:27.313 ========================= 00:23:27.313 Active slot: 1 00:23:27.313 Slot 1 Firmware Revision: 24.01.1 00:23:27.313 00:23:27.313 00:23:27.313 Commands Supported and Effects 00:23:27.313 ============================== 00:23:27.313 Admin Commands 00:23:27.313 -------------- 00:23:27.313 Get Log Page (02h): Supported 00:23:27.313 Identify (06h): Supported 00:23:27.313 Abort (08h): Supported 00:23:27.313 Set Features (09h): Supported 00:23:27.313 Get Features (0Ah): Supported 00:23:27.313 Asynchronous Event Request (0Ch): Supported 00:23:27.313 Keep Alive (18h): Supported 00:23:27.313 I/O Commands 00:23:27.313 ------------ 00:23:27.313 Flush (00h): Supported LBA-Change 00:23:27.313 Write (01h): Supported LBA-Change 00:23:27.313 Read (02h): Supported 00:23:27.313 Compare (05h): Supported 00:23:27.313 Write Zeroes (08h): Supported LBA-Change 00:23:27.313 Dataset Management (09h): Supported LBA-Change 00:23:27.313 Copy (19h): Supported LBA-Change 00:23:27.313 Unknown (79h): Supported LBA-Change 00:23:27.313 Unknown (7Ah): Supported 00:23:27.313 00:23:27.313 Error Log 00:23:27.313 ========= 00:23:27.313 00:23:27.313 Arbitration 00:23:27.313 =========== 00:23:27.313 Arbitration Burst: 1 00:23:27.313 00:23:27.313 Power Management 00:23:27.313 ================ 00:23:27.313 Number of Power States: 1 00:23:27.313 Current Power State: Power State #0 00:23:27.313 Power State #0: 00:23:27.313 Max Power: 0.00 W 00:23:27.313 Non-Operational State: Operational 00:23:27.313 Entry Latency: Not Reported 00:23:27.313 Exit Latency: Not Reported 00:23:27.313 Relative Read Throughput: 0 00:23:27.313 Relative Read Latency: 0 00:23:27.313 Relative Write Throughput: 0 00:23:27.313 Relative Write Latency: 0 00:23:27.313 Idle Power: Not Reported 00:23:27.313 Active Power: Not Reported 00:23:27.313 Non-Operational Permissive Mode: Not Supported 00:23:27.313 00:23:27.313 Health Information 00:23:27.313 ================== 00:23:27.313 Critical Warnings: 00:23:27.313 Available Spare Space: OK 00:23:27.313 Temperature: OK 00:23:27.313 Device Reliability: OK 00:23:27.313 Read Only: No 00:23:27.313 Volatile Memory Backup: OK 00:23:27.313 Current Temperature: 0 Kelvin (-273 Celsius) 00:23:27.313 Temperature Threshold: [2024-11-28 19:11:48.279344] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.313 [2024-11-28 19:11:48.279356] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.313 [2024-11-28 19:11:48.279362] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x4c0e10) 00:23:27.313 [2024-11-28 19:11:48.279387] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.313 [2024-11-28 19:11:48.279422] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x5414d0, cid 7, qid 0 00:23:27.313 [2024-11-28 19:11:48.279552] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.313 [2024-11-28 19:11:48.279566] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.313 [2024-11-28 19:11:48.279573] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.313 [2024-11-28 19:11:48.279579] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x5414d0) on tqpair=0x4c0e10 00:23:27.313 [2024-11-28 19:11:48.279621] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:23:27.313 [2024-11-28 19:11:48.279642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:27.313 [2024-11-28 19:11:48.279654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:27.313 [2024-11-28 19:11:48.279663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:27.313 [2024-11-28 19:11:48.279672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:23:27.313 [2024-11-28 19:11:48.279684] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.313 [2024-11-28 19:11:48.279695] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.313 [2024-11-28 19:11:48.279702] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x4c0e10) 00:23:27.313 [2024-11-28 19:11:48.279713] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.313 [2024-11-28 19:11:48.279736] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x540f50, cid 3, qid 0 00:23:27.313 [2024-11-28 19:11:48.279916] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.313 [2024-11-28 19:11:48.279930] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.313 [2024-11-28 19:11:48.279937] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.313 [2024-11-28 19:11:48.279944] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x540f50) on tqpair=0x4c0e10 00:23:27.313 [2024-11-28 19:11:48.279955] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.313 [2024-11-28 19:11:48.279962] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.313 [2024-11-28 19:11:48.279969] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x4c0e10) 00:23:27.313 [2024-11-28 19:11:48.279979] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.313 [2024-11-28 19:11:48.280005] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x540f50, cid 3, qid 0 00:23:27.313 [2024-11-28 19:11:48.280097] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.313 [2024-11-28 19:11:48.280110] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.313 [2024-11-28 19:11:48.280117] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.313 [2024-11-28 19:11:48.280123] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x540f50) on tqpair=0x4c0e10 00:23:27.313 [2024-11-28 19:11:48.280131] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:23:27.313 [2024-11-28 19:11:48.280138] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:23:27.313 [2024-11-28 19:11:48.280154] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.313 [2024-11-28 19:11:48.280162] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.313 [2024-11-28 19:11:48.280169] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x4c0e10) 00:23:27.313 [2024-11-28 19:11:48.280179] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.313 [2024-11-28 19:11:48.280199] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x540f50, cid 3, qid 0 00:23:27.313 [2024-11-28 19:11:48.280274] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.313 [2024-11-28 19:11:48.280287] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.314 [2024-11-28 19:11:48.280294] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.314 [2024-11-28 19:11:48.280300] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x540f50) on tqpair=0x4c0e10 00:23:27.314 [2024-11-28 19:11:48.280316] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.314 [2024-11-28 19:11:48.280325] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.314 [2024-11-28 19:11:48.280331] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x4c0e10) 00:23:27.314 [2024-11-28 19:11:48.280342] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.314 [2024-11-28 19:11:48.280362] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x540f50, cid 3, qid 0 00:23:27.314 [2024-11-28 19:11:48.280461] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.314 [2024-11-28 19:11:48.280475] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.314 [2024-11-28 19:11:48.280482] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.314 [2024-11-28 19:11:48.280492] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x540f50) on tqpair=0x4c0e10 00:23:27.314 [2024-11-28 19:11:48.280509] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.314 [2024-11-28 19:11:48.280518] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.314 [2024-11-28 19:11:48.280524] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x4c0e10) 00:23:27.314 [2024-11-28 19:11:48.280534] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.314 [2024-11-28 19:11:48.280555] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x540f50, cid 3, qid 0 00:23:27.314 [2024-11-28 19:11:48.280633] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.314 [2024-11-28 19:11:48.280647] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.314 [2024-11-28 19:11:48.280653] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.314 [2024-11-28 19:11:48.280660] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x540f50) on tqpair=0x4c0e10 00:23:27.314 [2024-11-28 19:11:48.280676] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.314 [2024-11-28 19:11:48.280685] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.314 [2024-11-28 19:11:48.280691] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x4c0e10) 00:23:27.314 [2024-11-28 19:11:48.280701] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.314 [2024-11-28 19:11:48.280721] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x540f50, cid 3, qid 0 00:23:27.314 [2024-11-28 19:11:48.280799] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.314 [2024-11-28 19:11:48.280812] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.314 [2024-11-28 19:11:48.280819] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.314 [2024-11-28 19:11:48.280825] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x540f50) on tqpair=0x4c0e10 00:23:27.314 [2024-11-28 19:11:48.280841] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.314 [2024-11-28 19:11:48.280850] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.314 [2024-11-28 19:11:48.280856] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x4c0e10) 00:23:27.314 [2024-11-28 19:11:48.280867] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.314 [2024-11-28 19:11:48.280886] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x540f50, cid 3, qid 0 00:23:27.314 [2024-11-28 19:11:48.280957] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.314 [2024-11-28 19:11:48.280968] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.314 [2024-11-28 19:11:48.280975] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.314 [2024-11-28 19:11:48.280981] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x540f50) on tqpair=0x4c0e10 00:23:27.314 [2024-11-28 19:11:48.280997] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.314 [2024-11-28 19:11:48.281005] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.314 [2024-11-28 19:11:48.281012] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x4c0e10) 00:23:27.314 [2024-11-28 19:11:48.281022] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.314 [2024-11-28 19:11:48.281041] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x540f50, cid 3, qid 0 00:23:27.314 [2024-11-28 19:11:48.281114] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.314 [2024-11-28 19:11:48.281126] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.314 [2024-11-28 19:11:48.281132] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.314 [2024-11-28 19:11:48.281138] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x540f50) on tqpair=0x4c0e10 00:23:27.314 [2024-11-28 19:11:48.281158] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.314 [2024-11-28 19:11:48.281167] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.314 [2024-11-28 19:11:48.281173] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x4c0e10) 00:23:27.314 [2024-11-28 19:11:48.281184] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.314 [2024-11-28 19:11:48.281204] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x540f50, cid 3, qid 0 00:23:27.314 [2024-11-28 19:11:48.281276] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.314 [2024-11-28 19:11:48.281289] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.314 [2024-11-28 19:11:48.281296] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.314 [2024-11-28 19:11:48.281302] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x540f50) on tqpair=0x4c0e10 00:23:27.314 [2024-11-28 19:11:48.281318] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.314 [2024-11-28 19:11:48.281326] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.314 [2024-11-28 19:11:48.281333] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x4c0e10) 00:23:27.314 [2024-11-28 19:11:48.281343] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.314 [2024-11-28 19:11:48.281363] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x540f50, cid 3, qid 0 00:23:27.314 [2024-11-28 19:11:48.285408] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.314 [2024-11-28 19:11:48.285425] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.314 [2024-11-28 19:11:48.285432] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.314 [2024-11-28 19:11:48.285438] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x540f50) on tqpair=0x4c0e10 00:23:27.314 [2024-11-28 19:11:48.285455] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:23:27.314 [2024-11-28 19:11:48.285464] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:23:27.314 [2024-11-28 19:11:48.285470] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x4c0e10) 00:23:27.314 [2024-11-28 19:11:48.285481] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:23:27.314 [2024-11-28 19:11:48.285503] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x540f50, cid 3, qid 0 00:23:27.314 [2024-11-28 19:11:48.285613] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:23:27.314 [2024-11-28 19:11:48.285627] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:23:27.314 [2024-11-28 19:11:48.285634] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:23:27.314 [2024-11-28 19:11:48.285640] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x540f50) on tqpair=0x4c0e10 00:23:27.314 [2024-11-28 19:11:48.285653] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 5 milliseconds 00:23:27.314 0 Kelvin (-273 Celsius) 00:23:27.314 Available Spare: 0% 00:23:27.314 Available Spare Threshold: 0% 00:23:27.314 Life Percentage Used: 0% 00:23:27.314 Data Units Read: 0 00:23:27.314 Data Units Written: 0 00:23:27.314 Host Read Commands: 0 00:23:27.314 Host Write Commands: 0 00:23:27.314 Controller Busy Time: 0 minutes 00:23:27.314 Power Cycles: 0 00:23:27.314 Power On Hours: 0 hours 00:23:27.314 Unsafe Shutdowns: 0 00:23:27.314 Unrecoverable Media Errors: 0 00:23:27.314 Lifetime Error Log Entries: 0 00:23:27.314 Warning Temperature Time: 0 minutes 00:23:27.314 Critical Temperature Time: 0 minutes 00:23:27.314 00:23:27.314 Number of Queues 00:23:27.314 ================ 00:23:27.314 Number of I/O Submission Queues: 127 00:23:27.314 Number of I/O Completion Queues: 127 00:23:27.314 00:23:27.314 Active Namespaces 00:23:27.314 ================= 00:23:27.314 Namespace ID:1 00:23:27.314 Error Recovery Timeout: Unlimited 00:23:27.314 Command Set Identifier: NVM (00h) 00:23:27.314 Deallocate: Supported 00:23:27.314 Deallocated/Unwritten Error: Not Supported 00:23:27.314 Deallocated Read Value: Unknown 00:23:27.314 Deallocate in Write Zeroes: Not Supported 00:23:27.314 Deallocated Guard Field: 0xFFFF 00:23:27.314 Flush: Supported 00:23:27.314 Reservation: Supported 00:23:27.314 Namespace Sharing Capabilities: Multiple Controllers 00:23:27.314 Size (in LBAs): 131072 (0GiB) 00:23:27.314 Capacity (in LBAs): 131072 (0GiB) 00:23:27.314 Utilization (in LBAs): 131072 (0GiB) 00:23:27.314 NGUID: ABCDEF0123456789ABCDEF0123456789 00:23:27.314 EUI64: ABCDEF0123456789 00:23:27.314 UUID: abc1eb83-770c-42df-93f2-d3b7135d5411 00:23:27.314 Thin Provisioning: Not Supported 00:23:27.314 Per-NS Atomic Units: Yes 00:23:27.314 Atomic Boundary Size (Normal): 0 00:23:27.314 Atomic Boundary Size (PFail): 0 00:23:27.314 Atomic Boundary Offset: 0 00:23:27.314 Maximum Single Source Range Length: 65535 00:23:27.314 Maximum Copy Length: 65535 00:23:27.314 Maximum Source Range Count: 1 00:23:27.314 NGUID/EUI64 Never Reused: No 00:23:27.314 Namespace Write Protected: No 00:23:27.314 Number of LBA Formats: 1 00:23:27.314 Current LBA Format: LBA Format #00 00:23:27.314 LBA Format #00: Data Size: 512 Metadata Size: 0 00:23:27.314 00:23:27.314 19:11:48 -- host/identify.sh@51 -- # sync 00:23:27.314 19:11:48 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:27.314 19:11:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:27.314 19:11:48 -- common/autotest_common.sh@10 -- # set +x 00:23:27.314 19:11:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:27.315 19:11:48 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:23:27.315 19:11:48 -- host/identify.sh@56 -- # nvmftestfini 00:23:27.315 19:11:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:27.315 19:11:48 -- nvmf/common.sh@116 -- # sync 00:23:27.315 19:11:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:27.315 19:11:48 -- nvmf/common.sh@119 -- # set +e 00:23:27.315 19:11:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:27.315 19:11:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:27.315 rmmod nvme_tcp 00:23:27.315 rmmod nvme_fabrics 00:23:27.315 rmmod nvme_keyring 00:23:27.573 19:11:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:27.573 19:11:48 -- nvmf/common.sh@123 -- # set -e 00:23:27.573 19:11:48 -- nvmf/common.sh@124 -- # return 0 00:23:27.573 19:11:48 -- nvmf/common.sh@477 -- # '[' -n 281894 ']' 00:23:27.573 19:11:48 -- nvmf/common.sh@478 -- # killprocess 281894 00:23:27.573 19:11:48 -- common/autotest_common.sh@936 -- # '[' -z 281894 ']' 00:23:27.573 19:11:48 -- common/autotest_common.sh@940 -- # kill -0 281894 00:23:27.573 19:11:48 -- common/autotest_common.sh@941 -- # uname 00:23:27.573 19:11:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:27.573 19:11:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 281894 00:23:27.573 19:11:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:27.573 19:11:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:27.573 19:11:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 281894' 00:23:27.573 killing process with pid 281894 00:23:27.573 19:11:48 -- common/autotest_common.sh@955 -- # kill 281894 00:23:27.573 [2024-11-28 19:11:48.402586] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:23:27.573 19:11:48 -- common/autotest_common.sh@960 -- # wait 281894 00:23:27.833 19:11:48 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:27.833 19:11:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:27.833 19:11:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:27.833 19:11:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:27.833 19:11:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:27.833 19:11:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:27.833 19:11:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:27.833 19:11:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:29.741 19:11:50 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:29.741 00:23:29.741 real 0m6.148s 00:23:29.741 user 0m7.362s 00:23:29.741 sys 0m1.887s 00:23:29.741 19:11:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:29.741 19:11:50 -- common/autotest_common.sh@10 -- # set +x 00:23:29.741 ************************************ 00:23:29.741 END TEST nvmf_identify 00:23:29.741 ************************************ 00:23:29.741 19:11:50 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:23:29.741 19:11:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:29.741 19:11:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:29.741 19:11:50 -- common/autotest_common.sh@10 -- # set +x 00:23:29.741 ************************************ 00:23:29.741 START TEST nvmf_perf 00:23:29.741 ************************************ 00:23:29.741 19:11:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:23:29.999 * Looking for test storage... 00:23:29.999 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:23:29.999 19:11:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:29.999 19:11:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:29.999 19:11:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:29.999 19:11:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:29.999 19:11:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:29.999 19:11:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:29.999 19:11:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:29.999 19:11:50 -- scripts/common.sh@335 -- # IFS=.-: 00:23:29.999 19:11:50 -- scripts/common.sh@335 -- # read -ra ver1 00:23:29.999 19:11:50 -- scripts/common.sh@336 -- # IFS=.-: 00:23:29.999 19:11:50 -- scripts/common.sh@336 -- # read -ra ver2 00:23:29.999 19:11:50 -- scripts/common.sh@337 -- # local 'op=<' 00:23:29.999 19:11:50 -- scripts/common.sh@339 -- # ver1_l=2 00:23:29.999 19:11:50 -- scripts/common.sh@340 -- # ver2_l=1 00:23:29.999 19:11:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:29.999 19:11:50 -- scripts/common.sh@343 -- # case "$op" in 00:23:29.999 19:11:50 -- scripts/common.sh@344 -- # : 1 00:23:29.999 19:11:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:29.999 19:11:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:29.999 19:11:50 -- scripts/common.sh@364 -- # decimal 1 00:23:29.999 19:11:50 -- scripts/common.sh@352 -- # local d=1 00:23:29.999 19:11:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:29.999 19:11:50 -- scripts/common.sh@354 -- # echo 1 00:23:29.999 19:11:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:29.999 19:11:50 -- scripts/common.sh@365 -- # decimal 2 00:23:29.999 19:11:50 -- scripts/common.sh@352 -- # local d=2 00:23:29.999 19:11:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:29.999 19:11:50 -- scripts/common.sh@354 -- # echo 2 00:23:29.999 19:11:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:29.999 19:11:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:29.999 19:11:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:29.999 19:11:50 -- scripts/common.sh@367 -- # return 0 00:23:29.999 19:11:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:29.999 19:11:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:29.999 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:29.999 --rc genhtml_branch_coverage=1 00:23:29.999 --rc genhtml_function_coverage=1 00:23:29.999 --rc genhtml_legend=1 00:23:29.999 --rc geninfo_all_blocks=1 00:23:29.999 --rc geninfo_unexecuted_blocks=1 00:23:29.999 00:23:29.999 ' 00:23:29.999 19:11:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:29.999 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:29.999 --rc genhtml_branch_coverage=1 00:23:29.999 --rc genhtml_function_coverage=1 00:23:29.999 --rc genhtml_legend=1 00:23:29.999 --rc geninfo_all_blocks=1 00:23:29.999 --rc geninfo_unexecuted_blocks=1 00:23:29.999 00:23:29.999 ' 00:23:29.999 19:11:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:29.999 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:29.999 --rc genhtml_branch_coverage=1 00:23:29.999 --rc genhtml_function_coverage=1 00:23:29.999 --rc genhtml_legend=1 00:23:30.000 --rc geninfo_all_blocks=1 00:23:30.000 --rc geninfo_unexecuted_blocks=1 00:23:30.000 00:23:30.000 ' 00:23:30.000 19:11:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:30.000 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:30.000 --rc genhtml_branch_coverage=1 00:23:30.000 --rc genhtml_function_coverage=1 00:23:30.000 --rc genhtml_legend=1 00:23:30.000 --rc geninfo_all_blocks=1 00:23:30.000 --rc geninfo_unexecuted_blocks=1 00:23:30.000 00:23:30.000 ' 00:23:30.000 19:11:50 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:30.000 19:11:50 -- nvmf/common.sh@7 -- # uname -s 00:23:30.000 19:11:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:30.000 19:11:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:30.000 19:11:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:30.000 19:11:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:30.000 19:11:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:30.000 19:11:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:30.000 19:11:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:30.000 19:11:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:30.000 19:11:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:30.000 19:11:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:30.000 19:11:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:30.000 19:11:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:30.000 19:11:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:30.000 19:11:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:30.000 19:11:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:30.000 19:11:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:30.000 19:11:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:30.000 19:11:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:30.000 19:11:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:30.000 19:11:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:30.000 19:11:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:30.000 19:11:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:30.000 19:11:50 -- paths/export.sh@5 -- # export PATH 00:23:30.000 19:11:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:30.000 19:11:50 -- nvmf/common.sh@46 -- # : 0 00:23:30.000 19:11:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:30.000 19:11:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:30.000 19:11:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:30.000 19:11:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:30.000 19:11:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:30.000 19:11:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:30.000 19:11:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:30.000 19:11:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:30.000 19:11:50 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:23:30.000 19:11:50 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:23:30.000 19:11:50 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:23:30.000 19:11:50 -- host/perf.sh@17 -- # nvmftestinit 00:23:30.000 19:11:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:30.000 19:11:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:30.000 19:11:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:30.000 19:11:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:30.000 19:11:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:30.000 19:11:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:30.000 19:11:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:30.000 19:11:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:30.000 19:11:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:30.000 19:11:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:30.000 19:11:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:30.000 19:11:50 -- common/autotest_common.sh@10 -- # set +x 00:23:31.909 19:11:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:31.909 19:11:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:31.909 19:11:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:31.909 19:11:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:31.909 19:11:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:31.909 19:11:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:31.909 19:11:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:31.909 19:11:52 -- nvmf/common.sh@294 -- # net_devs=() 00:23:31.909 19:11:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:31.909 19:11:52 -- nvmf/common.sh@295 -- # e810=() 00:23:31.909 19:11:52 -- nvmf/common.sh@295 -- # local -ga e810 00:23:31.909 19:11:52 -- nvmf/common.sh@296 -- # x722=() 00:23:31.909 19:11:52 -- nvmf/common.sh@296 -- # local -ga x722 00:23:31.909 19:11:52 -- nvmf/common.sh@297 -- # mlx=() 00:23:31.909 19:11:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:31.909 19:11:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:31.909 19:11:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:31.909 19:11:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:31.909 19:11:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:31.909 19:11:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:31.909 19:11:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:31.909 19:11:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:31.909 19:11:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:31.909 19:11:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:31.909 19:11:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:31.909 19:11:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:31.909 19:11:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:31.909 19:11:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:31.909 19:11:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:31.909 19:11:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:31.909 19:11:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:31.909 19:11:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:31.909 19:11:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:31.909 19:11:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:31.909 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:31.909 19:11:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:31.909 19:11:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:31.909 19:11:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:31.909 19:11:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:31.909 19:11:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:31.909 19:11:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:31.909 19:11:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:31.909 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:31.909 19:11:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:31.909 19:11:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:31.909 19:11:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:31.909 19:11:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:31.909 19:11:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:31.909 19:11:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:31.909 19:11:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:31.909 19:11:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:31.909 19:11:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:31.909 19:11:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:31.909 19:11:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:31.909 19:11:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:31.909 19:11:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:31.909 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:31.909 19:11:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:31.909 19:11:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:31.909 19:11:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:31.909 19:11:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:31.909 19:11:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:31.909 19:11:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:31.909 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:31.909 19:11:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:31.909 19:11:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:31.909 19:11:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:31.909 19:11:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:31.909 19:11:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:31.909 19:11:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:31.909 19:11:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:31.909 19:11:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:31.909 19:11:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:31.910 19:11:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:31.910 19:11:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:31.910 19:11:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:31.910 19:11:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:31.910 19:11:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:31.910 19:11:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:31.910 19:11:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:31.910 19:11:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:31.910 19:11:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:31.910 19:11:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:31.910 19:11:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:31.910 19:11:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:31.910 19:11:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:31.910 19:11:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:32.169 19:11:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:32.169 19:11:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:32.169 19:11:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:32.169 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:32.169 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.327 ms 00:23:32.169 00:23:32.169 --- 10.0.0.2 ping statistics --- 00:23:32.169 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:32.169 rtt min/avg/max/mdev = 0.327/0.327/0.327/0.000 ms 00:23:32.169 19:11:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:32.169 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:32.169 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.089 ms 00:23:32.169 00:23:32.169 --- 10.0.0.1 ping statistics --- 00:23:32.169 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:32.169 rtt min/avg/max/mdev = 0.089/0.089/0.089/0.000 ms 00:23:32.169 19:11:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:32.169 19:11:52 -- nvmf/common.sh@410 -- # return 0 00:23:32.169 19:11:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:32.169 19:11:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:32.169 19:11:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:32.169 19:11:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:32.169 19:11:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:32.169 19:11:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:32.169 19:11:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:32.169 19:11:53 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:23:32.169 19:11:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:32.169 19:11:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:32.169 19:11:53 -- common/autotest_common.sh@10 -- # set +x 00:23:32.169 19:11:53 -- nvmf/common.sh@469 -- # nvmfpid=284001 00:23:32.169 19:11:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:32.169 19:11:53 -- nvmf/common.sh@470 -- # waitforlisten 284001 00:23:32.169 19:11:53 -- common/autotest_common.sh@829 -- # '[' -z 284001 ']' 00:23:32.169 19:11:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:32.169 19:11:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:32.169 19:11:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:32.169 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:32.169 19:11:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:32.169 19:11:53 -- common/autotest_common.sh@10 -- # set +x 00:23:32.169 [2024-11-28 19:11:53.047953] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:32.169 [2024-11-28 19:11:53.048043] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:32.169 EAL: No free 2048 kB hugepages reported on node 1 00:23:32.169 [2024-11-28 19:11:53.114037] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:32.429 [2024-11-28 19:11:53.223813] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:32.429 [2024-11-28 19:11:53.223962] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:32.429 [2024-11-28 19:11:53.223980] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:32.429 [2024-11-28 19:11:53.223994] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:32.429 [2024-11-28 19:11:53.224054] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:32.429 [2024-11-28 19:11:53.224088] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:32.429 [2024-11-28 19:11:53.224113] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:32.429 [2024-11-28 19:11:53.224116] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:32.998 19:11:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:32.998 19:11:54 -- common/autotest_common.sh@862 -- # return 0 00:23:32.998 19:11:54 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:32.998 19:11:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:32.998 19:11:54 -- common/autotest_common.sh@10 -- # set +x 00:23:32.998 19:11:54 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:32.998 19:11:54 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:23:32.998 19:11:54 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:23:36.284 19:11:57 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:23:36.284 19:11:57 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:23:36.543 19:11:57 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:23:36.543 19:11:57 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:23:36.801 19:11:57 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:23:36.801 19:11:57 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:23:36.801 19:11:57 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:23:36.801 19:11:57 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:23:36.801 19:11:57 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:23:37.060 [2024-11-28 19:11:57.923963] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:37.061 19:11:57 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:37.319 19:11:58 -- host/perf.sh@45 -- # for bdev in $bdevs 00:23:37.319 19:11:58 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:23:37.576 19:11:58 -- host/perf.sh@45 -- # for bdev in $bdevs 00:23:37.576 19:11:58 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:23:37.834 19:11:58 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:38.093 [2024-11-28 19:11:58.967905] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:38.093 19:11:58 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:23:38.352 19:11:59 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:23:38.352 19:11:59 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:38.352 19:11:59 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:23:38.352 19:11:59 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:23:39.731 Initializing NVMe Controllers 00:23:39.731 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:23:39.731 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:23:39.731 Initialization complete. Launching workers. 00:23:39.731 ======================================================== 00:23:39.731 Latency(us) 00:23:39.731 Device Information : IOPS MiB/s Average min max 00:23:39.731 PCIE (0000:88:00.0) NSID 1 from core 0: 85204.41 332.83 375.16 42.95 5248.42 00:23:39.731 ======================================================== 00:23:39.731 Total : 85204.41 332.83 375.16 42.95 5248.42 00:23:39.731 00:23:39.731 19:12:00 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:39.731 EAL: No free 2048 kB hugepages reported on node 1 00:23:41.106 Initializing NVMe Controllers 00:23:41.106 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:41.106 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:41.106 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:41.106 Initialization complete. Launching workers. 00:23:41.106 ======================================================== 00:23:41.106 Latency(us) 00:23:41.106 Device Information : IOPS MiB/s Average min max 00:23:41.106 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 77.00 0.30 13305.21 146.16 45887.69 00:23:41.106 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 42.00 0.16 23916.57 7929.56 47885.21 00:23:41.106 ======================================================== 00:23:41.106 Total : 119.00 0.46 17050.40 146.16 47885.21 00:23:41.106 00:23:41.106 19:12:01 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:41.106 EAL: No free 2048 kB hugepages reported on node 1 00:23:42.485 Initializing NVMe Controllers 00:23:42.485 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:42.485 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:42.485 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:42.485 Initialization complete. Launching workers. 00:23:42.485 ======================================================== 00:23:42.485 Latency(us) 00:23:42.485 Device Information : IOPS MiB/s Average min max 00:23:42.485 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8213.41 32.08 3920.91 619.87 46057.63 00:23:42.485 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3914.94 15.29 8185.97 6085.03 15880.18 00:23:42.485 ======================================================== 00:23:42.485 Total : 12128.35 47.38 5297.64 619.87 46057.63 00:23:42.485 00:23:42.485 19:12:03 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:23:42.485 19:12:03 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:23:42.485 19:12:03 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:42.485 EAL: No free 2048 kB hugepages reported on node 1 00:23:45.019 Initializing NVMe Controllers 00:23:45.020 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:45.020 Controller IO queue size 128, less than required. 00:23:45.020 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:45.020 Controller IO queue size 128, less than required. 00:23:45.020 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:45.020 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:45.020 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:45.020 Initialization complete. Launching workers. 00:23:45.020 ======================================================== 00:23:45.020 Latency(us) 00:23:45.020 Device Information : IOPS MiB/s Average min max 00:23:45.020 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1741.96 435.49 75130.79 55823.80 112695.65 00:23:45.020 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 596.49 149.12 218566.16 63996.74 348436.77 00:23:45.020 ======================================================== 00:23:45.020 Total : 2338.44 584.61 111718.00 55823.80 348436.77 00:23:45.020 00:23:45.020 19:12:05 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:23:45.020 EAL: No free 2048 kB hugepages reported on node 1 00:23:45.020 No valid NVMe controllers or AIO or URING devices found 00:23:45.020 Initializing NVMe Controllers 00:23:45.020 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:45.020 Controller IO queue size 128, less than required. 00:23:45.020 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:45.020 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:23:45.020 Controller IO queue size 128, less than required. 00:23:45.020 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:45.020 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:23:45.020 WARNING: Some requested NVMe devices were skipped 00:23:45.020 19:12:05 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:23:45.020 EAL: No free 2048 kB hugepages reported on node 1 00:23:47.552 Initializing NVMe Controllers 00:23:47.552 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:47.552 Controller IO queue size 128, less than required. 00:23:47.552 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:47.552 Controller IO queue size 128, less than required. 00:23:47.552 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:23:47.552 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:23:47.552 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:23:47.552 Initialization complete. Launching workers. 00:23:47.552 00:23:47.552 ==================== 00:23:47.552 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:23:47.552 TCP transport: 00:23:47.552 polls: 11517 00:23:47.552 idle_polls: 8398 00:23:47.552 sock_completions: 3119 00:23:47.552 nvme_completions: 5720 00:23:47.552 submitted_requests: 8747 00:23:47.552 queued_requests: 1 00:23:47.552 00:23:47.552 ==================== 00:23:47.552 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:23:47.552 TCP transport: 00:23:47.552 polls: 11871 00:23:47.552 idle_polls: 8364 00:23:47.552 sock_completions: 3507 00:23:47.552 nvme_completions: 6244 00:23:47.552 submitted_requests: 9470 00:23:47.552 queued_requests: 1 00:23:47.552 ======================================================== 00:23:47.552 Latency(us) 00:23:47.552 Device Information : IOPS MiB/s Average min max 00:23:47.552 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1490.50 372.63 88487.63 54679.41 143648.22 00:23:47.552 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1621.24 405.31 79465.24 41530.38 118837.53 00:23:47.552 ======================================================== 00:23:47.552 Total : 3111.74 777.93 83786.90 41530.38 143648.22 00:23:47.552 00:23:47.552 19:12:08 -- host/perf.sh@66 -- # sync 00:23:47.552 19:12:08 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:47.811 19:12:08 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:23:47.811 19:12:08 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:23:47.811 19:12:08 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:23:51.096 19:12:12 -- host/perf.sh@72 -- # ls_guid=64b597d9-5536-4e06-b963-a7b95744a08b 00:23:51.096 19:12:12 -- host/perf.sh@73 -- # get_lvs_free_mb 64b597d9-5536-4e06-b963-a7b95744a08b 00:23:51.096 19:12:12 -- common/autotest_common.sh@1353 -- # local lvs_uuid=64b597d9-5536-4e06-b963-a7b95744a08b 00:23:51.096 19:12:12 -- common/autotest_common.sh@1354 -- # local lvs_info 00:23:51.096 19:12:12 -- common/autotest_common.sh@1355 -- # local fc 00:23:51.096 19:12:12 -- common/autotest_common.sh@1356 -- # local cs 00:23:51.096 19:12:12 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:51.355 19:12:12 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:23:51.355 { 00:23:51.355 "uuid": "64b597d9-5536-4e06-b963-a7b95744a08b", 00:23:51.355 "name": "lvs_0", 00:23:51.355 "base_bdev": "Nvme0n1", 00:23:51.355 "total_data_clusters": 238234, 00:23:51.355 "free_clusters": 238234, 00:23:51.355 "block_size": 512, 00:23:51.355 "cluster_size": 4194304 00:23:51.355 } 00:23:51.355 ]' 00:23:51.355 19:12:12 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="64b597d9-5536-4e06-b963-a7b95744a08b") .free_clusters' 00:23:51.614 19:12:12 -- common/autotest_common.sh@1358 -- # fc=238234 00:23:51.614 19:12:12 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="64b597d9-5536-4e06-b963-a7b95744a08b") .cluster_size' 00:23:51.614 19:12:12 -- common/autotest_common.sh@1359 -- # cs=4194304 00:23:51.614 19:12:12 -- common/autotest_common.sh@1362 -- # free_mb=952936 00:23:51.614 19:12:12 -- common/autotest_common.sh@1363 -- # echo 952936 00:23:51.614 952936 00:23:51.614 19:12:12 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:23:51.614 19:12:12 -- host/perf.sh@78 -- # free_mb=20480 00:23:51.614 19:12:12 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 64b597d9-5536-4e06-b963-a7b95744a08b lbd_0 20480 00:23:52.181 19:12:13 -- host/perf.sh@80 -- # lb_guid=ba4633bf-e5cb-4ef1-a8f5-f02c15263bc7 00:23:52.181 19:12:13 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore ba4633bf-e5cb-4ef1-a8f5-f02c15263bc7 lvs_n_0 00:23:53.117 19:12:13 -- host/perf.sh@83 -- # ls_nested_guid=be52aedf-9c23-4966-bb41-216bfce8ee3a 00:23:53.117 19:12:13 -- host/perf.sh@84 -- # get_lvs_free_mb be52aedf-9c23-4966-bb41-216bfce8ee3a 00:23:53.117 19:12:13 -- common/autotest_common.sh@1353 -- # local lvs_uuid=be52aedf-9c23-4966-bb41-216bfce8ee3a 00:23:53.117 19:12:13 -- common/autotest_common.sh@1354 -- # local lvs_info 00:23:53.117 19:12:13 -- common/autotest_common.sh@1355 -- # local fc 00:23:53.117 19:12:13 -- common/autotest_common.sh@1356 -- # local cs 00:23:53.117 19:12:13 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:23:53.117 19:12:14 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:23:53.117 { 00:23:53.117 "uuid": "64b597d9-5536-4e06-b963-a7b95744a08b", 00:23:53.117 "name": "lvs_0", 00:23:53.117 "base_bdev": "Nvme0n1", 00:23:53.117 "total_data_clusters": 238234, 00:23:53.117 "free_clusters": 233114, 00:23:53.117 "block_size": 512, 00:23:53.117 "cluster_size": 4194304 00:23:53.117 }, 00:23:53.117 { 00:23:53.117 "uuid": "be52aedf-9c23-4966-bb41-216bfce8ee3a", 00:23:53.117 "name": "lvs_n_0", 00:23:53.117 "base_bdev": "ba4633bf-e5cb-4ef1-a8f5-f02c15263bc7", 00:23:53.117 "total_data_clusters": 5114, 00:23:53.117 "free_clusters": 5114, 00:23:53.117 "block_size": 512, 00:23:53.117 "cluster_size": 4194304 00:23:53.117 } 00:23:53.117 ]' 00:23:53.117 19:12:14 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="be52aedf-9c23-4966-bb41-216bfce8ee3a") .free_clusters' 00:23:53.117 19:12:14 -- common/autotest_common.sh@1358 -- # fc=5114 00:23:53.117 19:12:14 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="be52aedf-9c23-4966-bb41-216bfce8ee3a") .cluster_size' 00:23:53.375 19:12:14 -- common/autotest_common.sh@1359 -- # cs=4194304 00:23:53.375 19:12:14 -- common/autotest_common.sh@1362 -- # free_mb=20456 00:23:53.375 19:12:14 -- common/autotest_common.sh@1363 -- # echo 20456 00:23:53.375 20456 00:23:53.375 19:12:14 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:23:53.375 19:12:14 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u be52aedf-9c23-4966-bb41-216bfce8ee3a lbd_nest_0 20456 00:23:53.634 19:12:14 -- host/perf.sh@88 -- # lb_nested_guid=3659f139-691c-4b39-9df3-411c5466016f 00:23:53.634 19:12:14 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:53.892 19:12:14 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:23:53.892 19:12:14 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 3659f139-691c-4b39-9df3-411c5466016f 00:23:54.150 19:12:14 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:54.409 19:12:15 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:23:54.409 19:12:15 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:23:54.409 19:12:15 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:23:54.409 19:12:15 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:23:54.409 19:12:15 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:23:54.409 EAL: No free 2048 kB hugepages reported on node 1 00:24:06.618 Initializing NVMe Controllers 00:24:06.618 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:06.618 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:06.618 Initialization complete. Launching workers. 00:24:06.618 ======================================================== 00:24:06.618 Latency(us) 00:24:06.618 Device Information : IOPS MiB/s Average min max 00:24:06.618 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 47.37 0.02 21108.18 167.22 46884.85 00:24:06.618 ======================================================== 00:24:06.618 Total : 47.37 0.02 21108.18 167.22 46884.85 00:24:06.618 00:24:06.618 19:12:25 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:06.618 19:12:25 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:06.618 EAL: No free 2048 kB hugepages reported on node 1 00:24:14.739 Initializing NVMe Controllers 00:24:14.739 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:14.739 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:14.739 Initialization complete. Launching workers. 00:24:14.739 ======================================================== 00:24:14.739 Latency(us) 00:24:14.740 Device Information : IOPS MiB/s Average min max 00:24:14.740 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 81.40 10.17 12291.24 5052.66 47902.58 00:24:14.740 ======================================================== 00:24:14.740 Total : 81.40 10.17 12291.24 5052.66 47902.58 00:24:14.740 00:24:14.740 19:12:35 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:24:14.740 19:12:35 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:14.740 19:12:35 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:14.997 EAL: No free 2048 kB hugepages reported on node 1 00:24:24.976 Initializing NVMe Controllers 00:24:24.976 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:24.976 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:24.976 Initialization complete. Launching workers. 00:24:24.976 ======================================================== 00:24:24.976 Latency(us) 00:24:24.976 Device Information : IOPS MiB/s Average min max 00:24:24.976 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7899.68 3.86 4057.50 364.04 43060.13 00:24:24.976 ======================================================== 00:24:24.976 Total : 7899.68 3.86 4057.50 364.04 43060.13 00:24:24.976 00:24:24.976 19:12:46 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:24.976 19:12:46 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:25.243 EAL: No free 2048 kB hugepages reported on node 1 00:24:37.449 Initializing NVMe Controllers 00:24:37.449 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:37.449 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:37.449 Initialization complete. Launching workers. 00:24:37.449 ======================================================== 00:24:37.449 Latency(us) 00:24:37.449 Device Information : IOPS MiB/s Average min max 00:24:37.449 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 4100.43 512.55 7804.48 807.28 18280.38 00:24:37.449 ======================================================== 00:24:37.449 Total : 4100.43 512.55 7804.48 807.28 18280.38 00:24:37.449 00:24:37.449 19:12:56 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:24:37.449 19:12:56 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:37.449 19:12:56 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:37.449 EAL: No free 2048 kB hugepages reported on node 1 00:24:47.430 Initializing NVMe Controllers 00:24:47.430 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:47.430 Controller IO queue size 128, less than required. 00:24:47.430 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:47.430 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:47.430 Initialization complete. Launching workers. 00:24:47.430 ======================================================== 00:24:47.430 Latency(us) 00:24:47.430 Device Information : IOPS MiB/s Average min max 00:24:47.430 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 12114.40 5.92 10571.67 1714.82 24106.05 00:24:47.430 ======================================================== 00:24:47.430 Total : 12114.40 5.92 10571.67 1714.82 24106.05 00:24:47.430 00:24:47.430 19:13:06 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:24:47.430 19:13:06 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:24:47.430 EAL: No free 2048 kB hugepages reported on node 1 00:24:57.414 Initializing NVMe Controllers 00:24:57.414 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:57.414 Controller IO queue size 128, less than required. 00:24:57.414 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:24:57.414 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:24:57.414 Initialization complete. Launching workers. 00:24:57.414 ======================================================== 00:24:57.414 Latency(us) 00:24:57.414 Device Information : IOPS MiB/s Average min max 00:24:57.414 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1188.12 148.51 108253.50 9963.98 245853.76 00:24:57.414 ======================================================== 00:24:57.414 Total : 1188.12 148.51 108253.50 9963.98 245853.76 00:24:57.414 00:24:57.414 19:13:17 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:57.414 19:13:17 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 3659f139-691c-4b39-9df3-411c5466016f 00:24:57.414 19:13:18 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:24:57.672 19:13:18 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete ba4633bf-e5cb-4ef1-a8f5-f02c15263bc7 00:24:57.930 19:13:18 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:24:58.189 19:13:19 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:24:58.189 19:13:19 -- host/perf.sh@114 -- # nvmftestfini 00:24:58.189 19:13:19 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:58.189 19:13:19 -- nvmf/common.sh@116 -- # sync 00:24:58.189 19:13:19 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:58.189 19:13:19 -- nvmf/common.sh@119 -- # set +e 00:24:58.189 19:13:19 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:58.189 19:13:19 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:58.189 rmmod nvme_tcp 00:24:58.189 rmmod nvme_fabrics 00:24:58.449 rmmod nvme_keyring 00:24:58.449 19:13:19 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:58.449 19:13:19 -- nvmf/common.sh@123 -- # set -e 00:24:58.449 19:13:19 -- nvmf/common.sh@124 -- # return 0 00:24:58.449 19:13:19 -- nvmf/common.sh@477 -- # '[' -n 284001 ']' 00:24:58.449 19:13:19 -- nvmf/common.sh@478 -- # killprocess 284001 00:24:58.449 19:13:19 -- common/autotest_common.sh@936 -- # '[' -z 284001 ']' 00:24:58.449 19:13:19 -- common/autotest_common.sh@940 -- # kill -0 284001 00:24:58.449 19:13:19 -- common/autotest_common.sh@941 -- # uname 00:24:58.449 19:13:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:58.449 19:13:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 284001 00:24:58.449 19:13:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:58.449 19:13:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:58.449 19:13:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 284001' 00:24:58.449 killing process with pid 284001 00:24:58.449 19:13:19 -- common/autotest_common.sh@955 -- # kill 284001 00:24:58.449 19:13:19 -- common/autotest_common.sh@960 -- # wait 284001 00:25:00.355 19:13:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:00.355 19:13:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:00.355 19:13:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:00.355 19:13:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:00.355 19:13:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:00.355 19:13:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:00.355 19:13:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:00.355 19:13:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:02.261 19:13:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:02.261 00:25:02.261 real 1m32.292s 00:25:02.261 user 5m42.671s 00:25:02.261 sys 0m15.428s 00:25:02.261 19:13:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:02.261 19:13:23 -- common/autotest_common.sh@10 -- # set +x 00:25:02.261 ************************************ 00:25:02.261 END TEST nvmf_perf 00:25:02.261 ************************************ 00:25:02.261 19:13:23 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:25:02.261 19:13:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:02.261 19:13:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:02.261 19:13:23 -- common/autotest_common.sh@10 -- # set +x 00:25:02.261 ************************************ 00:25:02.261 START TEST nvmf_fio_host 00:25:02.261 ************************************ 00:25:02.261 19:13:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:25:02.262 * Looking for test storage... 00:25:02.262 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:02.262 19:13:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:02.262 19:13:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:02.262 19:13:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:02.262 19:13:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:02.262 19:13:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:02.262 19:13:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:02.262 19:13:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:02.262 19:13:23 -- scripts/common.sh@335 -- # IFS=.-: 00:25:02.262 19:13:23 -- scripts/common.sh@335 -- # read -ra ver1 00:25:02.262 19:13:23 -- scripts/common.sh@336 -- # IFS=.-: 00:25:02.262 19:13:23 -- scripts/common.sh@336 -- # read -ra ver2 00:25:02.262 19:13:23 -- scripts/common.sh@337 -- # local 'op=<' 00:25:02.262 19:13:23 -- scripts/common.sh@339 -- # ver1_l=2 00:25:02.262 19:13:23 -- scripts/common.sh@340 -- # ver2_l=1 00:25:02.262 19:13:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:02.262 19:13:23 -- scripts/common.sh@343 -- # case "$op" in 00:25:02.262 19:13:23 -- scripts/common.sh@344 -- # : 1 00:25:02.262 19:13:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:02.262 19:13:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:02.262 19:13:23 -- scripts/common.sh@364 -- # decimal 1 00:25:02.262 19:13:23 -- scripts/common.sh@352 -- # local d=1 00:25:02.262 19:13:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:02.262 19:13:23 -- scripts/common.sh@354 -- # echo 1 00:25:02.262 19:13:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:02.262 19:13:23 -- scripts/common.sh@365 -- # decimal 2 00:25:02.262 19:13:23 -- scripts/common.sh@352 -- # local d=2 00:25:02.262 19:13:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:02.262 19:13:23 -- scripts/common.sh@354 -- # echo 2 00:25:02.262 19:13:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:02.262 19:13:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:02.262 19:13:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:02.262 19:13:23 -- scripts/common.sh@367 -- # return 0 00:25:02.262 19:13:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:02.262 19:13:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:02.262 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:02.262 --rc genhtml_branch_coverage=1 00:25:02.262 --rc genhtml_function_coverage=1 00:25:02.262 --rc genhtml_legend=1 00:25:02.262 --rc geninfo_all_blocks=1 00:25:02.262 --rc geninfo_unexecuted_blocks=1 00:25:02.262 00:25:02.262 ' 00:25:02.262 19:13:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:02.262 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:02.262 --rc genhtml_branch_coverage=1 00:25:02.262 --rc genhtml_function_coverage=1 00:25:02.262 --rc genhtml_legend=1 00:25:02.262 --rc geninfo_all_blocks=1 00:25:02.262 --rc geninfo_unexecuted_blocks=1 00:25:02.262 00:25:02.262 ' 00:25:02.262 19:13:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:02.262 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:02.262 --rc genhtml_branch_coverage=1 00:25:02.262 --rc genhtml_function_coverage=1 00:25:02.262 --rc genhtml_legend=1 00:25:02.262 --rc geninfo_all_blocks=1 00:25:02.262 --rc geninfo_unexecuted_blocks=1 00:25:02.262 00:25:02.262 ' 00:25:02.262 19:13:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:02.262 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:02.262 --rc genhtml_branch_coverage=1 00:25:02.262 --rc genhtml_function_coverage=1 00:25:02.262 --rc genhtml_legend=1 00:25:02.262 --rc geninfo_all_blocks=1 00:25:02.262 --rc geninfo_unexecuted_blocks=1 00:25:02.262 00:25:02.262 ' 00:25:02.262 19:13:23 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:02.262 19:13:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:02.262 19:13:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:02.262 19:13:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:02.262 19:13:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:02.262 19:13:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:02.262 19:13:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:02.262 19:13:23 -- paths/export.sh@5 -- # export PATH 00:25:02.262 19:13:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:02.262 19:13:23 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:02.262 19:13:23 -- nvmf/common.sh@7 -- # uname -s 00:25:02.262 19:13:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:02.262 19:13:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:02.262 19:13:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:02.262 19:13:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:02.262 19:13:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:02.262 19:13:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:02.262 19:13:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:02.262 19:13:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:02.262 19:13:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:02.262 19:13:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:02.262 19:13:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:02.262 19:13:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:02.262 19:13:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:02.262 19:13:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:02.262 19:13:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:02.262 19:13:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:02.262 19:13:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:02.262 19:13:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:02.262 19:13:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:02.262 19:13:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:02.262 19:13:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:02.262 19:13:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:02.262 19:13:23 -- paths/export.sh@5 -- # export PATH 00:25:02.262 19:13:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:02.262 19:13:23 -- nvmf/common.sh@46 -- # : 0 00:25:02.262 19:13:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:02.262 19:13:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:02.262 19:13:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:02.262 19:13:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:02.262 19:13:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:02.262 19:13:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:02.262 19:13:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:02.262 19:13:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:02.262 19:13:23 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:25:02.262 19:13:23 -- host/fio.sh@14 -- # nvmftestinit 00:25:02.262 19:13:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:02.262 19:13:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:02.262 19:13:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:02.262 19:13:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:02.262 19:13:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:02.262 19:13:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:02.263 19:13:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:02.263 19:13:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:02.263 19:13:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:02.263 19:13:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:02.263 19:13:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:02.263 19:13:23 -- common/autotest_common.sh@10 -- # set +x 00:25:04.794 19:13:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:04.794 19:13:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:04.794 19:13:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:04.794 19:13:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:04.794 19:13:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:04.794 19:13:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:04.794 19:13:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:04.794 19:13:25 -- nvmf/common.sh@294 -- # net_devs=() 00:25:04.794 19:13:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:04.794 19:13:25 -- nvmf/common.sh@295 -- # e810=() 00:25:04.794 19:13:25 -- nvmf/common.sh@295 -- # local -ga e810 00:25:04.794 19:13:25 -- nvmf/common.sh@296 -- # x722=() 00:25:04.794 19:13:25 -- nvmf/common.sh@296 -- # local -ga x722 00:25:04.794 19:13:25 -- nvmf/common.sh@297 -- # mlx=() 00:25:04.794 19:13:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:04.794 19:13:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:04.794 19:13:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:04.794 19:13:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:04.794 19:13:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:04.794 19:13:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:04.794 19:13:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:04.794 19:13:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:04.794 19:13:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:04.794 19:13:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:04.794 19:13:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:04.794 19:13:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:04.794 19:13:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:04.794 19:13:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:04.794 19:13:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:04.794 19:13:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:04.794 19:13:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:04.794 19:13:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:04.794 19:13:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:04.794 19:13:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:04.794 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:04.794 19:13:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:04.794 19:13:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:04.794 19:13:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:04.794 19:13:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:04.794 19:13:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:04.794 19:13:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:04.794 19:13:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:04.794 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:04.794 19:13:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:04.794 19:13:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:04.794 19:13:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:04.794 19:13:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:04.794 19:13:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:04.794 19:13:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:04.794 19:13:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:04.794 19:13:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:04.794 19:13:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:04.794 19:13:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:04.794 19:13:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:04.794 19:13:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:04.794 19:13:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:04.794 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:04.794 19:13:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:04.794 19:13:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:04.794 19:13:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:04.794 19:13:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:04.794 19:13:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:04.794 19:13:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:04.794 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:04.794 19:13:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:04.794 19:13:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:04.794 19:13:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:04.794 19:13:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:04.794 19:13:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:04.794 19:13:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:04.794 19:13:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:04.794 19:13:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:04.794 19:13:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:04.794 19:13:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:04.794 19:13:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:04.794 19:13:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:04.794 19:13:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:04.794 19:13:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:04.794 19:13:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:04.794 19:13:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:04.794 19:13:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:04.794 19:13:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:04.794 19:13:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:04.794 19:13:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:04.794 19:13:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:04.794 19:13:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:04.794 19:13:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:04.794 19:13:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:04.794 19:13:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:04.794 19:13:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:04.794 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:04.794 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.295 ms 00:25:04.794 00:25:04.794 --- 10.0.0.2 ping statistics --- 00:25:04.794 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:04.794 rtt min/avg/max/mdev = 0.295/0.295/0.295/0.000 ms 00:25:04.794 19:13:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:04.794 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:04.794 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.070 ms 00:25:04.794 00:25:04.794 --- 10.0.0.1 ping statistics --- 00:25:04.794 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:04.794 rtt min/avg/max/mdev = 0.070/0.070/0.070/0.000 ms 00:25:04.794 19:13:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:04.794 19:13:25 -- nvmf/common.sh@410 -- # return 0 00:25:04.794 19:13:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:04.794 19:13:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:04.794 19:13:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:04.794 19:13:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:04.794 19:13:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:04.795 19:13:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:04.795 19:13:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:04.795 19:13:25 -- host/fio.sh@16 -- # [[ y != y ]] 00:25:04.795 19:13:25 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:25:04.795 19:13:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:04.795 19:13:25 -- common/autotest_common.sh@10 -- # set +x 00:25:04.795 19:13:25 -- host/fio.sh@24 -- # nvmfpid=297208 00:25:04.795 19:13:25 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:04.795 19:13:25 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:04.795 19:13:25 -- host/fio.sh@28 -- # waitforlisten 297208 00:25:04.795 19:13:25 -- common/autotest_common.sh@829 -- # '[' -z 297208 ']' 00:25:04.795 19:13:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:04.795 19:13:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:04.795 19:13:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:04.795 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:04.795 19:13:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:04.795 19:13:25 -- common/autotest_common.sh@10 -- # set +x 00:25:04.795 [2024-11-28 19:13:25.489025] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:04.795 [2024-11-28 19:13:25.489107] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:04.795 EAL: No free 2048 kB hugepages reported on node 1 00:25:04.795 [2024-11-28 19:13:25.558142] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:04.795 [2024-11-28 19:13:25.674114] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:04.795 [2024-11-28 19:13:25.674261] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:04.795 [2024-11-28 19:13:25.674277] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:04.795 [2024-11-28 19:13:25.674289] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:04.795 [2024-11-28 19:13:25.674341] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:04.795 [2024-11-28 19:13:25.674368] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:04.795 [2024-11-28 19:13:25.674423] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:04.795 [2024-11-28 19:13:25.674427] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:05.729 19:13:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:05.729 19:13:26 -- common/autotest_common.sh@862 -- # return 0 00:25:05.729 19:13:26 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:25:05.987 [2024-11-28 19:13:26.829148] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:05.987 19:13:26 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:25:05.987 19:13:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:05.987 19:13:26 -- common/autotest_common.sh@10 -- # set +x 00:25:05.987 19:13:26 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:25:06.245 Malloc1 00:25:06.245 19:13:27 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:06.503 19:13:27 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:25:06.761 19:13:27 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:07.019 [2024-11-28 19:13:27.899403] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:07.019 19:13:27 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:25:07.278 19:13:28 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:25:07.278 19:13:28 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:07.278 19:13:28 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:07.278 19:13:28 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:07.278 19:13:28 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:07.278 19:13:28 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:07.278 19:13:28 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:07.278 19:13:28 -- common/autotest_common.sh@1330 -- # shift 00:25:07.278 19:13:28 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:07.278 19:13:28 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:07.278 19:13:28 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:07.278 19:13:28 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:07.278 19:13:28 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:07.278 19:13:28 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:07.278 19:13:28 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:07.278 19:13:28 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:07.278 19:13:28 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:07.278 19:13:28 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:07.278 19:13:28 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:07.278 19:13:28 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:07.278 19:13:28 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:07.278 19:13:28 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:07.278 19:13:28 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:07.536 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:25:07.536 fio-3.35 00:25:07.536 Starting 1 thread 00:25:07.536 EAL: No free 2048 kB hugepages reported on node 1 00:25:10.066 00:25:10.066 test: (groupid=0, jobs=1): err= 0: pid=297714: Thu Nov 28 19:13:30 2024 00:25:10.066 read: IOPS=9546, BW=37.3MiB/s (39.1MB/s)(74.8MiB/2006msec) 00:25:10.066 slat (nsec): min=1844, max=112406, avg=2522.27, stdev=1745.02 00:25:10.066 clat (usec): min=2273, max=12384, avg=7340.26, stdev=578.38 00:25:10.066 lat (usec): min=2292, max=12386, avg=7342.78, stdev=578.30 00:25:10.066 clat percentiles (usec): 00:25:10.066 | 1.00th=[ 5997], 5.00th=[ 6390], 10.00th=[ 6652], 20.00th=[ 6915], 00:25:10.066 | 30.00th=[ 7046], 40.00th=[ 7242], 50.00th=[ 7373], 60.00th=[ 7504], 00:25:10.066 | 70.00th=[ 7635], 80.00th=[ 7832], 90.00th=[ 8029], 95.00th=[ 8225], 00:25:10.066 | 99.00th=[ 8586], 99.50th=[ 8848], 99.90th=[10290], 99.95th=[11863], 00:25:10.066 | 99.99th=[12387] 00:25:10.066 bw ( KiB/s): min=36936, max=38816, per=99.94%, avg=38164.00, stdev=881.32, samples=4 00:25:10.066 iops : min= 9234, max= 9704, avg=9541.00, stdev=220.33, samples=4 00:25:10.066 write: IOPS=9557, BW=37.3MiB/s (39.1MB/s)(74.9MiB/2006msec); 0 zone resets 00:25:10.066 slat (nsec): min=1965, max=102026, avg=2602.91, stdev=1510.82 00:25:10.066 clat (usec): min=947, max=10628, avg=5966.62, stdev=482.32 00:25:10.066 lat (usec): min=953, max=10631, avg=5969.23, stdev=482.28 00:25:10.066 clat percentiles (usec): 00:25:10.066 | 1.00th=[ 4883], 5.00th=[ 5276], 10.00th=[ 5407], 20.00th=[ 5604], 00:25:10.066 | 30.00th=[ 5735], 40.00th=[ 5866], 50.00th=[ 5997], 60.00th=[ 6063], 00:25:10.066 | 70.00th=[ 6194], 80.00th=[ 6325], 90.00th=[ 6521], 95.00th=[ 6718], 00:25:10.066 | 99.00th=[ 6980], 99.50th=[ 7111], 99.90th=[ 8979], 99.95th=[10159], 00:25:10.066 | 99.99th=[10552] 00:25:10.066 bw ( KiB/s): min=37840, max=38976, per=99.99%, avg=38228.00, stdev=514.22, samples=4 00:25:10.066 iops : min= 9460, max= 9744, avg=9557.00, stdev=128.56, samples=4 00:25:10.066 lat (usec) : 1000=0.01% 00:25:10.066 lat (msec) : 2=0.02%, 4=0.11%, 10=99.77%, 20=0.10% 00:25:10.066 cpu : usr=64.99%, sys=33.17%, ctx=74, majf=0, minf=41 00:25:10.066 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:25:10.066 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:10.066 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:10.066 issued rwts: total=19150,19173,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:10.066 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:10.066 00:25:10.066 Run status group 0 (all jobs): 00:25:10.066 READ: bw=37.3MiB/s (39.1MB/s), 37.3MiB/s-37.3MiB/s (39.1MB/s-39.1MB/s), io=74.8MiB (78.4MB), run=2006-2006msec 00:25:10.066 WRITE: bw=37.3MiB/s (39.1MB/s), 37.3MiB/s-37.3MiB/s (39.1MB/s-39.1MB/s), io=74.9MiB (78.5MB), run=2006-2006msec 00:25:10.066 19:13:30 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:25:10.066 19:13:30 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:25:10.066 19:13:30 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:10.066 19:13:30 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:10.066 19:13:30 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:10.066 19:13:30 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:10.066 19:13:30 -- common/autotest_common.sh@1330 -- # shift 00:25:10.066 19:13:30 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:10.066 19:13:30 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:10.066 19:13:30 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:10.066 19:13:30 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:10.066 19:13:30 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:10.066 19:13:30 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:10.066 19:13:30 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:10.066 19:13:30 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:10.066 19:13:30 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:10.066 19:13:30 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:10.066 19:13:30 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:10.066 19:13:30 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:10.066 19:13:30 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:10.066 19:13:30 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:10.066 19:13:30 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:25:10.327 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:25:10.327 fio-3.35 00:25:10.327 Starting 1 thread 00:25:10.327 EAL: No free 2048 kB hugepages reported on node 1 00:25:12.857 00:25:12.858 test: (groupid=0, jobs=1): err= 0: pid=298051: Thu Nov 28 19:13:33 2024 00:25:12.858 read: IOPS=9092, BW=142MiB/s (149MB/s)(285MiB/2006msec) 00:25:12.858 slat (usec): min=2, max=104, avg= 3.78, stdev= 1.89 00:25:12.858 clat (usec): min=2027, max=15326, avg=8298.19, stdev=1872.76 00:25:12.858 lat (usec): min=2030, max=15329, avg=8301.97, stdev=1872.85 00:25:12.858 clat percentiles (usec): 00:25:12.858 | 1.00th=[ 4424], 5.00th=[ 5276], 10.00th=[ 5866], 20.00th=[ 6587], 00:25:12.858 | 30.00th=[ 7177], 40.00th=[ 7767], 50.00th=[ 8291], 60.00th=[ 8848], 00:25:12.858 | 70.00th=[ 9372], 80.00th=[ 9896], 90.00th=[10552], 95.00th=[11207], 00:25:12.858 | 99.00th=[13304], 99.50th=[13960], 99.90th=[14615], 99.95th=[14877], 00:25:12.858 | 99.99th=[15270] 00:25:12.858 bw ( KiB/s): min=66496, max=80544, per=49.51%, avg=72032.00, stdev=6002.42, samples=4 00:25:12.858 iops : min= 4156, max= 5034, avg=4502.00, stdev=375.15, samples=4 00:25:12.858 write: IOPS=5338, BW=83.4MiB/s (87.5MB/s)(146MiB/1754msec); 0 zone resets 00:25:12.858 slat (usec): min=30, max=188, avg=33.82, stdev= 5.70 00:25:12.858 clat (usec): min=5266, max=16871, avg=10556.22, stdev=1783.74 00:25:12.858 lat (usec): min=5302, max=16902, avg=10590.04, stdev=1784.33 00:25:12.858 clat percentiles (usec): 00:25:12.858 | 1.00th=[ 7242], 5.00th=[ 7898], 10.00th=[ 8455], 20.00th=[ 8979], 00:25:12.858 | 30.00th=[ 9503], 40.00th=[ 9896], 50.00th=[10421], 60.00th=[10945], 00:25:12.858 | 70.00th=[11338], 80.00th=[11994], 90.00th=[13042], 95.00th=[13829], 00:25:12.858 | 99.00th=[15401], 99.50th=[15926], 99.90th=[16581], 99.95th=[16909], 00:25:12.858 | 99.99th=[16909] 00:25:12.858 bw ( KiB/s): min=68768, max=84000, per=87.70%, avg=74904.00, stdev=6593.26, samples=4 00:25:12.858 iops : min= 4298, max= 5250, avg=4681.50, stdev=412.08, samples=4 00:25:12.858 lat (msec) : 4=0.23%, 10=68.07%, 20=31.70% 00:25:12.858 cpu : usr=79.25%, sys=19.60%, ctx=30, majf=0, minf=71 00:25:12.858 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.6% 00:25:12.858 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:12.858 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:12.858 issued rwts: total=18239,9363,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:12.858 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:12.858 00:25:12.858 Run status group 0 (all jobs): 00:25:12.858 READ: bw=142MiB/s (149MB/s), 142MiB/s-142MiB/s (149MB/s-149MB/s), io=285MiB (299MB), run=2006-2006msec 00:25:12.858 WRITE: bw=83.4MiB/s (87.5MB/s), 83.4MiB/s-83.4MiB/s (87.5MB/s-87.5MB/s), io=146MiB (153MB), run=1754-1754msec 00:25:12.858 19:13:33 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:12.858 19:13:33 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:25:12.858 19:13:33 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:25:12.858 19:13:33 -- host/fio.sh@51 -- # get_nvme_bdfs 00:25:12.858 19:13:33 -- common/autotest_common.sh@1508 -- # bdfs=() 00:25:12.858 19:13:33 -- common/autotest_common.sh@1508 -- # local bdfs 00:25:12.858 19:13:33 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:25:12.858 19:13:33 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:25:12.858 19:13:33 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:25:12.858 19:13:33 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:25:12.858 19:13:33 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:25:12.858 19:13:33 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:25:16.159 Nvme0n1 00:25:16.159 19:13:36 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:25:19.448 19:13:39 -- host/fio.sh@53 -- # ls_guid=875f30d1-0245-4451-8ab1-33e665e19b9f 00:25:19.448 19:13:39 -- host/fio.sh@54 -- # get_lvs_free_mb 875f30d1-0245-4451-8ab1-33e665e19b9f 00:25:19.448 19:13:39 -- common/autotest_common.sh@1353 -- # local lvs_uuid=875f30d1-0245-4451-8ab1-33e665e19b9f 00:25:19.448 19:13:39 -- common/autotest_common.sh@1354 -- # local lvs_info 00:25:19.448 19:13:39 -- common/autotest_common.sh@1355 -- # local fc 00:25:19.448 19:13:39 -- common/autotest_common.sh@1356 -- # local cs 00:25:19.448 19:13:39 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:25:19.448 19:13:40 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:25:19.448 { 00:25:19.448 "uuid": "875f30d1-0245-4451-8ab1-33e665e19b9f", 00:25:19.448 "name": "lvs_0", 00:25:19.448 "base_bdev": "Nvme0n1", 00:25:19.448 "total_data_clusters": 930, 00:25:19.448 "free_clusters": 930, 00:25:19.448 "block_size": 512, 00:25:19.448 "cluster_size": 1073741824 00:25:19.448 } 00:25:19.448 ]' 00:25:19.448 19:13:40 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="875f30d1-0245-4451-8ab1-33e665e19b9f") .free_clusters' 00:25:19.448 19:13:40 -- common/autotest_common.sh@1358 -- # fc=930 00:25:19.448 19:13:40 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="875f30d1-0245-4451-8ab1-33e665e19b9f") .cluster_size' 00:25:19.448 19:13:40 -- common/autotest_common.sh@1359 -- # cs=1073741824 00:25:19.448 19:13:40 -- common/autotest_common.sh@1362 -- # free_mb=952320 00:25:19.448 19:13:40 -- common/autotest_common.sh@1363 -- # echo 952320 00:25:19.448 952320 00:25:19.448 19:13:40 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:25:19.705 5ff29b41-6ed2-4e68-a98c-3e118e1c543a 00:25:19.705 19:13:40 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:25:19.962 19:13:40 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:25:20.219 19:13:41 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:25:20.477 19:13:41 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:20.477 19:13:41 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:20.477 19:13:41 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:20.477 19:13:41 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:20.477 19:13:41 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:20.477 19:13:41 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:20.477 19:13:41 -- common/autotest_common.sh@1330 -- # shift 00:25:20.477 19:13:41 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:20.477 19:13:41 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:20.477 19:13:41 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:20.477 19:13:41 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:20.477 19:13:41 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:20.477 19:13:41 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:20.477 19:13:41 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:20.477 19:13:41 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:20.477 19:13:41 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:20.477 19:13:41 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:20.477 19:13:41 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:20.477 19:13:41 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:20.477 19:13:41 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:20.477 19:13:41 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:20.477 19:13:41 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:20.735 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:25:20.735 fio-3.35 00:25:20.735 Starting 1 thread 00:25:20.735 EAL: No free 2048 kB hugepages reported on node 1 00:25:23.263 00:25:23.263 test: (groupid=0, jobs=1): err= 0: pid=299467: Thu Nov 28 19:13:44 2024 00:25:23.263 read: IOPS=6425, BW=25.1MiB/s (26.3MB/s)(50.4MiB/2007msec) 00:25:23.263 slat (nsec): min=1975, max=222712, avg=2663.20, stdev=2833.87 00:25:23.263 clat (usec): min=938, max=170407, avg=10889.04, stdev=11256.59 00:25:23.263 lat (usec): min=942, max=170443, avg=10891.70, stdev=11257.08 00:25:23.263 clat percentiles (msec): 00:25:23.263 | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 10], 00:25:23.263 | 30.00th=[ 10], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 11], 00:25:23.263 | 70.00th=[ 11], 80.00th=[ 11], 90.00th=[ 12], 95.00th=[ 12], 00:25:23.263 | 99.00th=[ 13], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:25:23.263 | 99.99th=[ 171] 00:25:23.263 bw ( KiB/s): min=17800, max=28376, per=99.83%, avg=25656.00, stdev=5238.08, samples=4 00:25:23.263 iops : min= 4450, max= 7094, avg=6414.00, stdev=1309.52, samples=4 00:25:23.263 write: IOPS=6429, BW=25.1MiB/s (26.3MB/s)(50.4MiB/2007msec); 0 zone resets 00:25:23.263 slat (usec): min=2, max=178, avg= 2.75, stdev= 1.95 00:25:23.263 clat (usec): min=297, max=168433, avg=8839.22, stdev=10549.61 00:25:23.263 lat (usec): min=302, max=168443, avg=8841.97, stdev=10550.12 00:25:23.263 clat percentiles (msec): 00:25:23.263 | 1.00th=[ 7], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 8], 00:25:23.263 | 30.00th=[ 8], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 9], 00:25:23.263 | 70.00th=[ 9], 80.00th=[ 9], 90.00th=[ 9], 95.00th=[ 10], 00:25:23.263 | 99.00th=[ 10], 99.50th=[ 15], 99.90th=[ 169], 99.95th=[ 169], 00:25:23.263 | 99.99th=[ 169] 00:25:23.263 bw ( KiB/s): min=18856, max=28184, per=99.88%, avg=25690.00, stdev=4558.59, samples=4 00:25:23.263 iops : min= 4714, max= 7046, avg=6422.50, stdev=1139.65, samples=4 00:25:23.263 lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01% 00:25:23.263 lat (msec) : 2=0.03%, 4=0.15%, 10=72.50%, 20=26.81%, 250=0.50% 00:25:23.263 cpu : usr=60.17%, sys=38.48%, ctx=92, majf=0, minf=41 00:25:23.263 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:25:23.263 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:23.263 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:23.263 issued rwts: total=12895,12905,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:23.263 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:23.263 00:25:23.263 Run status group 0 (all jobs): 00:25:23.263 READ: bw=25.1MiB/s (26.3MB/s), 25.1MiB/s-25.1MiB/s (26.3MB/s-26.3MB/s), io=50.4MiB (52.8MB), run=2007-2007msec 00:25:23.263 WRITE: bw=25.1MiB/s (26.3MB/s), 25.1MiB/s-25.1MiB/s (26.3MB/s-26.3MB/s), io=50.4MiB (52.9MB), run=2007-2007msec 00:25:23.263 19:13:44 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:25:23.521 19:13:44 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:25:24.457 19:13:45 -- host/fio.sh@64 -- # ls_nested_guid=244d4e9f-7db3-4266-92f7-e425ef5ca834 00:25:24.457 19:13:45 -- host/fio.sh@65 -- # get_lvs_free_mb 244d4e9f-7db3-4266-92f7-e425ef5ca834 00:25:24.457 19:13:45 -- common/autotest_common.sh@1353 -- # local lvs_uuid=244d4e9f-7db3-4266-92f7-e425ef5ca834 00:25:24.457 19:13:45 -- common/autotest_common.sh@1354 -- # local lvs_info 00:25:24.457 19:13:45 -- common/autotest_common.sh@1355 -- # local fc 00:25:24.457 19:13:45 -- common/autotest_common.sh@1356 -- # local cs 00:25:24.457 19:13:45 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:25:24.714 19:13:45 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:25:24.714 { 00:25:24.714 "uuid": "875f30d1-0245-4451-8ab1-33e665e19b9f", 00:25:24.714 "name": "lvs_0", 00:25:24.714 "base_bdev": "Nvme0n1", 00:25:24.714 "total_data_clusters": 930, 00:25:24.714 "free_clusters": 0, 00:25:24.714 "block_size": 512, 00:25:24.714 "cluster_size": 1073741824 00:25:24.714 }, 00:25:24.714 { 00:25:24.714 "uuid": "244d4e9f-7db3-4266-92f7-e425ef5ca834", 00:25:24.714 "name": "lvs_n_0", 00:25:24.714 "base_bdev": "5ff29b41-6ed2-4e68-a98c-3e118e1c543a", 00:25:24.714 "total_data_clusters": 237847, 00:25:24.714 "free_clusters": 237847, 00:25:24.714 "block_size": 512, 00:25:24.714 "cluster_size": 4194304 00:25:24.714 } 00:25:24.714 ]' 00:25:24.714 19:13:45 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="244d4e9f-7db3-4266-92f7-e425ef5ca834") .free_clusters' 00:25:24.714 19:13:45 -- common/autotest_common.sh@1358 -- # fc=237847 00:25:24.714 19:13:45 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="244d4e9f-7db3-4266-92f7-e425ef5ca834") .cluster_size' 00:25:24.972 19:13:45 -- common/autotest_common.sh@1359 -- # cs=4194304 00:25:24.972 19:13:45 -- common/autotest_common.sh@1362 -- # free_mb=951388 00:25:24.972 19:13:45 -- common/autotest_common.sh@1363 -- # echo 951388 00:25:24.972 951388 00:25:24.972 19:13:45 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:25:25.538 484d4457-51a9-4667-b0ab-f62c8662c78d 00:25:25.538 19:13:46 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:25:25.797 19:13:46 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:25:26.054 19:13:46 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:25:26.312 19:13:47 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:26.312 19:13:47 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:26.312 19:13:47 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:25:26.312 19:13:47 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:25:26.312 19:13:47 -- common/autotest_common.sh@1328 -- # local sanitizers 00:25:26.313 19:13:47 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:26.313 19:13:47 -- common/autotest_common.sh@1330 -- # shift 00:25:26.313 19:13:47 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:25:26.313 19:13:47 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:26.313 19:13:47 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:26.313 19:13:47 -- common/autotest_common.sh@1334 -- # grep libasan 00:25:26.313 19:13:47 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:26.313 19:13:47 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:26.313 19:13:47 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:26.313 19:13:47 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:25:26.313 19:13:47 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:25:26.313 19:13:47 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:25:26.313 19:13:47 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:25:26.313 19:13:47 -- common/autotest_common.sh@1334 -- # asan_lib= 00:25:26.313 19:13:47 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:25:26.313 19:13:47 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:25:26.313 19:13:47 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:25:26.571 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:25:26.571 fio-3.35 00:25:26.571 Starting 1 thread 00:25:26.571 EAL: No free 2048 kB hugepages reported on node 1 00:25:29.101 00:25:29.101 test: (groupid=0, jobs=1): err= 0: pid=300243: Thu Nov 28 19:13:49 2024 00:25:29.101 read: IOPS=6175, BW=24.1MiB/s (25.3MB/s)(48.4MiB/2008msec) 00:25:29.101 slat (nsec): min=1890, max=159537, avg=2685.69, stdev=2189.06 00:25:29.101 clat (usec): min=4254, max=19155, avg=11417.43, stdev=1018.99 00:25:29.101 lat (usec): min=4259, max=19158, avg=11420.11, stdev=1018.90 00:25:29.101 clat percentiles (usec): 00:25:29.101 | 1.00th=[ 8979], 5.00th=[ 9765], 10.00th=[10159], 20.00th=[10683], 00:25:29.101 | 30.00th=[10945], 40.00th=[11207], 50.00th=[11469], 60.00th=[11731], 00:25:29.101 | 70.00th=[11863], 80.00th=[12256], 90.00th=[12649], 95.00th=[12911], 00:25:29.101 | 99.00th=[13698], 99.50th=[13960], 99.90th=[17695], 99.95th=[17957], 00:25:29.101 | 99.99th=[17957] 00:25:29.101 bw ( KiB/s): min=23472, max=25152, per=99.82%, avg=24658.00, stdev=796.16, samples=4 00:25:29.101 iops : min= 5868, max= 6288, avg=6164.50, stdev=199.04, samples=4 00:25:29.101 write: IOPS=6160, BW=24.1MiB/s (25.2MB/s)(48.3MiB/2008msec); 0 zone resets 00:25:29.101 slat (nsec): min=2043, max=97144, avg=2786.55, stdev=1746.75 00:25:29.101 clat (usec): min=2063, max=17725, avg=9220.78, stdev=861.12 00:25:29.101 lat (usec): min=2069, max=17727, avg=9223.56, stdev=861.11 00:25:29.101 clat percentiles (usec): 00:25:29.101 | 1.00th=[ 7177], 5.00th=[ 7963], 10.00th=[ 8225], 20.00th=[ 8586], 00:25:29.101 | 30.00th=[ 8848], 40.00th=[ 8979], 50.00th=[ 9241], 60.00th=[ 9372], 00:25:29.101 | 70.00th=[ 9634], 80.00th=[ 9896], 90.00th=[10159], 95.00th=[10552], 00:25:29.101 | 99.00th=[11076], 99.50th=[11338], 99.90th=[15664], 99.95th=[15926], 00:25:29.101 | 99.99th=[17695] 00:25:29.101 bw ( KiB/s): min=24560, max=24704, per=99.95%, avg=24628.00, stdev=59.33, samples=4 00:25:29.101 iops : min= 6140, max= 6176, avg=6157.00, stdev=14.83, samples=4 00:25:29.101 lat (msec) : 4=0.04%, 10=45.61%, 20=54.35% 00:25:29.101 cpu : usr=58.59%, sys=40.01%, ctx=105, majf=0, minf=41 00:25:29.101 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:25:29.101 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:25:29.101 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:25:29.101 issued rwts: total=12401,12370,0,0 short=0,0,0,0 dropped=0,0,0,0 00:25:29.101 latency : target=0, window=0, percentile=100.00%, depth=128 00:25:29.101 00:25:29.101 Run status group 0 (all jobs): 00:25:29.101 READ: bw=24.1MiB/s (25.3MB/s), 24.1MiB/s-24.1MiB/s (25.3MB/s-25.3MB/s), io=48.4MiB (50.8MB), run=2008-2008msec 00:25:29.101 WRITE: bw=24.1MiB/s (25.2MB/s), 24.1MiB/s-24.1MiB/s (25.2MB/s-25.2MB/s), io=48.3MiB (50.7MB), run=2008-2008msec 00:25:29.101 19:13:49 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:25:29.101 19:13:50 -- host/fio.sh@74 -- # sync 00:25:29.101 19:13:50 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:25:33.325 19:13:53 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:25:33.325 19:13:54 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:25:36.609 19:13:57 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:25:36.609 19:13:57 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:25:38.516 19:13:59 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:25:38.516 19:13:59 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:25:38.516 19:13:59 -- host/fio.sh@86 -- # nvmftestfini 00:25:38.516 19:13:59 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:38.516 19:13:59 -- nvmf/common.sh@116 -- # sync 00:25:38.516 19:13:59 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:38.516 19:13:59 -- nvmf/common.sh@119 -- # set +e 00:25:38.516 19:13:59 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:38.516 19:13:59 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:38.516 rmmod nvme_tcp 00:25:38.516 rmmod nvme_fabrics 00:25:38.516 rmmod nvme_keyring 00:25:38.516 19:13:59 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:38.516 19:13:59 -- nvmf/common.sh@123 -- # set -e 00:25:38.516 19:13:59 -- nvmf/common.sh@124 -- # return 0 00:25:38.516 19:13:59 -- nvmf/common.sh@477 -- # '[' -n 297208 ']' 00:25:38.516 19:13:59 -- nvmf/common.sh@478 -- # killprocess 297208 00:25:38.516 19:13:59 -- common/autotest_common.sh@936 -- # '[' -z 297208 ']' 00:25:38.516 19:13:59 -- common/autotest_common.sh@940 -- # kill -0 297208 00:25:38.516 19:13:59 -- common/autotest_common.sh@941 -- # uname 00:25:38.516 19:13:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:38.516 19:13:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 297208 00:25:38.516 19:13:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:38.516 19:13:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:38.516 19:13:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 297208' 00:25:38.516 killing process with pid 297208 00:25:38.516 19:13:59 -- common/autotest_common.sh@955 -- # kill 297208 00:25:38.516 19:13:59 -- common/autotest_common.sh@960 -- # wait 297208 00:25:38.776 19:13:59 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:38.776 19:13:59 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:38.776 19:13:59 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:38.776 19:13:59 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:38.776 19:13:59 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:38.776 19:13:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:38.776 19:13:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:38.776 19:13:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:40.677 19:14:01 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:40.677 00:25:40.677 real 0m38.620s 00:25:40.677 user 2m28.854s 00:25:40.677 sys 0m6.963s 00:25:40.677 19:14:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:40.677 19:14:01 -- common/autotest_common.sh@10 -- # set +x 00:25:40.677 ************************************ 00:25:40.677 END TEST nvmf_fio_host 00:25:40.677 ************************************ 00:25:40.936 19:14:01 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:40.936 19:14:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:40.936 19:14:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:40.936 19:14:01 -- common/autotest_common.sh@10 -- # set +x 00:25:40.936 ************************************ 00:25:40.936 START TEST nvmf_failover 00:25:40.936 ************************************ 00:25:40.936 19:14:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:25:40.936 * Looking for test storage... 00:25:40.936 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:40.936 19:14:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:40.936 19:14:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:40.936 19:14:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:40.936 19:14:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:40.936 19:14:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:40.936 19:14:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:40.936 19:14:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:40.936 19:14:01 -- scripts/common.sh@335 -- # IFS=.-: 00:25:40.936 19:14:01 -- scripts/common.sh@335 -- # read -ra ver1 00:25:40.936 19:14:01 -- scripts/common.sh@336 -- # IFS=.-: 00:25:40.936 19:14:01 -- scripts/common.sh@336 -- # read -ra ver2 00:25:40.936 19:14:01 -- scripts/common.sh@337 -- # local 'op=<' 00:25:40.936 19:14:01 -- scripts/common.sh@339 -- # ver1_l=2 00:25:40.936 19:14:01 -- scripts/common.sh@340 -- # ver2_l=1 00:25:40.936 19:14:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:40.936 19:14:01 -- scripts/common.sh@343 -- # case "$op" in 00:25:40.936 19:14:01 -- scripts/common.sh@344 -- # : 1 00:25:40.936 19:14:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:40.936 19:14:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:40.936 19:14:01 -- scripts/common.sh@364 -- # decimal 1 00:25:40.936 19:14:01 -- scripts/common.sh@352 -- # local d=1 00:25:40.936 19:14:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:40.936 19:14:01 -- scripts/common.sh@354 -- # echo 1 00:25:40.936 19:14:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:40.936 19:14:01 -- scripts/common.sh@365 -- # decimal 2 00:25:40.936 19:14:01 -- scripts/common.sh@352 -- # local d=2 00:25:40.936 19:14:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:40.936 19:14:01 -- scripts/common.sh@354 -- # echo 2 00:25:40.936 19:14:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:40.936 19:14:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:40.936 19:14:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:40.936 19:14:01 -- scripts/common.sh@367 -- # return 0 00:25:40.936 19:14:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:40.936 19:14:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:40.936 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:40.936 --rc genhtml_branch_coverage=1 00:25:40.936 --rc genhtml_function_coverage=1 00:25:40.936 --rc genhtml_legend=1 00:25:40.936 --rc geninfo_all_blocks=1 00:25:40.936 --rc geninfo_unexecuted_blocks=1 00:25:40.936 00:25:40.936 ' 00:25:40.936 19:14:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:40.936 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:40.936 --rc genhtml_branch_coverage=1 00:25:40.936 --rc genhtml_function_coverage=1 00:25:40.936 --rc genhtml_legend=1 00:25:40.936 --rc geninfo_all_blocks=1 00:25:40.936 --rc geninfo_unexecuted_blocks=1 00:25:40.936 00:25:40.936 ' 00:25:40.936 19:14:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:40.936 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:40.936 --rc genhtml_branch_coverage=1 00:25:40.936 --rc genhtml_function_coverage=1 00:25:40.936 --rc genhtml_legend=1 00:25:40.936 --rc geninfo_all_blocks=1 00:25:40.936 --rc geninfo_unexecuted_blocks=1 00:25:40.936 00:25:40.936 ' 00:25:40.936 19:14:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:40.936 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:40.936 --rc genhtml_branch_coverage=1 00:25:40.936 --rc genhtml_function_coverage=1 00:25:40.936 --rc genhtml_legend=1 00:25:40.936 --rc geninfo_all_blocks=1 00:25:40.936 --rc geninfo_unexecuted_blocks=1 00:25:40.936 00:25:40.936 ' 00:25:40.936 19:14:01 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:40.936 19:14:01 -- nvmf/common.sh@7 -- # uname -s 00:25:40.936 19:14:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:40.936 19:14:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:40.936 19:14:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:40.936 19:14:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:40.936 19:14:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:40.936 19:14:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:40.936 19:14:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:40.936 19:14:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:40.936 19:14:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:40.936 19:14:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:40.936 19:14:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:40.936 19:14:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:40.936 19:14:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:40.936 19:14:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:40.936 19:14:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:40.936 19:14:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:40.936 19:14:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:40.936 19:14:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:40.936 19:14:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:40.936 19:14:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:40.936 19:14:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:40.936 19:14:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:40.936 19:14:01 -- paths/export.sh@5 -- # export PATH 00:25:40.936 19:14:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:40.936 19:14:01 -- nvmf/common.sh@46 -- # : 0 00:25:40.936 19:14:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:40.936 19:14:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:40.936 19:14:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:40.936 19:14:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:40.936 19:14:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:40.936 19:14:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:40.936 19:14:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:40.936 19:14:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:40.936 19:14:01 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:40.936 19:14:01 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:40.936 19:14:01 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:25:40.936 19:14:01 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:25:40.936 19:14:01 -- host/failover.sh@18 -- # nvmftestinit 00:25:40.936 19:14:01 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:40.936 19:14:01 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:40.936 19:14:01 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:40.936 19:14:01 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:40.936 19:14:01 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:40.936 19:14:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:40.936 19:14:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:40.936 19:14:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:40.936 19:14:01 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:40.936 19:14:01 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:40.936 19:14:01 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:40.936 19:14:01 -- common/autotest_common.sh@10 -- # set +x 00:25:43.470 19:14:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:43.470 19:14:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:43.470 19:14:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:43.470 19:14:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:43.470 19:14:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:43.470 19:14:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:43.470 19:14:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:43.470 19:14:03 -- nvmf/common.sh@294 -- # net_devs=() 00:25:43.470 19:14:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:43.470 19:14:03 -- nvmf/common.sh@295 -- # e810=() 00:25:43.470 19:14:03 -- nvmf/common.sh@295 -- # local -ga e810 00:25:43.470 19:14:03 -- nvmf/common.sh@296 -- # x722=() 00:25:43.470 19:14:03 -- nvmf/common.sh@296 -- # local -ga x722 00:25:43.470 19:14:03 -- nvmf/common.sh@297 -- # mlx=() 00:25:43.470 19:14:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:43.470 19:14:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:43.470 19:14:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:43.470 19:14:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:43.470 19:14:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:43.470 19:14:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:43.470 19:14:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:43.470 19:14:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:43.470 19:14:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:43.470 19:14:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:43.470 19:14:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:43.470 19:14:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:43.470 19:14:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:43.470 19:14:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:43.470 19:14:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:43.470 19:14:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:43.470 19:14:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:43.470 19:14:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:43.470 19:14:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:43.470 19:14:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:43.470 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:43.470 19:14:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:43.470 19:14:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:43.470 19:14:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:43.470 19:14:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:43.470 19:14:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:43.470 19:14:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:43.470 19:14:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:43.470 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:43.470 19:14:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:43.470 19:14:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:43.470 19:14:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:43.470 19:14:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:43.470 19:14:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:43.470 19:14:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:43.470 19:14:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:43.470 19:14:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:43.470 19:14:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:43.470 19:14:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:43.470 19:14:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:43.470 19:14:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:43.470 19:14:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:43.470 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:43.470 19:14:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:43.470 19:14:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:43.470 19:14:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:43.470 19:14:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:43.470 19:14:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:43.470 19:14:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:43.470 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:43.470 19:14:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:43.470 19:14:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:43.470 19:14:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:43.470 19:14:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:43.470 19:14:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:43.470 19:14:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:43.470 19:14:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:43.470 19:14:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:43.470 19:14:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:43.470 19:14:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:43.470 19:14:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:43.470 19:14:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:43.470 19:14:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:43.470 19:14:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:43.470 19:14:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:43.470 19:14:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:43.470 19:14:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:43.470 19:14:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:43.470 19:14:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:43.470 19:14:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:43.470 19:14:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:43.470 19:14:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:43.470 19:14:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:43.470 19:14:04 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:43.470 19:14:04 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:43.470 19:14:04 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:43.470 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:43.470 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.291 ms 00:25:43.470 00:25:43.470 --- 10.0.0.2 ping statistics --- 00:25:43.470 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:43.470 rtt min/avg/max/mdev = 0.291/0.291/0.291/0.000 ms 00:25:43.470 19:14:04 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:43.470 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:43.470 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.092 ms 00:25:43.470 00:25:43.470 --- 10.0.0.1 ping statistics --- 00:25:43.470 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:43.470 rtt min/avg/max/mdev = 0.092/0.092/0.092/0.000 ms 00:25:43.470 19:14:04 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:43.470 19:14:04 -- nvmf/common.sh@410 -- # return 0 00:25:43.470 19:14:04 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:43.470 19:14:04 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:43.470 19:14:04 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:43.470 19:14:04 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:43.470 19:14:04 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:43.470 19:14:04 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:43.470 19:14:04 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:43.470 19:14:04 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:25:43.470 19:14:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:43.471 19:14:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:43.471 19:14:04 -- common/autotest_common.sh@10 -- # set +x 00:25:43.471 19:14:04 -- nvmf/common.sh@469 -- # nvmfpid=303554 00:25:43.471 19:14:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:43.471 19:14:04 -- nvmf/common.sh@470 -- # waitforlisten 303554 00:25:43.471 19:14:04 -- common/autotest_common.sh@829 -- # '[' -z 303554 ']' 00:25:43.471 19:14:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:43.471 19:14:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:43.471 19:14:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:43.471 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:43.471 19:14:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:43.471 19:14:04 -- common/autotest_common.sh@10 -- # set +x 00:25:43.471 [2024-11-28 19:14:04.107630] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:43.471 [2024-11-28 19:14:04.107699] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:43.471 EAL: No free 2048 kB hugepages reported on node 1 00:25:43.471 [2024-11-28 19:14:04.188130] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:43.471 [2024-11-28 19:14:04.321487] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:43.471 [2024-11-28 19:14:04.321651] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:43.471 [2024-11-28 19:14:04.321690] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:43.471 [2024-11-28 19:14:04.321708] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:43.471 [2024-11-28 19:14:04.321798] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:43.471 [2024-11-28 19:14:04.321869] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:43.471 [2024-11-28 19:14:04.321874] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:44.041 19:14:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:44.041 19:14:05 -- common/autotest_common.sh@862 -- # return 0 00:25:44.041 19:14:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:44.041 19:14:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:44.041 19:14:05 -- common/autotest_common.sh@10 -- # set +x 00:25:44.299 19:14:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:44.299 19:14:05 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:25:44.299 [2024-11-28 19:14:05.341479] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:44.557 19:14:05 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:25:44.815 Malloc0 00:25:44.815 19:14:05 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:45.073 19:14:05 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:45.332 19:14:06 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:45.590 [2024-11-28 19:14:06.476815] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:45.590 19:14:06 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:45.848 [2024-11-28 19:14:06.745656] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:45.848 19:14:06 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:46.106 [2024-11-28 19:14:06.990542] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:25:46.106 19:14:07 -- host/failover.sh@31 -- # bdevperf_pid=303978 00:25:46.106 19:14:07 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:25:46.107 19:14:07 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:46.107 19:14:07 -- host/failover.sh@34 -- # waitforlisten 303978 /var/tmp/bdevperf.sock 00:25:46.107 19:14:07 -- common/autotest_common.sh@829 -- # '[' -z 303978 ']' 00:25:46.107 19:14:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:46.107 19:14:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:46.107 19:14:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:46.107 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:46.107 19:14:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:46.107 19:14:07 -- common/autotest_common.sh@10 -- # set +x 00:25:47.044 19:14:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:47.044 19:14:08 -- common/autotest_common.sh@862 -- # return 0 00:25:47.044 19:14:08 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:47.609 NVMe0n1 00:25:47.609 19:14:08 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:47.868 00:25:47.868 19:14:08 -- host/failover.sh@39 -- # run_test_pid=304150 00:25:47.868 19:14:08 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:47.868 19:14:08 -- host/failover.sh@41 -- # sleep 1 00:25:48.805 19:14:09 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:49.063 [2024-11-28 19:14:10.060323] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x656cb0 is same with the state(5) to be set 00:25:49.063 [2024-11-28 19:14:10.060430] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x656cb0 is same with the state(5) to be set 00:25:49.063 [2024-11-28 19:14:10.060450] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x656cb0 is same with the state(5) to be set 00:25:49.063 [2024-11-28 19:14:10.060463] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x656cb0 is same with the state(5) to be set 00:25:49.063 [2024-11-28 19:14:10.060475] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x656cb0 is same with the state(5) to be set 00:25:49.063 [2024-11-28 19:14:10.060488] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x656cb0 is same with the state(5) to be set 00:25:49.063 [2024-11-28 19:14:10.060501] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x656cb0 is same with the state(5) to be set 00:25:49.063 [2024-11-28 19:14:10.060513] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x656cb0 is same with the state(5) to be set 00:25:49.063 [2024-11-28 19:14:10.060524] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x656cb0 is same with the state(5) to be set 00:25:49.063 [2024-11-28 19:14:10.060536] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x656cb0 is same with the state(5) to be set 00:25:49.064 [2024-11-28 19:14:10.060548] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x656cb0 is same with the state(5) to be set 00:25:49.064 [2024-11-28 19:14:10.060560] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x656cb0 is same with the state(5) to be set 00:25:49.064 [2024-11-28 19:14:10.060572] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x656cb0 is same with the state(5) to be set 00:25:49.064 [2024-11-28 19:14:10.060583] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x656cb0 is same with the state(5) to be set 00:25:49.064 [2024-11-28 19:14:10.060595] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x656cb0 is same with the state(5) to be set 00:25:49.064 [2024-11-28 19:14:10.060607] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x656cb0 is same with the state(5) to be set 00:25:49.064 [2024-11-28 19:14:10.060620] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x656cb0 is same with the state(5) to be set 00:25:49.064 [2024-11-28 19:14:10.060631] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x656cb0 is same with the state(5) to be set 00:25:49.064 [2024-11-28 19:14:10.060643] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x656cb0 is same with the state(5) to be set 00:25:49.064 [2024-11-28 19:14:10.060655] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x656cb0 is same with the state(5) to be set 00:25:49.064 [2024-11-28 19:14:10.060667] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x656cb0 is same with the state(5) to be set 00:25:49.064 [2024-11-28 19:14:10.060689] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x656cb0 is same with the state(5) to be set 00:25:49.064 [2024-11-28 19:14:10.060712] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x656cb0 is same with the state(5) to be set 00:25:49.064 19:14:10 -- host/failover.sh@45 -- # sleep 3 00:25:52.353 19:14:13 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:52.611 00:25:52.611 19:14:13 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:52.869 [2024-11-28 19:14:13.705768] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.869 [2024-11-28 19:14:13.705804] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.869 [2024-11-28 19:14:13.705818] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.869 [2024-11-28 19:14:13.705830] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.869 [2024-11-28 19:14:13.705842] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.869 [2024-11-28 19:14:13.705854] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.869 [2024-11-28 19:14:13.705865] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.869 [2024-11-28 19:14:13.705877] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.869 [2024-11-28 19:14:13.705888] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.869 [2024-11-28 19:14:13.705900] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.869 [2024-11-28 19:14:13.705911] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.869 [2024-11-28 19:14:13.705922] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.869 [2024-11-28 19:14:13.705934] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.869 [2024-11-28 19:14:13.705945] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.869 [2024-11-28 19:14:13.705956] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.870 [2024-11-28 19:14:13.705967] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.870 [2024-11-28 19:14:13.705979] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.870 [2024-11-28 19:14:13.705990] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.870 [2024-11-28 19:14:13.706002] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.870 [2024-11-28 19:14:13.706013] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.870 [2024-11-28 19:14:13.706024] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.870 [2024-11-28 19:14:13.706035] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.870 [2024-11-28 19:14:13.706054] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.870 [2024-11-28 19:14:13.706066] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.870 [2024-11-28 19:14:13.706078] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.870 [2024-11-28 19:14:13.706089] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.870 [2024-11-28 19:14:13.706101] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.870 [2024-11-28 19:14:13.706113] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.870 [2024-11-28 19:14:13.706124] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.870 [2024-11-28 19:14:13.706136] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.870 [2024-11-28 19:14:13.706148] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.870 [2024-11-28 19:14:13.706159] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.870 [2024-11-28 19:14:13.706171] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.870 [2024-11-28 19:14:13.706182] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.870 [2024-11-28 19:14:13.706194] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.870 [2024-11-28 19:14:13.706206] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.870 [2024-11-28 19:14:13.706218] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.870 [2024-11-28 19:14:13.706230] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.870 [2024-11-28 19:14:13.706242] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.870 [2024-11-28 19:14:13.706253] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6583a0 is same with the state(5) to be set 00:25:52.870 19:14:13 -- host/failover.sh@50 -- # sleep 3 00:25:56.177 19:14:16 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:56.177 [2024-11-28 19:14:17.002063] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:56.177 19:14:17 -- host/failover.sh@55 -- # sleep 1 00:25:57.112 19:14:18 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:25:57.371 [2024-11-28 19:14:18.307298] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307366] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307404] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307417] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307429] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307456] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307479] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307491] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307503] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307515] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307527] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307538] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307550] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307561] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307573] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307584] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307595] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307607] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307618] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307629] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307640] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307652] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307663] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307674] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307686] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307698] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307710] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307721] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307748] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307760] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307771] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307782] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307794] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307808] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307821] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307832] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307844] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307856] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 [2024-11-28 19:14:18.307867] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x658a80 is same with the state(5) to be set 00:25:57.371 19:14:18 -- host/failover.sh@59 -- # wait 304150 00:26:03.941 0 00:26:03.941 19:14:23 -- host/failover.sh@61 -- # killprocess 303978 00:26:03.941 19:14:23 -- common/autotest_common.sh@936 -- # '[' -z 303978 ']' 00:26:03.941 19:14:23 -- common/autotest_common.sh@940 -- # kill -0 303978 00:26:03.941 19:14:23 -- common/autotest_common.sh@941 -- # uname 00:26:03.941 19:14:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:03.941 19:14:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 303978 00:26:03.941 19:14:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:03.941 19:14:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:03.941 19:14:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 303978' 00:26:03.941 killing process with pid 303978 00:26:03.941 19:14:24 -- common/autotest_common.sh@955 -- # kill 303978 00:26:03.941 19:14:24 -- common/autotest_common.sh@960 -- # wait 303978 00:26:03.941 19:14:24 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:26:03.941 [2024-11-28 19:14:07.049872] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:03.941 [2024-11-28 19:14:07.049965] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid303978 ] 00:26:03.941 EAL: No free 2048 kB hugepages reported on node 1 00:26:03.941 [2024-11-28 19:14:07.109429] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:03.941 [2024-11-28 19:14:07.215841] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:03.941 Running I/O for 15 seconds... 00:26:03.941 [2024-11-28 19:14:10.060968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:113264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.941 [2024-11-28 19:14:10.061009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.941 [2024-11-28 19:14:10.061037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:113280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.941 [2024-11-28 19:14:10.061053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.941 [2024-11-28 19:14:10.061070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:113296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.941 [2024-11-28 19:14:10.061084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.941 [2024-11-28 19:14:10.061099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:113304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.941 [2024-11-28 19:14:10.061113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.941 [2024-11-28 19:14:10.061129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:113320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.941 [2024-11-28 19:14:10.061143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.941 [2024-11-28 19:14:10.061158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:113328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.941 [2024-11-28 19:14:10.061172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.941 [2024-11-28 19:14:10.061187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:113352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.941 [2024-11-28 19:14:10.061201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.941 [2024-11-28 19:14:10.061217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:112656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.941 [2024-11-28 19:14:10.061230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.941 [2024-11-28 19:14:10.061246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:112688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.941 [2024-11-28 19:14:10.061260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.941 [2024-11-28 19:14:10.061275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:112696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.941 [2024-11-28 19:14:10.061289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.941 [2024-11-28 19:14:10.061304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:112704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.941 [2024-11-28 19:14:10.061318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.941 [2024-11-28 19:14:10.061340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:112712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.941 [2024-11-28 19:14:10.061355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.941 [2024-11-28 19:14:10.061370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:112720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.941 [2024-11-28 19:14:10.061384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.941 [2024-11-28 19:14:10.061410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:112744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.941 [2024-11-28 19:14:10.061425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.941 [2024-11-28 19:14:10.061441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:112752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.941 [2024-11-28 19:14:10.061454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.941 [2024-11-28 19:14:10.061470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:112760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.941 [2024-11-28 19:14:10.061483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.941 [2024-11-28 19:14:10.061498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:112768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.941 [2024-11-28 19:14:10.061512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.941 [2024-11-28 19:14:10.061527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:112776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.941 [2024-11-28 19:14:10.061542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.941 [2024-11-28 19:14:10.061557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:112800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.941 [2024-11-28 19:14:10.061571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.941 [2024-11-28 19:14:10.061586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:112808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.941 [2024-11-28 19:14:10.061599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.941 [2024-11-28 19:14:10.061615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:112816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.941 [2024-11-28 19:14:10.061628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.941 [2024-11-28 19:14:10.061643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:112824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.941 [2024-11-28 19:14:10.061656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.941 [2024-11-28 19:14:10.061679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:112840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.941 [2024-11-28 19:14:10.061708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.941 [2024-11-28 19:14:10.061724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:113376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.941 [2024-11-28 19:14:10.061742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.941 [2024-11-28 19:14:10.061757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:113384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.941 [2024-11-28 19:14:10.061770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.941 [2024-11-28 19:14:10.061785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:113392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.941 [2024-11-28 19:14:10.061798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.941 [2024-11-28 19:14:10.061813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:113400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.941 [2024-11-28 19:14:10.061826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.941 [2024-11-28 19:14:10.061841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:113408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.941 [2024-11-28 19:14:10.061853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.941 [2024-11-28 19:14:10.061868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:113416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.941 [2024-11-28 19:14:10.061881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.941 [2024-11-28 19:14:10.061895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:113424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.941 [2024-11-28 19:14:10.061908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.941 [2024-11-28 19:14:10.061923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:112856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.941 [2024-11-28 19:14:10.061936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.941 [2024-11-28 19:14:10.061951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:112880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.942 [2024-11-28 19:14:10.061964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.061980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:112904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.942 [2024-11-28 19:14:10.061994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.062009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:112936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.942 [2024-11-28 19:14:10.062022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.062037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:112952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.942 [2024-11-28 19:14:10.062049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.062063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:112960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.942 [2024-11-28 19:14:10.062076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.062094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:112984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.942 [2024-11-28 19:14:10.062108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.062123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:112992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.942 [2024-11-28 19:14:10.062136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.062150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:113016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.942 [2024-11-28 19:14:10.062163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.062178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:113032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.942 [2024-11-28 19:14:10.062192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.062206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:113040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.942 [2024-11-28 19:14:10.062219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.062234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:113072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.942 [2024-11-28 19:14:10.062247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.062261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:113080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.942 [2024-11-28 19:14:10.062274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.062288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:113088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.942 [2024-11-28 19:14:10.062300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.062315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:113112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.942 [2024-11-28 19:14:10.062328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.062342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:113120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.942 [2024-11-28 19:14:10.062355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.062374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:113432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.942 [2024-11-28 19:14:10.062387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.062428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:113440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.942 [2024-11-28 19:14:10.062443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.062458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:113448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.942 [2024-11-28 19:14:10.062475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.062491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:113456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.942 [2024-11-28 19:14:10.062505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.062520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:113464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.942 [2024-11-28 19:14:10.062534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.062549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:113472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.942 [2024-11-28 19:14:10.062562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.062577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:113480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.942 [2024-11-28 19:14:10.062591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.062606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:113488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.942 [2024-11-28 19:14:10.062619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.062634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:113496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.942 [2024-11-28 19:14:10.062647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.062662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:113504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.942 [2024-11-28 19:14:10.062675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.062690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:113512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.942 [2024-11-28 19:14:10.062718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.062733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:113520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.942 [2024-11-28 19:14:10.062746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.062761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:113528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.942 [2024-11-28 19:14:10.062773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.062788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:113536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.942 [2024-11-28 19:14:10.062801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.062815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:113544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.942 [2024-11-28 19:14:10.062827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.062849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:113552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.942 [2024-11-28 19:14:10.062863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.062878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:113560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.942 [2024-11-28 19:14:10.062890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.062905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:113568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.942 [2024-11-28 19:14:10.062917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.062932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:113576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.942 [2024-11-28 19:14:10.062945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.062960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:113584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.942 [2024-11-28 19:14:10.062973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.062987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:113592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.942 [2024-11-28 19:14:10.063000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.063014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:113600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.942 [2024-11-28 19:14:10.063027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.063048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:113608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.942 [2024-11-28 19:14:10.063076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.063092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:113616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.942 [2024-11-28 19:14:10.063106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.942 [2024-11-28 19:14:10.063121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:113624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.942 [2024-11-28 19:14:10.063135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.063150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:113632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.943 [2024-11-28 19:14:10.063163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.063179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:113640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.943 [2024-11-28 19:14:10.063192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.063208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:113648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.943 [2024-11-28 19:14:10.063225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.063241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:113656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.943 [2024-11-28 19:14:10.063255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.063271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:113664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.943 [2024-11-28 19:14:10.063284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.063299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:113672 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.943 [2024-11-28 19:14:10.063313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.063328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:113680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.943 [2024-11-28 19:14:10.063342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.063357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:113688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.943 [2024-11-28 19:14:10.063371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.063386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:113696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.943 [2024-11-28 19:14:10.063406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.063422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:113704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.943 [2024-11-28 19:14:10.063437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.063452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:113712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.943 [2024-11-28 19:14:10.063466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.063481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:113720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.943 [2024-11-28 19:14:10.063495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.063510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:113728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.943 [2024-11-28 19:14:10.063524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.063540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:113736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.943 [2024-11-28 19:14:10.063554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.063569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:113744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.943 [2024-11-28 19:14:10.063583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.063597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:113752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.943 [2024-11-28 19:14:10.063615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.063630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:113760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.943 [2024-11-28 19:14:10.063644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.063659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:113768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.943 [2024-11-28 19:14:10.063673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.063687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:113776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.943 [2024-11-28 19:14:10.063716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.063731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:113128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.943 [2024-11-28 19:14:10.063743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.063758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:113136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.943 [2024-11-28 19:14:10.063770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.063784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:113144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.943 [2024-11-28 19:14:10.063797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.063811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:113192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.943 [2024-11-28 19:14:10.063824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.063838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:113200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.943 [2024-11-28 19:14:10.063851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.063865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:113208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.943 [2024-11-28 19:14:10.063878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.063898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:113224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.943 [2024-11-28 19:14:10.063912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.063927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:113248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.943 [2024-11-28 19:14:10.063940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.063954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:113784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.943 [2024-11-28 19:14:10.063968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.063986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:113792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.943 [2024-11-28 19:14:10.064000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.064014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:113800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.943 [2024-11-28 19:14:10.064027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.064041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:113808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.943 [2024-11-28 19:14:10.064054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.064069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:113816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.943 [2024-11-28 19:14:10.064082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.064096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:113824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.943 [2024-11-28 19:14:10.064109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.064123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:113832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.943 [2024-11-28 19:14:10.064151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.064167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:113840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.943 [2024-11-28 19:14:10.064180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.064195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:113848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.943 [2024-11-28 19:14:10.064208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.064223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:113856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.943 [2024-11-28 19:14:10.064236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.064252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:113864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.943 [2024-11-28 19:14:10.064265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.064280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:113872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.943 [2024-11-28 19:14:10.064294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.943 [2024-11-28 19:14:10.064309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:113880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.943 [2024-11-28 19:14:10.064322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.944 [2024-11-28 19:14:10.064337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:113888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.944 [2024-11-28 19:14:10.064354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.944 [2024-11-28 19:14:10.064374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:113896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.944 [2024-11-28 19:14:10.064400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.944 [2024-11-28 19:14:10.064417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:113904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.944 [2024-11-28 19:14:10.064431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.944 [2024-11-28 19:14:10.064446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:113912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.944 [2024-11-28 19:14:10.064460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.944 [2024-11-28 19:14:10.064475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:113920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.944 [2024-11-28 19:14:10.064488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.944 [2024-11-28 19:14:10.064503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:113928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.944 [2024-11-28 19:14:10.064516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.944 [2024-11-28 19:14:10.064531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:113936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.944 [2024-11-28 19:14:10.064544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.944 [2024-11-28 19:14:10.064558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:113944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.944 [2024-11-28 19:14:10.064572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.944 [2024-11-28 19:14:10.064586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:113952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.944 [2024-11-28 19:14:10.064600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.944 [2024-11-28 19:14:10.064615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:113256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.944 [2024-11-28 19:14:10.064628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.944 [2024-11-28 19:14:10.064643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:113272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.944 [2024-11-28 19:14:10.064656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.944 [2024-11-28 19:14:10.064671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:113288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.944 [2024-11-28 19:14:10.064684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.944 [2024-11-28 19:14:10.064716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:113312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.944 [2024-11-28 19:14:10.064729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.944 [2024-11-28 19:14:10.064747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:113336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.944 [2024-11-28 19:14:10.064760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.944 [2024-11-28 19:14:10.064775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:113344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.944 [2024-11-28 19:14:10.064788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.944 [2024-11-28 19:14:10.064802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:113360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.944 [2024-11-28 19:14:10.064815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.944 [2024-11-28 19:14:10.064828] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa8e6a0 is same with the state(5) to be set 00:26:03.944 [2024-11-28 19:14:10.064844] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:26:03.944 [2024-11-28 19:14:10.064859] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:26:03.944 [2024-11-28 19:14:10.064871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:113368 len:8 PRP1 0x0 PRP2 0x0 00:26:03.944 [2024-11-28 19:14:10.064883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.944 [2024-11-28 19:14:10.064948] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xa8e6a0 was disconnected and freed. reset controller. 00:26:03.944 [2024-11-28 19:14:10.064976] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:26:03.944 [2024-11-28 19:14:10.065026] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:03.944 [2024-11-28 19:14:10.065045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.944 [2024-11-28 19:14:10.065060] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:03.944 [2024-11-28 19:14:10.065072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.944 [2024-11-28 19:14:10.065086] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:03.944 [2024-11-28 19:14:10.065099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.944 [2024-11-28 19:14:10.065112] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:03.944 [2024-11-28 19:14:10.065125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.944 [2024-11-28 19:14:10.065138] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.944 [2024-11-28 19:14:10.065175] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa6f870 (9): Bad file descriptor 00:26:03.944 [2024-11-28 19:14:10.067435] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.944 [2024-11-28 19:14:10.139849] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:26:03.944 [2024-11-28 19:14:13.705165] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:03.944 [2024-11-28 19:14:13.705271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.944 [2024-11-28 19:14:13.705300] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:03.944 [2024-11-28 19:14:13.705316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.944 [2024-11-28 19:14:13.705330] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:03.944 [2024-11-28 19:14:13.705344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.944 [2024-11-28 19:14:13.705357] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:03.944 [2024-11-28 19:14:13.705369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.944 [2024-11-28 19:14:13.705387] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa6f870 is same with the state(5) to be set 00:26:03.944 [2024-11-28 19:14:13.706365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:123896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.944 [2024-11-28 19:14:13.706389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.944 [2024-11-28 19:14:13.706432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:123904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.944 [2024-11-28 19:14:13.706448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.944 [2024-11-28 19:14:13.706464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:123912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.944 [2024-11-28 19:14:13.706478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.944 [2024-11-28 19:14:13.706493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:123960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.944 [2024-11-28 19:14:13.706506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.944 [2024-11-28 19:14:13.706521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:123968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.944 [2024-11-28 19:14:13.706534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.944 [2024-11-28 19:14:13.706549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:123976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.944 [2024-11-28 19:14:13.706563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.944 [2024-11-28 19:14:13.706578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:123984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.944 [2024-11-28 19:14:13.706592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.944 [2024-11-28 19:14:13.706607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:123992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.944 [2024-11-28 19:14:13.706620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.944 [2024-11-28 19:14:13.706635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:124000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.944 [2024-11-28 19:14:13.706649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.944 [2024-11-28 19:14:13.706669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:124008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.944 [2024-11-28 19:14:13.706683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.944 [2024-11-28 19:14:13.706715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:124016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.945 [2024-11-28 19:14:13.706729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.945 [2024-11-28 19:14:13.706743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:124024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.945 [2024-11-28 19:14:13.706756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.945 [2024-11-28 19:14:13.706771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:123432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.945 [2024-11-28 19:14:13.706784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.945 [2024-11-28 19:14:13.706798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:123440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.945 [2024-11-28 19:14:13.706811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.945 [2024-11-28 19:14:13.706826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:123448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.945 [2024-11-28 19:14:13.706839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.945 [2024-11-28 19:14:13.706854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:123456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.945 [2024-11-28 19:14:13.706866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.945 [2024-11-28 19:14:13.706881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:123464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.945 [2024-11-28 19:14:13.706895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.945 [2024-11-28 19:14:13.706910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:123480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.945 [2024-11-28 19:14:13.706923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.945 [2024-11-28 19:14:13.706937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:123496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.945 [2024-11-28 19:14:13.706950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.945 [2024-11-28 19:14:13.706965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:123504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.945 [2024-11-28 19:14:13.706978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.945 [2024-11-28 19:14:13.706992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:124064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.945 [2024-11-28 19:14:13.707006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.945 [2024-11-28 19:14:13.707020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:124072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.945 [2024-11-28 19:14:13.707037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.945 [2024-11-28 19:14:13.707052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:124088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.945 [2024-11-28 19:14:13.707066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.945 [2024-11-28 19:14:13.707080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:124096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.945 [2024-11-28 19:14:13.707093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.945 [2024-11-28 19:14:13.707107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:124112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.945 [2024-11-28 19:14:13.707120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.945 [2024-11-28 19:14:13.707135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:124120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.945 [2024-11-28 19:14:13.707148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.945 [2024-11-28 19:14:13.707162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:124128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.945 [2024-11-28 19:14:13.707175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.945 [2024-11-28 19:14:13.707189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:123528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.945 [2024-11-28 19:14:13.707202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.945 [2024-11-28 19:14:13.707217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:123560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.945 [2024-11-28 19:14:13.707230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.945 [2024-11-28 19:14:13.707244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:123592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.945 [2024-11-28 19:14:13.707257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.945 [2024-11-28 19:14:13.707272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:123600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.945 [2024-11-28 19:14:13.707285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.945 [2024-11-28 19:14:13.707299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:123616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.945 [2024-11-28 19:14:13.707312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.945 [2024-11-28 19:14:13.707327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:123640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.945 [2024-11-28 19:14:13.707340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.945 [2024-11-28 19:14:13.707354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:123648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.945 [2024-11-28 19:14:13.707368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.945 [2024-11-28 19:14:13.707382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:123656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.945 [2024-11-28 19:14:13.707424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.945 [2024-11-28 19:14:13.707442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:124136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.945 [2024-11-28 19:14:13.707456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.945 [2024-11-28 19:14:13.707471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:124152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.945 [2024-11-28 19:14:13.707485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.945 [2024-11-28 19:14:13.707500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:124160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.945 [2024-11-28 19:14:13.707514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.945 [2024-11-28 19:14:13.707529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:124176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.945 [2024-11-28 19:14:13.707542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.945 [2024-11-28 19:14:13.707557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:124192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.945 [2024-11-28 19:14:13.707571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.945 [2024-11-28 19:14:13.707586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:124208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.945 [2024-11-28 19:14:13.707599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.945 [2024-11-28 19:14:13.707620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:124216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.945 [2024-11-28 19:14:13.707633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.945 [2024-11-28 19:14:13.707648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:124224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.945 [2024-11-28 19:14:13.707662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.945 [2024-11-28 19:14:13.707683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:124232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.946 [2024-11-28 19:14:13.707697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.707728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:124240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.946 [2024-11-28 19:14:13.707741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.707756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:124248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.946 [2024-11-28 19:14:13.707769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.707783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:124256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.946 [2024-11-28 19:14:13.707796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.707814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:124264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.946 [2024-11-28 19:14:13.707828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.707843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:124272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.946 [2024-11-28 19:14:13.707857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.707871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:124280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.946 [2024-11-28 19:14:13.707885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.707900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:87 nsid:1 lba:124288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.946 [2024-11-28 19:14:13.707913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.707936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:124296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.946 [2024-11-28 19:14:13.707950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.707965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:124304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.946 [2024-11-28 19:14:13.707978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.707992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:123672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.946 [2024-11-28 19:14:13.708012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.708026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:123680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.946 [2024-11-28 19:14:13.708039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.708054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:123688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.946 [2024-11-28 19:14:13.708067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.708081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:123712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.946 [2024-11-28 19:14:13.708094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.708108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:123728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.946 [2024-11-28 19:14:13.708123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.708137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:123736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.946 [2024-11-28 19:14:13.708150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.708164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:123752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.946 [2024-11-28 19:14:13.708181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.708196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:123760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.946 [2024-11-28 19:14:13.708209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.708223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:123784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.946 [2024-11-28 19:14:13.708236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.708250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:123792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.946 [2024-11-28 19:14:13.708263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.708278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:123800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.946 [2024-11-28 19:14:13.708291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.708306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:123816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.946 [2024-11-28 19:14:13.708319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.708333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:123840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.946 [2024-11-28 19:14:13.708346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.708361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:123856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.946 [2024-11-28 19:14:13.708373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.708388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:123864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.946 [2024-11-28 19:14:13.708424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.708441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:123872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.946 [2024-11-28 19:14:13.708455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.708470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:124312 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.946 [2024-11-28 19:14:13.708483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.708498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:124320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.946 [2024-11-28 19:14:13.708512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.708527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:124328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.946 [2024-11-28 19:14:13.708540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.708559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:124336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.946 [2024-11-28 19:14:13.708574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.708589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:124344 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.946 [2024-11-28 19:14:13.708602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.708618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:124352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.946 [2024-11-28 19:14:13.708631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.708646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:124360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.946 [2024-11-28 19:14:13.708660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.708675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:124368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.946 [2024-11-28 19:14:13.708688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.708719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:124376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.946 [2024-11-28 19:14:13.708732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.708747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:124384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.946 [2024-11-28 19:14:13.708760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.708775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:124392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.946 [2024-11-28 19:14:13.708788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.708802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:124400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.946 [2024-11-28 19:14:13.708815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.708830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:124408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.946 [2024-11-28 19:14:13.708843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.946 [2024-11-28 19:14:13.708857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:124416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.946 [2024-11-28 19:14:13.708870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.708884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:124424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.947 [2024-11-28 19:14:13.708897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.708911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:124432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.947 [2024-11-28 19:14:13.708928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.708943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:124440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.947 [2024-11-28 19:14:13.708956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.708971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:124448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.947 [2024-11-28 19:14:13.708984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.708998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:124456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.947 [2024-11-28 19:14:13.709011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.709026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:124464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.947 [2024-11-28 19:14:13.709039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.709053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:124472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.947 [2024-11-28 19:14:13.709066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.709080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:124480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.947 [2024-11-28 19:14:13.709093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.709107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:123888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.947 [2024-11-28 19:14:13.709120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.709134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:123920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.947 [2024-11-28 19:14:13.709147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.709162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:123928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.947 [2024-11-28 19:14:13.709175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.709189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:123936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.947 [2024-11-28 19:14:13.709202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.709217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:123944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.947 [2024-11-28 19:14:13.709237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.709252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:123952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.947 [2024-11-28 19:14:13.709265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.709283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:124032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.947 [2024-11-28 19:14:13.709296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.709310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:124040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.947 [2024-11-28 19:14:13.709324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.709339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:124488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.947 [2024-11-28 19:14:13.709352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.709367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:124496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.947 [2024-11-28 19:14:13.709380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.709415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:124504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.947 [2024-11-28 19:14:13.709431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.709447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:124512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.947 [2024-11-28 19:14:13.709460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.709475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:124520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.947 [2024-11-28 19:14:13.709488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.709503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:124528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.947 [2024-11-28 19:14:13.709517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.709532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:124536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.947 [2024-11-28 19:14:13.709545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.709560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:124544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.947 [2024-11-28 19:14:13.709573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.709588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:124552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.947 [2024-11-28 19:14:13.709601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.709616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:124560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.947 [2024-11-28 19:14:13.709629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.709644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:124568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.947 [2024-11-28 19:14:13.709661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.709677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:124576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.947 [2024-11-28 19:14:13.709690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.709705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:124584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.947 [2024-11-28 19:14:13.709723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.709739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:124592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.947 [2024-11-28 19:14:13.709753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.709768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:124600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.947 [2024-11-28 19:14:13.709781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.709795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:124608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.947 [2024-11-28 19:14:13.709809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.709824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:124616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.947 [2024-11-28 19:14:13.709837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.709852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:124624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.947 [2024-11-28 19:14:13.709865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.709880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:124632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.947 [2024-11-28 19:14:13.709893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.709908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:124640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.947 [2024-11-28 19:14:13.709921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.709936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:124648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.947 [2024-11-28 19:14:13.709949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.709964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:124048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.947 [2024-11-28 19:14:13.709977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.709992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:124056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.947 [2024-11-28 19:14:13.710005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.947 [2024-11-28 19:14:13.710020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:124080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.947 [2024-11-28 19:14:13.710037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.948 [2024-11-28 19:14:13.710053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:124104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.948 [2024-11-28 19:14:13.710066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.948 [2024-11-28 19:14:13.710081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:124144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.948 [2024-11-28 19:14:13.710094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.948 [2024-11-28 19:14:13.710109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:124168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.948 [2024-11-28 19:14:13.710124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.948 [2024-11-28 19:14:13.710139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:124184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.948 [2024-11-28 19:14:13.710153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.948 [2024-11-28 19:14:13.710167] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa7bd10 is same with the state(5) to be set 00:26:03.948 [2024-11-28 19:14:13.710183] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:26:03.948 [2024-11-28 19:14:13.710195] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:26:03.948 [2024-11-28 19:14:13.710206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:124200 len:8 PRP1 0x0 PRP2 0x0 00:26:03.948 [2024-11-28 19:14:13.710219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.948 [2024-11-28 19:14:13.710275] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xa7bd10 was disconnected and freed. reset controller. 00:26:03.948 [2024-11-28 19:14:13.710292] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:26:03.948 [2024-11-28 19:14:13.710307] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.948 [2024-11-28 19:14:13.712475] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.948 [2024-11-28 19:14:13.712514] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa6f870 (9): Bad file descriptor 00:26:03.948 [2024-11-28 19:14:13.741430] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:26:03.948 [2024-11-28 19:14:18.308013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:84512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.948 [2024-11-28 19:14:18.308054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.948 [2024-11-28 19:14:18.308082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:83936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.948 [2024-11-28 19:14:18.308099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.948 [2024-11-28 19:14:18.308115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:83944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.948 [2024-11-28 19:14:18.308129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.948 [2024-11-28 19:14:18.308144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:83952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.948 [2024-11-28 19:14:18.308172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.948 [2024-11-28 19:14:18.308188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:83960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.948 [2024-11-28 19:14:18.308201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.948 [2024-11-28 19:14:18.308216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:83968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.948 [2024-11-28 19:14:18.308229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.948 [2024-11-28 19:14:18.308244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:83992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.948 [2024-11-28 19:14:18.308273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.948 [2024-11-28 19:14:18.308288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:84000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.948 [2024-11-28 19:14:18.308300] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.948 [2024-11-28 19:14:18.308314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:84008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.948 [2024-11-28 19:14:18.308327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.948 [2024-11-28 19:14:18.308342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:84544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.948 [2024-11-28 19:14:18.308354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.948 [2024-11-28 19:14:18.308369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:84552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.948 [2024-11-28 19:14:18.308381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.948 [2024-11-28 19:14:18.308417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:84568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.948 [2024-11-28 19:14:18.308434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.948 [2024-11-28 19:14:18.308449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:84584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.948 [2024-11-28 19:14:18.308462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.948 [2024-11-28 19:14:18.308477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:84592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.948 [2024-11-28 19:14:18.308490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.948 [2024-11-28 19:14:18.308505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:84624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.948 [2024-11-28 19:14:18.308519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.948 [2024-11-28 19:14:18.308534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:84632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.948 [2024-11-28 19:14:18.308548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.948 [2024-11-28 19:14:18.308567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:84656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.948 [2024-11-28 19:14:18.308582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.948 [2024-11-28 19:14:18.308598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:84680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.948 [2024-11-28 19:14:18.308612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.948 [2024-11-28 19:14:18.308626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:84704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.948 [2024-11-28 19:14:18.308640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.948 [2024-11-28 19:14:18.308654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:84712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.948 [2024-11-28 19:14:18.308668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.948 [2024-11-28 19:14:18.308682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:84728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.948 [2024-11-28 19:14:18.308695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.948 [2024-11-28 19:14:18.308725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:84736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.948 [2024-11-28 19:14:18.308738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.948 [2024-11-28 19:14:18.308753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:84744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.948 [2024-11-28 19:14:18.308767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.948 [2024-11-28 19:14:18.308781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:84752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.948 [2024-11-28 19:14:18.308794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.948 [2024-11-28 19:14:18.308808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:84760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.948 [2024-11-28 19:14:18.308822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.948 [2024-11-28 19:14:18.308836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:84768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.948 [2024-11-28 19:14:18.308849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.948 [2024-11-28 19:14:18.308863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:84776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.948 [2024-11-28 19:14:18.308876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.948 [2024-11-28 19:14:18.308891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:84784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.948 [2024-11-28 19:14:18.308904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.948 [2024-11-28 19:14:18.308918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:84792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.948 [2024-11-28 19:14:18.308939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.948 [2024-11-28 19:14:18.308954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:84800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.948 [2024-11-28 19:14:18.308967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.948 [2024-11-28 19:14:18.308982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:84808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.948 [2024-11-28 19:14:18.308995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.949 [2024-11-28 19:14:18.309009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:84048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.949 [2024-11-28 19:14:18.309022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.949 [2024-11-28 19:14:18.309037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:84056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.949 [2024-11-28 19:14:18.309050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.949 [2024-11-28 19:14:18.309065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:84064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.949 [2024-11-28 19:14:18.309078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.949 [2024-11-28 19:14:18.309092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:84080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.949 [2024-11-28 19:14:18.309106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.949 [2024-11-28 19:14:18.309120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:84088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.949 [2024-11-28 19:14:18.309133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.949 [2024-11-28 19:14:18.309147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:84120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.949 [2024-11-28 19:14:18.309160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.949 [2024-11-28 19:14:18.309174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:84136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.949 [2024-11-28 19:14:18.309187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.949 [2024-11-28 19:14:18.309202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:84144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.949 [2024-11-28 19:14:18.309214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.949 [2024-11-28 19:14:18.309229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:84152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.949 [2024-11-28 19:14:18.309242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.949 [2024-11-28 19:14:18.309256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:84160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.949 [2024-11-28 19:14:18.309269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.949 [2024-11-28 19:14:18.309287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:84168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.949 [2024-11-28 19:14:18.309301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.949 [2024-11-28 19:14:18.309316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:84176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.949 [2024-11-28 19:14:18.309330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.949 [2024-11-28 19:14:18.309344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:84200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.949 [2024-11-28 19:14:18.309357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.949 [2024-11-28 19:14:18.309372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:84216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.949 [2024-11-28 19:14:18.309384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.949 [2024-11-28 19:14:18.309424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:84224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.949 [2024-11-28 19:14:18.309440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.949 [2024-11-28 19:14:18.309456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:84240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.949 [2024-11-28 19:14:18.309469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.949 [2024-11-28 19:14:18.309485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:84816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.949 [2024-11-28 19:14:18.309498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.949 [2024-11-28 19:14:18.309513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:84824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.949 [2024-11-28 19:14:18.309528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.949 [2024-11-28 19:14:18.309543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:84832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.949 [2024-11-28 19:14:18.309556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.949 [2024-11-28 19:14:18.309572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:84840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.949 [2024-11-28 19:14:18.309585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.949 [2024-11-28 19:14:18.309600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:84848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.949 [2024-11-28 19:14:18.309613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.949 [2024-11-28 19:14:18.309628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:84856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.949 [2024-11-28 19:14:18.309642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.949 [2024-11-28 19:14:18.309657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:84864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.949 [2024-11-28 19:14:18.309675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.949 [2024-11-28 19:14:18.309691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:84872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.949 [2024-11-28 19:14:18.309720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.949 [2024-11-28 19:14:18.309735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:84880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.949 [2024-11-28 19:14:18.309748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.949 [2024-11-28 19:14:18.309762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:84888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.949 [2024-11-28 19:14:18.309777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.949 [2024-11-28 19:14:18.309791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:84896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.949 [2024-11-28 19:14:18.309805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.949 [2024-11-28 19:14:18.309819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:84904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.949 [2024-11-28 19:14:18.309832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.949 [2024-11-28 19:14:18.309847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:84912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.949 [2024-11-28 19:14:18.309861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.949 [2024-11-28 19:14:18.309875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:84248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.949 [2024-11-28 19:14:18.309889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.949 [2024-11-28 19:14:18.309904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:84256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.949 [2024-11-28 19:14:18.309917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.949 [2024-11-28 19:14:18.309932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:84280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.949 [2024-11-28 19:14:18.309945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.949 [2024-11-28 19:14:18.309959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:84288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.949 [2024-11-28 19:14:18.309972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.949 [2024-11-28 19:14:18.309987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:84296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.949 [2024-11-28 19:14:18.310007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.949 [2024-11-28 19:14:18.310023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:84312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.949 [2024-11-28 19:14:18.310036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.949 [2024-11-28 19:14:18.310050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:84320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.949 [2024-11-28 19:14:18.310067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.949 [2024-11-28 19:14:18.310083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:84352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.950 [2024-11-28 19:14:18.310097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.310111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:84920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.950 [2024-11-28 19:14:18.310124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.310139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:84928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.950 [2024-11-28 19:14:18.310152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.310166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:84936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.950 [2024-11-28 19:14:18.310180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.310202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:84944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.950 [2024-11-28 19:14:18.310217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.310232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:84952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.950 [2024-11-28 19:14:18.310247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.310262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:84960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.950 [2024-11-28 19:14:18.310276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.310291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:84968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.950 [2024-11-28 19:14:18.310305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.310320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:84976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.950 [2024-11-28 19:14:18.310334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.310349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:84984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.950 [2024-11-28 19:14:18.310362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.310377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:84992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.950 [2024-11-28 19:14:18.310391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.310430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:85000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.950 [2024-11-28 19:14:18.310444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.310463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:85008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.950 [2024-11-28 19:14:18.310478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.310494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:85016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.950 [2024-11-28 19:14:18.310518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.310535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:85024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.950 [2024-11-28 19:14:18.310550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.310565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:85032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.950 [2024-11-28 19:14:18.310579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.310595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:85040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.950 [2024-11-28 19:14:18.310609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.310624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:85048 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.950 [2024-11-28 19:14:18.310638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.310654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:85056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.950 [2024-11-28 19:14:18.310668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.310684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:85064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.950 [2024-11-28 19:14:18.310698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.310728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:85072 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.950 [2024-11-28 19:14:18.310742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.310758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:84368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.950 [2024-11-28 19:14:18.310772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.310787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:84376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.950 [2024-11-28 19:14:18.310800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.310815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:84392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.950 [2024-11-28 19:14:18.310829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.310843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:84432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.950 [2024-11-28 19:14:18.310860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.310876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:84448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.950 [2024-11-28 19:14:18.310890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.310905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:84464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.950 [2024-11-28 19:14:18.310918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.310933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:84480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.950 [2024-11-28 19:14:18.310946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.310960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:84488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.950 [2024-11-28 19:14:18.310974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.310990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:85080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.950 [2024-11-28 19:14:18.311004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.311019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:85088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.950 [2024-11-28 19:14:18.311032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.311047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:85096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.950 [2024-11-28 19:14:18.311060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.311075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:85104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.950 [2024-11-28 19:14:18.311088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.311102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:85112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.950 [2024-11-28 19:14:18.311116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.311131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:85120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.950 [2024-11-28 19:14:18.311146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.311160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:85128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.950 [2024-11-28 19:14:18.311174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.311189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:84504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.950 [2024-11-28 19:14:18.311202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.311221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:84520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.950 [2024-11-28 19:14:18.311235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.311250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:84528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.950 [2024-11-28 19:14:18.311264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.950 [2024-11-28 19:14:18.311279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:84536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.951 [2024-11-28 19:14:18.311292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.951 [2024-11-28 19:14:18.311307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:84560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.951 [2024-11-28 19:14:18.311321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.951 [2024-11-28 19:14:18.311335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:84576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.951 [2024-11-28 19:14:18.311349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.951 [2024-11-28 19:14:18.311364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:84600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.951 [2024-11-28 19:14:18.311377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.951 [2024-11-28 19:14:18.311397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:84608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.951 [2024-11-28 19:14:18.311428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.951 [2024-11-28 19:14:18.311444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:85136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.951 [2024-11-28 19:14:18.311458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.951 [2024-11-28 19:14:18.311473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:85144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.951 [2024-11-28 19:14:18.311488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.951 [2024-11-28 19:14:18.311504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:85152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.951 [2024-11-28 19:14:18.311518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.951 [2024-11-28 19:14:18.311533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:85160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.951 [2024-11-28 19:14:18.311546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.951 [2024-11-28 19:14:18.311561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:85168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:26:03.951 [2024-11-28 19:14:18.311575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.951 [2024-11-28 19:14:18.311589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:85176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.951 [2024-11-28 19:14:18.311606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.951 [2024-11-28 19:14:18.311622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:85184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.951 [2024-11-28 19:14:18.311635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.951 [2024-11-28 19:14:18.311650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:85192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.951 [2024-11-28 19:14:18.311664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.951 [2024-11-28 19:14:18.311679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:85200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.951 [2024-11-28 19:14:18.311692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.951 [2024-11-28 19:14:18.311722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:84616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.951 [2024-11-28 19:14:18.311736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.951 [2024-11-28 19:14:18.311750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:84640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.951 [2024-11-28 19:14:18.311763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.951 [2024-11-28 19:14:18.311778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:84648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.951 [2024-11-28 19:14:18.311791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.951 [2024-11-28 19:14:18.311805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:84664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.951 [2024-11-28 19:14:18.311818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.951 [2024-11-28 19:14:18.311833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:84672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.951 [2024-11-28 19:14:18.311846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.951 [2024-11-28 19:14:18.311861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:84688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.951 [2024-11-28 19:14:18.311874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.951 [2024-11-28 19:14:18.311888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:84696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.951 [2024-11-28 19:14:18.311901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.951 [2024-11-28 19:14:18.311915] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xa92630 is same with the state(5) to be set 00:26:03.951 [2024-11-28 19:14:18.311947] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:26:03.951 [2024-11-28 19:14:18.311958] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:26:03.951 [2024-11-28 19:14:18.311969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:84720 len:8 PRP1 0x0 PRP2 0x0 00:26:03.951 [2024-11-28 19:14:18.311981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.951 [2024-11-28 19:14:18.312046] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0xa92630 was disconnected and freed. reset controller. 00:26:03.951 [2024-11-28 19:14:18.312064] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:26:03.951 [2024-11-28 19:14:18.312097] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:03.951 [2024-11-28 19:14:18.312115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.951 [2024-11-28 19:14:18.312130] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:03.951 [2024-11-28 19:14:18.312142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.951 [2024-11-28 19:14:18.312156] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:03.951 [2024-11-28 19:14:18.312168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.951 [2024-11-28 19:14:18.312181] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:03.951 [2024-11-28 19:14:18.312193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.951 [2024-11-28 19:14:18.312206] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:03.951 [2024-11-28 19:14:18.312246] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa6f870 (9): Bad file descriptor 00:26:03.951 [2024-11-28 19:14:18.314351] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:03.951 [2024-11-28 19:14:18.346261] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:26:03.951 00:26:03.951 Latency(us) 00:26:03.951 [2024-11-28T18:14:24.999Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:03.951 [2024-11-28T18:14:24.999Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:26:03.951 Verification LBA range: start 0x0 length 0x4000 00:26:03.951 NVMe0n1 : 15.01 12765.50 49.87 502.52 0.00 9630.47 625.02 15631.55 00:26:03.951 [2024-11-28T18:14:24.999Z] =================================================================================================================== 00:26:03.951 [2024-11-28T18:14:24.999Z] Total : 12765.50 49.87 502.52 0.00 9630.47 625.02 15631.55 00:26:03.951 Received shutdown signal, test time was about 15.000000 seconds 00:26:03.951 00:26:03.951 Latency(us) 00:26:03.951 [2024-11-28T18:14:24.999Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:03.951 [2024-11-28T18:14:24.999Z] =================================================================================================================== 00:26:03.951 [2024-11-28T18:14:24.999Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:26:03.951 19:14:24 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:26:03.951 19:14:24 -- host/failover.sh@65 -- # count=3 00:26:03.951 19:14:24 -- host/failover.sh@67 -- # (( count != 3 )) 00:26:03.951 19:14:24 -- host/failover.sh@73 -- # bdevperf_pid=306021 00:26:03.951 19:14:24 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:26:03.951 19:14:24 -- host/failover.sh@75 -- # waitforlisten 306021 /var/tmp/bdevperf.sock 00:26:03.951 19:14:24 -- common/autotest_common.sh@829 -- # '[' -z 306021 ']' 00:26:03.951 19:14:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:26:03.951 19:14:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:03.951 19:14:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:26:03.951 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:26:03.951 19:14:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:03.951 19:14:24 -- common/autotest_common.sh@10 -- # set +x 00:26:04.532 19:14:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:04.532 19:14:25 -- common/autotest_common.sh@862 -- # return 0 00:26:04.532 19:14:25 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:26:04.532 [2024-11-28 19:14:25.539621] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:26:04.532 19:14:25 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:26:04.791 [2024-11-28 19:14:25.792306] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:26:04.791 19:14:25 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:05.360 NVMe0n1 00:26:05.360 19:14:26 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:05.619 00:26:05.619 19:14:26 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:05.877 00:26:05.877 19:14:26 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:05.877 19:14:26 -- host/failover.sh@82 -- # grep -q NVMe0 00:26:06.135 19:14:27 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:06.392 19:14:27 -- host/failover.sh@87 -- # sleep 3 00:26:09.678 19:14:30 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:09.678 19:14:30 -- host/failover.sh@88 -- # grep -q NVMe0 00:26:09.678 19:14:30 -- host/failover.sh@90 -- # run_test_pid=306847 00:26:09.678 19:14:30 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:26:09.678 19:14:30 -- host/failover.sh@92 -- # wait 306847 00:26:11.056 0 00:26:11.056 19:14:31 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:26:11.056 [2024-11-28 19:14:24.338103] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:11.056 [2024-11-28 19:14:24.338191] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid306021 ] 00:26:11.056 EAL: No free 2048 kB hugepages reported on node 1 00:26:11.056 [2024-11-28 19:14:24.398790] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:11.056 [2024-11-28 19:14:24.504104] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:11.056 [2024-11-28 19:14:27.396570] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:26:11.056 [2024-11-28 19:14:27.396656] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:11.056 [2024-11-28 19:14:27.396679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:11.056 [2024-11-28 19:14:27.396695] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:11.056 [2024-11-28 19:14:27.396709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:11.056 [2024-11-28 19:14:27.396722] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:11.056 [2024-11-28 19:14:27.396736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:11.056 [2024-11-28 19:14:27.396750] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:11.056 [2024-11-28 19:14:27.396763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:11.056 [2024-11-28 19:14:27.396777] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:26:11.056 [2024-11-28 19:14:27.396813] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:26:11.056 [2024-11-28 19:14:27.396844] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x208c870 (9): Bad file descriptor 00:26:11.056 [2024-11-28 19:14:27.448706] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:26:11.056 Running I/O for 1 seconds... 00:26:11.056 00:26:11.056 Latency(us) 00:26:11.056 [2024-11-28T18:14:32.104Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:26:11.056 [2024-11-28T18:14:32.104Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:26:11.056 Verification LBA range: start 0x0 length 0x4000 00:26:11.056 NVMe0n1 : 1.01 12764.43 49.86 0.00 0.00 9983.21 898.09 14660.65 00:26:11.056 [2024-11-28T18:14:32.104Z] =================================================================================================================== 00:26:11.056 [2024-11-28T18:14:32.104Z] Total : 12764.43 49.86 0.00 0.00 9983.21 898.09 14660.65 00:26:11.056 19:14:31 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:11.056 19:14:31 -- host/failover.sh@95 -- # grep -q NVMe0 00:26:11.056 19:14:32 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:11.315 19:14:32 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:11.315 19:14:32 -- host/failover.sh@99 -- # grep -q NVMe0 00:26:11.574 19:14:32 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:26:11.833 19:14:32 -- host/failover.sh@101 -- # sleep 3 00:26:15.133 19:14:35 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:26:15.133 19:14:35 -- host/failover.sh@103 -- # grep -q NVMe0 00:26:15.133 19:14:36 -- host/failover.sh@108 -- # killprocess 306021 00:26:15.133 19:14:36 -- common/autotest_common.sh@936 -- # '[' -z 306021 ']' 00:26:15.133 19:14:36 -- common/autotest_common.sh@940 -- # kill -0 306021 00:26:15.133 19:14:36 -- common/autotest_common.sh@941 -- # uname 00:26:15.133 19:14:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:15.133 19:14:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 306021 00:26:15.133 19:14:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:15.133 19:14:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:15.133 19:14:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 306021' 00:26:15.133 killing process with pid 306021 00:26:15.133 19:14:36 -- common/autotest_common.sh@955 -- # kill 306021 00:26:15.133 19:14:36 -- common/autotest_common.sh@960 -- # wait 306021 00:26:15.402 19:14:36 -- host/failover.sh@110 -- # sync 00:26:15.402 19:14:36 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:15.681 19:14:36 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:26:15.681 19:14:36 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:26:15.681 19:14:36 -- host/failover.sh@116 -- # nvmftestfini 00:26:15.681 19:14:36 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:15.681 19:14:36 -- nvmf/common.sh@116 -- # sync 00:26:15.681 19:14:36 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:15.681 19:14:36 -- nvmf/common.sh@119 -- # set +e 00:26:15.681 19:14:36 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:15.681 19:14:36 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:15.681 rmmod nvme_tcp 00:26:15.681 rmmod nvme_fabrics 00:26:15.681 rmmod nvme_keyring 00:26:15.956 19:14:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:15.956 19:14:36 -- nvmf/common.sh@123 -- # set -e 00:26:15.956 19:14:36 -- nvmf/common.sh@124 -- # return 0 00:26:15.956 19:14:36 -- nvmf/common.sh@477 -- # '[' -n 303554 ']' 00:26:15.956 19:14:36 -- nvmf/common.sh@478 -- # killprocess 303554 00:26:15.956 19:14:36 -- common/autotest_common.sh@936 -- # '[' -z 303554 ']' 00:26:15.956 19:14:36 -- common/autotest_common.sh@940 -- # kill -0 303554 00:26:15.956 19:14:36 -- common/autotest_common.sh@941 -- # uname 00:26:15.956 19:14:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:15.956 19:14:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 303554 00:26:15.956 19:14:36 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:15.957 19:14:36 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:15.957 19:14:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 303554' 00:26:15.957 killing process with pid 303554 00:26:15.957 19:14:36 -- common/autotest_common.sh@955 -- # kill 303554 00:26:15.957 19:14:36 -- common/autotest_common.sh@960 -- # wait 303554 00:26:16.247 19:14:37 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:16.247 19:14:37 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:16.247 19:14:37 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:16.247 19:14:37 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:16.247 19:14:37 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:16.247 19:14:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:16.247 19:14:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:16.247 19:14:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:18.215 19:14:39 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:18.215 00:26:18.215 real 0m37.363s 00:26:18.215 user 2m12.125s 00:26:18.215 sys 0m6.049s 00:26:18.215 19:14:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:18.215 19:14:39 -- common/autotest_common.sh@10 -- # set +x 00:26:18.216 ************************************ 00:26:18.216 END TEST nvmf_failover 00:26:18.216 ************************************ 00:26:18.216 19:14:39 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:26:18.216 19:14:39 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:18.216 19:14:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:18.216 19:14:39 -- common/autotest_common.sh@10 -- # set +x 00:26:18.216 ************************************ 00:26:18.216 START TEST nvmf_discovery 00:26:18.216 ************************************ 00:26:18.216 19:14:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:26:18.216 * Looking for test storage... 00:26:18.216 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:18.216 19:14:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:18.216 19:14:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:18.216 19:14:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:18.216 19:14:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:18.216 19:14:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:18.216 19:14:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:18.216 19:14:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:18.216 19:14:39 -- scripts/common.sh@335 -- # IFS=.-: 00:26:18.216 19:14:39 -- scripts/common.sh@335 -- # read -ra ver1 00:26:18.216 19:14:39 -- scripts/common.sh@336 -- # IFS=.-: 00:26:18.216 19:14:39 -- scripts/common.sh@336 -- # read -ra ver2 00:26:18.216 19:14:39 -- scripts/common.sh@337 -- # local 'op=<' 00:26:18.216 19:14:39 -- scripts/common.sh@339 -- # ver1_l=2 00:26:18.216 19:14:39 -- scripts/common.sh@340 -- # ver2_l=1 00:26:18.216 19:14:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:18.216 19:14:39 -- scripts/common.sh@343 -- # case "$op" in 00:26:18.216 19:14:39 -- scripts/common.sh@344 -- # : 1 00:26:18.216 19:14:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:18.216 19:14:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:18.216 19:14:39 -- scripts/common.sh@364 -- # decimal 1 00:26:18.216 19:14:39 -- scripts/common.sh@352 -- # local d=1 00:26:18.216 19:14:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:18.216 19:14:39 -- scripts/common.sh@354 -- # echo 1 00:26:18.216 19:14:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:18.216 19:14:39 -- scripts/common.sh@365 -- # decimal 2 00:26:18.216 19:14:39 -- scripts/common.sh@352 -- # local d=2 00:26:18.216 19:14:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:18.216 19:14:39 -- scripts/common.sh@354 -- # echo 2 00:26:18.216 19:14:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:18.216 19:14:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:18.216 19:14:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:18.216 19:14:39 -- scripts/common.sh@367 -- # return 0 00:26:18.216 19:14:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:18.216 19:14:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:18.216 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:18.216 --rc genhtml_branch_coverage=1 00:26:18.216 --rc genhtml_function_coverage=1 00:26:18.216 --rc genhtml_legend=1 00:26:18.216 --rc geninfo_all_blocks=1 00:26:18.216 --rc geninfo_unexecuted_blocks=1 00:26:18.216 00:26:18.216 ' 00:26:18.475 19:14:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:18.475 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:18.475 --rc genhtml_branch_coverage=1 00:26:18.475 --rc genhtml_function_coverage=1 00:26:18.475 --rc genhtml_legend=1 00:26:18.475 --rc geninfo_all_blocks=1 00:26:18.475 --rc geninfo_unexecuted_blocks=1 00:26:18.475 00:26:18.475 ' 00:26:18.475 19:14:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:18.475 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:18.475 --rc genhtml_branch_coverage=1 00:26:18.475 --rc genhtml_function_coverage=1 00:26:18.475 --rc genhtml_legend=1 00:26:18.475 --rc geninfo_all_blocks=1 00:26:18.475 --rc geninfo_unexecuted_blocks=1 00:26:18.475 00:26:18.475 ' 00:26:18.475 19:14:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:18.475 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:18.475 --rc genhtml_branch_coverage=1 00:26:18.475 --rc genhtml_function_coverage=1 00:26:18.475 --rc genhtml_legend=1 00:26:18.475 --rc geninfo_all_blocks=1 00:26:18.475 --rc geninfo_unexecuted_blocks=1 00:26:18.475 00:26:18.475 ' 00:26:18.475 19:14:39 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:18.475 19:14:39 -- nvmf/common.sh@7 -- # uname -s 00:26:18.475 19:14:39 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:18.475 19:14:39 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:18.475 19:14:39 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:18.475 19:14:39 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:18.475 19:14:39 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:18.475 19:14:39 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:18.475 19:14:39 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:18.475 19:14:39 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:18.475 19:14:39 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:18.475 19:14:39 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:18.475 19:14:39 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:18.475 19:14:39 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:18.475 19:14:39 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:18.475 19:14:39 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:18.475 19:14:39 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:18.475 19:14:39 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:18.475 19:14:39 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:18.475 19:14:39 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:18.475 19:14:39 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:18.475 19:14:39 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:18.475 19:14:39 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:18.475 19:14:39 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:18.475 19:14:39 -- paths/export.sh@5 -- # export PATH 00:26:18.475 19:14:39 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:18.475 19:14:39 -- nvmf/common.sh@46 -- # : 0 00:26:18.475 19:14:39 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:18.475 19:14:39 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:18.475 19:14:39 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:18.475 19:14:39 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:18.475 19:14:39 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:18.475 19:14:39 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:18.475 19:14:39 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:18.475 19:14:39 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:18.475 19:14:39 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:26:18.475 19:14:39 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:26:18.475 19:14:39 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:26:18.475 19:14:39 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:26:18.475 19:14:39 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:26:18.475 19:14:39 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:26:18.475 19:14:39 -- host/discovery.sh@25 -- # nvmftestinit 00:26:18.475 19:14:39 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:18.475 19:14:39 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:18.475 19:14:39 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:18.475 19:14:39 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:18.475 19:14:39 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:18.475 19:14:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:18.475 19:14:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:18.475 19:14:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:18.475 19:14:39 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:18.475 19:14:39 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:18.475 19:14:39 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:18.475 19:14:39 -- common/autotest_common.sh@10 -- # set +x 00:26:20.377 19:14:41 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:20.377 19:14:41 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:20.377 19:14:41 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:20.377 19:14:41 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:20.377 19:14:41 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:20.377 19:14:41 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:20.377 19:14:41 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:20.377 19:14:41 -- nvmf/common.sh@294 -- # net_devs=() 00:26:20.377 19:14:41 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:20.377 19:14:41 -- nvmf/common.sh@295 -- # e810=() 00:26:20.377 19:14:41 -- nvmf/common.sh@295 -- # local -ga e810 00:26:20.377 19:14:41 -- nvmf/common.sh@296 -- # x722=() 00:26:20.377 19:14:41 -- nvmf/common.sh@296 -- # local -ga x722 00:26:20.377 19:14:41 -- nvmf/common.sh@297 -- # mlx=() 00:26:20.377 19:14:41 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:20.377 19:14:41 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:20.377 19:14:41 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:20.377 19:14:41 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:20.377 19:14:41 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:20.377 19:14:41 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:20.377 19:14:41 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:20.377 19:14:41 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:20.377 19:14:41 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:20.377 19:14:41 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:20.377 19:14:41 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:20.377 19:14:41 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:20.377 19:14:41 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:20.377 19:14:41 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:20.377 19:14:41 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:20.377 19:14:41 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:20.377 19:14:41 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:20.377 19:14:41 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:20.377 19:14:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:20.377 19:14:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:20.377 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:20.377 19:14:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:20.377 19:14:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:20.377 19:14:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:20.377 19:14:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:20.377 19:14:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:20.377 19:14:41 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:20.377 19:14:41 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:20.377 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:20.377 19:14:41 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:20.377 19:14:41 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:20.377 19:14:41 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:20.377 19:14:41 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:20.377 19:14:41 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:20.377 19:14:41 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:20.377 19:14:41 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:20.377 19:14:41 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:20.377 19:14:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:20.377 19:14:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:20.377 19:14:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:20.377 19:14:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:20.377 19:14:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:20.377 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:20.377 19:14:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:20.377 19:14:41 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:20.377 19:14:41 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:20.377 19:14:41 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:20.377 19:14:41 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:20.377 19:14:41 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:20.377 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:20.377 19:14:41 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:20.377 19:14:41 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:20.377 19:14:41 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:20.377 19:14:41 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:20.377 19:14:41 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:20.377 19:14:41 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:20.377 19:14:41 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:20.377 19:14:41 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:20.377 19:14:41 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:20.377 19:14:41 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:20.377 19:14:41 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:20.377 19:14:41 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:20.377 19:14:41 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:20.377 19:14:41 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:20.377 19:14:41 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:20.377 19:14:41 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:20.377 19:14:41 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:20.377 19:14:41 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:20.377 19:14:41 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:20.638 19:14:41 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:20.638 19:14:41 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:20.638 19:14:41 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:20.638 19:14:41 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:20.638 19:14:41 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:20.638 19:14:41 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:20.638 19:14:41 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:20.638 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:20.638 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.320 ms 00:26:20.638 00:26:20.638 --- 10.0.0.2 ping statistics --- 00:26:20.638 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:20.638 rtt min/avg/max/mdev = 0.320/0.320/0.320/0.000 ms 00:26:20.638 19:14:41 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:20.638 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:20.638 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.085 ms 00:26:20.638 00:26:20.638 --- 10.0.0.1 ping statistics --- 00:26:20.638 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:20.638 rtt min/avg/max/mdev = 0.085/0.085/0.085/0.000 ms 00:26:20.638 19:14:41 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:20.638 19:14:41 -- nvmf/common.sh@410 -- # return 0 00:26:20.638 19:14:41 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:20.638 19:14:41 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:20.638 19:14:41 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:20.638 19:14:41 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:20.638 19:14:41 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:20.638 19:14:41 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:20.638 19:14:41 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:20.638 19:14:41 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:26:20.638 19:14:41 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:20.638 19:14:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:20.638 19:14:41 -- common/autotest_common.sh@10 -- # set +x 00:26:20.638 19:14:41 -- nvmf/common.sh@469 -- # nvmfpid=309522 00:26:20.638 19:14:41 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:26:20.638 19:14:41 -- nvmf/common.sh@470 -- # waitforlisten 309522 00:26:20.638 19:14:41 -- common/autotest_common.sh@829 -- # '[' -z 309522 ']' 00:26:20.638 19:14:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:20.638 19:14:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:20.638 19:14:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:20.638 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:20.638 19:14:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:20.638 19:14:41 -- common/autotest_common.sh@10 -- # set +x 00:26:20.638 [2024-11-28 19:14:41.590822] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:20.638 [2024-11-28 19:14:41.590898] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:20.638 EAL: No free 2048 kB hugepages reported on node 1 00:26:20.638 [2024-11-28 19:14:41.660510] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:20.898 [2024-11-28 19:14:41.783891] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:20.898 [2024-11-28 19:14:41.784061] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:20.898 [2024-11-28 19:14:41.784079] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:20.898 [2024-11-28 19:14:41.784092] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:20.898 [2024-11-28 19:14:41.784138] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:21.834 19:14:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:21.834 19:14:42 -- common/autotest_common.sh@862 -- # return 0 00:26:21.835 19:14:42 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:21.835 19:14:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:21.835 19:14:42 -- common/autotest_common.sh@10 -- # set +x 00:26:21.835 19:14:42 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:21.835 19:14:42 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:21.835 19:14:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.835 19:14:42 -- common/autotest_common.sh@10 -- # set +x 00:26:21.835 [2024-11-28 19:14:42.651103] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:21.835 19:14:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.835 19:14:42 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:26:21.835 19:14:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.835 19:14:42 -- common/autotest_common.sh@10 -- # set +x 00:26:21.835 [2024-11-28 19:14:42.659292] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:26:21.835 19:14:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.835 19:14:42 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:26:21.835 19:14:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.835 19:14:42 -- common/autotest_common.sh@10 -- # set +x 00:26:21.835 null0 00:26:21.835 19:14:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.835 19:14:42 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:26:21.835 19:14:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.835 19:14:42 -- common/autotest_common.sh@10 -- # set +x 00:26:21.835 null1 00:26:21.835 19:14:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.835 19:14:42 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:26:21.835 19:14:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:21.835 19:14:42 -- common/autotest_common.sh@10 -- # set +x 00:26:21.835 19:14:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:21.835 19:14:42 -- host/discovery.sh@45 -- # hostpid=309692 00:26:21.835 19:14:42 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:26:21.835 19:14:42 -- host/discovery.sh@46 -- # waitforlisten 309692 /tmp/host.sock 00:26:21.835 19:14:42 -- common/autotest_common.sh@829 -- # '[' -z 309692 ']' 00:26:21.835 19:14:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:26:21.835 19:14:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:21.835 19:14:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:26:21.835 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:26:21.835 19:14:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:21.835 19:14:42 -- common/autotest_common.sh@10 -- # set +x 00:26:21.835 [2024-11-28 19:14:42.729018] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:21.835 [2024-11-28 19:14:42.729109] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid309692 ] 00:26:21.835 EAL: No free 2048 kB hugepages reported on node 1 00:26:21.835 [2024-11-28 19:14:42.794225] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:22.093 [2024-11-28 19:14:42.907656] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:22.093 [2024-11-28 19:14:42.907831] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:22.660 19:14:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:22.660 19:14:43 -- common/autotest_common.sh@862 -- # return 0 00:26:22.660 19:14:43 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:22.660 19:14:43 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:26:22.660 19:14:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.660 19:14:43 -- common/autotest_common.sh@10 -- # set +x 00:26:22.660 19:14:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.660 19:14:43 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:26:22.660 19:14:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.660 19:14:43 -- common/autotest_common.sh@10 -- # set +x 00:26:22.660 19:14:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.660 19:14:43 -- host/discovery.sh@72 -- # notify_id=0 00:26:22.919 19:14:43 -- host/discovery.sh@78 -- # get_subsystem_names 00:26:22.919 19:14:43 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:22.919 19:14:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.919 19:14:43 -- common/autotest_common.sh@10 -- # set +x 00:26:22.919 19:14:43 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:22.919 19:14:43 -- host/discovery.sh@59 -- # sort 00:26:22.919 19:14:43 -- host/discovery.sh@59 -- # xargs 00:26:22.919 19:14:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.919 19:14:43 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:26:22.919 19:14:43 -- host/discovery.sh@79 -- # get_bdev_list 00:26:22.919 19:14:43 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:22.919 19:14:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.919 19:14:43 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:22.919 19:14:43 -- common/autotest_common.sh@10 -- # set +x 00:26:22.919 19:14:43 -- host/discovery.sh@55 -- # sort 00:26:22.919 19:14:43 -- host/discovery.sh@55 -- # xargs 00:26:22.919 19:14:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.919 19:14:43 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:26:22.919 19:14:43 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:26:22.919 19:14:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.919 19:14:43 -- common/autotest_common.sh@10 -- # set +x 00:26:22.919 19:14:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.919 19:14:43 -- host/discovery.sh@82 -- # get_subsystem_names 00:26:22.919 19:14:43 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:22.919 19:14:43 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:22.919 19:14:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.919 19:14:43 -- host/discovery.sh@59 -- # sort 00:26:22.919 19:14:43 -- common/autotest_common.sh@10 -- # set +x 00:26:22.919 19:14:43 -- host/discovery.sh@59 -- # xargs 00:26:22.919 19:14:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.919 19:14:43 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:26:22.919 19:14:43 -- host/discovery.sh@83 -- # get_bdev_list 00:26:22.919 19:14:43 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:22.919 19:14:43 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:22.919 19:14:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.919 19:14:43 -- common/autotest_common.sh@10 -- # set +x 00:26:22.919 19:14:43 -- host/discovery.sh@55 -- # sort 00:26:22.919 19:14:43 -- host/discovery.sh@55 -- # xargs 00:26:22.919 19:14:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.919 19:14:43 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:26:22.919 19:14:43 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:26:22.919 19:14:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.919 19:14:43 -- common/autotest_common.sh@10 -- # set +x 00:26:22.919 19:14:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.919 19:14:43 -- host/discovery.sh@86 -- # get_subsystem_names 00:26:22.919 19:14:43 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:22.919 19:14:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.919 19:14:43 -- common/autotest_common.sh@10 -- # set +x 00:26:22.919 19:14:43 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:22.919 19:14:43 -- host/discovery.sh@59 -- # sort 00:26:22.919 19:14:43 -- host/discovery.sh@59 -- # xargs 00:26:22.919 19:14:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.919 19:14:43 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:26:22.919 19:14:43 -- host/discovery.sh@87 -- # get_bdev_list 00:26:22.919 19:14:43 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:22.919 19:14:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.920 19:14:43 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:22.920 19:14:43 -- common/autotest_common.sh@10 -- # set +x 00:26:22.920 19:14:43 -- host/discovery.sh@55 -- # sort 00:26:22.920 19:14:43 -- host/discovery.sh@55 -- # xargs 00:26:22.920 19:14:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.920 19:14:43 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:26:22.920 19:14:43 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:22.920 19:14:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.920 19:14:43 -- common/autotest_common.sh@10 -- # set +x 00:26:22.920 [2024-11-28 19:14:43.954981] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:22.920 19:14:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:22.920 19:14:43 -- host/discovery.sh@92 -- # get_subsystem_names 00:26:22.920 19:14:43 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:22.920 19:14:43 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:22.920 19:14:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:22.920 19:14:43 -- common/autotest_common.sh@10 -- # set +x 00:26:22.920 19:14:43 -- host/discovery.sh@59 -- # sort 00:26:22.920 19:14:43 -- host/discovery.sh@59 -- # xargs 00:26:23.180 19:14:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:23.180 19:14:43 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:26:23.180 19:14:44 -- host/discovery.sh@93 -- # get_bdev_list 00:26:23.180 19:14:44 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:23.180 19:14:44 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:23.180 19:14:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:23.180 19:14:44 -- common/autotest_common.sh@10 -- # set +x 00:26:23.180 19:14:44 -- host/discovery.sh@55 -- # sort 00:26:23.180 19:14:44 -- host/discovery.sh@55 -- # xargs 00:26:23.180 19:14:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:23.180 19:14:44 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:26:23.180 19:14:44 -- host/discovery.sh@94 -- # get_notification_count 00:26:23.180 19:14:44 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:26:23.180 19:14:44 -- host/discovery.sh@74 -- # jq '. | length' 00:26:23.180 19:14:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:23.180 19:14:44 -- common/autotest_common.sh@10 -- # set +x 00:26:23.180 19:14:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:23.180 19:14:44 -- host/discovery.sh@74 -- # notification_count=0 00:26:23.180 19:14:44 -- host/discovery.sh@75 -- # notify_id=0 00:26:23.180 19:14:44 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:26:23.180 19:14:44 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:26:23.180 19:14:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:23.180 19:14:44 -- common/autotest_common.sh@10 -- # set +x 00:26:23.180 19:14:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:23.180 19:14:44 -- host/discovery.sh@100 -- # sleep 1 00:26:23.752 [2024-11-28 19:14:44.750070] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:23.752 [2024-11-28 19:14:44.750103] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:23.752 [2024-11-28 19:14:44.750134] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:24.011 [2024-11-28 19:14:44.836404] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:26:24.011 [2024-11-28 19:14:44.893255] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:24.012 [2024-11-28 19:14:44.893281] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:24.273 19:14:45 -- host/discovery.sh@101 -- # get_subsystem_names 00:26:24.273 19:14:45 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:24.273 19:14:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:24.273 19:14:45 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:24.273 19:14:45 -- common/autotest_common.sh@10 -- # set +x 00:26:24.273 19:14:45 -- host/discovery.sh@59 -- # sort 00:26:24.273 19:14:45 -- host/discovery.sh@59 -- # xargs 00:26:24.273 19:14:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:24.273 19:14:45 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:24.273 19:14:45 -- host/discovery.sh@102 -- # get_bdev_list 00:26:24.273 19:14:45 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:24.273 19:14:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:24.273 19:14:45 -- common/autotest_common.sh@10 -- # set +x 00:26:24.273 19:14:45 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:24.273 19:14:45 -- host/discovery.sh@55 -- # sort 00:26:24.273 19:14:45 -- host/discovery.sh@55 -- # xargs 00:26:24.273 19:14:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:24.273 19:14:45 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:26:24.273 19:14:45 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:26:24.273 19:14:45 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:24.273 19:14:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:24.273 19:14:45 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:24.273 19:14:45 -- common/autotest_common.sh@10 -- # set +x 00:26:24.273 19:14:45 -- host/discovery.sh@63 -- # sort -n 00:26:24.273 19:14:45 -- host/discovery.sh@63 -- # xargs 00:26:24.273 19:14:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:24.273 19:14:45 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:26:24.273 19:14:45 -- host/discovery.sh@104 -- # get_notification_count 00:26:24.273 19:14:45 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:26:24.273 19:14:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:24.273 19:14:45 -- host/discovery.sh@74 -- # jq '. | length' 00:26:24.273 19:14:45 -- common/autotest_common.sh@10 -- # set +x 00:26:24.273 19:14:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:24.273 19:14:45 -- host/discovery.sh@74 -- # notification_count=1 00:26:24.273 19:14:45 -- host/discovery.sh@75 -- # notify_id=1 00:26:24.273 19:14:45 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:26:24.273 19:14:45 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:26:24.273 19:14:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:24.273 19:14:45 -- common/autotest_common.sh@10 -- # set +x 00:26:24.273 19:14:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:24.273 19:14:45 -- host/discovery.sh@109 -- # sleep 1 00:26:25.209 19:14:46 -- host/discovery.sh@110 -- # get_bdev_list 00:26:25.209 19:14:46 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:25.469 19:14:46 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:25.469 19:14:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:25.469 19:14:46 -- common/autotest_common.sh@10 -- # set +x 00:26:25.469 19:14:46 -- host/discovery.sh@55 -- # sort 00:26:25.469 19:14:46 -- host/discovery.sh@55 -- # xargs 00:26:25.469 19:14:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:25.469 19:14:46 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:25.469 19:14:46 -- host/discovery.sh@111 -- # get_notification_count 00:26:25.469 19:14:46 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:26:25.469 19:14:46 -- host/discovery.sh@74 -- # jq '. | length' 00:26:25.469 19:14:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:25.469 19:14:46 -- common/autotest_common.sh@10 -- # set +x 00:26:25.469 19:14:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:25.469 19:14:46 -- host/discovery.sh@74 -- # notification_count=1 00:26:25.469 19:14:46 -- host/discovery.sh@75 -- # notify_id=2 00:26:25.469 19:14:46 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:26:25.469 19:14:46 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:26:25.469 19:14:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:25.469 19:14:46 -- common/autotest_common.sh@10 -- # set +x 00:26:25.469 [2024-11-28 19:14:46.337951] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:26:25.469 [2024-11-28 19:14:46.338932] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:26:25.469 [2024-11-28 19:14:46.338971] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:25.469 19:14:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:25.469 19:14:46 -- host/discovery.sh@117 -- # sleep 1 00:26:25.469 [2024-11-28 19:14:46.425222] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:26:25.728 [2024-11-28 19:14:46.687480] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:25.728 [2024-11-28 19:14:46.687518] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:25.728 [2024-11-28 19:14:46.687527] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:26.664 19:14:47 -- host/discovery.sh@118 -- # get_subsystem_names 00:26:26.664 19:14:47 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:26.664 19:14:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:26.664 19:14:47 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:26.664 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:26:26.664 19:14:47 -- host/discovery.sh@59 -- # sort 00:26:26.664 19:14:47 -- host/discovery.sh@59 -- # xargs 00:26:26.664 19:14:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:26.664 19:14:47 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:26.664 19:14:47 -- host/discovery.sh@119 -- # get_bdev_list 00:26:26.664 19:14:47 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:26.664 19:14:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:26.664 19:14:47 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:26.664 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:26:26.664 19:14:47 -- host/discovery.sh@55 -- # sort 00:26:26.664 19:14:47 -- host/discovery.sh@55 -- # xargs 00:26:26.664 19:14:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:26.664 19:14:47 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:26.664 19:14:47 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:26:26.664 19:14:47 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:26.664 19:14:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:26.664 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:26:26.664 19:14:47 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:26.664 19:14:47 -- host/discovery.sh@63 -- # sort -n 00:26:26.664 19:14:47 -- host/discovery.sh@63 -- # xargs 00:26:26.664 19:14:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:26.664 19:14:47 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:26:26.664 19:14:47 -- host/discovery.sh@121 -- # get_notification_count 00:26:26.664 19:14:47 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:26.664 19:14:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:26.664 19:14:47 -- host/discovery.sh@74 -- # jq '. | length' 00:26:26.664 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:26:26.664 19:14:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:26.664 19:14:47 -- host/discovery.sh@74 -- # notification_count=0 00:26:26.664 19:14:47 -- host/discovery.sh@75 -- # notify_id=2 00:26:26.664 19:14:47 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:26:26.664 19:14:47 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:26:26.664 19:14:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:26.664 19:14:47 -- common/autotest_common.sh@10 -- # set +x 00:26:26.664 [2024-11-28 19:14:47.509481] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:26:26.664 [2024-11-28 19:14:47.509514] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:26.664 19:14:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:26.664 19:14:47 -- host/discovery.sh@127 -- # sleep 1 00:26:26.664 [2024-11-28 19:14:47.514059] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:26.664 [2024-11-28 19:14:47.514092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:26.664 [2024-11-28 19:14:47.514111] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:26.664 [2024-11-28 19:14:47.514127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:26.664 [2024-11-28 19:14:47.514143] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:26.664 [2024-11-28 19:14:47.514158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:26.664 [2024-11-28 19:14:47.514174] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:26.664 [2024-11-28 19:14:47.514189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:26.665 [2024-11-28 19:14:47.514204] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x188a810 is same with the state(5) to be set 00:26:26.665 [2024-11-28 19:14:47.524066] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x188a810 (9): Bad file descriptor 00:26:26.665 [2024-11-28 19:14:47.534112] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:26.665 [2024-11-28 19:14:47.534327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:26.665 [2024-11-28 19:14:47.534509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:26.665 [2024-11-28 19:14:47.534536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x188a810 with addr=10.0.0.2, port=4420 00:26:26.665 [2024-11-28 19:14:47.534553] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x188a810 is same with the state(5) to be set 00:26:26.665 [2024-11-28 19:14:47.534576] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x188a810 (9): Bad file descriptor 00:26:26.665 [2024-11-28 19:14:47.534609] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:26.665 [2024-11-28 19:14:47.534627] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:26.665 [2024-11-28 19:14:47.534643] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:26.665 [2024-11-28 19:14:47.534678] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:26.665 [2024-11-28 19:14:47.544192] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:26.665 [2024-11-28 19:14:47.544351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:26.665 [2024-11-28 19:14:47.544510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:26.665 [2024-11-28 19:14:47.544537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x188a810 with addr=10.0.0.2, port=4420 00:26:26.665 [2024-11-28 19:14:47.544553] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x188a810 is same with the state(5) to be set 00:26:26.665 [2024-11-28 19:14:47.544575] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x188a810 (9): Bad file descriptor 00:26:26.665 [2024-11-28 19:14:47.544595] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:26.665 [2024-11-28 19:14:47.544608] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:26.665 [2024-11-28 19:14:47.544621] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:26.665 [2024-11-28 19:14:47.544640] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:26.665 [2024-11-28 19:14:47.554277] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:26.665 [2024-11-28 19:14:47.554449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:26.665 [2024-11-28 19:14:47.554551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:26.665 [2024-11-28 19:14:47.554578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x188a810 with addr=10.0.0.2, port=4420 00:26:26.665 [2024-11-28 19:14:47.554594] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x188a810 is same with the state(5) to be set 00:26:26.665 [2024-11-28 19:14:47.554616] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x188a810 (9): Bad file descriptor 00:26:26.665 [2024-11-28 19:14:47.554636] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:26.665 [2024-11-28 19:14:47.554649] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:26.665 [2024-11-28 19:14:47.554661] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:26.665 [2024-11-28 19:14:47.554680] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:26.665 [2024-11-28 19:14:47.564359] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:26.665 [2024-11-28 19:14:47.564558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:26.665 [2024-11-28 19:14:47.564679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:26.665 [2024-11-28 19:14:47.564705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x188a810 with addr=10.0.0.2, port=4420 00:26:26.665 [2024-11-28 19:14:47.564720] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x188a810 is same with the state(5) to be set 00:26:26.665 [2024-11-28 19:14:47.564742] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x188a810 (9): Bad file descriptor 00:26:26.665 [2024-11-28 19:14:47.564805] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:26.665 [2024-11-28 19:14:47.564825] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:26.665 [2024-11-28 19:14:47.564840] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:26.665 [2024-11-28 19:14:47.564861] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:26.665 [2024-11-28 19:14:47.574454] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:26.665 [2024-11-28 19:14:47.574627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:26.665 [2024-11-28 19:14:47.574777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:26.665 [2024-11-28 19:14:47.574806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x188a810 with addr=10.0.0.2, port=4420 00:26:26.665 [2024-11-28 19:14:47.574823] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x188a810 is same with the state(5) to be set 00:26:26.665 [2024-11-28 19:14:47.574847] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x188a810 (9): Bad file descriptor 00:26:26.665 [2024-11-28 19:14:47.574882] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:26.665 [2024-11-28 19:14:47.574902] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:26.665 [2024-11-28 19:14:47.574916] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:26.665 [2024-11-28 19:14:47.574937] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:26.665 [2024-11-28 19:14:47.584522] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:26.665 [2024-11-28 19:14:47.584696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:26.665 [2024-11-28 19:14:47.584884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:26.665 [2024-11-28 19:14:47.584910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x188a810 with addr=10.0.0.2, port=4420 00:26:26.665 [2024-11-28 19:14:47.584925] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x188a810 is same with the state(5) to be set 00:26:26.665 [2024-11-28 19:14:47.584947] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x188a810 (9): Bad file descriptor 00:26:26.665 [2024-11-28 19:14:47.584989] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:26.665 [2024-11-28 19:14:47.585008] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:26.665 [2024-11-28 19:14:47.585021] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:26.665 [2024-11-28 19:14:47.585040] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:26.665 [2024-11-28 19:14:47.594605] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:26.665 [2024-11-28 19:14:47.594815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:26.665 [2024-11-28 19:14:47.594943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:26.665 [2024-11-28 19:14:47.594972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x188a810 with addr=10.0.0.2, port=4420 00:26:26.665 [2024-11-28 19:14:47.594990] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x188a810 is same with the state(5) to be set 00:26:26.665 [2024-11-28 19:14:47.595015] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x188a810 (9): Bad file descriptor 00:26:26.665 [2024-11-28 19:14:47.595050] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:26.665 [2024-11-28 19:14:47.595069] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:26.665 [2024-11-28 19:14:47.595084] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:26.665 [2024-11-28 19:14:47.595104] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:26.665 [2024-11-28 19:14:47.596046] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:26:26.665 [2024-11-28 19:14:47.596076] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:27.604 19:14:48 -- host/discovery.sh@128 -- # get_subsystem_names 00:26:27.604 19:14:48 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:27.604 19:14:48 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:27.604 19:14:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:27.604 19:14:48 -- common/autotest_common.sh@10 -- # set +x 00:26:27.604 19:14:48 -- host/discovery.sh@59 -- # sort 00:26:27.604 19:14:48 -- host/discovery.sh@59 -- # xargs 00:26:27.604 19:14:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:27.604 19:14:48 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:26:27.604 19:14:48 -- host/discovery.sh@129 -- # get_bdev_list 00:26:27.604 19:14:48 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:27.604 19:14:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:27.604 19:14:48 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:27.604 19:14:48 -- common/autotest_common.sh@10 -- # set +x 00:26:27.604 19:14:48 -- host/discovery.sh@55 -- # sort 00:26:27.604 19:14:48 -- host/discovery.sh@55 -- # xargs 00:26:27.604 19:14:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:27.604 19:14:48 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:27.604 19:14:48 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:26:27.604 19:14:48 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:26:27.604 19:14:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:27.604 19:14:48 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:26:27.604 19:14:48 -- common/autotest_common.sh@10 -- # set +x 00:26:27.604 19:14:48 -- host/discovery.sh@63 -- # sort -n 00:26:27.604 19:14:48 -- host/discovery.sh@63 -- # xargs 00:26:27.604 19:14:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:27.604 19:14:48 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:26:27.604 19:14:48 -- host/discovery.sh@131 -- # get_notification_count 00:26:27.604 19:14:48 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:27.604 19:14:48 -- host/discovery.sh@74 -- # jq '. | length' 00:26:27.604 19:14:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:27.604 19:14:48 -- common/autotest_common.sh@10 -- # set +x 00:26:27.863 19:14:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:27.863 19:14:48 -- host/discovery.sh@74 -- # notification_count=0 00:26:27.863 19:14:48 -- host/discovery.sh@75 -- # notify_id=2 00:26:27.863 19:14:48 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:26:27.863 19:14:48 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:26:27.863 19:14:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:27.863 19:14:48 -- common/autotest_common.sh@10 -- # set +x 00:26:27.863 19:14:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:27.863 19:14:48 -- host/discovery.sh@135 -- # sleep 1 00:26:28.797 19:14:49 -- host/discovery.sh@136 -- # get_subsystem_names 00:26:28.797 19:14:49 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:26:28.797 19:14:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:28.797 19:14:49 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:26:28.797 19:14:49 -- common/autotest_common.sh@10 -- # set +x 00:26:28.797 19:14:49 -- host/discovery.sh@59 -- # sort 00:26:28.797 19:14:49 -- host/discovery.sh@59 -- # xargs 00:26:28.797 19:14:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:28.797 19:14:49 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:26:28.797 19:14:49 -- host/discovery.sh@137 -- # get_bdev_list 00:26:28.797 19:14:49 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:28.797 19:14:49 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:28.797 19:14:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:28.797 19:14:49 -- common/autotest_common.sh@10 -- # set +x 00:26:28.797 19:14:49 -- host/discovery.sh@55 -- # sort 00:26:28.797 19:14:49 -- host/discovery.sh@55 -- # xargs 00:26:28.797 19:14:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:28.797 19:14:49 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:26:28.797 19:14:49 -- host/discovery.sh@138 -- # get_notification_count 00:26:28.797 19:14:49 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:26:28.797 19:14:49 -- host/discovery.sh@74 -- # jq '. | length' 00:26:28.797 19:14:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:28.797 19:14:49 -- common/autotest_common.sh@10 -- # set +x 00:26:28.797 19:14:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:28.797 19:14:49 -- host/discovery.sh@74 -- # notification_count=2 00:26:28.797 19:14:49 -- host/discovery.sh@75 -- # notify_id=4 00:26:28.797 19:14:49 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:26:28.797 19:14:49 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:28.797 19:14:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:28.797 19:14:49 -- common/autotest_common.sh@10 -- # set +x 00:26:30.177 [2024-11-28 19:14:50.887070] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:30.177 [2024-11-28 19:14:50.887108] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:30.177 [2024-11-28 19:14:50.887131] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:30.177 [2024-11-28 19:14:51.015544] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:26:30.436 [2024-11-28 19:14:51.282225] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:30.436 [2024-11-28 19:14:51.282283] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:26:30.436 19:14:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:30.436 19:14:51 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:30.436 19:14:51 -- common/autotest_common.sh@650 -- # local es=0 00:26:30.436 19:14:51 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:30.436 19:14:51 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:30.436 19:14:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:30.436 19:14:51 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:30.436 19:14:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:30.436 19:14:51 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:30.436 19:14:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:30.436 19:14:51 -- common/autotest_common.sh@10 -- # set +x 00:26:30.436 request: 00:26:30.436 { 00:26:30.436 "name": "nvme", 00:26:30.436 "trtype": "tcp", 00:26:30.436 "traddr": "10.0.0.2", 00:26:30.436 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:30.436 "adrfam": "ipv4", 00:26:30.436 "trsvcid": "8009", 00:26:30.436 "wait_for_attach": true, 00:26:30.436 "method": "bdev_nvme_start_discovery", 00:26:30.436 "req_id": 1 00:26:30.436 } 00:26:30.436 Got JSON-RPC error response 00:26:30.436 response: 00:26:30.436 { 00:26:30.436 "code": -17, 00:26:30.436 "message": "File exists" 00:26:30.436 } 00:26:30.436 19:14:51 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:30.436 19:14:51 -- common/autotest_common.sh@653 -- # es=1 00:26:30.436 19:14:51 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:30.436 19:14:51 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:30.436 19:14:51 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:30.436 19:14:51 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:26:30.436 19:14:51 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:30.436 19:14:51 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:30.436 19:14:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:30.436 19:14:51 -- host/discovery.sh@67 -- # sort 00:26:30.436 19:14:51 -- common/autotest_common.sh@10 -- # set +x 00:26:30.436 19:14:51 -- host/discovery.sh@67 -- # xargs 00:26:30.436 19:14:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:30.436 19:14:51 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:26:30.436 19:14:51 -- host/discovery.sh@147 -- # get_bdev_list 00:26:30.436 19:14:51 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:30.436 19:14:51 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:30.436 19:14:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:30.436 19:14:51 -- host/discovery.sh@55 -- # sort 00:26:30.436 19:14:51 -- common/autotest_common.sh@10 -- # set +x 00:26:30.436 19:14:51 -- host/discovery.sh@55 -- # xargs 00:26:30.436 19:14:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:30.436 19:14:51 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:30.436 19:14:51 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:30.436 19:14:51 -- common/autotest_common.sh@650 -- # local es=0 00:26:30.436 19:14:51 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:30.436 19:14:51 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:30.436 19:14:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:30.436 19:14:51 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:30.436 19:14:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:30.436 19:14:51 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:26:30.436 19:14:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:30.436 19:14:51 -- common/autotest_common.sh@10 -- # set +x 00:26:30.436 request: 00:26:30.436 { 00:26:30.436 "name": "nvme_second", 00:26:30.436 "trtype": "tcp", 00:26:30.436 "traddr": "10.0.0.2", 00:26:30.436 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:30.436 "adrfam": "ipv4", 00:26:30.436 "trsvcid": "8009", 00:26:30.436 "wait_for_attach": true, 00:26:30.436 "method": "bdev_nvme_start_discovery", 00:26:30.436 "req_id": 1 00:26:30.436 } 00:26:30.436 Got JSON-RPC error response 00:26:30.436 response: 00:26:30.436 { 00:26:30.436 "code": -17, 00:26:30.436 "message": "File exists" 00:26:30.436 } 00:26:30.436 19:14:51 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:30.436 19:14:51 -- common/autotest_common.sh@653 -- # es=1 00:26:30.436 19:14:51 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:30.436 19:14:51 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:30.436 19:14:51 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:30.436 19:14:51 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:26:30.436 19:14:51 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:30.437 19:14:51 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:30.437 19:14:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:30.437 19:14:51 -- common/autotest_common.sh@10 -- # set +x 00:26:30.437 19:14:51 -- host/discovery.sh@67 -- # sort 00:26:30.437 19:14:51 -- host/discovery.sh@67 -- # xargs 00:26:30.437 19:14:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:30.437 19:14:51 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:26:30.437 19:14:51 -- host/discovery.sh@153 -- # get_bdev_list 00:26:30.437 19:14:51 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:30.437 19:14:51 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:26:30.437 19:14:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:30.437 19:14:51 -- host/discovery.sh@55 -- # sort 00:26:30.437 19:14:51 -- common/autotest_common.sh@10 -- # set +x 00:26:30.437 19:14:51 -- host/discovery.sh@55 -- # xargs 00:26:30.437 19:14:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:30.695 19:14:51 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:26:30.695 19:14:51 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:30.695 19:14:51 -- common/autotest_common.sh@650 -- # local es=0 00:26:30.695 19:14:51 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:30.695 19:14:51 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:26:30.695 19:14:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:30.695 19:14:51 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:26:30.695 19:14:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:26:30.695 19:14:51 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:26:30.695 19:14:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:30.695 19:14:51 -- common/autotest_common.sh@10 -- # set +x 00:26:31.632 [2024-11-28 19:14:52.494688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:31.632 [2024-11-28 19:14:52.494862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:31.632 [2024-11-28 19:14:52.494892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18ae3d0 with addr=10.0.0.2, port=8010 00:26:31.632 [2024-11-28 19:14:52.494922] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:26:31.632 [2024-11-28 19:14:52.494939] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:26:31.632 [2024-11-28 19:14:52.494962] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:26:32.567 [2024-11-28 19:14:53.496986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:32.567 [2024-11-28 19:14:53.497165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:26:32.567 [2024-11-28 19:14:53.497194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x187ad30 with addr=10.0.0.2, port=8010 00:26:32.567 [2024-11-28 19:14:53.497216] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:26:32.567 [2024-11-28 19:14:53.497231] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:26:32.567 [2024-11-28 19:14:53.497244] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:26:33.503 [2024-11-28 19:14:54.499290] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:26:33.504 request: 00:26:33.504 { 00:26:33.504 "name": "nvme_second", 00:26:33.504 "trtype": "tcp", 00:26:33.504 "traddr": "10.0.0.2", 00:26:33.504 "hostnqn": "nqn.2021-12.io.spdk:test", 00:26:33.504 "adrfam": "ipv4", 00:26:33.504 "trsvcid": "8010", 00:26:33.504 "attach_timeout_ms": 3000, 00:26:33.504 "method": "bdev_nvme_start_discovery", 00:26:33.504 "req_id": 1 00:26:33.504 } 00:26:33.504 Got JSON-RPC error response 00:26:33.504 response: 00:26:33.504 { 00:26:33.504 "code": -110, 00:26:33.504 "message": "Connection timed out" 00:26:33.504 } 00:26:33.504 19:14:54 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:26:33.504 19:14:54 -- common/autotest_common.sh@653 -- # es=1 00:26:33.504 19:14:54 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:26:33.504 19:14:54 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:26:33.504 19:14:54 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:26:33.504 19:14:54 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:26:33.504 19:14:54 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:26:33.504 19:14:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:33.504 19:14:54 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:26:33.504 19:14:54 -- common/autotest_common.sh@10 -- # set +x 00:26:33.504 19:14:54 -- host/discovery.sh@67 -- # sort 00:26:33.504 19:14:54 -- host/discovery.sh@67 -- # xargs 00:26:33.504 19:14:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:33.504 19:14:54 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:26:33.504 19:14:54 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:26:33.504 19:14:54 -- host/discovery.sh@162 -- # kill 309692 00:26:33.504 19:14:54 -- host/discovery.sh@163 -- # nvmftestfini 00:26:33.504 19:14:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:33.504 19:14:54 -- nvmf/common.sh@116 -- # sync 00:26:33.504 19:14:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:33.504 19:14:54 -- nvmf/common.sh@119 -- # set +e 00:26:33.504 19:14:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:33.504 19:14:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:33.504 rmmod nvme_tcp 00:26:33.761 rmmod nvme_fabrics 00:26:33.761 rmmod nvme_keyring 00:26:33.761 19:14:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:33.761 19:14:54 -- nvmf/common.sh@123 -- # set -e 00:26:33.761 19:14:54 -- nvmf/common.sh@124 -- # return 0 00:26:33.761 19:14:54 -- nvmf/common.sh@477 -- # '[' -n 309522 ']' 00:26:33.761 19:14:54 -- nvmf/common.sh@478 -- # killprocess 309522 00:26:33.761 19:14:54 -- common/autotest_common.sh@936 -- # '[' -z 309522 ']' 00:26:33.761 19:14:54 -- common/autotest_common.sh@940 -- # kill -0 309522 00:26:33.761 19:14:54 -- common/autotest_common.sh@941 -- # uname 00:26:33.761 19:14:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:33.761 19:14:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 309522 00:26:33.761 19:14:54 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:33.761 19:14:54 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:33.762 19:14:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 309522' 00:26:33.762 killing process with pid 309522 00:26:33.762 19:14:54 -- common/autotest_common.sh@955 -- # kill 309522 00:26:33.762 19:14:54 -- common/autotest_common.sh@960 -- # wait 309522 00:26:34.019 19:14:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:34.019 19:14:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:34.019 19:14:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:34.019 19:14:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:34.019 19:14:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:34.019 19:14:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:34.019 19:14:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:34.019 19:14:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:35.924 19:14:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:35.924 00:26:35.924 real 0m17.806s 00:26:35.924 user 0m27.504s 00:26:35.924 sys 0m3.040s 00:26:35.924 19:14:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:35.924 19:14:56 -- common/autotest_common.sh@10 -- # set +x 00:26:35.924 ************************************ 00:26:35.924 END TEST nvmf_discovery 00:26:35.924 ************************************ 00:26:35.924 19:14:56 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:26:35.924 19:14:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:35.924 19:14:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:35.924 19:14:56 -- common/autotest_common.sh@10 -- # set +x 00:26:35.924 ************************************ 00:26:35.924 START TEST nvmf_discovery_remove_ifc 00:26:35.924 ************************************ 00:26:35.924 19:14:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:26:36.182 * Looking for test storage... 00:26:36.182 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:36.182 19:14:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:36.182 19:14:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:36.182 19:14:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:36.182 19:14:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:36.182 19:14:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:36.182 19:14:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:36.182 19:14:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:36.182 19:14:57 -- scripts/common.sh@335 -- # IFS=.-: 00:26:36.182 19:14:57 -- scripts/common.sh@335 -- # read -ra ver1 00:26:36.182 19:14:57 -- scripts/common.sh@336 -- # IFS=.-: 00:26:36.182 19:14:57 -- scripts/common.sh@336 -- # read -ra ver2 00:26:36.182 19:14:57 -- scripts/common.sh@337 -- # local 'op=<' 00:26:36.182 19:14:57 -- scripts/common.sh@339 -- # ver1_l=2 00:26:36.182 19:14:57 -- scripts/common.sh@340 -- # ver2_l=1 00:26:36.182 19:14:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:36.182 19:14:57 -- scripts/common.sh@343 -- # case "$op" in 00:26:36.182 19:14:57 -- scripts/common.sh@344 -- # : 1 00:26:36.182 19:14:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:36.182 19:14:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:36.182 19:14:57 -- scripts/common.sh@364 -- # decimal 1 00:26:36.182 19:14:57 -- scripts/common.sh@352 -- # local d=1 00:26:36.182 19:14:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:36.182 19:14:57 -- scripts/common.sh@354 -- # echo 1 00:26:36.182 19:14:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:36.182 19:14:57 -- scripts/common.sh@365 -- # decimal 2 00:26:36.182 19:14:57 -- scripts/common.sh@352 -- # local d=2 00:26:36.182 19:14:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:36.182 19:14:57 -- scripts/common.sh@354 -- # echo 2 00:26:36.182 19:14:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:36.182 19:14:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:36.182 19:14:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:36.182 19:14:57 -- scripts/common.sh@367 -- # return 0 00:26:36.182 19:14:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:36.182 19:14:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:36.182 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:36.182 --rc genhtml_branch_coverage=1 00:26:36.182 --rc genhtml_function_coverage=1 00:26:36.182 --rc genhtml_legend=1 00:26:36.182 --rc geninfo_all_blocks=1 00:26:36.182 --rc geninfo_unexecuted_blocks=1 00:26:36.182 00:26:36.182 ' 00:26:36.182 19:14:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:36.182 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:36.182 --rc genhtml_branch_coverage=1 00:26:36.182 --rc genhtml_function_coverage=1 00:26:36.182 --rc genhtml_legend=1 00:26:36.182 --rc geninfo_all_blocks=1 00:26:36.182 --rc geninfo_unexecuted_blocks=1 00:26:36.182 00:26:36.182 ' 00:26:36.183 19:14:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:36.183 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:36.183 --rc genhtml_branch_coverage=1 00:26:36.183 --rc genhtml_function_coverage=1 00:26:36.183 --rc genhtml_legend=1 00:26:36.183 --rc geninfo_all_blocks=1 00:26:36.183 --rc geninfo_unexecuted_blocks=1 00:26:36.183 00:26:36.183 ' 00:26:36.183 19:14:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:36.183 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:36.183 --rc genhtml_branch_coverage=1 00:26:36.183 --rc genhtml_function_coverage=1 00:26:36.183 --rc genhtml_legend=1 00:26:36.183 --rc geninfo_all_blocks=1 00:26:36.183 --rc geninfo_unexecuted_blocks=1 00:26:36.183 00:26:36.183 ' 00:26:36.183 19:14:57 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:36.183 19:14:57 -- nvmf/common.sh@7 -- # uname -s 00:26:36.183 19:14:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:36.183 19:14:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:36.183 19:14:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:36.183 19:14:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:36.183 19:14:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:36.183 19:14:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:36.183 19:14:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:36.183 19:14:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:36.183 19:14:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:36.183 19:14:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:36.183 19:14:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:36.183 19:14:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:36.183 19:14:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:36.183 19:14:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:36.183 19:14:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:36.183 19:14:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:36.183 19:14:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:36.183 19:14:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:36.183 19:14:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:36.183 19:14:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:36.183 19:14:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:36.183 19:14:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:36.183 19:14:57 -- paths/export.sh@5 -- # export PATH 00:26:36.183 19:14:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:36.183 19:14:57 -- nvmf/common.sh@46 -- # : 0 00:26:36.183 19:14:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:36.183 19:14:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:36.183 19:14:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:36.183 19:14:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:36.183 19:14:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:36.183 19:14:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:36.183 19:14:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:36.183 19:14:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:36.183 19:14:57 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:26:36.183 19:14:57 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:26:36.183 19:14:57 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:26:36.183 19:14:57 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:26:36.183 19:14:57 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:26:36.183 19:14:57 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:26:36.183 19:14:57 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:26:36.183 19:14:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:36.183 19:14:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:36.183 19:14:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:36.183 19:14:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:36.183 19:14:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:36.183 19:14:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:36.183 19:14:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:36.183 19:14:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:36.183 19:14:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:36.183 19:14:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:36.183 19:14:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:36.183 19:14:57 -- common/autotest_common.sh@10 -- # set +x 00:26:38.711 19:14:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:38.711 19:14:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:38.711 19:14:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:38.711 19:14:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:38.711 19:14:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:38.711 19:14:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:38.711 19:14:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:38.711 19:14:59 -- nvmf/common.sh@294 -- # net_devs=() 00:26:38.711 19:14:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:38.711 19:14:59 -- nvmf/common.sh@295 -- # e810=() 00:26:38.711 19:14:59 -- nvmf/common.sh@295 -- # local -ga e810 00:26:38.711 19:14:59 -- nvmf/common.sh@296 -- # x722=() 00:26:38.711 19:14:59 -- nvmf/common.sh@296 -- # local -ga x722 00:26:38.711 19:14:59 -- nvmf/common.sh@297 -- # mlx=() 00:26:38.711 19:14:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:38.711 19:14:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:38.711 19:14:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:38.711 19:14:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:38.711 19:14:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:38.711 19:14:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:38.711 19:14:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:38.711 19:14:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:38.711 19:14:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:38.711 19:14:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:38.711 19:14:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:38.711 19:14:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:38.711 19:14:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:38.711 19:14:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:38.711 19:14:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:38.711 19:14:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:38.711 19:14:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:38.711 19:14:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:38.711 19:14:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:38.711 19:14:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:38.711 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:38.711 19:14:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:38.711 19:14:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:38.711 19:14:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:38.711 19:14:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:38.711 19:14:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:38.711 19:14:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:38.711 19:14:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:38.711 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:38.711 19:14:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:38.711 19:14:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:38.711 19:14:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:38.711 19:14:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:38.711 19:14:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:38.711 19:14:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:38.711 19:14:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:38.711 19:14:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:38.711 19:14:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:38.711 19:14:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:38.711 19:14:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:38.712 19:14:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:38.712 19:14:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:38.712 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:38.712 19:14:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:38.712 19:14:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:38.712 19:14:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:38.712 19:14:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:38.712 19:14:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:38.712 19:14:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:38.712 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:38.712 19:14:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:38.712 19:14:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:38.712 19:14:59 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:38.712 19:14:59 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:38.712 19:14:59 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:38.712 19:14:59 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:38.712 19:14:59 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:38.712 19:14:59 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:38.712 19:14:59 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:38.712 19:14:59 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:38.712 19:14:59 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:38.712 19:14:59 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:38.712 19:14:59 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:38.712 19:14:59 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:38.712 19:14:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:38.712 19:14:59 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:38.712 19:14:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:38.712 19:14:59 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:38.712 19:14:59 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:38.712 19:14:59 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:38.712 19:14:59 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:38.712 19:14:59 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:38.712 19:14:59 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:38.712 19:14:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:38.712 19:14:59 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:38.712 19:14:59 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:38.712 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:38.712 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.239 ms 00:26:38.712 00:26:38.712 --- 10.0.0.2 ping statistics --- 00:26:38.712 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:38.712 rtt min/avg/max/mdev = 0.239/0.239/0.239/0.000 ms 00:26:38.712 19:14:59 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:38.712 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:38.712 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.141 ms 00:26:38.712 00:26:38.712 --- 10.0.0.1 ping statistics --- 00:26:38.712 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:38.712 rtt min/avg/max/mdev = 0.141/0.141/0.141/0.000 ms 00:26:38.712 19:14:59 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:38.712 19:14:59 -- nvmf/common.sh@410 -- # return 0 00:26:38.712 19:14:59 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:38.712 19:14:59 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:38.712 19:14:59 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:38.712 19:14:59 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:38.712 19:14:59 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:38.712 19:14:59 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:38.712 19:14:59 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:38.712 19:14:59 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:26:38.712 19:14:59 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:38.712 19:14:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:38.712 19:14:59 -- common/autotest_common.sh@10 -- # set +x 00:26:38.712 19:14:59 -- nvmf/common.sh@469 -- # nvmfpid=313259 00:26:38.712 19:14:59 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:26:38.712 19:14:59 -- nvmf/common.sh@470 -- # waitforlisten 313259 00:26:38.712 19:14:59 -- common/autotest_common.sh@829 -- # '[' -z 313259 ']' 00:26:38.712 19:14:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:38.712 19:14:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:38.712 19:14:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:38.712 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:38.712 19:14:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:38.712 19:14:59 -- common/autotest_common.sh@10 -- # set +x 00:26:38.712 [2024-11-28 19:14:59.330619] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:38.712 [2024-11-28 19:14:59.330699] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:38.712 EAL: No free 2048 kB hugepages reported on node 1 00:26:38.712 [2024-11-28 19:14:59.396084] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:38.712 [2024-11-28 19:14:59.509384] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:38.712 [2024-11-28 19:14:59.509556] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:38.712 [2024-11-28 19:14:59.509575] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:38.712 [2024-11-28 19:14:59.509590] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:38.712 [2024-11-28 19:14:59.509621] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:39.647 19:15:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:39.647 19:15:00 -- common/autotest_common.sh@862 -- # return 0 00:26:39.647 19:15:00 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:39.647 19:15:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:39.647 19:15:00 -- common/autotest_common.sh@10 -- # set +x 00:26:39.647 19:15:00 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:39.647 19:15:00 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:26:39.647 19:15:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:39.647 19:15:00 -- common/autotest_common.sh@10 -- # set +x 00:26:39.647 [2024-11-28 19:15:00.415812] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:39.647 [2024-11-28 19:15:00.423987] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:26:39.647 null0 00:26:39.647 [2024-11-28 19:15:00.455965] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:39.647 19:15:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:39.647 19:15:00 -- host/discovery_remove_ifc.sh@59 -- # hostpid=313453 00:26:39.647 19:15:00 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:26:39.647 19:15:00 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 313453 /tmp/host.sock 00:26:39.647 19:15:00 -- common/autotest_common.sh@829 -- # '[' -z 313453 ']' 00:26:39.647 19:15:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:26:39.647 19:15:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:39.647 19:15:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:26:39.647 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:26:39.647 19:15:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:39.647 19:15:00 -- common/autotest_common.sh@10 -- # set +x 00:26:39.647 [2024-11-28 19:15:00.518161] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:39.647 [2024-11-28 19:15:00.518263] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid313453 ] 00:26:39.647 EAL: No free 2048 kB hugepages reported on node 1 00:26:39.647 [2024-11-28 19:15:00.582069] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:39.905 [2024-11-28 19:15:00.699728] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:39.905 [2024-11-28 19:15:00.699901] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:39.905 19:15:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:39.905 19:15:00 -- common/autotest_common.sh@862 -- # return 0 00:26:39.905 19:15:00 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:39.906 19:15:00 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:26:39.906 19:15:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:39.906 19:15:00 -- common/autotest_common.sh@10 -- # set +x 00:26:39.906 19:15:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:39.906 19:15:00 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:26:39.906 19:15:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:39.906 19:15:00 -- common/autotest_common.sh@10 -- # set +x 00:26:39.906 19:15:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:39.906 19:15:00 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:26:39.906 19:15:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:39.906 19:15:00 -- common/autotest_common.sh@10 -- # set +x 00:26:41.280 [2024-11-28 19:15:01.904536] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:41.280 [2024-11-28 19:15:01.904572] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:41.280 [2024-11-28 19:15:01.904598] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:41.280 [2024-11-28 19:15:01.990885] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:26:41.280 [2024-11-28 19:15:02.054356] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:41.280 [2024-11-28 19:15:02.054443] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:41.280 [2024-11-28 19:15:02.054483] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:41.280 [2024-11-28 19:15:02.054505] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:26:41.280 [2024-11-28 19:15:02.054534] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:41.280 19:15:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:41.280 19:15:02 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:26:41.280 19:15:02 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:41.280 19:15:02 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:41.280 19:15:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:41.280 19:15:02 -- common/autotest_common.sh@10 -- # set +x 00:26:41.280 19:15:02 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:41.280 19:15:02 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:41.280 19:15:02 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:41.280 [2024-11-28 19:15:02.061966] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x164dd40 was disconnected and freed. delete nvme_qpair. 00:26:41.280 19:15:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:41.280 19:15:02 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:26:41.280 19:15:02 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:26:41.280 19:15:02 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:26:41.280 19:15:02 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:26:41.280 19:15:02 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:41.280 19:15:02 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:41.280 19:15:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:41.280 19:15:02 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:41.280 19:15:02 -- common/autotest_common.sh@10 -- # set +x 00:26:41.280 19:15:02 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:41.280 19:15:02 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:41.280 19:15:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:41.280 19:15:02 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:41.280 19:15:02 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:42.214 19:15:03 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:42.214 19:15:03 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:42.214 19:15:03 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:42.214 19:15:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:42.214 19:15:03 -- common/autotest_common.sh@10 -- # set +x 00:26:42.214 19:15:03 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:42.214 19:15:03 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:42.214 19:15:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:42.214 19:15:03 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:42.214 19:15:03 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:43.587 19:15:04 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:43.587 19:15:04 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:43.587 19:15:04 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:43.587 19:15:04 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:43.587 19:15:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:43.587 19:15:04 -- common/autotest_common.sh@10 -- # set +x 00:26:43.587 19:15:04 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:43.587 19:15:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:43.587 19:15:04 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:43.587 19:15:04 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:44.520 19:15:05 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:44.520 19:15:05 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:44.520 19:15:05 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:44.520 19:15:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:44.520 19:15:05 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:44.520 19:15:05 -- common/autotest_common.sh@10 -- # set +x 00:26:44.520 19:15:05 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:44.520 19:15:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:44.520 19:15:05 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:44.520 19:15:05 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:45.454 19:15:06 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:45.454 19:15:06 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:45.454 19:15:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:45.454 19:15:06 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:45.454 19:15:06 -- common/autotest_common.sh@10 -- # set +x 00:26:45.454 19:15:06 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:45.454 19:15:06 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:45.454 19:15:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:45.454 19:15:06 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:45.454 19:15:06 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:46.389 19:15:07 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:46.389 19:15:07 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:46.389 19:15:07 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:46.389 19:15:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:46.389 19:15:07 -- common/autotest_common.sh@10 -- # set +x 00:26:46.389 19:15:07 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:46.389 19:15:07 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:46.389 19:15:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:46.389 19:15:07 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:46.389 19:15:07 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:46.647 [2024-11-28 19:15:07.495713] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:26:46.647 [2024-11-28 19:15:07.495777] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:46.647 [2024-11-28 19:15:07.495802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:46.647 [2024-11-28 19:15:07.495822] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:46.648 [2024-11-28 19:15:07.495837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:46.648 [2024-11-28 19:15:07.495852] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:46.648 [2024-11-28 19:15:07.495867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:46.648 [2024-11-28 19:15:07.495882] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:46.648 [2024-11-28 19:15:07.495897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:46.648 [2024-11-28 19:15:07.495912] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:46.648 [2024-11-28 19:15:07.495927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:46.648 [2024-11-28 19:15:07.495942] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1614430 is same with the state(5) to be set 00:26:46.648 [2024-11-28 19:15:07.505726] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1614430 (9): Bad file descriptor 00:26:46.648 [2024-11-28 19:15:07.515783] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:26:47.583 19:15:08 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:47.583 19:15:08 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:47.583 19:15:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:47.583 19:15:08 -- common/autotest_common.sh@10 -- # set +x 00:26:47.583 19:15:08 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:47.583 19:15:08 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:47.583 19:15:08 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:47.583 [2024-11-28 19:15:08.522455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:48.519 [2024-11-28 19:15:09.546462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:26:48.519 [2024-11-28 19:15:09.546531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1614430 with addr=10.0.0.2, port=4420 00:26:48.519 [2024-11-28 19:15:09.546559] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1614430 is same with the state(5) to be set 00:26:48.519 [2024-11-28 19:15:09.546595] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:26:48.519 [2024-11-28 19:15:09.546613] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:26:48.519 [2024-11-28 19:15:09.546627] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:26:48.519 [2024-11-28 19:15:09.546643] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:26:48.519 [2024-11-28 19:15:09.547075] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1614430 (9): Bad file descriptor 00:26:48.519 [2024-11-28 19:15:09.547117] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:26:48.519 [2024-11-28 19:15:09.547155] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:26:48.519 [2024-11-28 19:15:09.547194] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.519 [2024-11-28 19:15:09.547217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.519 [2024-11-28 19:15:09.547236] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.519 [2024-11-28 19:15:09.547251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.519 [2024-11-28 19:15:09.547266] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.519 [2024-11-28 19:15:09.547281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.519 [2024-11-28 19:15:09.547296] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.519 [2024-11-28 19:15:09.547310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.519 [2024-11-28 19:15:09.547326] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:26:48.519 [2024-11-28 19:15:09.547340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:48.519 [2024-11-28 19:15:09.547354] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:26:48.519 [2024-11-28 19:15:09.547596] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1614840 (9): Bad file descriptor 00:26:48.519 [2024-11-28 19:15:09.548615] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:26:48.519 [2024-11-28 19:15:09.548638] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:26:48.519 19:15:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:48.519 19:15:09 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:26:48.519 19:15:09 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:49.892 19:15:10 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:49.892 19:15:10 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:49.892 19:15:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:49.892 19:15:10 -- common/autotest_common.sh@10 -- # set +x 00:26:49.892 19:15:10 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:49.892 19:15:10 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:49.892 19:15:10 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:49.892 19:15:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:49.892 19:15:10 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:26:49.892 19:15:10 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:49.892 19:15:10 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:49.892 19:15:10 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:26:49.892 19:15:10 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:49.892 19:15:10 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:49.892 19:15:10 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:49.892 19:15:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:49.892 19:15:10 -- common/autotest_common.sh@10 -- # set +x 00:26:49.892 19:15:10 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:49.892 19:15:10 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:49.892 19:15:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:49.892 19:15:10 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:49.892 19:15:10 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:50.824 [2024-11-28 19:15:11.559051] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:26:50.824 [2024-11-28 19:15:11.559080] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:26:50.824 [2024-11-28 19:15:11.559105] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:26:50.824 [2024-11-28 19:15:11.645374] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:26:50.824 19:15:11 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:50.824 19:15:11 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:50.824 19:15:11 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:50.824 19:15:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:50.824 19:15:11 -- common/autotest_common.sh@10 -- # set +x 00:26:50.824 19:15:11 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:50.824 19:15:11 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:50.824 19:15:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:50.824 19:15:11 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:26:50.824 19:15:11 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:26:50.824 [2024-11-28 19:15:11.863651] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:26:50.824 [2024-11-28 19:15:11.863721] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:26:50.824 [2024-11-28 19:15:11.863759] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:26:50.824 [2024-11-28 19:15:11.863782] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:26:50.824 [2024-11-28 19:15:11.863796] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:26:50.824 [2024-11-28 19:15:11.867969] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x1622ef0 was disconnected and freed. delete nvme_qpair. 00:26:51.757 19:15:12 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:26:51.757 19:15:12 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:26:51.757 19:15:12 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:26:51.757 19:15:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:51.757 19:15:12 -- host/discovery_remove_ifc.sh@29 -- # sort 00:26:51.757 19:15:12 -- common/autotest_common.sh@10 -- # set +x 00:26:51.757 19:15:12 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:26:51.757 19:15:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:51.757 19:15:12 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:26:51.757 19:15:12 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:26:51.757 19:15:12 -- host/discovery_remove_ifc.sh@90 -- # killprocess 313453 00:26:51.757 19:15:12 -- common/autotest_common.sh@936 -- # '[' -z 313453 ']' 00:26:51.757 19:15:12 -- common/autotest_common.sh@940 -- # kill -0 313453 00:26:51.757 19:15:12 -- common/autotest_common.sh@941 -- # uname 00:26:51.757 19:15:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:51.757 19:15:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 313453 00:26:52.017 19:15:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:52.017 19:15:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:52.017 19:15:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 313453' 00:26:52.017 killing process with pid 313453 00:26:52.017 19:15:12 -- common/autotest_common.sh@955 -- # kill 313453 00:26:52.017 19:15:12 -- common/autotest_common.sh@960 -- # wait 313453 00:26:52.275 19:15:13 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:26:52.275 19:15:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:52.275 19:15:13 -- nvmf/common.sh@116 -- # sync 00:26:52.275 19:15:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:52.275 19:15:13 -- nvmf/common.sh@119 -- # set +e 00:26:52.275 19:15:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:52.275 19:15:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:52.275 rmmod nvme_tcp 00:26:52.275 rmmod nvme_fabrics 00:26:52.275 rmmod nvme_keyring 00:26:52.275 19:15:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:52.275 19:15:13 -- nvmf/common.sh@123 -- # set -e 00:26:52.275 19:15:13 -- nvmf/common.sh@124 -- # return 0 00:26:52.275 19:15:13 -- nvmf/common.sh@477 -- # '[' -n 313259 ']' 00:26:52.275 19:15:13 -- nvmf/common.sh@478 -- # killprocess 313259 00:26:52.275 19:15:13 -- common/autotest_common.sh@936 -- # '[' -z 313259 ']' 00:26:52.275 19:15:13 -- common/autotest_common.sh@940 -- # kill -0 313259 00:26:52.275 19:15:13 -- common/autotest_common.sh@941 -- # uname 00:26:52.275 19:15:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:52.275 19:15:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 313259 00:26:52.275 19:15:13 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:26:52.275 19:15:13 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:26:52.275 19:15:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 313259' 00:26:52.275 killing process with pid 313259 00:26:52.275 19:15:13 -- common/autotest_common.sh@955 -- # kill 313259 00:26:52.275 19:15:13 -- common/autotest_common.sh@960 -- # wait 313259 00:26:52.534 19:15:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:52.534 19:15:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:52.534 19:15:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:52.534 19:15:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:52.534 19:15:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:52.534 19:15:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:52.534 19:15:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:52.534 19:15:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:54.433 19:15:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:54.691 00:26:54.691 real 0m18.519s 00:26:54.691 user 0m25.661s 00:26:54.691 sys 0m2.996s 00:26:54.691 19:15:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:54.691 19:15:15 -- common/autotest_common.sh@10 -- # set +x 00:26:54.691 ************************************ 00:26:54.691 END TEST nvmf_discovery_remove_ifc 00:26:54.691 ************************************ 00:26:54.691 19:15:15 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:26:54.692 19:15:15 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:54.692 19:15:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:54.692 19:15:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:54.692 19:15:15 -- common/autotest_common.sh@10 -- # set +x 00:26:54.692 ************************************ 00:26:54.692 START TEST nvmf_digest 00:26:54.692 ************************************ 00:26:54.692 19:15:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:26:54.692 * Looking for test storage... 00:26:54.692 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:54.692 19:15:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:54.692 19:15:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:54.692 19:15:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:54.692 19:15:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:54.692 19:15:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:54.692 19:15:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:54.692 19:15:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:54.692 19:15:15 -- scripts/common.sh@335 -- # IFS=.-: 00:26:54.692 19:15:15 -- scripts/common.sh@335 -- # read -ra ver1 00:26:54.692 19:15:15 -- scripts/common.sh@336 -- # IFS=.-: 00:26:54.692 19:15:15 -- scripts/common.sh@336 -- # read -ra ver2 00:26:54.692 19:15:15 -- scripts/common.sh@337 -- # local 'op=<' 00:26:54.692 19:15:15 -- scripts/common.sh@339 -- # ver1_l=2 00:26:54.692 19:15:15 -- scripts/common.sh@340 -- # ver2_l=1 00:26:54.692 19:15:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:54.692 19:15:15 -- scripts/common.sh@343 -- # case "$op" in 00:26:54.692 19:15:15 -- scripts/common.sh@344 -- # : 1 00:26:54.692 19:15:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:54.692 19:15:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:54.692 19:15:15 -- scripts/common.sh@364 -- # decimal 1 00:26:54.692 19:15:15 -- scripts/common.sh@352 -- # local d=1 00:26:54.692 19:15:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:54.692 19:15:15 -- scripts/common.sh@354 -- # echo 1 00:26:54.692 19:15:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:54.692 19:15:15 -- scripts/common.sh@365 -- # decimal 2 00:26:54.692 19:15:15 -- scripts/common.sh@352 -- # local d=2 00:26:54.692 19:15:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:54.692 19:15:15 -- scripts/common.sh@354 -- # echo 2 00:26:54.692 19:15:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:54.692 19:15:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:54.692 19:15:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:54.692 19:15:15 -- scripts/common.sh@367 -- # return 0 00:26:54.692 19:15:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:54.692 19:15:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:54.692 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:54.692 --rc genhtml_branch_coverage=1 00:26:54.692 --rc genhtml_function_coverage=1 00:26:54.692 --rc genhtml_legend=1 00:26:54.692 --rc geninfo_all_blocks=1 00:26:54.692 --rc geninfo_unexecuted_blocks=1 00:26:54.692 00:26:54.692 ' 00:26:54.692 19:15:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:54.692 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:54.692 --rc genhtml_branch_coverage=1 00:26:54.692 --rc genhtml_function_coverage=1 00:26:54.692 --rc genhtml_legend=1 00:26:54.692 --rc geninfo_all_blocks=1 00:26:54.692 --rc geninfo_unexecuted_blocks=1 00:26:54.692 00:26:54.692 ' 00:26:54.692 19:15:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:54.692 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:54.692 --rc genhtml_branch_coverage=1 00:26:54.692 --rc genhtml_function_coverage=1 00:26:54.692 --rc genhtml_legend=1 00:26:54.692 --rc geninfo_all_blocks=1 00:26:54.692 --rc geninfo_unexecuted_blocks=1 00:26:54.692 00:26:54.692 ' 00:26:54.692 19:15:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:54.692 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:54.692 --rc genhtml_branch_coverage=1 00:26:54.692 --rc genhtml_function_coverage=1 00:26:54.692 --rc genhtml_legend=1 00:26:54.692 --rc geninfo_all_blocks=1 00:26:54.692 --rc geninfo_unexecuted_blocks=1 00:26:54.692 00:26:54.692 ' 00:26:54.692 19:15:15 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:54.692 19:15:15 -- nvmf/common.sh@7 -- # uname -s 00:26:54.692 19:15:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:54.692 19:15:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:54.692 19:15:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:54.692 19:15:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:54.692 19:15:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:54.692 19:15:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:54.692 19:15:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:54.692 19:15:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:54.692 19:15:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:54.692 19:15:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:54.692 19:15:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:54.692 19:15:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:54.692 19:15:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:54.692 19:15:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:54.692 19:15:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:54.692 19:15:15 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:54.692 19:15:15 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:54.692 19:15:15 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:54.692 19:15:15 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:54.692 19:15:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:54.692 19:15:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:54.692 19:15:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:54.692 19:15:15 -- paths/export.sh@5 -- # export PATH 00:26:54.692 19:15:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:54.692 19:15:15 -- nvmf/common.sh@46 -- # : 0 00:26:54.692 19:15:15 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:54.692 19:15:15 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:54.692 19:15:15 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:54.692 19:15:15 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:54.692 19:15:15 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:54.692 19:15:15 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:54.692 19:15:15 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:54.692 19:15:15 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:54.692 19:15:15 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:26:54.692 19:15:15 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:26:54.692 19:15:15 -- host/digest.sh@16 -- # runtime=2 00:26:54.692 19:15:15 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:26:54.692 19:15:15 -- host/digest.sh@132 -- # nvmftestinit 00:26:54.692 19:15:15 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:54.692 19:15:15 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:54.692 19:15:15 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:54.692 19:15:15 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:54.692 19:15:15 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:54.692 19:15:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:54.692 19:15:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:54.692 19:15:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:54.692 19:15:15 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:54.692 19:15:15 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:54.692 19:15:15 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:54.692 19:15:15 -- common/autotest_common.sh@10 -- # set +x 00:26:56.592 19:15:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:56.592 19:15:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:56.592 19:15:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:56.592 19:15:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:56.592 19:15:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:56.592 19:15:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:56.592 19:15:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:56.592 19:15:17 -- nvmf/common.sh@294 -- # net_devs=() 00:26:56.592 19:15:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:56.592 19:15:17 -- nvmf/common.sh@295 -- # e810=() 00:26:56.592 19:15:17 -- nvmf/common.sh@295 -- # local -ga e810 00:26:56.592 19:15:17 -- nvmf/common.sh@296 -- # x722=() 00:26:56.592 19:15:17 -- nvmf/common.sh@296 -- # local -ga x722 00:26:56.592 19:15:17 -- nvmf/common.sh@297 -- # mlx=() 00:26:56.592 19:15:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:56.592 19:15:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:56.592 19:15:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:56.592 19:15:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:56.592 19:15:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:56.592 19:15:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:56.592 19:15:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:56.592 19:15:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:56.592 19:15:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:56.592 19:15:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:56.592 19:15:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:56.592 19:15:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:56.592 19:15:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:56.592 19:15:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:56.592 19:15:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:56.592 19:15:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:56.593 19:15:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:56.593 19:15:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:56.593 19:15:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:56.593 19:15:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:56.593 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:56.593 19:15:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:56.593 19:15:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:56.593 19:15:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:56.593 19:15:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:56.593 19:15:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:56.593 19:15:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:56.593 19:15:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:56.593 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:56.593 19:15:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:56.593 19:15:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:56.593 19:15:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:56.593 19:15:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:56.593 19:15:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:56.593 19:15:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:56.593 19:15:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:56.593 19:15:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:56.593 19:15:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:56.593 19:15:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:56.593 19:15:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:56.593 19:15:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:56.593 19:15:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:56.593 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:56.593 19:15:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:56.593 19:15:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:56.593 19:15:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:56.593 19:15:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:56.593 19:15:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:56.593 19:15:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:56.593 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:56.593 19:15:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:56.593 19:15:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:56.593 19:15:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:56.593 19:15:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:56.593 19:15:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:56.593 19:15:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:56.593 19:15:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:56.593 19:15:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:56.593 19:15:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:56.593 19:15:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:56.593 19:15:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:56.593 19:15:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:56.593 19:15:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:56.593 19:15:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:56.593 19:15:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:56.593 19:15:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:56.593 19:15:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:56.593 19:15:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:56.593 19:15:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:56.851 19:15:17 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:56.851 19:15:17 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:56.851 19:15:17 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:56.852 19:15:17 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:56.852 19:15:17 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:56.852 19:15:17 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:56.852 19:15:17 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:56.852 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:56.852 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.350 ms 00:26:56.852 00:26:56.852 --- 10.0.0.2 ping statistics --- 00:26:56.852 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:56.852 rtt min/avg/max/mdev = 0.350/0.350/0.350/0.000 ms 00:26:56.852 19:15:17 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:56.852 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:56.852 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.119 ms 00:26:56.852 00:26:56.852 --- 10.0.0.1 ping statistics --- 00:26:56.852 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:56.852 rtt min/avg/max/mdev = 0.119/0.119/0.119/0.000 ms 00:26:56.852 19:15:17 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:56.852 19:15:17 -- nvmf/common.sh@410 -- # return 0 00:26:56.852 19:15:17 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:56.852 19:15:17 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:56.852 19:15:17 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:56.852 19:15:17 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:56.852 19:15:17 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:56.852 19:15:17 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:56.852 19:15:17 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:56.852 19:15:17 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:26:56.852 19:15:17 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:26:56.852 19:15:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:26:56.852 19:15:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:56.852 19:15:17 -- common/autotest_common.sh@10 -- # set +x 00:26:56.852 ************************************ 00:26:56.852 START TEST nvmf_digest_clean 00:26:56.852 ************************************ 00:26:56.852 19:15:17 -- common/autotest_common.sh@1114 -- # run_digest 00:26:56.852 19:15:17 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:26:56.852 19:15:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:56.852 19:15:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:56.852 19:15:17 -- common/autotest_common.sh@10 -- # set +x 00:26:56.852 19:15:17 -- nvmf/common.sh@469 -- # nvmfpid=317557 00:26:56.852 19:15:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:26:56.852 19:15:17 -- nvmf/common.sh@470 -- # waitforlisten 317557 00:26:56.852 19:15:17 -- common/autotest_common.sh@829 -- # '[' -z 317557 ']' 00:26:56.852 19:15:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:56.852 19:15:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:56.852 19:15:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:56.852 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:56.852 19:15:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:56.852 19:15:17 -- common/autotest_common.sh@10 -- # set +x 00:26:56.852 [2024-11-28 19:15:17.793096] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:56.852 [2024-11-28 19:15:17.793166] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:56.852 EAL: No free 2048 kB hugepages reported on node 1 00:26:56.852 [2024-11-28 19:15:17.863122] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:57.111 [2024-11-28 19:15:17.971255] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:57.111 [2024-11-28 19:15:17.971449] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:57.111 [2024-11-28 19:15:17.971469] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:57.111 [2024-11-28 19:15:17.971489] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:57.111 [2024-11-28 19:15:17.971526] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:57.111 19:15:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:57.111 19:15:18 -- common/autotest_common.sh@862 -- # return 0 00:26:57.111 19:15:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:57.111 19:15:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:57.111 19:15:18 -- common/autotest_common.sh@10 -- # set +x 00:26:57.111 19:15:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:57.111 19:15:18 -- host/digest.sh@120 -- # common_target_config 00:26:57.111 19:15:18 -- host/digest.sh@43 -- # rpc_cmd 00:26:57.111 19:15:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:57.111 19:15:18 -- common/autotest_common.sh@10 -- # set +x 00:26:57.111 null0 00:26:57.369 [2024-11-28 19:15:18.159362] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:57.369 [2024-11-28 19:15:18.183586] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:57.369 19:15:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:57.369 19:15:18 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:26:57.369 19:15:18 -- host/digest.sh@77 -- # local rw bs qd 00:26:57.369 19:15:18 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:26:57.369 19:15:18 -- host/digest.sh@80 -- # rw=randread 00:26:57.369 19:15:18 -- host/digest.sh@80 -- # bs=4096 00:26:57.369 19:15:18 -- host/digest.sh@80 -- # qd=128 00:26:57.369 19:15:18 -- host/digest.sh@82 -- # bperfpid=317703 00:26:57.369 19:15:18 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:26:57.369 19:15:18 -- host/digest.sh@83 -- # waitforlisten 317703 /var/tmp/bperf.sock 00:26:57.369 19:15:18 -- common/autotest_common.sh@829 -- # '[' -z 317703 ']' 00:26:57.369 19:15:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:26:57.369 19:15:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:57.369 19:15:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:26:57.369 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:26:57.369 19:15:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:57.369 19:15:18 -- common/autotest_common.sh@10 -- # set +x 00:26:57.369 [2024-11-28 19:15:18.226259] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:57.369 [2024-11-28 19:15:18.226333] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid317703 ] 00:26:57.369 EAL: No free 2048 kB hugepages reported on node 1 00:26:57.369 [2024-11-28 19:15:18.287140] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:26:57.369 [2024-11-28 19:15:18.401548] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:57.628 19:15:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:57.628 19:15:18 -- common/autotest_common.sh@862 -- # return 0 00:26:57.628 19:15:18 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:26:57.628 19:15:18 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:26:57.628 19:15:18 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:26:57.887 19:15:18 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:57.887 19:15:18 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:26:58.146 nvme0n1 00:26:58.405 19:15:19 -- host/digest.sh@91 -- # bperf_py perform_tests 00:26:58.405 19:15:19 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:26:58.405 Running I/O for 2 seconds... 00:27:00.936 00:27:00.936 Latency(us) 00:27:00.936 [2024-11-28T18:15:21.984Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:00.936 [2024-11-28T18:15:21.984Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:27:00.936 nvme0n1 : 2.04 16468.91 64.33 0.00 0.00 7610.04 2718.53 44079.03 00:27:00.936 [2024-11-28T18:15:21.984Z] =================================================================================================================== 00:27:00.936 [2024-11-28T18:15:21.984Z] Total : 16468.91 64.33 0.00 0.00 7610.04 2718.53 44079.03 00:27:00.936 0 00:27:00.936 19:15:21 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:27:00.936 19:15:21 -- host/digest.sh@92 -- # get_accel_stats 00:27:00.936 19:15:21 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:27:00.936 19:15:21 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:27:00.936 19:15:21 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:27:00.936 | select(.opcode=="crc32c") 00:27:00.936 | "\(.module_name) \(.executed)"' 00:27:00.936 19:15:21 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:27:00.936 19:15:21 -- host/digest.sh@93 -- # exp_module=software 00:27:00.936 19:15:21 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:27:00.936 19:15:21 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:27:00.936 19:15:21 -- host/digest.sh@97 -- # killprocess 317703 00:27:00.936 19:15:21 -- common/autotest_common.sh@936 -- # '[' -z 317703 ']' 00:27:00.936 19:15:21 -- common/autotest_common.sh@940 -- # kill -0 317703 00:27:00.936 19:15:21 -- common/autotest_common.sh@941 -- # uname 00:27:00.936 19:15:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:00.936 19:15:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 317703 00:27:00.936 19:15:21 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:00.937 19:15:21 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:00.937 19:15:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 317703' 00:27:00.937 killing process with pid 317703 00:27:00.937 19:15:21 -- common/autotest_common.sh@955 -- # kill 317703 00:27:00.937 Received shutdown signal, test time was about 2.000000 seconds 00:27:00.937 00:27:00.937 Latency(us) 00:27:00.937 [2024-11-28T18:15:21.985Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:00.937 [2024-11-28T18:15:21.985Z] =================================================================================================================== 00:27:00.937 [2024-11-28T18:15:21.985Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:00.937 19:15:21 -- common/autotest_common.sh@960 -- # wait 317703 00:27:00.937 19:15:21 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:27:00.937 19:15:21 -- host/digest.sh@77 -- # local rw bs qd 00:27:00.937 19:15:21 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:27:00.937 19:15:21 -- host/digest.sh@80 -- # rw=randread 00:27:00.937 19:15:21 -- host/digest.sh@80 -- # bs=131072 00:27:00.937 19:15:21 -- host/digest.sh@80 -- # qd=16 00:27:00.937 19:15:21 -- host/digest.sh@82 -- # bperfpid=318119 00:27:00.937 19:15:21 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:27:00.937 19:15:21 -- host/digest.sh@83 -- # waitforlisten 318119 /var/tmp/bperf.sock 00:27:00.937 19:15:21 -- common/autotest_common.sh@829 -- # '[' -z 318119 ']' 00:27:00.937 19:15:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:00.937 19:15:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:00.937 19:15:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:00.937 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:00.937 19:15:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:00.937 19:15:21 -- common/autotest_common.sh@10 -- # set +x 00:27:00.937 [2024-11-28 19:15:21.981176] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:00.937 [2024-11-28 19:15:21.981251] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid318119 ] 00:27:00.937 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:00.937 Zero copy mechanism will not be used. 00:27:01.195 EAL: No free 2048 kB hugepages reported on node 1 00:27:01.195 [2024-11-28 19:15:22.042899] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:01.195 [2024-11-28 19:15:22.155956] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:01.195 19:15:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:01.195 19:15:22 -- common/autotest_common.sh@862 -- # return 0 00:27:01.195 19:15:22 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:27:01.195 19:15:22 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:27:01.195 19:15:22 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:27:01.766 19:15:22 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:01.766 19:15:22 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:02.024 nvme0n1 00:27:02.024 19:15:22 -- host/digest.sh@91 -- # bperf_py perform_tests 00:27:02.024 19:15:22 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:02.284 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:02.284 Zero copy mechanism will not be used. 00:27:02.284 Running I/O for 2 seconds... 00:27:04.204 00:27:04.204 Latency(us) 00:27:04.204 [2024-11-28T18:15:25.252Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:04.204 [2024-11-28T18:15:25.252Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:27:04.204 nvme0n1 : 2.00 6596.68 824.58 0.00 0.00 2421.48 916.29 7039.05 00:27:04.204 [2024-11-28T18:15:25.252Z] =================================================================================================================== 00:27:04.204 [2024-11-28T18:15:25.253Z] Total : 6596.68 824.58 0.00 0.00 2421.48 916.29 7039.05 00:27:04.205 0 00:27:04.205 19:15:25 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:27:04.205 19:15:25 -- host/digest.sh@92 -- # get_accel_stats 00:27:04.205 19:15:25 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:27:04.205 19:15:25 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:27:04.205 19:15:25 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:27:04.205 | select(.opcode=="crc32c") 00:27:04.205 | "\(.module_name) \(.executed)"' 00:27:04.469 19:15:25 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:27:04.469 19:15:25 -- host/digest.sh@93 -- # exp_module=software 00:27:04.469 19:15:25 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:27:04.469 19:15:25 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:27:04.469 19:15:25 -- host/digest.sh@97 -- # killprocess 318119 00:27:04.469 19:15:25 -- common/autotest_common.sh@936 -- # '[' -z 318119 ']' 00:27:04.469 19:15:25 -- common/autotest_common.sh@940 -- # kill -0 318119 00:27:04.469 19:15:25 -- common/autotest_common.sh@941 -- # uname 00:27:04.469 19:15:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:04.469 19:15:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 318119 00:27:04.469 19:15:25 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:04.469 19:15:25 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:04.469 19:15:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 318119' 00:27:04.469 killing process with pid 318119 00:27:04.469 19:15:25 -- common/autotest_common.sh@955 -- # kill 318119 00:27:04.469 Received shutdown signal, test time was about 2.000000 seconds 00:27:04.469 00:27:04.469 Latency(us) 00:27:04.469 [2024-11-28T18:15:25.517Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:04.469 [2024-11-28T18:15:25.517Z] =================================================================================================================== 00:27:04.469 [2024-11-28T18:15:25.517Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:04.469 19:15:25 -- common/autotest_common.sh@960 -- # wait 318119 00:27:04.728 19:15:25 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:27:04.728 19:15:25 -- host/digest.sh@77 -- # local rw bs qd 00:27:04.728 19:15:25 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:27:04.728 19:15:25 -- host/digest.sh@80 -- # rw=randwrite 00:27:04.728 19:15:25 -- host/digest.sh@80 -- # bs=4096 00:27:04.728 19:15:25 -- host/digest.sh@80 -- # qd=128 00:27:04.728 19:15:25 -- host/digest.sh@82 -- # bperfpid=318548 00:27:04.728 19:15:25 -- host/digest.sh@83 -- # waitforlisten 318548 /var/tmp/bperf.sock 00:27:04.728 19:15:25 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:27:04.728 19:15:25 -- common/autotest_common.sh@829 -- # '[' -z 318548 ']' 00:27:04.728 19:15:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:04.728 19:15:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:04.728 19:15:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:04.728 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:04.728 19:15:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:04.728 19:15:25 -- common/autotest_common.sh@10 -- # set +x 00:27:04.728 [2024-11-28 19:15:25.693989] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:04.728 [2024-11-28 19:15:25.694065] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid318548 ] 00:27:04.728 EAL: No free 2048 kB hugepages reported on node 1 00:27:04.728 [2024-11-28 19:15:25.758125] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:04.986 [2024-11-28 19:15:25.875134] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:04.986 19:15:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:04.986 19:15:25 -- common/autotest_common.sh@862 -- # return 0 00:27:04.986 19:15:25 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:27:04.986 19:15:25 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:27:04.986 19:15:25 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:27:05.244 19:15:26 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:05.244 19:15:26 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:05.813 nvme0n1 00:27:05.813 19:15:26 -- host/digest.sh@91 -- # bperf_py perform_tests 00:27:05.813 19:15:26 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:05.813 Running I/O for 2 seconds... 00:27:08.349 00:27:08.349 Latency(us) 00:27:08.349 [2024-11-28T18:15:29.397Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:08.349 [2024-11-28T18:15:29.397Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:27:08.349 nvme0n1 : 2.01 19108.78 74.64 0.00 0.00 6683.45 6213.78 13010.11 00:27:08.349 [2024-11-28T18:15:29.398Z] =================================================================================================================== 00:27:08.350 [2024-11-28T18:15:29.398Z] Total : 19108.78 74.64 0.00 0.00 6683.45 6213.78 13010.11 00:27:08.350 0 00:27:08.350 19:15:28 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:27:08.350 19:15:28 -- host/digest.sh@92 -- # get_accel_stats 00:27:08.350 19:15:28 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:27:08.350 19:15:28 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:27:08.350 19:15:28 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:27:08.350 | select(.opcode=="crc32c") 00:27:08.350 | "\(.module_name) \(.executed)"' 00:27:08.350 19:15:29 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:27:08.350 19:15:29 -- host/digest.sh@93 -- # exp_module=software 00:27:08.350 19:15:29 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:27:08.350 19:15:29 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:27:08.350 19:15:29 -- host/digest.sh@97 -- # killprocess 318548 00:27:08.350 19:15:29 -- common/autotest_common.sh@936 -- # '[' -z 318548 ']' 00:27:08.350 19:15:29 -- common/autotest_common.sh@940 -- # kill -0 318548 00:27:08.350 19:15:29 -- common/autotest_common.sh@941 -- # uname 00:27:08.350 19:15:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:08.350 19:15:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 318548 00:27:08.350 19:15:29 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:08.350 19:15:29 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:08.350 19:15:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 318548' 00:27:08.350 killing process with pid 318548 00:27:08.350 19:15:29 -- common/autotest_common.sh@955 -- # kill 318548 00:27:08.350 Received shutdown signal, test time was about 2.000000 seconds 00:27:08.350 00:27:08.350 Latency(us) 00:27:08.350 [2024-11-28T18:15:29.398Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:08.350 [2024-11-28T18:15:29.398Z] =================================================================================================================== 00:27:08.350 [2024-11-28T18:15:29.398Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:08.350 19:15:29 -- common/autotest_common.sh@960 -- # wait 318548 00:27:08.350 19:15:29 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:27:08.350 19:15:29 -- host/digest.sh@77 -- # local rw bs qd 00:27:08.350 19:15:29 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:27:08.350 19:15:29 -- host/digest.sh@80 -- # rw=randwrite 00:27:08.350 19:15:29 -- host/digest.sh@80 -- # bs=131072 00:27:08.350 19:15:29 -- host/digest.sh@80 -- # qd=16 00:27:08.350 19:15:29 -- host/digest.sh@82 -- # bperfpid=319089 00:27:08.350 19:15:29 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:27:08.350 19:15:29 -- host/digest.sh@83 -- # waitforlisten 319089 /var/tmp/bperf.sock 00:27:08.350 19:15:29 -- common/autotest_common.sh@829 -- # '[' -z 319089 ']' 00:27:08.350 19:15:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:08.350 19:15:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:08.350 19:15:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:08.350 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:08.350 19:15:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:08.350 19:15:29 -- common/autotest_common.sh@10 -- # set +x 00:27:08.609 [2024-11-28 19:15:29.422957] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:08.609 [2024-11-28 19:15:29.423025] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid319089 ] 00:27:08.609 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:08.609 Zero copy mechanism will not be used. 00:27:08.609 EAL: No free 2048 kB hugepages reported on node 1 00:27:08.609 [2024-11-28 19:15:29.485360] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:08.609 [2024-11-28 19:15:29.598679] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:08.609 19:15:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:08.609 19:15:29 -- common/autotest_common.sh@862 -- # return 0 00:27:08.609 19:15:29 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:27:08.609 19:15:29 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:27:08.609 19:15:29 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:27:09.177 19:15:29 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:09.177 19:15:29 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:09.436 nvme0n1 00:27:09.436 19:15:30 -- host/digest.sh@91 -- # bperf_py perform_tests 00:27:09.436 19:15:30 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:09.436 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:09.436 Zero copy mechanism will not be used. 00:27:09.436 Running I/O for 2 seconds... 00:27:11.970 00:27:11.970 Latency(us) 00:27:11.970 [2024-11-28T18:15:33.018Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:11.970 [2024-11-28T18:15:33.018Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:27:11.970 nvme0n1 : 2.00 6879.50 859.94 0.00 0.00 2318.46 1929.67 8009.96 00:27:11.970 [2024-11-28T18:15:33.018Z] =================================================================================================================== 00:27:11.970 [2024-11-28T18:15:33.018Z] Total : 6879.50 859.94 0.00 0.00 2318.46 1929.67 8009.96 00:27:11.970 0 00:27:11.970 19:15:32 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:27:11.970 19:15:32 -- host/digest.sh@92 -- # get_accel_stats 00:27:11.970 19:15:32 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:27:11.970 19:15:32 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:27:11.970 19:15:32 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:27:11.970 | select(.opcode=="crc32c") 00:27:11.970 | "\(.module_name) \(.executed)"' 00:27:11.970 19:15:32 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:27:11.970 19:15:32 -- host/digest.sh@93 -- # exp_module=software 00:27:11.970 19:15:32 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:27:11.970 19:15:32 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:27:11.970 19:15:32 -- host/digest.sh@97 -- # killprocess 319089 00:27:11.970 19:15:32 -- common/autotest_common.sh@936 -- # '[' -z 319089 ']' 00:27:11.970 19:15:32 -- common/autotest_common.sh@940 -- # kill -0 319089 00:27:11.970 19:15:32 -- common/autotest_common.sh@941 -- # uname 00:27:11.970 19:15:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:11.970 19:15:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 319089 00:27:11.970 19:15:32 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:11.970 19:15:32 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:11.970 19:15:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 319089' 00:27:11.970 killing process with pid 319089 00:27:11.970 19:15:32 -- common/autotest_common.sh@955 -- # kill 319089 00:27:11.970 Received shutdown signal, test time was about 2.000000 seconds 00:27:11.970 00:27:11.970 Latency(us) 00:27:11.970 [2024-11-28T18:15:33.018Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:11.970 [2024-11-28T18:15:33.018Z] =================================================================================================================== 00:27:11.970 [2024-11-28T18:15:33.018Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:11.970 19:15:32 -- common/autotest_common.sh@960 -- # wait 319089 00:27:12.230 19:15:33 -- host/digest.sh@126 -- # killprocess 317557 00:27:12.230 19:15:33 -- common/autotest_common.sh@936 -- # '[' -z 317557 ']' 00:27:12.230 19:15:33 -- common/autotest_common.sh@940 -- # kill -0 317557 00:27:12.230 19:15:33 -- common/autotest_common.sh@941 -- # uname 00:27:12.230 19:15:33 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:12.230 19:15:33 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 317557 00:27:12.230 19:15:33 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:12.230 19:15:33 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:12.230 19:15:33 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 317557' 00:27:12.230 killing process with pid 317557 00:27:12.230 19:15:33 -- common/autotest_common.sh@955 -- # kill 317557 00:27:12.230 19:15:33 -- common/autotest_common.sh@960 -- # wait 317557 00:27:12.487 00:27:12.487 real 0m15.630s 00:27:12.487 user 0m30.839s 00:27:12.487 sys 0m4.505s 00:27:12.487 19:15:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:12.487 19:15:33 -- common/autotest_common.sh@10 -- # set +x 00:27:12.487 ************************************ 00:27:12.487 END TEST nvmf_digest_clean 00:27:12.487 ************************************ 00:27:12.487 19:15:33 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:27:12.487 19:15:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:12.487 19:15:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:12.487 19:15:33 -- common/autotest_common.sh@10 -- # set +x 00:27:12.487 ************************************ 00:27:12.487 START TEST nvmf_digest_error 00:27:12.487 ************************************ 00:27:12.487 19:15:33 -- common/autotest_common.sh@1114 -- # run_digest_error 00:27:12.487 19:15:33 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:27:12.487 19:15:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:12.487 19:15:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:12.487 19:15:33 -- common/autotest_common.sh@10 -- # set +x 00:27:12.487 19:15:33 -- nvmf/common.sh@469 -- # nvmfpid=319534 00:27:12.487 19:15:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:27:12.487 19:15:33 -- nvmf/common.sh@470 -- # waitforlisten 319534 00:27:12.487 19:15:33 -- common/autotest_common.sh@829 -- # '[' -z 319534 ']' 00:27:12.487 19:15:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:12.487 19:15:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:12.487 19:15:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:12.488 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:12.488 19:15:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:12.488 19:15:33 -- common/autotest_common.sh@10 -- # set +x 00:27:12.488 [2024-11-28 19:15:33.454336] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:12.488 [2024-11-28 19:15:33.454429] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:12.488 EAL: No free 2048 kB hugepages reported on node 1 00:27:12.488 [2024-11-28 19:15:33.521852] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:12.747 [2024-11-28 19:15:33.637578] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:12.747 [2024-11-28 19:15:33.637723] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:12.747 [2024-11-28 19:15:33.637740] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:12.747 [2024-11-28 19:15:33.637762] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:12.747 [2024-11-28 19:15:33.637790] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:12.747 19:15:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:12.747 19:15:33 -- common/autotest_common.sh@862 -- # return 0 00:27:12.747 19:15:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:12.747 19:15:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:12.747 19:15:33 -- common/autotest_common.sh@10 -- # set +x 00:27:12.747 19:15:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:12.747 19:15:33 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:27:12.747 19:15:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:12.747 19:15:33 -- common/autotest_common.sh@10 -- # set +x 00:27:12.747 [2024-11-28 19:15:33.706371] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:27:12.747 19:15:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:12.747 19:15:33 -- host/digest.sh@104 -- # common_target_config 00:27:12.747 19:15:33 -- host/digest.sh@43 -- # rpc_cmd 00:27:12.747 19:15:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:12.747 19:15:33 -- common/autotest_common.sh@10 -- # set +x 00:27:13.006 null0 00:27:13.006 [2024-11-28 19:15:33.829559] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:13.006 [2024-11-28 19:15:33.853811] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:13.006 19:15:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:13.006 19:15:33 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:27:13.006 19:15:33 -- host/digest.sh@54 -- # local rw bs qd 00:27:13.006 19:15:33 -- host/digest.sh@56 -- # rw=randread 00:27:13.006 19:15:33 -- host/digest.sh@56 -- # bs=4096 00:27:13.006 19:15:33 -- host/digest.sh@56 -- # qd=128 00:27:13.006 19:15:33 -- host/digest.sh@58 -- # bperfpid=319677 00:27:13.006 19:15:33 -- host/digest.sh@60 -- # waitforlisten 319677 /var/tmp/bperf.sock 00:27:13.006 19:15:33 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:27:13.006 19:15:33 -- common/autotest_common.sh@829 -- # '[' -z 319677 ']' 00:27:13.006 19:15:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:13.006 19:15:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:13.006 19:15:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:13.006 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:13.006 19:15:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:13.006 19:15:33 -- common/autotest_common.sh@10 -- # set +x 00:27:13.006 [2024-11-28 19:15:33.901776] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:13.006 [2024-11-28 19:15:33.901853] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid319677 ] 00:27:13.006 EAL: No free 2048 kB hugepages reported on node 1 00:27:13.006 [2024-11-28 19:15:33.967216] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:13.264 [2024-11-28 19:15:34.074161] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:14.198 19:15:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:14.198 19:15:34 -- common/autotest_common.sh@862 -- # return 0 00:27:14.198 19:15:34 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:14.198 19:15:34 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:14.198 19:15:35 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:14.198 19:15:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:14.198 19:15:35 -- common/autotest_common.sh@10 -- # set +x 00:27:14.198 19:15:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:14.198 19:15:35 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:14.198 19:15:35 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:14.765 nvme0n1 00:27:14.765 19:15:35 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:27:14.765 19:15:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:14.765 19:15:35 -- common/autotest_common.sh@10 -- # set +x 00:27:14.765 19:15:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:14.765 19:15:35 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:14.765 19:15:35 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:14.765 Running I/O for 2 seconds... 00:27:14.765 [2024-11-28 19:15:35.728009] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:14.766 [2024-11-28 19:15:35.728067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21111 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.766 [2024-11-28 19:15:35.728089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.766 [2024-11-28 19:15:35.740073] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:14.766 [2024-11-28 19:15:35.740109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:16004 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.766 [2024-11-28 19:15:35.740129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.766 [2024-11-28 19:15:35.757664] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:14.766 [2024-11-28 19:15:35.757723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:22958 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.766 [2024-11-28 19:15:35.757745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.766 [2024-11-28 19:15:35.772963] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:14.766 [2024-11-28 19:15:35.772999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:21431 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.766 [2024-11-28 19:15:35.773019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.766 [2024-11-28 19:15:35.788463] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:14.766 [2024-11-28 19:15:35.788494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:4025 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.766 [2024-11-28 19:15:35.788526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:14.766 [2024-11-28 19:15:35.805686] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:14.766 [2024-11-28 19:15:35.805718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:1255 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:14.766 [2024-11-28 19:15:35.805751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.025 [2024-11-28 19:15:35.817924] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.025 [2024-11-28 19:15:35.817961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:2819 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.025 [2024-11-28 19:15:35.817981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.025 [2024-11-28 19:15:35.833066] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.025 [2024-11-28 19:15:35.833101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17267 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.025 [2024-11-28 19:15:35.833121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.025 [2024-11-28 19:15:35.849616] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.025 [2024-11-28 19:15:35.849648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:21195 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.025 [2024-11-28 19:15:35.849667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.025 [2024-11-28 19:15:35.866363] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.025 [2024-11-28 19:15:35.866416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:6591 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.025 [2024-11-28 19:15:35.866451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.025 [2024-11-28 19:15:35.883672] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.025 [2024-11-28 19:15:35.883727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:12104 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.025 [2024-11-28 19:15:35.883757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.025 [2024-11-28 19:15:35.900670] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.025 [2024-11-28 19:15:35.900729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:20712 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.025 [2024-11-28 19:15:35.900749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.025 [2024-11-28 19:15:35.917092] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.025 [2024-11-28 19:15:35.917121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:4327 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.025 [2024-11-28 19:15:35.917157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.025 [2024-11-28 19:15:35.933243] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.025 [2024-11-28 19:15:35.933277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:3440 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.025 [2024-11-28 19:15:35.933297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.025 [2024-11-28 19:15:35.950571] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.025 [2024-11-28 19:15:35.950601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:9837 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.025 [2024-11-28 19:15:35.950618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.025 [2024-11-28 19:15:35.967531] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.025 [2024-11-28 19:15:35.967562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:14067 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.025 [2024-11-28 19:15:35.967579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.025 [2024-11-28 19:15:35.984660] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.025 [2024-11-28 19:15:35.984704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:6710 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.025 [2024-11-28 19:15:35.984721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.025 [2024-11-28 19:15:36.001659] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.025 [2024-11-28 19:15:36.001702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:5841 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.025 [2024-11-28 19:15:36.001718] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.025 [2024-11-28 19:15:36.018637] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.025 [2024-11-28 19:15:36.018665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:22101 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.025 [2024-11-28 19:15:36.018698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.025 [2024-11-28 19:15:36.035586] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.025 [2024-11-28 19:15:36.035621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:20963 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.025 [2024-11-28 19:15:36.035654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.025 [2024-11-28 19:15:36.052598] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.025 [2024-11-28 19:15:36.052626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:11218 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.025 [2024-11-28 19:15:36.052657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.025 [2024-11-28 19:15:36.069874] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.025 [2024-11-28 19:15:36.069908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:2344 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.025 [2024-11-28 19:15:36.069927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.283 [2024-11-28 19:15:36.085015] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.283 [2024-11-28 19:15:36.085049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:21713 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.283 [2024-11-28 19:15:36.085068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.283 [2024-11-28 19:15:36.102012] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.283 [2024-11-28 19:15:36.102046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:1397 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.283 [2024-11-28 19:15:36.102065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.283 [2024-11-28 19:15:36.119018] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.283 [2024-11-28 19:15:36.119052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:16838 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.283 [2024-11-28 19:15:36.119070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.283 [2024-11-28 19:15:36.135813] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.283 [2024-11-28 19:15:36.135846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:3624 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.283 [2024-11-28 19:15:36.135866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.283 [2024-11-28 19:15:36.152574] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.283 [2024-11-28 19:15:36.152601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:6562 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.283 [2024-11-28 19:15:36.152632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.283 [2024-11-28 19:15:36.169509] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.283 [2024-11-28 19:15:36.169537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:4822 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.284 [2024-11-28 19:15:36.169569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.284 [2024-11-28 19:15:36.186467] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.284 [2024-11-28 19:15:36.186494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:9481 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.284 [2024-11-28 19:15:36.186509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.284 [2024-11-28 19:15:36.203540] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.284 [2024-11-28 19:15:36.203576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:6137 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.284 [2024-11-28 19:15:36.203606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.284 [2024-11-28 19:15:36.220631] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.284 [2024-11-28 19:15:36.220662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:3194 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.284 [2024-11-28 19:15:36.220679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.284 [2024-11-28 19:15:36.237729] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.284 [2024-11-28 19:15:36.237768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:8868 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.284 [2024-11-28 19:15:36.237787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.284 [2024-11-28 19:15:36.254763] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.284 [2024-11-28 19:15:36.254800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:20870 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.284 [2024-11-28 19:15:36.254820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.284 [2024-11-28 19:15:36.271971] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.284 [2024-11-28 19:15:36.272012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:10031 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.284 [2024-11-28 19:15:36.272034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.284 [2024-11-28 19:15:36.288988] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.284 [2024-11-28 19:15:36.289025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:19194 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.284 [2024-11-28 19:15:36.289045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.284 [2024-11-28 19:15:36.306794] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.284 [2024-11-28 19:15:36.306830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:21228 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.284 [2024-11-28 19:15:36.306850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.284 [2024-11-28 19:15:36.324080] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.284 [2024-11-28 19:15:36.324117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:16405 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.284 [2024-11-28 19:15:36.324143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.542 [2024-11-28 19:15:36.341045] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.542 [2024-11-28 19:15:36.341083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:12497 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.542 [2024-11-28 19:15:36.341103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.542 [2024-11-28 19:15:36.358156] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.542 [2024-11-28 19:15:36.358193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:20149 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.542 [2024-11-28 19:15:36.358222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.542 [2024-11-28 19:15:36.375573] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.542 [2024-11-28 19:15:36.375606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:21803 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.542 [2024-11-28 19:15:36.375639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.542 [2024-11-28 19:15:36.392933] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.542 [2024-11-28 19:15:36.392970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:19586 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.542 [2024-11-28 19:15:36.392990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:112 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.542 [2024-11-28 19:15:36.409664] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.542 [2024-11-28 19:15:36.409694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:4179 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.542 [2024-11-28 19:15:36.409726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.542 [2024-11-28 19:15:36.426700] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.542 [2024-11-28 19:15:36.426750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:9002 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.542 [2024-11-28 19:15:36.426771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.542 [2024-11-28 19:15:36.444050] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.542 [2024-11-28 19:15:36.444086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:17488 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.542 [2024-11-28 19:15:36.444106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.542 [2024-11-28 19:15:36.460704] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.542 [2024-11-28 19:15:36.460735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:901 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.542 [2024-11-28 19:15:36.460767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.542 [2024-11-28 19:15:36.477781] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.542 [2024-11-28 19:15:36.477823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:12697 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.542 [2024-11-28 19:15:36.477844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.542 [2024-11-28 19:15:36.495420] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.542 [2024-11-28 19:15:36.495467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:6092 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.542 [2024-11-28 19:15:36.495484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.542 [2024-11-28 19:15:36.512464] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.543 [2024-11-28 19:15:36.512494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:24248 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.543 [2024-11-28 19:15:36.512531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.543 [2024-11-28 19:15:36.529496] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.543 [2024-11-28 19:15:36.529529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:1223 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.543 [2024-11-28 19:15:36.529560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.543 [2024-11-28 19:15:36.546562] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.543 [2024-11-28 19:15:36.546592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:9980 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.543 [2024-11-28 19:15:36.546624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.543 [2024-11-28 19:15:36.563660] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.543 [2024-11-28 19:15:36.563690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:2557 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.543 [2024-11-28 19:15:36.563706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.543 [2024-11-28 19:15:36.580851] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.543 [2024-11-28 19:15:36.580886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:18480 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.543 [2024-11-28 19:15:36.580906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.803 [2024-11-28 19:15:36.598223] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.803 [2024-11-28 19:15:36.598258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:6371 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.803 [2024-11-28 19:15:36.598277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.803 [2024-11-28 19:15:36.615251] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.803 [2024-11-28 19:15:36.615285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:17217 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.803 [2024-11-28 19:15:36.615305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.803 [2024-11-28 19:15:36.630996] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.803 [2024-11-28 19:15:36.631030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:16142 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.803 [2024-11-28 19:15:36.631050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.803 [2024-11-28 19:15:36.646103] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.803 [2024-11-28 19:15:36.646138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:23541 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.803 [2024-11-28 19:15:36.646157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.803 [2024-11-28 19:15:36.659771] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.803 [2024-11-28 19:15:36.659805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:13153 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.803 [2024-11-28 19:15:36.659824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.803 [2024-11-28 19:15:36.678104] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.803 [2024-11-28 19:15:36.678137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:16284 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.803 [2024-11-28 19:15:36.678157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.803 [2024-11-28 19:15:36.694865] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.803 [2024-11-28 19:15:36.694899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3647 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.803 [2024-11-28 19:15:36.694918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.803 [2024-11-28 19:15:36.711706] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.803 [2024-11-28 19:15:36.711740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24246 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.803 [2024-11-28 19:15:36.711759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.803 [2024-11-28 19:15:36.728660] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.803 [2024-11-28 19:15:36.728707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:2235 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.803 [2024-11-28 19:15:36.728726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.803 [2024-11-28 19:15:36.739999] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.803 [2024-11-28 19:15:36.740033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:6578 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.803 [2024-11-28 19:15:36.740052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.803 [2024-11-28 19:15:36.756235] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.803 [2024-11-28 19:15:36.756269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:7876 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.803 [2024-11-28 19:15:36.756296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.803 [2024-11-28 19:15:36.779040] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.803 [2024-11-28 19:15:36.779075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:15504 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.803 [2024-11-28 19:15:36.779094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.803 [2024-11-28 19:15:36.795640] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.803 [2024-11-28 19:15:36.795671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:12379 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.803 [2024-11-28 19:15:36.795689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.803 [2024-11-28 19:15:36.812622] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.803 [2024-11-28 19:15:36.812653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:7578 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.803 [2024-11-28 19:15:36.812671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.803 [2024-11-28 19:15:36.829415] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.803 [2024-11-28 19:15:36.829463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:25021 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.803 [2024-11-28 19:15:36.829480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:70 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:15.803 [2024-11-28 19:15:36.845998] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:15.803 [2024-11-28 19:15:36.846032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:22288 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:15.803 [2024-11-28 19:15:36.846051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.062 [2024-11-28 19:15:36.857466] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.062 [2024-11-28 19:15:36.857495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:19098 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.062 [2024-11-28 19:15:36.857526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.062 [2024-11-28 19:15:36.874440] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.062 [2024-11-28 19:15:36.874484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:15321 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.062 [2024-11-28 19:15:36.874500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.062 [2024-11-28 19:15:36.891085] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.062 [2024-11-28 19:15:36.891119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:12348 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.062 [2024-11-28 19:15:36.891139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.062 [2024-11-28 19:15:36.913845] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.062 [2024-11-28 19:15:36.913881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:9012 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.062 [2024-11-28 19:15:36.913900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.062 [2024-11-28 19:15:36.932085] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.062 [2024-11-28 19:15:36.932119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:10945 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.062 [2024-11-28 19:15:36.932138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.062 [2024-11-28 19:15:36.949002] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.062 [2024-11-28 19:15:36.949035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:18276 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.062 [2024-11-28 19:15:36.949054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:104 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.062 [2024-11-28 19:15:36.966011] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.062 [2024-11-28 19:15:36.966045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:21826 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.062 [2024-11-28 19:15:36.966064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.062 [2024-11-28 19:15:36.977371] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.062 [2024-11-28 19:15:36.977413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:2920 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.062 [2024-11-28 19:15:36.977449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.062 [2024-11-28 19:15:36.993717] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.062 [2024-11-28 19:15:36.993753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:18698 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.063 [2024-11-28 19:15:36.993772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.063 [2024-11-28 19:15:37.011108] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.063 [2024-11-28 19:15:37.011143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:17314 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.063 [2024-11-28 19:15:37.011162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.063 [2024-11-28 19:15:37.028035] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.063 [2024-11-28 19:15:37.028069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20418 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.063 [2024-11-28 19:15:37.028088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.063 [2024-11-28 19:15:37.045827] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.063 [2024-11-28 19:15:37.045872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:14732 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.063 [2024-11-28 19:15:37.045897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.063 [2024-11-28 19:15:37.062913] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.063 [2024-11-28 19:15:37.062948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:15519 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.063 [2024-11-28 19:15:37.062979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.063 [2024-11-28 19:15:37.080183] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.063 [2024-11-28 19:15:37.080217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:13927 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.063 [2024-11-28 19:15:37.080237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.063 [2024-11-28 19:15:37.095660] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.063 [2024-11-28 19:15:37.095708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:21659 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.063 [2024-11-28 19:15:37.095727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.063 [2024-11-28 19:15:37.107716] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.063 [2024-11-28 19:15:37.107760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:21740 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.063 [2024-11-28 19:15:37.107779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.321 [2024-11-28 19:15:37.124789] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.321 [2024-11-28 19:15:37.124824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:15771 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.321 [2024-11-28 19:15:37.124844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.321 [2024-11-28 19:15:37.142240] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.321 [2024-11-28 19:15:37.142274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:18937 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.321 [2024-11-28 19:15:37.142293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.321 [2024-11-28 19:15:37.157016] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.321 [2024-11-28 19:15:37.157050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:5281 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.321 [2024-11-28 19:15:37.157070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.321 [2024-11-28 19:15:37.174495] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.321 [2024-11-28 19:15:37.174538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:14405 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.321 [2024-11-28 19:15:37.174555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.321 [2024-11-28 19:15:37.191982] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.321 [2024-11-28 19:15:37.192023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:21251 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.321 [2024-11-28 19:15:37.192042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.321 [2024-11-28 19:15:37.208779] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.322 [2024-11-28 19:15:37.208812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:22285 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.322 [2024-11-28 19:15:37.208831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.322 [2024-11-28 19:15:37.225831] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.322 [2024-11-28 19:15:37.225864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:2707 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.322 [2024-11-28 19:15:37.225883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.322 [2024-11-28 19:15:37.242864] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.322 [2024-11-28 19:15:37.242907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:20421 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.322 [2024-11-28 19:15:37.242926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.322 [2024-11-28 19:15:37.259922] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.322 [2024-11-28 19:15:37.259957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:12500 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.322 [2024-11-28 19:15:37.259976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.322 [2024-11-28 19:15:37.277002] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.322 [2024-11-28 19:15:37.277038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:10954 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.322 [2024-11-28 19:15:37.277058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:72 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.322 [2024-11-28 19:15:37.293922] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.322 [2024-11-28 19:15:37.293957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:20773 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.322 [2024-11-28 19:15:37.293976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.322 [2024-11-28 19:15:37.310914] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.322 [2024-11-28 19:15:37.310948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:25355 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.322 [2024-11-28 19:15:37.310967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.322 [2024-11-28 19:15:37.327665] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.322 [2024-11-28 19:15:37.327693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:9719 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.322 [2024-11-28 19:15:37.327723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.322 [2024-11-28 19:15:37.338509] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.322 [2024-11-28 19:15:37.338536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:7364 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.322 [2024-11-28 19:15:37.338566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.322 [2024-11-28 19:15:37.360225] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.322 [2024-11-28 19:15:37.360260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:2296 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.322 [2024-11-28 19:15:37.360279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.581 [2024-11-28 19:15:37.377171] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.581 [2024-11-28 19:15:37.377205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:16163 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.581 [2024-11-28 19:15:37.377224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.581 [2024-11-28 19:15:37.394199] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.581 [2024-11-28 19:15:37.394233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:2629 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.581 [2024-11-28 19:15:37.394252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.581 [2024-11-28 19:15:37.405982] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.581 [2024-11-28 19:15:37.406016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:14593 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.581 [2024-11-28 19:15:37.406034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.581 [2024-11-28 19:15:37.422875] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.581 [2024-11-28 19:15:37.422908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:8860 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.581 [2024-11-28 19:15:37.422927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.581 [2024-11-28 19:15:37.439731] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.581 [2024-11-28 19:15:37.439764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:3210 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.581 [2024-11-28 19:15:37.439783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.581 [2024-11-28 19:15:37.456625] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.581 [2024-11-28 19:15:37.456652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:2183 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.581 [2024-11-28 19:15:37.456683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.581 [2024-11-28 19:15:37.473756] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.581 [2024-11-28 19:15:37.473804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:502 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.581 [2024-11-28 19:15:37.473830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.581 [2024-11-28 19:15:37.490780] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.581 [2024-11-28 19:15:37.490814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:11410 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.581 [2024-11-28 19:15:37.490834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.581 [2024-11-28 19:15:37.507828] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.581 [2024-11-28 19:15:37.507862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:22831 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.581 [2024-11-28 19:15:37.507881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.581 [2024-11-28 19:15:37.524806] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.581 [2024-11-28 19:15:37.524839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:13431 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.581 [2024-11-28 19:15:37.524858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.581 [2024-11-28 19:15:37.541998] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.581 [2024-11-28 19:15:37.542032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:10890 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.581 [2024-11-28 19:15:37.542051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.581 [2024-11-28 19:15:37.553615] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.582 [2024-11-28 19:15:37.553644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:17743 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.582 [2024-11-28 19:15:37.553680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.582 [2024-11-28 19:15:37.576368] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.582 [2024-11-28 19:15:37.576408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:12911 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.582 [2024-11-28 19:15:37.576429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.582 [2024-11-28 19:15:37.591795] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.582 [2024-11-28 19:15:37.591829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:19648 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.582 [2024-11-28 19:15:37.591848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.582 [2024-11-28 19:15:37.610352] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.582 [2024-11-28 19:15:37.610386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:21520 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.582 [2024-11-28 19:15:37.610413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.582 [2024-11-28 19:15:37.621590] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.582 [2024-11-28 19:15:37.621620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:19761 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.582 [2024-11-28 19:15:37.621637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.840 [2024-11-28 19:15:37.638354] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.840 [2024-11-28 19:15:37.638388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:790 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.840 [2024-11-28 19:15:37.638416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.840 [2024-11-28 19:15:37.655213] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.840 [2024-11-28 19:15:37.655246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:5368 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.840 [2024-11-28 19:15:37.655265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.840 [2024-11-28 19:15:37.672207] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.840 [2024-11-28 19:15:37.672240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:18512 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.840 [2024-11-28 19:15:37.672259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.840 [2024-11-28 19:15:37.689101] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.840 [2024-11-28 19:15:37.689136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:14475 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.840 [2024-11-28 19:15:37.689154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.840 [2024-11-28 19:15:37.706111] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x2172bb0) 00:27:16.840 [2024-11-28 19:15:37.706146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:356 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:16.840 [2024-11-28 19:15:37.706165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:16.840 00:27:16.840 Latency(us) 00:27:16.840 [2024-11-28T18:15:37.889Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:16.841 [2024-11-28T18:15:37.889Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:27:16.841 nvme0n1 : 2.04 15019.40 58.67 0.00 0.00 8349.65 2827.76 50098.63 00:27:16.841 [2024-11-28T18:15:37.889Z] =================================================================================================================== 00:27:16.841 [2024-11-28T18:15:37.889Z] Total : 15019.40 58.67 0.00 0.00 8349.65 2827.76 50098.63 00:27:16.841 0 00:27:16.841 19:15:37 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:16.841 19:15:37 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:16.841 19:15:37 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:16.841 19:15:37 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:16.841 | .driver_specific 00:27:16.841 | .nvme_error 00:27:16.841 | .status_code 00:27:16.841 | .command_transient_transport_error' 00:27:17.099 19:15:38 -- host/digest.sh@71 -- # (( 120 > 0 )) 00:27:17.099 19:15:38 -- host/digest.sh@73 -- # killprocess 319677 00:27:17.099 19:15:38 -- common/autotest_common.sh@936 -- # '[' -z 319677 ']' 00:27:17.099 19:15:38 -- common/autotest_common.sh@940 -- # kill -0 319677 00:27:17.099 19:15:38 -- common/autotest_common.sh@941 -- # uname 00:27:17.099 19:15:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:17.099 19:15:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 319677 00:27:17.099 19:15:38 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:17.099 19:15:38 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:17.099 19:15:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 319677' 00:27:17.099 killing process with pid 319677 00:27:17.099 19:15:38 -- common/autotest_common.sh@955 -- # kill 319677 00:27:17.099 Received shutdown signal, test time was about 2.000000 seconds 00:27:17.099 00:27:17.099 Latency(us) 00:27:17.099 [2024-11-28T18:15:38.147Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:17.099 [2024-11-28T18:15:38.147Z] =================================================================================================================== 00:27:17.099 [2024-11-28T18:15:38.147Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:17.099 19:15:38 -- common/autotest_common.sh@960 -- # wait 319677 00:27:17.356 19:15:38 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:27:17.356 19:15:38 -- host/digest.sh@54 -- # local rw bs qd 00:27:17.356 19:15:38 -- host/digest.sh@56 -- # rw=randread 00:27:17.356 19:15:38 -- host/digest.sh@56 -- # bs=131072 00:27:17.356 19:15:38 -- host/digest.sh@56 -- # qd=16 00:27:17.356 19:15:38 -- host/digest.sh@58 -- # bperfpid=320232 00:27:17.356 19:15:38 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:27:17.356 19:15:38 -- host/digest.sh@60 -- # waitforlisten 320232 /var/tmp/bperf.sock 00:27:17.356 19:15:38 -- common/autotest_common.sh@829 -- # '[' -z 320232 ']' 00:27:17.356 19:15:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:17.356 19:15:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:17.356 19:15:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:17.356 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:17.356 19:15:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:17.356 19:15:38 -- common/autotest_common.sh@10 -- # set +x 00:27:17.356 [2024-11-28 19:15:38.349467] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:17.356 [2024-11-28 19:15:38.349544] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid320232 ] 00:27:17.356 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:17.356 Zero copy mechanism will not be used. 00:27:17.356 EAL: No free 2048 kB hugepages reported on node 1 00:27:17.616 [2024-11-28 19:15:38.408645] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:17.616 [2024-11-28 19:15:38.514358] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:18.554 19:15:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:18.554 19:15:39 -- common/autotest_common.sh@862 -- # return 0 00:27:18.554 19:15:39 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:18.554 19:15:39 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:18.814 19:15:39 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:18.814 19:15:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:18.814 19:15:39 -- common/autotest_common.sh@10 -- # set +x 00:27:18.814 19:15:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:18.814 19:15:39 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:18.814 19:15:39 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:19.071 nvme0n1 00:27:19.071 19:15:40 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:27:19.071 19:15:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:19.071 19:15:40 -- common/autotest_common.sh@10 -- # set +x 00:27:19.071 19:15:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:19.071 19:15:40 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:19.071 19:15:40 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:19.330 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:19.330 Zero copy mechanism will not be used. 00:27:19.330 Running I/O for 2 seconds... 00:27:19.330 [2024-11-28 19:15:40.187721] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.330 [2024-11-28 19:15:40.187791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.330 [2024-11-28 19:15:40.187813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.330 [2024-11-28 19:15:40.191525] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.330 [2024-11-28 19:15:40.191557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.330 [2024-11-28 19:15:40.191576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.330 [2024-11-28 19:15:40.196885] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.330 [2024-11-28 19:15:40.196915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.330 [2024-11-28 19:15:40.196931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.330 [2024-11-28 19:15:40.201949] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.330 [2024-11-28 19:15:40.201995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.330 [2024-11-28 19:15:40.202012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.330 [2024-11-28 19:15:40.206361] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.330 [2024-11-28 19:15:40.206413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.330 [2024-11-28 19:15:40.206431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.330 [2024-11-28 19:15:40.211569] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.330 [2024-11-28 19:15:40.211599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.330 [2024-11-28 19:15:40.211633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.330 [2024-11-28 19:15:40.216828] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.330 [2024-11-28 19:15:40.216855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.330 [2024-11-28 19:15:40.216886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.330 [2024-11-28 19:15:40.221813] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.330 [2024-11-28 19:15:40.221851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.330 [2024-11-28 19:15:40.221869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.330 [2024-11-28 19:15:40.226425] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.330 [2024-11-28 19:15:40.226456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.330 [2024-11-28 19:15:40.226474] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.330 [2024-11-28 19:15:40.230844] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.330 [2024-11-28 19:15:40.230887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.330 [2024-11-28 19:15:40.230903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.330 [2024-11-28 19:15:40.235566] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.330 [2024-11-28 19:15:40.235595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.330 [2024-11-28 19:15:40.235613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.330 [2024-11-28 19:15:40.240055] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.330 [2024-11-28 19:15:40.240098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.330 [2024-11-28 19:15:40.240114] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.330 [2024-11-28 19:15:40.244510] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.330 [2024-11-28 19:15:40.244552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.330 [2024-11-28 19:15:40.244569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.330 [2024-11-28 19:15:40.249115] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.330 [2024-11-28 19:15:40.249159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.330 [2024-11-28 19:15:40.249175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.330 [2024-11-28 19:15:40.253673] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.330 [2024-11-28 19:15:40.253716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.330 [2024-11-28 19:15:40.253733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.331 [2024-11-28 19:15:40.259074] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.331 [2024-11-28 19:15:40.259104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.331 [2024-11-28 19:15:40.259122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.331 [2024-11-28 19:15:40.263529] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.331 [2024-11-28 19:15:40.263559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.331 [2024-11-28 19:15:40.263575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.331 [2024-11-28 19:15:40.267792] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.331 [2024-11-28 19:15:40.267820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.331 [2024-11-28 19:15:40.267837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.331 [2024-11-28 19:15:40.272204] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.331 [2024-11-28 19:15:40.272233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.331 [2024-11-28 19:15:40.272250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.331 [2024-11-28 19:15:40.276549] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.331 [2024-11-28 19:15:40.276577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.331 [2024-11-28 19:15:40.276609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.331 [2024-11-28 19:15:40.280962] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.331 [2024-11-28 19:15:40.280991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.331 [2024-11-28 19:15:40.281008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.331 [2024-11-28 19:15:40.285347] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.331 [2024-11-28 19:15:40.285376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.331 [2024-11-28 19:15:40.285400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.331 [2024-11-28 19:15:40.289633] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.331 [2024-11-28 19:15:40.289662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.331 [2024-11-28 19:15:40.289679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.331 [2024-11-28 19:15:40.293942] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.331 [2024-11-28 19:15:40.293985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.331 [2024-11-28 19:15:40.294001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.331 [2024-11-28 19:15:40.298418] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.331 [2024-11-28 19:15:40.298462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.331 [2024-11-28 19:15:40.298486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.331 [2024-11-28 19:15:40.302975] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.331 [2024-11-28 19:15:40.303005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.331 [2024-11-28 19:15:40.303022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.331 [2024-11-28 19:15:40.307503] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.331 [2024-11-28 19:15:40.307550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.331 [2024-11-28 19:15:40.307566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.331 [2024-11-28 19:15:40.312098] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.331 [2024-11-28 19:15:40.312141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.331 [2024-11-28 19:15:40.312157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.331 [2024-11-28 19:15:40.316488] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.331 [2024-11-28 19:15:40.316516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.331 [2024-11-28 19:15:40.316548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.331 [2024-11-28 19:15:40.321122] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.331 [2024-11-28 19:15:40.321150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.331 [2024-11-28 19:15:40.321181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.331 [2024-11-28 19:15:40.326200] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.331 [2024-11-28 19:15:40.326244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.331 [2024-11-28 19:15:40.326261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.331 [2024-11-28 19:15:40.331502] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.331 [2024-11-28 19:15:40.331533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.331 [2024-11-28 19:15:40.331551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.331 [2024-11-28 19:15:40.336277] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.331 [2024-11-28 19:15:40.336307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.331 [2024-11-28 19:15:40.336325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.331 [2024-11-28 19:15:40.340778] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.331 [2024-11-28 19:15:40.340814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.331 [2024-11-28 19:15:40.340833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.331 [2024-11-28 19:15:40.345608] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.331 [2024-11-28 19:15:40.345640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.331 [2024-11-28 19:15:40.345658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.331 [2024-11-28 19:15:40.350651] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.331 [2024-11-28 19:15:40.350682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.331 [2024-11-28 19:15:40.350699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.331 [2024-11-28 19:15:40.355816] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.331 [2024-11-28 19:15:40.355848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.331 [2024-11-28 19:15:40.355880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.331 [2024-11-28 19:15:40.362552] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.331 [2024-11-28 19:15:40.362583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.331 [2024-11-28 19:15:40.362600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.331 [2024-11-28 19:15:40.367918] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.331 [2024-11-28 19:15:40.367949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.331 [2024-11-28 19:15:40.367981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.331 [2024-11-28 19:15:40.372907] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.331 [2024-11-28 19:15:40.372937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.331 [2024-11-28 19:15:40.372954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.592 [2024-11-28 19:15:40.377265] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.592 [2024-11-28 19:15:40.377296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.592 [2024-11-28 19:15:40.377313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.592 [2024-11-28 19:15:40.382627] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.592 [2024-11-28 19:15:40.382657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.592 [2024-11-28 19:15:40.382674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.592 [2024-11-28 19:15:40.387568] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.592 [2024-11-28 19:15:40.387598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.592 [2024-11-28 19:15:40.387631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.592 [2024-11-28 19:15:40.393081] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.592 [2024-11-28 19:15:40.393112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.592 [2024-11-28 19:15:40.393130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.592 [2024-11-28 19:15:40.400421] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.592 [2024-11-28 19:15:40.400463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:23328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.593 [2024-11-28 19:15:40.400481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.593 [2024-11-28 19:15:40.406477] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.593 [2024-11-28 19:15:40.406508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.593 [2024-11-28 19:15:40.406526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.593 [2024-11-28 19:15:40.411908] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.593 [2024-11-28 19:15:40.411944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.593 [2024-11-28 19:15:40.411963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.593 [2024-11-28 19:15:40.416836] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.593 [2024-11-28 19:15:40.416866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.593 [2024-11-28 19:15:40.416883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.593 [2024-11-28 19:15:40.421259] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.593 [2024-11-28 19:15:40.421290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.593 [2024-11-28 19:15:40.421307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.593 [2024-11-28 19:15:40.426084] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.593 [2024-11-28 19:15:40.426115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.593 [2024-11-28 19:15:40.426133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.593 [2024-11-28 19:15:40.430279] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.593 [2024-11-28 19:15:40.430310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.593 [2024-11-28 19:15:40.430334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.593 [2024-11-28 19:15:40.434696] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.593 [2024-11-28 19:15:40.434727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:21920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.593 [2024-11-28 19:15:40.434744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.593 [2024-11-28 19:15:40.438732] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.593 [2024-11-28 19:15:40.438763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.593 [2024-11-28 19:15:40.438780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.593 [2024-11-28 19:15:40.443352] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.593 [2024-11-28 19:15:40.443382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.593 [2024-11-28 19:15:40.443409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.593 [2024-11-28 19:15:40.447744] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.593 [2024-11-28 19:15:40.447775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.593 [2024-11-28 19:15:40.447793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.593 [2024-11-28 19:15:40.451796] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.593 [2024-11-28 19:15:40.451827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.593 [2024-11-28 19:15:40.451844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.593 [2024-11-28 19:15:40.455816] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.593 [2024-11-28 19:15:40.455847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.593 [2024-11-28 19:15:40.455866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.593 [2024-11-28 19:15:40.459911] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.593 [2024-11-28 19:15:40.459941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.593 [2024-11-28 19:15:40.459959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.593 [2024-11-28 19:15:40.465307] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.593 [2024-11-28 19:15:40.465339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:7040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.593 [2024-11-28 19:15:40.465357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.593 [2024-11-28 19:15:40.470407] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.593 [2024-11-28 19:15:40.470438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.593 [2024-11-28 19:15:40.470455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.593 [2024-11-28 19:15:40.476026] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.593 [2024-11-28 19:15:40.476057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.593 [2024-11-28 19:15:40.476083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.593 [2024-11-28 19:15:40.481082] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.593 [2024-11-28 19:15:40.481114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.593 [2024-11-28 19:15:40.481133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.593 [2024-11-28 19:15:40.486207] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.593 [2024-11-28 19:15:40.486238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.593 [2024-11-28 19:15:40.486255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.593 [2024-11-28 19:15:40.489249] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.593 [2024-11-28 19:15:40.489278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.593 [2024-11-28 19:15:40.489296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.593 [2024-11-28 19:15:40.494001] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.593 [2024-11-28 19:15:40.494030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.593 [2024-11-28 19:15:40.494063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.593 [2024-11-28 19:15:40.498460] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.593 [2024-11-28 19:15:40.498488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.593 [2024-11-28 19:15:40.498522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.593 [2024-11-28 19:15:40.503386] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.593 [2024-11-28 19:15:40.503425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.593 [2024-11-28 19:15:40.503442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.593 [2024-11-28 19:15:40.507898] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.593 [2024-11-28 19:15:40.507928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.593 [2024-11-28 19:15:40.507950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.593 [2024-11-28 19:15:40.510991] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.593 [2024-11-28 19:15:40.511021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.593 [2024-11-28 19:15:40.511038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.593 [2024-11-28 19:15:40.514548] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.593 [2024-11-28 19:15:40.514578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.593 [2024-11-28 19:15:40.514595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.593 [2024-11-28 19:15:40.518120] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.593 [2024-11-28 19:15:40.518149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:6560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.593 [2024-11-28 19:15:40.518166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.593 [2024-11-28 19:15:40.521373] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.593 [2024-11-28 19:15:40.521409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.594 [2024-11-28 19:15:40.521428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.594 [2024-11-28 19:15:40.525119] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.594 [2024-11-28 19:15:40.525149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.594 [2024-11-28 19:15:40.525166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.594 [2024-11-28 19:15:40.528225] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.594 [2024-11-28 19:15:40.528254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.594 [2024-11-28 19:15:40.528271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.594 [2024-11-28 19:15:40.531921] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.594 [2024-11-28 19:15:40.531949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.594 [2024-11-28 19:15:40.531966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.594 [2024-11-28 19:15:40.535740] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.594 [2024-11-28 19:15:40.535768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:23168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.594 [2024-11-28 19:15:40.535784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.594 [2024-11-28 19:15:40.539953] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.594 [2024-11-28 19:15:40.539987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:12032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.594 [2024-11-28 19:15:40.540004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.594 [2024-11-28 19:15:40.544281] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.594 [2024-11-28 19:15:40.544309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.594 [2024-11-28 19:15:40.544325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.594 [2024-11-28 19:15:40.549511] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.594 [2024-11-28 19:15:40.549542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.594 [2024-11-28 19:15:40.549559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.594 [2024-11-28 19:15:40.556072] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.594 [2024-11-28 19:15:40.556101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.594 [2024-11-28 19:15:40.556133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.594 [2024-11-28 19:15:40.562924] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.594 [2024-11-28 19:15:40.562955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.594 [2024-11-28 19:15:40.562972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.594 [2024-11-28 19:15:40.568487] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.594 [2024-11-28 19:15:40.568515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.594 [2024-11-28 19:15:40.568532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.594 [2024-11-28 19:15:40.573868] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.594 [2024-11-28 19:15:40.573902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.594 [2024-11-28 19:15:40.573921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.594 [2024-11-28 19:15:40.579413] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.594 [2024-11-28 19:15:40.579450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:16192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.594 [2024-11-28 19:15:40.579467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.594 [2024-11-28 19:15:40.584653] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.594 [2024-11-28 19:15:40.584701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.594 [2024-11-28 19:15:40.584721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.594 [2024-11-28 19:15:40.590679] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.594 [2024-11-28 19:15:40.590708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.594 [2024-11-28 19:15:40.590742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.594 [2024-11-28 19:15:40.597023] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.594 [2024-11-28 19:15:40.597054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.594 [2024-11-28 19:15:40.597071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.594 [2024-11-28 19:15:40.603190] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.594 [2024-11-28 19:15:40.603220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.594 [2024-11-28 19:15:40.603238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.594 [2024-11-28 19:15:40.609465] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.594 [2024-11-28 19:15:40.609495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:9728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.594 [2024-11-28 19:15:40.609512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.594 [2024-11-28 19:15:40.615208] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.594 [2024-11-28 19:15:40.615239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.594 [2024-11-28 19:15:40.615257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.594 [2024-11-28 19:15:40.620824] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.594 [2024-11-28 19:15:40.620855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.594 [2024-11-28 19:15:40.620872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.594 [2024-11-28 19:15:40.625784] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.594 [2024-11-28 19:15:40.625814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.594 [2024-11-28 19:15:40.625831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.594 [2024-11-28 19:15:40.631556] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.594 [2024-11-28 19:15:40.631586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.594 [2024-11-28 19:15:40.631603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.856 [2024-11-28 19:15:40.638737] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.856 [2024-11-28 19:15:40.638768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.856 [2024-11-28 19:15:40.638792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.856 [2024-11-28 19:15:40.645291] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.856 [2024-11-28 19:15:40.645322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.856 [2024-11-28 19:15:40.645339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.856 [2024-11-28 19:15:40.651620] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.856 [2024-11-28 19:15:40.651651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.856 [2024-11-28 19:15:40.651668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.856 [2024-11-28 19:15:40.658166] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.856 [2024-11-28 19:15:40.658196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:3168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.856 [2024-11-28 19:15:40.658214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.856 [2024-11-28 19:15:40.663729] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.856 [2024-11-28 19:15:40.663760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.856 [2024-11-28 19:15:40.663777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.856 [2024-11-28 19:15:40.667898] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.856 [2024-11-28 19:15:40.667928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.856 [2024-11-28 19:15:40.667945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.856 [2024-11-28 19:15:40.671576] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.856 [2024-11-28 19:15:40.671605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.856 [2024-11-28 19:15:40.671622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.856 [2024-11-28 19:15:40.675273] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.856 [2024-11-28 19:15:40.675301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.856 [2024-11-28 19:15:40.675318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.856 [2024-11-28 19:15:40.679415] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.856 [2024-11-28 19:15:40.679445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.856 [2024-11-28 19:15:40.679462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.856 [2024-11-28 19:15:40.684592] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.856 [2024-11-28 19:15:40.684627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:19552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.856 [2024-11-28 19:15:40.684646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.856 [2024-11-28 19:15:40.690642] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.856 [2024-11-28 19:15:40.690672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.856 [2024-11-28 19:15:40.690688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.856 [2024-11-28 19:15:40.695756] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.856 [2024-11-28 19:15:40.695787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:12672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.856 [2024-11-28 19:15:40.695804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.856 [2024-11-28 19:15:40.701893] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.856 [2024-11-28 19:15:40.701923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.856 [2024-11-28 19:15:40.701941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.856 [2024-11-28 19:15:40.707697] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.856 [2024-11-28 19:15:40.707728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.856 [2024-11-28 19:15:40.707745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.856 [2024-11-28 19:15:40.714121] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.856 [2024-11-28 19:15:40.714151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:1824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.856 [2024-11-28 19:15:40.714168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.856 [2024-11-28 19:15:40.718583] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.856 [2024-11-28 19:15:40.718614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:2880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.856 [2024-11-28 19:15:40.718631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.856 [2024-11-28 19:15:40.721987] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.856 [2024-11-28 19:15:40.722017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:2272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.856 [2024-11-28 19:15:40.722034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.856 [2024-11-28 19:15:40.727649] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.856 [2024-11-28 19:15:40.727679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.857 [2024-11-28 19:15:40.727697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.857 [2024-11-28 19:15:40.733056] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.857 [2024-11-28 19:15:40.733087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.857 [2024-11-28 19:15:40.733104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.857 [2024-11-28 19:15:40.738078] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.857 [2024-11-28 19:15:40.738109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.857 [2024-11-28 19:15:40.738126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.857 [2024-11-28 19:15:40.742012] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.857 [2024-11-28 19:15:40.742042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.857 [2024-11-28 19:15:40.742059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.857 [2024-11-28 19:15:40.745763] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.857 [2024-11-28 19:15:40.745808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.857 [2024-11-28 19:15:40.745825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.857 [2024-11-28 19:15:40.750726] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.857 [2024-11-28 19:15:40.750756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.857 [2024-11-28 19:15:40.750774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.857 [2024-11-28 19:15:40.755624] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.857 [2024-11-28 19:15:40.755654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.857 [2024-11-28 19:15:40.755671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.857 [2024-11-28 19:15:40.761520] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.857 [2024-11-28 19:15:40.761551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.857 [2024-11-28 19:15:40.761569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.857 [2024-11-28 19:15:40.769018] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.857 [2024-11-28 19:15:40.769049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.857 [2024-11-28 19:15:40.769065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.857 [2024-11-28 19:15:40.774705] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.857 [2024-11-28 19:15:40.774739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.857 [2024-11-28 19:15:40.774764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.857 [2024-11-28 19:15:40.780099] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.857 [2024-11-28 19:15:40.780143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.857 [2024-11-28 19:15:40.780163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.857 [2024-11-28 19:15:40.785742] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.857 [2024-11-28 19:15:40.785787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.857 [2024-11-28 19:15:40.785807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.857 [2024-11-28 19:15:40.790822] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.857 [2024-11-28 19:15:40.790852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.857 [2024-11-28 19:15:40.790870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.857 [2024-11-28 19:15:40.795320] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.857 [2024-11-28 19:15:40.795350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.857 [2024-11-28 19:15:40.795366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.857 [2024-11-28 19:15:40.799831] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.857 [2024-11-28 19:15:40.799864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.857 [2024-11-28 19:15:40.799882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.857 [2024-11-28 19:15:40.804520] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.857 [2024-11-28 19:15:40.804550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.857 [2024-11-28 19:15:40.804567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.857 [2024-11-28 19:15:40.809418] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.857 [2024-11-28 19:15:40.809449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:12480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.857 [2024-11-28 19:15:40.809467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.857 [2024-11-28 19:15:40.815343] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.857 [2024-11-28 19:15:40.815374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.857 [2024-11-28 19:15:40.815391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.857 [2024-11-28 19:15:40.822769] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.857 [2024-11-28 19:15:40.822798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.857 [2024-11-28 19:15:40.822815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.857 [2024-11-28 19:15:40.828638] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.857 [2024-11-28 19:15:40.828684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.857 [2024-11-28 19:15:40.828703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.857 [2024-11-28 19:15:40.834405] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.857 [2024-11-28 19:15:40.834452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.857 [2024-11-28 19:15:40.834469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.857 [2024-11-28 19:15:40.839482] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.857 [2024-11-28 19:15:40.839510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.857 [2024-11-28 19:15:40.839527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.857 [2024-11-28 19:15:40.845536] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.857 [2024-11-28 19:15:40.845567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.857 [2024-11-28 19:15:40.845584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.857 [2024-11-28 19:15:40.851264] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.857 [2024-11-28 19:15:40.851298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.857 [2024-11-28 19:15:40.851317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.857 [2024-11-28 19:15:40.857379] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.857 [2024-11-28 19:15:40.857418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.857 [2024-11-28 19:15:40.857436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.857 [2024-11-28 19:15:40.863774] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.857 [2024-11-28 19:15:40.863805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:11264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.857 [2024-11-28 19:15:40.863822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.857 [2024-11-28 19:15:40.868693] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.857 [2024-11-28 19:15:40.868724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.857 [2024-11-28 19:15:40.868746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.857 [2024-11-28 19:15:40.873539] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.857 [2024-11-28 19:15:40.873568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.857 [2024-11-28 19:15:40.873586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.858 [2024-11-28 19:15:40.877542] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.858 [2024-11-28 19:15:40.877572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.858 [2024-11-28 19:15:40.877589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.858 [2024-11-28 19:15:40.881172] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.858 [2024-11-28 19:15:40.881202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.858 [2024-11-28 19:15:40.881219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:19.858 [2024-11-28 19:15:40.885195] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.858 [2024-11-28 19:15:40.885224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.858 [2024-11-28 19:15:40.885242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:19.858 [2024-11-28 19:15:40.890484] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.858 [2024-11-28 19:15:40.890515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.858 [2024-11-28 19:15:40.890532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:19.858 [2024-11-28 19:15:40.894853] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.858 [2024-11-28 19:15:40.894884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.858 [2024-11-28 19:15:40.894902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:19.858 [2024-11-28 19:15:40.898974] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:19.858 [2024-11-28 19:15:40.899004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:19.858 [2024-11-28 19:15:40.899021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.119 [2024-11-28 19:15:40.902643] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.119 [2024-11-28 19:15:40.902675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.119 [2024-11-28 19:15:40.902692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.119 [2024-11-28 19:15:40.906810] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.119 [2024-11-28 19:15:40.906846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.119 [2024-11-28 19:15:40.906864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.120 [2024-11-28 19:15:40.911822] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.120 [2024-11-28 19:15:40.911852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.120 [2024-11-28 19:15:40.911869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.120 [2024-11-28 19:15:40.917878] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.120 [2024-11-28 19:15:40.917908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.120 [2024-11-28 19:15:40.917926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.120 [2024-11-28 19:15:40.922513] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.120 [2024-11-28 19:15:40.922542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.120 [2024-11-28 19:15:40.922559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.120 [2024-11-28 19:15:40.926803] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.120 [2024-11-28 19:15:40.926831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.120 [2024-11-28 19:15:40.926847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.120 [2024-11-28 19:15:40.931453] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.120 [2024-11-28 19:15:40.931483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.120 [2024-11-28 19:15:40.931500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.120 [2024-11-28 19:15:40.936648] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.120 [2024-11-28 19:15:40.936678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.120 [2024-11-28 19:15:40.936695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.120 [2024-11-28 19:15:40.940949] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.120 [2024-11-28 19:15:40.940978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:15040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.120 [2024-11-28 19:15:40.940994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.120 [2024-11-28 19:15:40.944978] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.120 [2024-11-28 19:15:40.945007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.120 [2024-11-28 19:15:40.945025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.120 [2024-11-28 19:15:40.949001] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.120 [2024-11-28 19:15:40.949030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.120 [2024-11-28 19:15:40.949047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.120 [2024-11-28 19:15:40.953478] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.120 [2024-11-28 19:15:40.953507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.120 [2024-11-28 19:15:40.953524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.120 [2024-11-28 19:15:40.958266] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.120 [2024-11-28 19:15:40.958295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.120 [2024-11-28 19:15:40.958312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.120 [2024-11-28 19:15:40.962421] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.120 [2024-11-28 19:15:40.962451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.120 [2024-11-28 19:15:40.962467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.120 [2024-11-28 19:15:40.966076] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.120 [2024-11-28 19:15:40.966105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.120 [2024-11-28 19:15:40.966123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.120 [2024-11-28 19:15:40.970572] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.120 [2024-11-28 19:15:40.970601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.120 [2024-11-28 19:15:40.970618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.120 [2024-11-28 19:15:40.974196] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.120 [2024-11-28 19:15:40.974242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.120 [2024-11-28 19:15:40.974259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.120 [2024-11-28 19:15:40.978868] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.120 [2024-11-28 19:15:40.978914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.120 [2024-11-28 19:15:40.978931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.120 [2024-11-28 19:15:40.985644] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.120 [2024-11-28 19:15:40.985691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.120 [2024-11-28 19:15:40.985717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.120 [2024-11-28 19:15:40.993459] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.120 [2024-11-28 19:15:40.993489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.120 [2024-11-28 19:15:40.993507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.120 [2024-11-28 19:15:41.000549] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.120 [2024-11-28 19:15:41.000604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.120 [2024-11-28 19:15:41.000622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.120 [2024-11-28 19:15:41.007543] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.120 [2024-11-28 19:15:41.007586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:18144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.120 [2024-11-28 19:15:41.007602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.120 [2024-11-28 19:15:41.014360] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.120 [2024-11-28 19:15:41.014391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.120 [2024-11-28 19:15:41.014433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.120 [2024-11-28 19:15:41.021293] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.120 [2024-11-28 19:15:41.021324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.120 [2024-11-28 19:15:41.021342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.120 [2024-11-28 19:15:41.025869] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.120 [2024-11-28 19:15:41.025900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:19104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.120 [2024-11-28 19:15:41.025917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.120 [2024-11-28 19:15:41.030725] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.120 [2024-11-28 19:15:41.030756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.120 [2024-11-28 19:15:41.030774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.120 [2024-11-28 19:15:41.035230] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.120 [2024-11-28 19:15:41.035260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:8928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.120 [2024-11-28 19:15:41.035277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.120 [2024-11-28 19:15:41.039661] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.120 [2024-11-28 19:15:41.039699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.120 [2024-11-28 19:15:41.039736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.120 [2024-11-28 19:15:41.045203] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.120 [2024-11-28 19:15:41.045237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.121 [2024-11-28 19:15:41.045256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.121 [2024-11-28 19:15:41.050682] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.121 [2024-11-28 19:15:41.050716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.121 [2024-11-28 19:15:41.050735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.121 [2024-11-28 19:15:41.056455] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.121 [2024-11-28 19:15:41.056499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:16192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.121 [2024-11-28 19:15:41.056515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.121 [2024-11-28 19:15:41.061431] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.121 [2024-11-28 19:15:41.061461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.121 [2024-11-28 19:15:41.061479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.121 [2024-11-28 19:15:41.066055] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.121 [2024-11-28 19:15:41.066085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.121 [2024-11-28 19:15:41.066102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.121 [2024-11-28 19:15:41.070178] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.121 [2024-11-28 19:15:41.070206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:15744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.121 [2024-11-28 19:15:41.070223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.121 [2024-11-28 19:15:41.074329] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.121 [2024-11-28 19:15:41.074358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.121 [2024-11-28 19:15:41.074389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.121 [2024-11-28 19:15:41.078924] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.121 [2024-11-28 19:15:41.078970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.121 [2024-11-28 19:15:41.078987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.121 [2024-11-28 19:15:41.083486] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.121 [2024-11-28 19:15:41.083514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.121 [2024-11-28 19:15:41.083530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.121 [2024-11-28 19:15:41.088896] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.121 [2024-11-28 19:15:41.088929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.121 [2024-11-28 19:15:41.088949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.121 [2024-11-28 19:15:41.094386] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.121 [2024-11-28 19:15:41.094426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:1248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.121 [2024-11-28 19:15:41.094445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.121 [2024-11-28 19:15:41.099796] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.121 [2024-11-28 19:15:41.099845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.121 [2024-11-28 19:15:41.099865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.121 [2024-11-28 19:15:41.105319] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.121 [2024-11-28 19:15:41.105353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.121 [2024-11-28 19:15:41.105372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.121 [2024-11-28 19:15:41.110976] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.121 [2024-11-28 19:15:41.111023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.121 [2024-11-28 19:15:41.111042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.121 [2024-11-28 19:15:41.116466] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.121 [2024-11-28 19:15:41.116495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.121 [2024-11-28 19:15:41.116513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.121 [2024-11-28 19:15:41.121990] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.121 [2024-11-28 19:15:41.122023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.121 [2024-11-28 19:15:41.122042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.121 [2024-11-28 19:15:41.127654] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.121 [2024-11-28 19:15:41.127707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.121 [2024-11-28 19:15:41.127728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.121 [2024-11-28 19:15:41.133003] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.121 [2024-11-28 19:15:41.133032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.121 [2024-11-28 19:15:41.133050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.121 [2024-11-28 19:15:41.138425] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.121 [2024-11-28 19:15:41.138456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.121 [2024-11-28 19:15:41.138473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.121 [2024-11-28 19:15:41.144038] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.121 [2024-11-28 19:15:41.144068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.121 [2024-11-28 19:15:41.144085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.121 [2024-11-28 19:15:41.149149] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.121 [2024-11-28 19:15:41.149179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.121 [2024-11-28 19:15:41.149197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.121 [2024-11-28 19:15:41.153320] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.121 [2024-11-28 19:15:41.153351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.121 [2024-11-28 19:15:41.153368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.121 [2024-11-28 19:15:41.157470] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.121 [2024-11-28 19:15:41.157500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.121 [2024-11-28 19:15:41.157518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.121 [2024-11-28 19:15:41.161806] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.121 [2024-11-28 19:15:41.161835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:11520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.121 [2024-11-28 19:15:41.161852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.381 [2024-11-28 19:15:41.166342] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.381 [2024-11-28 19:15:41.166371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.381 [2024-11-28 19:15:41.166389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.381 [2024-11-28 19:15:41.170712] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.381 [2024-11-28 19:15:41.170741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.381 [2024-11-28 19:15:41.170758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.381 [2024-11-28 19:15:41.174975] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.381 [2024-11-28 19:15:41.175005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.381 [2024-11-28 19:15:41.175022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.381 [2024-11-28 19:15:41.180413] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.381 [2024-11-28 19:15:41.180443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.381 [2024-11-28 19:15:41.180460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.381 [2024-11-28 19:15:41.184644] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.381 [2024-11-28 19:15:41.184674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:16832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.381 [2024-11-28 19:15:41.184691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.381 [2024-11-28 19:15:41.189096] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.381 [2024-11-28 19:15:41.189125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.381 [2024-11-28 19:15:41.189156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.381 [2024-11-28 19:15:41.194596] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.381 [2024-11-28 19:15:41.194627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:5408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.381 [2024-11-28 19:15:41.194644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.381 [2024-11-28 19:15:41.199011] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.381 [2024-11-28 19:15:41.199040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.381 [2024-11-28 19:15:41.199056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.381 [2024-11-28 19:15:41.202855] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.381 [2024-11-28 19:15:41.202885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.381 [2024-11-28 19:15:41.202902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.381 [2024-11-28 19:15:41.207315] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.381 [2024-11-28 19:15:41.207345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.381 [2024-11-28 19:15:41.207368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.381 [2024-11-28 19:15:41.212359] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.381 [2024-11-28 19:15:41.212389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.381 [2024-11-28 19:15:41.212414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.381 [2024-11-28 19:15:41.217148] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.381 [2024-11-28 19:15:41.217178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.381 [2024-11-28 19:15:41.217196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.381 [2024-11-28 19:15:41.222840] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.381 [2024-11-28 19:15:41.222872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.381 [2024-11-28 19:15:41.222889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.381 [2024-11-28 19:15:41.228017] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.381 [2024-11-28 19:15:41.228047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.381 [2024-11-28 19:15:41.228065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.381 [2024-11-28 19:15:41.233111] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.381 [2024-11-28 19:15:41.233141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.381 [2024-11-28 19:15:41.233159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.381 [2024-11-28 19:15:41.238437] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.381 [2024-11-28 19:15:41.238467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.381 [2024-11-28 19:15:41.238484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.381 [2024-11-28 19:15:41.243449] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.381 [2024-11-28 19:15:41.243479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.381 [2024-11-28 19:15:41.243497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.381 [2024-11-28 19:15:41.247995] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.381 [2024-11-28 19:15:41.248024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.382 [2024-11-28 19:15:41.248041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.382 [2024-11-28 19:15:41.252354] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.382 [2024-11-28 19:15:41.252388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:12736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.382 [2024-11-28 19:15:41.252416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.382 [2024-11-28 19:15:41.256937] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.382 [2024-11-28 19:15:41.256980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.382 [2024-11-28 19:15:41.256997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.382 [2024-11-28 19:15:41.261471] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.382 [2024-11-28 19:15:41.261500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:9440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.382 [2024-11-28 19:15:41.261517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.382 [2024-11-28 19:15:41.266026] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.382 [2024-11-28 19:15:41.266054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.382 [2024-11-28 19:15:41.266071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.382 [2024-11-28 19:15:41.270384] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.382 [2024-11-28 19:15:41.270420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.382 [2024-11-28 19:15:41.270437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.382 [2024-11-28 19:15:41.274703] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.382 [2024-11-28 19:15:41.274731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.382 [2024-11-28 19:15:41.274748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.382 [2024-11-28 19:15:41.279198] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.382 [2024-11-28 19:15:41.279227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.382 [2024-11-28 19:15:41.279244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.382 [2024-11-28 19:15:41.284007] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.382 [2024-11-28 19:15:41.284037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.382 [2024-11-28 19:15:41.284055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.382 [2024-11-28 19:15:41.288603] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.382 [2024-11-28 19:15:41.288633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.382 [2024-11-28 19:15:41.288650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.382 [2024-11-28 19:15:41.293038] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.382 [2024-11-28 19:15:41.293068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:21888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.382 [2024-11-28 19:15:41.293085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.382 [2024-11-28 19:15:41.297311] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.382 [2024-11-28 19:15:41.297340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.382 [2024-11-28 19:15:41.297357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.382 [2024-11-28 19:15:41.301987] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.382 [2024-11-28 19:15:41.302017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.382 [2024-11-28 19:15:41.302034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.382 [2024-11-28 19:15:41.307361] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.382 [2024-11-28 19:15:41.307418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.382 [2024-11-28 19:15:41.307441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.382 [2024-11-28 19:15:41.312219] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.382 [2024-11-28 19:15:41.312248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.382 [2024-11-28 19:15:41.312265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.382 [2024-11-28 19:15:41.317469] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.382 [2024-11-28 19:15:41.317500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.382 [2024-11-28 19:15:41.317518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.382 [2024-11-28 19:15:41.322851] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.382 [2024-11-28 19:15:41.322882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.382 [2024-11-28 19:15:41.322899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.382 [2024-11-28 19:15:41.328432] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.382 [2024-11-28 19:15:41.328462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.382 [2024-11-28 19:15:41.328480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.382 [2024-11-28 19:15:41.333266] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.382 [2024-11-28 19:15:41.333296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.382 [2024-11-28 19:15:41.333319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.382 [2024-11-28 19:15:41.338477] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.382 [2024-11-28 19:15:41.338507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.382 [2024-11-28 19:15:41.338525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.382 [2024-11-28 19:15:41.343408] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.382 [2024-11-28 19:15:41.343438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:4896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.382 [2024-11-28 19:15:41.343455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.382 [2024-11-28 19:15:41.347767] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.382 [2024-11-28 19:15:41.347797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.382 [2024-11-28 19:15:41.347814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.382 [2024-11-28 19:15:41.352181] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.382 [2024-11-28 19:15:41.352209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.382 [2024-11-28 19:15:41.352226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.382 [2024-11-28 19:15:41.356514] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.382 [2024-11-28 19:15:41.356551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.382 [2024-11-28 19:15:41.356568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.382 [2024-11-28 19:15:41.361653] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.382 [2024-11-28 19:15:41.361685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.382 [2024-11-28 19:15:41.361702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.382 [2024-11-28 19:15:41.367192] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.382 [2024-11-28 19:15:41.367224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.382 [2024-11-28 19:15:41.367243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.382 [2024-11-28 19:15:41.373181] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.382 [2024-11-28 19:15:41.373212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.382 [2024-11-28 19:15:41.373229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.382 [2024-11-28 19:15:41.380829] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.382 [2024-11-28 19:15:41.380861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.382 [2024-11-28 19:15:41.380879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.383 [2024-11-28 19:15:41.388546] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.383 [2024-11-28 19:15:41.388577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:8000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.383 [2024-11-28 19:15:41.388595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.383 [2024-11-28 19:15:41.396580] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.383 [2024-11-28 19:15:41.396611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.383 [2024-11-28 19:15:41.396630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.383 [2024-11-28 19:15:41.404257] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.383 [2024-11-28 19:15:41.404289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.383 [2024-11-28 19:15:41.404306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.383 [2024-11-28 19:15:41.411037] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.383 [2024-11-28 19:15:41.411069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.383 [2024-11-28 19:15:41.411088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.383 [2024-11-28 19:15:41.417871] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.383 [2024-11-28 19:15:41.417902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:7040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.383 [2024-11-28 19:15:41.417920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.383 [2024-11-28 19:15:41.424709] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.383 [2024-11-28 19:15:41.424740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.383 [2024-11-28 19:15:41.424757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.641 [2024-11-28 19:15:41.431550] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.641 [2024-11-28 19:15:41.431581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:19968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.641 [2024-11-28 19:15:41.431599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.641 [2024-11-28 19:15:41.437647] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.641 [2024-11-28 19:15:41.437677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.641 [2024-11-28 19:15:41.437701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.641 [2024-11-28 19:15:41.444591] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.641 [2024-11-28 19:15:41.444621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.641 [2024-11-28 19:15:41.444638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.641 [2024-11-28 19:15:41.451941] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.641 [2024-11-28 19:15:41.451971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.642 [2024-11-28 19:15:41.451988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.642 [2024-11-28 19:15:41.459957] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.642 [2024-11-28 19:15:41.459987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.642 [2024-11-28 19:15:41.460005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.642 [2024-11-28 19:15:41.467111] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.642 [2024-11-28 19:15:41.467142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.642 [2024-11-28 19:15:41.467159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.642 [2024-11-28 19:15:41.473908] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.642 [2024-11-28 19:15:41.473938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:15904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.642 [2024-11-28 19:15:41.473955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.642 [2024-11-28 19:15:41.478113] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.642 [2024-11-28 19:15:41.478140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.642 [2024-11-28 19:15:41.478172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.642 [2024-11-28 19:15:41.485488] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.642 [2024-11-28 19:15:41.485517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.642 [2024-11-28 19:15:41.485549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.642 [2024-11-28 19:15:41.493264] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.642 [2024-11-28 19:15:41.493295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.642 [2024-11-28 19:15:41.493328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.642 [2024-11-28 19:15:41.501065] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.642 [2024-11-28 19:15:41.501104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.642 [2024-11-28 19:15:41.501138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.642 [2024-11-28 19:15:41.508482] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.642 [2024-11-28 19:15:41.508514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:21792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.642 [2024-11-28 19:15:41.508532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.642 [2024-11-28 19:15:41.513692] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.642 [2024-11-28 19:15:41.513724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.642 [2024-11-28 19:15:41.513741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.642 [2024-11-28 19:15:41.517767] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.642 [2024-11-28 19:15:41.517797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:2400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.642 [2024-11-28 19:15:41.517814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.642 [2024-11-28 19:15:41.521594] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.642 [2024-11-28 19:15:41.521623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.642 [2024-11-28 19:15:41.521640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.642 [2024-11-28 19:15:41.525942] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.642 [2024-11-28 19:15:41.525972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.642 [2024-11-28 19:15:41.525989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.642 [2024-11-28 19:15:41.530031] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.642 [2024-11-28 19:15:41.530061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.642 [2024-11-28 19:15:41.530079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.642 [2024-11-28 19:15:41.533984] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.642 [2024-11-28 19:15:41.534013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.642 [2024-11-28 19:15:41.534030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.642 [2024-11-28 19:15:41.538134] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.642 [2024-11-28 19:15:41.538162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.642 [2024-11-28 19:15:41.538197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.642 [2024-11-28 19:15:41.543051] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.642 [2024-11-28 19:15:41.543081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.642 [2024-11-28 19:15:41.543098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.642 [2024-11-28 19:15:41.546721] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.642 [2024-11-28 19:15:41.546759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.642 [2024-11-28 19:15:41.546791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.642 [2024-11-28 19:15:41.550915] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.642 [2024-11-28 19:15:41.550942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.642 [2024-11-28 19:15:41.550958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.642 [2024-11-28 19:15:41.556037] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.642 [2024-11-28 19:15:41.556067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.642 [2024-11-28 19:15:41.556084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.642 [2024-11-28 19:15:41.559670] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.642 [2024-11-28 19:15:41.559697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.642 [2024-11-28 19:15:41.559728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.642 [2024-11-28 19:15:41.564743] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.642 [2024-11-28 19:15:41.564772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.642 [2024-11-28 19:15:41.564794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.642 [2024-11-28 19:15:41.568512] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.642 [2024-11-28 19:15:41.568540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.642 [2024-11-28 19:15:41.568572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.642 [2024-11-28 19:15:41.572747] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.642 [2024-11-28 19:15:41.572793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.642 [2024-11-28 19:15:41.572810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.642 [2024-11-28 19:15:41.577743] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.642 [2024-11-28 19:15:41.577772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.642 [2024-11-28 19:15:41.577795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.642 [2024-11-28 19:15:41.581346] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.643 [2024-11-28 19:15:41.581388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.643 [2024-11-28 19:15:41.581424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.643 [2024-11-28 19:15:41.586546] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.643 [2024-11-28 19:15:41.586577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.643 [2024-11-28 19:15:41.586595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.643 [2024-11-28 19:15:41.590631] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.643 [2024-11-28 19:15:41.590661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.643 [2024-11-28 19:15:41.590679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.643 [2024-11-28 19:15:41.594994] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.643 [2024-11-28 19:15:41.595034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.643 [2024-11-28 19:15:41.595051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.643 [2024-11-28 19:15:41.599742] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.643 [2024-11-28 19:15:41.599774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.643 [2024-11-28 19:15:41.599805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.643 [2024-11-28 19:15:41.604944] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.643 [2024-11-28 19:15:41.604974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:13440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.643 [2024-11-28 19:15:41.605005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.643 [2024-11-28 19:15:41.610603] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.643 [2024-11-28 19:15:41.610634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.643 [2024-11-28 19:15:41.610651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.643 [2024-11-28 19:15:41.616359] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.643 [2024-11-28 19:15:41.616413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.643 [2024-11-28 19:15:41.616432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.643 [2024-11-28 19:15:41.621546] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.643 [2024-11-28 19:15:41.621581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.643 [2024-11-28 19:15:41.621613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.643 [2024-11-28 19:15:41.628037] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.643 [2024-11-28 19:15:41.628068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.643 [2024-11-28 19:15:41.628086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.643 [2024-11-28 19:15:41.631829] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.643 [2024-11-28 19:15:41.631857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.643 [2024-11-28 19:15:41.631890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.643 [2024-11-28 19:15:41.636070] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.643 [2024-11-28 19:15:41.636102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:21600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.643 [2024-11-28 19:15:41.636121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.643 [2024-11-28 19:15:41.640508] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.643 [2024-11-28 19:15:41.640537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.643 [2024-11-28 19:15:41.640554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.643 [2024-11-28 19:15:41.644849] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.643 [2024-11-28 19:15:41.644882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.643 [2024-11-28 19:15:41.644900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.643 [2024-11-28 19:15:41.649214] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.643 [2024-11-28 19:15:41.649247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.643 [2024-11-28 19:15:41.649266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.643 [2024-11-28 19:15:41.653708] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.643 [2024-11-28 19:15:41.653738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:7424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.643 [2024-11-28 19:15:41.653755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.643 [2024-11-28 19:15:41.658044] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.643 [2024-11-28 19:15:41.658071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.643 [2024-11-28 19:15:41.658107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.643 [2024-11-28 19:15:41.662337] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.643 [2024-11-28 19:15:41.662388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:10944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.643 [2024-11-28 19:15:41.662413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.643 [2024-11-28 19:15:41.667563] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.643 [2024-11-28 19:15:41.667591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.643 [2024-11-28 19:15:41.667623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.643 [2024-11-28 19:15:41.673767] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.643 [2024-11-28 19:15:41.673801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.643 [2024-11-28 19:15:41.673820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.643 [2024-11-28 19:15:41.679298] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.643 [2024-11-28 19:15:41.679343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.643 [2024-11-28 19:15:41.679360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.643 [2024-11-28 19:15:41.684616] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.643 [2024-11-28 19:15:41.684646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.643 [2024-11-28 19:15:41.684679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.902 [2024-11-28 19:15:41.689463] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.902 [2024-11-28 19:15:41.689492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.902 [2024-11-28 19:15:41.689524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.902 [2024-11-28 19:15:41.694457] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.902 [2024-11-28 19:15:41.694487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.902 [2024-11-28 19:15:41.694505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.902 [2024-11-28 19:15:41.698934] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.902 [2024-11-28 19:15:41.698967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.902 [2024-11-28 19:15:41.698986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.902 [2024-11-28 19:15:41.703079] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.902 [2024-11-28 19:15:41.703114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.902 [2024-11-28 19:15:41.703131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.902 [2024-11-28 19:15:41.707318] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.902 [2024-11-28 19:15:41.707346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.902 [2024-11-28 19:15:41.707383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.902 [2024-11-28 19:15:41.711552] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.902 [2024-11-28 19:15:41.711580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.902 [2024-11-28 19:15:41.711611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.902 [2024-11-28 19:15:41.715749] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.902 [2024-11-28 19:15:41.715777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.902 [2024-11-28 19:15:41.715808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.902 [2024-11-28 19:15:41.719871] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.902 [2024-11-28 19:15:41.719898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:21792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.902 [2024-11-28 19:15:41.719929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.902 [2024-11-28 19:15:41.724849] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.902 [2024-11-28 19:15:41.724880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.902 [2024-11-28 19:15:41.724898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.902 [2024-11-28 19:15:41.728475] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.902 [2024-11-28 19:15:41.728512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.902 [2024-11-28 19:15:41.728544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.902 [2024-11-28 19:15:41.732731] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.902 [2024-11-28 19:15:41.732758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.902 [2024-11-28 19:15:41.732790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.902 [2024-11-28 19:15:41.737770] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.902 [2024-11-28 19:15:41.737803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.902 [2024-11-28 19:15:41.737821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.903 [2024-11-28 19:15:41.741638] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.903 [2024-11-28 19:15:41.741681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.903 [2024-11-28 19:15:41.741698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.903 [2024-11-28 19:15:41.745874] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.903 [2024-11-28 19:15:41.745901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.903 [2024-11-28 19:15:41.745917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.903 [2024-11-28 19:15:41.749864] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.903 [2024-11-28 19:15:41.749891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.903 [2024-11-28 19:15:41.749923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.903 [2024-11-28 19:15:41.754256] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.903 [2024-11-28 19:15:41.754298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.903 [2024-11-28 19:15:41.754314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.903 [2024-11-28 19:15:41.758651] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.903 [2024-11-28 19:15:41.758679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.903 [2024-11-28 19:15:41.758711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.903 [2024-11-28 19:15:41.762954] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.903 [2024-11-28 19:15:41.762985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:14816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.903 [2024-11-28 19:15:41.763004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.903 [2024-11-28 19:15:41.767500] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.903 [2024-11-28 19:15:41.767528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.903 [2024-11-28 19:15:41.767560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.903 [2024-11-28 19:15:41.772535] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.903 [2024-11-28 19:15:41.772563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.903 [2024-11-28 19:15:41.772594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.903 [2024-11-28 19:15:41.777945] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.903 [2024-11-28 19:15:41.777979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.903 [2024-11-28 19:15:41.778004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.903 [2024-11-28 19:15:41.783593] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.903 [2024-11-28 19:15:41.783622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.903 [2024-11-28 19:15:41.783655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.903 [2024-11-28 19:15:41.788568] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.903 [2024-11-28 19:15:41.788598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.903 [2024-11-28 19:15:41.788615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.903 [2024-11-28 19:15:41.793419] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.903 [2024-11-28 19:15:41.793450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.903 [2024-11-28 19:15:41.793467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.903 [2024-11-28 19:15:41.798769] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.903 [2024-11-28 19:15:41.798814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.903 [2024-11-28 19:15:41.798830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.903 [2024-11-28 19:15:41.804797] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.903 [2024-11-28 19:15:41.804840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.903 [2024-11-28 19:15:41.804856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.903 [2024-11-28 19:15:41.810247] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.903 [2024-11-28 19:15:41.810291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.903 [2024-11-28 19:15:41.810308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.903 [2024-11-28 19:15:41.815188] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.903 [2024-11-28 19:15:41.815219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.903 [2024-11-28 19:15:41.815237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.903 [2024-11-28 19:15:41.820037] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.903 [2024-11-28 19:15:41.820071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.903 [2024-11-28 19:15:41.820092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.903 [2024-11-28 19:15:41.825509] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.903 [2024-11-28 19:15:41.825558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.903 [2024-11-28 19:15:41.825575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.903 [2024-11-28 19:15:41.831147] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.903 [2024-11-28 19:15:41.831192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.903 [2024-11-28 19:15:41.831209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.903 [2024-11-28 19:15:41.836842] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.903 [2024-11-28 19:15:41.836873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.903 [2024-11-28 19:15:41.836890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.903 [2024-11-28 19:15:41.842139] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.903 [2024-11-28 19:15:41.842183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.903 [2024-11-28 19:15:41.842200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.903 [2024-11-28 19:15:41.848023] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.903 [2024-11-28 19:15:41.848053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.903 [2024-11-28 19:15:41.848084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.903 [2024-11-28 19:15:41.853265] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.903 [2024-11-28 19:15:41.853296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.903 [2024-11-28 19:15:41.853314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.903 [2024-11-28 19:15:41.858958] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.903 [2024-11-28 19:15:41.858988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.903 [2024-11-28 19:15:41.859006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.903 [2024-11-28 19:15:41.863451] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.903 [2024-11-28 19:15:41.863481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.903 [2024-11-28 19:15:41.863498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.903 [2024-11-28 19:15:41.868287] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.903 [2024-11-28 19:15:41.868332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.903 [2024-11-28 19:15:41.868349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.903 [2024-11-28 19:15:41.873477] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.903 [2024-11-28 19:15:41.873506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:15936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.903 [2024-11-28 19:15:41.873539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.904 [2024-11-28 19:15:41.878538] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.904 [2024-11-28 19:15:41.878567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.904 [2024-11-28 19:15:41.878600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.904 [2024-11-28 19:15:41.883022] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.904 [2024-11-28 19:15:41.883052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.904 [2024-11-28 19:15:41.883069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.904 [2024-11-28 19:15:41.887485] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.904 [2024-11-28 19:15:41.887514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.904 [2024-11-28 19:15:41.887546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.904 [2024-11-28 19:15:41.892279] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.904 [2024-11-28 19:15:41.892308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.904 [2024-11-28 19:15:41.892341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.904 [2024-11-28 19:15:41.897230] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.904 [2024-11-28 19:15:41.897259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.904 [2024-11-28 19:15:41.897293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.904 [2024-11-28 19:15:41.901637] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.904 [2024-11-28 19:15:41.901665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.904 [2024-11-28 19:15:41.901698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.904 [2024-11-28 19:15:41.906053] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.904 [2024-11-28 19:15:41.906082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.904 [2024-11-28 19:15:41.906099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.904 [2024-11-28 19:15:41.910349] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.904 [2024-11-28 19:15:41.910377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.904 [2024-11-28 19:15:41.910406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.904 [2024-11-28 19:15:41.914569] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.904 [2024-11-28 19:15:41.914597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.904 [2024-11-28 19:15:41.914630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.904 [2024-11-28 19:15:41.919015] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.904 [2024-11-28 19:15:41.919043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.904 [2024-11-28 19:15:41.919059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.904 [2024-11-28 19:15:41.923228] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.904 [2024-11-28 19:15:41.923257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.904 [2024-11-28 19:15:41.923274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.904 [2024-11-28 19:15:41.927555] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.904 [2024-11-28 19:15:41.927583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.904 [2024-11-28 19:15:41.927600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:20.904 [2024-11-28 19:15:41.931647] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.904 [2024-11-28 19:15:41.931675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.904 [2024-11-28 19:15:41.931692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:20.904 [2024-11-28 19:15:41.935870] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.904 [2024-11-28 19:15:41.935898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.904 [2024-11-28 19:15:41.935914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:20.904 [2024-11-28 19:15:41.940299] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.904 [2024-11-28 19:15:41.940328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.904 [2024-11-28 19:15:41.940344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:20.904 [2024-11-28 19:15:41.944589] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:20.904 [2024-11-28 19:15:41.944617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:20.904 [2024-11-28 19:15:41.944633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.163 [2024-11-28 19:15:41.949867] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.163 [2024-11-28 19:15:41.949918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.163 [2024-11-28 19:15:41.949936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.163 [2024-11-28 19:15:41.954748] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.163 [2024-11-28 19:15:41.954781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.163 [2024-11-28 19:15:41.954800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.163 [2024-11-28 19:15:41.959314] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.163 [2024-11-28 19:15:41.959344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.163 [2024-11-28 19:15:41.959361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.163 [2024-11-28 19:15:41.962858] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.163 [2024-11-28 19:15:41.962888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.163 [2024-11-28 19:15:41.962905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.163 [2024-11-28 19:15:41.966913] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.163 [2024-11-28 19:15:41.966942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:2720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.163 [2024-11-28 19:15:41.966959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.163 [2024-11-28 19:15:41.971203] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.163 [2024-11-28 19:15:41.971232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.163 [2024-11-28 19:15:41.971249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.163 [2024-11-28 19:15:41.975483] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.163 [2024-11-28 19:15:41.975513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.163 [2024-11-28 19:15:41.975530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.163 [2024-11-28 19:15:41.980247] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.163 [2024-11-28 19:15:41.980277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.163 [2024-11-28 19:15:41.980294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.163 [2024-11-28 19:15:41.984504] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.163 [2024-11-28 19:15:41.984548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.163 [2024-11-28 19:15:41.984571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.163 [2024-11-28 19:15:41.989469] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.163 [2024-11-28 19:15:41.989498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.163 [2024-11-28 19:15:41.989529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.163 [2024-11-28 19:15:41.994083] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.163 [2024-11-28 19:15:41.994114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.163 [2024-11-28 19:15:41.994133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.163 [2024-11-28 19:15:41.999261] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.163 [2024-11-28 19:15:41.999290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.163 [2024-11-28 19:15:41.999307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.163 [2024-11-28 19:15:42.004351] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.163 [2024-11-28 19:15:42.004381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.163 [2024-11-28 19:15:42.004406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.163 [2024-11-28 19:15:42.009809] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.163 [2024-11-28 19:15:42.009838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:23904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.163 [2024-11-28 19:15:42.009855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.163 [2024-11-28 19:15:42.015062] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.163 [2024-11-28 19:15:42.015093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.163 [2024-11-28 19:15:42.015110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.163 [2024-11-28 19:15:42.020580] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.163 [2024-11-28 19:15:42.020610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:13664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.163 [2024-11-28 19:15:42.020628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.164 [2024-11-28 19:15:42.026240] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.164 [2024-11-28 19:15:42.026270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.164 [2024-11-28 19:15:42.026288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.164 [2024-11-28 19:15:42.032132] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.164 [2024-11-28 19:15:42.032167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.164 [2024-11-28 19:15:42.032185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.164 [2024-11-28 19:15:42.038345] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.164 [2024-11-28 19:15:42.038375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:25568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.164 [2024-11-28 19:15:42.038402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.164 [2024-11-28 19:15:42.043588] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.164 [2024-11-28 19:15:42.043618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.164 [2024-11-28 19:15:42.043635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.164 [2024-11-28 19:15:42.049359] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.164 [2024-11-28 19:15:42.049416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.164 [2024-11-28 19:15:42.049437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.164 [2024-11-28 19:15:42.055922] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.164 [2024-11-28 19:15:42.055952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.164 [2024-11-28 19:15:42.055970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.164 [2024-11-28 19:15:42.060930] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.164 [2024-11-28 19:15:42.060960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:3584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.164 [2024-11-28 19:15:42.060977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.164 [2024-11-28 19:15:42.065615] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.164 [2024-11-28 19:15:42.065645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.164 [2024-11-28 19:15:42.065662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.164 [2024-11-28 19:15:42.070358] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.164 [2024-11-28 19:15:42.070388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.164 [2024-11-28 19:15:42.070415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.164 [2024-11-28 19:15:42.075269] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.164 [2024-11-28 19:15:42.075299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.164 [2024-11-28 19:15:42.075316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.164 [2024-11-28 19:15:42.080525] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.164 [2024-11-28 19:15:42.080571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.164 [2024-11-28 19:15:42.080588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.164 [2024-11-28 19:15:42.084180] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.164 [2024-11-28 19:15:42.084210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.164 [2024-11-28 19:15:42.084227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.164 [2024-11-28 19:15:42.087667] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.164 [2024-11-28 19:15:42.087696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:17536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.164 [2024-11-28 19:15:42.087713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.164 [2024-11-28 19:15:42.091365] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.164 [2024-11-28 19:15:42.091402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.164 [2024-11-28 19:15:42.091421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.164 [2024-11-28 19:15:42.096088] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.164 [2024-11-28 19:15:42.096118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.164 [2024-11-28 19:15:42.096135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.164 [2024-11-28 19:15:42.100733] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.164 [2024-11-28 19:15:42.100763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:9824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.164 [2024-11-28 19:15:42.100780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.164 [2024-11-28 19:15:42.104888] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.164 [2024-11-28 19:15:42.104918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.164 [2024-11-28 19:15:42.104935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.164 [2024-11-28 19:15:42.108625] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.164 [2024-11-28 19:15:42.108654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.164 [2024-11-28 19:15:42.108670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.164 [2024-11-28 19:15:42.112339] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.164 [2024-11-28 19:15:42.112369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.164 [2024-11-28 19:15:42.112403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.164 [2024-11-28 19:15:42.116664] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.164 [2024-11-28 19:15:42.116704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.164 [2024-11-28 19:15:42.116721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.164 [2024-11-28 19:15:42.121204] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.164 [2024-11-28 19:15:42.121235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:5440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.164 [2024-11-28 19:15:42.121253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.164 [2024-11-28 19:15:42.125771] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.164 [2024-11-28 19:15:42.125801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.164 [2024-11-28 19:15:42.125820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.165 [2024-11-28 19:15:42.130277] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.165 [2024-11-28 19:15:42.130306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.165 [2024-11-28 19:15:42.130323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.165 [2024-11-28 19:15:42.135040] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.165 [2024-11-28 19:15:42.135070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.165 [2024-11-28 19:15:42.135087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.165 [2024-11-28 19:15:42.141097] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.165 [2024-11-28 19:15:42.141127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:21504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.165 [2024-11-28 19:15:42.141144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.165 [2024-11-28 19:15:42.145939] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.165 [2024-11-28 19:15:42.145970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:3136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.165 [2024-11-28 19:15:42.145988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.165 [2024-11-28 19:15:42.150268] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.165 [2024-11-28 19:15:42.150298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.165 [2024-11-28 19:15:42.150315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.165 [2024-11-28 19:15:42.154543] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.165 [2024-11-28 19:15:42.154579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.165 [2024-11-28 19:15:42.154597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.165 [2024-11-28 19:15:42.158953] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.165 [2024-11-28 19:15:42.158983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.165 [2024-11-28 19:15:42.158999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.165 [2024-11-28 19:15:42.163681] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.165 [2024-11-28 19:15:42.163710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:5536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.165 [2024-11-28 19:15:42.163727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:21.165 [2024-11-28 19:15:42.169069] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.165 [2024-11-28 19:15:42.169099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.165 [2024-11-28 19:15:42.169116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:21.165 [2024-11-28 19:15:42.174254] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.165 [2024-11-28 19:15:42.174284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.165 [2024-11-28 19:15:42.174302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:21.165 [2024-11-28 19:15:42.179593] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1837bb0) 00:27:21.165 [2024-11-28 19:15:42.179622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:21.165 [2024-11-28 19:15:42.179639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:21.165 00:27:21.165 Latency(us) 00:27:21.165 [2024-11-28T18:15:42.213Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:21.165 [2024-11-28T18:15:42.213Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:27:21.165 nvme0n1 : 2.00 6223.18 777.90 0.00 0.00 2566.86 564.34 9369.22 00:27:21.165 [2024-11-28T18:15:42.213Z] =================================================================================================================== 00:27:21.165 [2024-11-28T18:15:42.213Z] Total : 6223.18 777.90 0.00 0.00 2566.86 564.34 9369.22 00:27:21.165 0 00:27:21.165 19:15:42 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:21.165 19:15:42 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:21.165 19:15:42 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:21.165 19:15:42 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:21.165 | .driver_specific 00:27:21.165 | .nvme_error 00:27:21.165 | .status_code 00:27:21.165 | .command_transient_transport_error' 00:27:21.423 19:15:42 -- host/digest.sh@71 -- # (( 401 > 0 )) 00:27:21.423 19:15:42 -- host/digest.sh@73 -- # killprocess 320232 00:27:21.423 19:15:42 -- common/autotest_common.sh@936 -- # '[' -z 320232 ']' 00:27:21.423 19:15:42 -- common/autotest_common.sh@940 -- # kill -0 320232 00:27:21.423 19:15:42 -- common/autotest_common.sh@941 -- # uname 00:27:21.423 19:15:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:21.423 19:15:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 320232 00:27:21.680 19:15:42 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:21.680 19:15:42 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:21.680 19:15:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 320232' 00:27:21.680 killing process with pid 320232 00:27:21.680 19:15:42 -- common/autotest_common.sh@955 -- # kill 320232 00:27:21.680 Received shutdown signal, test time was about 2.000000 seconds 00:27:21.680 00:27:21.680 Latency(us) 00:27:21.680 [2024-11-28T18:15:42.728Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:21.680 [2024-11-28T18:15:42.728Z] =================================================================================================================== 00:27:21.680 [2024-11-28T18:15:42.728Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:21.680 19:15:42 -- common/autotest_common.sh@960 -- # wait 320232 00:27:21.938 19:15:42 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:27:21.938 19:15:42 -- host/digest.sh@54 -- # local rw bs qd 00:27:21.938 19:15:42 -- host/digest.sh@56 -- # rw=randwrite 00:27:21.938 19:15:42 -- host/digest.sh@56 -- # bs=4096 00:27:21.938 19:15:42 -- host/digest.sh@56 -- # qd=128 00:27:21.938 19:15:42 -- host/digest.sh@58 -- # bperfpid=320782 00:27:21.938 19:15:42 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:27:21.938 19:15:42 -- host/digest.sh@60 -- # waitforlisten 320782 /var/tmp/bperf.sock 00:27:21.938 19:15:42 -- common/autotest_common.sh@829 -- # '[' -z 320782 ']' 00:27:21.938 19:15:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:21.938 19:15:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:21.938 19:15:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:21.938 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:21.938 19:15:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:21.938 19:15:42 -- common/autotest_common.sh@10 -- # set +x 00:27:21.938 [2024-11-28 19:15:42.797414] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:21.938 [2024-11-28 19:15:42.797519] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid320782 ] 00:27:21.938 EAL: No free 2048 kB hugepages reported on node 1 00:27:21.938 [2024-11-28 19:15:42.859866] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:21.938 [2024-11-28 19:15:42.973442] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:22.870 19:15:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:22.870 19:15:43 -- common/autotest_common.sh@862 -- # return 0 00:27:22.870 19:15:43 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:22.870 19:15:43 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:23.128 19:15:44 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:23.128 19:15:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:23.128 19:15:44 -- common/autotest_common.sh@10 -- # set +x 00:27:23.128 19:15:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:23.128 19:15:44 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:23.128 19:15:44 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:23.385 nvme0n1 00:27:23.385 19:15:44 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:27:23.385 19:15:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:23.385 19:15:44 -- common/autotest_common.sh@10 -- # set +x 00:27:23.385 19:15:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:23.385 19:15:44 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:23.385 19:15:44 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:23.644 Running I/O for 2 seconds... 00:27:23.644 [2024-11-28 19:15:44.516980] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:23.644 [2024-11-28 19:15:44.517231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:9181 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.644 [2024-11-28 19:15:44.517274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:23.644 [2024-11-28 19:15:44.530836] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:23.644 [2024-11-28 19:15:44.531111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:15314 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.644 [2024-11-28 19:15:44.531144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:23.644 [2024-11-28 19:15:44.544772] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:23.645 [2024-11-28 19:15:44.545046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:4862 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.645 [2024-11-28 19:15:44.545080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:23.645 [2024-11-28 19:15:44.558506] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:23.645 [2024-11-28 19:15:44.558787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:12823 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.645 [2024-11-28 19:15:44.558819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:23.645 [2024-11-28 19:15:44.572347] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:23.645 [2024-11-28 19:15:44.572677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:7480 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.645 [2024-11-28 19:15:44.572711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:23.645 [2024-11-28 19:15:44.586095] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:23.645 [2024-11-28 19:15:44.586358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:2637 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.645 [2024-11-28 19:15:44.586390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:23.645 [2024-11-28 19:15:44.599835] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:23.645 [2024-11-28 19:15:44.600094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:3984 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.645 [2024-11-28 19:15:44.600126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:23.645 [2024-11-28 19:15:44.613503] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:23.645 [2024-11-28 19:15:44.613833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:8713 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.645 [2024-11-28 19:15:44.613864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:23.645 [2024-11-28 19:15:44.627251] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:23.645 [2024-11-28 19:15:44.627536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:24304 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.645 [2024-11-28 19:15:44.627565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:23.645 [2024-11-28 19:15:44.640997] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:23.645 [2024-11-28 19:15:44.641260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:20923 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.645 [2024-11-28 19:15:44.641291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:23.645 [2024-11-28 19:15:44.654769] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:23.645 [2024-11-28 19:15:44.655028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:12250 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.645 [2024-11-28 19:15:44.655059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:23.645 [2024-11-28 19:15:44.668407] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:23.645 [2024-11-28 19:15:44.668668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:15842 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.645 [2024-11-28 19:15:44.668714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:23.645 [2024-11-28 19:15:44.682034] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:23.645 [2024-11-28 19:15:44.682292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:1305 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.645 [2024-11-28 19:15:44.682323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:23.904 [2024-11-28 19:15:44.695657] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:23.904 [2024-11-28 19:15:44.695939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:5949 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.904 [2024-11-28 19:15:44.695971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:23.904 [2024-11-28 19:15:44.709228] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:23.904 [2024-11-28 19:15:44.709518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:2412 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.904 [2024-11-28 19:15:44.709547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:23.904 [2024-11-28 19:15:44.722865] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:23.904 [2024-11-28 19:15:44.723125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:17914 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.904 [2024-11-28 19:15:44.723156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:23.904 [2024-11-28 19:15:44.736460] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:23.904 [2024-11-28 19:15:44.736735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:24633 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.904 [2024-11-28 19:15:44.736773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:23.904 [2024-11-28 19:15:44.750117] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:23.904 [2024-11-28 19:15:44.750378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:15333 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.904 [2024-11-28 19:15:44.750422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:23.904 [2024-11-28 19:15:44.763821] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:23.904 [2024-11-28 19:15:44.764083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:7488 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.904 [2024-11-28 19:15:44.764116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:23.904 [2024-11-28 19:15:44.777521] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:23.904 [2024-11-28 19:15:44.777840] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:24986 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.904 [2024-11-28 19:15:44.777869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:23.904 [2024-11-28 19:15:44.790938] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:23.904 [2024-11-28 19:15:44.791208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:14149 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.904 [2024-11-28 19:15:44.791239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:23.904 [2024-11-28 19:15:44.804552] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:23.904 [2024-11-28 19:15:44.804829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:25268 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.904 [2024-11-28 19:15:44.804860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:23.904 [2024-11-28 19:15:44.818091] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:23.904 [2024-11-28 19:15:44.818352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:11718 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.904 [2024-11-28 19:15:44.818384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:23.904 [2024-11-28 19:15:44.831771] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:23.904 [2024-11-28 19:15:44.832032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:9469 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.904 [2024-11-28 19:15:44.832064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:23.904 [2024-11-28 19:15:44.845403] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:23.904 [2024-11-28 19:15:44.845657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:8612 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.904 [2024-11-28 19:15:44.845702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:23.904 [2024-11-28 19:15:44.859087] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:23.904 [2024-11-28 19:15:44.859360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:4765 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.904 [2024-11-28 19:15:44.859400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:23.904 [2024-11-28 19:15:44.872756] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:23.904 [2024-11-28 19:15:44.873016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:19675 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.904 [2024-11-28 19:15:44.873048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:23.904 [2024-11-28 19:15:44.886358] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:23.904 [2024-11-28 19:15:44.886651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:18252 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.904 [2024-11-28 19:15:44.886695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:23.904 [2024-11-28 19:15:44.899981] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:23.904 [2024-11-28 19:15:44.900263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:5418 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.904 [2024-11-28 19:15:44.900295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:23.904 [2024-11-28 19:15:44.913545] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:23.904 [2024-11-28 19:15:44.913805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:1152 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.904 [2024-11-28 19:15:44.913837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:23.904 [2024-11-28 19:15:44.927057] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:23.904 [2024-11-28 19:15:44.927318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:12747 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.904 [2024-11-28 19:15:44.927349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:23.904 [2024-11-28 19:15:44.940568] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:23.904 [2024-11-28 19:15:44.940847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:5278 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:23.904 [2024-11-28 19:15:44.940878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.164 [2024-11-28 19:15:44.954113] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.164 [2024-11-28 19:15:44.954371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:24605 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.164 [2024-11-28 19:15:44.954415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.164 [2024-11-28 19:15:44.967806] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.164 [2024-11-28 19:15:44.968071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:14638 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.164 [2024-11-28 19:15:44.968103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.164 [2024-11-28 19:15:44.981405] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.164 [2024-11-28 19:15:44.981643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:11094 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.164 [2024-11-28 19:15:44.981672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.164 [2024-11-28 19:15:44.995072] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.164 [2024-11-28 19:15:44.995348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:1025 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.164 [2024-11-28 19:15:44.995379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.164 [2024-11-28 19:15:45.008815] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.164 [2024-11-28 19:15:45.009093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:9010 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.164 [2024-11-28 19:15:45.009125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.164 [2024-11-28 19:15:45.022477] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.164 [2024-11-28 19:15:45.022821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:16233 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.164 [2024-11-28 19:15:45.022852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.164 [2024-11-28 19:15:45.036214] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.164 [2024-11-28 19:15:45.036499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:4519 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.164 [2024-11-28 19:15:45.036528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.164 [2024-11-28 19:15:45.049690] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.164 [2024-11-28 19:15:45.049969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:7530 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.164 [2024-11-28 19:15:45.049999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.164 [2024-11-28 19:15:45.063448] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.164 [2024-11-28 19:15:45.063693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:16272 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.164 [2024-11-28 19:15:45.063721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.164 [2024-11-28 19:15:45.077111] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.164 [2024-11-28 19:15:45.077371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:485 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.164 [2024-11-28 19:15:45.077411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.164 [2024-11-28 19:15:45.090830] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.164 [2024-11-28 19:15:45.091089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:15454 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.164 [2024-11-28 19:15:45.091125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.164 [2024-11-28 19:15:45.104508] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.164 [2024-11-28 19:15:45.104768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:25543 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.164 [2024-11-28 19:15:45.104800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.164 [2024-11-28 19:15:45.118124] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.164 [2024-11-28 19:15:45.118383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:6347 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.164 [2024-11-28 19:15:45.118424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.164 [2024-11-28 19:15:45.131869] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.164 [2024-11-28 19:15:45.132138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:17727 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.164 [2024-11-28 19:15:45.132170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.164 [2024-11-28 19:15:45.145498] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.164 [2024-11-28 19:15:45.145778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:14470 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.164 [2024-11-28 19:15:45.145809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.164 [2024-11-28 19:15:45.159056] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.164 [2024-11-28 19:15:45.159314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:7917 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.164 [2024-11-28 19:15:45.159345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.164 [2024-11-28 19:15:45.172660] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.164 [2024-11-28 19:15:45.172947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:16105 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.164 [2024-11-28 19:15:45.172979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.164 [2024-11-28 19:15:45.186356] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.164 [2024-11-28 19:15:45.186647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:5644 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.164 [2024-11-28 19:15:45.186675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.164 [2024-11-28 19:15:45.200081] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.164 [2024-11-28 19:15:45.200340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:3743 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.164 [2024-11-28 19:15:45.200371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.422 [2024-11-28 19:15:45.213741] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.422 [2024-11-28 19:15:45.214000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:25001 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.422 [2024-11-28 19:15:45.214037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.422 [2024-11-28 19:15:45.227406] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.422 [2024-11-28 19:15:45.227668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:10335 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.422 [2024-11-28 19:15:45.227696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.422 [2024-11-28 19:15:45.241016] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.422 [2024-11-28 19:15:45.241243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:6861 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.422 [2024-11-28 19:15:45.241274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.423 [2024-11-28 19:15:45.254660] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.423 [2024-11-28 19:15:45.254931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:11413 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.423 [2024-11-28 19:15:45.254962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.423 [2024-11-28 19:15:45.268369] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.423 [2024-11-28 19:15:45.268638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:8114 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.423 [2024-11-28 19:15:45.268667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.423 [2024-11-28 19:15:45.282032] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.423 [2024-11-28 19:15:45.282290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:5139 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.423 [2024-11-28 19:15:45.282321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.423 [2024-11-28 19:15:45.295649] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.423 [2024-11-28 19:15:45.295930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:1522 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.423 [2024-11-28 19:15:45.295961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.423 [2024-11-28 19:15:45.309213] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.423 [2024-11-28 19:15:45.309497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:24517 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.423 [2024-11-28 19:15:45.309526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.423 [2024-11-28 19:15:45.322835] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.423 [2024-11-28 19:15:45.323104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:15283 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.423 [2024-11-28 19:15:45.323135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.423 [2024-11-28 19:15:45.336538] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.423 [2024-11-28 19:15:45.336859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:10075 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.423 [2024-11-28 19:15:45.336891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.423 [2024-11-28 19:15:45.350208] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.423 [2024-11-28 19:15:45.350489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:16349 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.423 [2024-11-28 19:15:45.350518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.423 [2024-11-28 19:15:45.363953] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.423 [2024-11-28 19:15:45.364210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:16126 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.423 [2024-11-28 19:15:45.364242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.423 [2024-11-28 19:15:45.377559] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.423 [2024-11-28 19:15:45.377918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:4421 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.423 [2024-11-28 19:15:45.377951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.423 [2024-11-28 19:15:45.391225] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.423 [2024-11-28 19:15:45.391511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:7164 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.423 [2024-11-28 19:15:45.391540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.423 [2024-11-28 19:15:45.404864] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.423 [2024-11-28 19:15:45.405122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:5344 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.423 [2024-11-28 19:15:45.405154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.423 [2024-11-28 19:15:45.418523] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.423 [2024-11-28 19:15:45.418866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:20604 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.423 [2024-11-28 19:15:45.418897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.423 [2024-11-28 19:15:45.432160] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.423 [2024-11-28 19:15:45.432440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:5874 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.423 [2024-11-28 19:15:45.432468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.423 [2024-11-28 19:15:45.445861] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.423 [2024-11-28 19:15:45.446122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:13867 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.423 [2024-11-28 19:15:45.446154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.423 [2024-11-28 19:15:45.459226] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.423 [2024-11-28 19:15:45.459520] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:24382 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.423 [2024-11-28 19:15:45.459550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.681 [2024-11-28 19:15:45.472719] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.681 [2024-11-28 19:15:45.472982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:16366 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.681 [2024-11-28 19:15:45.473014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.681 [2024-11-28 19:15:45.486257] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.681 [2024-11-28 19:15:45.486533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:51 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.681 [2024-11-28 19:15:45.486561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.681 [2024-11-28 19:15:45.499822] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.681 [2024-11-28 19:15:45.500089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:19087 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.681 [2024-11-28 19:15:45.500121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.681 [2024-11-28 19:15:45.513592] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.681 [2024-11-28 19:15:45.513932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:2341 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.681 [2024-11-28 19:15:45.513963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.681 [2024-11-28 19:15:45.527267] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.681 [2024-11-28 19:15:45.527529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:22640 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.681 [2024-11-28 19:15:45.527556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.681 [2024-11-28 19:15:45.540876] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.681 [2024-11-28 19:15:45.541146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:20338 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.681 [2024-11-28 19:15:45.541178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.681 [2024-11-28 19:15:45.554495] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.681 [2024-11-28 19:15:45.554791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:5179 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.681 [2024-11-28 19:15:45.554819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.681 [2024-11-28 19:15:45.568009] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.681 [2024-11-28 19:15:45.568270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:10936 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.681 [2024-11-28 19:15:45.568307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.681 [2024-11-28 19:15:45.581682] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.681 [2024-11-28 19:15:45.581962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:13968 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.681 [2024-11-28 19:15:45.581993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.681 [2024-11-28 19:15:45.595340] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.681 [2024-11-28 19:15:45.595658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:23559 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.681 [2024-11-28 19:15:45.595687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.681 [2024-11-28 19:15:45.609038] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.681 [2024-11-28 19:15:45.609293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:14007 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.681 [2024-11-28 19:15:45.609324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.681 [2024-11-28 19:15:45.622704] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.681 [2024-11-28 19:15:45.622965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:23563 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.681 [2024-11-28 19:15:45.622996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.681 [2024-11-28 19:15:45.636372] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.681 [2024-11-28 19:15:45.636675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:4685 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.681 [2024-11-28 19:15:45.636721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.681 [2024-11-28 19:15:45.650030] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.681 [2024-11-28 19:15:45.650288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:62 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.681 [2024-11-28 19:15:45.650319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.681 [2024-11-28 19:15:45.663690] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.681 [2024-11-28 19:15:45.663962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:13304 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.681 [2024-11-28 19:15:45.663993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.681 [2024-11-28 19:15:45.677435] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.681 [2024-11-28 19:15:45.677680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:24348 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.681 [2024-11-28 19:15:45.677723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.681 [2024-11-28 19:15:45.691047] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.681 [2024-11-28 19:15:45.691314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:4370 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.682 [2024-11-28 19:15:45.691344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.682 [2024-11-28 19:15:45.704722] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.682 [2024-11-28 19:15:45.705009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:24398 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.682 [2024-11-28 19:15:45.705040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.682 [2024-11-28 19:15:45.718409] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.682 [2024-11-28 19:15:45.718670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:13921 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.682 [2024-11-28 19:15:45.718697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.940 [2024-11-28 19:15:45.732049] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.940 [2024-11-28 19:15:45.732317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:10717 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.940 [2024-11-28 19:15:45.732348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.940 [2024-11-28 19:15:45.745699] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.940 [2024-11-28 19:15:45.745967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:19391 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.940 [2024-11-28 19:15:45.745998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.940 [2024-11-28 19:15:45.759314] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.940 [2024-11-28 19:15:45.759581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:1889 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.940 [2024-11-28 19:15:45.759610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.940 [2024-11-28 19:15:45.773042] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.940 [2024-11-28 19:15:45.773300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:13003 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.940 [2024-11-28 19:15:45.773332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.940 [2024-11-28 19:15:45.786639] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.940 [2024-11-28 19:15:45.786920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:8242 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.940 [2024-11-28 19:15:45.786952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.940 [2024-11-28 19:15:45.800316] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.940 [2024-11-28 19:15:45.800586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:19615 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.940 [2024-11-28 19:15:45.800616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.940 [2024-11-28 19:15:45.813984] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.940 [2024-11-28 19:15:45.814250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:15251 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.940 [2024-11-28 19:15:45.814281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.940 [2024-11-28 19:15:45.827589] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.940 [2024-11-28 19:15:45.827869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:1658 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.940 [2024-11-28 19:15:45.827901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.940 [2024-11-28 19:15:45.841248] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.940 [2024-11-28 19:15:45.841522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:12778 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.940 [2024-11-28 19:15:45.841551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.940 [2024-11-28 19:15:45.854952] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.940 [2024-11-28 19:15:45.855209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:9586 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.940 [2024-11-28 19:15:45.855239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.940 [2024-11-28 19:15:45.868601] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.940 [2024-11-28 19:15:45.868868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:8682 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.940 [2024-11-28 19:15:45.868898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.940 [2024-11-28 19:15:45.882268] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.940 [2024-11-28 19:15:45.882545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:1315 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.940 [2024-11-28 19:15:45.882572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.940 [2024-11-28 19:15:45.895951] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.940 [2024-11-28 19:15:45.896218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:11463 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.940 [2024-11-28 19:15:45.896249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.940 [2024-11-28 19:15:45.909620] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.940 [2024-11-28 19:15:45.909892] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:1379 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.940 [2024-11-28 19:15:45.909923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.940 [2024-11-28 19:15:45.923305] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.940 [2024-11-28 19:15:45.923574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:8547 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.940 [2024-11-28 19:15:45.923608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.941 [2024-11-28 19:15:45.936942] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.941 [2024-11-28 19:15:45.937200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:4844 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.941 [2024-11-28 19:15:45.937231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.941 [2024-11-28 19:15:45.950624] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.941 [2024-11-28 19:15:45.950897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:6780 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.941 [2024-11-28 19:15:45.950927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.941 [2024-11-28 19:15:45.964281] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.941 [2024-11-28 19:15:45.964549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:19218 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.941 [2024-11-28 19:15:45.964577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:24.941 [2024-11-28 19:15:45.977953] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:24.941 [2024-11-28 19:15:45.978208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:13284 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:24.941 [2024-11-28 19:15:45.978239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.199 [2024-11-28 19:15:45.991555] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.199 [2024-11-28 19:15:45.991829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:8811 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.199 [2024-11-28 19:15:45.991860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.199 [2024-11-28 19:15:46.005218] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.199 [2024-11-28 19:15:46.005511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:17064 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.199 [2024-11-28 19:15:46.005541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.199 [2024-11-28 19:15:46.018881] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.199 [2024-11-28 19:15:46.019139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:6793 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.199 [2024-11-28 19:15:46.019170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.199 [2024-11-28 19:15:46.032542] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.199 [2024-11-28 19:15:46.032878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:2120 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.199 [2024-11-28 19:15:46.032910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.199 [2024-11-28 19:15:46.046168] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.199 [2024-11-28 19:15:46.046469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:24228 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.199 [2024-11-28 19:15:46.046498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.199 [2024-11-28 19:15:46.059725] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.199 [2024-11-28 19:15:46.059994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:223 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.199 [2024-11-28 19:15:46.060025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.199 [2024-11-28 19:15:46.073368] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.199 [2024-11-28 19:15:46.073679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:21322 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.199 [2024-11-28 19:15:46.073708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.199 [2024-11-28 19:15:46.086797] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.199 [2024-11-28 19:15:46.087056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:15450 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.199 [2024-11-28 19:15:46.087087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.199 [2024-11-28 19:15:46.100487] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.199 [2024-11-28 19:15:46.100738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:3343 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.199 [2024-11-28 19:15:46.100770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.199 [2024-11-28 19:15:46.113948] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.199 [2024-11-28 19:15:46.114215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:19105 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.199 [2024-11-28 19:15:46.114245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.199 [2024-11-28 19:15:46.127551] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.199 [2024-11-28 19:15:46.127846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:12864 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.199 [2024-11-28 19:15:46.127878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.199 [2024-11-28 19:15:46.141168] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.199 [2024-11-28 19:15:46.141448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:18128 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.199 [2024-11-28 19:15:46.141501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.199 [2024-11-28 19:15:46.154636] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.199 [2024-11-28 19:15:46.154905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:6031 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.199 [2024-11-28 19:15:46.154936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.199 [2024-11-28 19:15:46.168028] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.199 [2024-11-28 19:15:46.168286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:15712 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.199 [2024-11-28 19:15:46.168317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.199 [2024-11-28 19:15:46.181572] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.199 [2024-11-28 19:15:46.181841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:24520 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.199 [2024-11-28 19:15:46.181872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.199 [2024-11-28 19:15:46.195095] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.199 [2024-11-28 19:15:46.195360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:10583 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.199 [2024-11-28 19:15:46.195391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.199 [2024-11-28 19:15:46.208768] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.199 [2024-11-28 19:15:46.209042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:23162 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.199 [2024-11-28 19:15:46.209075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.199 [2024-11-28 19:15:46.222578] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.199 [2024-11-28 19:15:46.222872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:12414 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.199 [2024-11-28 19:15:46.222904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.199 [2024-11-28 19:15:46.236181] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.199 [2024-11-28 19:15:46.236463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:18864 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.199 [2024-11-28 19:15:46.236492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.459 [2024-11-28 19:15:46.249789] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.459 [2024-11-28 19:15:46.250046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:1671 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.459 [2024-11-28 19:15:46.250077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.459 [2024-11-28 19:15:46.263480] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.459 [2024-11-28 19:15:46.263838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:19095 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.459 [2024-11-28 19:15:46.263869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.459 [2024-11-28 19:15:46.277158] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.459 [2024-11-28 19:15:46.277441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:18251 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.459 [2024-11-28 19:15:46.277475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.459 [2024-11-28 19:15:46.290946] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.459 [2024-11-28 19:15:46.291206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:1334 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.459 [2024-11-28 19:15:46.291236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.459 [2024-11-28 19:15:46.304623] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.459 [2024-11-28 19:15:46.304973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:3050 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.459 [2024-11-28 19:15:46.305005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.459 [2024-11-28 19:15:46.318340] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.459 [2024-11-28 19:15:46.318657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:8986 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.459 [2024-11-28 19:15:46.318685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.459 [2024-11-28 19:15:46.331991] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.459 [2024-11-28 19:15:46.332255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:18185 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.459 [2024-11-28 19:15:46.332287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.459 [2024-11-28 19:15:46.345480] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.459 [2024-11-28 19:15:46.345821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:11528 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.459 [2024-11-28 19:15:46.345853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.459 [2024-11-28 19:15:46.359147] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.459 [2024-11-28 19:15:46.359415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:1017 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.459 [2024-11-28 19:15:46.359458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.459 [2024-11-28 19:15:46.372842] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.459 [2024-11-28 19:15:46.373104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:21417 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.459 [2024-11-28 19:15:46.373134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.459 [2024-11-28 19:15:46.386512] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.459 [2024-11-28 19:15:46.386771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:19690 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.459 [2024-11-28 19:15:46.386801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.459 [2024-11-28 19:15:46.400155] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.459 [2024-11-28 19:15:46.400442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:18242 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.459 [2024-11-28 19:15:46.400469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.459 [2024-11-28 19:15:46.413912] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.459 [2024-11-28 19:15:46.414176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:13340 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.459 [2024-11-28 19:15:46.414207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.459 [2024-11-28 19:15:46.427525] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.459 [2024-11-28 19:15:46.427810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:14938 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.459 [2024-11-28 19:15:46.427841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.459 [2024-11-28 19:15:46.441167] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.459 [2024-11-28 19:15:46.441456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:12304 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.459 [2024-11-28 19:15:46.441485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.459 [2024-11-28 19:15:46.454871] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.459 [2024-11-28 19:15:46.455139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:8050 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.459 [2024-11-28 19:15:46.455170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.459 [2024-11-28 19:15:46.468446] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.460 [2024-11-28 19:15:46.468715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:689 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.460 [2024-11-28 19:15:46.468748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.460 [2024-11-28 19:15:46.482000] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.460 [2024-11-28 19:15:46.482279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:23985 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.460 [2024-11-28 19:15:46.482310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:34 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.460 [2024-11-28 19:15:46.495625] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.460 [2024-11-28 19:15:46.495946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:6027 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.460 [2024-11-28 19:15:46.495977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.720 [2024-11-28 19:15:46.509260] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62ad0) with pdu=0x2000190fe2e8 00:27:25.720 [2024-11-28 19:15:46.509489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:13462 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:25.720 [2024-11-28 19:15:46.509517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:007d p:0 m:0 dnr:0 00:27:25.720 00:27:25.720 Latency(us) 00:27:25.720 [2024-11-28T18:15:46.768Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:25.720 [2024-11-28T18:15:46.768Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:27:25.720 nvme0n1 : 2.01 18700.11 73.05 0.00 0.00 6829.48 3762.25 13883.92 00:27:25.720 [2024-11-28T18:15:46.768Z] =================================================================================================================== 00:27:25.720 [2024-11-28T18:15:46.768Z] Total : 18700.11 73.05 0.00 0.00 6829.48 3762.25 13883.92 00:27:25.720 0 00:27:25.720 19:15:46 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:25.720 19:15:46 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:25.720 19:15:46 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:25.720 | .driver_specific 00:27:25.720 | .nvme_error 00:27:25.720 | .status_code 00:27:25.720 | .command_transient_transport_error' 00:27:25.720 19:15:46 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:25.980 19:15:46 -- host/digest.sh@71 -- # (( 147 > 0 )) 00:27:25.980 19:15:46 -- host/digest.sh@73 -- # killprocess 320782 00:27:25.980 19:15:46 -- common/autotest_common.sh@936 -- # '[' -z 320782 ']' 00:27:25.980 19:15:46 -- common/autotest_common.sh@940 -- # kill -0 320782 00:27:25.980 19:15:46 -- common/autotest_common.sh@941 -- # uname 00:27:25.980 19:15:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:25.980 19:15:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 320782 00:27:25.980 19:15:46 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:25.980 19:15:46 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:25.980 19:15:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 320782' 00:27:25.980 killing process with pid 320782 00:27:25.980 19:15:46 -- common/autotest_common.sh@955 -- # kill 320782 00:27:25.980 Received shutdown signal, test time was about 2.000000 seconds 00:27:25.980 00:27:25.980 Latency(us) 00:27:25.980 [2024-11-28T18:15:47.028Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:25.980 [2024-11-28T18:15:47.028Z] =================================================================================================================== 00:27:25.980 [2024-11-28T18:15:47.028Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:25.980 19:15:46 -- common/autotest_common.sh@960 -- # wait 320782 00:27:26.238 19:15:47 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:27:26.238 19:15:47 -- host/digest.sh@54 -- # local rw bs qd 00:27:26.238 19:15:47 -- host/digest.sh@56 -- # rw=randwrite 00:27:26.238 19:15:47 -- host/digest.sh@56 -- # bs=131072 00:27:26.238 19:15:47 -- host/digest.sh@56 -- # qd=16 00:27:26.238 19:15:47 -- host/digest.sh@58 -- # bperfpid=321213 00:27:26.238 19:15:47 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:27:26.238 19:15:47 -- host/digest.sh@60 -- # waitforlisten 321213 /var/tmp/bperf.sock 00:27:26.238 19:15:47 -- common/autotest_common.sh@829 -- # '[' -z 321213 ']' 00:27:26.238 19:15:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:27:26.238 19:15:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:26.238 19:15:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:27:26.238 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:27:26.238 19:15:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:26.238 19:15:47 -- common/autotest_common.sh@10 -- # set +x 00:27:26.238 [2024-11-28 19:15:47.132633] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:26.238 [2024-11-28 19:15:47.132724] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid321213 ] 00:27:26.239 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:26.239 Zero copy mechanism will not be used. 00:27:26.239 EAL: No free 2048 kB hugepages reported on node 1 00:27:26.239 [2024-11-28 19:15:47.195309] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:26.496 [2024-11-28 19:15:47.320764] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:27.431 19:15:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:27.431 19:15:48 -- common/autotest_common.sh@862 -- # return 0 00:27:27.431 19:15:48 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:27.431 19:15:48 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:27:27.431 19:15:48 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:27:27.431 19:15:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:27.431 19:15:48 -- common/autotest_common.sh@10 -- # set +x 00:27:27.431 19:15:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:27.431 19:15:48 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:27.431 19:15:48 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:27:27.689 nvme0n1 00:27:27.689 19:15:48 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:27:27.689 19:15:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:27.689 19:15:48 -- common/autotest_common.sh@10 -- # set +x 00:27:27.689 19:15:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:27.689 19:15:48 -- host/digest.sh@69 -- # bperf_py perform_tests 00:27:27.689 19:15:48 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:27:27.949 I/O size of 131072 is greater than zero copy threshold (65536). 00:27:27.949 Zero copy mechanism will not be used. 00:27:27.949 Running I/O for 2 seconds... 00:27:27.949 [2024-11-28 19:15:48.832280] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:27.949 [2024-11-28 19:15:48.832575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.949 [2024-11-28 19:15:48.832614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.949 [2024-11-28 19:15:48.837799] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:27.949 [2024-11-28 19:15:48.837920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.949 [2024-11-28 19:15:48.837955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.949 [2024-11-28 19:15:48.842927] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:27.949 [2024-11-28 19:15:48.843037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.949 [2024-11-28 19:15:48.843070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.949 [2024-11-28 19:15:48.847662] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:27.949 [2024-11-28 19:15:48.847802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.949 [2024-11-28 19:15:48.847834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.949 [2024-11-28 19:15:48.852286] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:27.949 [2024-11-28 19:15:48.852417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.949 [2024-11-28 19:15:48.852470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.949 [2024-11-28 19:15:48.856829] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:27.949 [2024-11-28 19:15:48.856934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.949 [2024-11-28 19:15:48.856966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.949 [2024-11-28 19:15:48.861446] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:27.949 [2024-11-28 19:15:48.861589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.949 [2024-11-28 19:15:48.861618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.949 [2024-11-28 19:15:48.866097] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:27.949 [2024-11-28 19:15:48.866337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.949 [2024-11-28 19:15:48.866368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.949 [2024-11-28 19:15:48.870649] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:27.949 [2024-11-28 19:15:48.870895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.949 [2024-11-28 19:15:48.870927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.949 [2024-11-28 19:15:48.875242] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:27.949 [2024-11-28 19:15:48.875460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.950 [2024-11-28 19:15:48.875490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.950 [2024-11-28 19:15:48.879763] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:27.950 [2024-11-28 19:15:48.879891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.950 [2024-11-28 19:15:48.879923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.950 [2024-11-28 19:15:48.884293] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:27.950 [2024-11-28 19:15:48.884440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.950 [2024-11-28 19:15:48.884469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.950 [2024-11-28 19:15:48.888795] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:27.950 [2024-11-28 19:15:48.888904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.950 [2024-11-28 19:15:48.888937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.950 [2024-11-28 19:15:48.893314] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:27.950 [2024-11-28 19:15:48.893483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.950 [2024-11-28 19:15:48.893512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.950 [2024-11-28 19:15:48.897875] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:27.950 [2024-11-28 19:15:48.898017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.950 [2024-11-28 19:15:48.898048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.950 [2024-11-28 19:15:48.902512] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:27.950 [2024-11-28 19:15:48.902750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.950 [2024-11-28 19:15:48.902781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.950 [2024-11-28 19:15:48.907028] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:27.950 [2024-11-28 19:15:48.907261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.950 [2024-11-28 19:15:48.907293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.950 [2024-11-28 19:15:48.911612] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:27.950 [2024-11-28 19:15:48.911771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.950 [2024-11-28 19:15:48.911803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.950 [2024-11-28 19:15:48.916115] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:27.950 [2024-11-28 19:15:48.916225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.950 [2024-11-28 19:15:48.916256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.950 [2024-11-28 19:15:48.920626] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:27.950 [2024-11-28 19:15:48.920750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.950 [2024-11-28 19:15:48.920781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.950 [2024-11-28 19:15:48.925130] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:27.950 [2024-11-28 19:15:48.925242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.950 [2024-11-28 19:15:48.925273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.950 [2024-11-28 19:15:48.929698] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:27.950 [2024-11-28 19:15:48.929855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.950 [2024-11-28 19:15:48.929886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.950 [2024-11-28 19:15:48.934225] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:27.950 [2024-11-28 19:15:48.934364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.950 [2024-11-28 19:15:48.934403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.950 [2024-11-28 19:15:48.938881] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:27.950 [2024-11-28 19:15:48.939122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.950 [2024-11-28 19:15:48.939153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.950 [2024-11-28 19:15:48.943391] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:27.950 [2024-11-28 19:15:48.943632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.950 [2024-11-28 19:15:48.943660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.950 [2024-11-28 19:15:48.948140] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:27.950 [2024-11-28 19:15:48.948315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.950 [2024-11-28 19:15:48.948347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.950 [2024-11-28 19:15:48.953341] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:27.950 [2024-11-28 19:15:48.953519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.950 [2024-11-28 19:15:48.953547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.950 [2024-11-28 19:15:48.958538] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:27.950 [2024-11-28 19:15:48.958679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.950 [2024-11-28 19:15:48.958722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.950 [2024-11-28 19:15:48.964848] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:27.950 [2024-11-28 19:15:48.964978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.950 [2024-11-28 19:15:48.965009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.950 [2024-11-28 19:15:48.969615] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:27.950 [2024-11-28 19:15:48.969726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.950 [2024-11-28 19:15:48.969757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.950 [2024-11-28 19:15:48.974254] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:27.950 [2024-11-28 19:15:48.974444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.950 [2024-11-28 19:15:48.974479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:27.950 [2024-11-28 19:15:48.979056] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:27.950 [2024-11-28 19:15:48.979271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.950 [2024-11-28 19:15:48.979303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:27.950 [2024-11-28 19:15:48.983826] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:27.950 [2024-11-28 19:15:48.984032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.950 [2024-11-28 19:15:48.984064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:27.950 [2024-11-28 19:15:48.988497] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:27.950 [2024-11-28 19:15:48.988642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.950 [2024-11-28 19:15:48.988670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:27.950 [2024-11-28 19:15:48.993084] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:27.950 [2024-11-28 19:15:48.993228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:27.950 [2024-11-28 19:15:48.993259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.211 [2024-11-28 19:15:48.997770] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.211 [2024-11-28 19:15:48.997888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.211 [2024-11-28 19:15:48.997918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.211 [2024-11-28 19:15:49.002322] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.211 [2024-11-28 19:15:49.002467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.211 [2024-11-28 19:15:49.002495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.211 [2024-11-28 19:15:49.007100] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.211 [2024-11-28 19:15:49.007226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.211 [2024-11-28 19:15:49.007257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.211 [2024-11-28 19:15:49.011956] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.211 [2024-11-28 19:15:49.012129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.211 [2024-11-28 19:15:49.012160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.211 [2024-11-28 19:15:49.016792] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.211 [2024-11-28 19:15:49.017040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.211 [2024-11-28 19:15:49.017071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.211 [2024-11-28 19:15:49.021286] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.211 [2024-11-28 19:15:49.021498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.211 [2024-11-28 19:15:49.021526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.211 [2024-11-28 19:15:49.026567] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.211 [2024-11-28 19:15:49.026769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.211 [2024-11-28 19:15:49.026800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.211 [2024-11-28 19:15:49.031645] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.211 [2024-11-28 19:15:49.031822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.211 [2024-11-28 19:15:49.031853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.211 [2024-11-28 19:15:49.037514] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.211 [2024-11-28 19:15:49.037619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.211 [2024-11-28 19:15:49.037647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.211 [2024-11-28 19:15:49.042799] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.211 [2024-11-28 19:15:49.042951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.211 [2024-11-28 19:15:49.042982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.211 [2024-11-28 19:15:49.047461] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.211 [2024-11-28 19:15:49.047627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.211 [2024-11-28 19:15:49.047655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.211 [2024-11-28 19:15:49.052073] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.211 [2024-11-28 19:15:49.052216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.211 [2024-11-28 19:15:49.052248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.211 [2024-11-28 19:15:49.056827] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.211 [2024-11-28 19:15:49.057046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.211 [2024-11-28 19:15:49.057077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.211 [2024-11-28 19:15:49.061390] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.211 [2024-11-28 19:15:49.061569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.211 [2024-11-28 19:15:49.061596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.211 [2024-11-28 19:15:49.065840] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.211 [2024-11-28 19:15:49.065992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.211 [2024-11-28 19:15:49.066023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.211 [2024-11-28 19:15:49.070542] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.211 [2024-11-28 19:15:49.070686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.211 [2024-11-28 19:15:49.070730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.211 [2024-11-28 19:15:49.075095] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.211 [2024-11-28 19:15:49.075203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.211 [2024-11-28 19:15:49.075234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.211 [2024-11-28 19:15:49.079653] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.211 [2024-11-28 19:15:49.079812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.211 [2024-11-28 19:15:49.079843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.211 [2024-11-28 19:15:49.084406] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.211 [2024-11-28 19:15:49.084569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.211 [2024-11-28 19:15:49.084597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.211 [2024-11-28 19:15:49.088709] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.211 [2024-11-28 19:15:49.088884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.211 [2024-11-28 19:15:49.088912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.211 [2024-11-28 19:15:49.093412] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.211 [2024-11-28 19:15:49.093624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.211 [2024-11-28 19:15:49.093652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.211 [2024-11-28 19:15:49.098038] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.211 [2024-11-28 19:15:49.098222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.211 [2024-11-28 19:15:49.098259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.211 [2024-11-28 19:15:49.102639] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.211 [2024-11-28 19:15:49.102913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.211 [2024-11-28 19:15:49.102944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.211 [2024-11-28 19:15:49.107415] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.212 [2024-11-28 19:15:49.107567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.212 [2024-11-28 19:15:49.107595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.212 [2024-11-28 19:15:49.112012] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.212 [2024-11-28 19:15:49.112158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.212 [2024-11-28 19:15:49.112188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.212 [2024-11-28 19:15:49.116780] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.212 [2024-11-28 19:15:49.116907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.212 [2024-11-28 19:15:49.116937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.212 [2024-11-28 19:15:49.121468] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.212 [2024-11-28 19:15:49.121628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.212 [2024-11-28 19:15:49.121657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.212 [2024-11-28 19:15:49.126090] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.212 [2024-11-28 19:15:49.126244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.212 [2024-11-28 19:15:49.126276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.212 [2024-11-28 19:15:49.130790] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.212 [2024-11-28 19:15:49.131003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.212 [2024-11-28 19:15:49.131035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.212 [2024-11-28 19:15:49.135485] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.212 [2024-11-28 19:15:49.135695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.212 [2024-11-28 19:15:49.135740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.212 [2024-11-28 19:15:49.140080] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.212 [2024-11-28 19:15:49.140316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.212 [2024-11-28 19:15:49.140348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.212 [2024-11-28 19:15:49.144707] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.212 [2024-11-28 19:15:49.144853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.212 [2024-11-28 19:15:49.144883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.212 [2024-11-28 19:15:49.149355] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.212 [2024-11-28 19:15:49.149526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.212 [2024-11-28 19:15:49.149554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.212 [2024-11-28 19:15:49.153997] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.212 [2024-11-28 19:15:49.154156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.212 [2024-11-28 19:15:49.154185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.212 [2024-11-28 19:15:49.158847] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.212 [2024-11-28 19:15:49.159022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.212 [2024-11-28 19:15:49.159054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.212 [2024-11-28 19:15:49.163357] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.212 [2024-11-28 19:15:49.163546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.212 [2024-11-28 19:15:49.163573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.212 [2024-11-28 19:15:49.168133] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.212 [2024-11-28 19:15:49.168346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.212 [2024-11-28 19:15:49.168378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.212 [2024-11-28 19:15:49.172754] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.212 [2024-11-28 19:15:49.173043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.212 [2024-11-28 19:15:49.173076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.212 [2024-11-28 19:15:49.177557] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.212 [2024-11-28 19:15:49.177759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.212 [2024-11-28 19:15:49.177791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.212 [2024-11-28 19:15:49.182133] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.212 [2024-11-28 19:15:49.182273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.212 [2024-11-28 19:15:49.182304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.212 [2024-11-28 19:15:49.186671] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.212 [2024-11-28 19:15:49.186815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.212 [2024-11-28 19:15:49.186845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.212 [2024-11-28 19:15:49.191242] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.212 [2024-11-28 19:15:49.191386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.212 [2024-11-28 19:15:49.191441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.212 [2024-11-28 19:15:49.195926] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.212 [2024-11-28 19:15:49.196093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.212 [2024-11-28 19:15:49.196124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.212 [2024-11-28 19:15:49.200526] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.212 [2024-11-28 19:15:49.200684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.212 [2024-11-28 19:15:49.200711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.212 [2024-11-28 19:15:49.205346] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.212 [2024-11-28 19:15:49.205594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.212 [2024-11-28 19:15:49.205622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.212 [2024-11-28 19:15:49.210070] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.212 [2024-11-28 19:15:49.210362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.212 [2024-11-28 19:15:49.210400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.212 [2024-11-28 19:15:49.214868] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.212 [2024-11-28 19:15:49.215062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.212 [2024-11-28 19:15:49.215093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.212 [2024-11-28 19:15:49.219461] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.212 [2024-11-28 19:15:49.219608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.212 [2024-11-28 19:15:49.219641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.212 [2024-11-28 19:15:49.224114] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.212 [2024-11-28 19:15:49.224275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.212 [2024-11-28 19:15:49.224306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.212 [2024-11-28 19:15:49.228914] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.212 [2024-11-28 19:15:49.229014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.212 [2024-11-28 19:15:49.229044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.212 [2024-11-28 19:15:49.233672] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.213 [2024-11-28 19:15:49.233869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.213 [2024-11-28 19:15:49.233900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.213 [2024-11-28 19:15:49.238315] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.213 [2024-11-28 19:15:49.238481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.213 [2024-11-28 19:15:49.238510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.213 [2024-11-28 19:15:49.243106] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.213 [2024-11-28 19:15:49.243344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.213 [2024-11-28 19:15:49.243375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.213 [2024-11-28 19:15:49.247772] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.213 [2024-11-28 19:15:49.247957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:96 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.213 [2024-11-28 19:15:49.247988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.213 [2024-11-28 19:15:49.252760] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.213 [2024-11-28 19:15:49.252927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.213 [2024-11-28 19:15:49.252958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.472 [2024-11-28 19:15:49.258004] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.472 [2024-11-28 19:15:49.258179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.472 [2024-11-28 19:15:49.258210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.472 [2024-11-28 19:15:49.264097] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.472 [2024-11-28 19:15:49.264261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.472 [2024-11-28 19:15:49.264292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.472 [2024-11-28 19:15:49.269004] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.472 [2024-11-28 19:15:49.269141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.472 [2024-11-28 19:15:49.269171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.472 [2024-11-28 19:15:49.273561] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.472 [2024-11-28 19:15:49.273724] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.472 [2024-11-28 19:15:49.273755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.472 [2024-11-28 19:15:49.278064] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.472 [2024-11-28 19:15:49.278230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.472 [2024-11-28 19:15:49.278261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.472 [2024-11-28 19:15:49.282833] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.472 [2024-11-28 19:15:49.283068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.472 [2024-11-28 19:15:49.283099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.472 [2024-11-28 19:15:49.287362] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.472 [2024-11-28 19:15:49.287585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.472 [2024-11-28 19:15:49.287613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.472 [2024-11-28 19:15:49.292080] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.473 [2024-11-28 19:15:49.292292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.473 [2024-11-28 19:15:49.292324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.473 [2024-11-28 19:15:49.297410] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.473 [2024-11-28 19:15:49.297623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.473 [2024-11-28 19:15:49.297652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.473 [2024-11-28 19:15:49.302800] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.473 [2024-11-28 19:15:49.302959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.473 [2024-11-28 19:15:49.302989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.473 [2024-11-28 19:15:49.308896] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.473 [2024-11-28 19:15:49.309015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.473 [2024-11-28 19:15:49.309045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.473 [2024-11-28 19:15:49.313469] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.473 [2024-11-28 19:15:49.313574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.473 [2024-11-28 19:15:49.313601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.473 [2024-11-28 19:15:49.318162] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.473 [2024-11-28 19:15:49.318298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.473 [2024-11-28 19:15:49.318329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.473 [2024-11-28 19:15:49.322638] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.473 [2024-11-28 19:15:49.322789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.473 [2024-11-28 19:15:49.322821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.473 [2024-11-28 19:15:49.327284] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.473 [2024-11-28 19:15:49.327526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.473 [2024-11-28 19:15:49.327554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.473 [2024-11-28 19:15:49.331950] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.473 [2024-11-28 19:15:49.332131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.473 [2024-11-28 19:15:49.332163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.473 [2024-11-28 19:15:49.336427] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.473 [2024-11-28 19:15:49.336609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.473 [2024-11-28 19:15:49.336637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.473 [2024-11-28 19:15:49.340550] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.473 [2024-11-28 19:15:49.340663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.473 [2024-11-28 19:15:49.340691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.473 [2024-11-28 19:15:49.344877] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.473 [2024-11-28 19:15:49.344986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.473 [2024-11-28 19:15:49.345022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.473 [2024-11-28 19:15:49.349386] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.473 [2024-11-28 19:15:49.349569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.473 [2024-11-28 19:15:49.349597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.473 [2024-11-28 19:15:49.353829] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.473 [2024-11-28 19:15:49.353981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.473 [2024-11-28 19:15:49.354012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.473 [2024-11-28 19:15:49.358359] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.473 [2024-11-28 19:15:49.358604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.473 [2024-11-28 19:15:49.358633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.473 [2024-11-28 19:15:49.362765] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.473 [2024-11-28 19:15:49.363020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.473 [2024-11-28 19:15:49.363051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.473 [2024-11-28 19:15:49.367219] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.473 [2024-11-28 19:15:49.367425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.473 [2024-11-28 19:15:49.367471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.473 [2024-11-28 19:15:49.371651] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.473 [2024-11-28 19:15:49.371794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.473 [2024-11-28 19:15:49.371824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.473 [2024-11-28 19:15:49.376070] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.473 [2024-11-28 19:15:49.376188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.473 [2024-11-28 19:15:49.376219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.473 [2024-11-28 19:15:49.380511] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.473 [2024-11-28 19:15:49.380620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.473 [2024-11-28 19:15:49.380648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.473 [2024-11-28 19:15:49.384975] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.473 [2024-11-28 19:15:49.385151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.473 [2024-11-28 19:15:49.385182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.473 [2024-11-28 19:15:49.389418] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.473 [2024-11-28 19:15:49.389573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.473 [2024-11-28 19:15:49.389601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.473 [2024-11-28 19:15:49.393982] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.473 [2024-11-28 19:15:49.394220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.473 [2024-11-28 19:15:49.394250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.473 [2024-11-28 19:15:49.398382] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.473 [2024-11-28 19:15:49.398623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.474 [2024-11-28 19:15:49.398651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.474 [2024-11-28 19:15:49.402876] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.474 [2024-11-28 19:15:49.403063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.474 [2024-11-28 19:15:49.403094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.474 [2024-11-28 19:15:49.407263] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.474 [2024-11-28 19:15:49.407388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.474 [2024-11-28 19:15:49.407427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.474 [2024-11-28 19:15:49.411660] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.474 [2024-11-28 19:15:49.411778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.474 [2024-11-28 19:15:49.411809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.474 [2024-11-28 19:15:49.416132] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.474 [2024-11-28 19:15:49.416243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.474 [2024-11-28 19:15:49.416274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.474 [2024-11-28 19:15:49.420713] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.474 [2024-11-28 19:15:49.420886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.474 [2024-11-28 19:15:49.420916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.474 [2024-11-28 19:15:49.425122] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.474 [2024-11-28 19:15:49.425265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.474 [2024-11-28 19:15:49.425295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.474 [2024-11-28 19:15:49.429649] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.474 [2024-11-28 19:15:49.429900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.474 [2024-11-28 19:15:49.429931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.474 [2024-11-28 19:15:49.434029] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.474 [2024-11-28 19:15:49.434258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.474 [2024-11-28 19:15:49.434288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.474 [2024-11-28 19:15:49.438536] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.474 [2024-11-28 19:15:49.438732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.474 [2024-11-28 19:15:49.438761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.474 [2024-11-28 19:15:49.442976] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.474 [2024-11-28 19:15:49.443152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.474 [2024-11-28 19:15:49.443183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.474 [2024-11-28 19:15:49.447479] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.474 [2024-11-28 19:15:49.447577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.474 [2024-11-28 19:15:49.447605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.474 [2024-11-28 19:15:49.451830] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.474 [2024-11-28 19:15:49.451935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.474 [2024-11-28 19:15:49.451962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.474 [2024-11-28 19:15:49.456370] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.474 [2024-11-28 19:15:49.456567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.474 [2024-11-28 19:15:49.456595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.474 [2024-11-28 19:15:49.461690] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.474 [2024-11-28 19:15:49.461920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.474 [2024-11-28 19:15:49.461959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.474 [2024-11-28 19:15:49.466866] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.474 [2024-11-28 19:15:49.467170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.474 [2024-11-28 19:15:49.467203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.474 [2024-11-28 19:15:49.473125] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.474 [2024-11-28 19:15:49.473314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.474 [2024-11-28 19:15:49.473346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.474 [2024-11-28 19:15:49.478107] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.474 [2024-11-28 19:15:49.478230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.474 [2024-11-28 19:15:49.478261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.474 [2024-11-28 19:15:49.482730] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.474 [2024-11-28 19:15:49.482884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.474 [2024-11-28 19:15:49.482914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.474 [2024-11-28 19:15:49.487340] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.474 [2024-11-28 19:15:49.487517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.474 [2024-11-28 19:15:49.487545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.474 [2024-11-28 19:15:49.491995] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.474 [2024-11-28 19:15:49.492124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.474 [2024-11-28 19:15:49.492154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.474 [2024-11-28 19:15:49.496642] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.474 [2024-11-28 19:15:49.496910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.474 [2024-11-28 19:15:49.496941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.474 [2024-11-28 19:15:49.501406] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.474 [2024-11-28 19:15:49.501632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.474 [2024-11-28 19:15:49.501660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.474 [2024-11-28 19:15:49.505957] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.474 [2024-11-28 19:15:49.506216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.474 [2024-11-28 19:15:49.506245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.474 [2024-11-28 19:15:49.510598] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.474 [2024-11-28 19:15:49.510789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.474 [2024-11-28 19:15:49.510820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.474 [2024-11-28 19:15:49.515366] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.474 [2024-11-28 19:15:49.515503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.474 [2024-11-28 19:15:49.515531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.734 [2024-11-28 19:15:49.520036] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.734 [2024-11-28 19:15:49.520255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.734 [2024-11-28 19:15:49.520285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.734 [2024-11-28 19:15:49.524761] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.734 [2024-11-28 19:15:49.524881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.734 [2024-11-28 19:15:49.524909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.734 [2024-11-28 19:15:49.529486] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.734 [2024-11-28 19:15:49.529679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.734 [2024-11-28 19:15:49.529706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.734 [2024-11-28 19:15:49.534281] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.734 [2024-11-28 19:15:49.534517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.734 [2024-11-28 19:15:49.534546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.734 [2024-11-28 19:15:49.539044] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.734 [2024-11-28 19:15:49.539201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.734 [2024-11-28 19:15:49.539233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.734 [2024-11-28 19:15:49.543919] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.734 [2024-11-28 19:15:49.544138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.734 [2024-11-28 19:15:49.544169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.734 [2024-11-28 19:15:49.548569] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.734 [2024-11-28 19:15:49.548695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.734 [2024-11-28 19:15:49.548724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.734 [2024-11-28 19:15:49.553317] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.734 [2024-11-28 19:15:49.553450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.734 [2024-11-28 19:15:49.553479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.734 [2024-11-28 19:15:49.557946] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.735 [2024-11-28 19:15:49.558151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.735 [2024-11-28 19:15:49.558184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.735 [2024-11-28 19:15:49.563048] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.735 [2024-11-28 19:15:49.563302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.735 [2024-11-28 19:15:49.563334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.735 [2024-11-28 19:15:49.568083] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.735 [2024-11-28 19:15:49.568207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.735 [2024-11-28 19:15:49.568237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.735 [2024-11-28 19:15:49.573914] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.735 [2024-11-28 19:15:49.574169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.735 [2024-11-28 19:15:49.574201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.735 [2024-11-28 19:15:49.579355] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.735 [2024-11-28 19:15:49.579565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.735 [2024-11-28 19:15:49.579593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.735 [2024-11-28 19:15:49.584076] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.735 [2024-11-28 19:15:49.584300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.735 [2024-11-28 19:15:49.584331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.735 [2024-11-28 19:15:49.588647] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.735 [2024-11-28 19:15:49.588824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.735 [2024-11-28 19:15:49.588866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.735 [2024-11-28 19:15:49.593017] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.735 [2024-11-28 19:15:49.593139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.735 [2024-11-28 19:15:49.593167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.735 [2024-11-28 19:15:49.597698] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.735 [2024-11-28 19:15:49.597885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.735 [2024-11-28 19:15:49.597916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.735 [2024-11-28 19:15:49.602303] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.735 [2024-11-28 19:15:49.602482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.735 [2024-11-28 19:15:49.602511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.735 [2024-11-28 19:15:49.607045] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.735 [2024-11-28 19:15:49.607168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.735 [2024-11-28 19:15:49.607198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.735 [2024-11-28 19:15:49.611896] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.735 [2024-11-28 19:15:49.612126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.735 [2024-11-28 19:15:49.612157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.735 [2024-11-28 19:15:49.616455] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.735 [2024-11-28 19:15:49.616616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.735 [2024-11-28 19:15:49.616644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.735 [2024-11-28 19:15:49.621061] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.735 [2024-11-28 19:15:49.621250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.735 [2024-11-28 19:15:49.621281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.735 [2024-11-28 19:15:49.625811] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.735 [2024-11-28 19:15:49.625948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.735 [2024-11-28 19:15:49.625978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.735 [2024-11-28 19:15:49.630486] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.735 [2024-11-28 19:15:49.630643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.735 [2024-11-28 19:15:49.630671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.735 [2024-11-28 19:15:49.635136] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.735 [2024-11-28 19:15:49.635302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.735 [2024-11-28 19:15:49.635333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.735 [2024-11-28 19:15:49.639711] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.735 [2024-11-28 19:15:49.639908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.735 [2024-11-28 19:15:49.639939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.735 [2024-11-28 19:15:49.644376] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.735 [2024-11-28 19:15:49.644577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.735 [2024-11-28 19:15:49.644605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.735 [2024-11-28 19:15:49.649150] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.735 [2024-11-28 19:15:49.649337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.735 [2024-11-28 19:15:49.649367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.735 [2024-11-28 19:15:49.653702] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.735 [2024-11-28 19:15:49.653870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.735 [2024-11-28 19:15:49.653901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.735 [2024-11-28 19:15:49.658446] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.735 [2024-11-28 19:15:49.658625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.735 [2024-11-28 19:15:49.658653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.735 [2024-11-28 19:15:49.663055] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.735 [2024-11-28 19:15:49.663198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.735 [2024-11-28 19:15:49.663229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.735 [2024-11-28 19:15:49.668178] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.735 [2024-11-28 19:15:49.668360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.735 [2024-11-28 19:15:49.668416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.735 [2024-11-28 19:15:49.673573] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.735 [2024-11-28 19:15:49.673785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.735 [2024-11-28 19:15:49.673815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.735 [2024-11-28 19:15:49.680134] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.735 [2024-11-28 19:15:49.680305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.735 [2024-11-28 19:15:49.680336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.735 [2024-11-28 19:15:49.684830] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.735 [2024-11-28 19:15:49.685037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.735 [2024-11-28 19:15:49.685068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.735 [2024-11-28 19:15:49.689408] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.736 [2024-11-28 19:15:49.689557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.736 [2024-11-28 19:15:49.689585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.736 [2024-11-28 19:15:49.693995] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.736 [2024-11-28 19:15:49.694126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.736 [2024-11-28 19:15:49.694157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.736 [2024-11-28 19:15:49.698565] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.736 [2024-11-28 19:15:49.698766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.736 [2024-11-28 19:15:49.698797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.736 [2024-11-28 19:15:49.703183] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.736 [2024-11-28 19:15:49.703409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.736 [2024-11-28 19:15:49.703453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.736 [2024-11-28 19:15:49.708449] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.736 [2024-11-28 19:15:49.708583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.736 [2024-11-28 19:15:49.708610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.736 [2024-11-28 19:15:49.713829] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.736 [2024-11-28 19:15:49.714043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.736 [2024-11-28 19:15:49.714073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.736 [2024-11-28 19:15:49.719968] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.736 [2024-11-28 19:15:49.720149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.736 [2024-11-28 19:15:49.720180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.736 [2024-11-28 19:15:49.724488] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.736 [2024-11-28 19:15:49.724592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.736 [2024-11-28 19:15:49.724619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.736 [2024-11-28 19:15:49.729114] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.736 [2024-11-28 19:15:49.729215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.736 [2024-11-28 19:15:49.729246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.736 [2024-11-28 19:15:49.733620] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.736 [2024-11-28 19:15:49.733767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.736 [2024-11-28 19:15:49.733798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.736 [2024-11-28 19:15:49.738350] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.736 [2024-11-28 19:15:49.738547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.736 [2024-11-28 19:15:49.738575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.736 [2024-11-28 19:15:49.742972] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.736 [2024-11-28 19:15:49.743153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.736 [2024-11-28 19:15:49.743184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.736 [2024-11-28 19:15:49.747804] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.736 [2024-11-28 19:15:49.747960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.736 [2024-11-28 19:15:49.747991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.736 [2024-11-28 19:15:49.752475] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.736 [2024-11-28 19:15:49.752651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.736 [2024-11-28 19:15:49.752680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.736 [2024-11-28 19:15:49.757026] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.736 [2024-11-28 19:15:49.757185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.736 [2024-11-28 19:15:49.757216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.736 [2024-11-28 19:15:49.761592] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.736 [2024-11-28 19:15:49.761801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.736 [2024-11-28 19:15:49.761832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.736 [2024-11-28 19:15:49.766378] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.736 [2024-11-28 19:15:49.766598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.736 [2024-11-28 19:15:49.766626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.736 [2024-11-28 19:15:49.771582] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.736 [2024-11-28 19:15:49.771800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.736 [2024-11-28 19:15:49.771832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.736 [2024-11-28 19:15:49.776269] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.736 [2024-11-28 19:15:49.776439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.736 [2024-11-28 19:15:49.776468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.997 [2024-11-28 19:15:49.780899] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.997 [2024-11-28 19:15:49.781080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.998 [2024-11-28 19:15:49.781119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.998 [2024-11-28 19:15:49.785511] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.998 [2024-11-28 19:15:49.785661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.998 [2024-11-28 19:15:49.785689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.998 [2024-11-28 19:15:49.790010] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.998 [2024-11-28 19:15:49.790100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.998 [2024-11-28 19:15:49.790130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.998 [2024-11-28 19:15:49.794852] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.998 [2024-11-28 19:15:49.795032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.998 [2024-11-28 19:15:49.795068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.998 [2024-11-28 19:15:49.799330] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.998 [2024-11-28 19:15:49.799478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.998 [2024-11-28 19:15:49.799506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.998 [2024-11-28 19:15:49.804191] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.998 [2024-11-28 19:15:49.804346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.998 [2024-11-28 19:15:49.804378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.998 [2024-11-28 19:15:49.809600] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.998 [2024-11-28 19:15:49.809816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.998 [2024-11-28 19:15:49.809847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.998 [2024-11-28 19:15:49.814648] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.998 [2024-11-28 19:15:49.814852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.998 [2024-11-28 19:15:49.814882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.998 [2024-11-28 19:15:49.820798] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.998 [2024-11-28 19:15:49.821016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.998 [2024-11-28 19:15:49.821048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.998 [2024-11-28 19:15:49.826011] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.998 [2024-11-28 19:15:49.826273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.998 [2024-11-28 19:15:49.826304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.998 [2024-11-28 19:15:49.831181] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.998 [2024-11-28 19:15:49.831338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.998 [2024-11-28 19:15:49.831369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.998 [2024-11-28 19:15:49.836352] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.998 [2024-11-28 19:15:49.836607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.998 [2024-11-28 19:15:49.836634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.998 [2024-11-28 19:15:49.841668] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.998 [2024-11-28 19:15:49.841902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.998 [2024-11-28 19:15:49.841933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.998 [2024-11-28 19:15:49.846855] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.998 [2024-11-28 19:15:49.847128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.998 [2024-11-28 19:15:49.847155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.998 [2024-11-28 19:15:49.852079] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.998 [2024-11-28 19:15:49.852263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.998 [2024-11-28 19:15:49.852293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.998 [2024-11-28 19:15:49.857351] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.998 [2024-11-28 19:15:49.857486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.998 [2024-11-28 19:15:49.857514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.998 [2024-11-28 19:15:49.862588] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.998 [2024-11-28 19:15:49.862767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.998 [2024-11-28 19:15:49.862798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.998 [2024-11-28 19:15:49.868223] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.998 [2024-11-28 19:15:49.868368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.998 [2024-11-28 19:15:49.868406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.998 [2024-11-28 19:15:49.874265] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.998 [2024-11-28 19:15:49.874438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.998 [2024-11-28 19:15:49.874467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.998 [2024-11-28 19:15:49.878837] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.998 [2024-11-28 19:15:49.878949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.998 [2024-11-28 19:15:49.878980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.998 [2024-11-28 19:15:49.883536] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.998 [2024-11-28 19:15:49.883713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.998 [2024-11-28 19:15:49.883760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.998 [2024-11-28 19:15:49.888556] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.998 [2024-11-28 19:15:49.888692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.998 [2024-11-28 19:15:49.888721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.998 [2024-11-28 19:15:49.894147] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.998 [2024-11-28 19:15:49.894283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.998 [2024-11-28 19:15:49.894315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.998 [2024-11-28 19:15:49.898616] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.998 [2024-11-28 19:15:49.898776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.998 [2024-11-28 19:15:49.898807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.998 [2024-11-28 19:15:49.903597] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.998 [2024-11-28 19:15:49.903773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.998 [2024-11-28 19:15:49.903803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.998 [2024-11-28 19:15:49.908863] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.998 [2024-11-28 19:15:49.909035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.998 [2024-11-28 19:15:49.909066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.998 [2024-11-28 19:15:49.914648] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.998 [2024-11-28 19:15:49.914759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.998 [2024-11-28 19:15:49.914789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.999 [2024-11-28 19:15:49.920458] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.999 [2024-11-28 19:15:49.920627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.999 [2024-11-28 19:15:49.920655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.999 [2024-11-28 19:15:49.926949] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.999 [2024-11-28 19:15:49.927146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.999 [2024-11-28 19:15:49.927176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.999 [2024-11-28 19:15:49.932523] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.999 [2024-11-28 19:15:49.932757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.999 [2024-11-28 19:15:49.932795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.999 [2024-11-28 19:15:49.936925] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.999 [2024-11-28 19:15:49.937065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.999 [2024-11-28 19:15:49.937096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.999 [2024-11-28 19:15:49.941748] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.999 [2024-11-28 19:15:49.941874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.999 [2024-11-28 19:15:49.941906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.999 [2024-11-28 19:15:49.946417] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.999 [2024-11-28 19:15:49.946563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.999 [2024-11-28 19:15:49.946591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.999 [2024-11-28 19:15:49.951146] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.999 [2024-11-28 19:15:49.951276] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.999 [2024-11-28 19:15:49.951306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.999 [2024-11-28 19:15:49.955694] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.999 [2024-11-28 19:15:49.955812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.999 [2024-11-28 19:15:49.955843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.999 [2024-11-28 19:15:49.960836] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.999 [2024-11-28 19:15:49.960990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.999 [2024-11-28 19:15:49.961021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.999 [2024-11-28 19:15:49.966216] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.999 [2024-11-28 19:15:49.966608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.999 [2024-11-28 19:15:49.966636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.999 [2024-11-28 19:15:49.972116] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.999 [2024-11-28 19:15:49.972450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.999 [2024-11-28 19:15:49.972479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.999 [2024-11-28 19:15:49.978603] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.999 [2024-11-28 19:15:49.978731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.999 [2024-11-28 19:15:49.978762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.999 [2024-11-28 19:15:49.984015] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.999 [2024-11-28 19:15:49.984148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.999 [2024-11-28 19:15:49.984179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.999 [2024-11-28 19:15:49.988711] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.999 [2024-11-28 19:15:49.988852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.999 [2024-11-28 19:15:49.988883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.999 [2024-11-28 19:15:49.993248] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.999 [2024-11-28 19:15:49.993405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.999 [2024-11-28 19:15:49.993450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.999 [2024-11-28 19:15:49.998338] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.999 [2024-11-28 19:15:49.998445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.999 [2024-11-28 19:15:49.998472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.999 [2024-11-28 19:15:50.003570] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.999 [2024-11-28 19:15:50.003775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.999 [2024-11-28 19:15:50.003807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:28.999 [2024-11-28 19:15:50.008969] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.999 [2024-11-28 19:15:50.009228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.999 [2024-11-28 19:15:50.009260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:28.999 [2024-11-28 19:15:50.014998] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.999 [2024-11-28 19:15:50.015279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.999 [2024-11-28 19:15:50.015323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:28.999 [2024-11-28 19:15:50.019576] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:28.999 [2024-11-28 19:15:50.019715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:28.999 [2024-11-28 19:15:50.019748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:28.999 [2024-11-28 19:15:50.024268] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.000 [2024-11-28 19:15:50.024439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.000 [2024-11-28 19:15:50.024467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.000 [2024-11-28 19:15:50.029027] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.000 [2024-11-28 19:15:50.029184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.000 [2024-11-28 19:15:50.029215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.000 [2024-11-28 19:15:50.033682] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.000 [2024-11-28 19:15:50.033842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.000 [2024-11-28 19:15:50.033873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.000 [2024-11-28 19:15:50.038492] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.000 [2024-11-28 19:15:50.038610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.000 [2024-11-28 19:15:50.038641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.000 [2024-11-28 19:15:50.043239] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.000 [2024-11-28 19:15:50.043484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.000 [2024-11-28 19:15:50.043514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.260 [2024-11-28 19:15:50.048003] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.260 [2024-11-28 19:15:50.048237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.260 [2024-11-28 19:15:50.048269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.260 [2024-11-28 19:15:50.052610] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.260 [2024-11-28 19:15:50.052766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.260 [2024-11-28 19:15:50.052795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.260 [2024-11-28 19:15:50.058056] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.260 [2024-11-28 19:15:50.058200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.260 [2024-11-28 19:15:50.058234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.260 [2024-11-28 19:15:50.062774] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.260 [2024-11-28 19:15:50.062942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.260 [2024-11-28 19:15:50.062986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.260 [2024-11-28 19:15:50.067342] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.260 [2024-11-28 19:15:50.067484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.260 [2024-11-28 19:15:50.067513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.260 [2024-11-28 19:15:50.071826] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.260 [2024-11-28 19:15:50.071952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.260 [2024-11-28 19:15:50.071984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.260 [2024-11-28 19:15:50.076521] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.260 [2024-11-28 19:15:50.076624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.260 [2024-11-28 19:15:50.076653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.260 [2024-11-28 19:15:50.082416] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.260 [2024-11-28 19:15:50.082629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.260 [2024-11-28 19:15:50.082660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.260 [2024-11-28 19:15:50.087049] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.260 [2024-11-28 19:15:50.087268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.260 [2024-11-28 19:15:50.087302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.260 [2024-11-28 19:15:50.091968] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.260 [2024-11-28 19:15:50.092167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.260 [2024-11-28 19:15:50.092200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.260 [2024-11-28 19:15:50.096286] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.260 [2024-11-28 19:15:50.096448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.260 [2024-11-28 19:15:50.096482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.260 [2024-11-28 19:15:50.100722] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.260 [2024-11-28 19:15:50.100908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.260 [2024-11-28 19:15:50.100942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.260 [2024-11-28 19:15:50.105551] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.260 [2024-11-28 19:15:50.105713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.260 [2024-11-28 19:15:50.105742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.260 [2024-11-28 19:15:50.110627] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.260 [2024-11-28 19:15:50.110779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.260 [2024-11-28 19:15:50.110811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.260 [2024-11-28 19:15:50.115958] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.260 [2024-11-28 19:15:50.116130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.260 [2024-11-28 19:15:50.116170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.260 [2024-11-28 19:15:50.121157] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.260 [2024-11-28 19:15:50.121331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.260 [2024-11-28 19:15:50.121363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.260 [2024-11-28 19:15:50.127632] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.260 [2024-11-28 19:15:50.127907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.260 [2024-11-28 19:15:50.127940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.260 [2024-11-28 19:15:50.132416] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.260 [2024-11-28 19:15:50.132655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.260 [2024-11-28 19:15:50.132685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.260 [2024-11-28 19:15:50.136858] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.260 [2024-11-28 19:15:50.137019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.260 [2024-11-28 19:15:50.137051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.260 [2024-11-28 19:15:50.141366] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.260 [2024-11-28 19:15:50.141575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.260 [2024-11-28 19:15:50.141605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.260 [2024-11-28 19:15:50.146135] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.260 [2024-11-28 19:15:50.146301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.260 [2024-11-28 19:15:50.146334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.260 [2024-11-28 19:15:50.150820] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.260 [2024-11-28 19:15:50.150944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.260 [2024-11-28 19:15:50.150977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.260 [2024-11-28 19:15:50.155536] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.260 [2024-11-28 19:15:50.155679] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.261 [2024-11-28 19:15:50.155708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.261 [2024-11-28 19:15:50.160412] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.261 [2024-11-28 19:15:50.160598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.261 [2024-11-28 19:15:50.160628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.261 [2024-11-28 19:15:50.165013] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.261 [2024-11-28 19:15:50.165205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.261 [2024-11-28 19:15:50.165237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.261 [2024-11-28 19:15:50.169896] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.261 [2024-11-28 19:15:50.170104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.261 [2024-11-28 19:15:50.170137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.261 [2024-11-28 19:15:50.174371] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.261 [2024-11-28 19:15:50.174553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.261 [2024-11-28 19:15:50.174583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.261 [2024-11-28 19:15:50.179061] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.261 [2024-11-28 19:15:50.179287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.261 [2024-11-28 19:15:50.179319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.261 [2024-11-28 19:15:50.184245] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.261 [2024-11-28 19:15:50.184402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.261 [2024-11-28 19:15:50.184449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.261 [2024-11-28 19:15:50.189368] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.261 [2024-11-28 19:15:50.189585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.261 [2024-11-28 19:15:50.189620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.261 [2024-11-28 19:15:50.194380] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.261 [2024-11-28 19:15:50.194567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.261 [2024-11-28 19:15:50.194596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.261 [2024-11-28 19:15:50.198965] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.261 [2024-11-28 19:15:50.199147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.261 [2024-11-28 19:15:50.199178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.261 [2024-11-28 19:15:50.204144] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.261 [2024-11-28 19:15:50.204385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.261 [2024-11-28 19:15:50.204426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.261 [2024-11-28 19:15:50.209136] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.261 [2024-11-28 19:15:50.209301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.261 [2024-11-28 19:15:50.209333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.261 [2024-11-28 19:15:50.214254] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.261 [2024-11-28 19:15:50.214464] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.261 [2024-11-28 19:15:50.214495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.261 [2024-11-28 19:15:50.219376] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.261 [2024-11-28 19:15:50.219598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.261 [2024-11-28 19:15:50.219628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.261 [2024-11-28 19:15:50.224810] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.261 [2024-11-28 19:15:50.225019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.261 [2024-11-28 19:15:50.225051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.261 [2024-11-28 19:15:50.230554] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.261 [2024-11-28 19:15:50.230775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.261 [2024-11-28 19:15:50.230807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.261 [2024-11-28 19:15:50.235834] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.261 [2024-11-28 19:15:50.235973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.261 [2024-11-28 19:15:50.236004] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.261 [2024-11-28 19:15:50.241275] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.261 [2024-11-28 19:15:50.241488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.261 [2024-11-28 19:15:50.241518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.261 [2024-11-28 19:15:50.246557] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.261 [2024-11-28 19:15:50.246816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.261 [2024-11-28 19:15:50.246849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.261 [2024-11-28 19:15:50.251875] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.261 [2024-11-28 19:15:50.251999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.261 [2024-11-28 19:15:50.252032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.261 [2024-11-28 19:15:50.257212] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.261 [2024-11-28 19:15:50.257445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.261 [2024-11-28 19:15:50.257475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.261 [2024-11-28 19:15:50.262762] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.261 [2024-11-28 19:15:50.262893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.261 [2024-11-28 19:15:50.262924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.261 [2024-11-28 19:15:50.267882] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.261 [2024-11-28 19:15:50.268105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.261 [2024-11-28 19:15:50.268138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.261 [2024-11-28 19:15:50.273165] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.261 [2024-11-28 19:15:50.273342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.261 [2024-11-28 19:15:50.273374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.261 [2024-11-28 19:15:50.278247] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.261 [2024-11-28 19:15:50.278418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.261 [2024-11-28 19:15:50.278462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.261 [2024-11-28 19:15:50.284069] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.261 [2024-11-28 19:15:50.284246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.261 [2024-11-28 19:15:50.284277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.261 [2024-11-28 19:15:50.289975] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.261 [2024-11-28 19:15:50.290193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.261 [2024-11-28 19:15:50.290226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.261 [2024-11-28 19:15:50.295515] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.261 [2024-11-28 19:15:50.295664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.261 [2024-11-28 19:15:50.295693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.261 [2024-11-28 19:15:50.301011] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.261 [2024-11-28 19:15:50.301198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.261 [2024-11-28 19:15:50.301231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.521 [2024-11-28 19:15:50.306344] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.521 [2024-11-28 19:15:50.306494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.521 [2024-11-28 19:15:50.306524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.521 [2024-11-28 19:15:50.311710] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.521 [2024-11-28 19:15:50.311995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.521 [2024-11-28 19:15:50.312028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.521 [2024-11-28 19:15:50.317207] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.521 [2024-11-28 19:15:50.317348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.521 [2024-11-28 19:15:50.317381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.521 [2024-11-28 19:15:50.322567] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.521 [2024-11-28 19:15:50.322777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.521 [2024-11-28 19:15:50.322810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.521 [2024-11-28 19:15:50.327808] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.521 [2024-11-28 19:15:50.327931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.521 [2024-11-28 19:15:50.327969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.521 [2024-11-28 19:15:50.333127] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.521 [2024-11-28 19:15:50.333355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.522 [2024-11-28 19:15:50.333388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.522 [2024-11-28 19:15:50.338262] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.522 [2024-11-28 19:15:50.338468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.522 [2024-11-28 19:15:50.338497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.522 [2024-11-28 19:15:50.343532] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.522 [2024-11-28 19:15:50.343683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.522 [2024-11-28 19:15:50.343713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.522 [2024-11-28 19:15:50.348734] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.522 [2024-11-28 19:15:50.348886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.522 [2024-11-28 19:15:50.348919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.522 [2024-11-28 19:15:50.354272] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.522 [2024-11-28 19:15:50.354481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.522 [2024-11-28 19:15:50.354512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.522 [2024-11-28 19:15:50.359623] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.522 [2024-11-28 19:15:50.359812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.522 [2024-11-28 19:15:50.359843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.522 [2024-11-28 19:15:50.364984] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.522 [2024-11-28 19:15:50.365238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.522 [2024-11-28 19:15:50.365271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.522 [2024-11-28 19:15:50.370447] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.522 [2024-11-28 19:15:50.370690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.522 [2024-11-28 19:15:50.370720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.522 [2024-11-28 19:15:50.376081] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.522 [2024-11-28 19:15:50.376415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.522 [2024-11-28 19:15:50.376461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.522 [2024-11-28 19:15:50.381658] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.522 [2024-11-28 19:15:50.381868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.522 [2024-11-28 19:15:50.381901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.522 [2024-11-28 19:15:50.387159] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.522 [2024-11-28 19:15:50.387310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.522 [2024-11-28 19:15:50.387343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.522 [2024-11-28 19:15:50.392480] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.522 [2024-11-28 19:15:50.392607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.522 [2024-11-28 19:15:50.392643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.522 [2024-11-28 19:15:50.397779] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.522 [2024-11-28 19:15:50.397956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.522 [2024-11-28 19:15:50.397988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.522 [2024-11-28 19:15:50.403272] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.522 [2024-11-28 19:15:50.403375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.522 [2024-11-28 19:15:50.403415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.522 [2024-11-28 19:15:50.409104] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.522 [2024-11-28 19:15:50.409256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.522 [2024-11-28 19:15:50.409287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.522 [2024-11-28 19:15:50.414880] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.522 [2024-11-28 19:15:50.415224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.522 [2024-11-28 19:15:50.415257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.522 [2024-11-28 19:15:50.420906] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.522 [2024-11-28 19:15:50.421076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.522 [2024-11-28 19:15:50.421113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.522 [2024-11-28 19:15:50.426920] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.522 [2024-11-28 19:15:50.427011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.522 [2024-11-28 19:15:50.427044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.522 [2024-11-28 19:15:50.431840] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.522 [2024-11-28 19:15:50.431954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.522 [2024-11-28 19:15:50.431987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.522 [2024-11-28 19:15:50.436264] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.522 [2024-11-28 19:15:50.436385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.522 [2024-11-28 19:15:50.436442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.522 [2024-11-28 19:15:50.440718] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.522 [2024-11-28 19:15:50.440857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.522 [2024-11-28 19:15:50.440888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.522 [2024-11-28 19:15:50.445129] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.522 [2024-11-28 19:15:50.445258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.522 [2024-11-28 19:15:50.445290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.522 [2024-11-28 19:15:50.449981] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.522 [2024-11-28 19:15:50.450203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.522 [2024-11-28 19:15:50.450236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.522 [2024-11-28 19:15:50.455492] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.522 [2024-11-28 19:15:50.455805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.522 [2024-11-28 19:15:50.455838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.522 [2024-11-28 19:15:50.461308] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.522 [2024-11-28 19:15:50.461514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.522 [2024-11-28 19:15:50.461543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.522 [2024-11-28 19:15:50.467388] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.522 [2024-11-28 19:15:50.467546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.522 [2024-11-28 19:15:50.467575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.522 [2024-11-28 19:15:50.472762] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.522 [2024-11-28 19:15:50.472913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.522 [2024-11-28 19:15:50.472945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.522 [2024-11-28 19:15:50.478076] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.522 [2024-11-28 19:15:50.478241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.523 [2024-11-28 19:15:50.478273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.523 [2024-11-28 19:15:50.483329] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.523 [2024-11-28 19:15:50.483525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.523 [2024-11-28 19:15:50.483555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.523 [2024-11-28 19:15:50.488713] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.523 [2024-11-28 19:15:50.488871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.523 [2024-11-28 19:15:50.488903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.523 [2024-11-28 19:15:50.494079] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.523 [2024-11-28 19:15:50.494303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.523 [2024-11-28 19:15:50.494336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.523 [2024-11-28 19:15:50.499499] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.523 [2024-11-28 19:15:50.499767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.523 [2024-11-28 19:15:50.499800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.523 [2024-11-28 19:15:50.504712] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.523 [2024-11-28 19:15:50.504961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.523 [2024-11-28 19:15:50.504993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.523 [2024-11-28 19:15:50.509932] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.523 [2024-11-28 19:15:50.510102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.523 [2024-11-28 19:15:50.510133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.523 [2024-11-28 19:15:50.515288] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.523 [2024-11-28 19:15:50.515513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.523 [2024-11-28 19:15:50.515542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.523 [2024-11-28 19:15:50.520518] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.523 [2024-11-28 19:15:50.520792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.523 [2024-11-28 19:15:50.520823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.523 [2024-11-28 19:15:50.525793] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.523 [2024-11-28 19:15:50.525960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.523 [2024-11-28 19:15:50.525990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.523 [2024-11-28 19:15:50.531039] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.523 [2024-11-28 19:15:50.531157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.523 [2024-11-28 19:15:50.531188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.523 [2024-11-28 19:15:50.536455] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.523 [2024-11-28 19:15:50.536670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.523 [2024-11-28 19:15:50.536715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.523 [2024-11-28 19:15:50.541296] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.523 [2024-11-28 19:15:50.541419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.523 [2024-11-28 19:15:50.541463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.523 [2024-11-28 19:15:50.546489] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.523 [2024-11-28 19:15:50.546674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.523 [2024-11-28 19:15:50.546716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.523 [2024-11-28 19:15:50.551681] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.523 [2024-11-28 19:15:50.551830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.523 [2024-11-28 19:15:50.551861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.523 [2024-11-28 19:15:50.556978] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.523 [2024-11-28 19:15:50.557127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.523 [2024-11-28 19:15:50.557163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.523 [2024-11-28 19:15:50.562388] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.523 [2024-11-28 19:15:50.562672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.523 [2024-11-28 19:15:50.562700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.523 [2024-11-28 19:15:50.567594] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.523 [2024-11-28 19:15:50.567737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.523 [2024-11-28 19:15:50.567768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.784 [2024-11-28 19:15:50.572917] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.784 [2024-11-28 19:15:50.573057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.784 [2024-11-28 19:15:50.573088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.784 [2024-11-28 19:15:50.578259] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.784 [2024-11-28 19:15:50.578496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.784 [2024-11-28 19:15:50.578525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.784 [2024-11-28 19:15:50.583513] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.784 [2024-11-28 19:15:50.583696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.784 [2024-11-28 19:15:50.583732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.784 [2024-11-28 19:15:50.588806] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.784 [2024-11-28 19:15:50.589032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.784 [2024-11-28 19:15:50.589063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.784 [2024-11-28 19:15:50.594050] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.784 [2024-11-28 19:15:50.594211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.784 [2024-11-28 19:15:50.594242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.784 [2024-11-28 19:15:50.599245] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.784 [2024-11-28 19:15:50.599533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.784 [2024-11-28 19:15:50.599561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.784 [2024-11-28 19:15:50.604659] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.784 [2024-11-28 19:15:50.605043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.784 [2024-11-28 19:15:50.605075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.784 [2024-11-28 19:15:50.609863] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.784 [2024-11-28 19:15:50.610054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.784 [2024-11-28 19:15:50.610085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.784 [2024-11-28 19:15:50.615048] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.784 [2024-11-28 19:15:50.615223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.784 [2024-11-28 19:15:50.615254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.784 [2024-11-28 19:15:50.620498] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.784 [2024-11-28 19:15:50.620693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.784 [2024-11-28 19:15:50.620725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.784 [2024-11-28 19:15:50.625731] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.784 [2024-11-28 19:15:50.625890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.784 [2024-11-28 19:15:50.625921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.784 [2024-11-28 19:15:50.631113] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.784 [2024-11-28 19:15:50.631325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.784 [2024-11-28 19:15:50.631355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.784 [2024-11-28 19:15:50.636498] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.784 [2024-11-28 19:15:50.636632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.784 [2024-11-28 19:15:50.636659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.784 [2024-11-28 19:15:50.641921] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.784 [2024-11-28 19:15:50.642164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.784 [2024-11-28 19:15:50.642194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.784 [2024-11-28 19:15:50.647442] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.784 [2024-11-28 19:15:50.647686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.784 [2024-11-28 19:15:50.647717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.784 [2024-11-28 19:15:50.652721] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.784 [2024-11-28 19:15:50.653011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.784 [2024-11-28 19:15:50.653042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.784 [2024-11-28 19:15:50.658123] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.784 [2024-11-28 19:15:50.658302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.784 [2024-11-28 19:15:50.658334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.784 [2024-11-28 19:15:50.663598] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.784 [2024-11-28 19:15:50.663866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.784 [2024-11-28 19:15:50.663897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.784 [2024-11-28 19:15:50.668939] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.784 [2024-11-28 19:15:50.669177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.784 [2024-11-28 19:15:50.669209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.784 [2024-11-28 19:15:50.674221] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.784 [2024-11-28 19:15:50.674368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.784 [2024-11-28 19:15:50.674406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.785 [2024-11-28 19:15:50.679652] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.785 [2024-11-28 19:15:50.679841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.785 [2024-11-28 19:15:50.679872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.785 [2024-11-28 19:15:50.684882] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.785 [2024-11-28 19:15:50.685023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.785 [2024-11-28 19:15:50.685053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.785 [2024-11-28 19:15:50.690722] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.785 [2024-11-28 19:15:50.690902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.785 [2024-11-28 19:15:50.690933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.785 [2024-11-28 19:15:50.696446] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.785 [2024-11-28 19:15:50.696749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.785 [2024-11-28 19:15:50.696799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.785 [2024-11-28 19:15:50.701625] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.785 [2024-11-28 19:15:50.701830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.785 [2024-11-28 19:15:50.701862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.785 [2024-11-28 19:15:50.706810] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.785 [2024-11-28 19:15:50.706968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.785 [2024-11-28 19:15:50.706999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.785 [2024-11-28 19:15:50.712932] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.785 [2024-11-28 19:15:50.713134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.785 [2024-11-28 19:15:50.713165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.785 [2024-11-28 19:15:50.718481] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.785 [2024-11-28 19:15:50.718611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.785 [2024-11-28 19:15:50.718638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.785 [2024-11-28 19:15:50.723933] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.785 [2024-11-28 19:15:50.724095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.785 [2024-11-28 19:15:50.724125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.785 [2024-11-28 19:15:50.729028] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.785 [2024-11-28 19:15:50.729242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.785 [2024-11-28 19:15:50.729273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.785 [2024-11-28 19:15:50.733539] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.785 [2024-11-28 19:15:50.733748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.785 [2024-11-28 19:15:50.733780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.785 [2024-11-28 19:15:50.738117] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.785 [2024-11-28 19:15:50.738279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.785 [2024-11-28 19:15:50.738310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.785 [2024-11-28 19:15:50.742570] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.785 [2024-11-28 19:15:50.742697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.785 [2024-11-28 19:15:50.742742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.785 [2024-11-28 19:15:50.747011] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.785 [2024-11-28 19:15:50.747131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.785 [2024-11-28 19:15:50.747161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.785 [2024-11-28 19:15:50.751526] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.785 [2024-11-28 19:15:50.751657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.785 [2024-11-28 19:15:50.751685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.785 [2024-11-28 19:15:50.756724] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.785 [2024-11-28 19:15:50.756832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.785 [2024-11-28 19:15:50.756862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.785 [2024-11-28 19:15:50.762817] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.785 [2024-11-28 19:15:50.762995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.785 [2024-11-28 19:15:50.763027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.785 [2024-11-28 19:15:50.767941] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.785 [2024-11-28 19:15:50.768226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.785 [2024-11-28 19:15:50.768257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.785 [2024-11-28 19:15:50.773215] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.785 [2024-11-28 19:15:50.773450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.785 [2024-11-28 19:15:50.773479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.785 [2024-11-28 19:15:50.778488] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.785 [2024-11-28 19:15:50.778729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.785 [2024-11-28 19:15:50.778774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.785 [2024-11-28 19:15:50.783712] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.785 [2024-11-28 19:15:50.783945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.785 [2024-11-28 19:15:50.783975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.785 [2024-11-28 19:15:50.789075] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.785 [2024-11-28 19:15:50.789226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.785 [2024-11-28 19:15:50.789257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.785 [2024-11-28 19:15:50.794224] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.785 [2024-11-28 19:15:50.794403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.785 [2024-11-28 19:15:50.794446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.785 [2024-11-28 19:15:50.800581] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.785 [2024-11-28 19:15:50.800705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.785 [2024-11-28 19:15:50.800733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.785 [2024-11-28 19:15:50.805988] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.785 [2024-11-28 19:15:50.806189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.785 [2024-11-28 19:15:50.806220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:27:29.785 [2024-11-28 19:15:50.811378] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.785 [2024-11-28 19:15:50.811514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.785 [2024-11-28 19:15:50.811541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:27:29.785 [2024-11-28 19:15:50.816825] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.785 [2024-11-28 19:15:50.817055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.785 [2024-11-28 19:15:50.817087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:27:29.785 [2024-11-28 19:15:50.822048] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0xe62fb0) with pdu=0x2000190fef90 00:27:29.786 [2024-11-28 19:15:50.822179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:29.786 [2024-11-28 19:15:50.822208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:27:29.786 00:27:29.786 Latency(us) 00:27:29.786 [2024-11-28T18:15:50.834Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:29.786 [2024-11-28T18:15:50.834Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:27:29.786 nvme0n1 : 2.00 6219.83 777.48 0.00 0.00 2564.98 1868.99 10825.58 00:27:29.786 [2024-11-28T18:15:50.834Z] =================================================================================================================== 00:27:29.786 [2024-11-28T18:15:50.834Z] Total : 6219.83 777.48 0.00 0.00 2564.98 1868.99 10825.58 00:27:29.786 0 00:27:30.044 19:15:50 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:27:30.044 19:15:50 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:27:30.044 19:15:50 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:27:30.044 19:15:50 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:27:30.044 | .driver_specific 00:27:30.044 | .nvme_error 00:27:30.044 | .status_code 00:27:30.044 | .command_transient_transport_error' 00:27:30.301 19:15:51 -- host/digest.sh@71 -- # (( 401 > 0 )) 00:27:30.301 19:15:51 -- host/digest.sh@73 -- # killprocess 321213 00:27:30.301 19:15:51 -- common/autotest_common.sh@936 -- # '[' -z 321213 ']' 00:27:30.301 19:15:51 -- common/autotest_common.sh@940 -- # kill -0 321213 00:27:30.301 19:15:51 -- common/autotest_common.sh@941 -- # uname 00:27:30.301 19:15:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:30.301 19:15:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 321213 00:27:30.301 19:15:51 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:30.301 19:15:51 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:30.301 19:15:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 321213' 00:27:30.301 killing process with pid 321213 00:27:30.301 19:15:51 -- common/autotest_common.sh@955 -- # kill 321213 00:27:30.301 Received shutdown signal, test time was about 2.000000 seconds 00:27:30.301 00:27:30.301 Latency(us) 00:27:30.301 [2024-11-28T18:15:51.349Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:30.301 [2024-11-28T18:15:51.349Z] =================================================================================================================== 00:27:30.301 [2024-11-28T18:15:51.349Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:30.301 19:15:51 -- common/autotest_common.sh@960 -- # wait 321213 00:27:30.559 19:15:51 -- host/digest.sh@115 -- # killprocess 319534 00:27:30.559 19:15:51 -- common/autotest_common.sh@936 -- # '[' -z 319534 ']' 00:27:30.559 19:15:51 -- common/autotest_common.sh@940 -- # kill -0 319534 00:27:30.559 19:15:51 -- common/autotest_common.sh@941 -- # uname 00:27:30.559 19:15:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:30.559 19:15:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 319534 00:27:30.559 19:15:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:30.559 19:15:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:30.559 19:15:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 319534' 00:27:30.559 killing process with pid 319534 00:27:30.559 19:15:51 -- common/autotest_common.sh@955 -- # kill 319534 00:27:30.559 19:15:51 -- common/autotest_common.sh@960 -- # wait 319534 00:27:30.817 00:27:30.817 real 0m18.275s 00:27:30.818 user 0m37.010s 00:27:30.818 sys 0m4.494s 00:27:30.818 19:15:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:30.818 19:15:51 -- common/autotest_common.sh@10 -- # set +x 00:27:30.818 ************************************ 00:27:30.818 END TEST nvmf_digest_error 00:27:30.818 ************************************ 00:27:30.818 19:15:51 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:27:30.818 19:15:51 -- host/digest.sh@139 -- # nvmftestfini 00:27:30.818 19:15:51 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:30.818 19:15:51 -- nvmf/common.sh@116 -- # sync 00:27:30.818 19:15:51 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:30.818 19:15:51 -- nvmf/common.sh@119 -- # set +e 00:27:30.818 19:15:51 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:30.818 19:15:51 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:30.818 rmmod nvme_tcp 00:27:30.818 rmmod nvme_fabrics 00:27:30.818 rmmod nvme_keyring 00:27:30.818 19:15:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:30.818 19:15:51 -- nvmf/common.sh@123 -- # set -e 00:27:30.818 19:15:51 -- nvmf/common.sh@124 -- # return 0 00:27:30.818 19:15:51 -- nvmf/common.sh@477 -- # '[' -n 319534 ']' 00:27:30.818 19:15:51 -- nvmf/common.sh@478 -- # killprocess 319534 00:27:30.818 19:15:51 -- common/autotest_common.sh@936 -- # '[' -z 319534 ']' 00:27:30.818 19:15:51 -- common/autotest_common.sh@940 -- # kill -0 319534 00:27:30.818 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (319534) - No such process 00:27:30.818 19:15:51 -- common/autotest_common.sh@963 -- # echo 'Process with pid 319534 is not found' 00:27:30.818 Process with pid 319534 is not found 00:27:30.818 19:15:51 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:30.818 19:15:51 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:30.818 19:15:51 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:30.818 19:15:51 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:30.818 19:15:51 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:30.818 19:15:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:30.818 19:15:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:30.818 19:15:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:33.351 19:15:53 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:33.351 00:27:33.351 real 0m38.295s 00:27:33.351 user 1m8.743s 00:27:33.351 sys 0m10.478s 00:27:33.351 19:15:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:33.352 19:15:53 -- common/autotest_common.sh@10 -- # set +x 00:27:33.352 ************************************ 00:27:33.352 END TEST nvmf_digest 00:27:33.352 ************************************ 00:27:33.352 19:15:53 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:27:33.352 19:15:53 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:27:33.352 19:15:53 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:27:33.352 19:15:53 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:27:33.352 19:15:53 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:33.352 19:15:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:33.352 19:15:53 -- common/autotest_common.sh@10 -- # set +x 00:27:33.352 ************************************ 00:27:33.352 START TEST nvmf_bdevperf 00:27:33.352 ************************************ 00:27:33.352 19:15:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:27:33.352 * Looking for test storage... 00:27:33.352 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:33.352 19:15:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:33.352 19:15:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:33.352 19:15:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:33.352 19:15:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:33.352 19:15:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:33.352 19:15:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:33.352 19:15:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:33.352 19:15:53 -- scripts/common.sh@335 -- # IFS=.-: 00:27:33.352 19:15:53 -- scripts/common.sh@335 -- # read -ra ver1 00:27:33.352 19:15:53 -- scripts/common.sh@336 -- # IFS=.-: 00:27:33.352 19:15:53 -- scripts/common.sh@336 -- # read -ra ver2 00:27:33.352 19:15:53 -- scripts/common.sh@337 -- # local 'op=<' 00:27:33.352 19:15:53 -- scripts/common.sh@339 -- # ver1_l=2 00:27:33.352 19:15:53 -- scripts/common.sh@340 -- # ver2_l=1 00:27:33.352 19:15:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:33.352 19:15:53 -- scripts/common.sh@343 -- # case "$op" in 00:27:33.352 19:15:53 -- scripts/common.sh@344 -- # : 1 00:27:33.352 19:15:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:33.352 19:15:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:33.352 19:15:53 -- scripts/common.sh@364 -- # decimal 1 00:27:33.352 19:15:53 -- scripts/common.sh@352 -- # local d=1 00:27:33.352 19:15:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:33.352 19:15:53 -- scripts/common.sh@354 -- # echo 1 00:27:33.352 19:15:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:33.352 19:15:53 -- scripts/common.sh@365 -- # decimal 2 00:27:33.352 19:15:53 -- scripts/common.sh@352 -- # local d=2 00:27:33.352 19:15:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:33.352 19:15:53 -- scripts/common.sh@354 -- # echo 2 00:27:33.352 19:15:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:33.352 19:15:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:33.352 19:15:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:33.352 19:15:53 -- scripts/common.sh@367 -- # return 0 00:27:33.352 19:15:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:33.352 19:15:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:33.352 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:33.352 --rc genhtml_branch_coverage=1 00:27:33.352 --rc genhtml_function_coverage=1 00:27:33.352 --rc genhtml_legend=1 00:27:33.352 --rc geninfo_all_blocks=1 00:27:33.352 --rc geninfo_unexecuted_blocks=1 00:27:33.352 00:27:33.352 ' 00:27:33.352 19:15:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:33.352 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:33.352 --rc genhtml_branch_coverage=1 00:27:33.352 --rc genhtml_function_coverage=1 00:27:33.352 --rc genhtml_legend=1 00:27:33.352 --rc geninfo_all_blocks=1 00:27:33.352 --rc geninfo_unexecuted_blocks=1 00:27:33.352 00:27:33.352 ' 00:27:33.352 19:15:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:33.352 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:33.352 --rc genhtml_branch_coverage=1 00:27:33.352 --rc genhtml_function_coverage=1 00:27:33.352 --rc genhtml_legend=1 00:27:33.352 --rc geninfo_all_blocks=1 00:27:33.352 --rc geninfo_unexecuted_blocks=1 00:27:33.352 00:27:33.352 ' 00:27:33.352 19:15:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:33.352 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:33.352 --rc genhtml_branch_coverage=1 00:27:33.352 --rc genhtml_function_coverage=1 00:27:33.352 --rc genhtml_legend=1 00:27:33.352 --rc geninfo_all_blocks=1 00:27:33.352 --rc geninfo_unexecuted_blocks=1 00:27:33.352 00:27:33.352 ' 00:27:33.352 19:15:53 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:33.352 19:15:53 -- nvmf/common.sh@7 -- # uname -s 00:27:33.352 19:15:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:33.352 19:15:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:33.352 19:15:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:33.352 19:15:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:33.352 19:15:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:33.352 19:15:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:33.352 19:15:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:33.352 19:15:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:33.352 19:15:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:33.352 19:15:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:33.352 19:15:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:33.352 19:15:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:33.352 19:15:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:33.352 19:15:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:33.352 19:15:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:33.352 19:15:53 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:33.352 19:15:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:33.352 19:15:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:33.352 19:15:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:33.352 19:15:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:33.352 19:15:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:33.352 19:15:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:33.352 19:15:53 -- paths/export.sh@5 -- # export PATH 00:27:33.352 19:15:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:33.352 19:15:53 -- nvmf/common.sh@46 -- # : 0 00:27:33.352 19:15:53 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:33.352 19:15:53 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:33.352 19:15:53 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:33.352 19:15:53 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:33.352 19:15:53 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:33.352 19:15:53 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:33.352 19:15:53 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:33.352 19:15:53 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:33.352 19:15:53 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:27:33.352 19:15:53 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:27:33.352 19:15:53 -- host/bdevperf.sh@24 -- # nvmftestinit 00:27:33.352 19:15:53 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:33.352 19:15:53 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:33.352 19:15:53 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:33.352 19:15:53 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:33.352 19:15:53 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:33.352 19:15:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:33.352 19:15:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:33.352 19:15:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:33.352 19:15:53 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:33.352 19:15:53 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:33.352 19:15:53 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:33.352 19:15:53 -- common/autotest_common.sh@10 -- # set +x 00:27:35.255 19:15:55 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:35.255 19:15:55 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:35.255 19:15:55 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:35.255 19:15:55 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:35.255 19:15:55 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:35.255 19:15:55 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:35.255 19:15:55 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:35.255 19:15:55 -- nvmf/common.sh@294 -- # net_devs=() 00:27:35.255 19:15:55 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:35.255 19:15:55 -- nvmf/common.sh@295 -- # e810=() 00:27:35.255 19:15:55 -- nvmf/common.sh@295 -- # local -ga e810 00:27:35.255 19:15:55 -- nvmf/common.sh@296 -- # x722=() 00:27:35.255 19:15:55 -- nvmf/common.sh@296 -- # local -ga x722 00:27:35.255 19:15:55 -- nvmf/common.sh@297 -- # mlx=() 00:27:35.255 19:15:55 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:35.255 19:15:55 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:35.255 19:15:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:35.255 19:15:55 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:35.255 19:15:55 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:35.255 19:15:55 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:35.255 19:15:55 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:35.255 19:15:55 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:35.255 19:15:55 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:35.255 19:15:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:35.255 19:15:55 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:35.255 19:15:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:35.255 19:15:55 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:35.255 19:15:55 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:35.255 19:15:55 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:35.255 19:15:55 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:35.255 19:15:55 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:35.255 19:15:55 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:35.255 19:15:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:35.255 19:15:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:35.255 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:35.255 19:15:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:35.255 19:15:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:35.255 19:15:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:35.255 19:15:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:35.255 19:15:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:35.255 19:15:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:35.255 19:15:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:35.255 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:35.255 19:15:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:35.255 19:15:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:35.255 19:15:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:35.255 19:15:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:35.256 19:15:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:35.256 19:15:55 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:35.256 19:15:55 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:35.256 19:15:55 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:35.256 19:15:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:35.256 19:15:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:35.256 19:15:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:35.256 19:15:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:35.256 19:15:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:35.256 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:35.256 19:15:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:35.256 19:15:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:35.256 19:15:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:35.256 19:15:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:35.256 19:15:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:35.256 19:15:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:35.256 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:35.256 19:15:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:35.256 19:15:55 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:35.256 19:15:55 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:35.256 19:15:55 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:35.256 19:15:55 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:35.256 19:15:55 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:35.256 19:15:55 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:35.256 19:15:55 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:35.256 19:15:55 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:35.256 19:15:55 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:35.256 19:15:55 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:35.256 19:15:55 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:35.256 19:15:55 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:35.256 19:15:55 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:35.256 19:15:55 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:35.256 19:15:55 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:35.256 19:15:55 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:35.256 19:15:55 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:35.256 19:15:55 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:35.256 19:15:56 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:35.256 19:15:56 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:35.256 19:15:56 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:35.256 19:15:56 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:35.256 19:15:56 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:35.256 19:15:56 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:35.256 19:15:56 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:35.256 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:35.256 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.177 ms 00:27:35.256 00:27:35.256 --- 10.0.0.2 ping statistics --- 00:27:35.256 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:35.256 rtt min/avg/max/mdev = 0.177/0.177/0.177/0.000 ms 00:27:35.256 19:15:56 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:35.256 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:35.256 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.073 ms 00:27:35.256 00:27:35.256 --- 10.0.0.1 ping statistics --- 00:27:35.256 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:35.256 rtt min/avg/max/mdev = 0.073/0.073/0.073/0.000 ms 00:27:35.256 19:15:56 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:35.256 19:15:56 -- nvmf/common.sh@410 -- # return 0 00:27:35.256 19:15:56 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:35.256 19:15:56 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:35.256 19:15:56 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:35.256 19:15:56 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:35.256 19:15:56 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:35.256 19:15:56 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:35.256 19:15:56 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:35.256 19:15:56 -- host/bdevperf.sh@25 -- # tgt_init 00:27:35.256 19:15:56 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:27:35.256 19:15:56 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:35.256 19:15:56 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:35.256 19:15:56 -- common/autotest_common.sh@10 -- # set +x 00:27:35.256 19:15:56 -- nvmf/common.sh@469 -- # nvmfpid=323727 00:27:35.256 19:15:56 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:35.256 19:15:56 -- nvmf/common.sh@470 -- # waitforlisten 323727 00:27:35.256 19:15:56 -- common/autotest_common.sh@829 -- # '[' -z 323727 ']' 00:27:35.256 19:15:56 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:35.256 19:15:56 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:35.256 19:15:56 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:35.256 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:35.256 19:15:56 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:35.256 19:15:56 -- common/autotest_common.sh@10 -- # set +x 00:27:35.256 [2024-11-28 19:15:56.285575] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:35.256 [2024-11-28 19:15:56.285663] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:35.514 EAL: No free 2048 kB hugepages reported on node 1 00:27:35.514 [2024-11-28 19:15:56.357090] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:35.514 [2024-11-28 19:15:56.473474] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:35.514 [2024-11-28 19:15:56.473643] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:35.514 [2024-11-28 19:15:56.473663] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:35.514 [2024-11-28 19:15:56.473677] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:35.514 [2024-11-28 19:15:56.473796] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:35.514 [2024-11-28 19:15:56.473879] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:35.514 [2024-11-28 19:15:56.473882] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:36.448 19:15:57 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:36.448 19:15:57 -- common/autotest_common.sh@862 -- # return 0 00:27:36.448 19:15:57 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:36.448 19:15:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:36.448 19:15:57 -- common/autotest_common.sh@10 -- # set +x 00:27:36.448 19:15:57 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:36.448 19:15:57 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:36.448 19:15:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:36.448 19:15:57 -- common/autotest_common.sh@10 -- # set +x 00:27:36.448 [2024-11-28 19:15:57.265573] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:36.448 19:15:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:36.448 19:15:57 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:36.448 19:15:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:36.448 19:15:57 -- common/autotest_common.sh@10 -- # set +x 00:27:36.448 Malloc0 00:27:36.448 19:15:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:36.448 19:15:57 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:36.448 19:15:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:36.448 19:15:57 -- common/autotest_common.sh@10 -- # set +x 00:27:36.448 19:15:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:36.448 19:15:57 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:36.448 19:15:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:36.448 19:15:57 -- common/autotest_common.sh@10 -- # set +x 00:27:36.448 19:15:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:36.448 19:15:57 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:36.448 19:15:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:36.448 19:15:57 -- common/autotest_common.sh@10 -- # set +x 00:27:36.448 [2024-11-28 19:15:57.330321] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:36.448 19:15:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:36.448 19:15:57 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:27:36.448 19:15:57 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:27:36.448 19:15:57 -- nvmf/common.sh@520 -- # config=() 00:27:36.448 19:15:57 -- nvmf/common.sh@520 -- # local subsystem config 00:27:36.448 19:15:57 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:36.448 19:15:57 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:36.448 { 00:27:36.448 "params": { 00:27:36.448 "name": "Nvme$subsystem", 00:27:36.448 "trtype": "$TEST_TRANSPORT", 00:27:36.448 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:36.448 "adrfam": "ipv4", 00:27:36.448 "trsvcid": "$NVMF_PORT", 00:27:36.448 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:36.448 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:36.448 "hdgst": ${hdgst:-false}, 00:27:36.448 "ddgst": ${ddgst:-false} 00:27:36.448 }, 00:27:36.448 "method": "bdev_nvme_attach_controller" 00:27:36.448 } 00:27:36.448 EOF 00:27:36.448 )") 00:27:36.448 19:15:57 -- nvmf/common.sh@542 -- # cat 00:27:36.448 19:15:57 -- nvmf/common.sh@544 -- # jq . 00:27:36.448 19:15:57 -- nvmf/common.sh@545 -- # IFS=, 00:27:36.448 19:15:57 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:36.448 "params": { 00:27:36.448 "name": "Nvme1", 00:27:36.448 "trtype": "tcp", 00:27:36.448 "traddr": "10.0.0.2", 00:27:36.448 "adrfam": "ipv4", 00:27:36.448 "trsvcid": "4420", 00:27:36.448 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:27:36.448 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:27:36.448 "hdgst": false, 00:27:36.448 "ddgst": false 00:27:36.448 }, 00:27:36.448 "method": "bdev_nvme_attach_controller" 00:27:36.448 }' 00:27:36.448 [2024-11-28 19:15:57.370951] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:36.448 [2024-11-28 19:15:57.371026] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid323886 ] 00:27:36.448 EAL: No free 2048 kB hugepages reported on node 1 00:27:36.448 [2024-11-28 19:15:57.433916] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:36.707 [2024-11-28 19:15:57.542874] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:36.707 Running I/O for 1 seconds... 00:27:38.086 00:27:38.086 Latency(us) 00:27:38.086 [2024-11-28T18:15:59.134Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:38.086 [2024-11-28T18:15:59.134Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:38.086 Verification LBA range: start 0x0 length 0x4000 00:27:38.086 Nvme1n1 : 1.01 12973.79 50.68 0.00 0.00 9823.51 1231.83 17670.45 00:27:38.086 [2024-11-28T18:15:59.134Z] =================================================================================================================== 00:27:38.086 [2024-11-28T18:15:59.134Z] Total : 12973.79 50.68 0.00 0.00 9823.51 1231.83 17670.45 00:27:38.086 19:15:58 -- host/bdevperf.sh@30 -- # bdevperfpid=324159 00:27:38.086 19:15:58 -- host/bdevperf.sh@32 -- # sleep 3 00:27:38.086 19:15:58 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:27:38.086 19:15:58 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:27:38.086 19:15:58 -- nvmf/common.sh@520 -- # config=() 00:27:38.086 19:15:58 -- nvmf/common.sh@520 -- # local subsystem config 00:27:38.086 19:15:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:27:38.086 19:15:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:27:38.086 { 00:27:38.086 "params": { 00:27:38.086 "name": "Nvme$subsystem", 00:27:38.086 "trtype": "$TEST_TRANSPORT", 00:27:38.086 "traddr": "$NVMF_FIRST_TARGET_IP", 00:27:38.086 "adrfam": "ipv4", 00:27:38.086 "trsvcid": "$NVMF_PORT", 00:27:38.086 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:27:38.086 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:27:38.086 "hdgst": ${hdgst:-false}, 00:27:38.086 "ddgst": ${ddgst:-false} 00:27:38.086 }, 00:27:38.086 "method": "bdev_nvme_attach_controller" 00:27:38.086 } 00:27:38.086 EOF 00:27:38.086 )") 00:27:38.086 19:15:58 -- nvmf/common.sh@542 -- # cat 00:27:38.086 19:15:58 -- nvmf/common.sh@544 -- # jq . 00:27:38.086 19:15:58 -- nvmf/common.sh@545 -- # IFS=, 00:27:38.086 19:15:58 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:27:38.086 "params": { 00:27:38.086 "name": "Nvme1", 00:27:38.086 "trtype": "tcp", 00:27:38.086 "traddr": "10.0.0.2", 00:27:38.086 "adrfam": "ipv4", 00:27:38.086 "trsvcid": "4420", 00:27:38.086 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:27:38.086 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:27:38.086 "hdgst": false, 00:27:38.086 "ddgst": false 00:27:38.086 }, 00:27:38.086 "method": "bdev_nvme_attach_controller" 00:27:38.086 }' 00:27:38.086 [2024-11-28 19:15:59.015504] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:38.086 [2024-11-28 19:15:59.015596] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid324159 ] 00:27:38.086 EAL: No free 2048 kB hugepages reported on node 1 00:27:38.086 [2024-11-28 19:15:59.074868] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:38.345 [2024-11-28 19:15:59.179440] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:38.345 Running I/O for 15 seconds... 00:27:41.646 19:16:01 -- host/bdevperf.sh@33 -- # kill -9 323727 00:27:41.646 19:16:01 -- host/bdevperf.sh@35 -- # sleep 3 00:27:41.646 [2024-11-28 19:16:01.991508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:7816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.646 [2024-11-28 19:16:01.991561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.646 [2024-11-28 19:16:01.991591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:7824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.646 [2024-11-28 19:16:01.991609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.646 [2024-11-28 19:16:01.991628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:7840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.646 [2024-11-28 19:16:01.991645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.646 [2024-11-28 19:16:01.991662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:7848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.646 [2024-11-28 19:16:01.991697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.646 [2024-11-28 19:16:01.991714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.646 [2024-11-28 19:16:01.991731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.646 [2024-11-28 19:16:01.991768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:7880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.646 [2024-11-28 19:16:01.991786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.991804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:7888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.647 [2024-11-28 19:16:01.991822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.991843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:7896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.647 [2024-11-28 19:16:01.991862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.991894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:7904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.647 [2024-11-28 19:16:01.991913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.991931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:7912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.647 [2024-11-28 19:16:01.991946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.991966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:7920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.647 [2024-11-28 19:16:01.991984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.992001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:7928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.647 [2024-11-28 19:16:01.992018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.992037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:7192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.647 [2024-11-28 19:16:01.992053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.992072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:7208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.647 [2024-11-28 19:16:01.992088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.992105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:7232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.647 [2024-11-28 19:16:01.992120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.992147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:7248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.647 [2024-11-28 19:16:01.992162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.992179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:7256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.647 [2024-11-28 19:16:01.992195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.992213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:7264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.647 [2024-11-28 19:16:01.992229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.992246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:7288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.647 [2024-11-28 19:16:01.992263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.992280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:7328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.647 [2024-11-28 19:16:01.992296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.992312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:8048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.647 [2024-11-28 19:16:01.992332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.992349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.647 [2024-11-28 19:16:01.992365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.992382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:8080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.647 [2024-11-28 19:16:01.992412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.992466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:8088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.647 [2024-11-28 19:16:01.992482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.992498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:8096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.647 [2024-11-28 19:16:01.992512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.992528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:8104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.647 [2024-11-28 19:16:01.992542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.992557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:8112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.647 [2024-11-28 19:16:01.992571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.992586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:8136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.647 [2024-11-28 19:16:01.992599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.992615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:8144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.647 [2024-11-28 19:16:01.992629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.992644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:8160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.647 [2024-11-28 19:16:01.992661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.992692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:8176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:41.647 [2024-11-28 19:16:01.992708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.992730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:8184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.647 [2024-11-28 19:16:01.992745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.992762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:8192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.647 [2024-11-28 19:16:01.992776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.992794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:8200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.647 [2024-11-28 19:16:01.992813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.992831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:8208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.647 [2024-11-28 19:16:01.992849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.992866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:8216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:41.647 [2024-11-28 19:16:01.992882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.992899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:7392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.647 [2024-11-28 19:16:01.992914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.992933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:7400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.647 [2024-11-28 19:16:01.992948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.992965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:7408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.647 [2024-11-28 19:16:01.992980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.992998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:7416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.647 [2024-11-28 19:16:01.993013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.993030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:7440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.647 [2024-11-28 19:16:01.993045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.993062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:7448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.647 [2024-11-28 19:16:01.993077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.993094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:7496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.647 [2024-11-28 19:16:01.993110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.993127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:7504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.647 [2024-11-28 19:16:01.993142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.993159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:8224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:41.647 [2024-11-28 19:16:01.993175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.647 [2024-11-28 19:16:01.993191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:115 nsid:1 lba:8232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:41.648 [2024-11-28 19:16:01.993207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.993229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:8240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:41.648 [2024-11-28 19:16:01.993245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.993263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:8248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.648 [2024-11-28 19:16:01.993278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.993295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:8256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.648 [2024-11-28 19:16:01.993310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.993327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:8264 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:41.648 [2024-11-28 19:16:01.993342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.993360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:8272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:41.648 [2024-11-28 19:16:01.993376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.993401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:8280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:41.648 [2024-11-28 19:16:01.993435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.993463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:101 nsid:1 lba:8288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:41.648 [2024-11-28 19:16:01.993478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.993494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:8296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:41.648 [2024-11-28 19:16:01.993508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.993523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:8304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:41.648 [2024-11-28 19:16:01.993537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.993553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.648 [2024-11-28 19:16:01.993566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.993582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:7512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.648 [2024-11-28 19:16:01.993596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.993611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:7528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.648 [2024-11-28 19:16:01.993625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.993641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:7552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.648 [2024-11-28 19:16:01.993658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.993674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:7576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.648 [2024-11-28 19:16:01.993713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.993731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:7600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.648 [2024-11-28 19:16:01.993756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.993773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:7608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.648 [2024-11-28 19:16:01.993788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.993805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:7624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.648 [2024-11-28 19:16:01.993820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.993838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:7632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.648 [2024-11-28 19:16:01.993853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.993870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:8320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:41.648 [2024-11-28 19:16:01.993885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.993902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:8328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.648 [2024-11-28 19:16:01.993917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.993934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:8336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:41.648 [2024-11-28 19:16:01.993949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.993966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:7640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.648 [2024-11-28 19:16:01.993981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.993998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:7664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.648 [2024-11-28 19:16:01.994016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.994033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:7672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.648 [2024-11-28 19:16:01.994049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.994066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:7696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.648 [2024-11-28 19:16:01.994082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.994100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:7712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.648 [2024-11-28 19:16:01.994120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.994139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:7744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.648 [2024-11-28 19:16:01.994154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.994172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:7752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.648 [2024-11-28 19:16:01.994188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.994206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:7776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.648 [2024-11-28 19:16:01.994221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.994238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:8344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.648 [2024-11-28 19:16:01.994255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.994273] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:8352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.648 [2024-11-28 19:16:01.994289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.994306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:8360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.648 [2024-11-28 19:16:01.994322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.994340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:8368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:41.648 [2024-11-28 19:16:01.994356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.994374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:8376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.648 [2024-11-28 19:16:01.994389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.994415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:103 nsid:1 lba:8384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:41.648 [2024-11-28 19:16:01.994432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.994468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:8392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:41.648 [2024-11-28 19:16:01.994483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.994498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:8400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:41.648 [2024-11-28 19:16:01.994513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.994529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:8408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:41.648 [2024-11-28 19:16:01.994543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.994567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:8416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.648 [2024-11-28 19:16:01.994583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.648 [2024-11-28 19:16:01.994599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:8424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.649 [2024-11-28 19:16:01.994613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.994628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:8432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:41.649 [2024-11-28 19:16:01.994642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.994658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:8440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.649 [2024-11-28 19:16:01.994698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.994716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:8448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:41.649 [2024-11-28 19:16:01.994732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.994750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:8456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:41.649 [2024-11-28 19:16:01.994766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.994784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:8464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:41.649 [2024-11-28 19:16:01.994799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.994817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:8472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:41.649 [2024-11-28 19:16:01.994834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.994852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:8480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:41.649 [2024-11-28 19:16:01.994867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.994885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:8488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:41.649 [2024-11-28 19:16:01.994901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.994919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:8496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:41.649 [2024-11-28 19:16:01.994934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.994952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:8504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.649 [2024-11-28 19:16:01.994968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.994985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:8512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.649 [2024-11-28 19:16:01.995005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.995024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:8520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:41.649 [2024-11-28 19:16:01.995040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.995057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:8528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.649 [2024-11-28 19:16:01.995080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.995103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:8536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:41.649 [2024-11-28 19:16:01.995119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.995136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:8544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:41.649 [2024-11-28 19:16:01.995152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.995169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:8552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:41.649 [2024-11-28 19:16:01.995184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.995201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.649 [2024-11-28 19:16:01.995216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.995233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:8568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:41.649 [2024-11-28 19:16:01.995248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.995264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:7808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.649 [2024-11-28 19:16:01.995280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.995297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:7832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.649 [2024-11-28 19:16:01.995312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.995329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:7864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.649 [2024-11-28 19:16:01.995344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.995362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:7872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.649 [2024-11-28 19:16:01.995377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.995401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:7936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.649 [2024-11-28 19:16:01.995418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.995450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:7944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.649 [2024-11-28 19:16:01.995472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.995489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:7952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.649 [2024-11-28 19:16:01.995503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.995518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:7960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.649 [2024-11-28 19:16:01.995532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.995548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:7968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.649 [2024-11-28 19:16:01.995562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.995577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:7976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.649 [2024-11-28 19:16:01.995591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.995606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:7984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.649 [2024-11-28 19:16:01.995625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.995646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:7992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.649 [2024-11-28 19:16:01.995660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.995696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:8000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.649 [2024-11-28 19:16:01.995711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.995729] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:8008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.649 [2024-11-28 19:16:01.995744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.995761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:8016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.649 [2024-11-28 19:16:01.995777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.995794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:8024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.649 [2024-11-28 19:16:01.995809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.995826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.649 [2024-11-28 19:16:01.995841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.995857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:8040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.649 [2024-11-28 19:16:01.995873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.995894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:8056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.649 [2024-11-28 19:16:01.995910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.995928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:8064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.649 [2024-11-28 19:16:01.995943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.649 [2024-11-28 19:16:01.995960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:8120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.650 [2024-11-28 19:16:01.995975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.650 [2024-11-28 19:16:01.995991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:8128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.650 [2024-11-28 19:16:01.996007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.650 [2024-11-28 19:16:01.996024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:8152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:41.650 [2024-11-28 19:16:01.996039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.650 [2024-11-28 19:16:01.996055] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11d8740 is same with the state(5) to be set 00:27:41.650 [2024-11-28 19:16:01.996073] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:41.650 [2024-11-28 19:16:01.996085] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:41.650 [2024-11-28 19:16:01.996098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8168 len:8 PRP1 0x0 PRP2 0x0 00:27:41.650 [2024-11-28 19:16:01.996112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:41.650 [2024-11-28 19:16:01.996182] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x11d8740 was disconnected and freed. reset controller. 00:27:41.650 [2024-11-28 19:16:01.998798] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.650 [2024-11-28 19:16:01.998884] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.650 [2024-11-28 19:16:01.999436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.650 [2024-11-28 19:16:01.999558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.650 [2024-11-28 19:16:01.999584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.650 [2024-11-28 19:16:01.999600] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.650 [2024-11-28 19:16:01.999806] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.650 [2024-11-28 19:16:01.999941] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.650 [2024-11-28 19:16:01.999965] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.650 [2024-11-28 19:16:01.999983] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.650 [2024-11-28 19:16:02.002540] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.650 [2024-11-28 19:16:02.011643] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.650 [2024-11-28 19:16:02.012012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.650 [2024-11-28 19:16:02.012139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.650 [2024-11-28 19:16:02.012169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.650 [2024-11-28 19:16:02.012186] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.650 [2024-11-28 19:16:02.012279] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.650 [2024-11-28 19:16:02.012455] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.650 [2024-11-28 19:16:02.012477] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.650 [2024-11-28 19:16:02.012492] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.650 [2024-11-28 19:16:02.015000] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.650 [2024-11-28 19:16:02.024479] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.650 [2024-11-28 19:16:02.024731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.650 [2024-11-28 19:16:02.024871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.650 [2024-11-28 19:16:02.024914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.650 [2024-11-28 19:16:02.024931] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.650 [2024-11-28 19:16:02.025097] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.650 [2024-11-28 19:16:02.025297] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.650 [2024-11-28 19:16:02.025323] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.650 [2024-11-28 19:16:02.025339] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.650 [2024-11-28 19:16:02.027635] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.650 [2024-11-28 19:16:02.037055] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.650 [2024-11-28 19:16:02.037364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.650 [2024-11-28 19:16:02.037504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.650 [2024-11-28 19:16:02.037531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.650 [2024-11-28 19:16:02.037547] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.650 [2024-11-28 19:16:02.037733] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.650 [2024-11-28 19:16:02.037902] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.650 [2024-11-28 19:16:02.037928] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.650 [2024-11-28 19:16:02.037945] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.650 [2024-11-28 19:16:02.040280] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.650 [2024-11-28 19:16:02.049465] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.650 [2024-11-28 19:16:02.049828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.650 [2024-11-28 19:16:02.049975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.650 [2024-11-28 19:16:02.050002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.650 [2024-11-28 19:16:02.050037] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.650 [2024-11-28 19:16:02.050166] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.650 [2024-11-28 19:16:02.050353] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.650 [2024-11-28 19:16:02.050379] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.650 [2024-11-28 19:16:02.050406] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.650 [2024-11-28 19:16:02.052670] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.650 [2024-11-28 19:16:02.061951] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.650 [2024-11-28 19:16:02.062253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.650 [2024-11-28 19:16:02.062402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.650 [2024-11-28 19:16:02.062448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.650 [2024-11-28 19:16:02.062465] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.650 [2024-11-28 19:16:02.062583] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.650 [2024-11-28 19:16:02.062687] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.650 [2024-11-28 19:16:02.062707] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.650 [2024-11-28 19:16:02.062721] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.650 [2024-11-28 19:16:02.065117] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.650 [2024-11-28 19:16:02.074773] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.650 [2024-11-28 19:16:02.075097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.650 [2024-11-28 19:16:02.075244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.650 [2024-11-28 19:16:02.075274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.650 [2024-11-28 19:16:02.075293] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.650 [2024-11-28 19:16:02.075501] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.650 [2024-11-28 19:16:02.075605] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.650 [2024-11-28 19:16:02.075627] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.650 [2024-11-28 19:16:02.075642] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.650 [2024-11-28 19:16:02.077954] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.650 [2024-11-28 19:16:02.087367] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.650 [2024-11-28 19:16:02.087690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.650 [2024-11-28 19:16:02.087824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.650 [2024-11-28 19:16:02.087852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.650 [2024-11-28 19:16:02.087876] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.650 [2024-11-28 19:16:02.088061] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.650 [2024-11-28 19:16:02.088230] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.650 [2024-11-28 19:16:02.088257] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.650 [2024-11-28 19:16:02.088273] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.650 [2024-11-28 19:16:02.090613] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.650 [2024-11-28 19:16:02.099838] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.650 [2024-11-28 19:16:02.100152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.651 [2024-11-28 19:16:02.100306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.651 [2024-11-28 19:16:02.100336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.651 [2024-11-28 19:16:02.100355] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.651 [2024-11-28 19:16:02.100513] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.651 [2024-11-28 19:16:02.100664] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.651 [2024-11-28 19:16:02.100689] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.651 [2024-11-28 19:16:02.100705] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.651 [2024-11-28 19:16:02.102969] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.651 [2024-11-28 19:16:02.112237] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.651 [2024-11-28 19:16:02.112534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.651 [2024-11-28 19:16:02.112665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.651 [2024-11-28 19:16:02.112696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.651 [2024-11-28 19:16:02.112715] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.651 [2024-11-28 19:16:02.112864] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.651 [2024-11-28 19:16:02.113033] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.651 [2024-11-28 19:16:02.113059] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.651 [2024-11-28 19:16:02.113075] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.651 [2024-11-28 19:16:02.115238] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.651 [2024-11-28 19:16:02.124759] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.651 [2024-11-28 19:16:02.125091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.651 [2024-11-28 19:16:02.125246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.651 [2024-11-28 19:16:02.125277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.651 [2024-11-28 19:16:02.125296] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.651 [2024-11-28 19:16:02.125482] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.651 [2024-11-28 19:16:02.125652] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.651 [2024-11-28 19:16:02.125678] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.651 [2024-11-28 19:16:02.125694] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.651 [2024-11-28 19:16:02.128016] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.651 [2024-11-28 19:16:02.137452] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.651 [2024-11-28 19:16:02.137757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.651 [2024-11-28 19:16:02.137884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.651 [2024-11-28 19:16:02.137911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.651 [2024-11-28 19:16:02.137929] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.651 [2024-11-28 19:16:02.138113] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.651 [2024-11-28 19:16:02.138264] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.651 [2024-11-28 19:16:02.138290] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.651 [2024-11-28 19:16:02.138305] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.651 [2024-11-28 19:16:02.140781] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.651 [2024-11-28 19:16:02.149982] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.651 [2024-11-28 19:16:02.150292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.651 [2024-11-28 19:16:02.150431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.651 [2024-11-28 19:16:02.150461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.651 [2024-11-28 19:16:02.150480] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.651 [2024-11-28 19:16:02.150629] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.651 [2024-11-28 19:16:02.150780] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.651 [2024-11-28 19:16:02.150806] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.651 [2024-11-28 19:16:02.150823] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.651 [2024-11-28 19:16:02.153071] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.651 [2024-11-28 19:16:02.162850] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.651 [2024-11-28 19:16:02.163202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.651 [2024-11-28 19:16:02.163358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.651 [2024-11-28 19:16:02.163388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.651 [2024-11-28 19:16:02.163421] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.651 [2024-11-28 19:16:02.163588] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.651 [2024-11-28 19:16:02.163801] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.651 [2024-11-28 19:16:02.163826] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.651 [2024-11-28 19:16:02.163843] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.651 [2024-11-28 19:16:02.166167] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.651 [2024-11-28 19:16:02.175666] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.651 [2024-11-28 19:16:02.175978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.651 [2024-11-28 19:16:02.176146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.651 [2024-11-28 19:16:02.176171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.651 [2024-11-28 19:16:02.176188] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.651 [2024-11-28 19:16:02.176311] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.651 [2024-11-28 19:16:02.176458] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.651 [2024-11-28 19:16:02.176482] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.651 [2024-11-28 19:16:02.176499] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.651 [2024-11-28 19:16:02.178695] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.651 [2024-11-28 19:16:02.188389] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.651 [2024-11-28 19:16:02.188690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.651 [2024-11-28 19:16:02.188819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.652 [2024-11-28 19:16:02.188862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.652 [2024-11-28 19:16:02.188879] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.652 [2024-11-28 19:16:02.189023] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.652 [2024-11-28 19:16:02.189189] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.652 [2024-11-28 19:16:02.189214] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.652 [2024-11-28 19:16:02.189231] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.652 [2024-11-28 19:16:02.191674] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.652 [2024-11-28 19:16:02.200919] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.652 [2024-11-28 19:16:02.201244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.652 [2024-11-28 19:16:02.201373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.652 [2024-11-28 19:16:02.201414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.652 [2024-11-28 19:16:02.201434] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.652 [2024-11-28 19:16:02.201582] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.652 [2024-11-28 19:16:02.201752] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.652 [2024-11-28 19:16:02.201783] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.652 [2024-11-28 19:16:02.201801] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.652 [2024-11-28 19:16:02.204338] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.652 [2024-11-28 19:16:02.213377] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.652 [2024-11-28 19:16:02.213685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.652 [2024-11-28 19:16:02.213815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.652 [2024-11-28 19:16:02.213844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.652 [2024-11-28 19:16:02.213863] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.652 [2024-11-28 19:16:02.213993] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.652 [2024-11-28 19:16:02.214180] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.652 [2024-11-28 19:16:02.214206] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.652 [2024-11-28 19:16:02.214223] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.652 [2024-11-28 19:16:02.216447] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.652 [2024-11-28 19:16:02.226006] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.652 [2024-11-28 19:16:02.226333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.652 [2024-11-28 19:16:02.226470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.652 [2024-11-28 19:16:02.226502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.652 [2024-11-28 19:16:02.226521] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.652 [2024-11-28 19:16:02.226669] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.652 [2024-11-28 19:16:02.226856] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.652 [2024-11-28 19:16:02.226882] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.652 [2024-11-28 19:16:02.226899] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.652 [2024-11-28 19:16:02.229292] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.652 [2024-11-28 19:16:02.238483] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.652 [2024-11-28 19:16:02.238812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.652 [2024-11-28 19:16:02.238974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.652 [2024-11-28 19:16:02.239004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.652 [2024-11-28 19:16:02.239022] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.652 [2024-11-28 19:16:02.239224] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.652 [2024-11-28 19:16:02.239407] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.652 [2024-11-28 19:16:02.239444] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.652 [2024-11-28 19:16:02.239466] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.652 [2024-11-28 19:16:02.241805] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.652 [2024-11-28 19:16:02.250917] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.652 [2024-11-28 19:16:02.251190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.652 [2024-11-28 19:16:02.251290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.652 [2024-11-28 19:16:02.251317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.652 [2024-11-28 19:16:02.251334] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.652 [2024-11-28 19:16:02.251513] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.652 [2024-11-28 19:16:02.251728] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.652 [2024-11-28 19:16:02.251751] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.652 [2024-11-28 19:16:02.251765] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.652 [2024-11-28 19:16:02.253901] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.652 [2024-11-28 19:16:02.263590] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.652 [2024-11-28 19:16:02.263914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.652 [2024-11-28 19:16:02.264067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.652 [2024-11-28 19:16:02.264096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.652 [2024-11-28 19:16:02.264115] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.652 [2024-11-28 19:16:02.264280] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.652 [2024-11-28 19:16:02.264482] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.652 [2024-11-28 19:16:02.264508] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.652 [2024-11-28 19:16:02.264525] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.652 [2024-11-28 19:16:02.266917] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.652 [2024-11-28 19:16:02.276184] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.652 [2024-11-28 19:16:02.276552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.652 [2024-11-28 19:16:02.276702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.652 [2024-11-28 19:16:02.276732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.652 [2024-11-28 19:16:02.276750] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.652 [2024-11-28 19:16:02.276916] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.652 [2024-11-28 19:16:02.277032] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.652 [2024-11-28 19:16:02.277056] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.652 [2024-11-28 19:16:02.277073] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.652 [2024-11-28 19:16:02.279505] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.652 [2024-11-28 19:16:02.288555] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.652 [2024-11-28 19:16:02.288894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.652 [2024-11-28 19:16:02.289044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.652 [2024-11-28 19:16:02.289089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.652 [2024-11-28 19:16:02.289106] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.652 [2024-11-28 19:16:02.289290] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.652 [2024-11-28 19:16:02.289491] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.652 [2024-11-28 19:16:02.289516] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.652 [2024-11-28 19:16:02.289532] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.652 [2024-11-28 19:16:02.291875] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.652 [2024-11-28 19:16:02.301105] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.653 [2024-11-28 19:16:02.301355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.653 [2024-11-28 19:16:02.301504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.653 [2024-11-28 19:16:02.301533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.653 [2024-11-28 19:16:02.301552] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.653 [2024-11-28 19:16:02.301680] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.653 [2024-11-28 19:16:02.301853] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.653 [2024-11-28 19:16:02.301877] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.653 [2024-11-28 19:16:02.301894] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.653 [2024-11-28 19:16:02.304323] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.653 [2024-11-28 19:16:02.313860] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.653 [2024-11-28 19:16:02.314164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.653 [2024-11-28 19:16:02.314298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.653 [2024-11-28 19:16:02.314327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.653 [2024-11-28 19:16:02.314345] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.653 [2024-11-28 19:16:02.314541] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.653 [2024-11-28 19:16:02.314712] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.653 [2024-11-28 19:16:02.314737] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.653 [2024-11-28 19:16:02.314753] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.653 [2024-11-28 19:16:02.316941] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.653 [2024-11-28 19:16:02.326315] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.653 [2024-11-28 19:16:02.326611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.653 [2024-11-28 19:16:02.326749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.653 [2024-11-28 19:16:02.326778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.653 [2024-11-28 19:16:02.326796] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.653 [2024-11-28 19:16:02.326962] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.653 [2024-11-28 19:16:02.327096] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.653 [2024-11-28 19:16:02.327120] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.653 [2024-11-28 19:16:02.327136] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.653 [2024-11-28 19:16:02.329504] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.653 [2024-11-28 19:16:02.338871] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.653 [2024-11-28 19:16:02.339116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.653 [2024-11-28 19:16:02.339262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.653 [2024-11-28 19:16:02.339289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.653 [2024-11-28 19:16:02.339306] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.653 [2024-11-28 19:16:02.339534] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.653 [2024-11-28 19:16:02.339651] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.653 [2024-11-28 19:16:02.339688] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.653 [2024-11-28 19:16:02.339703] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.653 [2024-11-28 19:16:02.341871] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.653 [2024-11-28 19:16:02.351166] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.653 [2024-11-28 19:16:02.351435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.653 [2024-11-28 19:16:02.351587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.653 [2024-11-28 19:16:02.351614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.653 [2024-11-28 19:16:02.351630] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.653 [2024-11-28 19:16:02.351779] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.653 [2024-11-28 19:16:02.351966] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.653 [2024-11-28 19:16:02.351987] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.653 [2024-11-28 19:16:02.352000] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.653 [2024-11-28 19:16:02.354123] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.653 [2024-11-28 19:16:02.363728] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.653 [2024-11-28 19:16:02.364031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.653 [2024-11-28 19:16:02.364186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.653 [2024-11-28 19:16:02.364215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.653 [2024-11-28 19:16:02.364234] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.653 [2024-11-28 19:16:02.364381] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.653 [2024-11-28 19:16:02.364545] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.653 [2024-11-28 19:16:02.364570] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.653 [2024-11-28 19:16:02.364586] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.653 [2024-11-28 19:16:02.366723] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.653 [2024-11-28 19:16:02.376199] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.653 [2024-11-28 19:16:02.376605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.653 [2024-11-28 19:16:02.376790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.653 [2024-11-28 19:16:02.376835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.653 [2024-11-28 19:16:02.376854] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.653 [2024-11-28 19:16:02.377092] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.653 [2024-11-28 19:16:02.377226] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.653 [2024-11-28 19:16:02.377249] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.653 [2024-11-28 19:16:02.377266] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.653 [2024-11-28 19:16:02.379362] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.653 [2024-11-28 19:16:02.388889] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.653 [2024-11-28 19:16:02.389169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.653 [2024-11-28 19:16:02.389326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.653 [2024-11-28 19:16:02.389355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.653 [2024-11-28 19:16:02.389374] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.653 [2024-11-28 19:16:02.389585] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.653 [2024-11-28 19:16:02.389776] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.653 [2024-11-28 19:16:02.389800] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.653 [2024-11-28 19:16:02.389817] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.653 [2024-11-28 19:16:02.392031] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.653 [2024-11-28 19:16:02.401416] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.653 [2024-11-28 19:16:02.401696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.653 [2024-11-28 19:16:02.401860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.653 [2024-11-28 19:16:02.401889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.653 [2024-11-28 19:16:02.401908] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.653 [2024-11-28 19:16:02.402074] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.653 [2024-11-28 19:16:02.402262] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.653 [2024-11-28 19:16:02.402286] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.653 [2024-11-28 19:16:02.402302] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.653 [2024-11-28 19:16:02.404776] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.653 [2024-11-28 19:16:02.413923] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.653 [2024-11-28 19:16:02.414244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.653 [2024-11-28 19:16:02.414344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.653 [2024-11-28 19:16:02.414373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.653 [2024-11-28 19:16:02.414391] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.654 [2024-11-28 19:16:02.414571] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.654 [2024-11-28 19:16:02.414741] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.654 [2024-11-28 19:16:02.414765] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.654 [2024-11-28 19:16:02.414781] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.654 [2024-11-28 19:16:02.417119] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.654 [2024-11-28 19:16:02.426442] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.654 [2024-11-28 19:16:02.426733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.654 [2024-11-28 19:16:02.426874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.654 [2024-11-28 19:16:02.426900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.654 [2024-11-28 19:16:02.426917] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.654 [2024-11-28 19:16:02.427092] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.654 [2024-11-28 19:16:02.427257] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.654 [2024-11-28 19:16:02.427282] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.654 [2024-11-28 19:16:02.427299] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.654 [2024-11-28 19:16:02.429698] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.654 [2024-11-28 19:16:02.439075] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.654 [2024-11-28 19:16:02.439379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.654 [2024-11-28 19:16:02.439545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.654 [2024-11-28 19:16:02.439573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.654 [2024-11-28 19:16:02.439595] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.654 [2024-11-28 19:16:02.439810] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.654 [2024-11-28 19:16:02.440035] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.654 [2024-11-28 19:16:02.440059] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.654 [2024-11-28 19:16:02.440076] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.654 [2024-11-28 19:16:02.442378] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.654 [2024-11-28 19:16:02.451443] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.654 [2024-11-28 19:16:02.451751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.654 [2024-11-28 19:16:02.451920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.654 [2024-11-28 19:16:02.451947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.654 [2024-11-28 19:16:02.451978] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.654 [2024-11-28 19:16:02.452136] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.654 [2024-11-28 19:16:02.452306] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.654 [2024-11-28 19:16:02.452330] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.654 [2024-11-28 19:16:02.452347] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.654 [2024-11-28 19:16:02.454567] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.654 [2024-11-28 19:16:02.464005] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.654 [2024-11-28 19:16:02.464333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.654 [2024-11-28 19:16:02.464487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.654 [2024-11-28 19:16:02.464517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.654 [2024-11-28 19:16:02.464535] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.654 [2024-11-28 19:16:02.464719] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.654 [2024-11-28 19:16:02.464907] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.654 [2024-11-28 19:16:02.464932] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.654 [2024-11-28 19:16:02.464948] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.654 [2024-11-28 19:16:02.467212] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.654 [2024-11-28 19:16:02.476501] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.654 [2024-11-28 19:16:02.476827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.654 [2024-11-28 19:16:02.476951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.654 [2024-11-28 19:16:02.476980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.654 [2024-11-28 19:16:02.476999] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.654 [2024-11-28 19:16:02.477170] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.654 [2024-11-28 19:16:02.477323] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.654 [2024-11-28 19:16:02.477347] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.654 [2024-11-28 19:16:02.477363] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.654 [2024-11-28 19:16:02.479494] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.654 [2024-11-28 19:16:02.489039] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.654 [2024-11-28 19:16:02.489403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.654 [2024-11-28 19:16:02.489503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.654 [2024-11-28 19:16:02.489529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.654 [2024-11-28 19:16:02.489546] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.654 [2024-11-28 19:16:02.489723] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.654 [2024-11-28 19:16:02.489893] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.654 [2024-11-28 19:16:02.489918] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.654 [2024-11-28 19:16:02.489934] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.654 [2024-11-28 19:16:02.492379] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.654 [2024-11-28 19:16:02.501590] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.654 [2024-11-28 19:16:02.501885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.654 [2024-11-28 19:16:02.502069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.654 [2024-11-28 19:16:02.502096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.654 [2024-11-28 19:16:02.502127] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.654 [2024-11-28 19:16:02.502303] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.654 [2024-11-28 19:16:02.502447] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.654 [2024-11-28 19:16:02.502472] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.654 [2024-11-28 19:16:02.502489] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.654 [2024-11-28 19:16:02.504661] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.654 [2024-11-28 19:16:02.514176] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.654 [2024-11-28 19:16:02.514547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.654 [2024-11-28 19:16:02.514716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.654 [2024-11-28 19:16:02.514743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.654 [2024-11-28 19:16:02.514761] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.654 [2024-11-28 19:16:02.514951] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.654 [2024-11-28 19:16:02.515158] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.654 [2024-11-28 19:16:02.515182] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.654 [2024-11-28 19:16:02.515198] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.654 [2024-11-28 19:16:02.517605] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.654 [2024-11-28 19:16:02.526822] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.654 [2024-11-28 19:16:02.527099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.654 [2024-11-28 19:16:02.527255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.654 [2024-11-28 19:16:02.527284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.654 [2024-11-28 19:16:02.527302] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.655 [2024-11-28 19:16:02.527481] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.655 [2024-11-28 19:16:02.527688] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.655 [2024-11-28 19:16:02.527712] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.655 [2024-11-28 19:16:02.527728] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.655 [2024-11-28 19:16:02.530120] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.655 [2024-11-28 19:16:02.539324] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.655 [2024-11-28 19:16:02.539623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.655 [2024-11-28 19:16:02.539748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.655 [2024-11-28 19:16:02.539777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.655 [2024-11-28 19:16:02.539796] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.655 [2024-11-28 19:16:02.539997] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.655 [2024-11-28 19:16:02.540150] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.655 [2024-11-28 19:16:02.540174] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.655 [2024-11-28 19:16:02.540190] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.655 [2024-11-28 19:16:02.542590] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.655 [2024-11-28 19:16:02.551970] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.655 [2024-11-28 19:16:02.552299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.655 [2024-11-28 19:16:02.552429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.655 [2024-11-28 19:16:02.552460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.655 [2024-11-28 19:16:02.552478] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.655 [2024-11-28 19:16:02.552643] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.655 [2024-11-28 19:16:02.552802] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.655 [2024-11-28 19:16:02.552826] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.655 [2024-11-28 19:16:02.552842] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.655 [2024-11-28 19:16:02.555175] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.655 [2024-11-28 19:16:02.564695] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.655 [2024-11-28 19:16:02.565040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.655 [2024-11-28 19:16:02.565159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.655 [2024-11-28 19:16:02.565186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.655 [2024-11-28 19:16:02.565203] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.655 [2024-11-28 19:16:02.565342] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.655 [2024-11-28 19:16:02.565559] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.655 [2024-11-28 19:16:02.565584] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.655 [2024-11-28 19:16:02.565600] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.655 [2024-11-28 19:16:02.567918] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.655 [2024-11-28 19:16:02.577188] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.655 [2024-11-28 19:16:02.577512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.655 [2024-11-28 19:16:02.577601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.655 [2024-11-28 19:16:02.577630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.655 [2024-11-28 19:16:02.577649] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.655 [2024-11-28 19:16:02.577797] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.655 [2024-11-28 19:16:02.577966] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.655 [2024-11-28 19:16:02.577990] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.655 [2024-11-28 19:16:02.578006] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.655 [2024-11-28 19:16:02.580110] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.655 [2024-11-28 19:16:02.589850] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.655 [2024-11-28 19:16:02.590092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.655 [2024-11-28 19:16:02.590241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.655 [2024-11-28 19:16:02.590270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.655 [2024-11-28 19:16:02.590289] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.655 [2024-11-28 19:16:02.590465] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.655 [2024-11-28 19:16:02.590582] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.655 [2024-11-28 19:16:02.590606] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.655 [2024-11-28 19:16:02.590628] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.655 [2024-11-28 19:16:02.593073] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.655 [2024-11-28 19:16:02.602399] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.655 [2024-11-28 19:16:02.602695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.655 [2024-11-28 19:16:02.602832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.655 [2024-11-28 19:16:02.602879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.655 [2024-11-28 19:16:02.602898] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.655 [2024-11-28 19:16:02.603064] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.655 [2024-11-28 19:16:02.603252] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.655 [2024-11-28 19:16:02.603276] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.655 [2024-11-28 19:16:02.603292] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.655 [2024-11-28 19:16:02.605800] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.655 [2024-11-28 19:16:02.614931] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.655 [2024-11-28 19:16:02.615188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.655 [2024-11-28 19:16:02.615341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.655 [2024-11-28 19:16:02.615371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.655 [2024-11-28 19:16:02.615390] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.655 [2024-11-28 19:16:02.615551] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.655 [2024-11-28 19:16:02.615721] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.655 [2024-11-28 19:16:02.615745] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.655 [2024-11-28 19:16:02.615761] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.655 [2024-11-28 19:16:02.618121] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.655 [2024-11-28 19:16:02.627527] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.655 [2024-11-28 19:16:02.627856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.655 [2024-11-28 19:16:02.627972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.655 [2024-11-28 19:16:02.628005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.655 [2024-11-28 19:16:02.628040] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.655 [2024-11-28 19:16:02.628242] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.655 [2024-11-28 19:16:02.628441] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.655 [2024-11-28 19:16:02.628466] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.655 [2024-11-28 19:16:02.628487] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.655 [2024-11-28 19:16:02.630769] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.655 [2024-11-28 19:16:02.640372] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.655 [2024-11-28 19:16:02.640636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.656 [2024-11-28 19:16:02.640790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.656 [2024-11-28 19:16:02.640819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.656 [2024-11-28 19:16:02.640837] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.656 [2024-11-28 19:16:02.641002] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.656 [2024-11-28 19:16:02.641190] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.656 [2024-11-28 19:16:02.641215] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.656 [2024-11-28 19:16:02.641231] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.656 [2024-11-28 19:16:02.643660] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.656 [2024-11-28 19:16:02.653117] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.656 [2024-11-28 19:16:02.653446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.656 [2024-11-28 19:16:02.653581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.656 [2024-11-28 19:16:02.653610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.656 [2024-11-28 19:16:02.653629] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.656 [2024-11-28 19:16:02.653777] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.656 [2024-11-28 19:16:02.653965] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.656 [2024-11-28 19:16:02.653989] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.656 [2024-11-28 19:16:02.654005] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.656 [2024-11-28 19:16:02.656269] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.656 [2024-11-28 19:16:02.665836] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.656 [2024-11-28 19:16:02.666174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.656 [2024-11-28 19:16:02.666258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.656 [2024-11-28 19:16:02.666287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.656 [2024-11-28 19:16:02.666306] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.656 [2024-11-28 19:16:02.666465] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.656 [2024-11-28 19:16:02.666653] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.656 [2024-11-28 19:16:02.666677] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.656 [2024-11-28 19:16:02.666693] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.656 [2024-11-28 19:16:02.669100] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.656 [2024-11-28 19:16:02.678359] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.656 [2024-11-28 19:16:02.678629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.656 [2024-11-28 19:16:02.678752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.656 [2024-11-28 19:16:02.678791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.656 [2024-11-28 19:16:02.678807] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.656 [2024-11-28 19:16:02.678952] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.656 [2024-11-28 19:16:02.679109] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.656 [2024-11-28 19:16:02.679129] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.656 [2024-11-28 19:16:02.679158] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.656 [2024-11-28 19:16:02.681191] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.915 [2024-11-28 19:16:02.691211] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.915 [2024-11-28 19:16:02.691553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.915 [2024-11-28 19:16:02.691675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.915 [2024-11-28 19:16:02.691712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.915 [2024-11-28 19:16:02.691729] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.915 [2024-11-28 19:16:02.691889] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.915 [2024-11-28 19:16:02.692121] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.915 [2024-11-28 19:16:02.692146] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.915 [2024-11-28 19:16:02.692162] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.915 [2024-11-28 19:16:02.694526] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.915 [2024-11-28 19:16:02.703844] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.915 [2024-11-28 19:16:02.704121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.915 [2024-11-28 19:16:02.704222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.915 [2024-11-28 19:16:02.704251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.915 [2024-11-28 19:16:02.704269] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.915 [2024-11-28 19:16:02.704458] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.915 [2024-11-28 19:16:02.704633] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.915 [2024-11-28 19:16:02.704654] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.915 [2024-11-28 19:16:02.704669] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.915 [2024-11-28 19:16:02.707021] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.915 [2024-11-28 19:16:02.716560] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.915 [2024-11-28 19:16:02.716921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.915 [2024-11-28 19:16:02.717068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.915 [2024-11-28 19:16:02.717092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.915 [2024-11-28 19:16:02.717108] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.915 [2024-11-28 19:16:02.717295] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.915 [2024-11-28 19:16:02.717467] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.915 [2024-11-28 19:16:02.717492] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.915 [2024-11-28 19:16:02.717509] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.915 [2024-11-28 19:16:02.719772] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.916 [2024-11-28 19:16:02.729126] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.916 [2024-11-28 19:16:02.729420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.916 [2024-11-28 19:16:02.729602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.916 [2024-11-28 19:16:02.729659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.916 [2024-11-28 19:16:02.729678] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.916 [2024-11-28 19:16:02.729862] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.916 [2024-11-28 19:16:02.730032] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.916 [2024-11-28 19:16:02.730056] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.916 [2024-11-28 19:16:02.730072] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.916 [2024-11-28 19:16:02.732358] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.916 [2024-11-28 19:16:02.741705] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.916 [2024-11-28 19:16:02.742039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.916 [2024-11-28 19:16:02.742159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.916 [2024-11-28 19:16:02.742188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.916 [2024-11-28 19:16:02.742207] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.916 [2024-11-28 19:16:02.742372] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.916 [2024-11-28 19:16:02.742553] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.916 [2024-11-28 19:16:02.742579] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.916 [2024-11-28 19:16:02.742595] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.916 [2024-11-28 19:16:02.744997] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.916 [2024-11-28 19:16:02.754362] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.916 [2024-11-28 19:16:02.754684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.916 [2024-11-28 19:16:02.754923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.916 [2024-11-28 19:16:02.754985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.916 [2024-11-28 19:16:02.755003] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.916 [2024-11-28 19:16:02.755187] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.916 [2024-11-28 19:16:02.755375] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.916 [2024-11-28 19:16:02.755408] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.916 [2024-11-28 19:16:02.755426] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.916 [2024-11-28 19:16:02.757687] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.916 [2024-11-28 19:16:02.766923] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.916 [2024-11-28 19:16:02.767200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.916 [2024-11-28 19:16:02.767351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.916 [2024-11-28 19:16:02.767377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.916 [2024-11-28 19:16:02.767404] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.916 [2024-11-28 19:16:02.767539] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.916 [2024-11-28 19:16:02.767700] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.916 [2024-11-28 19:16:02.767725] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.916 [2024-11-28 19:16:02.767741] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.916 [2024-11-28 19:16:02.770006] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.916 [2024-11-28 19:16:02.779594] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.916 [2024-11-28 19:16:02.779845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.916 [2024-11-28 19:16:02.779967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.916 [2024-11-28 19:16:02.779996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.916 [2024-11-28 19:16:02.780015] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.916 [2024-11-28 19:16:02.780162] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.916 [2024-11-28 19:16:02.780314] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.916 [2024-11-28 19:16:02.780339] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.916 [2024-11-28 19:16:02.780355] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.916 [2024-11-28 19:16:02.782718] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.916 [2024-11-28 19:16:02.792178] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.916 [2024-11-28 19:16:02.792639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.916 [2024-11-28 19:16:02.792732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.916 [2024-11-28 19:16:02.792757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.916 [2024-11-28 19:16:02.792778] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.916 [2024-11-28 19:16:02.792957] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.916 [2024-11-28 19:16:02.793182] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.916 [2024-11-28 19:16:02.793206] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.916 [2024-11-28 19:16:02.793222] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.916 [2024-11-28 19:16:02.795623] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.916 [2024-11-28 19:16:02.804779] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.916 [2024-11-28 19:16:02.805067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.916 [2024-11-28 19:16:02.805221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.916 [2024-11-28 19:16:02.805250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.916 [2024-11-28 19:16:02.805269] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.916 [2024-11-28 19:16:02.805428] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.916 [2024-11-28 19:16:02.805617] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.916 [2024-11-28 19:16:02.805641] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.916 [2024-11-28 19:16:02.805657] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.916 [2024-11-28 19:16:02.807938] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.916 [2024-11-28 19:16:02.817205] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.916 [2024-11-28 19:16:02.817504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.916 [2024-11-28 19:16:02.817699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.916 [2024-11-28 19:16:02.817761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.916 [2024-11-28 19:16:02.817779] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.916 [2024-11-28 19:16:02.817945] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.916 [2024-11-28 19:16:02.818115] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.916 [2024-11-28 19:16:02.818139] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.916 [2024-11-28 19:16:02.818155] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.916 [2024-11-28 19:16:02.820411] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.916 [2024-11-28 19:16:02.830056] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.916 [2024-11-28 19:16:02.830348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.916 [2024-11-28 19:16:02.830481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.916 [2024-11-28 19:16:02.830511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.916 [2024-11-28 19:16:02.830535] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.916 [2024-11-28 19:16:02.830684] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.916 [2024-11-28 19:16:02.830837] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.916 [2024-11-28 19:16:02.830861] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.916 [2024-11-28 19:16:02.830877] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.916 [2024-11-28 19:16:02.833202] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.916 [2024-11-28 19:16:02.842586] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.916 [2024-11-28 19:16:02.842956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.916 [2024-11-28 19:16:02.843076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.916 [2024-11-28 19:16:02.843102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.917 [2024-11-28 19:16:02.843117] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.917 [2024-11-28 19:16:02.843281] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.917 [2024-11-28 19:16:02.843442] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.917 [2024-11-28 19:16:02.843467] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.917 [2024-11-28 19:16:02.843483] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.917 [2024-11-28 19:16:02.845944] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.917 [2024-11-28 19:16:02.855197] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.917 [2024-11-28 19:16:02.855534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.917 [2024-11-28 19:16:02.855665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.917 [2024-11-28 19:16:02.855694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.917 [2024-11-28 19:16:02.855712] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.917 [2024-11-28 19:16:02.855825] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.917 [2024-11-28 19:16:02.856030] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.917 [2024-11-28 19:16:02.856055] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.917 [2024-11-28 19:16:02.856071] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.917 [2024-11-28 19:16:02.858452] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.917 [2024-11-28 19:16:02.867702] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.917 [2024-11-28 19:16:02.867981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.917 [2024-11-28 19:16:02.868136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.917 [2024-11-28 19:16:02.868165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.917 [2024-11-28 19:16:02.868183] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.917 [2024-11-28 19:16:02.868391] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.917 [2024-11-28 19:16:02.868607] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.917 [2024-11-28 19:16:02.868631] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.917 [2024-11-28 19:16:02.868647] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.917 [2024-11-28 19:16:02.871019] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.917 [2024-11-28 19:16:02.880268] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.917 [2024-11-28 19:16:02.880615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.917 [2024-11-28 19:16:02.880771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.917 [2024-11-28 19:16:02.880801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.917 [2024-11-28 19:16:02.880820] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.917 [2024-11-28 19:16:02.880968] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.917 [2024-11-28 19:16:02.881138] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.917 [2024-11-28 19:16:02.881162] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.917 [2024-11-28 19:16:02.881178] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.917 [2024-11-28 19:16:02.883542] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.917 [2024-11-28 19:16:02.892550] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.917 [2024-11-28 19:16:02.892837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.917 [2024-11-28 19:16:02.892990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.917 [2024-11-28 19:16:02.893019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.917 [2024-11-28 19:16:02.893038] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.917 [2024-11-28 19:16:02.893204] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.917 [2024-11-28 19:16:02.893355] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.917 [2024-11-28 19:16:02.893379] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.917 [2024-11-28 19:16:02.893405] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.917 [2024-11-28 19:16:02.895698] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.917 [2024-11-28 19:16:02.904963] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.917 [2024-11-28 19:16:02.905252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.917 [2024-11-28 19:16:02.905376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.917 [2024-11-28 19:16:02.905416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.917 [2024-11-28 19:16:02.905436] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.917 [2024-11-28 19:16:02.905601] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.917 [2024-11-28 19:16:02.905741] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.917 [2024-11-28 19:16:02.905765] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.917 [2024-11-28 19:16:02.905782] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.917 [2024-11-28 19:16:02.908083] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.917 [2024-11-28 19:16:02.917742] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.917 [2024-11-28 19:16:02.918065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.917 [2024-11-28 19:16:02.918195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.917 [2024-11-28 19:16:02.918224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.917 [2024-11-28 19:16:02.918243] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.917 [2024-11-28 19:16:02.918456] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.917 [2024-11-28 19:16:02.918644] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.917 [2024-11-28 19:16:02.918669] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.917 [2024-11-28 19:16:02.918685] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.917 [2024-11-28 19:16:02.921180] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.917 [2024-11-28 19:16:02.930297] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.917 [2024-11-28 19:16:02.930632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.917 [2024-11-28 19:16:02.930752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.917 [2024-11-28 19:16:02.930781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.917 [2024-11-28 19:16:02.930799] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.917 [2024-11-28 19:16:02.930965] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.917 [2024-11-28 19:16:02.931153] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.917 [2024-11-28 19:16:02.931177] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.917 [2024-11-28 19:16:02.931193] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.917 [2024-11-28 19:16:02.933686] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.917 [2024-11-28 19:16:02.942714] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.917 [2024-11-28 19:16:02.943042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.917 [2024-11-28 19:16:02.943167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.917 [2024-11-28 19:16:02.943196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.917 [2024-11-28 19:16:02.943214] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.917 [2024-11-28 19:16:02.943426] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.917 [2024-11-28 19:16:02.943614] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.917 [2024-11-28 19:16:02.943648] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.917 [2024-11-28 19:16:02.943664] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.917 [2024-11-28 19:16:02.945839] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:41.917 [2024-11-28 19:16:02.955251] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:41.917 [2024-11-28 19:16:02.955592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.917 [2024-11-28 19:16:02.955776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:41.917 [2024-11-28 19:16:02.955802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:41.917 [2024-11-28 19:16:02.955818] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:41.917 [2024-11-28 19:16:02.956053] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:41.917 [2024-11-28 19:16:02.956187] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:41.917 [2024-11-28 19:16:02.956211] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:41.917 [2024-11-28 19:16:02.956227] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:41.918 [2024-11-28 19:16:02.958477] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.178 [2024-11-28 19:16:02.967941] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.178 [2024-11-28 19:16:02.968218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.178 [2024-11-28 19:16:02.968343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.178 [2024-11-28 19:16:02.968372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.178 [2024-11-28 19:16:02.968390] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.178 [2024-11-28 19:16:02.968552] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.178 [2024-11-28 19:16:02.968722] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.178 [2024-11-28 19:16:02.968746] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.178 [2024-11-28 19:16:02.968763] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.178 [2024-11-28 19:16:02.971188] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.178 [2024-11-28 19:16:02.980356] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.178 [2024-11-28 19:16:02.980680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.178 [2024-11-28 19:16:02.980809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.178 [2024-11-28 19:16:02.980839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.178 [2024-11-28 19:16:02.980858] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.179 [2024-11-28 19:16:02.981059] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.179 [2024-11-28 19:16:02.981193] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.179 [2024-11-28 19:16:02.981217] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.179 [2024-11-28 19:16:02.981240] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.179 [2024-11-28 19:16:02.983588] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.179 [2024-11-28 19:16:02.992922] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.179 [2024-11-28 19:16:02.993245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.179 [2024-11-28 19:16:02.993408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.179 [2024-11-28 19:16:02.993438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.179 [2024-11-28 19:16:02.993456] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.179 [2024-11-28 19:16:02.993639] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.179 [2024-11-28 19:16:02.993825] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.179 [2024-11-28 19:16:02.993846] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.179 [2024-11-28 19:16:02.993861] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.179 [2024-11-28 19:16:02.996054] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.179 [2024-11-28 19:16:03.005450] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.179 [2024-11-28 19:16:03.005774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.179 [2024-11-28 19:16:03.005902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.179 [2024-11-28 19:16:03.005929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.179 [2024-11-28 19:16:03.005945] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.179 [2024-11-28 19:16:03.006088] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.179 [2024-11-28 19:16:03.006240] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.179 [2024-11-28 19:16:03.006264] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.179 [2024-11-28 19:16:03.006280] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.179 [2024-11-28 19:16:03.008678] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.179 [2024-11-28 19:16:03.017879] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.179 [2024-11-28 19:16:03.018191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.179 [2024-11-28 19:16:03.018342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.179 [2024-11-28 19:16:03.018371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.179 [2024-11-28 19:16:03.018389] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.179 [2024-11-28 19:16:03.018621] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.179 [2024-11-28 19:16:03.018827] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.179 [2024-11-28 19:16:03.018852] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.179 [2024-11-28 19:16:03.018869] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.179 [2024-11-28 19:16:03.021131] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.179 [2024-11-28 19:16:03.030445] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.179 [2024-11-28 19:16:03.030801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.179 [2024-11-28 19:16:03.030940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.179 [2024-11-28 19:16:03.030965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.179 [2024-11-28 19:16:03.030981] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.179 [2024-11-28 19:16:03.031158] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.179 [2024-11-28 19:16:03.031323] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.179 [2024-11-28 19:16:03.031348] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.179 [2024-11-28 19:16:03.031365] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.179 [2024-11-28 19:16:03.033752] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.179 [2024-11-28 19:16:03.042970] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.179 [2024-11-28 19:16:03.043321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.179 [2024-11-28 19:16:03.043450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.179 [2024-11-28 19:16:03.043481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.179 [2024-11-28 19:16:03.043499] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.179 [2024-11-28 19:16:03.043664] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.179 [2024-11-28 19:16:03.043835] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.179 [2024-11-28 19:16:03.043859] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.179 [2024-11-28 19:16:03.043876] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.179 [2024-11-28 19:16:03.046140] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.179 [2024-11-28 19:16:03.055600] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.179 [2024-11-28 19:16:03.055908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.179 [2024-11-28 19:16:03.056137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.179 [2024-11-28 19:16:03.056185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.179 [2024-11-28 19:16:03.056204] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.179 [2024-11-28 19:16:03.056352] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.179 [2024-11-28 19:16:03.056500] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.179 [2024-11-28 19:16:03.056525] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.179 [2024-11-28 19:16:03.056541] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.179 [2024-11-28 19:16:03.058930] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.179 [2024-11-28 19:16:03.068273] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.179 [2024-11-28 19:16:03.068584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.179 [2024-11-28 19:16:03.068680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.179 [2024-11-28 19:16:03.068730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.179 [2024-11-28 19:16:03.068748] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.179 [2024-11-28 19:16:03.068950] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.179 [2024-11-28 19:16:03.069085] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.179 [2024-11-28 19:16:03.069109] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.179 [2024-11-28 19:16:03.069126] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.179 [2024-11-28 19:16:03.071294] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.179 [2024-11-28 19:16:03.080770] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.179 [2024-11-28 19:16:03.081062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.179 [2024-11-28 19:16:03.081189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.179 [2024-11-28 19:16:03.081219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.179 [2024-11-28 19:16:03.081238] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.179 [2024-11-28 19:16:03.081452] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.179 [2024-11-28 19:16:03.081607] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.179 [2024-11-28 19:16:03.081629] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.179 [2024-11-28 19:16:03.081644] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.179 [2024-11-28 19:16:03.084051] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.179 [2024-11-28 19:16:03.093306] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.179 [2024-11-28 19:16:03.093625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.179 [2024-11-28 19:16:03.093738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.179 [2024-11-28 19:16:03.093764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.179 [2024-11-28 19:16:03.093781] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.179 [2024-11-28 19:16:03.093930] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.179 [2024-11-28 19:16:03.094124] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.179 [2024-11-28 19:16:03.094149] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.179 [2024-11-28 19:16:03.094165] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.180 [2024-11-28 19:16:03.096463] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.180 [2024-11-28 19:16:03.105691] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.180 [2024-11-28 19:16:03.106015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.180 [2024-11-28 19:16:03.106150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.180 [2024-11-28 19:16:03.106180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.180 [2024-11-28 19:16:03.106198] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.180 [2024-11-28 19:16:03.106365] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.180 [2024-11-28 19:16:03.106580] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.180 [2024-11-28 19:16:03.106605] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.180 [2024-11-28 19:16:03.106622] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.180 [2024-11-28 19:16:03.109021] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.180 [2024-11-28 19:16:03.118470] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.180 [2024-11-28 19:16:03.118781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.180 [2024-11-28 19:16:03.118945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.180 [2024-11-28 19:16:03.118972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.180 [2024-11-28 19:16:03.118989] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.180 [2024-11-28 19:16:03.119187] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.180 [2024-11-28 19:16:03.119376] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.180 [2024-11-28 19:16:03.119412] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.180 [2024-11-28 19:16:03.119430] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.180 [2024-11-28 19:16:03.121773] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.180 [2024-11-28 19:16:03.131187] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.180 [2024-11-28 19:16:03.131462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.180 [2024-11-28 19:16:03.131564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.180 [2024-11-28 19:16:03.131595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.180 [2024-11-28 19:16:03.131613] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.180 [2024-11-28 19:16:03.131743] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.180 [2024-11-28 19:16:03.131931] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.180 [2024-11-28 19:16:03.131956] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.180 [2024-11-28 19:16:03.131972] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.180 [2024-11-28 19:16:03.134045] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.180 [2024-11-28 19:16:03.143588] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.180 [2024-11-28 19:16:03.143937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.180 [2024-11-28 19:16:03.144068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.180 [2024-11-28 19:16:03.144103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.180 [2024-11-28 19:16:03.144122] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.180 [2024-11-28 19:16:03.144306] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.180 [2024-11-28 19:16:03.144517] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.180 [2024-11-28 19:16:03.144540] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.180 [2024-11-28 19:16:03.144555] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.180 [2024-11-28 19:16:03.146894] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.180 [2024-11-28 19:16:03.156240] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.180 [2024-11-28 19:16:03.156572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.180 [2024-11-28 19:16:03.156671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.180 [2024-11-28 19:16:03.156714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.180 [2024-11-28 19:16:03.156733] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.180 [2024-11-28 19:16:03.156881] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.180 [2024-11-28 19:16:03.157051] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.180 [2024-11-28 19:16:03.157076] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.180 [2024-11-28 19:16:03.157092] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.180 [2024-11-28 19:16:03.159532] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.180 [2024-11-28 19:16:03.169019] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.180 [2024-11-28 19:16:03.169304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.180 [2024-11-28 19:16:03.169414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.180 [2024-11-28 19:16:03.169468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.180 [2024-11-28 19:16:03.169485] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.180 [2024-11-28 19:16:03.169651] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.180 [2024-11-28 19:16:03.169855] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.180 [2024-11-28 19:16:03.169881] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.180 [2024-11-28 19:16:03.169897] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.180 [2024-11-28 19:16:03.172197] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.180 [2024-11-28 19:16:03.181617] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.180 [2024-11-28 19:16:03.181913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.180 [2024-11-28 19:16:03.182055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.180 [2024-11-28 19:16:03.182086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.180 [2024-11-28 19:16:03.182110] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.180 [2024-11-28 19:16:03.182277] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.180 [2024-11-28 19:16:03.182456] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.180 [2024-11-28 19:16:03.182481] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.180 [2024-11-28 19:16:03.182496] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.180 [2024-11-28 19:16:03.185020] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.180 [2024-11-28 19:16:03.194086] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.180 [2024-11-28 19:16:03.194437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.180 [2024-11-28 19:16:03.194556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.180 [2024-11-28 19:16:03.194582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.180 [2024-11-28 19:16:03.194598] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.180 [2024-11-28 19:16:03.194790] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.180 [2024-11-28 19:16:03.194942] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.180 [2024-11-28 19:16:03.194966] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.180 [2024-11-28 19:16:03.194982] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.180 [2024-11-28 19:16:03.197215] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.180 [2024-11-28 19:16:03.206763] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.180 [2024-11-28 19:16:03.207069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.180 [2024-11-28 19:16:03.207200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.180 [2024-11-28 19:16:03.207230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.180 [2024-11-28 19:16:03.207248] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.180 [2024-11-28 19:16:03.207408] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.180 [2024-11-28 19:16:03.207564] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.180 [2024-11-28 19:16:03.207587] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.180 [2024-11-28 19:16:03.207601] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.180 [2024-11-28 19:16:03.210026] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.180 [2024-11-28 19:16:03.219167] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.180 [2024-11-28 19:16:03.219466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.180 [2024-11-28 19:16:03.219568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.180 [2024-11-28 19:16:03.219594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.181 [2024-11-28 19:16:03.219610] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.181 [2024-11-28 19:16:03.219764] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.181 [2024-11-28 19:16:03.219930] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.181 [2024-11-28 19:16:03.219955] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.181 [2024-11-28 19:16:03.219973] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.181 [2024-11-28 19:16:03.222390] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.442 [2024-11-28 19:16:03.231735] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.442 [2024-11-28 19:16:03.232038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.442 [2024-11-28 19:16:03.232139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.442 [2024-11-28 19:16:03.232165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.442 [2024-11-28 19:16:03.232180] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.442 [2024-11-28 19:16:03.232324] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.442 [2024-11-28 19:16:03.232485] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.442 [2024-11-28 19:16:03.232512] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.442 [2024-11-28 19:16:03.232530] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.442 [2024-11-28 19:16:03.234744] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.442 [2024-11-28 19:16:03.244371] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.442 [2024-11-28 19:16:03.244608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.442 [2024-11-28 19:16:03.244736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.442 [2024-11-28 19:16:03.244764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.442 [2024-11-28 19:16:03.244784] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.442 [2024-11-28 19:16:03.244951] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.442 [2024-11-28 19:16:03.245138] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.442 [2024-11-28 19:16:03.245163] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.442 [2024-11-28 19:16:03.245180] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.442 [2024-11-28 19:16:03.247593] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.442 [2024-11-28 19:16:03.256928] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.442 [2024-11-28 19:16:03.257302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.442 [2024-11-28 19:16:03.257429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.442 [2024-11-28 19:16:03.257458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.442 [2024-11-28 19:16:03.257476] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.442 [2024-11-28 19:16:03.257660] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.442 [2024-11-28 19:16:03.257889] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.442 [2024-11-28 19:16:03.257915] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.442 [2024-11-28 19:16:03.257933] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.442 [2024-11-28 19:16:03.260326] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.442 [2024-11-28 19:16:03.269648] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.442 [2024-11-28 19:16:03.269959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.442 [2024-11-28 19:16:03.270058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.442 [2024-11-28 19:16:03.270083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.442 [2024-11-28 19:16:03.270100] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.443 [2024-11-28 19:16:03.270257] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.443 [2024-11-28 19:16:03.270441] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.443 [2024-11-28 19:16:03.270468] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.443 [2024-11-28 19:16:03.270485] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.443 [2024-11-28 19:16:03.272772] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.443 [2024-11-28 19:16:03.282436] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.443 [2024-11-28 19:16:03.282741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.443 [2024-11-28 19:16:03.282877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.443 [2024-11-28 19:16:03.282907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.443 [2024-11-28 19:16:03.282925] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.443 [2024-11-28 19:16:03.283109] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.443 [2024-11-28 19:16:03.283298] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.443 [2024-11-28 19:16:03.283324] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.443 [2024-11-28 19:16:03.283341] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.443 [2024-11-28 19:16:03.285782] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.443 [2024-11-28 19:16:03.295042] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.443 [2024-11-28 19:16:03.295387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.443 [2024-11-28 19:16:03.295476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.443 [2024-11-28 19:16:03.295501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.443 [2024-11-28 19:16:03.295517] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.443 [2024-11-28 19:16:03.295705] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.443 [2024-11-28 19:16:03.295893] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.443 [2024-11-28 19:16:03.295924] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.443 [2024-11-28 19:16:03.295942] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.443 [2024-11-28 19:16:03.298211] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.443 [2024-11-28 19:16:03.307580] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.443 [2024-11-28 19:16:03.307916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.443 [2024-11-28 19:16:03.308045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.443 [2024-11-28 19:16:03.308073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.443 [2024-11-28 19:16:03.308091] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.443 [2024-11-28 19:16:03.308238] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.443 [2024-11-28 19:16:03.308421] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.443 [2024-11-28 19:16:03.308445] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.443 [2024-11-28 19:16:03.308461] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.443 [2024-11-28 19:16:03.310763] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.443 [2024-11-28 19:16:03.320308] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.443 [2024-11-28 19:16:03.320624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.443 [2024-11-28 19:16:03.320724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.443 [2024-11-28 19:16:03.320755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.443 [2024-11-28 19:16:03.320773] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.443 [2024-11-28 19:16:03.320975] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.443 [2024-11-28 19:16:03.321183] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.443 [2024-11-28 19:16:03.321208] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.443 [2024-11-28 19:16:03.321225] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.443 [2024-11-28 19:16:03.323488] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.443 [2024-11-28 19:16:03.333009] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.443 [2024-11-28 19:16:03.333289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.443 [2024-11-28 19:16:03.333445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.443 [2024-11-28 19:16:03.333476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.443 [2024-11-28 19:16:03.333494] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.443 [2024-11-28 19:16:03.333678] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.443 [2024-11-28 19:16:03.333847] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.443 [2024-11-28 19:16:03.333872] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.443 [2024-11-28 19:16:03.333894] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.443 [2024-11-28 19:16:03.336179] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.443 [2024-11-28 19:16:03.345527] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.443 [2024-11-28 19:16:03.345830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.443 [2024-11-28 19:16:03.345979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.443 [2024-11-28 19:16:03.346008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.443 [2024-11-28 19:16:03.346027] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.443 [2024-11-28 19:16:03.346174] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.443 [2024-11-28 19:16:03.346380] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.443 [2024-11-28 19:16:03.346418] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.443 [2024-11-28 19:16:03.346436] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.443 [2024-11-28 19:16:03.348613] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.443 [2024-11-28 19:16:03.358118] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.443 [2024-11-28 19:16:03.358407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.443 [2024-11-28 19:16:03.358562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.443 [2024-11-28 19:16:03.358592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.443 [2024-11-28 19:16:03.358610] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.443 [2024-11-28 19:16:03.358813] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.443 [2024-11-28 19:16:03.358972] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.443 [2024-11-28 19:16:03.358997] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.443 [2024-11-28 19:16:03.359013] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.443 [2024-11-28 19:16:03.361471] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.443 [2024-11-28 19:16:03.370832] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.443 [2024-11-28 19:16:03.371161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.443 [2024-11-28 19:16:03.371260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.443 [2024-11-28 19:16:03.371290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.443 [2024-11-28 19:16:03.371309] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.443 [2024-11-28 19:16:03.371452] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.443 [2024-11-28 19:16:03.371604] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.444 [2024-11-28 19:16:03.371629] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.444 [2024-11-28 19:16:03.371645] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.444 [2024-11-28 19:16:03.373936] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.444 [2024-11-28 19:16:03.383644] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.444 [2024-11-28 19:16:03.384003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.444 [2024-11-28 19:16:03.384146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.444 [2024-11-28 19:16:03.384171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.444 [2024-11-28 19:16:03.384188] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.444 [2024-11-28 19:16:03.384351] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.444 [2024-11-28 19:16:03.384520] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.444 [2024-11-28 19:16:03.384546] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.444 [2024-11-28 19:16:03.384562] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.444 [2024-11-28 19:16:03.386867] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.444 [2024-11-28 19:16:03.396341] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.444 [2024-11-28 19:16:03.396644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.444 [2024-11-28 19:16:03.396773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.444 [2024-11-28 19:16:03.396800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.444 [2024-11-28 19:16:03.396819] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.444 [2024-11-28 19:16:03.396985] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.444 [2024-11-28 19:16:03.397172] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.444 [2024-11-28 19:16:03.397197] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.444 [2024-11-28 19:16:03.397214] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.444 [2024-11-28 19:16:03.399486] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.444 [2024-11-28 19:16:03.408633] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.444 [2024-11-28 19:16:03.408945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.444 [2024-11-28 19:16:03.409063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.444 [2024-11-28 19:16:03.409088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.444 [2024-11-28 19:16:03.409104] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.444 [2024-11-28 19:16:03.409253] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.444 [2024-11-28 19:16:03.409415] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.444 [2024-11-28 19:16:03.409452] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.444 [2024-11-28 19:16:03.409466] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.444 [2024-11-28 19:16:03.411517] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.444 [2024-11-28 19:16:03.421471] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.444 [2024-11-28 19:16:03.421758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.444 [2024-11-28 19:16:03.421861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.444 [2024-11-28 19:16:03.421890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.444 [2024-11-28 19:16:03.421908] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.444 [2024-11-28 19:16:03.422075] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.444 [2024-11-28 19:16:03.422226] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.444 [2024-11-28 19:16:03.422251] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.444 [2024-11-28 19:16:03.422268] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.444 [2024-11-28 19:16:03.424552] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.444 [2024-11-28 19:16:03.433798] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.444 [2024-11-28 19:16:03.434136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.444 [2024-11-28 19:16:03.434267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.444 [2024-11-28 19:16:03.434296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.444 [2024-11-28 19:16:03.434314] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.444 [2024-11-28 19:16:03.434458] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.444 [2024-11-28 19:16:03.434682] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.444 [2024-11-28 19:16:03.434708] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.444 [2024-11-28 19:16:03.434724] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.444 [2024-11-28 19:16:03.437138] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.444 [2024-11-28 19:16:03.446353] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.444 [2024-11-28 19:16:03.446631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.444 [2024-11-28 19:16:03.446715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.444 [2024-11-28 19:16:03.446742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.444 [2024-11-28 19:16:03.446759] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.444 [2024-11-28 19:16:03.446864] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.444 [2024-11-28 19:16:03.447022] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.444 [2024-11-28 19:16:03.447046] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.444 [2024-11-28 19:16:03.447061] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.444 [2024-11-28 19:16:03.449428] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.444 [2024-11-28 19:16:03.459052] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.444 [2024-11-28 19:16:03.459402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.444 [2024-11-28 19:16:03.459517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.444 [2024-11-28 19:16:03.459542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.444 [2024-11-28 19:16:03.459559] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.444 [2024-11-28 19:16:03.459730] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.444 [2024-11-28 19:16:03.459900] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.444 [2024-11-28 19:16:03.459923] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.444 [2024-11-28 19:16:03.459939] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.444 [2024-11-28 19:16:03.462253] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.444 [2024-11-28 19:16:03.471842] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.444 [2024-11-28 19:16:03.472113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.444 [2024-11-28 19:16:03.472234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.444 [2024-11-28 19:16:03.472263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.444 [2024-11-28 19:16:03.472281] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.444 [2024-11-28 19:16:03.472486] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.444 [2024-11-28 19:16:03.472655] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.444 [2024-11-28 19:16:03.472693] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.444 [2024-11-28 19:16:03.472710] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.444 [2024-11-28 19:16:03.474900] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.444 [2024-11-28 19:16:03.483991] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.444 [2024-11-28 19:16:03.484227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.444 [2024-11-28 19:16:03.484375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.444 [2024-11-28 19:16:03.484412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.444 [2024-11-28 19:16:03.484431] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.444 [2024-11-28 19:16:03.484581] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.444 [2024-11-28 19:16:03.484733] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.444 [2024-11-28 19:16:03.484756] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.444 [2024-11-28 19:16:03.484771] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.444 [2024-11-28 19:16:03.486661] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.707 [2024-11-28 19:16:03.496563] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.707 [2024-11-28 19:16:03.496851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.707 [2024-11-28 19:16:03.496979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.707 [2024-11-28 19:16:03.497015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.707 [2024-11-28 19:16:03.497034] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.707 [2024-11-28 19:16:03.497201] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.707 [2024-11-28 19:16:03.497364] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.707 [2024-11-28 19:16:03.497387] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.707 [2024-11-28 19:16:03.497430] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.707 [2024-11-28 19:16:03.499653] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.707 [2024-11-28 19:16:03.509251] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.707 [2024-11-28 19:16:03.509535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.707 [2024-11-28 19:16:03.509654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.707 [2024-11-28 19:16:03.509683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.707 [2024-11-28 19:16:03.509702] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.707 [2024-11-28 19:16:03.509868] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.707 [2024-11-28 19:16:03.510075] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.707 [2024-11-28 19:16:03.510101] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.707 [2024-11-28 19:16:03.510118] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.707 [2024-11-28 19:16:03.512541] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.707 [2024-11-28 19:16:03.521766] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.707 [2024-11-28 19:16:03.522100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.707 [2024-11-28 19:16:03.522260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.707 [2024-11-28 19:16:03.522288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.707 [2024-11-28 19:16:03.522306] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.707 [2024-11-28 19:16:03.522546] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.707 [2024-11-28 19:16:03.522694] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.707 [2024-11-28 19:16:03.522716] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.707 [2024-11-28 19:16:03.522744] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.707 [2024-11-28 19:16:03.525082] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.707 [2024-11-28 19:16:03.534510] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.707 [2024-11-28 19:16:03.534851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.707 [2024-11-28 19:16:03.534976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.707 [2024-11-28 19:16:03.535003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.707 [2024-11-28 19:16:03.535031] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.707 [2024-11-28 19:16:03.535181] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.708 [2024-11-28 19:16:03.535350] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.708 [2024-11-28 19:16:03.535375] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.708 [2024-11-28 19:16:03.535403] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.708 [2024-11-28 19:16:03.537846] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.708 [2024-11-28 19:16:03.547153] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.708 [2024-11-28 19:16:03.547459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.708 [2024-11-28 19:16:03.547606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.708 [2024-11-28 19:16:03.547635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.708 [2024-11-28 19:16:03.547653] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.708 [2024-11-28 19:16:03.547831] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.708 [2024-11-28 19:16:03.548018] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.708 [2024-11-28 19:16:03.548043] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.708 [2024-11-28 19:16:03.548060] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.708 [2024-11-28 19:16:03.550295] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.708 [2024-11-28 19:16:03.559744] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.708 [2024-11-28 19:16:03.560078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.708 [2024-11-28 19:16:03.560183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.708 [2024-11-28 19:16:03.560213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.708 [2024-11-28 19:16:03.560231] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.708 [2024-11-28 19:16:03.560429] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.708 [2024-11-28 19:16:03.560601] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.708 [2024-11-28 19:16:03.560625] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.708 [2024-11-28 19:16:03.560642] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.708 [2024-11-28 19:16:03.562944] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.708 [2024-11-28 19:16:03.572242] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.708 [2024-11-28 19:16:03.572578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.708 [2024-11-28 19:16:03.572723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.708 [2024-11-28 19:16:03.572749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.708 [2024-11-28 19:16:03.572766] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.708 [2024-11-28 19:16:03.572886] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.708 [2024-11-28 19:16:03.573077] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.708 [2024-11-28 19:16:03.573104] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.708 [2024-11-28 19:16:03.573121] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.708 [2024-11-28 19:16:03.575581] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.708 [2024-11-28 19:16:03.584666] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.708 [2024-11-28 19:16:03.584955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.708 [2024-11-28 19:16:03.585094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.708 [2024-11-28 19:16:03.585123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.708 [2024-11-28 19:16:03.585141] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.708 [2024-11-28 19:16:03.585318] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.708 [2024-11-28 19:16:03.585498] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.708 [2024-11-28 19:16:03.585525] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.708 [2024-11-28 19:16:03.585543] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.708 [2024-11-28 19:16:03.587881] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.708 [2024-11-28 19:16:03.597187] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.708 [2024-11-28 19:16:03.597508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.708 [2024-11-28 19:16:03.597642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.708 [2024-11-28 19:16:03.597668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.708 [2024-11-28 19:16:03.597683] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.708 [2024-11-28 19:16:03.597825] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.708 [2024-11-28 19:16:03.597996] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.708 [2024-11-28 19:16:03.598020] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.708 [2024-11-28 19:16:03.598036] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.708 [2024-11-28 19:16:03.600475] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.708 [2024-11-28 19:16:03.609829] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.708 [2024-11-28 19:16:03.610133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.708 [2024-11-28 19:16:03.610287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.708 [2024-11-28 19:16:03.610317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.708 [2024-11-28 19:16:03.610336] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.708 [2024-11-28 19:16:03.610532] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.708 [2024-11-28 19:16:03.610743] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.708 [2024-11-28 19:16:03.610769] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.708 [2024-11-28 19:16:03.610786] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.708 [2024-11-28 19:16:03.613161] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.708 [2024-11-28 19:16:03.622420] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.708 [2024-11-28 19:16:03.622749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.708 [2024-11-28 19:16:03.622878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.708 [2024-11-28 19:16:03.622920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.708 [2024-11-28 19:16:03.622937] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.708 [2024-11-28 19:16:03.623117] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.708 [2024-11-28 19:16:03.623280] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.708 [2024-11-28 19:16:03.623306] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.708 [2024-11-28 19:16:03.623322] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.708 [2024-11-28 19:16:03.625559] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.708 [2024-11-28 19:16:03.634998] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.708 [2024-11-28 19:16:03.635342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.708 [2024-11-28 19:16:03.635480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.708 [2024-11-28 19:16:03.635509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.708 [2024-11-28 19:16:03.635526] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.708 [2024-11-28 19:16:03.635742] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.708 [2024-11-28 19:16:03.635912] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.708 [2024-11-28 19:16:03.635937] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.708 [2024-11-28 19:16:03.635954] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.708 [2024-11-28 19:16:03.638134] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.708 [2024-11-28 19:16:03.647583] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.708 [2024-11-28 19:16:03.647870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.708 [2024-11-28 19:16:03.648000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.708 [2024-11-28 19:16:03.648032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.708 [2024-11-28 19:16:03.648051] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.708 [2024-11-28 19:16:03.648199] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.708 [2024-11-28 19:16:03.648417] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.708 [2024-11-28 19:16:03.648448] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.708 [2024-11-28 19:16:03.648464] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.709 [2024-11-28 19:16:03.650785] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.709 [2024-11-28 19:16:03.660109] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.709 [2024-11-28 19:16:03.660442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.709 [2024-11-28 19:16:03.660583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.709 [2024-11-28 19:16:03.660610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.709 [2024-11-28 19:16:03.660628] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.709 [2024-11-28 19:16:03.660806] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.709 [2024-11-28 19:16:03.660957] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.709 [2024-11-28 19:16:03.660982] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.709 [2024-11-28 19:16:03.660998] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.709 [2024-11-28 19:16:03.663158] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.709 [2024-11-28 19:16:03.672672] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.709 [2024-11-28 19:16:03.672998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.709 [2024-11-28 19:16:03.673172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.709 [2024-11-28 19:16:03.673199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.709 [2024-11-28 19:16:03.673216] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.709 [2024-11-28 19:16:03.673408] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.709 [2024-11-28 19:16:03.673651] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.709 [2024-11-28 19:16:03.673676] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.709 [2024-11-28 19:16:03.673692] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.709 [2024-11-28 19:16:03.676051] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.709 [2024-11-28 19:16:03.685375] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.709 [2024-11-28 19:16:03.685689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.709 [2024-11-28 19:16:03.685796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.709 [2024-11-28 19:16:03.685825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.709 [2024-11-28 19:16:03.685844] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.709 [2024-11-28 19:16:03.686010] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.709 [2024-11-28 19:16:03.686198] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.709 [2024-11-28 19:16:03.686223] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.709 [2024-11-28 19:16:03.686245] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.709 [2024-11-28 19:16:03.688503] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.709 [2024-11-28 19:16:03.697913] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.709 [2024-11-28 19:16:03.698250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.709 [2024-11-28 19:16:03.698370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.709 [2024-11-28 19:16:03.698404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.709 [2024-11-28 19:16:03.698423] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.709 [2024-11-28 19:16:03.698581] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.709 [2024-11-28 19:16:03.698757] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.709 [2024-11-28 19:16:03.698781] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.709 [2024-11-28 19:16:03.698797] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.709 [2024-11-28 19:16:03.701087] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.709 [2024-11-28 19:16:03.710490] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.709 [2024-11-28 19:16:03.710850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.709 [2024-11-28 19:16:03.711002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.709 [2024-11-28 19:16:03.711030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.709 [2024-11-28 19:16:03.711048] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.709 [2024-11-28 19:16:03.711213] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.709 [2024-11-28 19:16:03.711429] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.709 [2024-11-28 19:16:03.711455] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.709 [2024-11-28 19:16:03.711470] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.709 [2024-11-28 19:16:03.713932] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.709 [2024-11-28 19:16:03.723111] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.709 [2024-11-28 19:16:03.723462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.709 [2024-11-28 19:16:03.723602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.709 [2024-11-28 19:16:03.723631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.709 [2024-11-28 19:16:03.723649] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.709 [2024-11-28 19:16:03.723814] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.709 [2024-11-28 19:16:03.723983] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.709 [2024-11-28 19:16:03.724006] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.709 [2024-11-28 19:16:03.724022] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.709 [2024-11-28 19:16:03.726332] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.709 [2024-11-28 19:16:03.735503] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.709 [2024-11-28 19:16:03.735833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.709 [2024-11-28 19:16:03.735980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.709 [2024-11-28 19:16:03.736006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.709 [2024-11-28 19:16:03.736022] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.709 [2024-11-28 19:16:03.736154] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.709 [2024-11-28 19:16:03.736383] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.709 [2024-11-28 19:16:03.736418] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.709 [2024-11-28 19:16:03.736435] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.709 [2024-11-28 19:16:03.738719] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.709 [2024-11-28 19:16:03.748157] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.709 [2024-11-28 19:16:03.748472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.709 [2024-11-28 19:16:03.748575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.709 [2024-11-28 19:16:03.748604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.709 [2024-11-28 19:16:03.748622] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.709 [2024-11-28 19:16:03.748806] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.709 [2024-11-28 19:16:03.748993] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.709 [2024-11-28 19:16:03.749032] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.709 [2024-11-28 19:16:03.749046] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.709 [2024-11-28 19:16:03.751271] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.971 [2024-11-28 19:16:03.760894] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.972 [2024-11-28 19:16:03.761203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.972 [2024-11-28 19:16:03.761328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.972 [2024-11-28 19:16:03.761357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.972 [2024-11-28 19:16:03.761374] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.972 [2024-11-28 19:16:03.761538] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.972 [2024-11-28 19:16:03.761701] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.972 [2024-11-28 19:16:03.761738] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.972 [2024-11-28 19:16:03.761754] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.972 [2024-11-28 19:16:03.764110] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.972 [2024-11-28 19:16:03.773477] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.972 [2024-11-28 19:16:03.773783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.972 [2024-11-28 19:16:03.773938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.972 [2024-11-28 19:16:03.773966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.972 [2024-11-28 19:16:03.773984] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.972 [2024-11-28 19:16:03.774149] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.972 [2024-11-28 19:16:03.774372] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.972 [2024-11-28 19:16:03.774407] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.972 [2024-11-28 19:16:03.774425] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.972 [2024-11-28 19:16:03.776602] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.972 [2024-11-28 19:16:03.785946] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.972 [2024-11-28 19:16:03.786274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.972 [2024-11-28 19:16:03.786408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.972 [2024-11-28 19:16:03.786437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.972 [2024-11-28 19:16:03.786455] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.972 [2024-11-28 19:16:03.786620] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.972 [2024-11-28 19:16:03.786807] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.972 [2024-11-28 19:16:03.786830] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.972 [2024-11-28 19:16:03.786846] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.972 [2024-11-28 19:16:03.788930] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.972 [2024-11-28 19:16:03.798515] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.972 [2024-11-28 19:16:03.798790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.972 [2024-11-28 19:16:03.798919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.972 [2024-11-28 19:16:03.798947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.972 [2024-11-28 19:16:03.798965] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.972 [2024-11-28 19:16:03.799147] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.972 [2024-11-28 19:16:03.799298] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.972 [2024-11-28 19:16:03.799321] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.972 [2024-11-28 19:16:03.799337] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.972 [2024-11-28 19:16:03.801551] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.972 [2024-11-28 19:16:03.811091] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.972 [2024-11-28 19:16:03.811408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.972 [2024-11-28 19:16:03.811513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.972 [2024-11-28 19:16:03.811542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.972 [2024-11-28 19:16:03.811559] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.972 [2024-11-28 19:16:03.811724] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.972 [2024-11-28 19:16:03.811893] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.972 [2024-11-28 19:16:03.811918] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.972 [2024-11-28 19:16:03.811933] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.972 [2024-11-28 19:16:03.814180] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.972 [2024-11-28 19:16:03.823521] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.972 [2024-11-28 19:16:03.823858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.972 [2024-11-28 19:16:03.824011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.972 [2024-11-28 19:16:03.824040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.972 [2024-11-28 19:16:03.824057] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.972 [2024-11-28 19:16:03.824276] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.972 [2024-11-28 19:16:03.824479] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.972 [2024-11-28 19:16:03.824503] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.972 [2024-11-28 19:16:03.824519] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.972 [2024-11-28 19:16:03.826766] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.972 [2024-11-28 19:16:03.836224] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.972 [2024-11-28 19:16:03.836536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.972 [2024-11-28 19:16:03.836691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.972 [2024-11-28 19:16:03.836720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.972 [2024-11-28 19:16:03.836738] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.972 [2024-11-28 19:16:03.836921] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.972 [2024-11-28 19:16:03.837072] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.972 [2024-11-28 19:16:03.837095] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.972 [2024-11-28 19:16:03.837111] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.972 [2024-11-28 19:16:03.839422] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.972 [2024-11-28 19:16:03.848823] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.972 [2024-11-28 19:16:03.849139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.972 [2024-11-28 19:16:03.849262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.972 [2024-11-28 19:16:03.849296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.972 [2024-11-28 19:16:03.849315] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.972 [2024-11-28 19:16:03.849520] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.972 [2024-11-28 19:16:03.849709] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.972 [2024-11-28 19:16:03.849733] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.972 [2024-11-28 19:16:03.849749] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.972 [2024-11-28 19:16:03.851816] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.972 [2024-11-28 19:16:03.861299] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.972 [2024-11-28 19:16:03.861658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.972 [2024-11-28 19:16:03.861791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.972 [2024-11-28 19:16:03.861820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.973 [2024-11-28 19:16:03.861837] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.973 [2024-11-28 19:16:03.862001] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.973 [2024-11-28 19:16:03.862153] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.973 [2024-11-28 19:16:03.862177] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.973 [2024-11-28 19:16:03.862192] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.973 [2024-11-28 19:16:03.864415] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.973 [2024-11-28 19:16:03.874090] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.973 [2024-11-28 19:16:03.874411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.973 [2024-11-28 19:16:03.874565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.973 [2024-11-28 19:16:03.874594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.973 [2024-11-28 19:16:03.874611] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.973 [2024-11-28 19:16:03.874812] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.973 [2024-11-28 19:16:03.874946] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.973 [2024-11-28 19:16:03.874969] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.973 [2024-11-28 19:16:03.874984] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.973 [2024-11-28 19:16:03.877405] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.973 [2024-11-28 19:16:03.886691] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.973 [2024-11-28 19:16:03.886983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.973 [2024-11-28 19:16:03.887114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.973 [2024-11-28 19:16:03.887142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.973 [2024-11-28 19:16:03.887174] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.973 [2024-11-28 19:16:03.887341] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.973 [2024-11-28 19:16:03.887515] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.973 [2024-11-28 19:16:03.887536] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.973 [2024-11-28 19:16:03.887548] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.973 [2024-11-28 19:16:03.890089] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.973 [2024-11-28 19:16:03.899242] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.973 [2024-11-28 19:16:03.899614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.973 [2024-11-28 19:16:03.899739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.973 [2024-11-28 19:16:03.899768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.973 [2024-11-28 19:16:03.899785] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.973 [2024-11-28 19:16:03.900004] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.973 [2024-11-28 19:16:03.900174] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.973 [2024-11-28 19:16:03.900197] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.973 [2024-11-28 19:16:03.900212] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.973 [2024-11-28 19:16:03.902373] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.973 [2024-11-28 19:16:03.911829] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.973 [2024-11-28 19:16:03.912181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.973 [2024-11-28 19:16:03.912306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.973 [2024-11-28 19:16:03.912332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.973 [2024-11-28 19:16:03.912348] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.973 [2024-11-28 19:16:03.912524] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.973 [2024-11-28 19:16:03.912686] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.973 [2024-11-28 19:16:03.912723] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.973 [2024-11-28 19:16:03.912738] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.973 [2024-11-28 19:16:03.914932] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.973 [2024-11-28 19:16:03.924485] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.973 [2024-11-28 19:16:03.924813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.973 [2024-11-28 19:16:03.924967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.973 [2024-11-28 19:16:03.924996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.973 [2024-11-28 19:16:03.925013] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.973 [2024-11-28 19:16:03.925185] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.973 [2024-11-28 19:16:03.925373] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.973 [2024-11-28 19:16:03.925407] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.973 [2024-11-28 19:16:03.925425] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.973 [2024-11-28 19:16:03.927833] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.973 [2024-11-28 19:16:03.937093] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.973 [2024-11-28 19:16:03.937387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.973 [2024-11-28 19:16:03.937524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.973 [2024-11-28 19:16:03.937552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.973 [2024-11-28 19:16:03.937570] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.973 [2024-11-28 19:16:03.937699] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.973 [2024-11-28 19:16:03.937922] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.973 [2024-11-28 19:16:03.937945] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.973 [2024-11-28 19:16:03.937961] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.973 [2024-11-28 19:16:03.940389] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.973 [2024-11-28 19:16:03.949699] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.973 [2024-11-28 19:16:03.950004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.973 [2024-11-28 19:16:03.950105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.973 [2024-11-28 19:16:03.950133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.973 [2024-11-28 19:16:03.950151] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.973 [2024-11-28 19:16:03.950315] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.973 [2024-11-28 19:16:03.950532] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.973 [2024-11-28 19:16:03.950556] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.973 [2024-11-28 19:16:03.950572] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.973 [2024-11-28 19:16:03.953035] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.973 [2024-11-28 19:16:03.962361] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.973 [2024-11-28 19:16:03.962751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.973 [2024-11-28 19:16:03.962882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.973 [2024-11-28 19:16:03.962911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.973 [2024-11-28 19:16:03.962928] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.973 [2024-11-28 19:16:03.963093] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.973 [2024-11-28 19:16:03.963195] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.973 [2024-11-28 19:16:03.963219] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.973 [2024-11-28 19:16:03.963234] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.973 [2024-11-28 19:16:03.965885] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.973 [2024-11-28 19:16:03.974987] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.973 [2024-11-28 19:16:03.975315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.973 [2024-11-28 19:16:03.975445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.973 [2024-11-28 19:16:03.975475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.973 [2024-11-28 19:16:03.975493] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.973 [2024-11-28 19:16:03.975676] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.973 [2024-11-28 19:16:03.975863] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.974 [2024-11-28 19:16:03.975887] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.974 [2024-11-28 19:16:03.975902] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.974 [2024-11-28 19:16:03.978241] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.974 [2024-11-28 19:16:03.987620] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.974 [2024-11-28 19:16:03.988008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.974 [2024-11-28 19:16:03.988136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.974 [2024-11-28 19:16:03.988164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.974 [2024-11-28 19:16:03.988181] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.974 [2024-11-28 19:16:03.988309] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.974 [2024-11-28 19:16:03.988490] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.974 [2024-11-28 19:16:03.988515] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.974 [2024-11-28 19:16:03.988531] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.974 [2024-11-28 19:16:03.990886] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.974 [2024-11-28 19:16:04.000134] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.974 [2024-11-28 19:16:04.000388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.974 [2024-11-28 19:16:04.000512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.974 [2024-11-28 19:16:04.000538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.974 [2024-11-28 19:16:04.000553] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.974 [2024-11-28 19:16:04.000751] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.974 [2024-11-28 19:16:04.000921] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.974 [2024-11-28 19:16:04.000950] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.974 [2024-11-28 19:16:04.000968] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.974 [2024-11-28 19:16:04.003013] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:42.974 [2024-11-28 19:16:04.012824] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:42.974 [2024-11-28 19:16:04.013068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.974 [2024-11-28 19:16:04.013191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:42.974 [2024-11-28 19:16:04.013220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:42.974 [2024-11-28 19:16:04.013237] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:42.974 [2024-11-28 19:16:04.013384] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:42.974 [2024-11-28 19:16:04.013625] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:42.974 [2024-11-28 19:16:04.013646] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:42.974 [2024-11-28 19:16:04.013659] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:42.974 [2024-11-28 19:16:04.015946] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.234 [2024-11-28 19:16:04.025526] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.234 [2024-11-28 19:16:04.025850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.234 [2024-11-28 19:16:04.025977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.234 [2024-11-28 19:16:04.026006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.234 [2024-11-28 19:16:04.026024] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.234 [2024-11-28 19:16:04.026225] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.234 [2024-11-28 19:16:04.026405] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.234 [2024-11-28 19:16:04.026430] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.234 [2024-11-28 19:16:04.026446] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.234 [2024-11-28 19:16:04.028674] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.234 [2024-11-28 19:16:04.038147] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.234 [2024-11-28 19:16:04.038420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.234 [2024-11-28 19:16:04.038542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.234 [2024-11-28 19:16:04.038582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.234 [2024-11-28 19:16:04.038597] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.234 [2024-11-28 19:16:04.038785] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.234 [2024-11-28 19:16:04.038930] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.234 [2024-11-28 19:16:04.038955] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.234 [2024-11-28 19:16:04.038976] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.234 [2024-11-28 19:16:04.041403] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.234 [2024-11-28 19:16:04.050629] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.234 [2024-11-28 19:16:04.050917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.234 [2024-11-28 19:16:04.051071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.234 [2024-11-28 19:16:04.051099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.234 [2024-11-28 19:16:04.051117] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.234 [2024-11-28 19:16:04.051282] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.234 [2024-11-28 19:16:04.051481] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.234 [2024-11-28 19:16:04.051506] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.234 [2024-11-28 19:16:04.051522] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.234 [2024-11-28 19:16:04.053966] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.234 [2024-11-28 19:16:04.063132] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.234 [2024-11-28 19:16:04.063422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.234 [2024-11-28 19:16:04.063546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.234 [2024-11-28 19:16:04.063575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.234 [2024-11-28 19:16:04.063593] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.234 [2024-11-28 19:16:04.063758] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.234 [2024-11-28 19:16:04.063945] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.234 [2024-11-28 19:16:04.063969] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.234 [2024-11-28 19:16:04.063984] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.234 [2024-11-28 19:16:04.066376] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.234 [2024-11-28 19:16:04.075653] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.234 [2024-11-28 19:16:04.075986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.234 [2024-11-28 19:16:04.076140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.234 [2024-11-28 19:16:04.076169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.234 [2024-11-28 19:16:04.076186] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.234 [2024-11-28 19:16:04.076369] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.234 [2024-11-28 19:16:04.076565] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.234 [2024-11-28 19:16:04.076587] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.234 [2024-11-28 19:16:04.076601] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.234 [2024-11-28 19:16:04.078921] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.234 [2024-11-28 19:16:04.088077] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.234 [2024-11-28 19:16:04.088408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.234 [2024-11-28 19:16:04.088529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.234 [2024-11-28 19:16:04.088560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.234 [2024-11-28 19:16:04.088578] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.234 [2024-11-28 19:16:04.088689] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.234 [2024-11-28 19:16:04.088878] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.234 [2024-11-28 19:16:04.088901] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.234 [2024-11-28 19:16:04.088916] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.234 [2024-11-28 19:16:04.091118] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.234 [2024-11-28 19:16:04.100854] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.235 [2024-11-28 19:16:04.101148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.235 [2024-11-28 19:16:04.101253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.235 [2024-11-28 19:16:04.101282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.235 [2024-11-28 19:16:04.101300] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.235 [2024-11-28 19:16:04.101495] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.235 [2024-11-28 19:16:04.101648] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.235 [2024-11-28 19:16:04.101671] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.235 [2024-11-28 19:16:04.101686] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.235 [2024-11-28 19:16:04.103861] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.235 [2024-11-28 19:16:04.113544] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.235 [2024-11-28 19:16:04.113873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.235 [2024-11-28 19:16:04.114028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.235 [2024-11-28 19:16:04.114057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.235 [2024-11-28 19:16:04.114075] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.235 [2024-11-28 19:16:04.114275] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.235 [2024-11-28 19:16:04.114421] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.235 [2024-11-28 19:16:04.114445] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.235 [2024-11-28 19:16:04.114460] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.235 [2024-11-28 19:16:04.116745] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.235 [2024-11-28 19:16:04.125971] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.235 [2024-11-28 19:16:04.126296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.235 [2024-11-28 19:16:04.126438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.235 [2024-11-28 19:16:04.126465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.235 [2024-11-28 19:16:04.126481] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.235 [2024-11-28 19:16:04.126728] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.235 [2024-11-28 19:16:04.126898] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.235 [2024-11-28 19:16:04.126921] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.235 [2024-11-28 19:16:04.126936] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.235 [2024-11-28 19:16:04.129291] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.235 [2024-11-28 19:16:04.138387] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.235 [2024-11-28 19:16:04.138705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.235 [2024-11-28 19:16:04.138851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.235 [2024-11-28 19:16:04.138877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.235 [2024-11-28 19:16:04.138892] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.235 [2024-11-28 19:16:04.139098] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.235 [2024-11-28 19:16:04.139280] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.235 [2024-11-28 19:16:04.139304] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.235 [2024-11-28 19:16:04.139319] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.235 [2024-11-28 19:16:04.141688] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.235 [2024-11-28 19:16:04.151114] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.235 [2024-11-28 19:16:04.151447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.235 [2024-11-28 19:16:04.151575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.235 [2024-11-28 19:16:04.151604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.235 [2024-11-28 19:16:04.151622] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.235 [2024-11-28 19:16:04.151841] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.235 [2024-11-28 19:16:04.151992] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.235 [2024-11-28 19:16:04.152016] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.235 [2024-11-28 19:16:04.152031] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.235 [2024-11-28 19:16:04.154061] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.235 [2024-11-28 19:16:04.163791] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.235 [2024-11-28 19:16:04.164023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.235 [2024-11-28 19:16:04.164157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.235 [2024-11-28 19:16:04.164186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.235 [2024-11-28 19:16:04.164204] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.235 [2024-11-28 19:16:04.164369] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.235 [2024-11-28 19:16:04.164530] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.235 [2024-11-28 19:16:04.164554] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.235 [2024-11-28 19:16:04.164569] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.235 [2024-11-28 19:16:04.166816] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.235 [2024-11-28 19:16:04.176320] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.235 [2024-11-28 19:16:04.176634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.235 [2024-11-28 19:16:04.176768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.235 [2024-11-28 19:16:04.176797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.235 [2024-11-28 19:16:04.176815] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.235 [2024-11-28 19:16:04.176943] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.235 [2024-11-28 19:16:04.177095] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.235 [2024-11-28 19:16:04.177118] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.235 [2024-11-28 19:16:04.177133] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.235 [2024-11-28 19:16:04.179516] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.235 [2024-11-28 19:16:04.188925] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.235 [2024-11-28 19:16:04.189232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.235 [2024-11-28 19:16:04.189386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.235 [2024-11-28 19:16:04.189425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.235 [2024-11-28 19:16:04.189444] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.235 [2024-11-28 19:16:04.189627] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.235 [2024-11-28 19:16:04.189778] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.235 [2024-11-28 19:16:04.189801] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.235 [2024-11-28 19:16:04.189817] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.235 [2024-11-28 19:16:04.192296] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.235 [2024-11-28 19:16:04.201209] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.235 [2024-11-28 19:16:04.201480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.235 [2024-11-28 19:16:04.201596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.235 [2024-11-28 19:16:04.201626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.235 [2024-11-28 19:16:04.201643] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.235 [2024-11-28 19:16:04.201841] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.235 [2024-11-28 19:16:04.202010] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.235 [2024-11-28 19:16:04.202033] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.235 [2024-11-28 19:16:04.202049] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.235 [2024-11-28 19:16:04.204429] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.235 [2024-11-28 19:16:04.213781] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.235 [2024-11-28 19:16:04.214033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.235 [2024-11-28 19:16:04.214188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.235 [2024-11-28 19:16:04.214217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.236 [2024-11-28 19:16:04.214235] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.236 [2024-11-28 19:16:04.214443] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.236 [2024-11-28 19:16:04.214547] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.236 [2024-11-28 19:16:04.214568] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.236 [2024-11-28 19:16:04.214582] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.236 [2024-11-28 19:16:04.217102] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.236 [2024-11-28 19:16:04.226519] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.236 [2024-11-28 19:16:04.226870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.236 [2024-11-28 19:16:04.226968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.236 [2024-11-28 19:16:04.227009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.236 [2024-11-28 19:16:04.227025] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.236 [2024-11-28 19:16:04.227189] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.236 [2024-11-28 19:16:04.227389] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.236 [2024-11-28 19:16:04.227423] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.236 [2024-11-28 19:16:04.227438] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.236 [2024-11-28 19:16:04.229998] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.236 [2024-11-28 19:16:04.239246] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.236 [2024-11-28 19:16:04.239569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.236 [2024-11-28 19:16:04.239665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.236 [2024-11-28 19:16:04.239691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.236 [2024-11-28 19:16:04.239712] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.236 [2024-11-28 19:16:04.239829] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.236 [2024-11-28 19:16:04.240060] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.236 [2024-11-28 19:16:04.240084] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.236 [2024-11-28 19:16:04.240099] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.236 [2024-11-28 19:16:04.242391] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.236 [2024-11-28 19:16:04.251777] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.236 [2024-11-28 19:16:04.252042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.236 [2024-11-28 19:16:04.252152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.236 [2024-11-28 19:16:04.252181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.236 [2024-11-28 19:16:04.252199] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.236 [2024-11-28 19:16:04.252381] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.236 [2024-11-28 19:16:04.252580] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.236 [2024-11-28 19:16:04.252601] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.236 [2024-11-28 19:16:04.252615] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.236 [2024-11-28 19:16:04.254936] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.236 [2024-11-28 19:16:04.264367] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.236 [2024-11-28 19:16:04.264630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.236 [2024-11-28 19:16:04.264785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.236 [2024-11-28 19:16:04.264813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.236 [2024-11-28 19:16:04.264831] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.236 [2024-11-28 19:16:04.264977] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.236 [2024-11-28 19:16:04.265110] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.236 [2024-11-28 19:16:04.265134] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.236 [2024-11-28 19:16:04.265149] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.236 [2024-11-28 19:16:04.267214] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.236 [2024-11-28 19:16:04.276975] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.236 [2024-11-28 19:16:04.277282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.236 [2024-11-28 19:16:04.277425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.236 [2024-11-28 19:16:04.277467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.236 [2024-11-28 19:16:04.277483] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.236 [2024-11-28 19:16:04.277621] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.236 [2024-11-28 19:16:04.277765] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.236 [2024-11-28 19:16:04.277789] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.236 [2024-11-28 19:16:04.277804] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.236 [2024-11-28 19:16:04.279964] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.495 [2024-11-28 19:16:04.289538] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.495 [2024-11-28 19:16:04.289883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.495 [2024-11-28 19:16:04.290011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.495 [2024-11-28 19:16:04.290037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.495 [2024-11-28 19:16:04.290053] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.495 [2024-11-28 19:16:04.290201] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.495 [2024-11-28 19:16:04.290352] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.495 [2024-11-28 19:16:04.290387] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.495 [2024-11-28 19:16:04.290411] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.495 [2024-11-28 19:16:04.292657] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.495 [2024-11-28 19:16:04.302131] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.495 [2024-11-28 19:16:04.302446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.495 [2024-11-28 19:16:04.302562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.495 [2024-11-28 19:16:04.302588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.495 [2024-11-28 19:16:04.302604] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.495 [2024-11-28 19:16:04.302799] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.495 [2024-11-28 19:16:04.302952] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.495 [2024-11-28 19:16:04.302971] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.495 [2024-11-28 19:16:04.302983] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.495 [2024-11-28 19:16:04.305374] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.495 [2024-11-28 19:16:04.314964] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.495 [2024-11-28 19:16:04.315389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.495 [2024-11-28 19:16:04.315531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.495 [2024-11-28 19:16:04.315557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.495 [2024-11-28 19:16:04.315573] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.495 [2024-11-28 19:16:04.315753] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.495 [2024-11-28 19:16:04.315913] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.495 [2024-11-28 19:16:04.315931] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.495 [2024-11-28 19:16:04.315944] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.495 [2024-11-28 19:16:04.318030] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.495 [2024-11-28 19:16:04.327516] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.495 [2024-11-28 19:16:04.327860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.495 [2024-11-28 19:16:04.327987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.495 [2024-11-28 19:16:04.328013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.495 [2024-11-28 19:16:04.328029] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.495 [2024-11-28 19:16:04.328159] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.495 [2024-11-28 19:16:04.328358] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.495 [2024-11-28 19:16:04.328399] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.495 [2024-11-28 19:16:04.328416] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.495 [2024-11-28 19:16:04.330798] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.495 [2024-11-28 19:16:04.340043] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.495 [2024-11-28 19:16:04.340352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.495 [2024-11-28 19:16:04.340501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.495 [2024-11-28 19:16:04.340528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.495 [2024-11-28 19:16:04.340544] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.495 [2024-11-28 19:16:04.340708] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.495 [2024-11-28 19:16:04.340868] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.495 [2024-11-28 19:16:04.340887] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.495 [2024-11-28 19:16:04.340899] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.495 [2024-11-28 19:16:04.343148] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.495 [2024-11-28 19:16:04.352723] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.495 [2024-11-28 19:16:04.353046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.495 [2024-11-28 19:16:04.353187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.495 [2024-11-28 19:16:04.353213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.495 [2024-11-28 19:16:04.353229] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.495 [2024-11-28 19:16:04.353418] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.495 [2024-11-28 19:16:04.353599] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.496 [2024-11-28 19:16:04.353625] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.496 [2024-11-28 19:16:04.353639] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.496 [2024-11-28 19:16:04.356032] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.496 [2024-11-28 19:16:04.365198] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.496 [2024-11-28 19:16:04.365550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.496 [2024-11-28 19:16:04.365665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.496 [2024-11-28 19:16:04.365691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.496 [2024-11-28 19:16:04.365707] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.496 [2024-11-28 19:16:04.365899] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.496 [2024-11-28 19:16:04.366067] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.496 [2024-11-28 19:16:04.366086] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.496 [2024-11-28 19:16:04.366098] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.496 [2024-11-28 19:16:04.368353] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.496 [2024-11-28 19:16:04.377615] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.496 [2024-11-28 19:16:04.378027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.496 [2024-11-28 19:16:04.378175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.496 [2024-11-28 19:16:04.378201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.496 [2024-11-28 19:16:04.378217] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.496 [2024-11-28 19:16:04.378332] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.496 [2024-11-28 19:16:04.378548] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.496 [2024-11-28 19:16:04.378569] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.496 [2024-11-28 19:16:04.378581] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.496 [2024-11-28 19:16:04.380794] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.496 [2024-11-28 19:16:04.390245] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.496 [2024-11-28 19:16:04.390652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.496 [2024-11-28 19:16:04.390863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.496 [2024-11-28 19:16:04.390889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.496 [2024-11-28 19:16:04.390905] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.496 [2024-11-28 19:16:04.391078] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.496 [2024-11-28 19:16:04.391262] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.496 [2024-11-28 19:16:04.391280] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.496 [2024-11-28 19:16:04.391297] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.496 [2024-11-28 19:16:04.393377] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.496 [2024-11-28 19:16:04.403009] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.496 [2024-11-28 19:16:04.403413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.496 [2024-11-28 19:16:04.403550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.496 [2024-11-28 19:16:04.403575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.496 [2024-11-28 19:16:04.403590] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.496 [2024-11-28 19:16:04.403766] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.496 [2024-11-28 19:16:04.403949] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.496 [2024-11-28 19:16:04.403968] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.496 [2024-11-28 19:16:04.403980] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.496 [2024-11-28 19:16:04.406391] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.496 [2024-11-28 19:16:04.415442] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.496 [2024-11-28 19:16:04.415812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.496 [2024-11-28 19:16:04.415966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.496 [2024-11-28 19:16:04.415993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.496 [2024-11-28 19:16:04.416008] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.496 [2024-11-28 19:16:04.416183] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.496 [2024-11-28 19:16:04.416356] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.496 [2024-11-28 19:16:04.416390] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.496 [2024-11-28 19:16:04.416413] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.496 [2024-11-28 19:16:04.418596] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.496 [2024-11-28 19:16:04.428007] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.496 [2024-11-28 19:16:04.428314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.496 [2024-11-28 19:16:04.428412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.496 [2024-11-28 19:16:04.428439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.496 [2024-11-28 19:16:04.428455] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.496 [2024-11-28 19:16:04.428636] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.496 [2024-11-28 19:16:04.428820] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.496 [2024-11-28 19:16:04.428839] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.496 [2024-11-28 19:16:04.428851] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.496 [2024-11-28 19:16:04.431051] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.496 [2024-11-28 19:16:04.440731] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.496 [2024-11-28 19:16:04.441143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.496 [2024-11-28 19:16:04.441316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.496 [2024-11-28 19:16:04.441342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.496 [2024-11-28 19:16:04.441358] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.496 [2024-11-28 19:16:04.441512] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.496 [2024-11-28 19:16:04.441639] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.496 [2024-11-28 19:16:04.441658] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.496 [2024-11-28 19:16:04.441685] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.496 [2024-11-28 19:16:04.443951] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.496 [2024-11-28 19:16:04.453457] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.496 [2024-11-28 19:16:04.453833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.496 [2024-11-28 19:16:04.454014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.496 [2024-11-28 19:16:04.454039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.496 [2024-11-28 19:16:04.454055] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.496 [2024-11-28 19:16:04.454274] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.496 [2024-11-28 19:16:04.454421] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.496 [2024-11-28 19:16:04.454440] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.496 [2024-11-28 19:16:04.454453] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.496 [2024-11-28 19:16:04.456798] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.496 [2024-11-28 19:16:04.466183] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.496 [2024-11-28 19:16:04.466492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.496 [2024-11-28 19:16:04.466619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.496 [2024-11-28 19:16:04.466646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.496 [2024-11-28 19:16:04.466663] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.496 [2024-11-28 19:16:04.466809] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.496 [2024-11-28 19:16:04.466948] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.496 [2024-11-28 19:16:04.466967] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.496 [2024-11-28 19:16:04.466980] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.497 [2024-11-28 19:16:04.469026] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.497 [2024-11-28 19:16:04.478808] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.497 [2024-11-28 19:16:04.479182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.497 [2024-11-28 19:16:04.479369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.497 [2024-11-28 19:16:04.479403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.497 [2024-11-28 19:16:04.479421] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.497 [2024-11-28 19:16:04.479585] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.497 [2024-11-28 19:16:04.479759] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.497 [2024-11-28 19:16:04.479778] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.497 [2024-11-28 19:16:04.479790] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.497 [2024-11-28 19:16:04.481730] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.497 [2024-11-28 19:16:04.491138] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.497 [2024-11-28 19:16:04.491489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.497 [2024-11-28 19:16:04.491613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.497 [2024-11-28 19:16:04.491638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.497 [2024-11-28 19:16:04.491655] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.497 [2024-11-28 19:16:04.491817] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.497 [2024-11-28 19:16:04.492032] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.497 [2024-11-28 19:16:04.492051] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.497 [2024-11-28 19:16:04.492063] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.497 [2024-11-28 19:16:04.494271] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.497 [2024-11-28 19:16:04.503631] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.497 [2024-11-28 19:16:04.504001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.497 [2024-11-28 19:16:04.504096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.497 [2024-11-28 19:16:04.504122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.497 [2024-11-28 19:16:04.504138] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.497 [2024-11-28 19:16:04.504287] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.497 [2024-11-28 19:16:04.504512] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.497 [2024-11-28 19:16:04.504534] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.497 [2024-11-28 19:16:04.504548] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.497 [2024-11-28 19:16:04.506721] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.497 [2024-11-28 19:16:04.516020] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.497 [2024-11-28 19:16:04.516361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.497 [2024-11-28 19:16:04.516502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.497 [2024-11-28 19:16:04.516530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.497 [2024-11-28 19:16:04.516546] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.497 [2024-11-28 19:16:04.516694] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.497 [2024-11-28 19:16:04.516908] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.497 [2024-11-28 19:16:04.516927] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.497 [2024-11-28 19:16:04.516939] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.497 [2024-11-28 19:16:04.519146] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.497 [2024-11-28 19:16:04.528593] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.497 [2024-11-28 19:16:04.529003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.497 [2024-11-28 19:16:04.529138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.497 [2024-11-28 19:16:04.529164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.497 [2024-11-28 19:16:04.529180] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.497 [2024-11-28 19:16:04.529357] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.497 [2024-11-28 19:16:04.529518] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.497 [2024-11-28 19:16:04.529540] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.497 [2024-11-28 19:16:04.529554] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.497 [2024-11-28 19:16:04.531864] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.497 [2024-11-28 19:16:04.541211] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.497 [2024-11-28 19:16:04.541511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.756 [2024-11-28 19:16:04.541636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.756 [2024-11-28 19:16:04.541663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.756 [2024-11-28 19:16:04.541680] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.756 [2024-11-28 19:16:04.541812] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.756 [2024-11-28 19:16:04.541976] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.756 [2024-11-28 19:16:04.541996] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.756 [2024-11-28 19:16:04.542009] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.756 [2024-11-28 19:16:04.544211] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.756 [2024-11-28 19:16:04.553293] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.756 [2024-11-28 19:16:04.553606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.756 [2024-11-28 19:16:04.553721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.756 [2024-11-28 19:16:04.553752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.756 [2024-11-28 19:16:04.553769] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.756 [2024-11-28 19:16:04.553965] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.756 [2024-11-28 19:16:04.554077] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.756 [2024-11-28 19:16:04.554096] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.756 [2024-11-28 19:16:04.554109] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.756 [2024-11-28 19:16:04.555984] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.756 [2024-11-28 19:16:04.565663] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.756 [2024-11-28 19:16:04.566034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.756 [2024-11-28 19:16:04.566130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.756 [2024-11-28 19:16:04.566155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.756 [2024-11-28 19:16:04.566171] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.756 [2024-11-28 19:16:04.566329] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.756 [2024-11-28 19:16:04.566481] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.756 [2024-11-28 19:16:04.566502] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.756 [2024-11-28 19:16:04.566515] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.756 [2024-11-28 19:16:04.568737] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.756 [2024-11-28 19:16:04.578156] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.756 [2024-11-28 19:16:04.578553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.756 [2024-11-28 19:16:04.578730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.756 [2024-11-28 19:16:04.578755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.756 [2024-11-28 19:16:04.578771] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.756 [2024-11-28 19:16:04.578948] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.756 [2024-11-28 19:16:04.579118] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.756 [2024-11-28 19:16:04.579138] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.756 [2024-11-28 19:16:04.579150] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.756 [2024-11-28 19:16:04.581401] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.756 [2024-11-28 19:16:04.590724] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.756 [2024-11-28 19:16:04.591061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.756 [2024-11-28 19:16:04.591185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.756 [2024-11-28 19:16:04.591211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.756 [2024-11-28 19:16:04.591238] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.756 [2024-11-28 19:16:04.591387] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.756 [2024-11-28 19:16:04.591578] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.757 [2024-11-28 19:16:04.591600] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.757 [2024-11-28 19:16:04.591614] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.757 [2024-11-28 19:16:04.594012] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.757 [2024-11-28 19:16:04.603192] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.757 [2024-11-28 19:16:04.603538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.757 [2024-11-28 19:16:04.603655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.757 [2024-11-28 19:16:04.603682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.757 [2024-11-28 19:16:04.603699] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.757 [2024-11-28 19:16:04.603859] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.757 [2024-11-28 19:16:04.604027] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.757 [2024-11-28 19:16:04.604046] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.757 [2024-11-28 19:16:04.604059] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.757 [2024-11-28 19:16:04.606072] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.757 [2024-11-28 19:16:04.615673] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.757 [2024-11-28 19:16:04.616025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.757 [2024-11-28 19:16:04.616150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.757 [2024-11-28 19:16:04.616177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.757 [2024-11-28 19:16:04.616193] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.757 [2024-11-28 19:16:04.616387] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.757 [2024-11-28 19:16:04.616569] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.757 [2024-11-28 19:16:04.616589] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.757 [2024-11-28 19:16:04.616602] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.757 [2024-11-28 19:16:04.618943] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.757 [2024-11-28 19:16:04.627962] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.757 [2024-11-28 19:16:04.628305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.757 [2024-11-28 19:16:04.628430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.757 [2024-11-28 19:16:04.628457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.757 [2024-11-28 19:16:04.628473] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.757 [2024-11-28 19:16:04.628611] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.757 [2024-11-28 19:16:04.628800] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.757 [2024-11-28 19:16:04.628819] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.757 [2024-11-28 19:16:04.628831] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.757 [2024-11-28 19:16:04.631110] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.757 [2024-11-28 19:16:04.640448] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.757 [2024-11-28 19:16:04.640694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.757 [2024-11-28 19:16:04.640861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.757 [2024-11-28 19:16:04.640887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.757 [2024-11-28 19:16:04.640903] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.757 [2024-11-28 19:16:04.641070] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.757 [2024-11-28 19:16:04.641209] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.757 [2024-11-28 19:16:04.641227] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.757 [2024-11-28 19:16:04.641240] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.757 [2024-11-28 19:16:04.643540] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.757 [2024-11-28 19:16:04.653078] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.757 [2024-11-28 19:16:04.653467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.757 [2024-11-28 19:16:04.653621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.757 [2024-11-28 19:16:04.653647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.757 [2024-11-28 19:16:04.653663] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.757 [2024-11-28 19:16:04.653838] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.757 [2024-11-28 19:16:04.654050] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.757 [2024-11-28 19:16:04.654069] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.757 [2024-11-28 19:16:04.654081] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.757 [2024-11-28 19:16:04.656390] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.757 [2024-11-28 19:16:04.665780] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.757 [2024-11-28 19:16:04.666073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.757 [2024-11-28 19:16:04.666194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.757 [2024-11-28 19:16:04.666219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.757 [2024-11-28 19:16:04.666235] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.757 [2024-11-28 19:16:04.666419] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.757 [2024-11-28 19:16:04.666565] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.757 [2024-11-28 19:16:04.666585] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.757 [2024-11-28 19:16:04.666597] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.757 [2024-11-28 19:16:04.668815] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.757 [2024-11-28 19:16:04.678569] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.757 [2024-11-28 19:16:04.678879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.757 [2024-11-28 19:16:04.679020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.757 [2024-11-28 19:16:04.679045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.757 [2024-11-28 19:16:04.679061] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.757 [2024-11-28 19:16:04.679238] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.757 [2024-11-28 19:16:04.679430] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.757 [2024-11-28 19:16:04.679450] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.757 [2024-11-28 19:16:04.679463] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.757 [2024-11-28 19:16:04.681809] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.757 [2024-11-28 19:16:04.691046] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.757 [2024-11-28 19:16:04.691380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.757 [2024-11-28 19:16:04.691511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.757 [2024-11-28 19:16:04.691537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.757 [2024-11-28 19:16:04.691553] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.757 [2024-11-28 19:16:04.691667] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.757 [2024-11-28 19:16:04.691840] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.757 [2024-11-28 19:16:04.691859] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.757 [2024-11-28 19:16:04.691871] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.757 [2024-11-28 19:16:04.694032] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.757 [2024-11-28 19:16:04.703652] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.757 [2024-11-28 19:16:04.703973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.757 [2024-11-28 19:16:04.704100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.757 [2024-11-28 19:16:04.704126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.757 [2024-11-28 19:16:04.704142] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.757 [2024-11-28 19:16:04.704336] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.757 [2024-11-28 19:16:04.704518] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.757 [2024-11-28 19:16:04.704546] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.757 [2024-11-28 19:16:04.704560] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.757 [2024-11-28 19:16:04.706759] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.757 [2024-11-28 19:16:04.716459] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.757 [2024-11-28 19:16:04.716847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.758 [2024-11-28 19:16:04.716997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.758 [2024-11-28 19:16:04.717023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.758 [2024-11-28 19:16:04.717039] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.758 [2024-11-28 19:16:04.717202] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.758 [2024-11-28 19:16:04.717431] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.758 [2024-11-28 19:16:04.717452] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.758 [2024-11-28 19:16:04.717465] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.758 [2024-11-28 19:16:04.719636] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.758 [2024-11-28 19:16:04.729017] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.758 [2024-11-28 19:16:04.729408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.758 [2024-11-28 19:16:04.729528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.758 [2024-11-28 19:16:04.729554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.758 [2024-11-28 19:16:04.729570] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.758 [2024-11-28 19:16:04.729733] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.758 [2024-11-28 19:16:04.729889] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.758 [2024-11-28 19:16:04.729908] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.758 [2024-11-28 19:16:04.729921] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.758 [2024-11-28 19:16:04.732240] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.758 [2024-11-28 19:16:04.741567] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.758 [2024-11-28 19:16:04.741954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.758 [2024-11-28 19:16:04.742041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.758 [2024-11-28 19:16:04.742066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.758 [2024-11-28 19:16:04.742082] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.758 [2024-11-28 19:16:04.742271] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.758 [2024-11-28 19:16:04.742437] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.758 [2024-11-28 19:16:04.742457] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.758 [2024-11-28 19:16:04.742475] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.758 [2024-11-28 19:16:04.744662] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.758 [2024-11-28 19:16:04.754118] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.758 [2024-11-28 19:16:04.754486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.758 [2024-11-28 19:16:04.754587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.758 [2024-11-28 19:16:04.754613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.758 [2024-11-28 19:16:04.754629] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.758 [2024-11-28 19:16:04.754729] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.758 [2024-11-28 19:16:04.754863] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.758 [2024-11-28 19:16:04.754898] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.758 [2024-11-28 19:16:04.754911] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.758 [2024-11-28 19:16:04.757328] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.758 [2024-11-28 19:16:04.766744] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.758 [2024-11-28 19:16:04.767101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.758 [2024-11-28 19:16:04.767234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.758 [2024-11-28 19:16:04.767263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.758 [2024-11-28 19:16:04.767280] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.758 [2024-11-28 19:16:04.767483] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.758 [2024-11-28 19:16:04.767658] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.758 [2024-11-28 19:16:04.767693] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.758 [2024-11-28 19:16:04.767706] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.758 [2024-11-28 19:16:04.770019] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.758 [2024-11-28 19:16:04.779330] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.758 [2024-11-28 19:16:04.779708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.758 [2024-11-28 19:16:04.779850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.758 [2024-11-28 19:16:04.779876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.758 [2024-11-28 19:16:04.779892] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.758 [2024-11-28 19:16:04.780070] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.758 [2024-11-28 19:16:04.780199] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.758 [2024-11-28 19:16:04.780217] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.758 [2024-11-28 19:16:04.780230] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.758 [2024-11-28 19:16:04.782577] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:43.758 [2024-11-28 19:16:04.791858] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:43.758 [2024-11-28 19:16:04.792242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.758 [2024-11-28 19:16:04.792390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:43.758 [2024-11-28 19:16:04.792429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:43.758 [2024-11-28 19:16:04.792445] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:43.758 [2024-11-28 19:16:04.792609] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:43.758 [2024-11-28 19:16:04.792837] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:43.758 [2024-11-28 19:16:04.792855] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:43.758 [2024-11-28 19:16:04.792868] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:43.758 [2024-11-28 19:16:04.795135] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.017 [2024-11-28 19:16:04.804515] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.017 [2024-11-28 19:16:04.804940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.017 [2024-11-28 19:16:04.805087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.017 [2024-11-28 19:16:04.805112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.017 [2024-11-28 19:16:04.805128] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.018 [2024-11-28 19:16:04.805337] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.018 [2024-11-28 19:16:04.805501] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.018 [2024-11-28 19:16:04.805520] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.018 [2024-11-28 19:16:04.805533] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.018 [2024-11-28 19:16:04.807808] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.018 [2024-11-28 19:16:04.816950] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.018 [2024-11-28 19:16:04.817261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.018 [2024-11-28 19:16:04.817403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.018 [2024-11-28 19:16:04.817429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.018 [2024-11-28 19:16:04.817444] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.018 [2024-11-28 19:16:04.817560] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.018 [2024-11-28 19:16:04.817753] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.018 [2024-11-28 19:16:04.817771] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.018 [2024-11-28 19:16:04.817784] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.018 [2024-11-28 19:16:04.820195] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.018 [2024-11-28 19:16:04.829407] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.018 [2024-11-28 19:16:04.829708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.018 [2024-11-28 19:16:04.829836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.018 [2024-11-28 19:16:04.829861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.018 [2024-11-28 19:16:04.829877] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.018 [2024-11-28 19:16:04.830023] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.018 [2024-11-28 19:16:04.830192] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.018 [2024-11-28 19:16:04.830211] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.018 [2024-11-28 19:16:04.830224] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.018 [2024-11-28 19:16:04.832431] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.018 [2024-11-28 19:16:04.842123] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.018 [2024-11-28 19:16:04.842404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.018 [2024-11-28 19:16:04.842526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.018 [2024-11-28 19:16:04.842552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.018 [2024-11-28 19:16:04.842567] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.018 [2024-11-28 19:16:04.842724] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.018 [2024-11-28 19:16:04.842919] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.018 [2024-11-28 19:16:04.842938] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.018 [2024-11-28 19:16:04.842950] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.018 [2024-11-28 19:16:04.845237] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.018 [2024-11-28 19:16:04.854566] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.018 [2024-11-28 19:16:04.854947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.018 [2024-11-28 19:16:04.855127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.018 [2024-11-28 19:16:04.855153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.018 [2024-11-28 19:16:04.855168] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.018 [2024-11-28 19:16:04.855312] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.018 [2024-11-28 19:16:04.855492] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.018 [2024-11-28 19:16:04.855512] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.018 [2024-11-28 19:16:04.855524] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.018 [2024-11-28 19:16:04.857735] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.018 [2024-11-28 19:16:04.867100] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.018 [2024-11-28 19:16:04.867515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.018 [2024-11-28 19:16:04.867644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.018 [2024-11-28 19:16:04.867672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.018 [2024-11-28 19:16:04.867688] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.018 [2024-11-28 19:16:04.867878] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.018 [2024-11-28 19:16:04.868061] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.018 [2024-11-28 19:16:04.868080] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.018 [2024-11-28 19:16:04.868093] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.018 [2024-11-28 19:16:04.870372] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.018 [2024-11-28 19:16:04.879604] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.018 [2024-11-28 19:16:04.879880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.018 [2024-11-28 19:16:04.880007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.018 [2024-11-28 19:16:04.880035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.018 [2024-11-28 19:16:04.880051] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.018 [2024-11-28 19:16:04.880227] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.018 [2024-11-28 19:16:04.880403] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.018 [2024-11-28 19:16:04.880434] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.018 [2024-11-28 19:16:04.880448] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.018 [2024-11-28 19:16:04.882544] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.018 [2024-11-28 19:16:04.892184] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.018 [2024-11-28 19:16:04.892491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.018 [2024-11-28 19:16:04.892610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.018 [2024-11-28 19:16:04.892635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.018 [2024-11-28 19:16:04.892650] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.018 [2024-11-28 19:16:04.892839] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.018 [2024-11-28 19:16:04.893006] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.018 [2024-11-28 19:16:04.893025] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.018 [2024-11-28 19:16:04.893037] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.018 [2024-11-28 19:16:04.895439] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.018 [2024-11-28 19:16:04.904750] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.018 [2024-11-28 19:16:04.905057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.018 [2024-11-28 19:16:04.905207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.018 [2024-11-28 19:16:04.905238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.018 [2024-11-28 19:16:04.905255] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.018 [2024-11-28 19:16:04.905418] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.018 [2024-11-28 19:16:04.905588] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.018 [2024-11-28 19:16:04.905607] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.018 [2024-11-28 19:16:04.905619] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.018 [2024-11-28 19:16:04.907847] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.018 [2024-11-28 19:16:04.917498] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.018 [2024-11-28 19:16:04.917822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.018 [2024-11-28 19:16:04.917967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.019 [2024-11-28 19:16:04.917992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.019 [2024-11-28 19:16:04.918009] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.019 [2024-11-28 19:16:04.918155] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.019 [2024-11-28 19:16:04.918324] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.019 [2024-11-28 19:16:04.918343] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.019 [2024-11-28 19:16:04.918355] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.019 [2024-11-28 19:16:04.920679] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.019 [2024-11-28 19:16:04.930015] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.019 [2024-11-28 19:16:04.930348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.019 [2024-11-28 19:16:04.930491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.019 [2024-11-28 19:16:04.930519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.019 [2024-11-28 19:16:04.930535] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.019 [2024-11-28 19:16:04.930666] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.019 [2024-11-28 19:16:04.930807] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.019 [2024-11-28 19:16:04.930826] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.019 [2024-11-28 19:16:04.930838] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.019 [2024-11-28 19:16:04.933210] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.019 [2024-11-28 19:16:04.942567] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.019 [2024-11-28 19:16:04.942886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.019 [2024-11-28 19:16:04.943013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.019 [2024-11-28 19:16:04.943040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.019 [2024-11-28 19:16:04.943061] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.019 [2024-11-28 19:16:04.943223] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.019 [2024-11-28 19:16:04.943379] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.019 [2024-11-28 19:16:04.943417] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.019 [2024-11-28 19:16:04.943430] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.019 [2024-11-28 19:16:04.945587] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.019 [2024-11-28 19:16:04.955129] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.019 [2024-11-28 19:16:04.955390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.019 [2024-11-28 19:16:04.955563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.019 [2024-11-28 19:16:04.955589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.019 [2024-11-28 19:16:04.955605] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.019 [2024-11-28 19:16:04.955768] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.019 [2024-11-28 19:16:04.955949] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.019 [2024-11-28 19:16:04.955968] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.019 [2024-11-28 19:16:04.955980] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.019 [2024-11-28 19:16:04.958238] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.019 [2024-11-28 19:16:04.967553] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.019 [2024-11-28 19:16:04.967890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.019 [2024-11-28 19:16:04.968012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.019 [2024-11-28 19:16:04.968037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.019 [2024-11-28 19:16:04.968054] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.019 [2024-11-28 19:16:04.968202] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.019 [2024-11-28 19:16:04.968374] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.019 [2024-11-28 19:16:04.968400] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.019 [2024-11-28 19:16:04.968414] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.019 [2024-11-28 19:16:04.970728] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.019 [2024-11-28 19:16:04.980090] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.019 [2024-11-28 19:16:04.980488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.019 [2024-11-28 19:16:04.980668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.019 [2024-11-28 19:16:04.980693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.019 [2024-11-28 19:16:04.980709] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.019 [2024-11-28 19:16:04.980908] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.019 [2024-11-28 19:16:04.981075] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.019 [2024-11-28 19:16:04.981094] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.019 [2024-11-28 19:16:04.981106] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.019 [2024-11-28 19:16:04.983264] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.019 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 323727 Killed "${NVMF_APP[@]}" "$@" 00:27:44.019 19:16:04 -- host/bdevperf.sh@36 -- # tgt_init 00:27:44.019 19:16:04 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:27:44.019 19:16:04 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:44.019 19:16:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:44.019 19:16:04 -- common/autotest_common.sh@10 -- # set +x 00:27:44.019 19:16:04 -- nvmf/common.sh@469 -- # nvmfpid=324846 00:27:44.019 19:16:04 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:44.019 19:16:04 -- nvmf/common.sh@470 -- # waitforlisten 324846 00:27:44.019 19:16:04 -- common/autotest_common.sh@829 -- # '[' -z 324846 ']' 00:27:44.019 19:16:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:44.019 19:16:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:44.019 19:16:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:44.019 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:44.019 19:16:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:44.019 19:16:04 -- common/autotest_common.sh@10 -- # set +x 00:27:44.019 [2024-11-28 19:16:04.992769] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.019 [2024-11-28 19:16:04.993066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.019 [2024-11-28 19:16:04.993185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.019 [2024-11-28 19:16:04.993211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.019 [2024-11-28 19:16:04.993227] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.019 [2024-11-28 19:16:04.993430] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.019 [2024-11-28 19:16:04.993633] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.019 [2024-11-28 19:16:04.993654] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.019 [2024-11-28 19:16:04.993668] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.019 [2024-11-28 19:16:04.995743] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.019 [2024-11-28 19:16:05.004967] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.019 [2024-11-28 19:16:05.005269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.019 [2024-11-28 19:16:05.005391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.019 [2024-11-28 19:16:05.005424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.019 [2024-11-28 19:16:05.005440] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.019 [2024-11-28 19:16:05.005611] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.019 [2024-11-28 19:16:05.005859] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.019 [2024-11-28 19:16:05.005880] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.019 [2024-11-28 19:16:05.005893] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.019 [2024-11-28 19:16:05.008137] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.019 [2024-11-28 19:16:05.017107] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.019 [2024-11-28 19:16:05.017387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.019 [2024-11-28 19:16:05.017494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.019 [2024-11-28 19:16:05.017520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.019 [2024-11-28 19:16:05.017536] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.019 [2024-11-28 19:16:05.017652] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.020 [2024-11-28 19:16:05.017860] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.020 [2024-11-28 19:16:05.017879] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.020 [2024-11-28 19:16:05.017892] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.020 [2024-11-28 19:16:05.019910] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.020 [2024-11-28 19:16:05.029205] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.020 [2024-11-28 19:16:05.029512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.020 [2024-11-28 19:16:05.029610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.020 [2024-11-28 19:16:05.029636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.020 [2024-11-28 19:16:05.029652] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.020 [2024-11-28 19:16:05.029785] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.020 [2024-11-28 19:16:05.029899] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.020 [2024-11-28 19:16:05.029935] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.020 [2024-11-28 19:16:05.029948] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.020 [2024-11-28 19:16:05.031166] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:44.020 [2024-11-28 19:16:05.031219] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:44.020 [2024-11-28 19:16:05.031865] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.020 [2024-11-28 19:16:05.041466] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.020 [2024-11-28 19:16:05.041756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.020 [2024-11-28 19:16:05.041851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.020 [2024-11-28 19:16:05.041877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.020 [2024-11-28 19:16:05.041892] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.020 [2024-11-28 19:16:05.042077] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.020 [2024-11-28 19:16:05.042234] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.020 [2024-11-28 19:16:05.042254] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.020 [2024-11-28 19:16:05.042267] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.020 [2024-11-28 19:16:05.044298] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.020 [2024-11-28 19:16:05.053707] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.020 [2024-11-28 19:16:05.053928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.020 [2024-11-28 19:16:05.054070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.020 [2024-11-28 19:16:05.054095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.020 [2024-11-28 19:16:05.054111] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.020 [2024-11-28 19:16:05.054321] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.020 [2024-11-28 19:16:05.054472] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.020 [2024-11-28 19:16:05.054493] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.020 [2024-11-28 19:16:05.054506] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.020 [2024-11-28 19:16:05.056541] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.279 [2024-11-28 19:16:05.065882] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.279 [2024-11-28 19:16:05.066205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.279 [2024-11-28 19:16:05.066301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.279 [2024-11-28 19:16:05.066327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.279 [2024-11-28 19:16:05.066343] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.279 [2024-11-28 19:16:05.066516] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.279 [2024-11-28 19:16:05.066708] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.279 [2024-11-28 19:16:05.066730] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.279 [2024-11-28 19:16:05.066758] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.279 EAL: No free 2048 kB hugepages reported on node 1 00:27:44.279 [2024-11-28 19:16:05.068801] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.279 [2024-11-28 19:16:05.078586] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.279 [2024-11-28 19:16:05.078905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.279 [2024-11-28 19:16:05.079028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.279 [2024-11-28 19:16:05.079055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.279 [2024-11-28 19:16:05.079071] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.279 [2024-11-28 19:16:05.079250] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.279 [2024-11-28 19:16:05.079437] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.279 [2024-11-28 19:16:05.079458] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.279 [2024-11-28 19:16:05.079472] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.279 [2024-11-28 19:16:05.081732] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.279 [2024-11-28 19:16:05.091328] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.279 [2024-11-28 19:16:05.091669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.279 [2024-11-28 19:16:05.091818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.279 [2024-11-28 19:16:05.091844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.279 [2024-11-28 19:16:05.091860] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.279 [2024-11-28 19:16:05.092086] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.279 [2024-11-28 19:16:05.092287] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.279 [2024-11-28 19:16:05.092310] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.279 [2024-11-28 19:16:05.092326] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.279 [2024-11-28 19:16:05.094575] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.279 [2024-11-28 19:16:05.101145] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:44.279 [2024-11-28 19:16:05.103916] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.279 [2024-11-28 19:16:05.104232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.279 [2024-11-28 19:16:05.104390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.279 [2024-11-28 19:16:05.104428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.279 [2024-11-28 19:16:05.104445] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.279 [2024-11-28 19:16:05.104642] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.279 [2024-11-28 19:16:05.104812] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.279 [2024-11-28 19:16:05.104832] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.279 [2024-11-28 19:16:05.104845] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.279 [2024-11-28 19:16:05.107145] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.279 [2024-11-28 19:16:05.116461] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.279 [2024-11-28 19:16:05.116835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.279 [2024-11-28 19:16:05.116995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.279 [2024-11-28 19:16:05.117021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.279 [2024-11-28 19:16:05.117040] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.279 [2024-11-28 19:16:05.117196] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.279 [2024-11-28 19:16:05.117370] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.279 [2024-11-28 19:16:05.117407] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.279 [2024-11-28 19:16:05.117423] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.279 [2024-11-28 19:16:05.119715] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.279 [2024-11-28 19:16:05.128801] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.279 [2024-11-28 19:16:05.129176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.279 [2024-11-28 19:16:05.129367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.279 [2024-11-28 19:16:05.129399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.279 [2024-11-28 19:16:05.129417] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.279 [2024-11-28 19:16:05.129550] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.279 [2024-11-28 19:16:05.129747] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.279 [2024-11-28 19:16:05.129783] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.279 [2024-11-28 19:16:05.129796] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.279 [2024-11-28 19:16:05.132080] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.279 [2024-11-28 19:16:05.141341] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.279 [2024-11-28 19:16:05.141667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.279 [2024-11-28 19:16:05.141794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.279 [2024-11-28 19:16:05.141820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.279 [2024-11-28 19:16:05.141837] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.279 [2024-11-28 19:16:05.141938] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.279 [2024-11-28 19:16:05.142118] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.279 [2024-11-28 19:16:05.142152] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.279 [2024-11-28 19:16:05.142165] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.279 [2024-11-28 19:16:05.144643] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.279 [2024-11-28 19:16:05.154004] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.279 [2024-11-28 19:16:05.154315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.279 [2024-11-28 19:16:05.154470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.279 [2024-11-28 19:16:05.154497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.279 [2024-11-28 19:16:05.154514] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.279 [2024-11-28 19:16:05.154729] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.279 [2024-11-28 19:16:05.154900] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.279 [2024-11-28 19:16:05.154928] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.279 [2024-11-28 19:16:05.154941] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.279 [2024-11-28 19:16:05.157269] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.279 [2024-11-28 19:16:05.166488] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.279 [2024-11-28 19:16:05.166947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.279 [2024-11-28 19:16:05.167151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.279 [2024-11-28 19:16:05.167177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.279 [2024-11-28 19:16:05.167196] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.279 [2024-11-28 19:16:05.167335] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.279 [2024-11-28 19:16:05.167539] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.279 [2024-11-28 19:16:05.167561] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.279 [2024-11-28 19:16:05.167576] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.279 [2024-11-28 19:16:05.169677] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.279 [2024-11-28 19:16:05.179035] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.279 [2024-11-28 19:16:05.179406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.279 [2024-11-28 19:16:05.179560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.279 [2024-11-28 19:16:05.179586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.279 [2024-11-28 19:16:05.179603] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.279 [2024-11-28 19:16:05.179755] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.279 [2024-11-28 19:16:05.179875] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.279 [2024-11-28 19:16:05.179910] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.279 [2024-11-28 19:16:05.179925] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.279 [2024-11-28 19:16:05.182237] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.279 [2024-11-28 19:16:05.191666] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.279 [2024-11-28 19:16:05.192009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.279 [2024-11-28 19:16:05.192176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.279 [2024-11-28 19:16:05.192202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.279 [2024-11-28 19:16:05.192218] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.279 [2024-11-28 19:16:05.192349] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.280 [2024-11-28 19:16:05.192551] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.280 [2024-11-28 19:16:05.192573] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.280 [2024-11-28 19:16:05.192596] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.280 [2024-11-28 19:16:05.194866] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.280 [2024-11-28 19:16:05.204094] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.280 [2024-11-28 19:16:05.204406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.280 [2024-11-28 19:16:05.204545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.280 [2024-11-28 19:16:05.204571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.280 [2024-11-28 19:16:05.204587] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.280 [2024-11-28 19:16:05.204736] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.280 [2024-11-28 19:16:05.204905] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.280 [2024-11-28 19:16:05.204925] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.280 [2024-11-28 19:16:05.204938] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.280 [2024-11-28 19:16:05.207376] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.280 [2024-11-28 19:16:05.215896] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:44.280 [2024-11-28 19:16:05.216004] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:44.280 [2024-11-28 19:16:05.216022] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:44.280 [2024-11-28 19:16:05.216034] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:44.280 [2024-11-28 19:16:05.216130] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:44.280 [2024-11-28 19:16:05.216190] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:44.280 [2024-11-28 19:16:05.216193] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:44.280 [2024-11-28 19:16:05.216368] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.280 [2024-11-28 19:16:05.216712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.280 [2024-11-28 19:16:05.216865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.280 [2024-11-28 19:16:05.216891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.280 [2024-11-28 19:16:05.216908] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.280 [2024-11-28 19:16:05.217024] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.280 [2024-11-28 19:16:05.217191] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.280 [2024-11-28 19:16:05.217212] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.280 [2024-11-28 19:16:05.217226] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.280 [2024-11-28 19:16:05.219310] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.280 [2024-11-28 19:16:05.228888] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.280 [2024-11-28 19:16:05.229347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.280 [2024-11-28 19:16:05.229495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.280 [2024-11-28 19:16:05.229523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.280 [2024-11-28 19:16:05.229550] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.280 [2024-11-28 19:16:05.229677] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.280 [2024-11-28 19:16:05.229887] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.280 [2024-11-28 19:16:05.229909] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.280 [2024-11-28 19:16:05.229926] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.280 [2024-11-28 19:16:05.232299] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.280 [2024-11-28 19:16:05.241203] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.280 [2024-11-28 19:16:05.241614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.280 [2024-11-28 19:16:05.241725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.280 [2024-11-28 19:16:05.241760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.280 [2024-11-28 19:16:05.241779] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.280 [2024-11-28 19:16:05.241923] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.280 [2024-11-28 19:16:05.242108] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.280 [2024-11-28 19:16:05.242130] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.280 [2024-11-28 19:16:05.242146] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.280 [2024-11-28 19:16:05.244233] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.280 [2024-11-28 19:16:05.253555] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.280 [2024-11-28 19:16:05.253997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.280 [2024-11-28 19:16:05.254134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.280 [2024-11-28 19:16:05.254161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.280 [2024-11-28 19:16:05.254181] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.280 [2024-11-28 19:16:05.254310] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.280 [2024-11-28 19:16:05.254476] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.280 [2024-11-28 19:16:05.254499] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.280 [2024-11-28 19:16:05.254516] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.280 [2024-11-28 19:16:05.256630] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.280 [2024-11-28 19:16:05.265873] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.280 [2024-11-28 19:16:05.266247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.280 [2024-11-28 19:16:05.266370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.280 [2024-11-28 19:16:05.266404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.280 [2024-11-28 19:16:05.266426] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.280 [2024-11-28 19:16:05.266618] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.280 [2024-11-28 19:16:05.266772] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.280 [2024-11-28 19:16:05.266793] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.280 [2024-11-28 19:16:05.266809] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.280 [2024-11-28 19:16:05.269099] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.280 [2024-11-28 19:16:05.277941] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.280 [2024-11-28 19:16:05.278293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.280 [2024-11-28 19:16:05.278427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.280 [2024-11-28 19:16:05.278455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.280 [2024-11-28 19:16:05.278473] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.280 [2024-11-28 19:16:05.278595] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.280 [2024-11-28 19:16:05.278763] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.280 [2024-11-28 19:16:05.278784] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.280 [2024-11-28 19:16:05.278799] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.280 [2024-11-28 19:16:05.280789] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.280 [2024-11-28 19:16:05.290320] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.280 [2024-11-28 19:16:05.290795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.280 [2024-11-28 19:16:05.290964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.280 [2024-11-28 19:16:05.290991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.280 [2024-11-28 19:16:05.291011] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.280 [2024-11-28 19:16:05.291121] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.280 [2024-11-28 19:16:05.291307] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.280 [2024-11-28 19:16:05.291328] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.280 [2024-11-28 19:16:05.291344] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.280 [2024-11-28 19:16:05.293254] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.280 [2024-11-28 19:16:05.302781] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.280 [2024-11-28 19:16:05.303150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.280 [2024-11-28 19:16:05.303257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.280 [2024-11-28 19:16:05.303285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.280 [2024-11-28 19:16:05.303303] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.280 [2024-11-28 19:16:05.303486] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.280 [2024-11-28 19:16:05.303631] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.280 [2024-11-28 19:16:05.303653] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.280 [2024-11-28 19:16:05.303668] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.280 [2024-11-28 19:16:05.305686] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.280 [2024-11-28 19:16:05.314979] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.280 [2024-11-28 19:16:05.315279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.280 [2024-11-28 19:16:05.315410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.280 [2024-11-28 19:16:05.315437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.280 [2024-11-28 19:16:05.315453] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.280 [2024-11-28 19:16:05.315602] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.280 [2024-11-28 19:16:05.315767] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.280 [2024-11-28 19:16:05.315788] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.280 [2024-11-28 19:16:05.315801] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.280 [2024-11-28 19:16:05.317803] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.541 [2024-11-28 19:16:05.327470] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.541 [2024-11-28 19:16:05.327722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.541 [2024-11-28 19:16:05.327822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.541 [2024-11-28 19:16:05.327849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.541 [2024-11-28 19:16:05.327866] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.541 [2024-11-28 19:16:05.328014] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.541 [2024-11-28 19:16:05.328180] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.541 [2024-11-28 19:16:05.328201] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.541 [2024-11-28 19:16:05.328216] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.541 [2024-11-28 19:16:05.330368] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.541 [2024-11-28 19:16:05.339848] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.541 [2024-11-28 19:16:05.340146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.541 [2024-11-28 19:16:05.340292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.541 [2024-11-28 19:16:05.340318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.541 [2024-11-28 19:16:05.340334] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.541 [2024-11-28 19:16:05.340509] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.541 [2024-11-28 19:16:05.340679] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.541 [2024-11-28 19:16:05.340719] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.541 [2024-11-28 19:16:05.340734] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.541 [2024-11-28 19:16:05.342665] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.541 [2024-11-28 19:16:05.352185] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.541 [2024-11-28 19:16:05.352484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.541 [2024-11-28 19:16:05.352610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.541 [2024-11-28 19:16:05.352638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.541 [2024-11-28 19:16:05.352655] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.541 [2024-11-28 19:16:05.352772] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.541 [2024-11-28 19:16:05.352924] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.541 [2024-11-28 19:16:05.352944] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.541 [2024-11-28 19:16:05.352958] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.541 [2024-11-28 19:16:05.355051] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.541 [2024-11-28 19:16:05.364470] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.541 [2024-11-28 19:16:05.364800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.541 [2024-11-28 19:16:05.364924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.541 [2024-11-28 19:16:05.364950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.541 [2024-11-28 19:16:05.364966] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.541 [2024-11-28 19:16:05.365082] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.541 [2024-11-28 19:16:05.365265] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.541 [2024-11-28 19:16:05.365286] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.541 [2024-11-28 19:16:05.365299] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.541 [2024-11-28 19:16:05.367366] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.541 [2024-11-28 19:16:05.376563] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.541 [2024-11-28 19:16:05.376825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.541 [2024-11-28 19:16:05.376922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.541 [2024-11-28 19:16:05.376948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.541 [2024-11-28 19:16:05.376963] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.541 [2024-11-28 19:16:05.377161] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.541 [2024-11-28 19:16:05.377356] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.541 [2024-11-28 19:16:05.377377] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.541 [2024-11-28 19:16:05.377420] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.541 [2024-11-28 19:16:05.379389] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.541 [2024-11-28 19:16:05.388854] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.541 [2024-11-28 19:16:05.389177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.541 [2024-11-28 19:16:05.389337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.541 [2024-11-28 19:16:05.389364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.541 [2024-11-28 19:16:05.389380] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.541 [2024-11-28 19:16:05.389503] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.541 [2024-11-28 19:16:05.389640] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.541 [2024-11-28 19:16:05.389661] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.541 [2024-11-28 19:16:05.389675] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.541 [2024-11-28 19:16:05.391785] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.541 [2024-11-28 19:16:05.401136] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.541 [2024-11-28 19:16:05.401417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.541 [2024-11-28 19:16:05.401540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.541 [2024-11-28 19:16:05.401566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.541 [2024-11-28 19:16:05.401582] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.541 [2024-11-28 19:16:05.401731] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.541 [2024-11-28 19:16:05.401897] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.541 [2024-11-28 19:16:05.401919] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.541 [2024-11-28 19:16:05.401932] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.541 [2024-11-28 19:16:05.404149] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.541 [2024-11-28 19:16:05.413533] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.541 [2024-11-28 19:16:05.413843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.541 [2024-11-28 19:16:05.413974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.541 [2024-11-28 19:16:05.414000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.541 [2024-11-28 19:16:05.414016] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.541 [2024-11-28 19:16:05.414132] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.541 [2024-11-28 19:16:05.414314] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.541 [2024-11-28 19:16:05.414343] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.541 [2024-11-28 19:16:05.414357] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.541 [2024-11-28 19:16:05.416358] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.541 [2024-11-28 19:16:05.425820] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.541 [2024-11-28 19:16:05.426066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.541 [2024-11-28 19:16:05.426150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.541 [2024-11-28 19:16:05.426177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.541 [2024-11-28 19:16:05.426193] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.541 [2024-11-28 19:16:05.426326] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.541 [2024-11-28 19:16:05.426535] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.542 [2024-11-28 19:16:05.426557] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.542 [2024-11-28 19:16:05.426571] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.542 [2024-11-28 19:16:05.428542] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.542 [2024-11-28 19:16:05.438211] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.542 [2024-11-28 19:16:05.438499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.542 [2024-11-28 19:16:05.438639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.542 [2024-11-28 19:16:05.438665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.542 [2024-11-28 19:16:05.438681] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.542 [2024-11-28 19:16:05.438862] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.542 [2024-11-28 19:16:05.439010] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.542 [2024-11-28 19:16:05.439031] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.542 [2024-11-28 19:16:05.439045] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.542 [2024-11-28 19:16:05.441101] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.542 [2024-11-28 19:16:05.450459] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.542 [2024-11-28 19:16:05.450758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.542 [2024-11-28 19:16:05.450848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.542 [2024-11-28 19:16:05.450875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.542 [2024-11-28 19:16:05.450891] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.542 [2024-11-28 19:16:05.451024] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.542 [2024-11-28 19:16:05.451175] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.542 [2024-11-28 19:16:05.451196] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.542 [2024-11-28 19:16:05.451209] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.542 [2024-11-28 19:16:05.453328] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.542 [2024-11-28 19:16:05.462747] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.542 [2024-11-28 19:16:05.463019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.542 [2024-11-28 19:16:05.463129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.542 [2024-11-28 19:16:05.463154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.542 [2024-11-28 19:16:05.463170] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.542 [2024-11-28 19:16:05.463318] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.542 [2024-11-28 19:16:05.463508] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.542 [2024-11-28 19:16:05.463530] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.542 [2024-11-28 19:16:05.463543] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.542 [2024-11-28 19:16:05.465611] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.542 [2024-11-28 19:16:05.475166] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.542 [2024-11-28 19:16:05.475406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.542 [2024-11-28 19:16:05.475525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.542 [2024-11-28 19:16:05.475551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.542 [2024-11-28 19:16:05.475566] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.542 [2024-11-28 19:16:05.475731] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.542 [2024-11-28 19:16:05.475911] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.542 [2024-11-28 19:16:05.475932] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.542 [2024-11-28 19:16:05.475945] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.542 [2024-11-28 19:16:05.478035] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.542 [2024-11-28 19:16:05.487437] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.542 [2024-11-28 19:16:05.487721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.542 [2024-11-28 19:16:05.487838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.542 [2024-11-28 19:16:05.487864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.542 [2024-11-28 19:16:05.487880] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.542 [2024-11-28 19:16:05.488012] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.542 [2024-11-28 19:16:05.488147] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.542 [2024-11-28 19:16:05.488167] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.542 [2024-11-28 19:16:05.488181] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.542 [2024-11-28 19:16:05.490123] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.542 [2024-11-28 19:16:05.499834] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.542 [2024-11-28 19:16:05.500126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.542 [2024-11-28 19:16:05.500246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.542 [2024-11-28 19:16:05.500272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.542 [2024-11-28 19:16:05.500287] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.542 [2024-11-28 19:16:05.500445] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.542 [2024-11-28 19:16:05.500620] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.542 [2024-11-28 19:16:05.500641] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.542 [2024-11-28 19:16:05.500655] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.542 [2024-11-28 19:16:05.502655] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.542 [2024-11-28 19:16:05.512053] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.542 [2024-11-28 19:16:05.512377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.542 [2024-11-28 19:16:05.512510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.542 [2024-11-28 19:16:05.512537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.542 [2024-11-28 19:16:05.512553] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.542 [2024-11-28 19:16:05.512669] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.542 [2024-11-28 19:16:05.512805] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.542 [2024-11-28 19:16:05.512826] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.542 [2024-11-28 19:16:05.512840] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.542 [2024-11-28 19:16:05.514911] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.542 [2024-11-28 19:16:05.524402] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.542 [2024-11-28 19:16:05.524666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.542 [2024-11-28 19:16:05.524808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.542 [2024-11-28 19:16:05.524834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.542 [2024-11-28 19:16:05.524849] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.542 [2024-11-28 19:16:05.525030] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.542 [2024-11-28 19:16:05.525179] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.542 [2024-11-28 19:16:05.525200] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.542 [2024-11-28 19:16:05.525213] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.542 [2024-11-28 19:16:05.527088] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.542 [2024-11-28 19:16:05.536748] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.542 [2024-11-28 19:16:05.537039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.542 [2024-11-28 19:16:05.537138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.542 [2024-11-28 19:16:05.537163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.542 [2024-11-28 19:16:05.537180] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.542 [2024-11-28 19:16:05.537328] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.542 [2024-11-28 19:16:05.537519] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.542 [2024-11-28 19:16:05.537540] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.542 [2024-11-28 19:16:05.537553] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.542 [2024-11-28 19:16:05.539505] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.542 [2024-11-28 19:16:05.549035] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.543 [2024-11-28 19:16:05.549322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.543 [2024-11-28 19:16:05.549444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.543 [2024-11-28 19:16:05.549471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.543 [2024-11-28 19:16:05.549487] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.543 [2024-11-28 19:16:05.549652] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.543 [2024-11-28 19:16:05.549800] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.543 [2024-11-28 19:16:05.549821] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.543 [2024-11-28 19:16:05.549834] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.543 [2024-11-28 19:16:05.551819] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.543 [2024-11-28 19:16:05.561421] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.543 [2024-11-28 19:16:05.561680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.543 [2024-11-28 19:16:05.561797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.543 [2024-11-28 19:16:05.561822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.543 [2024-11-28 19:16:05.561839] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.543 [2024-11-28 19:16:05.562003] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.543 [2024-11-28 19:16:05.562168] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.543 [2024-11-28 19:16:05.562188] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.543 [2024-11-28 19:16:05.562201] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.543 [2024-11-28 19:16:05.564226] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.543 [2024-11-28 19:16:05.573553] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.543 [2024-11-28 19:16:05.573798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.543 [2024-11-28 19:16:05.573916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.543 [2024-11-28 19:16:05.573942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.543 [2024-11-28 19:16:05.573964] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.543 [2024-11-28 19:16:05.574113] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.543 [2024-11-28 19:16:05.574278] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.543 [2024-11-28 19:16:05.574299] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.543 [2024-11-28 19:16:05.574312] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.543 [2024-11-28 19:16:05.576251] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.543 [2024-11-28 19:16:05.585967] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.543 [2024-11-28 19:16:05.586256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.543 [2024-11-28 19:16:05.586346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.543 [2024-11-28 19:16:05.586372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.543 [2024-11-28 19:16:05.586388] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.543 [2024-11-28 19:16:05.586547] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.803 [2024-11-28 19:16:05.586746] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.803 [2024-11-28 19:16:05.586768] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.803 [2024-11-28 19:16:05.586784] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.803 [2024-11-28 19:16:05.588871] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.803 [2024-11-28 19:16:05.598175] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.803 [2024-11-28 19:16:05.598490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.803 [2024-11-28 19:16:05.598570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.803 [2024-11-28 19:16:05.598595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.803 [2024-11-28 19:16:05.598611] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.803 [2024-11-28 19:16:05.598759] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.803 [2024-11-28 19:16:05.598942] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.803 [2024-11-28 19:16:05.598962] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.803 [2024-11-28 19:16:05.598976] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.803 [2024-11-28 19:16:05.601028] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.803 [2024-11-28 19:16:05.610470] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.803 [2024-11-28 19:16:05.610778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.803 [2024-11-28 19:16:05.610892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.803 [2024-11-28 19:16:05.610917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.803 [2024-11-28 19:16:05.610933] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.803 [2024-11-28 19:16:05.611087] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.803 [2024-11-28 19:16:05.611236] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.803 [2024-11-28 19:16:05.611257] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.803 [2024-11-28 19:16:05.611271] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.803 [2024-11-28 19:16:05.613236] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.803 [2024-11-28 19:16:05.622766] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.803 [2024-11-28 19:16:05.623050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.803 [2024-11-28 19:16:05.623171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.803 [2024-11-28 19:16:05.623196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.803 [2024-11-28 19:16:05.623212] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.803 [2024-11-28 19:16:05.623344] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.803 [2024-11-28 19:16:05.623537] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.803 [2024-11-28 19:16:05.623559] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.803 [2024-11-28 19:16:05.623573] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.803 [2024-11-28 19:16:05.625688] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.803 [2024-11-28 19:16:05.635106] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.803 [2024-11-28 19:16:05.635399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.803 [2024-11-28 19:16:05.635520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.803 [2024-11-28 19:16:05.635546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.803 [2024-11-28 19:16:05.635561] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.803 [2024-11-28 19:16:05.635661] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.803 [2024-11-28 19:16:05.635828] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.803 [2024-11-28 19:16:05.635849] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.803 [2024-11-28 19:16:05.635862] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.803 [2024-11-28 19:16:05.637761] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.803 [2024-11-28 19:16:05.647476] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.803 [2024-11-28 19:16:05.647775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.803 [2024-11-28 19:16:05.647895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.803 [2024-11-28 19:16:05.647922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.803 [2024-11-28 19:16:05.647938] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.803 [2024-11-28 19:16:05.648108] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.803 [2024-11-28 19:16:05.648290] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.803 [2024-11-28 19:16:05.648311] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.803 [2024-11-28 19:16:05.648324] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.803 [2024-11-28 19:16:05.650474] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.803 [2024-11-28 19:16:05.659614] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.803 [2024-11-28 19:16:05.659875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.803 [2024-11-28 19:16:05.659991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.803 [2024-11-28 19:16:05.660018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.803 [2024-11-28 19:16:05.660034] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.803 [2024-11-28 19:16:05.660199] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.803 [2024-11-28 19:16:05.660365] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.803 [2024-11-28 19:16:05.660385] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.803 [2024-11-28 19:16:05.660408] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.803 [2024-11-28 19:16:05.662548] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.803 [2024-11-28 19:16:05.671807] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.803 [2024-11-28 19:16:05.672085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.803 [2024-11-28 19:16:05.672201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.803 [2024-11-28 19:16:05.672228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.803 [2024-11-28 19:16:05.672244] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.803 [2024-11-28 19:16:05.672442] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.803 [2024-11-28 19:16:05.672591] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.803 [2024-11-28 19:16:05.672612] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.803 [2024-11-28 19:16:05.672625] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.803 [2024-11-28 19:16:05.674747] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.803 [2024-11-28 19:16:05.684028] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.803 [2024-11-28 19:16:05.684352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.803 [2024-11-28 19:16:05.684476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.803 [2024-11-28 19:16:05.684504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.803 [2024-11-28 19:16:05.684521] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.803 [2024-11-28 19:16:05.684669] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.803 [2024-11-28 19:16:05.684873] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.803 [2024-11-28 19:16:05.684894] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.803 [2024-11-28 19:16:05.684908] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.803 [2024-11-28 19:16:05.687040] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.803 [2024-11-28 19:16:05.696409] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.803 [2024-11-28 19:16:05.696656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.803 [2024-11-28 19:16:05.696776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.803 [2024-11-28 19:16:05.696803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.803 [2024-11-28 19:16:05.696819] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.803 [2024-11-28 19:16:05.696984] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.803 [2024-11-28 19:16:05.697181] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.803 [2024-11-28 19:16:05.697202] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.803 [2024-11-28 19:16:05.697215] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.803 [2024-11-28 19:16:05.699137] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.803 [2024-11-28 19:16:05.708452] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.803 [2024-11-28 19:16:05.708780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.803 [2024-11-28 19:16:05.708875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.803 [2024-11-28 19:16:05.708901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.803 [2024-11-28 19:16:05.708917] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.803 [2024-11-28 19:16:05.709000] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.803 [2024-11-28 19:16:05.709151] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.803 [2024-11-28 19:16:05.709172] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.803 [2024-11-28 19:16:05.709185] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.803 [2024-11-28 19:16:05.711214] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.803 [2024-11-28 19:16:05.720753] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.803 [2024-11-28 19:16:05.721004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.803 [2024-11-28 19:16:05.721122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.803 [2024-11-28 19:16:05.721147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.803 [2024-11-28 19:16:05.721163] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.803 [2024-11-28 19:16:05.721296] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.803 [2024-11-28 19:16:05.721482] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.803 [2024-11-28 19:16:05.721503] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.803 [2024-11-28 19:16:05.721522] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.803 [2024-11-28 19:16:05.723386] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.803 [2024-11-28 19:16:05.733089] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.803 [2024-11-28 19:16:05.733390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.803 [2024-11-28 19:16:05.733525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.803 [2024-11-28 19:16:05.733551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.803 [2024-11-28 19:16:05.733567] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.803 [2024-11-28 19:16:05.733732] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.804 [2024-11-28 19:16:05.733898] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.804 [2024-11-28 19:16:05.733918] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.804 [2024-11-28 19:16:05.733932] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.804 [2024-11-28 19:16:05.735926] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.804 [2024-11-28 19:16:05.745389] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.804 [2024-11-28 19:16:05.745635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.804 [2024-11-28 19:16:05.745751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.804 [2024-11-28 19:16:05.745777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.804 [2024-11-28 19:16:05.745793] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.804 [2024-11-28 19:16:05.745942] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.804 [2024-11-28 19:16:05.746076] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.804 [2024-11-28 19:16:05.746097] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.804 [2024-11-28 19:16:05.746110] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.804 [2024-11-28 19:16:05.748066] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.804 [2024-11-28 19:16:05.757712] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.804 [2024-11-28 19:16:05.758028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.804 [2024-11-28 19:16:05.758148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.804 [2024-11-28 19:16:05.758173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.804 [2024-11-28 19:16:05.758189] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.804 [2024-11-28 19:16:05.758354] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.804 [2024-11-28 19:16:05.758515] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.804 [2024-11-28 19:16:05.758537] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.804 [2024-11-28 19:16:05.758556] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.804 [2024-11-28 19:16:05.760683] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.804 [2024-11-28 19:16:05.770089] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.804 [2024-11-28 19:16:05.770364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.804 [2024-11-28 19:16:05.770478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.804 [2024-11-28 19:16:05.770504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.804 [2024-11-28 19:16:05.770520] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.804 [2024-11-28 19:16:05.770702] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.804 [2024-11-28 19:16:05.770855] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.804 [2024-11-28 19:16:05.770876] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.804 [2024-11-28 19:16:05.770890] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.804 [2024-11-28 19:16:05.773127] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.804 [2024-11-28 19:16:05.782281] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.804 [2024-11-28 19:16:05.782591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.804 [2024-11-28 19:16:05.782715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.804 [2024-11-28 19:16:05.782741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.804 [2024-11-28 19:16:05.782757] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.804 [2024-11-28 19:16:05.782906] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.804 [2024-11-28 19:16:05.783103] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.804 [2024-11-28 19:16:05.783124] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.804 [2024-11-28 19:16:05.783137] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.804 [2024-11-28 19:16:05.785212] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.804 [2024-11-28 19:16:05.794481] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.804 [2024-11-28 19:16:05.794718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.804 [2024-11-28 19:16:05.794833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.804 [2024-11-28 19:16:05.794859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.804 [2024-11-28 19:16:05.794875] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.804 [2024-11-28 19:16:05.795039] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.804 [2024-11-28 19:16:05.795236] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.804 [2024-11-28 19:16:05.795258] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.804 [2024-11-28 19:16:05.795271] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.804 [2024-11-28 19:16:05.797372] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.804 [2024-11-28 19:16:05.806610] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.804 [2024-11-28 19:16:05.806859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.804 [2024-11-28 19:16:05.806975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.804 [2024-11-28 19:16:05.807000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.804 [2024-11-28 19:16:05.807017] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.804 [2024-11-28 19:16:05.807182] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.804 [2024-11-28 19:16:05.807363] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.804 [2024-11-28 19:16:05.807384] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.804 [2024-11-28 19:16:05.807423] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.804 [2024-11-28 19:16:05.809635] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.804 [2024-11-28 19:16:05.818859] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.804 [2024-11-28 19:16:05.819195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.804 [2024-11-28 19:16:05.819311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.804 [2024-11-28 19:16:05.819337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.804 [2024-11-28 19:16:05.819354] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.804 [2024-11-28 19:16:05.819528] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.804 [2024-11-28 19:16:05.819725] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.804 [2024-11-28 19:16:05.819746] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.804 [2024-11-28 19:16:05.819760] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.804 [2024-11-28 19:16:05.821763] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.804 [2024-11-28 19:16:05.831185] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.804 [2024-11-28 19:16:05.831422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.804 [2024-11-28 19:16:05.831542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.804 [2024-11-28 19:16:05.831568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.804 [2024-11-28 19:16:05.831583] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.804 [2024-11-28 19:16:05.831716] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.804 [2024-11-28 19:16:05.831882] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.804 [2024-11-28 19:16:05.831903] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.804 [2024-11-28 19:16:05.831917] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.804 [2024-11-28 19:16:05.834101] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:44.804 [2024-11-28 19:16:05.843363] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:44.804 [2024-11-28 19:16:05.843718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.804 [2024-11-28 19:16:05.843840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:44.804 [2024-11-28 19:16:05.843866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:44.804 [2024-11-28 19:16:05.843881] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:44.804 [2024-11-28 19:16:05.844046] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:44.804 [2024-11-28 19:16:05.844196] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:44.804 [2024-11-28 19:16:05.844216] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:44.804 [2024-11-28 19:16:05.844230] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:44.804 [2024-11-28 19:16:05.846459] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:45.064 [2024-11-28 19:16:05.855655] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:45.064 [2024-11-28 19:16:05.855985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.064 [2024-11-28 19:16:05.856128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.064 [2024-11-28 19:16:05.856153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:45.064 [2024-11-28 19:16:05.856169] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:45.064 [2024-11-28 19:16:05.856284] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:45.064 [2024-11-28 19:16:05.856430] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:45.064 [2024-11-28 19:16:05.856455] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:45.064 [2024-11-28 19:16:05.856468] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:45.064 [2024-11-28 19:16:05.858559] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:45.064 [2024-11-28 19:16:05.867928] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:45.064 [2024-11-28 19:16:05.868189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.064 [2024-11-28 19:16:05.868334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.064 [2024-11-28 19:16:05.868360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:45.064 [2024-11-28 19:16:05.868376] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:45.065 [2024-11-28 19:16:05.868555] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:45.065 [2024-11-28 19:16:05.868755] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:45.065 [2024-11-28 19:16:05.868776] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:45.065 [2024-11-28 19:16:05.868789] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:45.065 [2024-11-28 19:16:05.870607] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:45.065 [2024-11-28 19:16:05.880248] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:45.065 [2024-11-28 19:16:05.880514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.065 [2024-11-28 19:16:05.880631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.065 [2024-11-28 19:16:05.880658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:45.065 [2024-11-28 19:16:05.880673] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:45.065 [2024-11-28 19:16:05.880822] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:45.065 [2024-11-28 19:16:05.880923] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:45.065 [2024-11-28 19:16:05.880943] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:45.065 [2024-11-28 19:16:05.880957] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:45.065 [2024-11-28 19:16:05.882978] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:45.065 [2024-11-28 19:16:05.892536] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:45.065 [2024-11-28 19:16:05.892852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.065 [2024-11-28 19:16:05.892970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.065 [2024-11-28 19:16:05.892996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:45.065 [2024-11-28 19:16:05.893011] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:45.065 [2024-11-28 19:16:05.893144] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:45.065 [2024-11-28 19:16:05.893294] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:45.065 [2024-11-28 19:16:05.893315] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:45.065 [2024-11-28 19:16:05.893329] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:45.065 [2024-11-28 19:16:05.895291] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:45.065 [2024-11-28 19:16:05.904553] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:45.065 [2024-11-28 19:16:05.904830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.065 [2024-11-28 19:16:05.904943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.065 [2024-11-28 19:16:05.904969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:45.065 [2024-11-28 19:16:05.904985] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:45.065 [2024-11-28 19:16:05.905133] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:45.065 [2024-11-28 19:16:05.905299] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:45.065 [2024-11-28 19:16:05.905320] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:45.065 [2024-11-28 19:16:05.905333] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:45.065 [2024-11-28 19:16:05.907484] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:45.065 [2024-11-28 19:16:05.916820] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:45.065 [2024-11-28 19:16:05.917150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.065 [2024-11-28 19:16:05.917235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.065 [2024-11-28 19:16:05.917262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:45.065 [2024-11-28 19:16:05.917283] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:45.065 [2024-11-28 19:16:05.917458] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:45.065 [2024-11-28 19:16:05.917639] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:45.065 [2024-11-28 19:16:05.917660] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:45.065 [2024-11-28 19:16:05.917673] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:45.065 [2024-11-28 19:16:05.919624] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:45.065 [2024-11-28 19:16:05.929205] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:45.065 [2024-11-28 19:16:05.929533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.065 [2024-11-28 19:16:05.929627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.065 [2024-11-28 19:16:05.929654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:45.065 [2024-11-28 19:16:05.929670] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:45.065 [2024-11-28 19:16:05.929851] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:45.065 [2024-11-28 19:16:05.930033] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:45.065 [2024-11-28 19:16:05.930053] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:45.065 [2024-11-28 19:16:05.930066] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:45.065 [2024-11-28 19:16:05.932296] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:45.065 [2024-11-28 19:16:05.941705] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:45.065 [2024-11-28 19:16:05.941975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.065 [2024-11-28 19:16:05.942067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.065 [2024-11-28 19:16:05.942093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:45.065 [2024-11-28 19:16:05.942110] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:45.065 [2024-11-28 19:16:05.942225] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:45.065 [2024-11-28 19:16:05.942360] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:45.065 [2024-11-28 19:16:05.942381] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:45.065 [2024-11-28 19:16:05.942402] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:45.065 [2024-11-28 19:16:05.944428] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:45.065 [2024-11-28 19:16:05.954129] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:45.065 [2024-11-28 19:16:05.954414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.065 [2024-11-28 19:16:05.954537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.065 [2024-11-28 19:16:05.954563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:45.065 [2024-11-28 19:16:05.954584] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:45.065 [2024-11-28 19:16:05.954717] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:45.065 [2024-11-28 19:16:05.954852] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:45.065 [2024-11-28 19:16:05.954872] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:45.065 [2024-11-28 19:16:05.954886] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:45.065 [2024-11-28 19:16:05.956871] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:45.065 [2024-11-28 19:16:05.966453] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:45.065 [2024-11-28 19:16:05.966734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.065 [2024-11-28 19:16:05.966852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.065 [2024-11-28 19:16:05.966878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:45.065 [2024-11-28 19:16:05.966894] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:45.065 [2024-11-28 19:16:05.967042] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:45.065 [2024-11-28 19:16:05.967163] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:45.065 [2024-11-28 19:16:05.967184] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:45.065 [2024-11-28 19:16:05.967198] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:45.065 [2024-11-28 19:16:05.969228] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:45.065 [2024-11-28 19:16:05.978770] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:45.065 [2024-11-28 19:16:05.979013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.065 [2024-11-28 19:16:05.979100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.065 [2024-11-28 19:16:05.979126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:45.065 [2024-11-28 19:16:05.979141] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:45.065 [2024-11-28 19:16:05.979290] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:45.065 [2024-11-28 19:16:05.979451] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:45.065 [2024-11-28 19:16:05.979473] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:45.065 [2024-11-28 19:16:05.979486] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:45.066 19:16:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:45.066 19:16:05 -- common/autotest_common.sh@862 -- # return 0 00:27:45.066 19:16:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:45.066 19:16:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:45.066 19:16:05 -- common/autotest_common.sh@10 -- # set +x 00:27:45.066 [2024-11-28 19:16:05.981740] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:45.066 [2024-11-28 19:16:05.991200] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:45.066 [2024-11-28 19:16:05.991504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.066 [2024-11-28 19:16:05.991600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.066 [2024-11-28 19:16:05.991631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:45.066 [2024-11-28 19:16:05.991647] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:45.066 [2024-11-28 19:16:05.991795] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:45.066 [2024-11-28 19:16:05.991991] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:45.066 [2024-11-28 19:16:05.992012] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:45.066 [2024-11-28 19:16:05.992025] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:45.066 [2024-11-28 19:16:05.994358] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:45.066 [2024-11-28 19:16:06.003702] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:45.066 [2024-11-28 19:16:06.004014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.066 [2024-11-28 19:16:06.004132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.066 [2024-11-28 19:16:06.004160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:45.066 [2024-11-28 19:16:06.004176] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:45.066 [2024-11-28 19:16:06.004324] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:45.066 [2024-11-28 19:16:06.004470] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:45.066 [2024-11-28 19:16:06.004492] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:45.066 [2024-11-28 19:16:06.004506] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:45.066 19:16:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:45.066 19:16:06 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:27:45.066 19:16:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:45.066 19:16:06 -- common/autotest_common.sh@10 -- # set +x 00:27:45.066 [2024-11-28 19:16:06.006757] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:45.066 [2024-11-28 19:16:06.011388] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:45.066 [2024-11-28 19:16:06.015969] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:45.066 [2024-11-28 19:16:06.016286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.066 [2024-11-28 19:16:06.016383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.066 [2024-11-28 19:16:06.016418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:45.066 [2024-11-28 19:16:06.016434] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:45.066 [2024-11-28 19:16:06.016599] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:45.066 [2024-11-28 19:16:06.016801] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:45.066 [2024-11-28 19:16:06.016822] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:45.066 [2024-11-28 19:16:06.016836] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:45.066 19:16:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:45.066 19:16:06 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:45.066 19:16:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:45.066 19:16:06 -- common/autotest_common.sh@10 -- # set +x 00:27:45.066 [2024-11-28 19:16:06.018992] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:45.066 [2024-11-28 19:16:06.028213] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:45.066 [2024-11-28 19:16:06.028556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.066 [2024-11-28 19:16:06.028662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.066 [2024-11-28 19:16:06.028688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:45.066 [2024-11-28 19:16:06.028705] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:45.066 [2024-11-28 19:16:06.028838] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:45.066 [2024-11-28 19:16:06.029005] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:45.066 [2024-11-28 19:16:06.029026] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:45.066 [2024-11-28 19:16:06.029039] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:45.066 [2024-11-28 19:16:06.031186] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:45.066 [2024-11-28 19:16:06.040523] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:45.066 [2024-11-28 19:16:06.040879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.066 [2024-11-28 19:16:06.040968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.066 [2024-11-28 19:16:06.040994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:45.066 [2024-11-28 19:16:06.041011] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:45.066 [2024-11-28 19:16:06.041178] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:45.066 [2024-11-28 19:16:06.041391] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:45.066 [2024-11-28 19:16:06.041423] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:45.066 [2024-11-28 19:16:06.041439] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:45.066 [2024-11-28 19:16:06.043359] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:45.066 [2024-11-28 19:16:06.052948] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:45.066 [2024-11-28 19:16:06.053346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.066 [2024-11-28 19:16:06.053516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.066 [2024-11-28 19:16:06.053543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:45.066 [2024-11-28 19:16:06.053562] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:45.066 [2024-11-28 19:16:06.053720] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:45.066 [2024-11-28 19:16:06.053890] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:45.066 [2024-11-28 19:16:06.053911] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:45.066 [2024-11-28 19:16:06.053927] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:45.066 Malloc0 00:27:45.066 19:16:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:45.066 19:16:06 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:45.066 19:16:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:45.066 19:16:06 -- common/autotest_common.sh@10 -- # set +x 00:27:45.066 [2024-11-28 19:16:06.056166] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:45.066 19:16:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:45.066 19:16:06 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:45.066 19:16:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:45.066 19:16:06 -- common/autotest_common.sh@10 -- # set +x 00:27:45.066 [2024-11-28 19:16:06.065390] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:45.066 [2024-11-28 19:16:06.065671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.066 [2024-11-28 19:16:06.065771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:45.066 [2024-11-28 19:16:06.065797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x11b9160 with addr=10.0.0.2, port=4420 00:27:45.066 [2024-11-28 19:16:06.065813] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11b9160 is same with the state(5) to be set 00:27:45.066 [2024-11-28 19:16:06.065962] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x11b9160 (9): Bad file descriptor 00:27:45.066 [2024-11-28 19:16:06.066128] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:27:45.066 [2024-11-28 19:16:06.066149] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:27:45.066 [2024-11-28 19:16:06.066162] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:45.066 [2024-11-28 19:16:06.068301] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:27:45.066 19:16:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:45.066 19:16:06 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:45.066 19:16:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:45.066 19:16:06 -- common/autotest_common.sh@10 -- # set +x 00:27:45.066 [2024-11-28 19:16:06.074828] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:45.066 [2024-11-28 19:16:06.077512] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:45.066 19:16:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:45.066 19:16:06 -- host/bdevperf.sh@38 -- # wait 324159 00:27:45.324 [2024-11-28 19:16:06.229786] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:27:53.439 00:27:53.439 Latency(us) 00:27:53.439 [2024-11-28T18:16:14.487Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:53.439 [2024-11-28T18:16:14.487Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:53.439 Verification LBA range: start 0x0 length 0x4000 00:27:53.439 Nvme1n1 : 15.01 8817.59 34.44 16343.49 0.00 5072.49 782.79 20777.34 00:27:53.439 [2024-11-28T18:16:14.487Z] =================================================================================================================== 00:27:53.439 [2024-11-28T18:16:14.487Z] Total : 8817.59 34.44 16343.49 0.00 5072.49 782.79 20777.34 00:27:53.697 19:16:14 -- host/bdevperf.sh@39 -- # sync 00:27:53.697 19:16:14 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:53.697 19:16:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:53.697 19:16:14 -- common/autotest_common.sh@10 -- # set +x 00:27:53.697 19:16:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:53.697 19:16:14 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:27:53.697 19:16:14 -- host/bdevperf.sh@44 -- # nvmftestfini 00:27:53.697 19:16:14 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:53.697 19:16:14 -- nvmf/common.sh@116 -- # sync 00:27:53.697 19:16:14 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:53.697 19:16:14 -- nvmf/common.sh@119 -- # set +e 00:27:53.697 19:16:14 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:53.697 19:16:14 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:53.697 rmmod nvme_tcp 00:27:53.697 rmmod nvme_fabrics 00:27:53.697 rmmod nvme_keyring 00:27:53.697 19:16:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:53.697 19:16:14 -- nvmf/common.sh@123 -- # set -e 00:27:53.697 19:16:14 -- nvmf/common.sh@124 -- # return 0 00:27:53.697 19:16:14 -- nvmf/common.sh@477 -- # '[' -n 324846 ']' 00:27:53.697 19:16:14 -- nvmf/common.sh@478 -- # killprocess 324846 00:27:53.697 19:16:14 -- common/autotest_common.sh@936 -- # '[' -z 324846 ']' 00:27:53.697 19:16:14 -- common/autotest_common.sh@940 -- # kill -0 324846 00:27:53.957 19:16:14 -- common/autotest_common.sh@941 -- # uname 00:27:53.957 19:16:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:53.957 19:16:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 324846 00:27:53.957 19:16:14 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:53.957 19:16:14 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:53.957 19:16:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 324846' 00:27:53.957 killing process with pid 324846 00:27:53.957 19:16:14 -- common/autotest_common.sh@955 -- # kill 324846 00:27:53.957 19:16:14 -- common/autotest_common.sh@960 -- # wait 324846 00:27:54.216 19:16:15 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:54.216 19:16:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:54.216 19:16:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:54.216 19:16:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:54.216 19:16:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:54.216 19:16:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:54.216 19:16:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:54.216 19:16:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:56.119 19:16:17 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:56.119 00:27:56.119 real 0m23.283s 00:27:56.119 user 1m1.639s 00:27:56.119 sys 0m4.538s 00:27:56.119 19:16:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:56.119 19:16:17 -- common/autotest_common.sh@10 -- # set +x 00:27:56.119 ************************************ 00:27:56.119 END TEST nvmf_bdevperf 00:27:56.119 ************************************ 00:27:56.119 19:16:17 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:56.119 19:16:17 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:56.119 19:16:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:56.119 19:16:17 -- common/autotest_common.sh@10 -- # set +x 00:27:56.119 ************************************ 00:27:56.119 START TEST nvmf_target_disconnect 00:27:56.119 ************************************ 00:27:56.119 19:16:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:27:56.378 * Looking for test storage... 00:27:56.378 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:56.378 19:16:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:56.378 19:16:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:56.378 19:16:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:56.378 19:16:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:56.378 19:16:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:56.378 19:16:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:56.378 19:16:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:56.378 19:16:17 -- scripts/common.sh@335 -- # IFS=.-: 00:27:56.378 19:16:17 -- scripts/common.sh@335 -- # read -ra ver1 00:27:56.378 19:16:17 -- scripts/common.sh@336 -- # IFS=.-: 00:27:56.378 19:16:17 -- scripts/common.sh@336 -- # read -ra ver2 00:27:56.378 19:16:17 -- scripts/common.sh@337 -- # local 'op=<' 00:27:56.378 19:16:17 -- scripts/common.sh@339 -- # ver1_l=2 00:27:56.378 19:16:17 -- scripts/common.sh@340 -- # ver2_l=1 00:27:56.378 19:16:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:56.378 19:16:17 -- scripts/common.sh@343 -- # case "$op" in 00:27:56.378 19:16:17 -- scripts/common.sh@344 -- # : 1 00:27:56.378 19:16:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:56.378 19:16:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:56.378 19:16:17 -- scripts/common.sh@364 -- # decimal 1 00:27:56.378 19:16:17 -- scripts/common.sh@352 -- # local d=1 00:27:56.378 19:16:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:56.378 19:16:17 -- scripts/common.sh@354 -- # echo 1 00:27:56.378 19:16:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:56.378 19:16:17 -- scripts/common.sh@365 -- # decimal 2 00:27:56.378 19:16:17 -- scripts/common.sh@352 -- # local d=2 00:27:56.378 19:16:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:56.378 19:16:17 -- scripts/common.sh@354 -- # echo 2 00:27:56.378 19:16:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:56.378 19:16:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:56.378 19:16:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:56.378 19:16:17 -- scripts/common.sh@367 -- # return 0 00:27:56.378 19:16:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:56.378 19:16:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:56.378 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:56.378 --rc genhtml_branch_coverage=1 00:27:56.378 --rc genhtml_function_coverage=1 00:27:56.378 --rc genhtml_legend=1 00:27:56.378 --rc geninfo_all_blocks=1 00:27:56.378 --rc geninfo_unexecuted_blocks=1 00:27:56.378 00:27:56.378 ' 00:27:56.378 19:16:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:56.378 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:56.378 --rc genhtml_branch_coverage=1 00:27:56.378 --rc genhtml_function_coverage=1 00:27:56.378 --rc genhtml_legend=1 00:27:56.378 --rc geninfo_all_blocks=1 00:27:56.378 --rc geninfo_unexecuted_blocks=1 00:27:56.378 00:27:56.378 ' 00:27:56.378 19:16:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:56.378 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:56.378 --rc genhtml_branch_coverage=1 00:27:56.378 --rc genhtml_function_coverage=1 00:27:56.378 --rc genhtml_legend=1 00:27:56.378 --rc geninfo_all_blocks=1 00:27:56.378 --rc geninfo_unexecuted_blocks=1 00:27:56.378 00:27:56.378 ' 00:27:56.378 19:16:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:56.378 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:56.378 --rc genhtml_branch_coverage=1 00:27:56.378 --rc genhtml_function_coverage=1 00:27:56.378 --rc genhtml_legend=1 00:27:56.378 --rc geninfo_all_blocks=1 00:27:56.378 --rc geninfo_unexecuted_blocks=1 00:27:56.378 00:27:56.378 ' 00:27:56.378 19:16:17 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:56.378 19:16:17 -- nvmf/common.sh@7 -- # uname -s 00:27:56.378 19:16:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:56.378 19:16:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:56.378 19:16:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:56.378 19:16:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:56.378 19:16:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:56.378 19:16:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:56.378 19:16:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:56.378 19:16:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:56.378 19:16:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:56.378 19:16:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:56.378 19:16:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:56.378 19:16:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:56.378 19:16:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:56.378 19:16:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:56.378 19:16:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:56.378 19:16:17 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:56.378 19:16:17 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:56.378 19:16:17 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:56.378 19:16:17 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:56.378 19:16:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:56.378 19:16:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:56.378 19:16:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:56.378 19:16:17 -- paths/export.sh@5 -- # export PATH 00:27:56.379 19:16:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:56.379 19:16:17 -- nvmf/common.sh@46 -- # : 0 00:27:56.379 19:16:17 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:56.379 19:16:17 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:56.379 19:16:17 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:56.379 19:16:17 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:56.379 19:16:17 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:56.379 19:16:17 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:56.379 19:16:17 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:56.379 19:16:17 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:56.379 19:16:17 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:27:56.379 19:16:17 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:27:56.379 19:16:17 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:27:56.379 19:16:17 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:27:56.379 19:16:17 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:56.379 19:16:17 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:56.379 19:16:17 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:56.379 19:16:17 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:56.379 19:16:17 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:56.379 19:16:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:56.379 19:16:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:56.379 19:16:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:56.379 19:16:17 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:56.379 19:16:17 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:56.379 19:16:17 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:56.379 19:16:17 -- common/autotest_common.sh@10 -- # set +x 00:27:58.913 19:16:19 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:58.913 19:16:19 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:58.913 19:16:19 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:58.913 19:16:19 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:58.913 19:16:19 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:58.913 19:16:19 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:58.913 19:16:19 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:58.913 19:16:19 -- nvmf/common.sh@294 -- # net_devs=() 00:27:58.913 19:16:19 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:58.913 19:16:19 -- nvmf/common.sh@295 -- # e810=() 00:27:58.913 19:16:19 -- nvmf/common.sh@295 -- # local -ga e810 00:27:58.913 19:16:19 -- nvmf/common.sh@296 -- # x722=() 00:27:58.913 19:16:19 -- nvmf/common.sh@296 -- # local -ga x722 00:27:58.913 19:16:19 -- nvmf/common.sh@297 -- # mlx=() 00:27:58.913 19:16:19 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:58.913 19:16:19 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:58.913 19:16:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:58.913 19:16:19 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:58.913 19:16:19 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:58.913 19:16:19 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:58.913 19:16:19 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:58.913 19:16:19 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:58.913 19:16:19 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:58.913 19:16:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:58.913 19:16:19 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:58.913 19:16:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:58.913 19:16:19 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:58.913 19:16:19 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:58.913 19:16:19 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:58.913 19:16:19 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:58.913 19:16:19 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:58.913 19:16:19 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:58.913 19:16:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:58.914 19:16:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:58.914 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:58.914 19:16:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:58.914 19:16:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:58.914 19:16:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:58.914 19:16:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:58.914 19:16:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:58.914 19:16:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:58.914 19:16:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:58.914 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:58.914 19:16:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:58.914 19:16:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:58.914 19:16:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:58.914 19:16:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:58.914 19:16:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:58.914 19:16:19 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:58.914 19:16:19 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:58.914 19:16:19 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:58.914 19:16:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:58.914 19:16:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:58.914 19:16:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:58.914 19:16:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:58.914 19:16:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:58.914 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:58.914 19:16:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:58.914 19:16:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:58.914 19:16:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:58.914 19:16:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:58.914 19:16:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:58.914 19:16:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:58.914 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:58.914 19:16:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:58.914 19:16:19 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:58.914 19:16:19 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:58.914 19:16:19 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:58.914 19:16:19 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:58.914 19:16:19 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:58.914 19:16:19 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:58.914 19:16:19 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:58.914 19:16:19 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:58.914 19:16:19 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:58.914 19:16:19 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:58.914 19:16:19 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:58.914 19:16:19 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:58.914 19:16:19 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:58.914 19:16:19 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:58.914 19:16:19 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:58.914 19:16:19 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:58.914 19:16:19 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:58.914 19:16:19 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:58.914 19:16:19 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:58.914 19:16:19 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:58.914 19:16:19 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:58.914 19:16:19 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:58.914 19:16:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:58.914 19:16:19 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:58.914 19:16:19 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:58.914 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:58.914 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.201 ms 00:27:58.914 00:27:58.914 --- 10.0.0.2 ping statistics --- 00:27:58.914 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:58.914 rtt min/avg/max/mdev = 0.201/0.201/0.201/0.000 ms 00:27:58.914 19:16:19 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:58.914 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:58.914 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.078 ms 00:27:58.914 00:27:58.914 --- 10.0.0.1 ping statistics --- 00:27:58.914 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:58.914 rtt min/avg/max/mdev = 0.078/0.078/0.078/0.000 ms 00:27:58.914 19:16:19 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:58.914 19:16:19 -- nvmf/common.sh@410 -- # return 0 00:27:58.914 19:16:19 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:58.914 19:16:19 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:58.914 19:16:19 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:58.914 19:16:19 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:58.914 19:16:19 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:58.914 19:16:19 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:58.914 19:16:19 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:58.914 19:16:19 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:27:58.914 19:16:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:58.914 19:16:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:58.914 19:16:19 -- common/autotest_common.sh@10 -- # set +x 00:27:58.914 ************************************ 00:27:58.914 START TEST nvmf_target_disconnect_tc1 00:27:58.914 ************************************ 00:27:58.914 19:16:19 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc1 00:27:58.914 19:16:19 -- host/target_disconnect.sh@32 -- # set +e 00:27:58.914 19:16:19 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:58.914 EAL: No free 2048 kB hugepages reported on node 1 00:27:58.914 [2024-11-28 19:16:19.682464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-28 19:16:19.682648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:27:58.914 [2024-11-28 19:16:19.682676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1951b40 with addr=10.0.0.2, port=4420 00:27:58.914 [2024-11-28 19:16:19.682706] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:27:58.914 [2024-11-28 19:16:19.682725] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:27:58.914 [2024-11-28 19:16:19.682739] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:27:58.914 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:27:58.914 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:27:58.914 Initializing NVMe Controllers 00:27:58.914 19:16:19 -- host/target_disconnect.sh@33 -- # trap - ERR 00:27:58.914 19:16:19 -- host/target_disconnect.sh@33 -- # print_backtrace 00:27:58.914 19:16:19 -- common/autotest_common.sh@1142 -- # [[ hxBET =~ e ]] 00:27:58.914 19:16:19 -- common/autotest_common.sh@1142 -- # return 0 00:27:58.914 19:16:19 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:27:58.914 19:16:19 -- host/target_disconnect.sh@41 -- # set -e 00:27:58.914 00:27:58.914 real 0m0.092s 00:27:58.914 user 0m0.040s 00:27:58.914 sys 0m0.051s 00:27:58.914 19:16:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:58.914 19:16:19 -- common/autotest_common.sh@10 -- # set +x 00:27:58.914 ************************************ 00:27:58.914 END TEST nvmf_target_disconnect_tc1 00:27:58.914 ************************************ 00:27:58.914 19:16:19 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:27:58.914 19:16:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:27:58.914 19:16:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:58.914 19:16:19 -- common/autotest_common.sh@10 -- # set +x 00:27:58.914 ************************************ 00:27:58.914 START TEST nvmf_target_disconnect_tc2 00:27:58.914 ************************************ 00:27:58.914 19:16:19 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc2 00:27:58.914 19:16:19 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:27:58.914 19:16:19 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:27:58.914 19:16:19 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:58.914 19:16:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:58.914 19:16:19 -- common/autotest_common.sh@10 -- # set +x 00:27:58.914 19:16:19 -- nvmf/common.sh@469 -- # nvmfpid=328045 00:27:58.914 19:16:19 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:27:58.914 19:16:19 -- nvmf/common.sh@470 -- # waitforlisten 328045 00:27:58.914 19:16:19 -- common/autotest_common.sh@829 -- # '[' -z 328045 ']' 00:27:58.914 19:16:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:58.914 19:16:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:58.914 19:16:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:58.914 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:58.914 19:16:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:58.914 19:16:19 -- common/autotest_common.sh@10 -- # set +x 00:27:58.914 [2024-11-28 19:16:19.769572] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:58.914 [2024-11-28 19:16:19.769642] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:58.914 EAL: No free 2048 kB hugepages reported on node 1 00:27:58.914 [2024-11-28 19:16:19.832296] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:58.914 [2024-11-28 19:16:19.943438] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:58.914 [2024-11-28 19:16:19.943590] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:58.914 [2024-11-28 19:16:19.943608] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:58.914 [2024-11-28 19:16:19.943620] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:58.914 [2024-11-28 19:16:19.943729] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:27:58.914 [2024-11-28 19:16:19.943794] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:27:58.914 [2024-11-28 19:16:19.943833] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:27:58.914 [2024-11-28 19:16:19.943836] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:27:59.851 19:16:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:59.851 19:16:20 -- common/autotest_common.sh@862 -- # return 0 00:27:59.851 19:16:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:59.851 19:16:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:59.851 19:16:20 -- common/autotest_common.sh@10 -- # set +x 00:27:59.851 19:16:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:59.851 19:16:20 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:27:59.851 19:16:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:59.851 19:16:20 -- common/autotest_common.sh@10 -- # set +x 00:27:59.851 Malloc0 00:27:59.851 19:16:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:59.851 19:16:20 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:27:59.851 19:16:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:59.851 19:16:20 -- common/autotest_common.sh@10 -- # set +x 00:27:59.851 [2024-11-28 19:16:20.800103] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:59.851 19:16:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:59.851 19:16:20 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:59.851 19:16:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:59.851 19:16:20 -- common/autotest_common.sh@10 -- # set +x 00:27:59.851 19:16:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:59.851 19:16:20 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:59.851 19:16:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:59.851 19:16:20 -- common/autotest_common.sh@10 -- # set +x 00:27:59.851 19:16:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:59.851 19:16:20 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:59.851 19:16:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:59.851 19:16:20 -- common/autotest_common.sh@10 -- # set +x 00:27:59.851 [2024-11-28 19:16:20.828386] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:59.851 19:16:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:59.851 19:16:20 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:59.851 19:16:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:27:59.851 19:16:20 -- common/autotest_common.sh@10 -- # set +x 00:27:59.851 19:16:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:27:59.851 19:16:20 -- host/target_disconnect.sh@50 -- # reconnectpid=328199 00:27:59.851 19:16:20 -- host/target_disconnect.sh@52 -- # sleep 2 00:27:59.851 19:16:20 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:59.851 EAL: No free 2048 kB hugepages reported on node 1 00:28:02.411 19:16:22 -- host/target_disconnect.sh@53 -- # kill -9 328045 00:28:02.412 19:16:22 -- host/target_disconnect.sh@55 -- # sleep 2 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Write completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Write completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Write completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Write completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Write completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Write completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Write completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Write completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 [2024-11-28 19:16:22.853376] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Write completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Write completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Write completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Write completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Write completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Write completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Write completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Write completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 [2024-11-28 19:16:22.853703] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Write completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Read completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.412 Write completed with error (sct=0, sc=8) 00:28:02.412 starting I/O failed 00:28:02.413 Read completed with error (sct=0, sc=8) 00:28:02.413 starting I/O failed 00:28:02.413 Read completed with error (sct=0, sc=8) 00:28:02.413 starting I/O failed 00:28:02.413 Write completed with error (sct=0, sc=8) 00:28:02.413 starting I/O failed 00:28:02.413 Read completed with error (sct=0, sc=8) 00:28:02.413 starting I/O failed 00:28:02.413 Write completed with error (sct=0, sc=8) 00:28:02.413 starting I/O failed 00:28:02.413 Read completed with error (sct=0, sc=8) 00:28:02.413 starting I/O failed 00:28:02.413 Read completed with error (sct=0, sc=8) 00:28:02.413 starting I/O failed 00:28:02.413 Write completed with error (sct=0, sc=8) 00:28:02.413 starting I/O failed 00:28:02.413 Read completed with error (sct=0, sc=8) 00:28:02.413 starting I/O failed 00:28:02.413 Read completed with error (sct=0, sc=8) 00:28:02.413 starting I/O failed 00:28:02.413 Write completed with error (sct=0, sc=8) 00:28:02.413 starting I/O failed 00:28:02.413 Write completed with error (sct=0, sc=8) 00:28:02.413 starting I/O failed 00:28:02.413 Write completed with error (sct=0, sc=8) 00:28:02.413 starting I/O failed 00:28:02.413 Write completed with error (sct=0, sc=8) 00:28:02.413 starting I/O failed 00:28:02.413 Write completed with error (sct=0, sc=8) 00:28:02.413 starting I/O failed 00:28:02.413 Read completed with error (sct=0, sc=8) 00:28:02.413 starting I/O failed 00:28:02.413 [2024-11-28 19:16:22.854023] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:28:02.413 [2024-11-28 19:16:22.854214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.413 [2024-11-28 19:16:22.854355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.413 [2024-11-28 19:16:22.854389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.413 qpair failed and we were unable to recover it. 00:28:02.413 [2024-11-28 19:16:22.854505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.413 [2024-11-28 19:16:22.854600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.413 [2024-11-28 19:16:22.854626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.413 qpair failed and we were unable to recover it. 00:28:02.413 [2024-11-28 19:16:22.854763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.413 [2024-11-28 19:16:22.854872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.413 [2024-11-28 19:16:22.854898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.413 qpair failed and we were unable to recover it. 00:28:02.413 [2024-11-28 19:16:22.854994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.413 [2024-11-28 19:16:22.855136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.413 [2024-11-28 19:16:22.855162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.413 qpair failed and we were unable to recover it. 00:28:02.413 [2024-11-28 19:16:22.855283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.413 [2024-11-28 19:16:22.855428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.413 [2024-11-28 19:16:22.855455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.413 qpair failed and we were unable to recover it. 00:28:02.413 [2024-11-28 19:16:22.855573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.413 [2024-11-28 19:16:22.855662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.413 [2024-11-28 19:16:22.855687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.413 qpair failed and we were unable to recover it. 00:28:02.413 [2024-11-28 19:16:22.855807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.413 [2024-11-28 19:16:22.855924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.413 [2024-11-28 19:16:22.855950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.413 qpair failed and we were unable to recover it. 00:28:02.413 [2024-11-28 19:16:22.856095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.413 [2024-11-28 19:16:22.856240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.413 [2024-11-28 19:16:22.856266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.413 qpair failed and we were unable to recover it. 00:28:02.413 [2024-11-28 19:16:22.856386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.413 [2024-11-28 19:16:22.856508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.413 [2024-11-28 19:16:22.856534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.413 qpair failed and we were unable to recover it. 00:28:02.413 [2024-11-28 19:16:22.856626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.413 [2024-11-28 19:16:22.856719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.413 [2024-11-28 19:16:22.856745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.413 qpair failed and we were unable to recover it. 00:28:02.413 [2024-11-28 19:16:22.856892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.413 [2024-11-28 19:16:22.857002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.413 [2024-11-28 19:16:22.857034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.413 qpair failed and we were unable to recover it. 00:28:02.413 [2024-11-28 19:16:22.857128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.413 [2024-11-28 19:16:22.857313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.413 [2024-11-28 19:16:22.857339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.413 qpair failed and we were unable to recover it. 00:28:02.413 [2024-11-28 19:16:22.857453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.413 [2024-11-28 19:16:22.857546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.413 [2024-11-28 19:16:22.857572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.413 qpair failed and we were unable to recover it. 00:28:02.413 [2024-11-28 19:16:22.857651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.413 [2024-11-28 19:16:22.857759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.413 [2024-11-28 19:16:22.857785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.413 qpair failed and we were unable to recover it. 00:28:02.413 [2024-11-28 19:16:22.857899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.413 [2024-11-28 19:16:22.858007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.413 [2024-11-28 19:16:22.858033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.413 qpair failed and we were unable to recover it. 00:28:02.413 [2024-11-28 19:16:22.858126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.413 [2024-11-28 19:16:22.858243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.413 [2024-11-28 19:16:22.858268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.414 qpair failed and we were unable to recover it. 00:28:02.414 [2024-11-28 19:16:22.858380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.858504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.858529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.414 qpair failed and we were unable to recover it. 00:28:02.414 [2024-11-28 19:16:22.858616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.858731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.858756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.414 qpair failed and we were unable to recover it. 00:28:02.414 [2024-11-28 19:16:22.858898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.858983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.859008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.414 qpair failed and we were unable to recover it. 00:28:02.414 [2024-11-28 19:16:22.859099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.859206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.859232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.414 qpair failed and we were unable to recover it. 00:28:02.414 [2024-11-28 19:16:22.859314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.859433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.859468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.414 qpair failed and we were unable to recover it. 00:28:02.414 [2024-11-28 19:16:22.859592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.859679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.859705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.414 qpair failed and we were unable to recover it. 00:28:02.414 [2024-11-28 19:16:22.859853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.859965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.859991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.414 qpair failed and we were unable to recover it. 00:28:02.414 [2024-11-28 19:16:22.860107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.860192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.860217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.414 qpair failed and we were unable to recover it. 00:28:02.414 [2024-11-28 19:16:22.860329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.860471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.860497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.414 qpair failed and we were unable to recover it. 00:28:02.414 [2024-11-28 19:16:22.860589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.860669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.860694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.414 qpair failed and we were unable to recover it. 00:28:02.414 [2024-11-28 19:16:22.860779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.860894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.860921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.414 qpair failed and we were unable to recover it. 00:28:02.414 [2024-11-28 19:16:22.861059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.861167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.861192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.414 qpair failed and we were unable to recover it. 00:28:02.414 [2024-11-28 19:16:22.861335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.861448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.861474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.414 qpair failed and we were unable to recover it. 00:28:02.414 [2024-11-28 19:16:22.861592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.861738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.861763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.414 qpair failed and we were unable to recover it. 00:28:02.414 [2024-11-28 19:16:22.861850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.861961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.861986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.414 qpair failed and we were unable to recover it. 00:28:02.414 [2024-11-28 19:16:22.862103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.862215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.862241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.414 qpair failed and we were unable to recover it. 00:28:02.414 [2024-11-28 19:16:22.862370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.862512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.862542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.414 qpair failed and we were unable to recover it. 00:28:02.414 [2024-11-28 19:16:22.862637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.862782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.862808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.414 qpair failed and we were unable to recover it. 00:28:02.414 [2024-11-28 19:16:22.862893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.862979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.863004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.414 qpair failed and we were unable to recover it. 00:28:02.414 [2024-11-28 19:16:22.863087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.863196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.863221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.414 qpair failed and we were unable to recover it. 00:28:02.414 [2024-11-28 19:16:22.863308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.414 [2024-11-28 19:16:22.863420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.863447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.415 qpair failed and we were unable to recover it. 00:28:02.415 [2024-11-28 19:16:22.863528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.863619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.863644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.415 qpair failed and we were unable to recover it. 00:28:02.415 [2024-11-28 19:16:22.863752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.863884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.863911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.415 qpair failed and we were unable to recover it. 00:28:02.415 [2024-11-28 19:16:22.864051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.864188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.864214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.415 qpair failed and we were unable to recover it. 00:28:02.415 [2024-11-28 19:16:22.864330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.864406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.864432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.415 qpair failed and we were unable to recover it. 00:28:02.415 [2024-11-28 19:16:22.864519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.864634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.864661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.415 qpair failed and we were unable to recover it. 00:28:02.415 [2024-11-28 19:16:22.864751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.864859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.864884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.415 qpair failed and we were unable to recover it. 00:28:02.415 [2024-11-28 19:16:22.864969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.865075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.865100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.415 qpair failed and we were unable to recover it. 00:28:02.415 [2024-11-28 19:16:22.865194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.865282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.865309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.415 qpair failed and we were unable to recover it. 00:28:02.415 [2024-11-28 19:16:22.865387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.865480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.865506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.415 qpair failed and we were unable to recover it. 00:28:02.415 [2024-11-28 19:16:22.865616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.865729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.865755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.415 qpair failed and we were unable to recover it. 00:28:02.415 [2024-11-28 19:16:22.865842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.865928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.865954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.415 qpair failed and we were unable to recover it. 00:28:02.415 [2024-11-28 19:16:22.866143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.866257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.866283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.415 qpair failed and we were unable to recover it. 00:28:02.415 [2024-11-28 19:16:22.866406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.866491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.866516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.415 qpair failed and we were unable to recover it. 00:28:02.415 [2024-11-28 19:16:22.866604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.866724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.866749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.415 qpair failed and we were unable to recover it. 00:28:02.415 [2024-11-28 19:16:22.866844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.866971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.867012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.415 qpair failed and we were unable to recover it. 00:28:02.415 [2024-11-28 19:16:22.867189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.867297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.867322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.415 qpair failed and we were unable to recover it. 00:28:02.415 [2024-11-28 19:16:22.867413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.867501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.867527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.415 qpair failed and we were unable to recover it. 00:28:02.415 [2024-11-28 19:16:22.867641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.867722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.867747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.415 qpair failed and we were unable to recover it. 00:28:02.415 [2024-11-28 19:16:22.867859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.867945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.867970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.415 qpair failed and we were unable to recover it. 00:28:02.415 [2024-11-28 19:16:22.868078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.868162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.868186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.415 qpair failed and we were unable to recover it. 00:28:02.415 [2024-11-28 19:16:22.868300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.868457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.868483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.415 qpair failed and we were unable to recover it. 00:28:02.415 [2024-11-28 19:16:22.868581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.415 [2024-11-28 19:16:22.868661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.868704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.416 qpair failed and we were unable to recover it. 00:28:02.416 [2024-11-28 19:16:22.868829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.868961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.868988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.416 qpair failed and we were unable to recover it. 00:28:02.416 [2024-11-28 19:16:22.869114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.869269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.869294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.416 qpair failed and we were unable to recover it. 00:28:02.416 [2024-11-28 19:16:22.869379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.869488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.869513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.416 qpair failed and we were unable to recover it. 00:28:02.416 [2024-11-28 19:16:22.869651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.869731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.869756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.416 qpair failed and we were unable to recover it. 00:28:02.416 [2024-11-28 19:16:22.869870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.869973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.869998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.416 qpair failed and we were unable to recover it. 00:28:02.416 [2024-11-28 19:16:22.870105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.870211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.870236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.416 qpair failed and we were unable to recover it. 00:28:02.416 [2024-11-28 19:16:22.870328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.870456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.870482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.416 qpair failed and we were unable to recover it. 00:28:02.416 [2024-11-28 19:16:22.870556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.870664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.870690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.416 qpair failed and we were unable to recover it. 00:28:02.416 [2024-11-28 19:16:22.870773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.870916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.870941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.416 qpair failed and we were unable to recover it. 00:28:02.416 [2024-11-28 19:16:22.871027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.871111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.871136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.416 qpair failed and we were unable to recover it. 00:28:02.416 [2024-11-28 19:16:22.871267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.871402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.871429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.416 qpair failed and we were unable to recover it. 00:28:02.416 [2024-11-28 19:16:22.871535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.871624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.871648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.416 qpair failed and we were unable to recover it. 00:28:02.416 [2024-11-28 19:16:22.871797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.871882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.871910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.416 qpair failed and we were unable to recover it. 00:28:02.416 [2024-11-28 19:16:22.872020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.872099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.872125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.416 qpair failed and we were unable to recover it. 00:28:02.416 [2024-11-28 19:16:22.872209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.872322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.872348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.416 qpair failed and we were unable to recover it. 00:28:02.416 [2024-11-28 19:16:22.872468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.872584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.872609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.416 qpair failed and we were unable to recover it. 00:28:02.416 [2024-11-28 19:16:22.872753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.872836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.872861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.416 qpair failed and we were unable to recover it. 00:28:02.416 [2024-11-28 19:16:22.872970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.873047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.873072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.416 qpair failed and we were unable to recover it. 00:28:02.416 [2024-11-28 19:16:22.873163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.873275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.873300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.416 qpair failed and we were unable to recover it. 00:28:02.416 [2024-11-28 19:16:22.873439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.873579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.873604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.416 qpair failed and we were unable to recover it. 00:28:02.416 [2024-11-28 19:16:22.873688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.873770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.416 [2024-11-28 19:16:22.873794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.416 qpair failed and we were unable to recover it. 00:28:02.417 [2024-11-28 19:16:22.873890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.873985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.874015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.417 qpair failed and we were unable to recover it. 00:28:02.417 [2024-11-28 19:16:22.874112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.874246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.874275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.417 qpair failed and we were unable to recover it. 00:28:02.417 [2024-11-28 19:16:22.874356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.874478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.874504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.417 qpair failed and we were unable to recover it. 00:28:02.417 [2024-11-28 19:16:22.874615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.874690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.874714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.417 qpair failed and we were unable to recover it. 00:28:02.417 [2024-11-28 19:16:22.874847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.874976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.875004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.417 qpair failed and we were unable to recover it. 00:28:02.417 [2024-11-28 19:16:22.875103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.875227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.875268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.417 qpair failed and we were unable to recover it. 00:28:02.417 [2024-11-28 19:16:22.875352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.875464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.875489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.417 qpair failed and we were unable to recover it. 00:28:02.417 [2024-11-28 19:16:22.875602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.875724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.875748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.417 qpair failed and we were unable to recover it. 00:28:02.417 [2024-11-28 19:16:22.875835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.875922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.875949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.417 qpair failed and we were unable to recover it. 00:28:02.417 [2024-11-28 19:16:22.876036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.876115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.876140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.417 qpair failed and we were unable to recover it. 00:28:02.417 [2024-11-28 19:16:22.876283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.876409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.876449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.417 qpair failed and we were unable to recover it. 00:28:02.417 [2024-11-28 19:16:22.876565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.876689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.876714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.417 qpair failed and we were unable to recover it. 00:28:02.417 [2024-11-28 19:16:22.876833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.876912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.876938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.417 qpair failed and we were unable to recover it. 00:28:02.417 [2024-11-28 19:16:22.877056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.877195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.877220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.417 qpair failed and we were unable to recover it. 00:28:02.417 [2024-11-28 19:16:22.877326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.877455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.877484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.417 qpair failed and we were unable to recover it. 00:28:02.417 [2024-11-28 19:16:22.877617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.877724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.877750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.417 qpair failed and we were unable to recover it. 00:28:02.417 [2024-11-28 19:16:22.877837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.877947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.877972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.417 qpair failed and we were unable to recover it. 00:28:02.417 [2024-11-28 19:16:22.878102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.878255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.878280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.417 qpair failed and we were unable to recover it. 00:28:02.417 [2024-11-28 19:16:22.878401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.878478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.878503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.417 qpair failed and we were unable to recover it. 00:28:02.417 [2024-11-28 19:16:22.878583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.878669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.878694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.417 qpair failed and we were unable to recover it. 00:28:02.417 [2024-11-28 19:16:22.878807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.878900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.417 [2024-11-28 19:16:22.878925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.417 qpair failed and we were unable to recover it. 00:28:02.418 [2024-11-28 19:16:22.879028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.418 [2024-11-28 19:16:22.879151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.418 [2024-11-28 19:16:22.879175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.418 qpair failed and we were unable to recover it. 00:28:02.418 [2024-11-28 19:16:22.879294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.418 [2024-11-28 19:16:22.879372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.418 [2024-11-28 19:16:22.879402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.418 qpair failed and we were unable to recover it. 00:28:02.418 [2024-11-28 19:16:22.879558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.418 [2024-11-28 19:16:22.879680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.418 [2024-11-28 19:16:22.879706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.418 qpair failed and we were unable to recover it. 00:28:02.418 [2024-11-28 19:16:22.879846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.418 [2024-11-28 19:16:22.879982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.418 [2024-11-28 19:16:22.880007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.418 qpair failed and we were unable to recover it. 00:28:02.418 [2024-11-28 19:16:22.880135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.418 [2024-11-28 19:16:22.880234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.418 [2024-11-28 19:16:22.880262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.418 qpair failed and we were unable to recover it. 00:28:02.418 [2024-11-28 19:16:22.880348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.418 [2024-11-28 19:16:22.880508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.418 [2024-11-28 19:16:22.880549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.418 qpair failed and we were unable to recover it. 00:28:02.418 [2024-11-28 19:16:22.880698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.418 [2024-11-28 19:16:22.880817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.418 [2024-11-28 19:16:22.880841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.418 qpair failed and we were unable to recover it. 00:28:02.418 [2024-11-28 19:16:22.880956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.418 [2024-11-28 19:16:22.881094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.418 [2024-11-28 19:16:22.881119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.418 qpair failed and we were unable to recover it. 00:28:02.418 [2024-11-28 19:16:22.881262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.418 [2024-11-28 19:16:22.881369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.418 [2024-11-28 19:16:22.881400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.418 qpair failed and we were unable to recover it. 00:28:02.418 [2024-11-28 19:16:22.881482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.418 [2024-11-28 19:16:22.881556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.418 [2024-11-28 19:16:22.881581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.418 qpair failed and we were unable to recover it. 00:28:02.418 [2024-11-28 19:16:22.881661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.418 [2024-11-28 19:16:22.881785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.418 [2024-11-28 19:16:22.881812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.418 qpair failed and we were unable to recover it. 00:28:02.418 [2024-11-28 19:16:22.881935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.418 [2024-11-28 19:16:22.882070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.418 [2024-11-28 19:16:22.882096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.418 qpair failed and we were unable to recover it. 00:28:02.418 [2024-11-28 19:16:22.882181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.418 [2024-11-28 19:16:22.882285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.418 [2024-11-28 19:16:22.882311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.418 qpair failed and we were unable to recover it. 00:28:02.418 [2024-11-28 19:16:22.882432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.418 [2024-11-28 19:16:22.882582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.418 [2024-11-28 19:16:22.882607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.418 qpair failed and we were unable to recover it. 00:28:02.418 [2024-11-28 19:16:22.882726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.418 [2024-11-28 19:16:22.882835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.418 [2024-11-28 19:16:22.882860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.418 qpair failed and we were unable to recover it. 00:28:02.418 [2024-11-28 19:16:22.882943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.418 [2024-11-28 19:16:22.883055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.418 [2024-11-28 19:16:22.883080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.418 qpair failed and we were unable to recover it. 00:28:02.418 [2024-11-28 19:16:22.883175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.418 [2024-11-28 19:16:22.883336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.418 [2024-11-28 19:16:22.883364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.419 qpair failed and we were unable to recover it. 00:28:02.419 [2024-11-28 19:16:22.883495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.883617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.883658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.419 qpair failed and we were unable to recover it. 00:28:02.419 [2024-11-28 19:16:22.883767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.883852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.883878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.419 qpair failed and we were unable to recover it. 00:28:02.419 [2024-11-28 19:16:22.883961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.884085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.884110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.419 qpair failed and we were unable to recover it. 00:28:02.419 [2024-11-28 19:16:22.884222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.884359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.884385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.419 qpair failed and we were unable to recover it. 00:28:02.419 [2024-11-28 19:16:22.884504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.884603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.884628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.419 qpair failed and we were unable to recover it. 00:28:02.419 [2024-11-28 19:16:22.884743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.884845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.884869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.419 qpair failed and we were unable to recover it. 00:28:02.419 [2024-11-28 19:16:22.884952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.885033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.885059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.419 qpair failed and we were unable to recover it. 00:28:02.419 [2024-11-28 19:16:22.885177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.885284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.885309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.419 qpair failed and we were unable to recover it. 00:28:02.419 [2024-11-28 19:16:22.885407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.885533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.885561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.419 qpair failed and we were unable to recover it. 00:28:02.419 [2024-11-28 19:16:22.885695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.885778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.885803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.419 qpair failed and we were unable to recover it. 00:28:02.419 [2024-11-28 19:16:22.885923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.886030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.886055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.419 qpair failed and we were unable to recover it. 00:28:02.419 [2024-11-28 19:16:22.886163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.886325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.886350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.419 qpair failed and we were unable to recover it. 00:28:02.419 [2024-11-28 19:16:22.886498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.886625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.886653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.419 qpair failed and we were unable to recover it. 00:28:02.419 [2024-11-28 19:16:22.886809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.886919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.886944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.419 qpair failed and we were unable to recover it. 00:28:02.419 [2024-11-28 19:16:22.887076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.887201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.887246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.419 qpair failed and we were unable to recover it. 00:28:02.419 [2024-11-28 19:16:22.887360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.887467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.887495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.419 qpair failed and we were unable to recover it. 00:28:02.419 [2024-11-28 19:16:22.887590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.887727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.887752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.419 qpair failed and we were unable to recover it. 00:28:02.419 [2024-11-28 19:16:22.887879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.887959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.887984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.419 qpair failed and we were unable to recover it. 00:28:02.419 [2024-11-28 19:16:22.888069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.888175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.888199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.419 qpair failed and we were unable to recover it. 00:28:02.419 [2024-11-28 19:16:22.888286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.888402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.888428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.419 qpair failed and we were unable to recover it. 00:28:02.419 [2024-11-28 19:16:22.888523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.888636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.888661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.419 qpair failed and we were unable to recover it. 00:28:02.419 [2024-11-28 19:16:22.888778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.419 [2024-11-28 19:16:22.888904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.888931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.420 qpair failed and we were unable to recover it. 00:28:02.420 [2024-11-28 19:16:22.889039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.889177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.889202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.420 qpair failed and we were unable to recover it. 00:28:02.420 [2024-11-28 19:16:22.889320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.889427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.889452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.420 qpair failed and we were unable to recover it. 00:28:02.420 [2024-11-28 19:16:22.889613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.889735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.889776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.420 qpair failed and we were unable to recover it. 00:28:02.420 [2024-11-28 19:16:22.889903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.890038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.890063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.420 qpair failed and we were unable to recover it. 00:28:02.420 [2024-11-28 19:16:22.890144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.890274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.890302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.420 qpair failed and we were unable to recover it. 00:28:02.420 [2024-11-28 19:16:22.890417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.890530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.890555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.420 qpair failed and we were unable to recover it. 00:28:02.420 [2024-11-28 19:16:22.890668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.890810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.890835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.420 qpair failed and we were unable to recover it. 00:28:02.420 [2024-11-28 19:16:22.890951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.891039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.891064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.420 qpair failed and we were unable to recover it. 00:28:02.420 [2024-11-28 19:16:22.891181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.891258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.891282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.420 qpair failed and we were unable to recover it. 00:28:02.420 [2024-11-28 19:16:22.891404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.891513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.891538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.420 qpair failed and we were unable to recover it. 00:28:02.420 [2024-11-28 19:16:22.891619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.891698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.891722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.420 qpair failed and we were unable to recover it. 00:28:02.420 [2024-11-28 19:16:22.891800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.891903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.891928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.420 qpair failed and we were unable to recover it. 00:28:02.420 [2024-11-28 19:16:22.892018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.892136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.892161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.420 qpair failed and we were unable to recover it. 00:28:02.420 [2024-11-28 19:16:22.892249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.892335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.892360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.420 qpair failed and we were unable to recover it. 00:28:02.420 [2024-11-28 19:16:22.892464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.892603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.892627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.420 qpair failed and we were unable to recover it. 00:28:02.420 [2024-11-28 19:16:22.892712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.892822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.892846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.420 qpair failed and we were unable to recover it. 00:28:02.420 [2024-11-28 19:16:22.893006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.893139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.893164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.420 qpair failed and we were unable to recover it. 00:28:02.420 [2024-11-28 19:16:22.893241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.893367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.893398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.420 qpair failed and we were unable to recover it. 00:28:02.420 [2024-11-28 19:16:22.893528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.893643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.893668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.420 qpair failed and we were unable to recover it. 00:28:02.420 [2024-11-28 19:16:22.893796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.893893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.893920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.420 qpair failed and we were unable to recover it. 00:28:02.420 [2024-11-28 19:16:22.894060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.894167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.420 [2024-11-28 19:16:22.894192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.420 qpair failed and we were unable to recover it. 00:28:02.420 [2024-11-28 19:16:22.894340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.894482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.894507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.421 qpair failed and we were unable to recover it. 00:28:02.421 [2024-11-28 19:16:22.894594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.894748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.894775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.421 qpair failed and we were unable to recover it. 00:28:02.421 [2024-11-28 19:16:22.894877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.895002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.895026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.421 qpair failed and we were unable to recover it. 00:28:02.421 [2024-11-28 19:16:22.895119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.895223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.895247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.421 qpair failed and we were unable to recover it. 00:28:02.421 [2024-11-28 19:16:22.895333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.895479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.895504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.421 qpair failed and we were unable to recover it. 00:28:02.421 [2024-11-28 19:16:22.895666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.895763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.895790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.421 qpair failed and we were unable to recover it. 00:28:02.421 [2024-11-28 19:16:22.895917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.896030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.896056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.421 qpair failed and we were unable to recover it. 00:28:02.421 [2024-11-28 19:16:22.896182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.896313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.896337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.421 qpair failed and we were unable to recover it. 00:28:02.421 [2024-11-28 19:16:22.896475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.896580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.896606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.421 qpair failed and we were unable to recover it. 00:28:02.421 [2024-11-28 19:16:22.896716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.896851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.896875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.421 qpair failed and we were unable to recover it. 00:28:02.421 [2024-11-28 19:16:22.896962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.897039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.897063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.421 qpair failed and we were unable to recover it. 00:28:02.421 [2024-11-28 19:16:22.897171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.897253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.897278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.421 qpair failed and we were unable to recover it. 00:28:02.421 [2024-11-28 19:16:22.897369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.897475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.897499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.421 qpair failed and we were unable to recover it. 00:28:02.421 [2024-11-28 19:16:22.897611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.897740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.897767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.421 qpair failed and we were unable to recover it. 00:28:02.421 [2024-11-28 19:16:22.897894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.898049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.898074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.421 qpair failed and we were unable to recover it. 00:28:02.421 [2024-11-28 19:16:22.898160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.898263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.898287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.421 qpair failed and we were unable to recover it. 00:28:02.421 [2024-11-28 19:16:22.898404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.898515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.898540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.421 qpair failed and we were unable to recover it. 00:28:02.421 [2024-11-28 19:16:22.898659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.898746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.898771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.421 qpair failed and we were unable to recover it. 00:28:02.421 [2024-11-28 19:16:22.898858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.898940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.898964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.421 qpair failed and we were unable to recover it. 00:28:02.421 [2024-11-28 19:16:22.899077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.899194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.899218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.421 qpair failed and we were unable to recover it. 00:28:02.421 [2024-11-28 19:16:22.899358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.899478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.421 [2024-11-28 19:16:22.899508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.421 qpair failed and we were unable to recover it. 00:28:02.421 [2024-11-28 19:16:22.899627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.899764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.899789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.422 qpair failed and we were unable to recover it. 00:28:02.422 [2024-11-28 19:16:22.899902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.899994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.900024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.422 qpair failed and we were unable to recover it. 00:28:02.422 [2024-11-28 19:16:22.900171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.900284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.900309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.422 qpair failed and we were unable to recover it. 00:28:02.422 [2024-11-28 19:16:22.900404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.900524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.900550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.422 qpair failed and we were unable to recover it. 00:28:02.422 [2024-11-28 19:16:22.900668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.900825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.900866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.422 qpair failed and we were unable to recover it. 00:28:02.422 [2024-11-28 19:16:22.900981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.901119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.901147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.422 qpair failed and we were unable to recover it. 00:28:02.422 [2024-11-28 19:16:22.901302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.901413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.901439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.422 qpair failed and we were unable to recover it. 00:28:02.422 [2024-11-28 19:16:22.901525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.901636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.901660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.422 qpair failed and we were unable to recover it. 00:28:02.422 [2024-11-28 19:16:22.901769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.901922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.901950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.422 qpair failed and we were unable to recover it. 00:28:02.422 [2024-11-28 19:16:22.902103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.902219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.902243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.422 qpair failed and we were unable to recover it. 00:28:02.422 [2024-11-28 19:16:22.902383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.902482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.902508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.422 qpair failed and we were unable to recover it. 00:28:02.422 [2024-11-28 19:16:22.902623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.902760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.902784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.422 qpair failed and we were unable to recover it. 00:28:02.422 [2024-11-28 19:16:22.902908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.903027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.903051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.422 qpair failed and we were unable to recover it. 00:28:02.422 [2024-11-28 19:16:22.903164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.903242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.903266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.422 qpair failed and we were unable to recover it. 00:28:02.422 [2024-11-28 19:16:22.903345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.903490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.903515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.422 qpair failed and we were unable to recover it. 00:28:02.422 [2024-11-28 19:16:22.903629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.903782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.903807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.422 qpair failed and we were unable to recover it. 00:28:02.422 [2024-11-28 19:16:22.903947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.904056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.904080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.422 qpair failed and we were unable to recover it. 00:28:02.422 [2024-11-28 19:16:22.904203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.904318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.904342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.422 qpair failed and we were unable to recover it. 00:28:02.422 [2024-11-28 19:16:22.904423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.904542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.904568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.422 qpair failed and we were unable to recover it. 00:28:02.422 [2024-11-28 19:16:22.904645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.904780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.904805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.422 qpair failed and we were unable to recover it. 00:28:02.422 [2024-11-28 19:16:22.904892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.905003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.905029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.422 qpair failed and we were unable to recover it. 00:28:02.422 [2024-11-28 19:16:22.905169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.905259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.422 [2024-11-28 19:16:22.905284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.423 qpair failed and we were unable to recover it. 00:28:02.423 [2024-11-28 19:16:22.905404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.905504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.905530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.423 qpair failed and we were unable to recover it. 00:28:02.423 [2024-11-28 19:16:22.905642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.905764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.905789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.423 qpair failed and we were unable to recover it. 00:28:02.423 [2024-11-28 19:16:22.905865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.905978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.906002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.423 qpair failed and we were unable to recover it. 00:28:02.423 [2024-11-28 19:16:22.906088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.906201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.906225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.423 qpair failed and we were unable to recover it. 00:28:02.423 [2024-11-28 19:16:22.906315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.906426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.906452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.423 qpair failed and we were unable to recover it. 00:28:02.423 [2024-11-28 19:16:22.906535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.906609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.906634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.423 qpair failed and we were unable to recover it. 00:28:02.423 [2024-11-28 19:16:22.906749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.906863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.906888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.423 qpair failed and we were unable to recover it. 00:28:02.423 [2024-11-28 19:16:22.907003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.907191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.907216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.423 qpair failed and we were unable to recover it. 00:28:02.423 [2024-11-28 19:16:22.907329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.907476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.907502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.423 qpair failed and we were unable to recover it. 00:28:02.423 [2024-11-28 19:16:22.907597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.907688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.907713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.423 qpair failed and we were unable to recover it. 00:28:02.423 [2024-11-28 19:16:22.907822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.907972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.907997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.423 qpair failed and we were unable to recover it. 00:28:02.423 [2024-11-28 19:16:22.908154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.908244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.908268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.423 qpair failed and we were unable to recover it. 00:28:02.423 [2024-11-28 19:16:22.908369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.908539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.908564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.423 qpair failed and we were unable to recover it. 00:28:02.423 [2024-11-28 19:16:22.908707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.908815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.908842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.423 qpair failed and we were unable to recover it. 00:28:02.423 [2024-11-28 19:16:22.908957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.909067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.909092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.423 qpair failed and we were unable to recover it. 00:28:02.423 [2024-11-28 19:16:22.909206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.909343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.909371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.423 qpair failed and we were unable to recover it. 00:28:02.423 [2024-11-28 19:16:22.909507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.909624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.909651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.423 qpair failed and we were unable to recover it. 00:28:02.423 [2024-11-28 19:16:22.909756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.909867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.909891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.423 qpair failed and we were unable to recover it. 00:28:02.423 [2024-11-28 19:16:22.909973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.910083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.910110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.423 qpair failed and we were unable to recover it. 00:28:02.423 [2024-11-28 19:16:22.910276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.910354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.910378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.423 qpair failed and we were unable to recover it. 00:28:02.423 [2024-11-28 19:16:22.910484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.910567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.910592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.423 qpair failed and we were unable to recover it. 00:28:02.423 [2024-11-28 19:16:22.910731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.910807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.423 [2024-11-28 19:16:22.910848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.423 qpair failed and we were unable to recover it. 00:28:02.423 [2024-11-28 19:16:22.910967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.424 [2024-11-28 19:16:22.911106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.424 [2024-11-28 19:16:22.911130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.424 qpair failed and we were unable to recover it. 00:28:02.424 [2024-11-28 19:16:22.911239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.424 [2024-11-28 19:16:22.911353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.424 [2024-11-28 19:16:22.911377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.424 qpair failed and we were unable to recover it. 00:28:02.424 [2024-11-28 19:16:22.911541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.424 [2024-11-28 19:16:22.911682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.424 [2024-11-28 19:16:22.911709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.424 qpair failed and we were unable to recover it. 00:28:02.424 [2024-11-28 19:16:22.911822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.424 [2024-11-28 19:16:22.911938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.424 [2024-11-28 19:16:22.911962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.424 qpair failed and we were unable to recover it. 00:28:02.424 [2024-11-28 19:16:22.912074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.424 [2024-11-28 19:16:22.912185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.424 [2024-11-28 19:16:22.912209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.424 qpair failed and we were unable to recover it. 00:28:02.424 [2024-11-28 19:16:22.912337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.424 [2024-11-28 19:16:22.912526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.424 [2024-11-28 19:16:22.912555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.424 qpair failed and we were unable to recover it. 00:28:02.424 [2024-11-28 19:16:22.912713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.424 [2024-11-28 19:16:22.912833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.424 [2024-11-28 19:16:22.912858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.424 qpair failed and we were unable to recover it. 00:28:02.424 [2024-11-28 19:16:22.912970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.424 [2024-11-28 19:16:22.913084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.424 [2024-11-28 19:16:22.913109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.424 qpair failed and we were unable to recover it. 00:28:02.424 [2024-11-28 19:16:22.913191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.424 [2024-11-28 19:16:22.913294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.424 [2024-11-28 19:16:22.913324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.424 qpair failed and we were unable to recover it. 00:28:02.424 [2024-11-28 19:16:22.913463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.424 [2024-11-28 19:16:22.913546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.424 [2024-11-28 19:16:22.913571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.424 qpair failed and we were unable to recover it. 00:28:02.424 [2024-11-28 19:16:22.913669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.424 [2024-11-28 19:16:22.913781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.424 [2024-11-28 19:16:22.913806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.424 qpair failed and we were unable to recover it. 00:28:02.424 [2024-11-28 19:16:22.913895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.424 [2024-11-28 19:16:22.913997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.424 [2024-11-28 19:16:22.914021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.424 qpair failed and we were unable to recover it. 00:28:02.424 [2024-11-28 19:16:22.914129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.424 [2024-11-28 19:16:22.914211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.424 [2024-11-28 19:16:22.914236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.424 qpair failed and we were unable to recover it. 00:28:02.424 [2024-11-28 19:16:22.914351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.424 [2024-11-28 19:16:22.914492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.424 [2024-11-28 19:16:22.914518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.424 qpair failed and we were unable to recover it. 00:28:02.424 [2024-11-28 19:16:22.914644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.424 [2024-11-28 19:16:22.914732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.424 [2024-11-28 19:16:22.914760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.424 qpair failed and we were unable to recover it. 00:28:02.424 [2024-11-28 19:16:22.914867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.424 [2024-11-28 19:16:22.915013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.424 [2024-11-28 19:16:22.915040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.424 qpair failed and we were unable to recover it. 00:28:02.424 [2024-11-28 19:16:22.915149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.424 [2024-11-28 19:16:22.915265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.424 [2024-11-28 19:16:22.915289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.424 qpair failed and we were unable to recover it. 00:28:02.424 [2024-11-28 19:16:22.915427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.424 [2024-11-28 19:16:22.915548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.915572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.425 qpair failed and we were unable to recover it. 00:28:02.425 [2024-11-28 19:16:22.915666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.915835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.915864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.425 qpair failed and we were unable to recover it. 00:28:02.425 [2024-11-28 19:16:22.915986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.916095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.916119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.425 qpair failed and we were unable to recover it. 00:28:02.425 [2024-11-28 19:16:22.916225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.916299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.916323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.425 qpair failed and we were unable to recover it. 00:28:02.425 [2024-11-28 19:16:22.916448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.916561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.916586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.425 qpair failed and we were unable to recover it. 00:28:02.425 [2024-11-28 19:16:22.916711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.916820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.916844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.425 qpair failed and we were unable to recover it. 00:28:02.425 [2024-11-28 19:16:22.916960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.917068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.917092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.425 qpair failed and we were unable to recover it. 00:28:02.425 [2024-11-28 19:16:22.917182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.917285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.917309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.425 qpair failed and we were unable to recover it. 00:28:02.425 [2024-11-28 19:16:22.917425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.917542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.917567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.425 qpair failed and we were unable to recover it. 00:28:02.425 [2024-11-28 19:16:22.917702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.917832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.917857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.425 qpair failed and we were unable to recover it. 00:28:02.425 [2024-11-28 19:16:22.917999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.918081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.918106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.425 qpair failed and we were unable to recover it. 00:28:02.425 [2024-11-28 19:16:22.918229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.918324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.918348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.425 qpair failed and we were unable to recover it. 00:28:02.425 [2024-11-28 19:16:22.918516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.918688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.918715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.425 qpair failed and we were unable to recover it. 00:28:02.425 [2024-11-28 19:16:22.918844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.918971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.918996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.425 qpair failed and we were unable to recover it. 00:28:02.425 [2024-11-28 19:16:22.919140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.919226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.919253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.425 qpair failed and we were unable to recover it. 00:28:02.425 [2024-11-28 19:16:22.919400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.919515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.919540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.425 qpair failed and we were unable to recover it. 00:28:02.425 [2024-11-28 19:16:22.919647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.919729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.919753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.425 qpair failed and we were unable to recover it. 00:28:02.425 [2024-11-28 19:16:22.919895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.919985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.920010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.425 qpair failed and we were unable to recover it. 00:28:02.425 [2024-11-28 19:16:22.920126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.920236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.920260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.425 qpair failed and we were unable to recover it. 00:28:02.425 [2024-11-28 19:16:22.920348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.920429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.920455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.425 qpair failed and we were unable to recover it. 00:28:02.425 [2024-11-28 19:16:22.920578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.920673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.920697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.425 qpair failed and we were unable to recover it. 00:28:02.425 [2024-11-28 19:16:22.920842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.920972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.425 [2024-11-28 19:16:22.920999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.425 qpair failed and we were unable to recover it. 00:28:02.425 [2024-11-28 19:16:22.921126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.921241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.921269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.426 qpair failed and we were unable to recover it. 00:28:02.426 [2024-11-28 19:16:22.921403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.921494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.921519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.426 qpair failed and we were unable to recover it. 00:28:02.426 [2024-11-28 19:16:22.921650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.921748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.921775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.426 qpair failed and we were unable to recover it. 00:28:02.426 [2024-11-28 19:16:22.921901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.921994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.922036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.426 qpair failed and we were unable to recover it. 00:28:02.426 [2024-11-28 19:16:22.922124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.922237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.922261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.426 qpair failed and we were unable to recover it. 00:28:02.426 [2024-11-28 19:16:22.922348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.922424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.922450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.426 qpair failed and we were unable to recover it. 00:28:02.426 [2024-11-28 19:16:22.922550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.922655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.922680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.426 qpair failed and we were unable to recover it. 00:28:02.426 [2024-11-28 19:16:22.922764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.922875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.922901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.426 qpair failed and we were unable to recover it. 00:28:02.426 [2024-11-28 19:16:22.923000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.923085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.923109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.426 qpair failed and we were unable to recover it. 00:28:02.426 [2024-11-28 19:16:22.923252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.923357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.923411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.426 qpair failed and we were unable to recover it. 00:28:02.426 [2024-11-28 19:16:22.923550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.923670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.923696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.426 qpair failed and we were unable to recover it. 00:28:02.426 [2024-11-28 19:16:22.923777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.923859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.923885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.426 qpair failed and we were unable to recover it. 00:28:02.426 [2024-11-28 19:16:22.924033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.924152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.924181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.426 qpair failed and we were unable to recover it. 00:28:02.426 [2024-11-28 19:16:22.924316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.924419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.924445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.426 qpair failed and we were unable to recover it. 00:28:02.426 [2024-11-28 19:16:22.924578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.924670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.924700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.426 qpair failed and we were unable to recover it. 00:28:02.426 [2024-11-28 19:16:22.924835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.924921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.924947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.426 qpair failed and we were unable to recover it. 00:28:02.426 [2024-11-28 19:16:22.925066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.925175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.925200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.426 qpair failed and we were unable to recover it. 00:28:02.426 [2024-11-28 19:16:22.925290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.925426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.925455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.426 qpair failed and we were unable to recover it. 00:28:02.426 [2024-11-28 19:16:22.925582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.925703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.925728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.426 qpair failed and we were unable to recover it. 00:28:02.426 [2024-11-28 19:16:22.925847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.925931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.925957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.426 qpair failed and we were unable to recover it. 00:28:02.426 [2024-11-28 19:16:22.926079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.926190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.926216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.426 qpair failed and we were unable to recover it. 00:28:02.426 [2024-11-28 19:16:22.926323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.926438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.926481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.426 qpair failed and we were unable to recover it. 00:28:02.426 [2024-11-28 19:16:22.926571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.426 [2024-11-28 19:16:22.926656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.926681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.427 qpair failed and we were unable to recover it. 00:28:02.427 [2024-11-28 19:16:22.926788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.926866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.926893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.427 qpair failed and we were unable to recover it. 00:28:02.427 [2024-11-28 19:16:22.927034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.927161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.927189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.427 qpair failed and we were unable to recover it. 00:28:02.427 [2024-11-28 19:16:22.927315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.927429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.927455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.427 qpair failed and we were unable to recover it. 00:28:02.427 [2024-11-28 19:16:22.927575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.927713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.927738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.427 qpair failed and we were unable to recover it. 00:28:02.427 [2024-11-28 19:16:22.927878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.928011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.928039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.427 qpair failed and we were unable to recover it. 00:28:02.427 [2024-11-28 19:16:22.928170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.928279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.928304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.427 qpair failed and we were unable to recover it. 00:28:02.427 [2024-11-28 19:16:22.928445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.928571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.928599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.427 qpair failed and we were unable to recover it. 00:28:02.427 [2024-11-28 19:16:22.928695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.928818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.928853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.427 qpair failed and we were unable to recover it. 00:28:02.427 [2024-11-28 19:16:22.928989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.929072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.929097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.427 qpair failed and we were unable to recover it. 00:28:02.427 [2024-11-28 19:16:22.929197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.929320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.929361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.427 qpair failed and we were unable to recover it. 00:28:02.427 [2024-11-28 19:16:22.929456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.929563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.929587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.427 qpair failed and we were unable to recover it. 00:28:02.427 [2024-11-28 19:16:22.929680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.929794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.929819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.427 qpair failed and we were unable to recover it. 00:28:02.427 [2024-11-28 19:16:22.929936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.930062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.930090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.427 qpair failed and we were unable to recover it. 00:28:02.427 [2024-11-28 19:16:22.930185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.930302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.930331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.427 qpair failed and we were unable to recover it. 00:28:02.427 [2024-11-28 19:16:22.930440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.930896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.930929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.427 qpair failed and we were unable to recover it. 00:28:02.427 [2024-11-28 19:16:22.931067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.931223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.931249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.427 qpair failed and we were unable to recover it. 00:28:02.427 [2024-11-28 19:16:22.931365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.931492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.931520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.427 qpair failed and we were unable to recover it. 00:28:02.427 [2024-11-28 19:16:22.931641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.931727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.931754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.427 qpair failed and we were unable to recover it. 00:28:02.427 [2024-11-28 19:16:22.931854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.931950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.931976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.427 qpair failed and we were unable to recover it. 00:28:02.427 [2024-11-28 19:16:22.932091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.932204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.932229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.427 qpair failed and we were unable to recover it. 00:28:02.427 [2024-11-28 19:16:22.932351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.932446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.932473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.427 qpair failed and we were unable to recover it. 00:28:02.427 [2024-11-28 19:16:22.932613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.427 [2024-11-28 19:16:22.932700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.932725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.428 qpair failed and we were unable to recover it. 00:28:02.428 [2024-11-28 19:16:22.932843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.932966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.932994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.428 qpair failed and we were unable to recover it. 00:28:02.428 [2024-11-28 19:16:22.933137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.933218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.933242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.428 qpair failed and we were unable to recover it. 00:28:02.428 [2024-11-28 19:16:22.933362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.933448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.933474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.428 qpair failed and we were unable to recover it. 00:28:02.428 [2024-11-28 19:16:22.933605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.933735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.933762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.428 qpair failed and we were unable to recover it. 00:28:02.428 [2024-11-28 19:16:22.933872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.933979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.934003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.428 qpair failed and we were unable to recover it. 00:28:02.428 [2024-11-28 19:16:22.934115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.934230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.934259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.428 qpair failed and we were unable to recover it. 00:28:02.428 [2024-11-28 19:16:22.934390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.934522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.934548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.428 qpair failed and we were unable to recover it. 00:28:02.428 [2024-11-28 19:16:22.934665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.934801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.934825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.428 qpair failed and we were unable to recover it. 00:28:02.428 [2024-11-28 19:16:22.934908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.934988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.935013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.428 qpair failed and we were unable to recover it. 00:28:02.428 [2024-11-28 19:16:22.935097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.935178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.935203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.428 qpair failed and we were unable to recover it. 00:28:02.428 [2024-11-28 19:16:22.935281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.935401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.935427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.428 qpair failed and we were unable to recover it. 00:28:02.428 [2024-11-28 19:16:22.935567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.935652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.935677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.428 qpair failed and we were unable to recover it. 00:28:02.428 [2024-11-28 19:16:22.935825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.935981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.936006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.428 qpair failed and we were unable to recover it. 00:28:02.428 [2024-11-28 19:16:22.936119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.936251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.936278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.428 qpair failed and we were unable to recover it. 00:28:02.428 [2024-11-28 19:16:22.936390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.936487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.936512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.428 qpair failed and we were unable to recover it. 00:28:02.428 [2024-11-28 19:16:22.936590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.936703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.936727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.428 qpair failed and we were unable to recover it. 00:28:02.428 [2024-11-28 19:16:22.936860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.937026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.937051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.428 qpair failed and we were unable to recover it. 00:28:02.428 [2024-11-28 19:16:22.937169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.937253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.937277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.428 qpair failed and we were unable to recover it. 00:28:02.428 [2024-11-28 19:16:22.937414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.937508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.937536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.428 qpair failed and we were unable to recover it. 00:28:02.428 [2024-11-28 19:16:22.937628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.937727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.937754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.428 qpair failed and we were unable to recover it. 00:28:02.428 [2024-11-28 19:16:22.937917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.938029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.428 [2024-11-28 19:16:22.938053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.428 qpair failed and we were unable to recover it. 00:28:02.428 [2024-11-28 19:16:22.938182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.938305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.938334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.429 qpair failed and we were unable to recover it. 00:28:02.429 [2024-11-28 19:16:22.938471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.938588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.938614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.429 qpair failed and we were unable to recover it. 00:28:02.429 [2024-11-28 19:16:22.938728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.938837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.938862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.429 qpair failed and we were unable to recover it. 00:28:02.429 [2024-11-28 19:16:22.938960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.939078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.939105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.429 qpair failed and we were unable to recover it. 00:28:02.429 [2024-11-28 19:16:22.939199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.939327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.939366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.429 qpair failed and we were unable to recover it. 00:28:02.429 [2024-11-28 19:16:22.939504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.939657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.939682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.429 qpair failed and we were unable to recover it. 00:28:02.429 [2024-11-28 19:16:22.939789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.939943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.939971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.429 qpair failed and we were unable to recover it. 00:28:02.429 [2024-11-28 19:16:22.940134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.940219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.940244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.429 qpair failed and we were unable to recover it. 00:28:02.429 [2024-11-28 19:16:22.940380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.940469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.940495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.429 qpair failed and we were unable to recover it. 00:28:02.429 [2024-11-28 19:16:22.940610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.940695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.940719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.429 qpair failed and we were unable to recover it. 00:28:02.429 [2024-11-28 19:16:22.940863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.940975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.941001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.429 qpair failed and we were unable to recover it. 00:28:02.429 [2024-11-28 19:16:22.941084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.941191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.941215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.429 qpair failed and we were unable to recover it. 00:28:02.429 [2024-11-28 19:16:22.941293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.941405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.941431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.429 qpair failed and we were unable to recover it. 00:28:02.429 [2024-11-28 19:16:22.941549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.941653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.941677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.429 qpair failed and we were unable to recover it. 00:28:02.429 [2024-11-28 19:16:22.941762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.941849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.941875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.429 qpair failed and we were unable to recover it. 00:28:02.429 [2024-11-28 19:16:22.941987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.942106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.942135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.429 qpair failed and we were unable to recover it. 00:28:02.429 [2024-11-28 19:16:22.942266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.942387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.942425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.429 qpair failed and we were unable to recover it. 00:28:02.429 [2024-11-28 19:16:22.942590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.942706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.942731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.429 qpair failed and we were unable to recover it. 00:28:02.429 [2024-11-28 19:16:22.942814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.942928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.942952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.429 qpair failed and we were unable to recover it. 00:28:02.429 [2024-11-28 19:16:22.943058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.943229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.943254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.429 qpair failed and we were unable to recover it. 00:28:02.429 [2024-11-28 19:16:22.943367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.943463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.943488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.429 qpair failed and we were unable to recover it. 00:28:02.429 [2024-11-28 19:16:22.943575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.943685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.429 [2024-11-28 19:16:22.943710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.429 qpair failed and we were unable to recover it. 00:28:02.430 [2024-11-28 19:16:22.943820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.430 [2024-11-28 19:16:22.943910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.430 [2024-11-28 19:16:22.943936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.430 qpair failed and we were unable to recover it. 00:28:02.430 [2024-11-28 19:16:22.944074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.430 [2024-11-28 19:16:22.944153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.430 [2024-11-28 19:16:22.944178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.430 qpair failed and we were unable to recover it. 00:28:02.430 [2024-11-28 19:16:22.944303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.430 [2024-11-28 19:16:22.944414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.430 [2024-11-28 19:16:22.944442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.430 qpair failed and we were unable to recover it. 00:28:02.430 [2024-11-28 19:16:22.944544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.430 [2024-11-28 19:16:22.944624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.430 [2024-11-28 19:16:22.944652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.430 qpair failed and we were unable to recover it. 00:28:02.430 [2024-11-28 19:16:22.944771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.430 [2024-11-28 19:16:22.944880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.430 [2024-11-28 19:16:22.944905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.430 qpair failed and we were unable to recover it. 00:28:02.430 [2024-11-28 19:16:22.945036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.430 [2024-11-28 19:16:22.945157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.430 [2024-11-28 19:16:22.945185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.430 qpair failed and we were unable to recover it. 00:28:02.430 [2024-11-28 19:16:22.945304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.430 [2024-11-28 19:16:22.945433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.430 [2024-11-28 19:16:22.945463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.430 qpair failed and we were unable to recover it. 00:28:02.430 [2024-11-28 19:16:22.945600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.430 [2024-11-28 19:16:22.945709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.430 [2024-11-28 19:16:22.945734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.430 qpair failed and we were unable to recover it. 00:28:02.430 [2024-11-28 19:16:22.945888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.430 [2024-11-28 19:16:22.945983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.430 [2024-11-28 19:16:22.946012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.430 qpair failed and we were unable to recover it. 00:28:02.430 [2024-11-28 19:16:22.946136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.430 [2024-11-28 19:16:22.946265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.430 [2024-11-28 19:16:22.946290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.430 qpair failed and we were unable to recover it. 00:28:02.430 [2024-11-28 19:16:22.946412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.430 [2024-11-28 19:16:22.946528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.430 [2024-11-28 19:16:22.946554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.430 qpair failed and we were unable to recover it. 00:28:02.430 [2024-11-28 19:16:22.946717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.430 [2024-11-28 19:16:22.946868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.430 [2024-11-28 19:16:22.946895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.430 qpair failed and we were unable to recover it. 00:28:02.430 [2024-11-28 19:16:22.947017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.430 [2024-11-28 19:16:22.947143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.430 [2024-11-28 19:16:22.947168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.430 qpair failed and we were unable to recover it. 00:28:02.430 [2024-11-28 19:16:22.947319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.430 [2024-11-28 19:16:22.947418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.430 [2024-11-28 19:16:22.947449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.430 qpair failed and we were unable to recover it. 00:28:02.430 [2024-11-28 19:16:22.947570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.430 [2024-11-28 19:16:22.947694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.430 [2024-11-28 19:16:22.947721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.430 qpair failed and we were unable to recover it. 00:28:02.430 [2024-11-28 19:16:22.947873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.430 [2024-11-28 19:16:22.947973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.430 [2024-11-28 19:16:22.948000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.430 qpair failed and we were unable to recover it. 00:28:02.430 [2024-11-28 19:16:22.948127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.430 [2024-11-28 19:16:22.948265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.430 [2024-11-28 19:16:22.948290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.430 qpair failed and we were unable to recover it. 00:28:02.430 [2024-11-28 19:16:22.948463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.430 [2024-11-28 19:16:22.948623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.430 [2024-11-28 19:16:22.948650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.430 qpair failed and we were unable to recover it. 00:28:02.431 [2024-11-28 19:16:22.948773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.948866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.948894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.431 qpair failed and we were unable to recover it. 00:28:02.431 [2024-11-28 19:16:22.949019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.949132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.949156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.431 qpair failed and we were unable to recover it. 00:28:02.431 [2024-11-28 19:16:22.949239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.949350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.949375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.431 qpair failed and we were unable to recover it. 00:28:02.431 [2024-11-28 19:16:22.949523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.949626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.949655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.431 qpair failed and we were unable to recover it. 00:28:02.431 [2024-11-28 19:16:22.949819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.949907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.949931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.431 qpair failed and we were unable to recover it. 00:28:02.431 [2024-11-28 19:16:22.950063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.950216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.950243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.431 qpair failed and we were unable to recover it. 00:28:02.431 [2024-11-28 19:16:22.950425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.950515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.950539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.431 qpair failed and we were unable to recover it. 00:28:02.431 [2024-11-28 19:16:22.950629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.950720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.950744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.431 qpair failed and we were unable to recover it. 00:28:02.431 [2024-11-28 19:16:22.950824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.950901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.950925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.431 qpair failed and we were unable to recover it. 00:28:02.431 [2024-11-28 19:16:22.951057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.951184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.951211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.431 qpair failed and we were unable to recover it. 00:28:02.431 [2024-11-28 19:16:22.951322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.951417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.951443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.431 qpair failed and we were unable to recover it. 00:28:02.431 [2024-11-28 19:16:22.951554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.951627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.951652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.431 qpair failed and we were unable to recover it. 00:28:02.431 [2024-11-28 19:16:22.951738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.951818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.951843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.431 qpair failed and we were unable to recover it. 00:28:02.431 [2024-11-28 19:16:22.951958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.952067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.952091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.431 qpair failed and we were unable to recover it. 00:28:02.431 [2024-11-28 19:16:22.952233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.952391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.952423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.431 qpair failed and we were unable to recover it. 00:28:02.431 [2024-11-28 19:16:22.952544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.952654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.952681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.431 qpair failed and we were unable to recover it. 00:28:02.431 [2024-11-28 19:16:22.952795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.952921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.952946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.431 qpair failed and we were unable to recover it. 00:28:02.431 [2024-11-28 19:16:22.953032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.953140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.953167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.431 qpair failed and we were unable to recover it. 00:28:02.431 [2024-11-28 19:16:22.953320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.953408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.953436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.431 qpair failed and we were unable to recover it. 00:28:02.431 [2024-11-28 19:16:22.953551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.953631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.953655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.431 qpair failed and we were unable to recover it. 00:28:02.431 [2024-11-28 19:16:22.953773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.953888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.431 [2024-11-28 19:16:22.953931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.431 qpair failed and we were unable to recover it. 00:28:02.432 [2024-11-28 19:16:22.954069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.954149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.954174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.432 qpair failed and we were unable to recover it. 00:28:02.432 [2024-11-28 19:16:22.954255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.954400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.954426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.432 qpair failed and we were unable to recover it. 00:28:02.432 [2024-11-28 19:16:22.954534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.954661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.954689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.432 qpair failed and we were unable to recover it. 00:28:02.432 [2024-11-28 19:16:22.954806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.954908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.954936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.432 qpair failed and we were unable to recover it. 00:28:02.432 [2024-11-28 19:16:22.955048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.955156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.955181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.432 qpair failed and we were unable to recover it. 00:28:02.432 [2024-11-28 19:16:22.955300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.955443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.955476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.432 qpair failed and we were unable to recover it. 00:28:02.432 [2024-11-28 19:16:22.955582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.955700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.955728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.432 qpair failed and we were unable to recover it. 00:28:02.432 [2024-11-28 19:16:22.955894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.956004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.956029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.432 qpair failed and we were unable to recover it. 00:28:02.432 [2024-11-28 19:16:22.956140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.956221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.956246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.432 qpair failed and we were unable to recover it. 00:28:02.432 [2024-11-28 19:16:22.956356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.956435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.956460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.432 qpair failed and we were unable to recover it. 00:28:02.432 [2024-11-28 19:16:22.956552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.956635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.956659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.432 qpair failed and we were unable to recover it. 00:28:02.432 [2024-11-28 19:16:22.956743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.956855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.956879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.432 qpair failed and we were unable to recover it. 00:28:02.432 [2024-11-28 19:16:22.957054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.957217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.957245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.432 qpair failed and we were unable to recover it. 00:28:02.432 [2024-11-28 19:16:22.957380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.957530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.957555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.432 qpair failed and we were unable to recover it. 00:28:02.432 [2024-11-28 19:16:22.957647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.957760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.957800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.432 qpair failed and we were unable to recover it. 00:28:02.432 [2024-11-28 19:16:22.957933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.958086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.958114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.432 qpair failed and we were unable to recover it. 00:28:02.432 [2024-11-28 19:16:22.958259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.958369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.958401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.432 qpair failed and we were unable to recover it. 00:28:02.432 [2024-11-28 19:16:22.958572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.958704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.958728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.432 qpair failed and we were unable to recover it. 00:28:02.432 [2024-11-28 19:16:22.958837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.958944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.958968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.432 qpair failed and we were unable to recover it. 00:28:02.432 [2024-11-28 19:16:22.959105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.959235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.959260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.432 qpair failed and we were unable to recover it. 00:28:02.432 [2024-11-28 19:16:22.959375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.959470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.959495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.432 qpair failed and we were unable to recover it. 00:28:02.432 [2024-11-28 19:16:22.959578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.432 [2024-11-28 19:16:22.959685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.959709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.433 qpair failed and we were unable to recover it. 00:28:02.433 [2024-11-28 19:16:22.959822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.959911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.959935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.433 qpair failed and we were unable to recover it. 00:28:02.433 [2024-11-28 19:16:22.960010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.960128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.960153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.433 qpair failed and we were unable to recover it. 00:28:02.433 [2024-11-28 19:16:22.960262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.960383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.960421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.433 qpair failed and we were unable to recover it. 00:28:02.433 [2024-11-28 19:16:22.960566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.960658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.960682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.433 qpair failed and we were unable to recover it. 00:28:02.433 [2024-11-28 19:16:22.960779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.960914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.960939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.433 qpair failed and we were unable to recover it. 00:28:02.433 [2024-11-28 19:16:22.961073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.961196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.961226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.433 qpair failed and we were unable to recover it. 00:28:02.433 [2024-11-28 19:16:22.961330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.961447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.961473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.433 qpair failed and we were unable to recover it. 00:28:02.433 [2024-11-28 19:16:22.961627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.961763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.961788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.433 qpair failed and we were unable to recover it. 00:28:02.433 [2024-11-28 19:16:22.961880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.961995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.962020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.433 qpair failed and we were unable to recover it. 00:28:02.433 [2024-11-28 19:16:22.962162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.962246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.962270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.433 qpair failed and we were unable to recover it. 00:28:02.433 [2024-11-28 19:16:22.962380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.962500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.962527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.433 qpair failed and we were unable to recover it. 00:28:02.433 [2024-11-28 19:16:22.962626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.962731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.962758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.433 qpair failed and we were unable to recover it. 00:28:02.433 [2024-11-28 19:16:22.962867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.962977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.963002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.433 qpair failed and we were unable to recover it. 00:28:02.433 [2024-11-28 19:16:22.963117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.963285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.963313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.433 qpair failed and we were unable to recover it. 00:28:02.433 [2024-11-28 19:16:22.963418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.963557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.963587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.433 qpair failed and we were unable to recover it. 00:28:02.433 [2024-11-28 19:16:22.963687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.963768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.963792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.433 qpair failed and we were unable to recover it. 00:28:02.433 [2024-11-28 19:16:22.963878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.964005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.964033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.433 qpair failed and we were unable to recover it. 00:28:02.433 [2024-11-28 19:16:22.964128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.964250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.964277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.433 qpair failed and we were unable to recover it. 00:28:02.433 [2024-11-28 19:16:22.964386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.964485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.964510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.433 qpair failed and we were unable to recover it. 00:28:02.433 [2024-11-28 19:16:22.964596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.964677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.964702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.433 qpair failed and we were unable to recover it. 00:28:02.433 [2024-11-28 19:16:22.964827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.964916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.964943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.433 qpair failed and we were unable to recover it. 00:28:02.433 [2024-11-28 19:16:22.965093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.965209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.433 [2024-11-28 19:16:22.965235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.434 qpair failed and we were unable to recover it. 00:28:02.434 [2024-11-28 19:16:22.965347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.965434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.965461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.434 qpair failed and we were unable to recover it. 00:28:02.434 [2024-11-28 19:16:22.965581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.965711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.965739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.434 qpair failed and we were unable to recover it. 00:28:02.434 [2024-11-28 19:16:22.965864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.966011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.966036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.434 qpair failed and we were unable to recover it. 00:28:02.434 [2024-11-28 19:16:22.966193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.966321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.966349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.434 qpair failed and we were unable to recover it. 00:28:02.434 [2024-11-28 19:16:22.966465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.966615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.966643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.434 qpair failed and we were unable to recover it. 00:28:02.434 [2024-11-28 19:16:22.966756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.966844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.966869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.434 qpair failed and we were unable to recover it. 00:28:02.434 [2024-11-28 19:16:22.966980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.967064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.967090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.434 qpair failed and we were unable to recover it. 00:28:02.434 [2024-11-28 19:16:22.967217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.967345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.967372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.434 qpair failed and we were unable to recover it. 00:28:02.434 [2024-11-28 19:16:22.967504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.967614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.967639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.434 qpair failed and we were unable to recover it. 00:28:02.434 [2024-11-28 19:16:22.967724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.967862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.967890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.434 qpair failed and we were unable to recover it. 00:28:02.434 [2024-11-28 19:16:22.967974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.968065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.968091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.434 qpair failed and we were unable to recover it. 00:28:02.434 [2024-11-28 19:16:22.968222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.968312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.968337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.434 qpair failed and we were unable to recover it. 00:28:02.434 [2024-11-28 19:16:22.968471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.968602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.968634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.434 qpair failed and we were unable to recover it. 00:28:02.434 [2024-11-28 19:16:22.968752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.968830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.968855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.434 qpair failed and we were unable to recover it. 00:28:02.434 [2024-11-28 19:16:22.968964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.969075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.969100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.434 qpair failed and we were unable to recover it. 00:28:02.434 [2024-11-28 19:16:22.969182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.969362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.969387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.434 qpair failed and we were unable to recover it. 00:28:02.434 [2024-11-28 19:16:22.969513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.969601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.969626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.434 qpair failed and we were unable to recover it. 00:28:02.434 [2024-11-28 19:16:22.969738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.969826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.969852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.434 qpair failed and we were unable to recover it. 00:28:02.434 [2024-11-28 19:16:22.969947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.970124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.970152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.434 qpair failed and we were unable to recover it. 00:28:02.434 [2024-11-28 19:16:22.970310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.970407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.970436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.434 qpair failed and we were unable to recover it. 00:28:02.434 [2024-11-28 19:16:22.970576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.434 [2024-11-28 19:16:22.970723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.970748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.435 qpair failed and we were unable to recover it. 00:28:02.435 [2024-11-28 19:16:22.970864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.970992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.971020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.435 qpair failed and we were unable to recover it. 00:28:02.435 [2024-11-28 19:16:22.971169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.971269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.971306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.435 qpair failed and we were unable to recover it. 00:28:02.435 [2024-11-28 19:16:22.971423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.971515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.971542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.435 qpair failed and we were unable to recover it. 00:28:02.435 [2024-11-28 19:16:22.971628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.971705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.971729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.435 qpair failed and we were unable to recover it. 00:28:02.435 [2024-11-28 19:16:22.971870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.971980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.972004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.435 qpair failed and we were unable to recover it. 00:28:02.435 [2024-11-28 19:16:22.972145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.972257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.972282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.435 qpair failed and we were unable to recover it. 00:28:02.435 [2024-11-28 19:16:22.972406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.972530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.972555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.435 qpair failed and we were unable to recover it. 00:28:02.435 [2024-11-28 19:16:22.972663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.972818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.972847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.435 qpair failed and we were unable to recover it. 00:28:02.435 [2024-11-28 19:16:22.972986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.973071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.973096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.435 qpair failed and we were unable to recover it. 00:28:02.435 [2024-11-28 19:16:22.973170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.973256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.973282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.435 qpair failed and we were unable to recover it. 00:28:02.435 [2024-11-28 19:16:22.973401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.973563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.973604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.435 qpair failed and we were unable to recover it. 00:28:02.435 [2024-11-28 19:16:22.973683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.973789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.973813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.435 qpair failed and we were unable to recover it. 00:28:02.435 [2024-11-28 19:16:22.973947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.974038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.974066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.435 qpair failed and we were unable to recover it. 00:28:02.435 [2024-11-28 19:16:22.974223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.974367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.974416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.435 qpair failed and we were unable to recover it. 00:28:02.435 [2024-11-28 19:16:22.974539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.974664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.974688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.435 qpair failed and we were unable to recover it. 00:28:02.435 [2024-11-28 19:16:22.974828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.974955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.974979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.435 qpair failed and we were unable to recover it. 00:28:02.435 [2024-11-28 19:16:22.975071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.975180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.975205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.435 qpair failed and we were unable to recover it. 00:28:02.435 [2024-11-28 19:16:22.975353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.975441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.975466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.435 qpair failed and we were unable to recover it. 00:28:02.435 [2024-11-28 19:16:22.975554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.975663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.975688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.435 qpair failed and we were unable to recover it. 00:28:02.435 [2024-11-28 19:16:22.975865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.975952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.975977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.435 qpair failed and we were unable to recover it. 00:28:02.435 [2024-11-28 19:16:22.976088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.976207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.976231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.435 qpair failed and we were unable to recover it. 00:28:02.435 [2024-11-28 19:16:22.976370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.976522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.435 [2024-11-28 19:16:22.976547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.436 qpair failed and we were unable to recover it. 00:28:02.436 [2024-11-28 19:16:22.976695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.436 [2024-11-28 19:16:22.976811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.436 [2024-11-28 19:16:22.976835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.436 qpair failed and we were unable to recover it. 00:28:02.436 [2024-11-28 19:16:22.976924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.436 [2024-11-28 19:16:22.977002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.436 [2024-11-28 19:16:22.977028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.436 qpair failed and we were unable to recover it. 00:28:02.436 [2024-11-28 19:16:22.977140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.436 [2024-11-28 19:16:22.977282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.436 [2024-11-28 19:16:22.977306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.436 qpair failed and we were unable to recover it. 00:28:02.436 [2024-11-28 19:16:22.977429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.436 [2024-11-28 19:16:22.977515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.436 [2024-11-28 19:16:22.977539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.436 qpair failed and we were unable to recover it. 00:28:02.436 [2024-11-28 19:16:22.977637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.436 [2024-11-28 19:16:22.977712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.436 [2024-11-28 19:16:22.977736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.436 qpair failed and we were unable to recover it. 00:28:02.436 [2024-11-28 19:16:22.977876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.436 [2024-11-28 19:16:22.978035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.436 [2024-11-28 19:16:22.978062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.436 qpair failed and we were unable to recover it. 00:28:02.436 [2024-11-28 19:16:22.978239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.436 [2024-11-28 19:16:22.978347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.436 [2024-11-28 19:16:22.978371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.436 qpair failed and we were unable to recover it. 00:28:02.436 [2024-11-28 19:16:22.978480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.436 [2024-11-28 19:16:22.978600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.436 [2024-11-28 19:16:22.978624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.436 qpair failed and we were unable to recover it. 00:28:02.436 [2024-11-28 19:16:22.978750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.436 [2024-11-28 19:16:22.978898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.436 [2024-11-28 19:16:22.978925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.436 qpair failed and we were unable to recover it. 00:28:02.436 [2024-11-28 19:16:22.979051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.436 [2024-11-28 19:16:22.979164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.436 [2024-11-28 19:16:22.979192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.436 qpair failed and we were unable to recover it. 00:28:02.436 [2024-11-28 19:16:22.979321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.436 [2024-11-28 19:16:22.979413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.436 [2024-11-28 19:16:22.979439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.436 qpair failed and we were unable to recover it. 00:28:02.436 [2024-11-28 19:16:22.979537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.436 [2024-11-28 19:16:22.979663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.436 [2024-11-28 19:16:22.979690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.436 qpair failed and we were unable to recover it. 00:28:02.436 [2024-11-28 19:16:22.979820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.436 [2024-11-28 19:16:22.979957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.436 [2024-11-28 19:16:22.979982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.436 qpair failed and we were unable to recover it. 00:28:02.436 [2024-11-28 19:16:22.980072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.436 [2024-11-28 19:16:22.980216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.436 [2024-11-28 19:16:22.980241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.436 qpair failed and we were unable to recover it. 00:28:02.436 [2024-11-28 19:16:22.980379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.436 [2024-11-28 19:16:22.980534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.436 [2024-11-28 19:16:22.980563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.436 qpair failed and we were unable to recover it. 00:28:02.436 [2024-11-28 19:16:22.980715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.436 [2024-11-28 19:16:22.980827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.436 [2024-11-28 19:16:22.980854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.436 qpair failed and we were unable to recover it. 00:28:02.436 [2024-11-28 19:16:22.980965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.436 [2024-11-28 19:16:22.981070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.436 [2024-11-28 19:16:22.981096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.436 qpair failed and we were unable to recover it. 00:28:02.436 [2024-11-28 19:16:22.981213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.436 [2024-11-28 19:16:22.981350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.981376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.437 qpair failed and we were unable to recover it. 00:28:02.437 [2024-11-28 19:16:22.981533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.981643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.981669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.437 qpair failed and we were unable to recover it. 00:28:02.437 [2024-11-28 19:16:22.981752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.981863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.981890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.437 qpair failed and we were unable to recover it. 00:28:02.437 [2024-11-28 19:16:22.982023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.982158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.982186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.437 qpair failed and we were unable to recover it. 00:28:02.437 [2024-11-28 19:16:22.982312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.982475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.982504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.437 qpair failed and we were unable to recover it. 00:28:02.437 [2024-11-28 19:16:22.982636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.982749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.982773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.437 qpair failed and we were unable to recover it. 00:28:02.437 [2024-11-28 19:16:22.982930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.983020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.983047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.437 qpair failed and we were unable to recover it. 00:28:02.437 [2024-11-28 19:16:22.983148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.983263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.983290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.437 qpair failed and we were unable to recover it. 00:28:02.437 [2024-11-28 19:16:22.983390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.983502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.983527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.437 qpair failed and we were unable to recover it. 00:28:02.437 [2024-11-28 19:16:22.983617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.983750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.983790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.437 qpair failed and we were unable to recover it. 00:28:02.437 [2024-11-28 19:16:22.983874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.984019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.984044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.437 qpair failed and we were unable to recover it. 00:28:02.437 [2024-11-28 19:16:22.984125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.984214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.984238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.437 qpair failed and we were unable to recover it. 00:28:02.437 [2024-11-28 19:16:22.984345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.984426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.984453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.437 qpair failed and we were unable to recover it. 00:28:02.437 [2024-11-28 19:16:22.984595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.984684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.984716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.437 qpair failed and we were unable to recover it. 00:28:02.437 [2024-11-28 19:16:22.984847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.984984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.985009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.437 qpair failed and we were unable to recover it. 00:28:02.437 [2024-11-28 19:16:22.985148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.985285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.985309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.437 qpair failed and we were unable to recover it. 00:28:02.437 [2024-11-28 19:16:22.985403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.985487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.985511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.437 qpair failed and we were unable to recover it. 00:28:02.437 [2024-11-28 19:16:22.985618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.985728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.985753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.437 qpair failed and we were unable to recover it. 00:28:02.437 [2024-11-28 19:16:22.985848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.985930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.985954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.437 qpair failed and we were unable to recover it. 00:28:02.437 [2024-11-28 19:16:22.986077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.986213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.986241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.437 qpair failed and we were unable to recover it. 00:28:02.437 [2024-11-28 19:16:22.986374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.986494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.986519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.437 qpair failed and we were unable to recover it. 00:28:02.437 [2024-11-28 19:16:22.986644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.986765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.437 [2024-11-28 19:16:22.986791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.438 qpair failed and we were unable to recover it. 00:28:02.438 [2024-11-28 19:16:22.986880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.986978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.987006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.438 qpair failed and we were unable to recover it. 00:28:02.438 [2024-11-28 19:16:22.987121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.987231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.987256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.438 qpair failed and we were unable to recover it. 00:28:02.438 [2024-11-28 19:16:22.987351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.987561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.987587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.438 qpair failed and we were unable to recover it. 00:28:02.438 [2024-11-28 19:16:22.987699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.987858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.987887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.438 qpair failed and we were unable to recover it. 00:28:02.438 [2024-11-28 19:16:22.988049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.988170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.988196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.438 qpair failed and we were unable to recover it. 00:28:02.438 [2024-11-28 19:16:22.988336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.988459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.988488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.438 qpair failed and we were unable to recover it. 00:28:02.438 [2024-11-28 19:16:22.988614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.988789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.988813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.438 qpair failed and we were unable to recover it. 00:28:02.438 [2024-11-28 19:16:22.988926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.989065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.989089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.438 qpair failed and we were unable to recover it. 00:28:02.438 [2024-11-28 19:16:22.989194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.989277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.989320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.438 qpair failed and we were unable to recover it. 00:28:02.438 [2024-11-28 19:16:22.989407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.989535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.989562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.438 qpair failed and we were unable to recover it. 00:28:02.438 [2024-11-28 19:16:22.989670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.989759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.989782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.438 qpair failed and we were unable to recover it. 00:28:02.438 [2024-11-28 19:16:22.989895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.990077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.990102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.438 qpair failed and we were unable to recover it. 00:28:02.438 [2024-11-28 19:16:22.990221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.990352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.990380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.438 qpair failed and we were unable to recover it. 00:28:02.438 [2024-11-28 19:16:22.990505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.990621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.990645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.438 qpair failed and we were unable to recover it. 00:28:02.438 [2024-11-28 19:16:22.990757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.990895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.990919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.438 qpair failed and we were unable to recover it. 00:28:02.438 [2024-11-28 19:16:22.990999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.991112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.991137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.438 qpair failed and we were unable to recover it. 00:28:02.438 [2024-11-28 19:16:22.991211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.991328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.991352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.438 qpair failed and we were unable to recover it. 00:28:02.438 [2024-11-28 19:16:22.991473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.991572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.991597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.438 qpair failed and we were unable to recover it. 00:28:02.438 [2024-11-28 19:16:22.991690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.991817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.991845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.438 qpair failed and we were unable to recover it. 00:28:02.438 [2024-11-28 19:16:22.991975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.992089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.992114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.438 qpair failed and we were unable to recover it. 00:28:02.438 [2024-11-28 19:16:22.992202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.992340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.992364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.438 qpair failed and we were unable to recover it. 00:28:02.438 [2024-11-28 19:16:22.992490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.992585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.438 [2024-11-28 19:16:22.992611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.438 qpair failed and we were unable to recover it. 00:28:02.439 [2024-11-28 19:16:22.992724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.992858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.992883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.439 qpair failed and we were unable to recover it. 00:28:02.439 [2024-11-28 19:16:22.993006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.993166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.993190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.439 qpair failed and we were unable to recover it. 00:28:02.439 [2024-11-28 19:16:22.993277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.993408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.993436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.439 qpair failed and we were unable to recover it. 00:28:02.439 [2024-11-28 19:16:22.993559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.993661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.993685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.439 qpair failed and we were unable to recover it. 00:28:02.439 [2024-11-28 19:16:22.993769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.993897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.993926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.439 qpair failed and we were unable to recover it. 00:28:02.439 [2024-11-28 19:16:22.994029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.994120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.994161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.439 qpair failed and we were unable to recover it. 00:28:02.439 [2024-11-28 19:16:22.994251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.994362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.994387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.439 qpair failed and we were unable to recover it. 00:28:02.439 [2024-11-28 19:16:22.994536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.994653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.994681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.439 qpair failed and we were unable to recover it. 00:28:02.439 [2024-11-28 19:16:22.994801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.994956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.994981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.439 qpair failed and we were unable to recover it. 00:28:02.439 [2024-11-28 19:16:22.995071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.995181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.995206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.439 qpair failed and we were unable to recover it. 00:28:02.439 [2024-11-28 19:16:22.995317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.995464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.995490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.439 qpair failed and we were unable to recover it. 00:28:02.439 [2024-11-28 19:16:22.995625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.995774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.995802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.439 qpair failed and we were unable to recover it. 00:28:02.439 [2024-11-28 19:16:22.995929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.996064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.996088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.439 qpair failed and we were unable to recover it. 00:28:02.439 [2024-11-28 19:16:22.996194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.996291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.996320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.439 qpair failed and we were unable to recover it. 00:28:02.439 [2024-11-28 19:16:22.996476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.996645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.996670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.439 qpair failed and we were unable to recover it. 00:28:02.439 [2024-11-28 19:16:22.996810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.996889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.996913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.439 qpair failed and we were unable to recover it. 00:28:02.439 [2024-11-28 19:16:22.997002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.997114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.997139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.439 qpair failed and we were unable to recover it. 00:28:02.439 [2024-11-28 19:16:22.997283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.997380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.997431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.439 qpair failed and we were unable to recover it. 00:28:02.439 [2024-11-28 19:16:22.997561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.997675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.997701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.439 qpair failed and we were unable to recover it. 00:28:02.439 [2024-11-28 19:16:22.997864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.998029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.998054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.439 qpair failed and we were unable to recover it. 00:28:02.439 [2024-11-28 19:16:22.998138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.998219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.439 [2024-11-28 19:16:22.998248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.439 qpair failed and we were unable to recover it. 00:28:02.439 [2024-11-28 19:16:22.998390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:22.998516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:22.998540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.440 qpair failed and we were unable to recover it. 00:28:02.440 [2024-11-28 19:16:22.998683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:22.998804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:22.998831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.440 qpair failed and we were unable to recover it. 00:28:02.440 [2024-11-28 19:16:22.998921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:22.999022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:22.999048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.440 qpair failed and we were unable to recover it. 00:28:02.440 [2024-11-28 19:16:22.999156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:22.999265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:22.999289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.440 qpair failed and we were unable to recover it. 00:28:02.440 [2024-11-28 19:16:22.999407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:22.999569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:22.999594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.440 qpair failed and we were unable to recover it. 00:28:02.440 [2024-11-28 19:16:22.999719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:22.999833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:22.999857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.440 qpair failed and we were unable to recover it. 00:28:02.440 [2024-11-28 19:16:22.999973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:23.000054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:23.000079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.440 qpair failed and we were unable to recover it. 00:28:02.440 [2024-11-28 19:16:23.000170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:23.000280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:23.000304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.440 qpair failed and we were unable to recover it. 00:28:02.440 [2024-11-28 19:16:23.000422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:23.000538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:23.000562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.440 qpair failed and we were unable to recover it. 00:28:02.440 [2024-11-28 19:16:23.000677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:23.000788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:23.000812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.440 qpair failed and we were unable to recover it. 00:28:02.440 [2024-11-28 19:16:23.000925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:23.001053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:23.001081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.440 qpair failed and we were unable to recover it. 00:28:02.440 [2024-11-28 19:16:23.001172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:23.001259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:23.001288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.440 qpair failed and we were unable to recover it. 00:28:02.440 [2024-11-28 19:16:23.001426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:23.001544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:23.001569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.440 qpair failed and we were unable to recover it. 00:28:02.440 [2024-11-28 19:16:23.001708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:23.001817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:23.001844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.440 qpair failed and we were unable to recover it. 00:28:02.440 [2024-11-28 19:16:23.001945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:23.002109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:23.002133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.440 qpair failed and we were unable to recover it. 00:28:02.440 [2024-11-28 19:16:23.002245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:23.002337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:23.002362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.440 qpair failed and we were unable to recover it. 00:28:02.440 [2024-11-28 19:16:23.002484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:23.002603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:23.002628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.440 qpair failed and we were unable to recover it. 00:28:02.440 [2024-11-28 19:16:23.002746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:23.002875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:23.002904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.440 qpair failed and we were unable to recover it. 00:28:02.440 [2024-11-28 19:16:23.003051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:23.003166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:23.003191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.440 qpair failed and we were unable to recover it. 00:28:02.440 [2024-11-28 19:16:23.003308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:23.003448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:23.003473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.440 qpair failed and we were unable to recover it. 00:28:02.440 [2024-11-28 19:16:23.003616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:23.003742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:23.003769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.440 qpair failed and we were unable to recover it. 00:28:02.440 [2024-11-28 19:16:23.003882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.440 [2024-11-28 19:16:23.004017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.004041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.441 qpair failed and we were unable to recover it. 00:28:02.441 [2024-11-28 19:16:23.004158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.004243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.004267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.441 qpair failed and we were unable to recover it. 00:28:02.441 [2024-11-28 19:16:23.004412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.004533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.004557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.441 qpair failed and we were unable to recover it. 00:28:02.441 [2024-11-28 19:16:23.004639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.004775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.004800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.441 qpair failed and we were unable to recover it. 00:28:02.441 [2024-11-28 19:16:23.004930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.005050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.005077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.441 qpair failed and we were unable to recover it. 00:28:02.441 [2024-11-28 19:16:23.005225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.005358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.005384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.441 qpair failed and we were unable to recover it. 00:28:02.441 [2024-11-28 19:16:23.005504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.005621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.005647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.441 qpair failed and we were unable to recover it. 00:28:02.441 [2024-11-28 19:16:23.005749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.005836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.005864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.441 qpair failed and we were unable to recover it. 00:28:02.441 [2024-11-28 19:16:23.005951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.006075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.006102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.441 qpair failed and we were unable to recover it. 00:28:02.441 [2024-11-28 19:16:23.006210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.006296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.006320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.441 qpair failed and we were unable to recover it. 00:28:02.441 [2024-11-28 19:16:23.006464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.006598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.006626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.441 qpair failed and we were unable to recover it. 00:28:02.441 [2024-11-28 19:16:23.006726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.006812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.006839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.441 qpair failed and we were unable to recover it. 00:28:02.441 [2024-11-28 19:16:23.006976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.007060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.007084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.441 qpair failed and we were unable to recover it. 00:28:02.441 [2024-11-28 19:16:23.007189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.007312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.007340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.441 qpair failed and we were unable to recover it. 00:28:02.441 [2024-11-28 19:16:23.007438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.007540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.007568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.441 qpair failed and we were unable to recover it. 00:28:02.441 [2024-11-28 19:16:23.007706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.007814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.007839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.441 qpair failed and we were unable to recover it. 00:28:02.441 [2024-11-28 19:16:23.007926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.008031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.008055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.441 qpair failed and we were unable to recover it. 00:28:02.441 [2024-11-28 19:16:23.008222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.008319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.008347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.441 qpair failed and we were unable to recover it. 00:28:02.441 [2024-11-28 19:16:23.008500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.008582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.008608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.441 qpair failed and we were unable to recover it. 00:28:02.441 [2024-11-28 19:16:23.008694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.008832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.008857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.441 qpair failed and we were unable to recover it. 00:28:02.441 [2024-11-28 19:16:23.008939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.009046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.009088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.441 qpair failed and we were unable to recover it. 00:28:02.441 [2024-11-28 19:16:23.009201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.009347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.441 [2024-11-28 19:16:23.009372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.441 qpair failed and we were unable to recover it. 00:28:02.441 [2024-11-28 19:16:23.009475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.009590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.009615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.442 qpair failed and we were unable to recover it. 00:28:02.442 [2024-11-28 19:16:23.009778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.009903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.009932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.442 qpair failed and we were unable to recover it. 00:28:02.442 [2024-11-28 19:16:23.010072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.010189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.010214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.442 qpair failed and we were unable to recover it. 00:28:02.442 [2024-11-28 19:16:23.010345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.010469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.010497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.442 qpair failed and we were unable to recover it. 00:28:02.442 [2024-11-28 19:16:23.010627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.010820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.010848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.442 qpair failed and we were unable to recover it. 00:28:02.442 [2024-11-28 19:16:23.011012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.011154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.011179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.442 qpair failed and we were unable to recover it. 00:28:02.442 [2024-11-28 19:16:23.011294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.011419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.011449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.442 qpair failed and we were unable to recover it. 00:28:02.442 [2024-11-28 19:16:23.011549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.011666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.011702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.442 qpair failed and we were unable to recover it. 00:28:02.442 [2024-11-28 19:16:23.011813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.011922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.011948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.442 qpair failed and we were unable to recover it. 00:28:02.442 [2024-11-28 19:16:23.012108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.012263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.012292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.442 qpair failed and we were unable to recover it. 00:28:02.442 [2024-11-28 19:16:23.012442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.012601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.012626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.442 qpair failed and we were unable to recover it. 00:28:02.442 [2024-11-28 19:16:23.012742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.012821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.012846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.442 qpair failed and we were unable to recover it. 00:28:02.442 [2024-11-28 19:16:23.012969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.013111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.013136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.442 qpair failed and we were unable to recover it. 00:28:02.442 [2024-11-28 19:16:23.013228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.013335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.013360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.442 qpair failed and we were unable to recover it. 00:28:02.442 [2024-11-28 19:16:23.013511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.013618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.013643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.442 qpair failed and we were unable to recover it. 00:28:02.442 [2024-11-28 19:16:23.013753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.013861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.013885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.442 qpair failed and we were unable to recover it. 00:28:02.442 [2024-11-28 19:16:23.014016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.014134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.014162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.442 qpair failed and we were unable to recover it. 00:28:02.442 [2024-11-28 19:16:23.014328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.014437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.014466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.442 qpair failed and we were unable to recover it. 00:28:02.442 [2024-11-28 19:16:23.014598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.014681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.442 [2024-11-28 19:16:23.014722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.443 qpair failed and we were unable to recover it. 00:28:02.443 [2024-11-28 19:16:23.014815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.014929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.014971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.443 qpair failed and we were unable to recover it. 00:28:02.443 [2024-11-28 19:16:23.015110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.015188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.015212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.443 qpair failed and we were unable to recover it. 00:28:02.443 [2024-11-28 19:16:23.015330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.015468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.015493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.443 qpair failed and we were unable to recover it. 00:28:02.443 [2024-11-28 19:16:23.015666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.015806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.015831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.443 qpair failed and we were unable to recover it. 00:28:02.443 [2024-11-28 19:16:23.015940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.016048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.016073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.443 qpair failed and we were unable to recover it. 00:28:02.443 [2024-11-28 19:16:23.016192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.016328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.016353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.443 qpair failed and we were unable to recover it. 00:28:02.443 [2024-11-28 19:16:23.016529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.016665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.016690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.443 qpair failed and we were unable to recover it. 00:28:02.443 [2024-11-28 19:16:23.016829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.016937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.016962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.443 qpair failed and we were unable to recover it. 00:28:02.443 [2024-11-28 19:16:23.017099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.017233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.017257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.443 qpair failed and we were unable to recover it. 00:28:02.443 [2024-11-28 19:16:23.017378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.017516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.017541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.443 qpair failed and we were unable to recover it. 00:28:02.443 [2024-11-28 19:16:23.017620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.017761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.017786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.443 qpair failed and we were unable to recover it. 00:28:02.443 [2024-11-28 19:16:23.017873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.017967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.017995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.443 qpair failed and we were unable to recover it. 00:28:02.443 [2024-11-28 19:16:23.018091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.018210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.018237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.443 qpair failed and we were unable to recover it. 00:28:02.443 [2024-11-28 19:16:23.018354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.018450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.018476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.443 qpair failed and we were unable to recover it. 00:28:02.443 [2024-11-28 19:16:23.018559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.018714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.018742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.443 qpair failed and we were unable to recover it. 00:28:02.443 [2024-11-28 19:16:23.018844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.018937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.018982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.443 qpair failed and we were unable to recover it. 00:28:02.443 [2024-11-28 19:16:23.019107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.019187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.019212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.443 qpair failed and we were unable to recover it. 00:28:02.443 [2024-11-28 19:16:23.019351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.019441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.019467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.443 qpair failed and we were unable to recover it. 00:28:02.443 [2024-11-28 19:16:23.019556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.019639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.019664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.443 qpair failed and we were unable to recover it. 00:28:02.443 [2024-11-28 19:16:23.019812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.019950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.019975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.443 qpair failed and we were unable to recover it. 00:28:02.443 [2024-11-28 19:16:23.020061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.020237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.020262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.443 qpair failed and we were unable to recover it. 00:28:02.443 [2024-11-28 19:16:23.020382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.443 [2024-11-28 19:16:23.020521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.020546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.444 qpair failed and we were unable to recover it. 00:28:02.444 [2024-11-28 19:16:23.020639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.020752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.020776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.444 qpair failed and we were unable to recover it. 00:28:02.444 [2024-11-28 19:16:23.020916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.021049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.021075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.444 qpair failed and we were unable to recover it. 00:28:02.444 [2024-11-28 19:16:23.021167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.021293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.021320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.444 qpair failed and we were unable to recover it. 00:28:02.444 [2024-11-28 19:16:23.021455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.021536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.021560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.444 qpair failed and we were unable to recover it. 00:28:02.444 [2024-11-28 19:16:23.021711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.021830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.021859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.444 qpair failed and we were unable to recover it. 00:28:02.444 [2024-11-28 19:16:23.021953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.022069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.022097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.444 qpair failed and we were unable to recover it. 00:28:02.444 [2024-11-28 19:16:23.022222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.022359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.022384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.444 qpair failed and we were unable to recover it. 00:28:02.444 [2024-11-28 19:16:23.022477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.022591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.022615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.444 qpair failed and we were unable to recover it. 00:28:02.444 [2024-11-28 19:16:23.022781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.022894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.022922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.444 qpair failed and we were unable to recover it. 00:28:02.444 [2024-11-28 19:16:23.023086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.023220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.023245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.444 qpair failed and we were unable to recover it. 00:28:02.444 [2024-11-28 19:16:23.023332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.023444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.023471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.444 qpair failed and we were unable to recover it. 00:28:02.444 [2024-11-28 19:16:23.023622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.023741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.023768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.444 qpair failed and we were unable to recover it. 00:28:02.444 [2024-11-28 19:16:23.023930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.024012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.024038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.444 qpair failed and we were unable to recover it. 00:28:02.444 [2024-11-28 19:16:23.024128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.024240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.024264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.444 qpair failed and we were unable to recover it. 00:28:02.444 [2024-11-28 19:16:23.024351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.024499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.024528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.444 qpair failed and we were unable to recover it. 00:28:02.444 [2024-11-28 19:16:23.024660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.024775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.024799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.444 qpair failed and we were unable to recover it. 00:28:02.444 [2024-11-28 19:16:23.024887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.024998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.025022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.444 qpair failed and we were unable to recover it. 00:28:02.444 [2024-11-28 19:16:23.025104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.025218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.025242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.444 qpair failed and we were unable to recover it. 00:28:02.444 [2024-11-28 19:16:23.025363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.025502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.025528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.444 qpair failed and we were unable to recover it. 00:28:02.444 [2024-11-28 19:16:23.025652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.025772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.025800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.444 qpair failed and we were unable to recover it. 00:28:02.444 [2024-11-28 19:16:23.025923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.026029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.444 [2024-11-28 19:16:23.026054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.445 qpair failed and we were unable to recover it. 00:28:02.445 [2024-11-28 19:16:23.026162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.026299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.026323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.445 qpair failed and we were unable to recover it. 00:28:02.445 [2024-11-28 19:16:23.026482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.026596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.026621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.445 qpair failed and we were unable to recover it. 00:28:02.445 [2024-11-28 19:16:23.026724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.026812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.026855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.445 qpair failed and we were unable to recover it. 00:28:02.445 [2024-11-28 19:16:23.026963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.027076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.027100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.445 qpair failed and we were unable to recover it. 00:28:02.445 [2024-11-28 19:16:23.027201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.027285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.027309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.445 qpair failed and we were unable to recover it. 00:28:02.445 [2024-11-28 19:16:23.027426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.027576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.027601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.445 qpair failed and we were unable to recover it. 00:28:02.445 [2024-11-28 19:16:23.027683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.027798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.027827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.445 qpair failed and we were unable to recover it. 00:28:02.445 [2024-11-28 19:16:23.027935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.028017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.028041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.445 qpair failed and we were unable to recover it. 00:28:02.445 [2024-11-28 19:16:23.028159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.028268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.028312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.445 qpair failed and we were unable to recover it. 00:28:02.445 [2024-11-28 19:16:23.028453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.028577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.028602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.445 qpair failed and we were unable to recover it. 00:28:02.445 [2024-11-28 19:16:23.028754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.028882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.028910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.445 qpair failed and we were unable to recover it. 00:28:02.445 [2024-11-28 19:16:23.029032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.029144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.029170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.445 qpair failed and we were unable to recover it. 00:28:02.445 [2024-11-28 19:16:23.029309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.029403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.029430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.445 qpair failed and we were unable to recover it. 00:28:02.445 [2024-11-28 19:16:23.029512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.029601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.029625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.445 qpair failed and we were unable to recover it. 00:28:02.445 [2024-11-28 19:16:23.029732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.029866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.029893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.445 qpair failed and we were unable to recover it. 00:28:02.445 [2024-11-28 19:16:23.030024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.030134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.030159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.445 qpair failed and we were unable to recover it. 00:28:02.445 [2024-11-28 19:16:23.030267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.030385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.030421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.445 qpair failed and we were unable to recover it. 00:28:02.445 [2024-11-28 19:16:23.030590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.030732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.030757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.445 qpair failed and we were unable to recover it. 00:28:02.445 [2024-11-28 19:16:23.030848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.030965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.030989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.445 qpair failed and we were unable to recover it. 00:28:02.445 [2024-11-28 19:16:23.031096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.031228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.031256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.445 qpair failed and we were unable to recover it. 00:28:02.445 [2024-11-28 19:16:23.031378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.031505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.031533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.445 qpair failed and we were unable to recover it. 00:28:02.445 [2024-11-28 19:16:23.031663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.031774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.445 [2024-11-28 19:16:23.031799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.446 qpair failed and we were unable to recover it. 00:28:02.446 [2024-11-28 19:16:23.031939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.032076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.032100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.446 qpair failed and we were unable to recover it. 00:28:02.446 [2024-11-28 19:16:23.032190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.032277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.032303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.446 qpair failed and we were unable to recover it. 00:28:02.446 [2024-11-28 19:16:23.032415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.032490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.032515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.446 qpair failed and we were unable to recover it. 00:28:02.446 [2024-11-28 19:16:23.032669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.032804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.032831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.446 qpair failed and we were unable to recover it. 00:28:02.446 [2024-11-28 19:16:23.032923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.033072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.033112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.446 qpair failed and we were unable to recover it. 00:28:02.446 [2024-11-28 19:16:23.033232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.033314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.033338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.446 qpair failed and we were unable to recover it. 00:28:02.446 [2024-11-28 19:16:23.033474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.033558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.033600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.446 qpair failed and we were unable to recover it. 00:28:02.446 [2024-11-28 19:16:23.033689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.033836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.033864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.446 qpair failed and we were unable to recover it. 00:28:02.446 [2024-11-28 19:16:23.034004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.034115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.034139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.446 qpair failed and we were unable to recover it. 00:28:02.446 [2024-11-28 19:16:23.034227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.034309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.034334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.446 qpair failed and we were unable to recover it. 00:28:02.446 [2024-11-28 19:16:23.034479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.034633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.034658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.446 qpair failed and we were unable to recover it. 00:28:02.446 [2024-11-28 19:16:23.034770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.034912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.034937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.446 qpair failed and we were unable to recover it. 00:28:02.446 [2024-11-28 19:16:23.035109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.035234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.035261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.446 qpair failed and we were unable to recover it. 00:28:02.446 [2024-11-28 19:16:23.035384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.035487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.035515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.446 qpair failed and we were unable to recover it. 00:28:02.446 [2024-11-28 19:16:23.035622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.035726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.035751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.446 qpair failed and we were unable to recover it. 00:28:02.446 [2024-11-28 19:16:23.035858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.035980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.036007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.446 qpair failed and we were unable to recover it. 00:28:02.446 [2024-11-28 19:16:23.036090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.036189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.036213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.446 qpair failed and we were unable to recover it. 00:28:02.446 [2024-11-28 19:16:23.036299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.036404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.036431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.446 qpair failed and we were unable to recover it. 00:28:02.446 [2024-11-28 19:16:23.036552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.036661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.036688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.446 qpair failed and we were unable to recover it. 00:28:02.446 [2024-11-28 19:16:23.036777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.036882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.036907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.446 qpair failed and we were unable to recover it. 00:28:02.446 [2024-11-28 19:16:23.037029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.037139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.446 [2024-11-28 19:16:23.037164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.446 qpair failed and we were unable to recover it. 00:28:02.446 [2024-11-28 19:16:23.037315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.037434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.037463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.447 qpair failed and we were unable to recover it. 00:28:02.447 [2024-11-28 19:16:23.037561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.037659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.037687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.447 qpair failed and we were unable to recover it. 00:28:02.447 [2024-11-28 19:16:23.037822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.037936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.037961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.447 qpair failed and we were unable to recover it. 00:28:02.447 [2024-11-28 19:16:23.038069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.038184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.038213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.447 qpair failed and we were unable to recover it. 00:28:02.447 [2024-11-28 19:16:23.038305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.038473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.038499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.447 qpair failed and we were unable to recover it. 00:28:02.447 [2024-11-28 19:16:23.038642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.038790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.038815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.447 qpair failed and we were unable to recover it. 00:28:02.447 [2024-11-28 19:16:23.038954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.039085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.039112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.447 qpair failed and we were unable to recover it. 00:28:02.447 [2024-11-28 19:16:23.039233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.039369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.039398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.447 qpair failed and we were unable to recover it. 00:28:02.447 [2024-11-28 19:16:23.039513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.039623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.039647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.447 qpair failed and we were unable to recover it. 00:28:02.447 [2024-11-28 19:16:23.039756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.039887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.039912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.447 qpair failed and we were unable to recover it. 00:28:02.447 [2024-11-28 19:16:23.040026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.040184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.040211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.447 qpair failed and we were unable to recover it. 00:28:02.447 [2024-11-28 19:16:23.040342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.040455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.040481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.447 qpair failed and we were unable to recover it. 00:28:02.447 [2024-11-28 19:16:23.040583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.040741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.040765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.447 qpair failed and we were unable to recover it. 00:28:02.447 [2024-11-28 19:16:23.040886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.041044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.041072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.447 qpair failed and we were unable to recover it. 00:28:02.447 [2024-11-28 19:16:23.041171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.041280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.041309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.447 qpair failed and we were unable to recover it. 00:28:02.447 [2024-11-28 19:16:23.041430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.041513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.041539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.447 qpair failed and we were unable to recover it. 00:28:02.447 [2024-11-28 19:16:23.041679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.041762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.041787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.447 qpair failed and we were unable to recover it. 00:28:02.447 [2024-11-28 19:16:23.041872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.041958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.041982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.447 qpair failed and we were unable to recover it. 00:28:02.447 [2024-11-28 19:16:23.042082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.042194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.042218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.447 qpair failed and we were unable to recover it. 00:28:02.447 [2024-11-28 19:16:23.042338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.042461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.042489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.447 qpair failed and we were unable to recover it. 00:28:02.447 [2024-11-28 19:16:23.042599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.042706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.042730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.447 qpair failed and we were unable to recover it. 00:28:02.447 [2024-11-28 19:16:23.042813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.042925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.042950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.447 qpair failed and we were unable to recover it. 00:28:02.447 [2024-11-28 19:16:23.043029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.043143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.043167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.447 qpair failed and we were unable to recover it. 00:28:02.447 [2024-11-28 19:16:23.043260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.043422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.447 [2024-11-28 19:16:23.043448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.447 qpair failed and we were unable to recover it. 00:28:02.447 [2024-11-28 19:16:23.043583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.043701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.043728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.448 qpair failed and we were unable to recover it. 00:28:02.448 [2024-11-28 19:16:23.043862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.043998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.044023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.448 qpair failed and we were unable to recover it. 00:28:02.448 [2024-11-28 19:16:23.044143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.044256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.044281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.448 qpair failed and we were unable to recover it. 00:28:02.448 [2024-11-28 19:16:23.044414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.044524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.044552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.448 qpair failed and we were unable to recover it. 00:28:02.448 [2024-11-28 19:16:23.044679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.044805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.044830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.448 qpair failed and we were unable to recover it. 00:28:02.448 [2024-11-28 19:16:23.044917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.045028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.045052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.448 qpair failed and we were unable to recover it. 00:28:02.448 [2024-11-28 19:16:23.045139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.045248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.045272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.448 qpair failed and we were unable to recover it. 00:28:02.448 [2024-11-28 19:16:23.045388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.045484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.045508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.448 qpair failed and we were unable to recover it. 00:28:02.448 [2024-11-28 19:16:23.045588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.045698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.045722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.448 qpair failed and we were unable to recover it. 00:28:02.448 [2024-11-28 19:16:23.045833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.045947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.045976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.448 qpair failed and we were unable to recover it. 00:28:02.448 [2024-11-28 19:16:23.046097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.046191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.046218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.448 qpair failed and we were unable to recover it. 00:28:02.448 [2024-11-28 19:16:23.046387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.046475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.046500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.448 qpair failed and we were unable to recover it. 00:28:02.448 [2024-11-28 19:16:23.046615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.046731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.046757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.448 qpair failed and we were unable to recover it. 00:28:02.448 [2024-11-28 19:16:23.046855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.046936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.046962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.448 qpair failed and we were unable to recover it. 00:28:02.448 [2024-11-28 19:16:23.047078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.047164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.047189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.448 qpair failed and we were unable to recover it. 00:28:02.448 [2024-11-28 19:16:23.047350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.047455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.047483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.448 qpair failed and we were unable to recover it. 00:28:02.448 [2024-11-28 19:16:23.047603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.047697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.047724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.448 qpair failed and we were unable to recover it. 00:28:02.448 [2024-11-28 19:16:23.047850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.047988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.048013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.448 qpair failed and we were unable to recover it. 00:28:02.448 [2024-11-28 19:16:23.048121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.048236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.048263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.448 qpair failed and we were unable to recover it. 00:28:02.448 [2024-11-28 19:16:23.048387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.448 [2024-11-28 19:16:23.048515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.048544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.449 qpair failed and we were unable to recover it. 00:28:02.449 [2024-11-28 19:16:23.048682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.048768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.048793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.449 qpair failed and we were unable to recover it. 00:28:02.449 [2024-11-28 19:16:23.048910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.049031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.049060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.449 qpair failed and we were unable to recover it. 00:28:02.449 [2024-11-28 19:16:23.049161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.049250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.049277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.449 qpair failed and we were unable to recover it. 00:28:02.449 [2024-11-28 19:16:23.049386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.049482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.049508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.449 qpair failed and we were unable to recover it. 00:28:02.449 [2024-11-28 19:16:23.049620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.049758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.049801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.449 qpair failed and we were unable to recover it. 00:28:02.449 [2024-11-28 19:16:23.049932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.050045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.050072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.449 qpair failed and we were unable to recover it. 00:28:02.449 [2024-11-28 19:16:23.050182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.050292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.050317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.449 qpair failed and we were unable to recover it. 00:28:02.449 [2024-11-28 19:16:23.050430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.050568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.050594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.449 qpair failed and we were unable to recover it. 00:28:02.449 [2024-11-28 19:16:23.050723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.050839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.050866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.449 qpair failed and we were unable to recover it. 00:28:02.449 [2024-11-28 19:16:23.050996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.051086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.051112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.449 qpair failed and we were unable to recover it. 00:28:02.449 [2024-11-28 19:16:23.051226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.051340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.051380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.449 qpair failed and we were unable to recover it. 00:28:02.449 [2024-11-28 19:16:23.051537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.051715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.051741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.449 qpair failed and we were unable to recover it. 00:28:02.449 [2024-11-28 19:16:23.051852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.051959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.051984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.449 qpair failed and we were unable to recover it. 00:28:02.449 [2024-11-28 19:16:23.052104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.052214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.052240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.449 qpair failed and we were unable to recover it. 00:28:02.449 [2024-11-28 19:16:23.052356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.052464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.052489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.449 qpair failed and we were unable to recover it. 00:28:02.449 [2024-11-28 19:16:23.052573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.052688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.052714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.449 qpair failed and we were unable to recover it. 00:28:02.449 [2024-11-28 19:16:23.052876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.053008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.053033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.449 qpair failed and we were unable to recover it. 00:28:02.449 [2024-11-28 19:16:23.053117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.053207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.053231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.449 qpair failed and we were unable to recover it. 00:28:02.449 [2024-11-28 19:16:23.053384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.053503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.053527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.449 qpair failed and we were unable to recover it. 00:28:02.449 [2024-11-28 19:16:23.053668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.053804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.053828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.449 qpair failed and we were unable to recover it. 00:28:02.449 [2024-11-28 19:16:23.053946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.054025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.054049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.449 qpair failed and we were unable to recover it. 00:28:02.449 [2024-11-28 19:16:23.054165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.054302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.054331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.449 qpair failed and we were unable to recover it. 00:28:02.449 [2024-11-28 19:16:23.054480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.449 [2024-11-28 19:16:23.054596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.054620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.450 qpair failed and we were unable to recover it. 00:28:02.450 [2024-11-28 19:16:23.054772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.054899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.054926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.450 qpair failed and we were unable to recover it. 00:28:02.450 [2024-11-28 19:16:23.055039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.055120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.055145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.450 qpair failed and we were unable to recover it. 00:28:02.450 [2024-11-28 19:16:23.055299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.055377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.055412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.450 qpair failed and we were unable to recover it. 00:28:02.450 [2024-11-28 19:16:23.055533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.055665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.055690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.450 qpair failed and we were unable to recover it. 00:28:02.450 [2024-11-28 19:16:23.055811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.055897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.055922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.450 qpair failed and we were unable to recover it. 00:28:02.450 [2024-11-28 19:16:23.056033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.056162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.056203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.450 qpair failed and we were unable to recover it. 00:28:02.450 [2024-11-28 19:16:23.056311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.056461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.056489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.450 qpair failed and we were unable to recover it. 00:28:02.450 [2024-11-28 19:16:23.056638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.056725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.056750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.450 qpair failed and we were unable to recover it. 00:28:02.450 [2024-11-28 19:16:23.056859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.056964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.057005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.450 qpair failed and we were unable to recover it. 00:28:02.450 [2024-11-28 19:16:23.057104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.057234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.057263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.450 qpair failed and we were unable to recover it. 00:28:02.450 [2024-11-28 19:16:23.057372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.057469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.057494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.450 qpair failed and we were unable to recover it. 00:28:02.450 [2024-11-28 19:16:23.057576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.057713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.057740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.450 qpair failed and we were unable to recover it. 00:28:02.450 [2024-11-28 19:16:23.057862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.057985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.058025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.450 qpair failed and we were unable to recover it. 00:28:02.450 [2024-11-28 19:16:23.058107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.058247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.058271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.450 qpair failed and we were unable to recover it. 00:28:02.450 [2024-11-28 19:16:23.058377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.058504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.058529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.450 qpair failed and we were unable to recover it. 00:28:02.450 [2024-11-28 19:16:23.058617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.058753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.058780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.450 qpair failed and we were unable to recover it. 00:28:02.450 [2024-11-28 19:16:23.058950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.059089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.059130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.450 qpair failed and we were unable to recover it. 00:28:02.450 [2024-11-28 19:16:23.059222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.059308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.059335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.450 qpair failed and we were unable to recover it. 00:28:02.450 [2024-11-28 19:16:23.059478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.059560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.059585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.450 qpair failed and we were unable to recover it. 00:28:02.450 [2024-11-28 19:16:23.059730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.059839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.059865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.450 qpair failed and we were unable to recover it. 00:28:02.450 [2024-11-28 19:16:23.059983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.060122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.060148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.450 qpair failed and we were unable to recover it. 00:28:02.450 [2024-11-28 19:16:23.060285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.060371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.060417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.450 qpair failed and we were unable to recover it. 00:28:02.450 [2024-11-28 19:16:23.060537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.060644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.060669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.450 qpair failed and we were unable to recover it. 00:28:02.450 [2024-11-28 19:16:23.060776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.060897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.060926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.450 qpair failed and we were unable to recover it. 00:28:02.450 [2024-11-28 19:16:23.061010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.061124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.061151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.450 qpair failed and we were unable to recover it. 00:28:02.450 [2024-11-28 19:16:23.061255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.450 [2024-11-28 19:16:23.061359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.061384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.451 qpair failed and we were unable to recover it. 00:28:02.451 [2024-11-28 19:16:23.061513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.061607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.061634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.451 qpair failed and we were unable to recover it. 00:28:02.451 [2024-11-28 19:16:23.061761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.061886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.061914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.451 qpair failed and we were unable to recover it. 00:28:02.451 [2024-11-28 19:16:23.062045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.062125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.062149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.451 qpair failed and we were unable to recover it. 00:28:02.451 [2024-11-28 19:16:23.062267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.062424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.062453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.451 qpair failed and we were unable to recover it. 00:28:02.451 [2024-11-28 19:16:23.062549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.062652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.062680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.451 qpair failed and we were unable to recover it. 00:28:02.451 [2024-11-28 19:16:23.062839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.062949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.062973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.451 qpair failed and we were unable to recover it. 00:28:02.451 [2024-11-28 19:16:23.063075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.063188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.063216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.451 qpair failed and we were unable to recover it. 00:28:02.451 [2024-11-28 19:16:23.063316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.063416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.063444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.451 qpair failed and we were unable to recover it. 00:28:02.451 [2024-11-28 19:16:23.063577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.063693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.063717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.451 qpair failed and we were unable to recover it. 00:28:02.451 [2024-11-28 19:16:23.063866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.063983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.064010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.451 qpair failed and we were unable to recover it. 00:28:02.451 [2024-11-28 19:16:23.064103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.064252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.064281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.451 qpair failed and we were unable to recover it. 00:28:02.451 [2024-11-28 19:16:23.064403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.064491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.064517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.451 qpair failed and we were unable to recover it. 00:28:02.451 [2024-11-28 19:16:23.064629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.064764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.064806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.451 qpair failed and we were unable to recover it. 00:28:02.451 [2024-11-28 19:16:23.064947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.065054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.065082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.451 qpair failed and we were unable to recover it. 00:28:02.451 [2024-11-28 19:16:23.065180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.065296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.065321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.451 qpair failed and we were unable to recover it. 00:28:02.451 [2024-11-28 19:16:23.065439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.065534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.065562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.451 qpair failed and we were unable to recover it. 00:28:02.451 [2024-11-28 19:16:23.065690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.065788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.065815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.451 qpair failed and we were unable to recover it. 00:28:02.451 [2024-11-28 19:16:23.065946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.066036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.066060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.451 qpair failed and we were unable to recover it. 00:28:02.451 [2024-11-28 19:16:23.066145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.066223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.066247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.451 qpair failed and we were unable to recover it. 00:28:02.451 [2024-11-28 19:16:23.066356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.066449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.066490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.451 qpair failed and we were unable to recover it. 00:28:02.451 [2024-11-28 19:16:23.066625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.066736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.066760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.451 qpair failed and we were unable to recover it. 00:28:02.451 [2024-11-28 19:16:23.066900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.066994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.067021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.451 qpair failed and we were unable to recover it. 00:28:02.451 [2024-11-28 19:16:23.067137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.067236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.067264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.451 qpair failed and we were unable to recover it. 00:28:02.451 [2024-11-28 19:16:23.067415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.067564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.451 [2024-11-28 19:16:23.067593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.451 qpair failed and we were unable to recover it. 00:28:02.451 [2024-11-28 19:16:23.067700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.067847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.067875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.452 qpair failed and we were unable to recover it. 00:28:02.452 [2024-11-28 19:16:23.068035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.068188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.068213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.452 qpair failed and we were unable to recover it. 00:28:02.452 [2024-11-28 19:16:23.068324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.068412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.068437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.452 qpair failed and we were unable to recover it. 00:28:02.452 [2024-11-28 19:16:23.068517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.068686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.068711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.452 qpair failed and we were unable to recover it. 00:28:02.452 [2024-11-28 19:16:23.068832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.068948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.068977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.452 qpair failed and we were unable to recover it. 00:28:02.452 [2024-11-28 19:16:23.069116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.069263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.069287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.452 qpair failed and we were unable to recover it. 00:28:02.452 [2024-11-28 19:16:23.069430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.069580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.069609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.452 qpair failed and we were unable to recover it. 00:28:02.452 [2024-11-28 19:16:23.069712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.069798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.069824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.452 qpair failed and we were unable to recover it. 00:28:02.452 [2024-11-28 19:16:23.069960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.070073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.070098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.452 qpair failed and we were unable to recover it. 00:28:02.452 [2024-11-28 19:16:23.070208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.070321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.070353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.452 qpair failed and we were unable to recover it. 00:28:02.452 [2024-11-28 19:16:23.070483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.070609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.070636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.452 qpair failed and we were unable to recover it. 00:28:02.452 [2024-11-28 19:16:23.070730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.070859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.070884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.452 qpair failed and we were unable to recover it. 00:28:02.452 [2024-11-28 19:16:23.071018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.071115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.071143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.452 qpair failed and we were unable to recover it. 00:28:02.452 [2024-11-28 19:16:23.071241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.071337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.071366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.452 qpair failed and we were unable to recover it. 00:28:02.452 [2024-11-28 19:16:23.071505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.071588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.071613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.452 qpair failed and we were unable to recover it. 00:28:02.452 [2024-11-28 19:16:23.071742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.071865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.071893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.452 qpair failed and we were unable to recover it. 00:28:02.452 [2024-11-28 19:16:23.071998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.072153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.072182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.452 qpair failed and we were unable to recover it. 00:28:02.452 [2024-11-28 19:16:23.072288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.072403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.072429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.452 qpair failed and we were unable to recover it. 00:28:02.452 [2024-11-28 19:16:23.072572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.072720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.072748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.452 qpair failed and we were unable to recover it. 00:28:02.452 [2024-11-28 19:16:23.072868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.072987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.073014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.452 qpair failed and we were unable to recover it. 00:28:02.452 [2024-11-28 19:16:23.073121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.073246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.073271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.452 qpair failed and we were unable to recover it. 00:28:02.452 [2024-11-28 19:16:23.073364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.073457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.073483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.452 qpair failed and we were unable to recover it. 00:28:02.452 [2024-11-28 19:16:23.073601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.073743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.073770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.452 qpair failed and we were unable to recover it. 00:28:02.452 [2024-11-28 19:16:23.073882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.073997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.074022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.452 qpair failed and we were unable to recover it. 00:28:02.452 [2024-11-28 19:16:23.074152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.074274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.074303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.452 qpair failed and we were unable to recover it. 00:28:02.452 [2024-11-28 19:16:23.074431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.074555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.452 [2024-11-28 19:16:23.074584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.452 qpair failed and we were unable to recover it. 00:28:02.452 [2024-11-28 19:16:23.074694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.074808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.074833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.453 qpair failed and we were unable to recover it. 00:28:02.453 [2024-11-28 19:16:23.074950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.075034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.075059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.453 qpair failed and we were unable to recover it. 00:28:02.453 [2024-11-28 19:16:23.075149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.075254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.075281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.453 qpair failed and we were unable to recover it. 00:28:02.453 [2024-11-28 19:16:23.075403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.075496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.075521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.453 qpair failed and we were unable to recover it. 00:28:02.453 [2024-11-28 19:16:23.075642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.075754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.075780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.453 qpair failed and we were unable to recover it. 00:28:02.453 [2024-11-28 19:16:23.075907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.076055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.076083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.453 qpair failed and we were unable to recover it. 00:28:02.453 [2024-11-28 19:16:23.076193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.076279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.076303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.453 qpair failed and we were unable to recover it. 00:28:02.453 [2024-11-28 19:16:23.076399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.076537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.076564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.453 qpair failed and we were unable to recover it. 00:28:02.453 [2024-11-28 19:16:23.076718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.076846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.076872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.453 qpair failed and we were unable to recover it. 00:28:02.453 [2024-11-28 19:16:23.076990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.077064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.077088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.453 qpair failed and we were unable to recover it. 00:28:02.453 [2024-11-28 19:16:23.077219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.077365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.077399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.453 qpair failed and we were unable to recover it. 00:28:02.453 [2024-11-28 19:16:23.077530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.077622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.077650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.453 qpair failed and we were unable to recover it. 00:28:02.453 [2024-11-28 19:16:23.077765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.077877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.077904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.453 qpair failed and we were unable to recover it. 00:28:02.453 [2024-11-28 19:16:23.078040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.078160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.078188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.453 qpair failed and we were unable to recover it. 00:28:02.453 [2024-11-28 19:16:23.078310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.078447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.078476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.453 qpair failed and we were unable to recover it. 00:28:02.453 [2024-11-28 19:16:23.078596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.078685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.078712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.453 qpair failed and we were unable to recover it. 00:28:02.453 [2024-11-28 19:16:23.078826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.078964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.078992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.453 qpair failed and we were unable to recover it. 00:28:02.453 [2024-11-28 19:16:23.079118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.079220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.079247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.453 qpair failed and we were unable to recover it. 00:28:02.453 [2024-11-28 19:16:23.079412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.079527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.079551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.453 qpair failed and we were unable to recover it. 00:28:02.453 [2024-11-28 19:16:23.079681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.079769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.079797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.453 qpair failed and we were unable to recover it. 00:28:02.453 [2024-11-28 19:16:23.079952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.080065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.080093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.453 qpair failed and we were unable to recover it. 00:28:02.453 [2024-11-28 19:16:23.080202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.080319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.080345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.453 qpair failed and we were unable to recover it. 00:28:02.453 [2024-11-28 19:16:23.080461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.080576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.080601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.453 qpair failed and we were unable to recover it. 00:28:02.453 [2024-11-28 19:16:23.080688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.080796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.080838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.453 qpair failed and we were unable to recover it. 00:28:02.453 [2024-11-28 19:16:23.080952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.453 [2024-11-28 19:16:23.081066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.081093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.454 qpair failed and we were unable to recover it. 00:28:02.454 [2024-11-28 19:16:23.081214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.081334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.081362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.454 qpair failed and we were unable to recover it. 00:28:02.454 [2024-11-28 19:16:23.081490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.081660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.081685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.454 qpair failed and we were unable to recover it. 00:28:02.454 [2024-11-28 19:16:23.081801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.081916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.081940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.454 qpair failed and we were unable to recover it. 00:28:02.454 [2024-11-28 19:16:23.082053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.082182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.082210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.454 qpair failed and we were unable to recover it. 00:28:02.454 [2024-11-28 19:16:23.082298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.082448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.082476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.454 qpair failed and we were unable to recover it. 00:28:02.454 [2024-11-28 19:16:23.082564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.082706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.082730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.454 qpair failed and we were unable to recover it. 00:28:02.454 [2024-11-28 19:16:23.082821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.082906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.082946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.454 qpair failed and we were unable to recover it. 00:28:02.454 [2024-11-28 19:16:23.083076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.083194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.083221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.454 qpair failed and we were unable to recover it. 00:28:02.454 [2024-11-28 19:16:23.083379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.083508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.083533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.454 qpair failed and we were unable to recover it. 00:28:02.454 [2024-11-28 19:16:23.083645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.083743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.083774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.454 qpair failed and we were unable to recover it. 00:28:02.454 [2024-11-28 19:16:23.083907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.084027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.084054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.454 qpair failed and we were unable to recover it. 00:28:02.454 [2024-11-28 19:16:23.084214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.084333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.084358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.454 qpair failed and we were unable to recover it. 00:28:02.454 [2024-11-28 19:16:23.084478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.084605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.084633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.454 qpair failed and we were unable to recover it. 00:28:02.454 [2024-11-28 19:16:23.084717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.084837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.084865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.454 qpair failed and we were unable to recover it. 00:28:02.454 [2024-11-28 19:16:23.085017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.085126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.085151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.454 qpair failed and we were unable to recover it. 00:28:02.454 [2024-11-28 19:16:23.085287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.085405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.085433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.454 qpair failed and we were unable to recover it. 00:28:02.454 [2024-11-28 19:16:23.085526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.085634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.085659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.454 qpair failed and we were unable to recover it. 00:28:02.454 [2024-11-28 19:16:23.085778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.085914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.085939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.454 qpair failed and we were unable to recover it. 00:28:02.454 [2024-11-28 19:16:23.086100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.086248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.086275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.454 qpair failed and we were unable to recover it. 00:28:02.454 [2024-11-28 19:16:23.086401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.086526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.086567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.454 qpair failed and we were unable to recover it. 00:28:02.454 [2024-11-28 19:16:23.086692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.086782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.086807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.454 qpair failed and we were unable to recover it. 00:28:02.454 [2024-11-28 19:16:23.086908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.087039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.087063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.454 qpair failed and we were unable to recover it. 00:28:02.454 [2024-11-28 19:16:23.087174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.087254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.087296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.454 qpair failed and we were unable to recover it. 00:28:02.454 [2024-11-28 19:16:23.087437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.087533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.087558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.454 qpair failed and we were unable to recover it. 00:28:02.454 [2024-11-28 19:16:23.087674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.087805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.087832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.454 qpair failed and we were unable to recover it. 00:28:02.454 [2024-11-28 19:16:23.087960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.088115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.454 [2024-11-28 19:16:23.088142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.455 qpair failed and we were unable to recover it. 00:28:02.455 [2024-11-28 19:16:23.088272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.088410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.088437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.455 qpair failed and we were unable to recover it. 00:28:02.455 [2024-11-28 19:16:23.088576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.088662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.088690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.455 qpair failed and we were unable to recover it. 00:28:02.455 [2024-11-28 19:16:23.088785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.088883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.088910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.455 qpair failed and we were unable to recover it. 00:28:02.455 [2024-11-28 19:16:23.089042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.089130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.089154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.455 qpair failed and we were unable to recover it. 00:28:02.455 [2024-11-28 19:16:23.089268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.089378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.089425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.455 qpair failed and we were unable to recover it. 00:28:02.455 [2024-11-28 19:16:23.089520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.089633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.089660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.455 qpair failed and we were unable to recover it. 00:28:02.455 [2024-11-28 19:16:23.089778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.089875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.089901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.455 qpair failed and we were unable to recover it. 00:28:02.455 [2024-11-28 19:16:23.089998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.090108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.090132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.455 qpair failed and we were unable to recover it. 00:28:02.455 [2024-11-28 19:16:23.090254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.090366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.090399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.455 qpair failed and we were unable to recover it. 00:28:02.455 [2024-11-28 19:16:23.090510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.090618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.090643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.455 qpair failed and we were unable to recover it. 00:28:02.455 [2024-11-28 19:16:23.090763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.090867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.090895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.455 qpair failed and we were unable to recover it. 00:28:02.455 [2024-11-28 19:16:23.090986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.091134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.091162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.455 qpair failed and we were unable to recover it. 00:28:02.455 [2024-11-28 19:16:23.091299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.091389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.091422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.455 qpair failed and we were unable to recover it. 00:28:02.455 [2024-11-28 19:16:23.091501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.091623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.091647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.455 qpair failed and we were unable to recover it. 00:28:02.455 [2024-11-28 19:16:23.091790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.091891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.091919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.455 qpair failed and we were unable to recover it. 00:28:02.455 [2024-11-28 19:16:23.092011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.092112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.092137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.455 qpair failed and we were unable to recover it. 00:28:02.455 [2024-11-28 19:16:23.092256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.092342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.092367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.455 qpair failed and we were unable to recover it. 00:28:02.455 [2024-11-28 19:16:23.092459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.092600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.092625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.455 qpair failed and we were unable to recover it. 00:28:02.455 [2024-11-28 19:16:23.092740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.092880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.092905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.455 qpair failed and we were unable to recover it. 00:28:02.455 [2024-11-28 19:16:23.093047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.093148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.093175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.455 qpair failed and we were unable to recover it. 00:28:02.455 [2024-11-28 19:16:23.093300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.093436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.093462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.455 qpair failed and we were unable to recover it. 00:28:02.455 [2024-11-28 19:16:23.093554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.093666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.093691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.455 qpair failed and we were unable to recover it. 00:28:02.455 [2024-11-28 19:16:23.093770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.093881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.093906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.455 qpair failed and we were unable to recover it. 00:28:02.455 [2024-11-28 19:16:23.094017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.094126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.094151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.455 qpair failed and we were unable to recover it. 00:28:02.455 [2024-11-28 19:16:23.094265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.094352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.094376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.455 qpair failed and we were unable to recover it. 00:28:02.455 [2024-11-28 19:16:23.094525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.094632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.094659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.455 qpair failed and we were unable to recover it. 00:28:02.455 [2024-11-28 19:16:23.094782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.094899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.094926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.455 qpair failed and we were unable to recover it. 00:28:02.455 [2024-11-28 19:16:23.095061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.095171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.095196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.455 qpair failed and we were unable to recover it. 00:28:02.455 [2024-11-28 19:16:23.095297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.455 [2024-11-28 19:16:23.095418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.095445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.456 qpair failed and we were unable to recover it. 00:28:02.456 [2024-11-28 19:16:23.095599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.095749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.095775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.456 qpair failed and we were unable to recover it. 00:28:02.456 [2024-11-28 19:16:23.095886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.096011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.096036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.456 qpair failed and we were unable to recover it. 00:28:02.456 [2024-11-28 19:16:23.096176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.096278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.096305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.456 qpair failed and we were unable to recover it. 00:28:02.456 [2024-11-28 19:16:23.096425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.096520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.096547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.456 qpair failed and we were unable to recover it. 00:28:02.456 [2024-11-28 19:16:23.096709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.096860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.096888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.456 qpair failed and we were unable to recover it. 00:28:02.456 [2024-11-28 19:16:23.096982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.097112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.097145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.456 qpair failed and we were unable to recover it. 00:28:02.456 [2024-11-28 19:16:23.097268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.097384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.097420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.456 qpair failed and we were unable to recover it. 00:28:02.456 [2024-11-28 19:16:23.097561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.097636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.097661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.456 qpair failed and we were unable to recover it. 00:28:02.456 [2024-11-28 19:16:23.097793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.097919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.097947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.456 qpair failed and we were unable to recover it. 00:28:02.456 [2024-11-28 19:16:23.098072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.098173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.098201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.456 qpair failed and we were unable to recover it. 00:28:02.456 [2024-11-28 19:16:23.098336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.098453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.098479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.456 qpair failed and we were unable to recover it. 00:28:02.456 [2024-11-28 19:16:23.098646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.098753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.098777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.456 qpair failed and we were unable to recover it. 00:28:02.456 [2024-11-28 19:16:23.098908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.099030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.099058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.456 qpair failed and we were unable to recover it. 00:28:02.456 [2024-11-28 19:16:23.099162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.099246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.099270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.456 qpair failed and we were unable to recover it. 00:28:02.456 [2024-11-28 19:16:23.099381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.099498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.099525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.456 qpair failed and we were unable to recover it. 00:28:02.456 [2024-11-28 19:16:23.099677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.099789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.099816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.456 qpair failed and we were unable to recover it. 00:28:02.456 [2024-11-28 19:16:23.099927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.100041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.100066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.456 qpair failed and we were unable to recover it. 00:28:02.456 [2024-11-28 19:16:23.100204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.100331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.100359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.456 qpair failed and we were unable to recover it. 00:28:02.456 [2024-11-28 19:16:23.100504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.100618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.100643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.456 qpair failed and we were unable to recover it. 00:28:02.456 [2024-11-28 19:16:23.100733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.100818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.100844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.456 qpair failed and we were unable to recover it. 00:28:02.456 [2024-11-28 19:16:23.100954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.101085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.101128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.456 qpair failed and we were unable to recover it. 00:28:02.456 [2024-11-28 19:16:23.101212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.101319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.101344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.456 qpair failed and we were unable to recover it. 00:28:02.456 [2024-11-28 19:16:23.101458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.101568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.101593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.456 qpair failed and we were unable to recover it. 00:28:02.456 [2024-11-28 19:16:23.101685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.101813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.101854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.456 qpair failed and we were unable to recover it. 00:28:02.456 [2024-11-28 19:16:23.101968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.102076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.102103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.456 qpair failed and we were unable to recover it. 00:28:02.456 [2024-11-28 19:16:23.102194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.102282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.456 [2024-11-28 19:16:23.102307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.456 qpair failed and we were unable to recover it. 00:28:02.456 [2024-11-28 19:16:23.102457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.102561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.102586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.457 qpair failed and we were unable to recover it. 00:28:02.457 [2024-11-28 19:16:23.102701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.102857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.102885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.457 qpair failed and we were unable to recover it. 00:28:02.457 [2024-11-28 19:16:23.103022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.103138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.103163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.457 qpair failed and we were unable to recover it. 00:28:02.457 [2024-11-28 19:16:23.103297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.103421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.103449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.457 qpair failed and we were unable to recover it. 00:28:02.457 [2024-11-28 19:16:23.103572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.103665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.103693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.457 qpair failed and we were unable to recover it. 00:28:02.457 [2024-11-28 19:16:23.103855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.103964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.103988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.457 qpair failed and we were unable to recover it. 00:28:02.457 [2024-11-28 19:16:23.104069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.104153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.104177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.457 qpair failed and we were unable to recover it. 00:28:02.457 [2024-11-28 19:16:23.104268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.104351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.104376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.457 qpair failed and we were unable to recover it. 00:28:02.457 [2024-11-28 19:16:23.104498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.104605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.104631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.457 qpair failed and we were unable to recover it. 00:28:02.457 [2024-11-28 19:16:23.104714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.104829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.104854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.457 qpair failed and we were unable to recover it. 00:28:02.457 [2024-11-28 19:16:23.104934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.105044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.105069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.457 qpair failed and we were unable to recover it. 00:28:02.457 [2024-11-28 19:16:23.105152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.105266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.105290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.457 qpair failed and we were unable to recover it. 00:28:02.457 [2024-11-28 19:16:23.105404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.105498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.105523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.457 qpair failed and we were unable to recover it. 00:28:02.457 [2024-11-28 19:16:23.105635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.105747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.105772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.457 qpair failed and we were unable to recover it. 00:28:02.457 [2024-11-28 19:16:23.105856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.105937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.105962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.457 qpair failed and we were unable to recover it. 00:28:02.457 [2024-11-28 19:16:23.106072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.106168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.106193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.457 qpair failed and we were unable to recover it. 00:28:02.457 [2024-11-28 19:16:23.106303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.106391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.106437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.457 qpair failed and we were unable to recover it. 00:28:02.457 [2024-11-28 19:16:23.106524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.106611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.106635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.457 qpair failed and we were unable to recover it. 00:28:02.457 [2024-11-28 19:16:23.106747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.106864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.106888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.457 qpair failed and we were unable to recover it. 00:28:02.457 [2024-11-28 19:16:23.107015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.107101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.107125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.457 qpair failed and we were unable to recover it. 00:28:02.457 [2024-11-28 19:16:23.107246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.107384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.107416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.457 qpair failed and we were unable to recover it. 00:28:02.457 [2024-11-28 19:16:23.107499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.107584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.107610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.457 qpair failed and we were unable to recover it. 00:28:02.457 [2024-11-28 19:16:23.107750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.107834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.107858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.457 qpair failed and we were unable to recover it. 00:28:02.457 [2024-11-28 19:16:23.107974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.108084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.108109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.457 qpair failed and we were unable to recover it. 00:28:02.457 [2024-11-28 19:16:23.108220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.108293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.108317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.457 qpair failed and we were unable to recover it. 00:28:02.457 [2024-11-28 19:16:23.108406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.108494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.108520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.457 qpair failed and we were unable to recover it. 00:28:02.457 [2024-11-28 19:16:23.108632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.108744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.108769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.457 qpair failed and we were unable to recover it. 00:28:02.457 [2024-11-28 19:16:23.108880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.108988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.109013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.457 qpair failed and we were unable to recover it. 00:28:02.457 [2024-11-28 19:16:23.109125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.109206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.109231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.457 qpair failed and we were unable to recover it. 00:28:02.457 [2024-11-28 19:16:23.109345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.109451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.109476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.457 qpair failed and we were unable to recover it. 00:28:02.457 [2024-11-28 19:16:23.109567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.109677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.457 [2024-11-28 19:16:23.109707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.457 qpair failed and we were unable to recover it. 00:28:02.457 [2024-11-28 19:16:23.109853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.109944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.109969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.458 qpair failed and we were unable to recover it. 00:28:02.458 [2024-11-28 19:16:23.110081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.110192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.110217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.458 qpair failed and we were unable to recover it. 00:28:02.458 [2024-11-28 19:16:23.110327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.110447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.110472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.458 qpair failed and we were unable to recover it. 00:28:02.458 [2024-11-28 19:16:23.110559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.110649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.110674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.458 qpair failed and we were unable to recover it. 00:28:02.458 [2024-11-28 19:16:23.110764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.110878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.110903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.458 qpair failed and we were unable to recover it. 00:28:02.458 [2024-11-28 19:16:23.111018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.111103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.111128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.458 qpair failed and we were unable to recover it. 00:28:02.458 [2024-11-28 19:16:23.111214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.111326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.111350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.458 qpair failed and we were unable to recover it. 00:28:02.458 [2024-11-28 19:16:23.111448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.111539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.111564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.458 qpair failed and we were unable to recover it. 00:28:02.458 [2024-11-28 19:16:23.111653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.111736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.111760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.458 qpair failed and we were unable to recover it. 00:28:02.458 [2024-11-28 19:16:23.111850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.111937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.111967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.458 qpair failed and we were unable to recover it. 00:28:02.458 [2024-11-28 19:16:23.112074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.112190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.112215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.458 qpair failed and we were unable to recover it. 00:28:02.458 [2024-11-28 19:16:23.112352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.112442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.112468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.458 qpair failed and we were unable to recover it. 00:28:02.458 [2024-11-28 19:16:23.112546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.112653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.112678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.458 qpair failed and we were unable to recover it. 00:28:02.458 [2024-11-28 19:16:23.112765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.112881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.112906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.458 qpair failed and we were unable to recover it. 00:28:02.458 [2024-11-28 19:16:23.113020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.113095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.113119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.458 qpair failed and we were unable to recover it. 00:28:02.458 [2024-11-28 19:16:23.113211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.113297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.113323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.458 qpair failed and we were unable to recover it. 00:28:02.458 [2024-11-28 19:16:23.113436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.113542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.113567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.458 qpair failed and we were unable to recover it. 00:28:02.458 [2024-11-28 19:16:23.113685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.113763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.113787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.458 qpair failed and we were unable to recover it. 00:28:02.458 [2024-11-28 19:16:23.113875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.113959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.113984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.458 qpair failed and we were unable to recover it. 00:28:02.458 [2024-11-28 19:16:23.114095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.114183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.114207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.458 qpair failed and we were unable to recover it. 00:28:02.458 [2024-11-28 19:16:23.114289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.114429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.114455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.458 qpair failed and we were unable to recover it. 00:28:02.458 [2024-11-28 19:16:23.114544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.114621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.114646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.458 qpair failed and we were unable to recover it. 00:28:02.458 [2024-11-28 19:16:23.114757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.114863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.114888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.458 qpair failed and we were unable to recover it. 00:28:02.458 [2024-11-28 19:16:23.114967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.115104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.115129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.458 qpair failed and we were unable to recover it. 00:28:02.458 [2024-11-28 19:16:23.115269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.115374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.458 [2024-11-28 19:16:23.115405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.459 qpair failed and we were unable to recover it. 00:28:02.459 [2024-11-28 19:16:23.115501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.115586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.115610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.459 qpair failed and we were unable to recover it. 00:28:02.459 [2024-11-28 19:16:23.115694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.115803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.115828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.459 qpair failed and we were unable to recover it. 00:28:02.459 [2024-11-28 19:16:23.115937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.116049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.116073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.459 qpair failed and we were unable to recover it. 00:28:02.459 [2024-11-28 19:16:23.116221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.116300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.116325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.459 qpair failed and we were unable to recover it. 00:28:02.459 [2024-11-28 19:16:23.116421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.116556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.116581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.459 qpair failed and we were unable to recover it. 00:28:02.459 [2024-11-28 19:16:23.116708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.116792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.116817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.459 qpair failed and we were unable to recover it. 00:28:02.459 [2024-11-28 19:16:23.116927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.117004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.117028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.459 qpair failed and we were unable to recover it. 00:28:02.459 [2024-11-28 19:16:23.117134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.117248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.117272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.459 qpair failed and we were unable to recover it. 00:28:02.459 [2024-11-28 19:16:23.117365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.117449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.117475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.459 qpair failed and we were unable to recover it. 00:28:02.459 [2024-11-28 19:16:23.117570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.117643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.117667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.459 qpair failed and we were unable to recover it. 00:28:02.459 [2024-11-28 19:16:23.117750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.117839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.117864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.459 qpair failed and we were unable to recover it. 00:28:02.459 [2024-11-28 19:16:23.117976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.118058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.118082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.459 qpair failed and we were unable to recover it. 00:28:02.459 [2024-11-28 19:16:23.118167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.118249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.118273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.459 qpair failed and we were unable to recover it. 00:28:02.459 [2024-11-28 19:16:23.118356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.118449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.118475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.459 qpair failed and we were unable to recover it. 00:28:02.459 [2024-11-28 19:16:23.118589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.118679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.118703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.459 qpair failed and we were unable to recover it. 00:28:02.459 [2024-11-28 19:16:23.118820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.118942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.118968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.459 qpair failed and we were unable to recover it. 00:28:02.459 [2024-11-28 19:16:23.119049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.119153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.119178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.459 qpair failed and we were unable to recover it. 00:28:02.459 [2024-11-28 19:16:23.119261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.119377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.119410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.459 qpair failed and we were unable to recover it. 00:28:02.459 [2024-11-28 19:16:23.119551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.119665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.119690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.459 qpair failed and we were unable to recover it. 00:28:02.459 [2024-11-28 19:16:23.119776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.119867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.119892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.459 qpair failed and we were unable to recover it. 00:28:02.459 [2024-11-28 19:16:23.119998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.120069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.120094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.459 qpair failed and we were unable to recover it. 00:28:02.459 [2024-11-28 19:16:23.120235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.120331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.120355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.459 qpair failed and we were unable to recover it. 00:28:02.459 [2024-11-28 19:16:23.120447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.120558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.120582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.459 qpair failed and we were unable to recover it. 00:28:02.459 [2024-11-28 19:16:23.120693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.120773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.120798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.459 qpair failed and we were unable to recover it. 00:28:02.459 [2024-11-28 19:16:23.120883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.120994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.121020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.459 qpair failed and we were unable to recover it. 00:28:02.459 [2024-11-28 19:16:23.121134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.121253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.121278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.459 qpair failed and we were unable to recover it. 00:28:02.459 [2024-11-28 19:16:23.121363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.121488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.121513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.459 qpair failed and we were unable to recover it. 00:28:02.459 [2024-11-28 19:16:23.121636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.121723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.121747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.459 qpair failed and we were unable to recover it. 00:28:02.459 [2024-11-28 19:16:23.121831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.121913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.459 [2024-11-28 19:16:23.121937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.459 qpair failed and we were unable to recover it. 00:28:02.460 [2024-11-28 19:16:23.122052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.122133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.122159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.460 qpair failed and we were unable to recover it. 00:28:02.460 [2024-11-28 19:16:23.122256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.122358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.122382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.460 qpair failed and we were unable to recover it. 00:28:02.460 [2024-11-28 19:16:23.122465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.122547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.122572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.460 qpair failed and we were unable to recover it. 00:28:02.460 [2024-11-28 19:16:23.122658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.122744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.122770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.460 qpair failed and we were unable to recover it. 00:28:02.460 [2024-11-28 19:16:23.122908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.122987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.123011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.460 qpair failed and we were unable to recover it. 00:28:02.460 [2024-11-28 19:16:23.123125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.123206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.123232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.460 qpair failed and we were unable to recover it. 00:28:02.460 [2024-11-28 19:16:23.123322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.123443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.123472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.460 qpair failed and we were unable to recover it. 00:28:02.460 [2024-11-28 19:16:23.123588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.123701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.123726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.460 qpair failed and we were unable to recover it. 00:28:02.460 [2024-11-28 19:16:23.123815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.123916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.123942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.460 qpair failed and we were unable to recover it. 00:28:02.460 [2024-11-28 19:16:23.124063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.124178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.124202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.460 qpair failed and we were unable to recover it. 00:28:02.460 [2024-11-28 19:16:23.124315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.124403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.124428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.460 qpair failed and we were unable to recover it. 00:28:02.460 [2024-11-28 19:16:23.124544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.124625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.124649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.460 qpair failed and we were unable to recover it. 00:28:02.460 [2024-11-28 19:16:23.124740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.124820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.124845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.460 qpair failed and we were unable to recover it. 00:28:02.460 [2024-11-28 19:16:23.124930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.125042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.125065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.460 qpair failed and we were unable to recover it. 00:28:02.460 [2024-11-28 19:16:23.125178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.125258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.125281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.460 qpair failed and we were unable to recover it. 00:28:02.460 [2024-11-28 19:16:23.125366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.125453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.125476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.460 qpair failed and we were unable to recover it. 00:28:02.460 [2024-11-28 19:16:23.125553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.125667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.125690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.460 qpair failed and we were unable to recover it. 00:28:02.460 [2024-11-28 19:16:23.125810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.125888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.125912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.460 qpair failed and we were unable to recover it. 00:28:02.460 [2024-11-28 19:16:23.125987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.126071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.126094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.460 qpair failed and we were unable to recover it. 00:28:02.460 [2024-11-28 19:16:23.126179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.126260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.126283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.460 qpair failed and we were unable to recover it. 00:28:02.460 [2024-11-28 19:16:23.126370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.126468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.126492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.460 qpair failed and we were unable to recover it. 00:28:02.460 [2024-11-28 19:16:23.126583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.126692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.126716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.460 qpair failed and we were unable to recover it. 00:28:02.460 [2024-11-28 19:16:23.126811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.126885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.126909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.460 qpair failed and we were unable to recover it. 00:28:02.460 [2024-11-28 19:16:23.127020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.127098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.127121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.460 qpair failed and we were unable to recover it. 00:28:02.460 [2024-11-28 19:16:23.127215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.127309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.127332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.460 qpair failed and we were unable to recover it. 00:28:02.460 [2024-11-28 19:16:23.127444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.127550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.127574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.460 qpair failed and we were unable to recover it. 00:28:02.460 [2024-11-28 19:16:23.127662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.127770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.127795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.460 qpair failed and we were unable to recover it. 00:28:02.460 [2024-11-28 19:16:23.127914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.128028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.128052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.460 qpair failed and we were unable to recover it. 00:28:02.460 [2024-11-28 19:16:23.128174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.128288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.128312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.460 qpair failed and we were unable to recover it. 00:28:02.460 [2024-11-28 19:16:23.128409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.128494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.128519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.460 qpair failed and we were unable to recover it. 00:28:02.460 [2024-11-28 19:16:23.128634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.128747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.128771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.460 qpair failed and we were unable to recover it. 00:28:02.460 [2024-11-28 19:16:23.128855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.128966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.128990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.460 qpair failed and we were unable to recover it. 00:28:02.460 [2024-11-28 19:16:23.129110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.129180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.460 [2024-11-28 19:16:23.129205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.461 qpair failed and we were unable to recover it. 00:28:02.461 [2024-11-28 19:16:23.129288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.129367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.129397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.461 qpair failed and we were unable to recover it. 00:28:02.461 [2024-11-28 19:16:23.129509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.129586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.129610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.461 qpair failed and we were unable to recover it. 00:28:02.461 [2024-11-28 19:16:23.129740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.129844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.129869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.461 qpair failed and we were unable to recover it. 00:28:02.461 [2024-11-28 19:16:23.130012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.130129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.130154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.461 qpair failed and we were unable to recover it. 00:28:02.461 [2024-11-28 19:16:23.130251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.130373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.130415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.461 qpair failed and we were unable to recover it. 00:28:02.461 [2024-11-28 19:16:23.130525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.130647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.130679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.461 qpair failed and we were unable to recover it. 00:28:02.461 [2024-11-28 19:16:23.130792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.130944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.130974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.461 qpair failed and we were unable to recover it. 00:28:02.461 [2024-11-28 19:16:23.131078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.131196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.131228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.461 qpair failed and we were unable to recover it. 00:28:02.461 [2024-11-28 19:16:23.131330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.131432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.131469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.461 qpair failed and we were unable to recover it. 00:28:02.461 [2024-11-28 19:16:23.131628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.131754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.131784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.461 qpair failed and we were unable to recover it. 00:28:02.461 [2024-11-28 19:16:23.131945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.132062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.132086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.461 qpair failed and we were unable to recover it. 00:28:02.461 [2024-11-28 19:16:23.132179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.132321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.132345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.461 qpair failed and we were unable to recover it. 00:28:02.461 [2024-11-28 19:16:23.132432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.132543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.132567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.461 qpair failed and we were unable to recover it. 00:28:02.461 [2024-11-28 19:16:23.132709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.132873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.132917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.461 qpair failed and we were unable to recover it. 00:28:02.461 [2024-11-28 19:16:23.133016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.133114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.133155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.461 qpair failed and we were unable to recover it. 00:28:02.461 [2024-11-28 19:16:23.133297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.133425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.133450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.461 qpair failed and we were unable to recover it. 00:28:02.461 [2024-11-28 19:16:23.133545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.133650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.133675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.461 qpair failed and we were unable to recover it. 00:28:02.461 [2024-11-28 19:16:23.133815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.133938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.133966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.461 qpair failed and we were unable to recover it. 00:28:02.461 [2024-11-28 19:16:23.134058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.134199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.134226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.461 qpair failed and we were unable to recover it. 00:28:02.461 [2024-11-28 19:16:23.134327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.134401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.134426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.461 qpair failed and we were unable to recover it. 00:28:02.461 [2024-11-28 19:16:23.134545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.134633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.134675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.461 qpair failed and we were unable to recover it. 00:28:02.461 [2024-11-28 19:16:23.134775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.134889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.134915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.461 qpair failed and we were unable to recover it. 00:28:02.461 [2024-11-28 19:16:23.135065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.135146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.135173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.461 qpair failed and we were unable to recover it. 00:28:02.461 [2024-11-28 19:16:23.135313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.135428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.135454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.461 qpair failed and we were unable to recover it. 00:28:02.461 [2024-11-28 19:16:23.135537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.135618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.135647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.461 qpair failed and we were unable to recover it. 00:28:02.461 [2024-11-28 19:16:23.135754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.135882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.135924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.461 qpair failed and we were unable to recover it. 00:28:02.461 [2024-11-28 19:16:23.136083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.136183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.136211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.461 qpair failed and we were unable to recover it. 00:28:02.461 [2024-11-28 19:16:23.136312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.136446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.136471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.461 qpair failed and we were unable to recover it. 00:28:02.461 [2024-11-28 19:16:23.136593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.136685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.136712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.461 qpair failed and we were unable to recover it. 00:28:02.461 [2024-11-28 19:16:23.136832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.461 [2024-11-28 19:16:23.136953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.136980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.462 qpair failed and we were unable to recover it. 00:28:02.462 [2024-11-28 19:16:23.137069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.137158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.137200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.462 qpair failed and we were unable to recover it. 00:28:02.462 [2024-11-28 19:16:23.137292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.137368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.137398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.462 qpair failed and we were unable to recover it. 00:28:02.462 [2024-11-28 19:16:23.137493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.137644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.137671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.462 qpair failed and we were unable to recover it. 00:28:02.462 [2024-11-28 19:16:23.137767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.137885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.137913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.462 qpair failed and we were unable to recover it. 00:28:02.462 [2024-11-28 19:16:23.138009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.138104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.138136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.462 qpair failed and we were unable to recover it. 00:28:02.462 [2024-11-28 19:16:23.138235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.138332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.138356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.462 qpair failed and we were unable to recover it. 00:28:02.462 [2024-11-28 19:16:23.138474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.138567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.138591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.462 qpair failed and we were unable to recover it. 00:28:02.462 [2024-11-28 19:16:23.138726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.138854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.138881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.462 qpair failed and we were unable to recover it. 00:28:02.462 [2024-11-28 19:16:23.139006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.139126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.139153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.462 qpair failed and we were unable to recover it. 00:28:02.462 [2024-11-28 19:16:23.139252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.139367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.139402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.462 qpair failed and we were unable to recover it. 00:28:02.462 [2024-11-28 19:16:23.139561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.139657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.139684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.462 qpair failed and we were unable to recover it. 00:28:02.462 [2024-11-28 19:16:23.139782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.139872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.139899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.462 qpair failed and we were unable to recover it. 00:28:02.462 [2024-11-28 19:16:23.139980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.140100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.140127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.462 qpair failed and we were unable to recover it. 00:28:02.462 [2024-11-28 19:16:23.140262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.140377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.140416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.462 qpair failed and we were unable to recover it. 00:28:02.462 [2024-11-28 19:16:23.140507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.140644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.140672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.462 qpair failed and we were unable to recover it. 00:28:02.462 [2024-11-28 19:16:23.140772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.140866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.140894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.462 qpair failed and we were unable to recover it. 00:28:02.462 [2024-11-28 19:16:23.140992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.141082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.141109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.462 qpair failed and we were unable to recover it. 00:28:02.462 [2024-11-28 19:16:23.141227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.141305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.141333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.462 qpair failed and we were unable to recover it. 00:28:02.462 [2024-11-28 19:16:23.141423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.141551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.141579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.462 qpair failed and we were unable to recover it. 00:28:02.462 [2024-11-28 19:16:23.141761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.141879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.141907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.462 qpair failed and we were unable to recover it. 00:28:02.462 [2024-11-28 19:16:23.141996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.142116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.142143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.462 qpair failed and we were unable to recover it. 00:28:02.462 [2024-11-28 19:16:23.142243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.142379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.142410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.462 qpair failed and we were unable to recover it. 00:28:02.462 [2024-11-28 19:16:23.142494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.142604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.142629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.462 qpair failed and we were unable to recover it. 00:28:02.462 [2024-11-28 19:16:23.142709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.142833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.142860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.462 qpair failed and we were unable to recover it. 00:28:02.462 [2024-11-28 19:16:23.142958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.143059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.143086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.462 qpair failed and we were unable to recover it. 00:28:02.462 [2024-11-28 19:16:23.143211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.143323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.143365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.462 qpair failed and we were unable to recover it. 00:28:02.462 [2024-11-28 19:16:23.143493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.143584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.143608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.462 qpair failed and we were unable to recover it. 00:28:02.462 [2024-11-28 19:16:23.143698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.143826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.462 [2024-11-28 19:16:23.143853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.462 qpair failed and we were unable to recover it. 00:28:02.462 [2024-11-28 19:16:23.143940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.144090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.144117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.463 qpair failed and we were unable to recover it. 00:28:02.463 [2024-11-28 19:16:23.144210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.144328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.144356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.463 qpair failed and we were unable to recover it. 00:28:02.463 [2024-11-28 19:16:23.144487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.144599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.144624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.463 qpair failed and we were unable to recover it. 00:28:02.463 [2024-11-28 19:16:23.144714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.144806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.144833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.463 qpair failed and we were unable to recover it. 00:28:02.463 [2024-11-28 19:16:23.144948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.145064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.145092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.463 qpair failed and we were unable to recover it. 00:28:02.463 [2024-11-28 19:16:23.145191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.145328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.145352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.463 qpair failed and we were unable to recover it. 00:28:02.463 [2024-11-28 19:16:23.145469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.145586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.145611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.463 qpair failed and we were unable to recover it. 00:28:02.463 [2024-11-28 19:16:23.145698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.145811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.145840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.463 qpair failed and we were unable to recover it. 00:28:02.463 [2024-11-28 19:16:23.145930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.146051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.146079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.463 qpair failed and we were unable to recover it. 00:28:02.463 [2024-11-28 19:16:23.146218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.146356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.146384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.463 qpair failed and we were unable to recover it. 00:28:02.463 [2024-11-28 19:16:23.146546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.146639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.146667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.463 qpair failed and we were unable to recover it. 00:28:02.463 [2024-11-28 19:16:23.146752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.146875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.146903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.463 qpair failed and we were unable to recover it. 00:28:02.463 [2024-11-28 19:16:23.147009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.147093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.147136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.463 qpair failed and we were unable to recover it. 00:28:02.463 [2024-11-28 19:16:23.147253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.147365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.147390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.463 qpair failed and we were unable to recover it. 00:28:02.463 [2024-11-28 19:16:23.147489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.147565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.147590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.463 qpair failed and we were unable to recover it. 00:28:02.463 [2024-11-28 19:16:23.147689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.147813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.147840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.463 qpair failed and we were unable to recover it. 00:28:02.463 [2024-11-28 19:16:23.147930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.148022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.148051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.463 qpair failed and we were unable to recover it. 00:28:02.463 [2024-11-28 19:16:23.148159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.148279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.148304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.463 qpair failed and we were unable to recover it. 00:28:02.463 [2024-11-28 19:16:23.148423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.148531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.148556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.463 qpair failed and we were unable to recover it. 00:28:02.463 [2024-11-28 19:16:23.148659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.148748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.148775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.463 qpair failed and we were unable to recover it. 00:28:02.463 [2024-11-28 19:16:23.148872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.148996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.149025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.463 qpair failed and we were unable to recover it. 00:28:02.463 [2024-11-28 19:16:23.149159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.149244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.149269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.463 qpair failed and we were unable to recover it. 00:28:02.463 [2024-11-28 19:16:23.149382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.149479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.149504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.463 qpair failed and we were unable to recover it. 00:28:02.463 [2024-11-28 19:16:23.149628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.149741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.149768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.463 qpair failed and we were unable to recover it. 00:28:02.463 [2024-11-28 19:16:23.149861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.149941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.149969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.463 qpair failed and we were unable to recover it. 00:28:02.463 [2024-11-28 19:16:23.150120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.150281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.150305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.463 qpair failed and we were unable to recover it. 00:28:02.463 [2024-11-28 19:16:23.150425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.150533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.150558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.463 qpair failed and we were unable to recover it. 00:28:02.463 [2024-11-28 19:16:23.150671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.150751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.150780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.463 qpair failed and we were unable to recover it. 00:28:02.463 [2024-11-28 19:16:23.150870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.150974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.150998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.463 qpair failed and we were unable to recover it. 00:28:02.463 [2024-11-28 19:16:23.151107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.151222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.151247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.463 qpair failed and we were unable to recover it. 00:28:02.463 [2024-11-28 19:16:23.151358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.151444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.463 [2024-11-28 19:16:23.151469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.463 qpair failed and we were unable to recover it. 00:28:02.463 [2024-11-28 19:16:23.151582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.151665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.151690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.464 qpair failed and we were unable to recover it. 00:28:02.464 [2024-11-28 19:16:23.151767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.151850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.151874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.464 qpair failed and we were unable to recover it. 00:28:02.464 [2024-11-28 19:16:23.151995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.152079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.152104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.464 qpair failed and we were unable to recover it. 00:28:02.464 [2024-11-28 19:16:23.152193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.152267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.152292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.464 qpair failed and we were unable to recover it. 00:28:02.464 [2024-11-28 19:16:23.152369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.152469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.152494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.464 qpair failed and we were unable to recover it. 00:28:02.464 [2024-11-28 19:16:23.152572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.152648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.152673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.464 qpair failed and we were unable to recover it. 00:28:02.464 [2024-11-28 19:16:23.152750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.152890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.152915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.464 qpair failed and we were unable to recover it. 00:28:02.464 [2024-11-28 19:16:23.153027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.153119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.153143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.464 qpair failed and we were unable to recover it. 00:28:02.464 [2024-11-28 19:16:23.153255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.153369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.153400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.464 qpair failed and we were unable to recover it. 00:28:02.464 [2024-11-28 19:16:23.153520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.153656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.153680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.464 qpair failed and we were unable to recover it. 00:28:02.464 [2024-11-28 19:16:23.153801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.153902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.153927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.464 qpair failed and we were unable to recover it. 00:28:02.464 [2024-11-28 19:16:23.154006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.154116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.154140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.464 qpair failed and we were unable to recover it. 00:28:02.464 [2024-11-28 19:16:23.154271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.154347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.154371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.464 qpair failed and we were unable to recover it. 00:28:02.464 [2024-11-28 19:16:23.154459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.154543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.154567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.464 qpair failed and we were unable to recover it. 00:28:02.464 [2024-11-28 19:16:23.154682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.154793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.154818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.464 qpair failed and we were unable to recover it. 00:28:02.464 [2024-11-28 19:16:23.154929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.155016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.155040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.464 qpair failed and we were unable to recover it. 00:28:02.464 [2024-11-28 19:16:23.155133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.155249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.155274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.464 qpair failed and we were unable to recover it. 00:28:02.464 [2024-11-28 19:16:23.155364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.155509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.155535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.464 qpair failed and we were unable to recover it. 00:28:02.464 [2024-11-28 19:16:23.155652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.155731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.155756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.464 qpair failed and we were unable to recover it. 00:28:02.464 [2024-11-28 19:16:23.155850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.155934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.155958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.464 qpair failed and we were unable to recover it. 00:28:02.464 [2024-11-28 19:16:23.156098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.156184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.156209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.464 qpair failed and we were unable to recover it. 00:28:02.464 [2024-11-28 19:16:23.156327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.156439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.156464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.464 qpair failed and we were unable to recover it. 00:28:02.464 [2024-11-28 19:16:23.156577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.156687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.156712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.464 qpair failed and we were unable to recover it. 00:28:02.464 [2024-11-28 19:16:23.156827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.156941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.156967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.464 qpair failed and we were unable to recover it. 00:28:02.464 [2024-11-28 19:16:23.157051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.157163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.157188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.464 qpair failed and we were unable to recover it. 00:28:02.464 [2024-11-28 19:16:23.157303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.157410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.157436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.464 qpair failed and we were unable to recover it. 00:28:02.464 [2024-11-28 19:16:23.157528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.157614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.157637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.464 qpair failed and we were unable to recover it. 00:28:02.464 [2024-11-28 19:16:23.157756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.157834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.157858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.464 qpair failed and we were unable to recover it. 00:28:02.464 [2024-11-28 19:16:23.157962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.158050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.158074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.464 qpair failed and we were unable to recover it. 00:28:02.464 [2024-11-28 19:16:23.158163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.158303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.158328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.464 qpair failed and we were unable to recover it. 00:28:02.464 [2024-11-28 19:16:23.158413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.158497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.158522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.464 qpair failed and we were unable to recover it. 00:28:02.464 [2024-11-28 19:16:23.158636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.158746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.158770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.464 qpair failed and we were unable to recover it. 00:28:02.464 [2024-11-28 19:16:23.158877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.158959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.158983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.464 qpair failed and we were unable to recover it. 00:28:02.464 [2024-11-28 19:16:23.159067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.159186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.464 [2024-11-28 19:16:23.159211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.464 qpair failed and we were unable to recover it. 00:28:02.464 [2024-11-28 19:16:23.159296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.159389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.159419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.465 qpair failed and we were unable to recover it. 00:28:02.465 [2024-11-28 19:16:23.159502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.159586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.159609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.465 qpair failed and we were unable to recover it. 00:28:02.465 [2024-11-28 19:16:23.159688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.159796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.159822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.465 qpair failed and we were unable to recover it. 00:28:02.465 [2024-11-28 19:16:23.159908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.159992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.160016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.465 qpair failed and we were unable to recover it. 00:28:02.465 [2024-11-28 19:16:23.160089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.160175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.160200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.465 qpair failed and we were unable to recover it. 00:28:02.465 [2024-11-28 19:16:23.160280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.160412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.160438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.465 qpair failed and we were unable to recover it. 00:28:02.465 [2024-11-28 19:16:23.160513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.160591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.160614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.465 qpair failed and we were unable to recover it. 00:28:02.465 [2024-11-28 19:16:23.160701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.160794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.160818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.465 qpair failed and we were unable to recover it. 00:28:02.465 [2024-11-28 19:16:23.160960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.161068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.161092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.465 qpair failed and we were unable to recover it. 00:28:02.465 [2024-11-28 19:16:23.161199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.161271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.161295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.465 qpair failed and we were unable to recover it. 00:28:02.465 [2024-11-28 19:16:23.161383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.161507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.161532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.465 qpair failed and we were unable to recover it. 00:28:02.465 [2024-11-28 19:16:23.161616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.161703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.161727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.465 qpair failed and we were unable to recover it. 00:28:02.465 [2024-11-28 19:16:23.161847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.161955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.161980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.465 qpair failed and we were unable to recover it. 00:28:02.465 [2024-11-28 19:16:23.162091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.162177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.162206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.465 qpair failed and we were unable to recover it. 00:28:02.465 [2024-11-28 19:16:23.162322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.162414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.162439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.465 qpair failed and we were unable to recover it. 00:28:02.465 [2024-11-28 19:16:23.162530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.162654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.162678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.465 qpair failed and we were unable to recover it. 00:28:02.465 [2024-11-28 19:16:23.162770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.162856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.162882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.465 qpair failed and we were unable to recover it. 00:28:02.465 [2024-11-28 19:16:23.162969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.163050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.163075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.465 qpair failed and we were unable to recover it. 00:28:02.465 [2024-11-28 19:16:23.163164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.163302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.163326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.465 qpair failed and we were unable to recover it. 00:28:02.465 [2024-11-28 19:16:23.163406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.163513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.163538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.465 qpair failed and we were unable to recover it. 00:28:02.465 [2024-11-28 19:16:23.163649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.163730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.163755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.465 qpair failed and we were unable to recover it. 00:28:02.465 [2024-11-28 19:16:23.163835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.163906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.163930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.465 qpair failed and we were unable to recover it. 00:28:02.465 [2024-11-28 19:16:23.164017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.164104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.164130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.465 qpair failed and we were unable to recover it. 00:28:02.465 [2024-11-28 19:16:23.164212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.164352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.164376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.465 qpair failed and we were unable to recover it. 00:28:02.465 [2024-11-28 19:16:23.164480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.164587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.164612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.465 qpair failed and we were unable to recover it. 00:28:02.465 [2024-11-28 19:16:23.164721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.164797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.164821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.465 qpair failed and we were unable to recover it. 00:28:02.465 [2024-11-28 19:16:23.164903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.165012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.165038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.465 qpair failed and we were unable to recover it. 00:28:02.465 [2024-11-28 19:16:23.165129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.165243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.165267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.465 qpair failed and we were unable to recover it. 00:28:02.465 [2024-11-28 19:16:23.165370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.165515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.165541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.465 qpair failed and we were unable to recover it. 00:28:02.465 [2024-11-28 19:16:23.165652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.165773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.165799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.465 qpair failed and we were unable to recover it. 00:28:02.465 [2024-11-28 19:16:23.165891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.165970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.165995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.465 qpair failed and we were unable to recover it. 00:28:02.465 [2024-11-28 19:16:23.166102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.166181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.166206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.465 qpair failed and we were unable to recover it. 00:28:02.465 [2024-11-28 19:16:23.166291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.166406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.166431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.465 qpair failed and we were unable to recover it. 00:28:02.465 [2024-11-28 19:16:23.166522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.166639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.166663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.465 qpair failed and we were unable to recover it. 00:28:02.465 [2024-11-28 19:16:23.166756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.166865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.465 [2024-11-28 19:16:23.166889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.465 qpair failed and we were unable to recover it. 00:28:02.466 [2024-11-28 19:16:23.166981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.167087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.167112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.466 qpair failed and we were unable to recover it. 00:28:02.466 [2024-11-28 19:16:23.167197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.167279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.167305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.466 qpair failed and we were unable to recover it. 00:28:02.466 [2024-11-28 19:16:23.167389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.167512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.167537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.466 qpair failed and we were unable to recover it. 00:28:02.466 [2024-11-28 19:16:23.167631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.167753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.167777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.466 qpair failed and we were unable to recover it. 00:28:02.466 [2024-11-28 19:16:23.167889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.167966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.167990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.466 qpair failed and we were unable to recover it. 00:28:02.466 [2024-11-28 19:16:23.168101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.168192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.168217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.466 qpair failed and we were unable to recover it. 00:28:02.466 [2024-11-28 19:16:23.168294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.168403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.168428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.466 qpair failed and we were unable to recover it. 00:28:02.466 [2024-11-28 19:16:23.168518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.168626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.168651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.466 qpair failed and we were unable to recover it. 00:28:02.466 [2024-11-28 19:16:23.168732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.168840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.168864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.466 qpair failed and we were unable to recover it. 00:28:02.466 [2024-11-28 19:16:23.168980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.169096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.169121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.466 qpair failed and we were unable to recover it. 00:28:02.466 [2024-11-28 19:16:23.169195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.169279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.169305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.466 qpair failed and we were unable to recover it. 00:28:02.466 [2024-11-28 19:16:23.169426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.169512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.169536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.466 qpair failed and we were unable to recover it. 00:28:02.466 [2024-11-28 19:16:23.169653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.169758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.169783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.466 qpair failed and we were unable to recover it. 00:28:02.466 [2024-11-28 19:16:23.169897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.169977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.170002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.466 qpair failed and we were unable to recover it. 00:28:02.466 [2024-11-28 19:16:23.170149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.170259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.170283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.466 qpair failed and we were unable to recover it. 00:28:02.466 [2024-11-28 19:16:23.170419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.170505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.170530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.466 qpair failed and we were unable to recover it. 00:28:02.466 [2024-11-28 19:16:23.170618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.170695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.170721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.466 qpair failed and we were unable to recover it. 00:28:02.466 [2024-11-28 19:16:23.170808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.170890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.170916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.466 qpair failed and we were unable to recover it. 00:28:02.466 [2024-11-28 19:16:23.171026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.171168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.171192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.466 qpair failed and we were unable to recover it. 00:28:02.466 [2024-11-28 19:16:23.171309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.171426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.171452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.466 qpair failed and we were unable to recover it. 00:28:02.466 [2024-11-28 19:16:23.171537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.171616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.171640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.466 qpair failed and we were unable to recover it. 00:28:02.466 [2024-11-28 19:16:23.171732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.171815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.171840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.466 qpair failed and we were unable to recover it. 00:28:02.466 [2024-11-28 19:16:23.171956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.172040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.172065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.466 qpair failed and we were unable to recover it. 00:28:02.466 [2024-11-28 19:16:23.172148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.172264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.172289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.466 qpair failed and we were unable to recover it. 00:28:02.466 [2024-11-28 19:16:23.172404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.172490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.172516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.466 qpair failed and we were unable to recover it. 00:28:02.466 [2024-11-28 19:16:23.172605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.172694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.172719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.466 qpair failed and we were unable to recover it. 00:28:02.466 [2024-11-28 19:16:23.172860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.172940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.172965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.466 qpair failed and we were unable to recover it. 00:28:02.466 [2024-11-28 19:16:23.173084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.173166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.173191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.466 qpair failed and we were unable to recover it. 00:28:02.466 [2024-11-28 19:16:23.173313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.173389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.173423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.466 qpair failed and we were unable to recover it. 00:28:02.466 [2024-11-28 19:16:23.173542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.466 [2024-11-28 19:16:23.173620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.173649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.467 qpair failed and we were unable to recover it. 00:28:02.467 [2024-11-28 19:16:23.173733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.173821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.173846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.467 qpair failed and we were unable to recover it. 00:28:02.467 [2024-11-28 19:16:23.173954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.174061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.174086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.467 qpair failed and we were unable to recover it. 00:28:02.467 [2024-11-28 19:16:23.174157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.174266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.174291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.467 qpair failed and we were unable to recover it. 00:28:02.467 [2024-11-28 19:16:23.174382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.174480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.174506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.467 qpair failed and we were unable to recover it. 00:28:02.467 [2024-11-28 19:16:23.174616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.174729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.174754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.467 qpair failed and we were unable to recover it. 00:28:02.467 [2024-11-28 19:16:23.174840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.174922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.174947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.467 qpair failed and we were unable to recover it. 00:28:02.467 [2024-11-28 19:16:23.175063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.175143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.175167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.467 qpair failed and we were unable to recover it. 00:28:02.467 [2024-11-28 19:16:23.175251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.175331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.175356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.467 qpair failed and we were unable to recover it. 00:28:02.467 [2024-11-28 19:16:23.175480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.175595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.175621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.467 qpair failed and we were unable to recover it. 00:28:02.467 [2024-11-28 19:16:23.175714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.175795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.175819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.467 qpair failed and we were unable to recover it. 00:28:02.467 [2024-11-28 19:16:23.175913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.176017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.176042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.467 qpair failed and we were unable to recover it. 00:28:02.467 [2024-11-28 19:16:23.176145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.176228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.176253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.467 qpair failed and we were unable to recover it. 00:28:02.467 [2024-11-28 19:16:23.176337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.176430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.176456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.467 qpair failed and we were unable to recover it. 00:28:02.467 [2024-11-28 19:16:23.176603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.176714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.176738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.467 qpair failed and we were unable to recover it. 00:28:02.467 [2024-11-28 19:16:23.176821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.176908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.176933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.467 qpair failed and we were unable to recover it. 00:28:02.467 [2024-11-28 19:16:23.177045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.177197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.177222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.467 qpair failed and we were unable to recover it. 00:28:02.467 [2024-11-28 19:16:23.177310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.177418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.177444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.467 qpair failed and we were unable to recover it. 00:28:02.467 [2024-11-28 19:16:23.177565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.177643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.177667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.467 qpair failed and we were unable to recover it. 00:28:02.467 [2024-11-28 19:16:23.177808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.177884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.177909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.467 qpair failed and we were unable to recover it. 00:28:02.467 [2024-11-28 19:16:23.178019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.178131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.178156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.467 qpair failed and we were unable to recover it. 00:28:02.467 [2024-11-28 19:16:23.178243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.178316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.178339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.467 qpair failed and we were unable to recover it. 00:28:02.467 [2024-11-28 19:16:23.178463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.178578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.178602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.467 qpair failed and we were unable to recover it. 00:28:02.467 [2024-11-28 19:16:23.178747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.178856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.178880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.467 qpair failed and we were unable to recover it. 00:28:02.467 [2024-11-28 19:16:23.178957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.467 [2024-11-28 19:16:23.179070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.179096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.468 qpair failed and we were unable to recover it. 00:28:02.468 [2024-11-28 19:16:23.179175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.179261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.179285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.468 qpair failed and we were unable to recover it. 00:28:02.468 [2024-11-28 19:16:23.179366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.179467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.179493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.468 qpair failed and we were unable to recover it. 00:28:02.468 [2024-11-28 19:16:23.179602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.179686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.179710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.468 qpair failed and we were unable to recover it. 00:28:02.468 [2024-11-28 19:16:23.179790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.179903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.179927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.468 qpair failed and we were unable to recover it. 00:28:02.468 [2024-11-28 19:16:23.180019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.180097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.180121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.468 qpair failed and we were unable to recover it. 00:28:02.468 [2024-11-28 19:16:23.180242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.180325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.180350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.468 qpair failed and we were unable to recover it. 00:28:02.468 [2024-11-28 19:16:23.180496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.180592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.180625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.468 qpair failed and we were unable to recover it. 00:28:02.468 [2024-11-28 19:16:23.180732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.180835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.180872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.468 qpair failed and we were unable to recover it. 00:28:02.468 [2024-11-28 19:16:23.181003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.181151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.181178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.468 qpair failed and we were unable to recover it. 00:28:02.468 [2024-11-28 19:16:23.181304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.181427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.181454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.468 qpair failed and we were unable to recover it. 00:28:02.468 [2024-11-28 19:16:23.181555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.181674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.181702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.468 qpair failed and we were unable to recover it. 00:28:02.468 [2024-11-28 19:16:23.181823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.181924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.181952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.468 qpair failed and we were unable to recover it. 00:28:02.468 [2024-11-28 19:16:23.182052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.182148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.182182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.468 qpair failed and we were unable to recover it. 00:28:02.468 [2024-11-28 19:16:23.182341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.182438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.182469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.468 qpair failed and we were unable to recover it. 00:28:02.468 [2024-11-28 19:16:23.182564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.182679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.182712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.468 qpair failed and we were unable to recover it. 00:28:02.468 [2024-11-28 19:16:23.182836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.182941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.182968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.468 qpair failed and we were unable to recover it. 00:28:02.468 [2024-11-28 19:16:23.183101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.183207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.183235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.468 qpair failed and we were unable to recover it. 00:28:02.468 [2024-11-28 19:16:23.183387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.183490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.183521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.468 qpair failed and we were unable to recover it. 00:28:02.468 [2024-11-28 19:16:23.183605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.183695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.183720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.468 qpair failed and we were unable to recover it. 00:28:02.468 [2024-11-28 19:16:23.183829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.183937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.183961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.468 qpair failed and we were unable to recover it. 00:28:02.468 [2024-11-28 19:16:23.184048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.184160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.184184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.468 qpair failed and we were unable to recover it. 00:28:02.468 [2024-11-28 19:16:23.184290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.184370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.184445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.468 qpair failed and we were unable to recover it. 00:28:02.468 [2024-11-28 19:16:23.184562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.184665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.184694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.468 qpair failed and we were unable to recover it. 00:28:02.468 [2024-11-28 19:16:23.184816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.184914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.184941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.468 qpair failed and we were unable to recover it. 00:28:02.468 [2024-11-28 19:16:23.185062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.185149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.185176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.468 qpair failed and we were unable to recover it. 00:28:02.468 [2024-11-28 19:16:23.185295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.185440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.185469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.468 qpair failed and we were unable to recover it. 00:28:02.468 [2024-11-28 19:16:23.185590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.185685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.468 [2024-11-28 19:16:23.185713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.469 qpair failed and we were unable to recover it. 00:28:02.469 [2024-11-28 19:16:23.185795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.185918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.185946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.469 qpair failed and we were unable to recover it. 00:28:02.469 [2024-11-28 19:16:23.186042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.186175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.186200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.469 qpair failed and we were unable to recover it. 00:28:02.469 [2024-11-28 19:16:23.186287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.186399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.186425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.469 qpair failed and we were unable to recover it. 00:28:02.469 [2024-11-28 19:16:23.186525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.186651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.186678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.469 qpair failed and we were unable to recover it. 00:28:02.469 [2024-11-28 19:16:23.186779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.186873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.186901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.469 qpair failed and we were unable to recover it. 00:28:02.469 [2024-11-28 19:16:23.187039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.187125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.187164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.469 qpair failed and we were unable to recover it. 00:28:02.469 [2024-11-28 19:16:23.187239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.187353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.187377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.469 qpair failed and we were unable to recover it. 00:28:02.469 [2024-11-28 19:16:23.187481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.187574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.187601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.469 qpair failed and we were unable to recover it. 00:28:02.469 [2024-11-28 19:16:23.187695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.187787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.187814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.469 qpair failed and we were unable to recover it. 00:28:02.469 [2024-11-28 19:16:23.187966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.188091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.188123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.469 qpair failed and we were unable to recover it. 00:28:02.469 [2024-11-28 19:16:23.188249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.188351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.188377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.469 qpair failed and we were unable to recover it. 00:28:02.469 [2024-11-28 19:16:23.188500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.188617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.188644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.469 qpair failed and we were unable to recover it. 00:28:02.469 [2024-11-28 19:16:23.188736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.188824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.188851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.469 qpair failed and we were unable to recover it. 00:28:02.469 [2024-11-28 19:16:23.188953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.189041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.189068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.469 qpair failed and we were unable to recover it. 00:28:02.469 [2024-11-28 19:16:23.189175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.189288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.189313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.469 qpair failed and we were unable to recover it. 00:28:02.469 [2024-11-28 19:16:23.189421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.189556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.189583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.469 qpair failed and we were unable to recover it. 00:28:02.469 [2024-11-28 19:16:23.189677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.189767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.189795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.469 qpair failed and we were unable to recover it. 00:28:02.469 [2024-11-28 19:16:23.189914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.190062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.190090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.469 qpair failed and we were unable to recover it. 00:28:02.469 [2024-11-28 19:16:23.190198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.190291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.190316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.469 qpair failed and we were unable to recover it. 00:28:02.469 [2024-11-28 19:16:23.190435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.190522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.190569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.469 qpair failed and we were unable to recover it. 00:28:02.469 [2024-11-28 19:16:23.190669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.190799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.190824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.469 qpair failed and we were unable to recover it. 00:28:02.469 [2024-11-28 19:16:23.190933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.191014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.191039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.469 qpair failed and we were unable to recover it. 00:28:02.469 [2024-11-28 19:16:23.191124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.191264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.191289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.469 qpair failed and we were unable to recover it. 00:28:02.469 [2024-11-28 19:16:23.191374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.191511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.191538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.469 qpair failed and we were unable to recover it. 00:28:02.469 [2024-11-28 19:16:23.191668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.191763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.191793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.469 qpair failed and we were unable to recover it. 00:28:02.469 [2024-11-28 19:16:23.191951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.192043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.192071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.469 qpair failed and we were unable to recover it. 00:28:02.469 [2024-11-28 19:16:23.192165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.192295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.192322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.469 qpair failed and we were unable to recover it. 00:28:02.469 [2024-11-28 19:16:23.192487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.192587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.192616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.469 qpair failed and we were unable to recover it. 00:28:02.469 [2024-11-28 19:16:23.192722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.469 [2024-11-28 19:16:23.192872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.192900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.470 qpair failed and we were unable to recover it. 00:28:02.470 [2024-11-28 19:16:23.193039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.193179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.193220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.470 qpair failed and we were unable to recover it. 00:28:02.470 [2024-11-28 19:16:23.193307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.193444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.193470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.470 qpair failed and we were unable to recover it. 00:28:02.470 [2024-11-28 19:16:23.193577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.193679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.193707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.470 qpair failed and we were unable to recover it. 00:28:02.470 [2024-11-28 19:16:23.193861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.193950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.193977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.470 qpair failed and we were unable to recover it. 00:28:02.470 [2024-11-28 19:16:23.194083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.194193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.194217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.470 qpair failed and we were unable to recover it. 00:28:02.470 [2024-11-28 19:16:23.194303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.194390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.194438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.470 qpair failed and we were unable to recover it. 00:28:02.470 [2024-11-28 19:16:23.194566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.194692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.194717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.470 qpair failed and we were unable to recover it. 00:28:02.470 [2024-11-28 19:16:23.194855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.194942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.194969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.470 qpair failed and we were unable to recover it. 00:28:02.470 [2024-11-28 19:16:23.195078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.195236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.195260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.470 qpair failed and we were unable to recover it. 00:28:02.470 [2024-11-28 19:16:23.195347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.195422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.195465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.470 qpair failed and we were unable to recover it. 00:28:02.470 [2024-11-28 19:16:23.195649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.195764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.195791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.470 qpair failed and we were unable to recover it. 00:28:02.470 [2024-11-28 19:16:23.195920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.196042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.196086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.470 qpair failed and we were unable to recover it. 00:28:02.470 [2024-11-28 19:16:23.196173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.196261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.196285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.470 qpair failed and we were unable to recover it. 00:28:02.470 [2024-11-28 19:16:23.196403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.196492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.196535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.470 qpair failed and we were unable to recover it. 00:28:02.470 [2024-11-28 19:16:23.196663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.196810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.196837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.470 qpair failed and we were unable to recover it. 00:28:02.470 [2024-11-28 19:16:23.196992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.197085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.197115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.470 qpair failed and we were unable to recover it. 00:28:02.470 [2024-11-28 19:16:23.197238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.197333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.197357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.470 qpair failed and we were unable to recover it. 00:28:02.470 [2024-11-28 19:16:23.197510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.197602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.197627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.470 qpair failed and we were unable to recover it. 00:28:02.470 [2024-11-28 19:16:23.197723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.197817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.197845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.470 qpair failed and we were unable to recover it. 00:28:02.470 [2024-11-28 19:16:23.197944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.198035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.198063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.470 qpair failed and we were unable to recover it. 00:28:02.470 [2024-11-28 19:16:23.198156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.198263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.198288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.470 qpair failed and we were unable to recover it. 00:28:02.470 [2024-11-28 19:16:23.198404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.198494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.198519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.470 qpair failed and we were unable to recover it. 00:28:02.470 [2024-11-28 19:16:23.198650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.198803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.198831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.470 qpair failed and we were unable to recover it. 00:28:02.470 [2024-11-28 19:16:23.198921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.199038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.199066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.470 qpair failed and we were unable to recover it. 00:28:02.470 [2024-11-28 19:16:23.199183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.199314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.199339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.470 qpair failed and we were unable to recover it. 00:28:02.470 [2024-11-28 19:16:23.199424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.199509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.199534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.470 qpair failed and we were unable to recover it. 00:28:02.470 [2024-11-28 19:16:23.199644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.199797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.199825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.470 qpair failed and we were unable to recover it. 00:28:02.470 [2024-11-28 19:16:23.199918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.200043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.200070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.470 qpair failed and we were unable to recover it. 00:28:02.470 [2024-11-28 19:16:23.200174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.200263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.470 [2024-11-28 19:16:23.200289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.471 qpair failed and we were unable to recover it. 00:28:02.471 [2024-11-28 19:16:23.200383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.200473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.200498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.471 qpair failed and we were unable to recover it. 00:28:02.471 [2024-11-28 19:16:23.200613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.200712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.200737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.471 qpair failed and we were unable to recover it. 00:28:02.471 [2024-11-28 19:16:23.200837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.200991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.201020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.471 qpair failed and we were unable to recover it. 00:28:02.471 [2024-11-28 19:16:23.201156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.201266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.201290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.471 qpair failed and we were unable to recover it. 00:28:02.471 [2024-11-28 19:16:23.201369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.201458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.201501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.471 qpair failed and we were unable to recover it. 00:28:02.471 [2024-11-28 19:16:23.201598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.201688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.201717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.471 qpair failed and we were unable to recover it. 00:28:02.471 [2024-11-28 19:16:23.201813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.201960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.201988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.471 qpair failed and we were unable to recover it. 00:28:02.471 [2024-11-28 19:16:23.202088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.202210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.202238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.471 qpair failed and we were unable to recover it. 00:28:02.471 [2024-11-28 19:16:23.202369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.202483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.202509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.471 qpair failed and we were unable to recover it. 00:28:02.471 [2024-11-28 19:16:23.202598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.202707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.202731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.471 qpair failed and we were unable to recover it. 00:28:02.471 [2024-11-28 19:16:23.202842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.202955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.202980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.471 qpair failed and we were unable to recover it. 00:28:02.471 [2024-11-28 19:16:23.203092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.203174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.203199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.471 qpair failed and we were unable to recover it. 00:28:02.471 [2024-11-28 19:16:23.203308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.203424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.203457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.471 qpair failed and we were unable to recover it. 00:28:02.471 [2024-11-28 19:16:23.203539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.203652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.203678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.471 qpair failed and we were unable to recover it. 00:28:02.471 [2024-11-28 19:16:23.203759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.203871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.203896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.471 qpair failed and we were unable to recover it. 00:28:02.471 [2024-11-28 19:16:23.203973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.204055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.204080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.471 qpair failed and we were unable to recover it. 00:28:02.471 [2024-11-28 19:16:23.204171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.204257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.204282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.471 qpair failed and we were unable to recover it. 00:28:02.471 [2024-11-28 19:16:23.204369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.204493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.204519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.471 qpair failed and we were unable to recover it. 00:28:02.471 [2024-11-28 19:16:23.204603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.204688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.204714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.471 qpair failed and we were unable to recover it. 00:28:02.471 [2024-11-28 19:16:23.204827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.204908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.204933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.471 qpair failed and we were unable to recover it. 00:28:02.471 [2024-11-28 19:16:23.205019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.205096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.205121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.471 qpair failed and we were unable to recover it. 00:28:02.471 [2024-11-28 19:16:23.205231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.205333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.205358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.471 qpair failed and we were unable to recover it. 00:28:02.471 [2024-11-28 19:16:23.205460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.205545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.205570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.471 qpair failed and we were unable to recover it. 00:28:02.471 [2024-11-28 19:16:23.205691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.471 [2024-11-28 19:16:23.205779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.205804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.472 qpair failed and we were unable to recover it. 00:28:02.472 [2024-11-28 19:16:23.205890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.206026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.206051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.472 qpair failed and we were unable to recover it. 00:28:02.472 [2024-11-28 19:16:23.206133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.206209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.206233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.472 qpair failed and we were unable to recover it. 00:28:02.472 [2024-11-28 19:16:23.206343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.206463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.206488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.472 qpair failed and we were unable to recover it. 00:28:02.472 [2024-11-28 19:16:23.206605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.206684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.206708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.472 qpair failed and we were unable to recover it. 00:28:02.472 [2024-11-28 19:16:23.206815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.206927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.206952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.472 qpair failed and we were unable to recover it. 00:28:02.472 [2024-11-28 19:16:23.207035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.207126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.207150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.472 qpair failed and we were unable to recover it. 00:28:02.472 [2024-11-28 19:16:23.207263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.207348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.207374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.472 qpair failed and we were unable to recover it. 00:28:02.472 [2024-11-28 19:16:23.207499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.207612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.207637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.472 qpair failed and we were unable to recover it. 00:28:02.472 [2024-11-28 19:16:23.207728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.207822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.207847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.472 qpair failed and we were unable to recover it. 00:28:02.472 [2024-11-28 19:16:23.207963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.208078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.208104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.472 qpair failed and we were unable to recover it. 00:28:02.472 [2024-11-28 19:16:23.208194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.208309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.208334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.472 qpair failed and we were unable to recover it. 00:28:02.472 [2024-11-28 19:16:23.208448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.208530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.208555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.472 qpair failed and we were unable to recover it. 00:28:02.472 [2024-11-28 19:16:23.208643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.208755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.208781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.472 qpair failed and we were unable to recover it. 00:28:02.472 [2024-11-28 19:16:23.208876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.208985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.209010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.472 qpair failed and we were unable to recover it. 00:28:02.472 [2024-11-28 19:16:23.209097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.209178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.209203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.472 qpair failed and we were unable to recover it. 00:28:02.472 [2024-11-28 19:16:23.209283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.209390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.209422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.472 qpair failed and we were unable to recover it. 00:28:02.472 [2024-11-28 19:16:23.209502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.209585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.209609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.472 qpair failed and we were unable to recover it. 00:28:02.472 [2024-11-28 19:16:23.209699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.209804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.209829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.472 qpair failed and we were unable to recover it. 00:28:02.472 [2024-11-28 19:16:23.209925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.210014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.210038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.472 qpair failed and we were unable to recover it. 00:28:02.472 [2024-11-28 19:16:23.210117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.210200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.210225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.472 qpair failed and we were unable to recover it. 00:28:02.472 [2024-11-28 19:16:23.210338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.210425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.210450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.472 qpair failed and we were unable to recover it. 00:28:02.472 [2024-11-28 19:16:23.210534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.210611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.210636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.472 qpair failed and we were unable to recover it. 00:28:02.472 [2024-11-28 19:16:23.210719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.210802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.210827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.472 qpair failed and we were unable to recover it. 00:28:02.472 [2024-11-28 19:16:23.210936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.211027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.211052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.472 qpair failed and we were unable to recover it. 00:28:02.472 [2024-11-28 19:16:23.211143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.211220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.211245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.472 qpair failed and we were unable to recover it. 00:28:02.472 [2024-11-28 19:16:23.211336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.211433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.211459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.472 qpair failed and we were unable to recover it. 00:28:02.472 [2024-11-28 19:16:23.211558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.211674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.211700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.472 qpair failed and we were unable to recover it. 00:28:02.472 [2024-11-28 19:16:23.211818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.211930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.211954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.472 qpair failed and we were unable to recover it. 00:28:02.472 [2024-11-28 19:16:23.212047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.472 [2024-11-28 19:16:23.212119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.212144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.473 qpair failed and we were unable to recover it. 00:28:02.473 [2024-11-28 19:16:23.212256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.212424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.212450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.473 qpair failed and we were unable to recover it. 00:28:02.473 [2024-11-28 19:16:23.212537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.212643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.212668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.473 qpair failed and we were unable to recover it. 00:28:02.473 [2024-11-28 19:16:23.212759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.212834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.212859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.473 qpair failed and we were unable to recover it. 00:28:02.473 [2024-11-28 19:16:23.212955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.213035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.213060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.473 qpair failed and we were unable to recover it. 00:28:02.473 [2024-11-28 19:16:23.213174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.213248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.213273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.473 qpair failed and we were unable to recover it. 00:28:02.473 [2024-11-28 19:16:23.213385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.213465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.213490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.473 qpair failed and we were unable to recover it. 00:28:02.473 [2024-11-28 19:16:23.213603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.213681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.213705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.473 qpair failed and we were unable to recover it. 00:28:02.473 [2024-11-28 19:16:23.213796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.213928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.213952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.473 qpair failed and we were unable to recover it. 00:28:02.473 [2024-11-28 19:16:23.214034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.214113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.214138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.473 qpair failed and we were unable to recover it. 00:28:02.473 [2024-11-28 19:16:23.214254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.214400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.214425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.473 qpair failed and we were unable to recover it. 00:28:02.473 [2024-11-28 19:16:23.214504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.214608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.214637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.473 qpair failed and we were unable to recover it. 00:28:02.473 [2024-11-28 19:16:23.214726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.214802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.214827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.473 qpair failed and we were unable to recover it. 00:28:02.473 [2024-11-28 19:16:23.214909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.215022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.215046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.473 qpair failed and we were unable to recover it. 00:28:02.473 [2024-11-28 19:16:23.215132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.215218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.215243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.473 qpair failed and we were unable to recover it. 00:28:02.473 [2024-11-28 19:16:23.215333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.215437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.215463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.473 qpair failed and we were unable to recover it. 00:28:02.473 [2024-11-28 19:16:23.215578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.215664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.215689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.473 qpair failed and we were unable to recover it. 00:28:02.473 [2024-11-28 19:16:23.215771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.215881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.215906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.473 qpair failed and we were unable to recover it. 00:28:02.473 [2024-11-28 19:16:23.215984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.216069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.216093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.473 qpair failed and we were unable to recover it. 00:28:02.473 [2024-11-28 19:16:23.216202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.216275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.216300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.473 qpair failed and we were unable to recover it. 00:28:02.473 [2024-11-28 19:16:23.216399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.216486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.216512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.473 qpair failed and we were unable to recover it. 00:28:02.473 [2024-11-28 19:16:23.216656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.216741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.216766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.473 qpair failed and we were unable to recover it. 00:28:02.473 [2024-11-28 19:16:23.216857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.216933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.216958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.473 qpair failed and we were unable to recover it. 00:28:02.473 [2024-11-28 19:16:23.217071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.217155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.217180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.473 qpair failed and we were unable to recover it. 00:28:02.473 [2024-11-28 19:16:23.217262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.217373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.217405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.473 qpair failed and we were unable to recover it. 00:28:02.473 [2024-11-28 19:16:23.217492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.217598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.217623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.473 qpair failed and we were unable to recover it. 00:28:02.473 [2024-11-28 19:16:23.217704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.217808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.217833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.473 qpair failed and we were unable to recover it. 00:28:02.473 [2024-11-28 19:16:23.217923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.218040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.218064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.473 qpair failed and we were unable to recover it. 00:28:02.473 [2024-11-28 19:16:23.218229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.218340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.218365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.473 qpair failed and we were unable to recover it. 00:28:02.473 [2024-11-28 19:16:23.218482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.473 [2024-11-28 19:16:23.218567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.218592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.474 qpair failed and we were unable to recover it. 00:28:02.474 [2024-11-28 19:16:23.218676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.218762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.218786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.474 qpair failed and we were unable to recover it. 00:28:02.474 [2024-11-28 19:16:23.218883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.218957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.218981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.474 qpair failed and we were unable to recover it. 00:28:02.474 [2024-11-28 19:16:23.219070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.219183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.219209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.474 qpair failed and we were unable to recover it. 00:28:02.474 [2024-11-28 19:16:23.219292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.219404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.219430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.474 qpair failed and we were unable to recover it. 00:28:02.474 [2024-11-28 19:16:23.219546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.219653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.219677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.474 qpair failed and we were unable to recover it. 00:28:02.474 [2024-11-28 19:16:23.219784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.219863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.219888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.474 qpair failed and we were unable to recover it. 00:28:02.474 [2024-11-28 19:16:23.220002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.220087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.220112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.474 qpair failed and we were unable to recover it. 00:28:02.474 [2024-11-28 19:16:23.220188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.220268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.220294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.474 qpair failed and we were unable to recover it. 00:28:02.474 [2024-11-28 19:16:23.220406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.220495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.220520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.474 qpair failed and we were unable to recover it. 00:28:02.474 [2024-11-28 19:16:23.220612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.220722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.220746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.474 qpair failed and we were unable to recover it. 00:28:02.474 [2024-11-28 19:16:23.220867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.220954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.220979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.474 qpair failed and we were unable to recover it. 00:28:02.474 [2024-11-28 19:16:23.221120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.221205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.221229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.474 qpair failed and we were unable to recover it. 00:28:02.474 [2024-11-28 19:16:23.221348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.221440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.221465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.474 qpair failed and we were unable to recover it. 00:28:02.474 [2024-11-28 19:16:23.221603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.221686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.221711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.474 qpair failed and we were unable to recover it. 00:28:02.474 [2024-11-28 19:16:23.221802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.221878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.221903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.474 qpair failed and we were unable to recover it. 00:28:02.474 [2024-11-28 19:16:23.221981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.222062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.222088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.474 qpair failed and we were unable to recover it. 00:28:02.474 [2024-11-28 19:16:23.222229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.222342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.222367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.474 qpair failed and we were unable to recover it. 00:28:02.474 [2024-11-28 19:16:23.222456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.222567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.222592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.474 qpair failed and we were unable to recover it. 00:28:02.474 [2024-11-28 19:16:23.222667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.222748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.222772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.474 qpair failed and we were unable to recover it. 00:28:02.474 [2024-11-28 19:16:23.222895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.223007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.223032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.474 qpair failed and we were unable to recover it. 00:28:02.474 [2024-11-28 19:16:23.223120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.223198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.223223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.474 qpair failed and we were unable to recover it. 00:28:02.474 [2024-11-28 19:16:23.223333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.223450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.223476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.474 qpair failed and we were unable to recover it. 00:28:02.474 [2024-11-28 19:16:23.223569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.223660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.223685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.474 qpair failed and we were unable to recover it. 00:28:02.474 [2024-11-28 19:16:23.223795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.223932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.223956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.474 qpair failed and we were unable to recover it. 00:28:02.474 [2024-11-28 19:16:23.224048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.224158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.224182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.474 qpair failed and we were unable to recover it. 00:28:02.474 [2024-11-28 19:16:23.224287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.224373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.224405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.474 qpair failed and we were unable to recover it. 00:28:02.474 [2024-11-28 19:16:23.224511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.224602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.224627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.474 qpair failed and we were unable to recover it. 00:28:02.474 [2024-11-28 19:16:23.224712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.224827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.474 [2024-11-28 19:16:23.224852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.474 qpair failed and we were unable to recover it. 00:28:02.474 [2024-11-28 19:16:23.224969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.225054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.225078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.475 qpair failed and we were unable to recover it. 00:28:02.475 [2024-11-28 19:16:23.225152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.225231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.225256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.475 qpair failed and we were unable to recover it. 00:28:02.475 [2024-11-28 19:16:23.225400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.225480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.225504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.475 qpair failed and we were unable to recover it. 00:28:02.475 [2024-11-28 19:16:23.225598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.225671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.225695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.475 qpair failed and we were unable to recover it. 00:28:02.475 [2024-11-28 19:16:23.225832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.225939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.225968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.475 qpair failed and we were unable to recover it. 00:28:02.475 [2024-11-28 19:16:23.226058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.226148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.226173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.475 qpair failed and we were unable to recover it. 00:28:02.475 [2024-11-28 19:16:23.226259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.226369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.226400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.475 qpair failed and we were unable to recover it. 00:28:02.475 [2024-11-28 19:16:23.226515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.226601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.226625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.475 qpair failed and we were unable to recover it. 00:28:02.475 [2024-11-28 19:16:23.226752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.226841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.226866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.475 qpair failed and we were unable to recover it. 00:28:02.475 [2024-11-28 19:16:23.226954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.227073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.227098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.475 qpair failed and we were unable to recover it. 00:28:02.475 [2024-11-28 19:16:23.227212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.227298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.227322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.475 qpair failed and we were unable to recover it. 00:28:02.475 [2024-11-28 19:16:23.227444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.227529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.227554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.475 qpair failed and we were unable to recover it. 00:28:02.475 [2024-11-28 19:16:23.227668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.227751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.227776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.475 qpair failed and we were unable to recover it. 00:28:02.475 [2024-11-28 19:16:23.227868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.227981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.228006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.475 qpair failed and we were unable to recover it. 00:28:02.475 [2024-11-28 19:16:23.228113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.228227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.228251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.475 qpair failed and we were unable to recover it. 00:28:02.475 [2024-11-28 19:16:23.228351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.228472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.228498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.475 qpair failed and we were unable to recover it. 00:28:02.475 [2024-11-28 19:16:23.228582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.228727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.228752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.475 qpair failed and we were unable to recover it. 00:28:02.475 [2024-11-28 19:16:23.228844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.228981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.229006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.475 qpair failed and we were unable to recover it. 00:28:02.475 [2024-11-28 19:16:23.229086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.229225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.229250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.475 qpair failed and we were unable to recover it. 00:28:02.475 [2024-11-28 19:16:23.229331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.229437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.229463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.475 qpair failed and we were unable to recover it. 00:28:02.475 [2024-11-28 19:16:23.229571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.229664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.229689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.475 qpair failed and we were unable to recover it. 00:28:02.475 [2024-11-28 19:16:23.229780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.229890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.229914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.475 qpair failed and we were unable to recover it. 00:28:02.475 [2024-11-28 19:16:23.229993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.230068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.230093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.475 qpair failed and we were unable to recover it. 00:28:02.475 [2024-11-28 19:16:23.230183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.230264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.230289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.475 qpair failed and we were unable to recover it. 00:28:02.475 [2024-11-28 19:16:23.230404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.230510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.230535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.475 qpair failed and we were unable to recover it. 00:28:02.475 [2024-11-28 19:16:23.230620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.230736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.230761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.475 qpair failed and we were unable to recover it. 00:28:02.475 [2024-11-28 19:16:23.230843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.230959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.230984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.475 qpair failed and we were unable to recover it. 00:28:02.475 [2024-11-28 19:16:23.231071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.231189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.231214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.475 qpair failed and we were unable to recover it. 00:28:02.475 [2024-11-28 19:16:23.231320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.231403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.231429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.475 qpair failed and we were unable to recover it. 00:28:02.475 [2024-11-28 19:16:23.231538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.475 [2024-11-28 19:16:23.231651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.231677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.476 qpair failed and we were unable to recover it. 00:28:02.476 [2024-11-28 19:16:23.231764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.231873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.231899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.476 qpair failed and we were unable to recover it. 00:28:02.476 [2024-11-28 19:16:23.232012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.232089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.232113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.476 qpair failed and we were unable to recover it. 00:28:02.476 [2024-11-28 19:16:23.232209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.232297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.232322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.476 qpair failed and we were unable to recover it. 00:28:02.476 [2024-11-28 19:16:23.232432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.232516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.232541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.476 qpair failed and we were unable to recover it. 00:28:02.476 [2024-11-28 19:16:23.232652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.232731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.232755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.476 qpair failed and we were unable to recover it. 00:28:02.476 [2024-11-28 19:16:23.232856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.233007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.233061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.476 qpair failed and we were unable to recover it. 00:28:02.476 [2024-11-28 19:16:23.233214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.233342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.233371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.476 qpair failed and we were unable to recover it. 00:28:02.476 [2024-11-28 19:16:23.233470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.233582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.233631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.476 qpair failed and we were unable to recover it. 00:28:02.476 [2024-11-28 19:16:23.233778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.233933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.233979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.476 qpair failed and we were unable to recover it. 00:28:02.476 [2024-11-28 19:16:23.234073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.234188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.234214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.476 qpair failed and we were unable to recover it. 00:28:02.476 [2024-11-28 19:16:23.234325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.234412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.234455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.476 qpair failed and we were unable to recover it. 00:28:02.476 [2024-11-28 19:16:23.234581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.234696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.234723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.476 qpair failed and we were unable to recover it. 00:28:02.476 [2024-11-28 19:16:23.234849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.234973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.235002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.476 qpair failed and we were unable to recover it. 00:28:02.476 [2024-11-28 19:16:23.235127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.235241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.235284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.476 qpair failed and we were unable to recover it. 00:28:02.476 [2024-11-28 19:16:23.235401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.235512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.235538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.476 qpair failed and we were unable to recover it. 00:28:02.476 [2024-11-28 19:16:23.235618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.235731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.235759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.476 qpair failed and we were unable to recover it. 00:28:02.476 [2024-11-28 19:16:23.235852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.235949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.235978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.476 qpair failed and we were unable to recover it. 00:28:02.476 [2024-11-28 19:16:23.236108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.236220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.236262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.476 qpair failed and we were unable to recover it. 00:28:02.476 [2024-11-28 19:16:23.236349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.236497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.236523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.476 qpair failed and we were unable to recover it. 00:28:02.476 [2024-11-28 19:16:23.236651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.236744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.236772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.476 qpair failed and we were unable to recover it. 00:28:02.476 [2024-11-28 19:16:23.236865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.236990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.237017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.476 qpair failed and we were unable to recover it. 00:28:02.476 [2024-11-28 19:16:23.237170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.237261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.237289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.476 qpair failed and we were unable to recover it. 00:28:02.476 [2024-11-28 19:16:23.237391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.237507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.237532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.476 qpair failed and we were unable to recover it. 00:28:02.476 [2024-11-28 19:16:23.237612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.237752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.237777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.476 qpair failed and we were unable to recover it. 00:28:02.476 [2024-11-28 19:16:23.237869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.237979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.476 [2024-11-28 19:16:23.238008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.476 qpair failed and we were unable to recover it. 00:28:02.476 [2024-11-28 19:16:23.238131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.238249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.238277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.477 qpair failed and we were unable to recover it. 00:28:02.477 [2024-11-28 19:16:23.238372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.238519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.238545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.477 qpair failed and we were unable to recover it. 00:28:02.477 [2024-11-28 19:16:23.238700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.238794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.238835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.477 qpair failed and we were unable to recover it. 00:28:02.477 [2024-11-28 19:16:23.238973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.239099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.239126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.477 qpair failed and we were unable to recover it. 00:28:02.477 [2024-11-28 19:16:23.239226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.239372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.239404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.477 qpair failed and we were unable to recover it. 00:28:02.477 [2024-11-28 19:16:23.239532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.239654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.239679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.477 qpair failed and we were unable to recover it. 00:28:02.477 [2024-11-28 19:16:23.239775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.239901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.239929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.477 qpair failed and we were unable to recover it. 00:28:02.477 [2024-11-28 19:16:23.240019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.240168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.240194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.477 qpair failed and we were unable to recover it. 00:28:02.477 [2024-11-28 19:16:23.240332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.240418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.240444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.477 qpair failed and we were unable to recover it. 00:28:02.477 [2024-11-28 19:16:23.240556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.240641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.240666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.477 qpair failed and we were unable to recover it. 00:28:02.477 [2024-11-28 19:16:23.240761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.240883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.240915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.477 qpair failed and we were unable to recover it. 00:28:02.477 [2024-11-28 19:16:23.241031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.241123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.241150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.477 qpair failed and we were unable to recover it. 00:28:02.477 [2024-11-28 19:16:23.241246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.241352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.241377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.477 qpair failed and we were unable to recover it. 00:28:02.477 [2024-11-28 19:16:23.241467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.241592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.241621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.477 qpair failed and we were unable to recover it. 00:28:02.477 [2024-11-28 19:16:23.241709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.241817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.241844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.477 qpair failed and we were unable to recover it. 00:28:02.477 [2024-11-28 19:16:23.241933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.242032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.242057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.477 qpair failed and we were unable to recover it. 00:28:02.477 [2024-11-28 19:16:23.242223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.242347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.242375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.477 qpair failed and we were unable to recover it. 00:28:02.477 [2024-11-28 19:16:23.242488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.242592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.242619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.477 qpair failed and we were unable to recover it. 00:28:02.477 [2024-11-28 19:16:23.242747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.242830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.242857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.477 qpair failed and we were unable to recover it. 00:28:02.477 [2024-11-28 19:16:23.242958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.243070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.243097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.477 qpair failed and we were unable to recover it. 00:28:02.477 [2024-11-28 19:16:23.243201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.243279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.243304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.477 qpair failed and we were unable to recover it. 00:28:02.477 [2024-11-28 19:16:23.243390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.243485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.243510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.477 qpair failed and we were unable to recover it. 00:28:02.477 [2024-11-28 19:16:23.243602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.243688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.243731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.477 qpair failed and we were unable to recover it. 00:28:02.477 [2024-11-28 19:16:23.243828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.243981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.244009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.477 qpair failed and we were unable to recover it. 00:28:02.477 [2024-11-28 19:16:23.244111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.244242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.244271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.477 qpair failed and we were unable to recover it. 00:28:02.477 [2024-11-28 19:16:23.244404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.244512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.244537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.477 qpair failed and we were unable to recover it. 00:28:02.477 [2024-11-28 19:16:23.244620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.244727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.244752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.477 qpair failed and we were unable to recover it. 00:28:02.477 [2024-11-28 19:16:23.244872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.245004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.245032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.477 qpair failed and we were unable to recover it. 00:28:02.477 [2024-11-28 19:16:23.245151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.245271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.477 [2024-11-28 19:16:23.245298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.477 qpair failed and we were unable to recover it. 00:28:02.477 [2024-11-28 19:16:23.245424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.245525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.245550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.478 qpair failed and we were unable to recover it. 00:28:02.478 [2024-11-28 19:16:23.245629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.245732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.245757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.478 qpair failed and we were unable to recover it. 00:28:02.478 [2024-11-28 19:16:23.245874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.245985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.246010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.478 qpair failed and we were unable to recover it. 00:28:02.478 [2024-11-28 19:16:23.246167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.246292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.246319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.478 qpair failed and we were unable to recover it. 00:28:02.478 [2024-11-28 19:16:23.246410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.246518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.246544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.478 qpair failed and we were unable to recover it. 00:28:02.478 [2024-11-28 19:16:23.246625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.246736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.246763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.478 qpair failed and we were unable to recover it. 00:28:02.478 [2024-11-28 19:16:23.246880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.247001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.247029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.478 qpair failed and we were unable to recover it. 00:28:02.478 [2024-11-28 19:16:23.247246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.247414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.247474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.478 qpair failed and we were unable to recover it. 00:28:02.478 [2024-11-28 19:16:23.247583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.247724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.247751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.478 qpair failed and we were unable to recover it. 00:28:02.478 [2024-11-28 19:16:23.247877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.248034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.248062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.478 qpair failed and we were unable to recover it. 00:28:02.478 [2024-11-28 19:16:23.248181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.248275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.248302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.478 qpair failed and we were unable to recover it. 00:28:02.478 [2024-11-28 19:16:23.248433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.248542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.248567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.478 qpair failed and we were unable to recover it. 00:28:02.478 [2024-11-28 19:16:23.248684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.248814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.248842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.478 qpair failed and we were unable to recover it. 00:28:02.478 [2024-11-28 19:16:23.248936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.249053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.249081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.478 qpair failed and we were unable to recover it. 00:28:02.478 [2024-11-28 19:16:23.249170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.249321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.249348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.478 qpair failed and we were unable to recover it. 00:28:02.478 [2024-11-28 19:16:23.249470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.249609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.249634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.478 qpair failed and we were unable to recover it. 00:28:02.478 [2024-11-28 19:16:23.249801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.249954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.249984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.478 qpair failed and we were unable to recover it. 00:28:02.478 [2024-11-28 19:16:23.250072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.250148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.250176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.478 qpair failed and we were unable to recover it. 00:28:02.478 [2024-11-28 19:16:23.250291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.250387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.250424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.478 qpair failed and we were unable to recover it. 00:28:02.478 [2024-11-28 19:16:23.250573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.250706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.250731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.478 qpair failed and we were unable to recover it. 00:28:02.478 [2024-11-28 19:16:23.250807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.250948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.250991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.478 qpair failed and we were unable to recover it. 00:28:02.478 [2024-11-28 19:16:23.251109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.251187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.251215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.478 qpair failed and we were unable to recover it. 00:28:02.478 [2024-11-28 19:16:23.251307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.251446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.251472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.478 qpair failed and we were unable to recover it. 00:28:02.478 [2024-11-28 19:16:23.251557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.251708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.251732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.478 qpair failed and we were unable to recover it. 00:28:02.478 [2024-11-28 19:16:23.251861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.251971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.251999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.478 qpair failed and we were unable to recover it. 00:28:02.478 [2024-11-28 19:16:23.252102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.252248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.252276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.478 qpair failed and we were unable to recover it. 00:28:02.478 [2024-11-28 19:16:23.252360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.252500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.252526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.478 qpair failed and we were unable to recover it. 00:28:02.478 [2024-11-28 19:16:23.252633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.252728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.252754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.478 qpair failed and we were unable to recover it. 00:28:02.478 [2024-11-28 19:16:23.252901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.253024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.478 [2024-11-28 19:16:23.253052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.478 qpair failed and we were unable to recover it. 00:28:02.479 [2024-11-28 19:16:23.253171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.253297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.253324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.479 qpair failed and we were unable to recover it. 00:28:02.479 [2024-11-28 19:16:23.253470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.253571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.253596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.479 qpair failed and we were unable to recover it. 00:28:02.479 [2024-11-28 19:16:23.253678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.253757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.253781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.479 qpair failed and we were unable to recover it. 00:28:02.479 [2024-11-28 19:16:23.253868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.253971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.254001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.479 qpair failed and we were unable to recover it. 00:28:02.479 [2024-11-28 19:16:23.254080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.254179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.254207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.479 qpair failed and we were unable to recover it. 00:28:02.479 [2024-11-28 19:16:23.254321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.254443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.254487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.479 qpair failed and we were unable to recover it. 00:28:02.479 [2024-11-28 19:16:23.254595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.254714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.254738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.479 qpair failed and we were unable to recover it. 00:28:02.479 [2024-11-28 19:16:23.254855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.255014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.255042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.479 qpair failed and we were unable to recover it. 00:28:02.479 [2024-11-28 19:16:23.255128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.255212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.255240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.479 qpair failed and we were unable to recover it. 00:28:02.479 [2024-11-28 19:16:23.255365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.255485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.255511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.479 qpair failed and we were unable to recover it. 00:28:02.479 [2024-11-28 19:16:23.255609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.255689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.255715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.479 qpair failed and we were unable to recover it. 00:28:02.479 [2024-11-28 19:16:23.255852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.255981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.256007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.479 qpair failed and we were unable to recover it. 00:28:02.479 [2024-11-28 19:16:23.256173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.256320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.256348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.479 qpair failed and we were unable to recover it. 00:28:02.479 [2024-11-28 19:16:23.256516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.256630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.256656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.479 qpair failed and we were unable to recover it. 00:28:02.479 [2024-11-28 19:16:23.256743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.256855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.256881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.479 qpair failed and we were unable to recover it. 00:28:02.479 [2024-11-28 19:16:23.256986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.257134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.257162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.479 qpair failed and we were unable to recover it. 00:28:02.479 [2024-11-28 19:16:23.257258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.257377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.257413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.479 qpair failed and we were unable to recover it. 00:28:02.479 [2024-11-28 19:16:23.257546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.257642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.257670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.479 qpair failed and we were unable to recover it. 00:28:02.479 [2024-11-28 19:16:23.257778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.257893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.257918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.479 qpair failed and we were unable to recover it. 00:28:02.479 [2024-11-28 19:16:23.258046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.258204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.258231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.479 qpair failed and we were unable to recover it. 00:28:02.479 [2024-11-28 19:16:23.258348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.258476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.258504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.479 qpair failed and we were unable to recover it. 00:28:02.479 [2024-11-28 19:16:23.258588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.258675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.258702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.479 qpair failed and we were unable to recover it. 00:28:02.479 [2024-11-28 19:16:23.258835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.258908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.258933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.479 qpair failed and we were unable to recover it. 00:28:02.479 [2024-11-28 19:16:23.259047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.259177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.259204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.479 qpair failed and we were unable to recover it. 00:28:02.479 [2024-11-28 19:16:23.259347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.259435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.259461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.479 qpair failed and we were unable to recover it. 00:28:02.479 [2024-11-28 19:16:23.259558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.259629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.259654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.479 qpair failed and we were unable to recover it. 00:28:02.479 [2024-11-28 19:16:23.259760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.259869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.259893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.479 qpair failed and we were unable to recover it. 00:28:02.479 [2024-11-28 19:16:23.260043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.260162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.260189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.479 qpair failed and we were unable to recover it. 00:28:02.479 [2024-11-28 19:16:23.260277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.260405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.479 [2024-11-28 19:16:23.260433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.479 qpair failed and we were unable to recover it. 00:28:02.480 [2024-11-28 19:16:23.260554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.260649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.260674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.480 qpair failed and we were unable to recover it. 00:28:02.480 [2024-11-28 19:16:23.260753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.260837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.260861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.480 qpair failed and we were unable to recover it. 00:28:02.480 [2024-11-28 19:16:23.260963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.261129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.261157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.480 qpair failed and we were unable to recover it. 00:28:02.480 [2024-11-28 19:16:23.261280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.261430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.261458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.480 qpair failed and we were unable to recover it. 00:28:02.480 [2024-11-28 19:16:23.261572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.261666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.261695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.480 qpair failed and we were unable to recover it. 00:28:02.480 [2024-11-28 19:16:23.261811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.261885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.261909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.480 qpair failed and we were unable to recover it. 00:28:02.480 [2024-11-28 19:16:23.262020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.262111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.262135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.480 qpair failed and we were unable to recover it. 00:28:02.480 [2024-11-28 19:16:23.262217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.262321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.262346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.480 qpair failed and we were unable to recover it. 00:28:02.480 [2024-11-28 19:16:23.262462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.262539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.262564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.480 qpair failed and we were unable to recover it. 00:28:02.480 [2024-11-28 19:16:23.262677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.262757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.262782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.480 qpair failed and we were unable to recover it. 00:28:02.480 [2024-11-28 19:16:23.262923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.263069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.263097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.480 qpair failed and we were unable to recover it. 00:28:02.480 [2024-11-28 19:16:23.263193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.263313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.263354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.480 qpair failed and we were unable to recover it. 00:28:02.480 [2024-11-28 19:16:23.263472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.263580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.263606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.480 qpair failed and we were unable to recover it. 00:28:02.480 [2024-11-28 19:16:23.263690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.263829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.263854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.480 qpair failed and we were unable to recover it. 00:28:02.480 [2024-11-28 19:16:23.263965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.264085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.264112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.480 qpair failed and we were unable to recover it. 00:28:02.480 [2024-11-28 19:16:23.264203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.264297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.264324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.480 qpair failed and we were unable to recover it. 00:28:02.480 [2024-11-28 19:16:23.264438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.264567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.264594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.480 qpair failed and we were unable to recover it. 00:28:02.480 [2024-11-28 19:16:23.264701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.264781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.264806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.480 qpair failed and we were unable to recover it. 00:28:02.480 [2024-11-28 19:16:23.264923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.265032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.265059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.480 qpair failed and we were unable to recover it. 00:28:02.480 [2024-11-28 19:16:23.265186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.265273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.265301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.480 qpair failed and we were unable to recover it. 00:28:02.480 [2024-11-28 19:16:23.265415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.265561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.265589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.480 qpair failed and we were unable to recover it. 00:28:02.480 [2024-11-28 19:16:23.265695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.265770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.265794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.480 qpair failed and we were unable to recover it. 00:28:02.480 [2024-11-28 19:16:23.265909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.265990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.266014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.480 qpair failed and we were unable to recover it. 00:28:02.480 [2024-11-28 19:16:23.266134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.266287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.266315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.480 qpair failed and we were unable to recover it. 00:28:02.480 [2024-11-28 19:16:23.266460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.266596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.266620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.480 qpair failed and we were unable to recover it. 00:28:02.480 [2024-11-28 19:16:23.266734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.266872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.480 [2024-11-28 19:16:23.266901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.481 qpair failed and we were unable to recover it. 00:28:02.481 [2024-11-28 19:16:23.267057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.267145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.267169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.481 qpair failed and we were unable to recover it. 00:28:02.481 [2024-11-28 19:16:23.267324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.267478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.267506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.481 qpair failed and we were unable to recover it. 00:28:02.481 [2024-11-28 19:16:23.267623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.267739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.267766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.481 qpair failed and we were unable to recover it. 00:28:02.481 [2024-11-28 19:16:23.267923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.268030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.268054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.481 qpair failed and we were unable to recover it. 00:28:02.481 [2024-11-28 19:16:23.268177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.268330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.268358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.481 qpair failed and we were unable to recover it. 00:28:02.481 [2024-11-28 19:16:23.268522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.268607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.268631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.481 qpair failed and we were unable to recover it. 00:28:02.481 [2024-11-28 19:16:23.268739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.268828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.268856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.481 qpair failed and we were unable to recover it. 00:28:02.481 [2024-11-28 19:16:23.268959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.269074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.269099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.481 qpair failed and we were unable to recover it. 00:28:02.481 [2024-11-28 19:16:23.269188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.269270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.269296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.481 qpair failed and we were unable to recover it. 00:28:02.481 [2024-11-28 19:16:23.269435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.269528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.269560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.481 qpair failed and we were unable to recover it. 00:28:02.481 [2024-11-28 19:16:23.269684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.269764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.269791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.481 qpair failed and we were unable to recover it. 00:28:02.481 [2024-11-28 19:16:23.269943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.270085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.270126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.481 qpair failed and we were unable to recover it. 00:28:02.481 [2024-11-28 19:16:23.270252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.270373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.270408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.481 qpair failed and we were unable to recover it. 00:28:02.481 [2024-11-28 19:16:23.270535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.270618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.270645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.481 qpair failed and we were unable to recover it. 00:28:02.481 [2024-11-28 19:16:23.270793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.270879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.270908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.481 qpair failed and we were unable to recover it. 00:28:02.481 [2024-11-28 19:16:23.271016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.271151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.271175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.481 qpair failed and we were unable to recover it. 00:28:02.481 [2024-11-28 19:16:23.271255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.271346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.271370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.481 qpair failed and we were unable to recover it. 00:28:02.481 [2024-11-28 19:16:23.271517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.271594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.271618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.481 qpair failed and we were unable to recover it. 00:28:02.481 [2024-11-28 19:16:23.271765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.271873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.271899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.481 qpair failed and we were unable to recover it. 00:28:02.481 [2024-11-28 19:16:23.272038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.272176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.272200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.481 qpair failed and we were unable to recover it. 00:28:02.481 [2024-11-28 19:16:23.272288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.272405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.272448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.481 qpair failed and we were unable to recover it. 00:28:02.481 [2024-11-28 19:16:23.272566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.272653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.272678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.481 qpair failed and we were unable to recover it. 00:28:02.481 [2024-11-28 19:16:23.272842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.272963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.272989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.481 qpair failed and we were unable to recover it. 00:28:02.481 [2024-11-28 19:16:23.273129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.273216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.273240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.481 qpair failed and we were unable to recover it. 00:28:02.481 [2024-11-28 19:16:23.273330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.273418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.273443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.481 qpair failed and we were unable to recover it. 00:28:02.481 [2024-11-28 19:16:23.273557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.273693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.273720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.481 qpair failed and we were unable to recover it. 00:28:02.481 [2024-11-28 19:16:23.273838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.273964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.273991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.481 qpair failed and we were unable to recover it. 00:28:02.481 [2024-11-28 19:16:23.274122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.274256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.274281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.481 qpair failed and we were unable to recover it. 00:28:02.481 [2024-11-28 19:16:23.274381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.274489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.481 [2024-11-28 19:16:23.274531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.482 qpair failed and we were unable to recover it. 00:28:02.482 [2024-11-28 19:16:23.274619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.274730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.274754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.482 qpair failed and we were unable to recover it. 00:28:02.482 [2024-11-28 19:16:23.274872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.274995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.275022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.482 qpair failed and we were unable to recover it. 00:28:02.482 [2024-11-28 19:16:23.275130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.275211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.275235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.482 qpair failed and we were unable to recover it. 00:28:02.482 [2024-11-28 19:16:23.275347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.275516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.275544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.482 qpair failed and we were unable to recover it. 00:28:02.482 [2024-11-28 19:16:23.275663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.275825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.275850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.482 qpair failed and we were unable to recover it. 00:28:02.482 [2024-11-28 19:16:23.275958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.276037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.276063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.482 qpair failed and we were unable to recover it. 00:28:02.482 [2024-11-28 19:16:23.276176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.276313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.276336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.482 qpair failed and we were unable to recover it. 00:28:02.482 [2024-11-28 19:16:23.276422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.276554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.276581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.482 qpair failed and we were unable to recover it. 00:28:02.482 [2024-11-28 19:16:23.276728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.276852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.276879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.482 qpair failed and we were unable to recover it. 00:28:02.482 [2024-11-28 19:16:23.277000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.277158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.277182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.482 qpair failed and we were unable to recover it. 00:28:02.482 [2024-11-28 19:16:23.277298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.277382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.277415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.482 qpair failed and we were unable to recover it. 00:28:02.482 [2024-11-28 19:16:23.277553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.277649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.277691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.482 qpair failed and we were unable to recover it. 00:28:02.482 [2024-11-28 19:16:23.277810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.277922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.277966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.482 qpair failed and we were unable to recover it. 00:28:02.482 [2024-11-28 19:16:23.278050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.278172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.278199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.482 qpair failed and we were unable to recover it. 00:28:02.482 [2024-11-28 19:16:23.278335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.278438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.278463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.482 qpair failed and we were unable to recover it. 00:28:02.482 [2024-11-28 19:16:23.278558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.278708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.278735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.482 qpair failed and we were unable to recover it. 00:28:02.482 [2024-11-28 19:16:23.278860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.278956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.278984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.482 qpair failed and we were unable to recover it. 00:28:02.482 [2024-11-28 19:16:23.279102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.279230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.279255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.482 qpair failed and we were unable to recover it. 00:28:02.482 [2024-11-28 19:16:23.279397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.279481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.279505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.482 qpair failed and we were unable to recover it. 00:28:02.482 [2024-11-28 19:16:23.279637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.279758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.279786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.482 qpair failed and we were unable to recover it. 00:28:02.482 [2024-11-28 19:16:23.279906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.279998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.280025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.482 qpair failed and we were unable to recover it. 00:28:02.482 [2024-11-28 19:16:23.280162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.280278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.280304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.482 qpair failed and we were unable to recover it. 00:28:02.482 [2024-11-28 19:16:23.280400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.280516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.280540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.482 qpair failed and we were unable to recover it. 00:28:02.482 [2024-11-28 19:16:23.280639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.280757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.280785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.482 qpair failed and we were unable to recover it. 00:28:02.482 [2024-11-28 19:16:23.280934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.281031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.281057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.482 qpair failed and we were unable to recover it. 00:28:02.482 [2024-11-28 19:16:23.281148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.281270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.281296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.482 qpair failed and we were unable to recover it. 00:28:02.482 [2024-11-28 19:16:23.281463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.281570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.281593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.482 qpair failed and we were unable to recover it. 00:28:02.482 [2024-11-28 19:16:23.281709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.281842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.482 [2024-11-28 19:16:23.281871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.482 qpair failed and we were unable to recover it. 00:28:02.483 [2024-11-28 19:16:23.281991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.282121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.282148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.483 qpair failed and we were unable to recover it. 00:28:02.483 [2024-11-28 19:16:23.282274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.282355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.282382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.483 qpair failed and we were unable to recover it. 00:28:02.483 [2024-11-28 19:16:23.282522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.282665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.282689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.483 qpair failed and we were unable to recover it. 00:28:02.483 [2024-11-28 19:16:23.282820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.282922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.282955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.483 qpair failed and we were unable to recover it. 00:28:02.483 [2024-11-28 19:16:23.283051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.283176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.283203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.483 qpair failed and we were unable to recover it. 00:28:02.483 [2024-11-28 19:16:23.283349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.283494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.283522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.483 qpair failed and we were unable to recover it. 00:28:02.483 [2024-11-28 19:16:23.283688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.283827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.283852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.483 qpair failed and we were unable to recover it. 00:28:02.483 [2024-11-28 19:16:23.284017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.284168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.284196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.483 qpair failed and we were unable to recover it. 00:28:02.483 [2024-11-28 19:16:23.284322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.284436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.284466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.483 qpair failed and we were unable to recover it. 00:28:02.483 [2024-11-28 19:16:23.284556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.284675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.284701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.483 qpair failed and we were unable to recover it. 00:28:02.483 [2024-11-28 19:16:23.284801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.284923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.284946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.483 qpair failed and we were unable to recover it. 00:28:02.483 [2024-11-28 19:16:23.285077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.285167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.285194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.483 qpair failed and we were unable to recover it. 00:28:02.483 [2024-11-28 19:16:23.285346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.285474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.285517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.483 qpair failed and we were unable to recover it. 00:28:02.483 [2024-11-28 19:16:23.285655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.285739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.285781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.483 qpair failed and we were unable to recover it. 00:28:02.483 [2024-11-28 19:16:23.285883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.285969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.285994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.483 qpair failed and we were unable to recover it. 00:28:02.483 [2024-11-28 19:16:23.286084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.286172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.286196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.483 qpair failed and we were unable to recover it. 00:28:02.483 [2024-11-28 19:16:23.286289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.286423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.286448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.483 qpair failed and we were unable to recover it. 00:28:02.483 [2024-11-28 19:16:23.286531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.286635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.286659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.483 qpair failed and we were unable to recover it. 00:28:02.483 [2024-11-28 19:16:23.286743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.286854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.286878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.483 qpair failed and we were unable to recover it. 00:28:02.483 [2024-11-28 19:16:23.287006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.287125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.287153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.483 qpair failed and we were unable to recover it. 00:28:02.483 [2024-11-28 19:16:23.287283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.287404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.287432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.483 qpair failed and we were unable to recover it. 00:28:02.483 [2024-11-28 19:16:23.287518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.287618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.287644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.483 qpair failed and we were unable to recover it. 00:28:02.483 [2024-11-28 19:16:23.287772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.287856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.287879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.483 qpair failed and we were unable to recover it. 00:28:02.483 [2024-11-28 19:16:23.287956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.288083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.288110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.483 qpair failed and we were unable to recover it. 00:28:02.483 [2024-11-28 19:16:23.288274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.288424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.288453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.483 qpair failed and we were unable to recover it. 00:28:02.483 [2024-11-28 19:16:23.288542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.288664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.288691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.483 qpair failed and we were unable to recover it. 00:28:02.483 [2024-11-28 19:16:23.288816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.288925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.288950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.483 qpair failed and we were unable to recover it. 00:28:02.483 [2024-11-28 19:16:23.289100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.289189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.289217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.483 qpair failed and we were unable to recover it. 00:28:02.483 [2024-11-28 19:16:23.289350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.483 [2024-11-28 19:16:23.289495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.289519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.484 qpair failed and we were unable to recover it. 00:28:02.484 [2024-11-28 19:16:23.289619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.289701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.289728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.484 qpair failed and we were unable to recover it. 00:28:02.484 [2024-11-28 19:16:23.289865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.289937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.289962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.484 qpair failed and we were unable to recover it. 00:28:02.484 [2024-11-28 19:16:23.290124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.290267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.290295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.484 qpair failed and we were unable to recover it. 00:28:02.484 [2024-11-28 19:16:23.290404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.290526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.290555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.484 qpair failed and we were unable to recover it. 00:28:02.484 [2024-11-28 19:16:23.290709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.290827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.290854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.484 qpair failed and we were unable to recover it. 00:28:02.484 [2024-11-28 19:16:23.290984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.291075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.291100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.484 qpair failed and we were unable to recover it. 00:28:02.484 [2024-11-28 19:16:23.291214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.291342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.291371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.484 qpair failed and we were unable to recover it. 00:28:02.484 [2024-11-28 19:16:23.291474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.291612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.291637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.484 qpair failed and we were unable to recover it. 00:28:02.484 [2024-11-28 19:16:23.291749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.291895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.291922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.484 qpair failed and we were unable to recover it. 00:28:02.484 [2024-11-28 19:16:23.292059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.292176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.292201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.484 qpair failed and we were unable to recover it. 00:28:02.484 [2024-11-28 19:16:23.292288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.292404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.292429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.484 qpair failed and we were unable to recover it. 00:28:02.484 [2024-11-28 19:16:23.292565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.292680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.292706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.484 qpair failed and we were unable to recover it. 00:28:02.484 [2024-11-28 19:16:23.292794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.292915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.292945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.484 qpair failed and we were unable to recover it. 00:28:02.484 [2024-11-28 19:16:23.293083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.293218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.293242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.484 qpair failed and we were unable to recover it. 00:28:02.484 [2024-11-28 19:16:23.293433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.293548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.293587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.484 qpair failed and we were unable to recover it. 00:28:02.484 [2024-11-28 19:16:23.293675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.293757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.293781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.484 qpair failed and we were unable to recover it. 00:28:02.484 [2024-11-28 19:16:23.293921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.294074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.294100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.484 qpair failed and we were unable to recover it. 00:28:02.484 [2024-11-28 19:16:23.294200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.294285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.294309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.484 qpair failed and we were unable to recover it. 00:28:02.484 [2024-11-28 19:16:23.294424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.294507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.294531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.484 qpair failed and we were unable to recover it. 00:28:02.484 [2024-11-28 19:16:23.294625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.294729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.294757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.484 qpair failed and we were unable to recover it. 00:28:02.484 [2024-11-28 19:16:23.294885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.295001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.295025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.484 qpair failed and we were unable to recover it. 00:28:02.484 [2024-11-28 19:16:23.295137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.295244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.295268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.484 qpair failed and we were unable to recover it. 00:28:02.484 [2024-11-28 19:16:23.295357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.295476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.295502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.484 qpair failed and we were unable to recover it. 00:28:02.484 [2024-11-28 19:16:23.295589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.295693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.295718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.484 qpair failed and we were unable to recover it. 00:28:02.484 [2024-11-28 19:16:23.295828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.295912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.295938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.484 qpair failed and we were unable to recover it. 00:28:02.484 [2024-11-28 19:16:23.296076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.296159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.296188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.484 qpair failed and we were unable to recover it. 00:28:02.484 [2024-11-28 19:16:23.296287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.296408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.296437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.484 qpair failed and we were unable to recover it. 00:28:02.484 [2024-11-28 19:16:23.296537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.296651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.296679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.484 qpair failed and we were unable to recover it. 00:28:02.484 [2024-11-28 19:16:23.296805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.484 [2024-11-28 19:16:23.296898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.296926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.485 qpair failed and we were unable to recover it. 00:28:02.485 [2024-11-28 19:16:23.297087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.297198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.297223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.485 qpair failed and we were unable to recover it. 00:28:02.485 [2024-11-28 19:16:23.297319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.297478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.297504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.485 qpair failed and we were unable to recover it. 00:28:02.485 [2024-11-28 19:16:23.297617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.297738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.297766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.485 qpair failed and we were unable to recover it. 00:28:02.485 [2024-11-28 19:16:23.297940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.298080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.298104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.485 qpair failed and we were unable to recover it. 00:28:02.485 [2024-11-28 19:16:23.298242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.298331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.298356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.485 qpair failed and we were unable to recover it. 00:28:02.485 [2024-11-28 19:16:23.298474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.298572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.298599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.485 qpair failed and we were unable to recover it. 00:28:02.485 [2024-11-28 19:16:23.298726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.298815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.298841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.485 qpair failed and we were unable to recover it. 00:28:02.485 [2024-11-28 19:16:23.298971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.299122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.299148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.485 qpair failed and we were unable to recover it. 00:28:02.485 [2024-11-28 19:16:23.299255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.299401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.299426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.485 qpair failed and we were unable to recover it. 00:28:02.485 [2024-11-28 19:16:23.299576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.299718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.299742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.485 qpair failed and we were unable to recover it. 00:28:02.485 [2024-11-28 19:16:23.299858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.299988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.300014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.485 qpair failed and we were unable to recover it. 00:28:02.485 [2024-11-28 19:16:23.300160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.300250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.300276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.485 qpair failed and we were unable to recover it. 00:28:02.485 [2024-11-28 19:16:23.300437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.300541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.300565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.485 qpair failed and we were unable to recover it. 00:28:02.485 [2024-11-28 19:16:23.300684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.300799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.300840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.485 qpair failed and we were unable to recover it. 00:28:02.485 [2024-11-28 19:16:23.300932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.301090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.301117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.485 qpair failed and we were unable to recover it. 00:28:02.485 [2024-11-28 19:16:23.301284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.301372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.301405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.485 qpair failed and we were unable to recover it. 00:28:02.485 [2024-11-28 19:16:23.301515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.301625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.301650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.485 qpair failed and we were unable to recover it. 00:28:02.485 [2024-11-28 19:16:23.301765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.301931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.301955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.485 qpair failed and we were unable to recover it. 00:28:02.485 [2024-11-28 19:16:23.302096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.302199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.302227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.485 qpair failed and we were unable to recover it. 00:28:02.485 [2024-11-28 19:16:23.302378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.302510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.302537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.485 qpair failed and we were unable to recover it. 00:28:02.485 [2024-11-28 19:16:23.302672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.302762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.302786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.485 qpair failed and we were unable to recover it. 00:28:02.485 [2024-11-28 19:16:23.302925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.303054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.303081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.485 qpair failed and we were unable to recover it. 00:28:02.485 [2024-11-28 19:16:23.303180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.303304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.303331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.485 qpair failed and we were unable to recover it. 00:28:02.485 [2024-11-28 19:16:23.303453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.303576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.303602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.485 qpair failed and we were unable to recover it. 00:28:02.485 [2024-11-28 19:16:23.303710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.303820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.485 [2024-11-28 19:16:23.303844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.485 qpair failed and we were unable to recover it. 00:28:02.486 [2024-11-28 19:16:23.304000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.304113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.304140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.486 qpair failed and we were unable to recover it. 00:28:02.486 [2024-11-28 19:16:23.304238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.304359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.304387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.486 qpair failed and we were unable to recover it. 00:28:02.486 [2024-11-28 19:16:23.304526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.304652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.304680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.486 qpair failed and we were unable to recover it. 00:28:02.486 [2024-11-28 19:16:23.304812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.304902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.304927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.486 qpair failed and we were unable to recover it. 00:28:02.486 [2024-11-28 19:16:23.305064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.305145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.305187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.486 qpair failed and we were unable to recover it. 00:28:02.486 [2024-11-28 19:16:23.305307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.305451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.305479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.486 qpair failed and we were unable to recover it. 00:28:02.486 [2024-11-28 19:16:23.305629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.305721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.305749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.486 qpair failed and we were unable to recover it. 00:28:02.486 [2024-11-28 19:16:23.305907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.306015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.306039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.486 qpair failed and we were unable to recover it. 00:28:02.486 [2024-11-28 19:16:23.306154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.306267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.306291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.486 qpair failed and we were unable to recover it. 00:28:02.486 [2024-11-28 19:16:23.306406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.306548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.306576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.486 qpair failed and we were unable to recover it. 00:28:02.486 [2024-11-28 19:16:23.306705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.306788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.306812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.486 qpair failed and we were unable to recover it. 00:28:02.486 [2024-11-28 19:16:23.306898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.307031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.307055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.486 qpair failed and we were unable to recover it. 00:28:02.486 [2024-11-28 19:16:23.307178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.307310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.307337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.486 qpair failed and we were unable to recover it. 00:28:02.486 [2024-11-28 19:16:23.307430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.307525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.307549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.486 qpair failed and we were unable to recover it. 00:28:02.486 [2024-11-28 19:16:23.307656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.307762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.307786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.486 qpair failed and we were unable to recover it. 00:28:02.486 [2024-11-28 19:16:23.307866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.307976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.308001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.486 qpair failed and we were unable to recover it. 00:28:02.486 [2024-11-28 19:16:23.308106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.308218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.308245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.486 qpair failed and we were unable to recover it. 00:28:02.486 [2024-11-28 19:16:23.308344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.308466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.308494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.486 qpair failed and we were unable to recover it. 00:28:02.486 [2024-11-28 19:16:23.308597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.308684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.308711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.486 qpair failed and we were unable to recover it. 00:28:02.486 [2024-11-28 19:16:23.308871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.308982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.309006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.486 qpair failed and we were unable to recover it. 00:28:02.486 [2024-11-28 19:16:23.309174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.309312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.309337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.486 qpair failed and we were unable to recover it. 00:28:02.486 [2024-11-28 19:16:23.309495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.309577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.309601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.486 qpair failed and we were unable to recover it. 00:28:02.486 [2024-11-28 19:16:23.309754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.309901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.309932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.486 qpair failed and we were unable to recover it. 00:28:02.486 [2024-11-28 19:16:23.310071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.310187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.310211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.486 qpair failed and we were unable to recover it. 00:28:02.486 [2024-11-28 19:16:23.310322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.310457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.310482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.486 qpair failed and we were unable to recover it. 00:28:02.486 [2024-11-28 19:16:23.310640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.310730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.310758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.486 qpair failed and we were unable to recover it. 00:28:02.486 [2024-11-28 19:16:23.310877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.310999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.311027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.486 qpair failed and we were unable to recover it. 00:28:02.486 [2024-11-28 19:16:23.311159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.311268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.311293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.486 qpair failed and we were unable to recover it. 00:28:02.486 [2024-11-28 19:16:23.311425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.311511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.486 [2024-11-28 19:16:23.311539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.486 qpair failed and we were unable to recover it. 00:28:02.486 [2024-11-28 19:16:23.311631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.311753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.311780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.487 qpair failed and we were unable to recover it. 00:28:02.487 [2024-11-28 19:16:23.311945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.312080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.312105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.487 qpair failed and we were unable to recover it. 00:28:02.487 [2024-11-28 19:16:23.312222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.312310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.312335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.487 qpair failed and we were unable to recover it. 00:28:02.487 [2024-11-28 19:16:23.312419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.312621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.312648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.487 qpair failed and we were unable to recover it. 00:28:02.487 [2024-11-28 19:16:23.312781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.312875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.312904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.487 qpair failed and we were unable to recover it. 00:28:02.487 [2024-11-28 19:16:23.312992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.313113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.313141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.487 qpair failed and we were unable to recover it. 00:28:02.487 [2024-11-28 19:16:23.313234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.313316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.313341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.487 qpair failed and we were unable to recover it. 00:28:02.487 [2024-11-28 19:16:23.313435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.313528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.313557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.487 qpair failed and we were unable to recover it. 00:28:02.487 [2024-11-28 19:16:23.313649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.313771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.313798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.487 qpair failed and we were unable to recover it. 00:28:02.487 [2024-11-28 19:16:23.313891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.314009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.314037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.487 qpair failed and we were unable to recover it. 00:28:02.487 [2024-11-28 19:16:23.314192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.314309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.314333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.487 qpair failed and we were unable to recover it. 00:28:02.487 [2024-11-28 19:16:23.314424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.314510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.314535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.487 qpair failed and we were unable to recover it. 00:28:02.487 [2024-11-28 19:16:23.314676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.314828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.314852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.487 qpair failed and we were unable to recover it. 00:28:02.487 [2024-11-28 19:16:23.314956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.315030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.315055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.487 qpair failed and we were unable to recover it. 00:28:02.487 [2024-11-28 19:16:23.315137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.315277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.315301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.487 qpair failed and we were unable to recover it. 00:28:02.487 [2024-11-28 19:16:23.315422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.315547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.315574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.487 qpair failed and we were unable to recover it. 00:28:02.487 [2024-11-28 19:16:23.315745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.315830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.315855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.487 qpair failed and we were unable to recover it. 00:28:02.487 [2024-11-28 19:16:23.315973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.316105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.316148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.487 qpair failed and we were unable to recover it. 00:28:02.487 [2024-11-28 19:16:23.316240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.316347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.316371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.487 qpair failed and we were unable to recover it. 00:28:02.487 [2024-11-28 19:16:23.316482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.316597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.316624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.487 qpair failed and we were unable to recover it. 00:28:02.487 [2024-11-28 19:16:23.316749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.316872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.316900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.487 qpair failed and we were unable to recover it. 00:28:02.487 [2024-11-28 19:16:23.316998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.317091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.317118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.487 qpair failed and we were unable to recover it. 00:28:02.487 [2024-11-28 19:16:23.317275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.317384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.317416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.487 qpair failed and we were unable to recover it. 00:28:02.487 [2024-11-28 19:16:23.317550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.317669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.317695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.487 qpair failed and we were unable to recover it. 00:28:02.487 [2024-11-28 19:16:23.317829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.317975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.318002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.487 qpair failed and we were unable to recover it. 00:28:02.487 [2024-11-28 19:16:23.318138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.318262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.318289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.487 qpair failed and we were unable to recover it. 00:28:02.487 [2024-11-28 19:16:23.318419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.318531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.318556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.487 qpair failed and we were unable to recover it. 00:28:02.487 [2024-11-28 19:16:23.318661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.318758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.318786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.487 qpair failed and we were unable to recover it. 00:28:02.487 [2024-11-28 19:16:23.318913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.319059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.487 [2024-11-28 19:16:23.319086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.487 qpair failed and we were unable to recover it. 00:28:02.487 [2024-11-28 19:16:23.319186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.319318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.319342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.488 qpair failed and we were unable to recover it. 00:28:02.488 [2024-11-28 19:16:23.319460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.319594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.319620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.488 qpair failed and we were unable to recover it. 00:28:02.488 [2024-11-28 19:16:23.319796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.319992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.320027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.488 qpair failed and we were unable to recover it. 00:28:02.488 [2024-11-28 19:16:23.320168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.320292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.320319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.488 qpair failed and we were unable to recover it. 00:28:02.488 [2024-11-28 19:16:23.320446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.320531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.320559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.488 qpair failed and we were unable to recover it. 00:28:02.488 [2024-11-28 19:16:23.320671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.320815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.320840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.488 qpair failed and we were unable to recover it. 00:28:02.488 [2024-11-28 19:16:23.320978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.321097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.321124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.488 qpair failed and we were unable to recover it. 00:28:02.488 [2024-11-28 19:16:23.321214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.321334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.321361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.488 qpair failed and we were unable to recover it. 00:28:02.488 [2024-11-28 19:16:23.321520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.321611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.321653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.488 qpair failed and we were unable to recover it. 00:28:02.488 [2024-11-28 19:16:23.321743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.321858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.321883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.488 qpair failed and we were unable to recover it. 00:28:02.488 [2024-11-28 19:16:23.322011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.322096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.322124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.488 qpair failed and we were unable to recover it. 00:28:02.488 [2024-11-28 19:16:23.322239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.322336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.322364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.488 qpair failed and we were unable to recover it. 00:28:02.488 [2024-11-28 19:16:23.322530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.322616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.322640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.488 qpair failed and we were unable to recover it. 00:28:02.488 [2024-11-28 19:16:23.322726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.322835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.322858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.488 qpair failed and we were unable to recover it. 00:28:02.488 [2024-11-28 19:16:23.322947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.323084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.323111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.488 qpair failed and we were unable to recover it. 00:28:02.488 [2024-11-28 19:16:23.323258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.323371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.323412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.488 qpair failed and we were unable to recover it. 00:28:02.488 [2024-11-28 19:16:23.323538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.323625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.323667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.488 qpair failed and we were unable to recover it. 00:28:02.488 [2024-11-28 19:16:23.323756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.323892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.323917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.488 qpair failed and we were unable to recover it. 00:28:02.488 [2024-11-28 19:16:23.324022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.324101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.324128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.488 qpair failed and we were unable to recover it. 00:28:02.488 [2024-11-28 19:16:23.324239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.324385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.324420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.488 qpair failed and we were unable to recover it. 00:28:02.488 [2024-11-28 19:16:23.324580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.324728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.324756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.488 qpair failed and we were unable to recover it. 00:28:02.488 [2024-11-28 19:16:23.324889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.325003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.325028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.488 qpair failed and we were unable to recover it. 00:28:02.488 [2024-11-28 19:16:23.325109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.325207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.325235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.488 qpair failed and we were unable to recover it. 00:28:02.488 [2024-11-28 19:16:23.325334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.325424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.325452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.488 qpair failed and we were unable to recover it. 00:28:02.488 [2024-11-28 19:16:23.325584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.325721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.325746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.488 qpair failed and we were unable to recover it. 00:28:02.488 [2024-11-28 19:16:23.325853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.325987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.326016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.488 qpair failed and we were unable to recover it. 00:28:02.488 [2024-11-28 19:16:23.326149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.326273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.326298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.488 qpair failed and we were unable to recover it. 00:28:02.488 [2024-11-28 19:16:23.326383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.326465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.326490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.488 qpair failed and we were unable to recover it. 00:28:02.488 [2024-11-28 19:16:23.326603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.326739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.488 [2024-11-28 19:16:23.326766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.488 qpair failed and we were unable to recover it. 00:28:02.488 [2024-11-28 19:16:23.326901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.327004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.327028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.489 qpair failed and we were unable to recover it. 00:28:02.489 [2024-11-28 19:16:23.327114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.327244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.327271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.489 qpair failed and we were unable to recover it. 00:28:02.489 [2024-11-28 19:16:23.327359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.327489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.327517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.489 qpair failed and we were unable to recover it. 00:28:02.489 [2024-11-28 19:16:23.327607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.327754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.327781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.489 qpair failed and we were unable to recover it. 00:28:02.489 [2024-11-28 19:16:23.327886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.327991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.328015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.489 qpair failed and we were unable to recover it. 00:28:02.489 [2024-11-28 19:16:23.328172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.328305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.328329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.489 qpair failed and we were unable to recover it. 00:28:02.489 [2024-11-28 19:16:23.328473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.328631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.328659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.489 qpair failed and we were unable to recover it. 00:28:02.489 [2024-11-28 19:16:23.328757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.328847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.328873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.489 qpair failed and we were unable to recover it. 00:28:02.489 [2024-11-28 19:16:23.328985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.329067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.329090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.489 qpair failed and we were unable to recover it. 00:28:02.489 [2024-11-28 19:16:23.329206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.329322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.329348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.489 qpair failed and we were unable to recover it. 00:28:02.489 [2024-11-28 19:16:23.329485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.329602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.329626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.489 qpair failed and we were unable to recover it. 00:28:02.489 [2024-11-28 19:16:23.329737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.329820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.329846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.489 qpair failed and we were unable to recover it. 00:28:02.489 [2024-11-28 19:16:23.329973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.330110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.330134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.489 qpair failed and we were unable to recover it. 00:28:02.489 [2024-11-28 19:16:23.330293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.330414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.330444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.489 qpair failed and we were unable to recover it. 00:28:02.489 [2024-11-28 19:16:23.330575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.330665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.330689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.489 qpair failed and we were unable to recover it. 00:28:02.489 [2024-11-28 19:16:23.330828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.330990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.331018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.489 qpair failed and we were unable to recover it. 00:28:02.489 [2024-11-28 19:16:23.331133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.331239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.331263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.489 qpair failed and we were unable to recover it. 00:28:02.489 [2024-11-28 19:16:23.331426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.331576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.331604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.489 qpair failed and we were unable to recover it. 00:28:02.489 [2024-11-28 19:16:23.331763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.331873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.331899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.489 qpair failed and we were unable to recover it. 00:28:02.489 [2024-11-28 19:16:23.332002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.332137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.332161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.489 qpair failed and we were unable to recover it. 00:28:02.489 [2024-11-28 19:16:23.332251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.332329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.332354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.489 qpair failed and we were unable to recover it. 00:28:02.489 [2024-11-28 19:16:23.332470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.332609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.332637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.489 qpair failed and we were unable to recover it. 00:28:02.489 [2024-11-28 19:16:23.332735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.332891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.332919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.489 qpair failed and we were unable to recover it. 00:28:02.489 [2024-11-28 19:16:23.333011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.333158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.333185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.489 qpair failed and we were unable to recover it. 00:28:02.489 [2024-11-28 19:16:23.333300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.333383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.333414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.489 qpair failed and we were unable to recover it. 00:28:02.489 [2024-11-28 19:16:23.333569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.333655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.489 [2024-11-28 19:16:23.333697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.489 qpair failed and we were unable to recover it. 00:28:02.489 [2024-11-28 19:16:23.333784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.333903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.333930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.490 qpair failed and we were unable to recover it. 00:28:02.490 [2024-11-28 19:16:23.334011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.334158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.334185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.490 qpair failed and we were unable to recover it. 00:28:02.490 [2024-11-28 19:16:23.334322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.334407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.334433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.490 qpair failed and we were unable to recover it. 00:28:02.490 [2024-11-28 19:16:23.334566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.334661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.334688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.490 qpair failed and we were unable to recover it. 00:28:02.490 [2024-11-28 19:16:23.334810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.334944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.334969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.490 qpair failed and we were unable to recover it. 00:28:02.490 [2024-11-28 19:16:23.335073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.335147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.335171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.490 qpair failed and we were unable to recover it. 00:28:02.490 [2024-11-28 19:16:23.335324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.335423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.335449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.490 qpair failed and we were unable to recover it. 00:28:02.490 [2024-11-28 19:16:23.335536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.335676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.335700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.490 qpair failed and we were unable to recover it. 00:28:02.490 [2024-11-28 19:16:23.335792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.335924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.335952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.490 qpair failed and we were unable to recover it. 00:28:02.490 [2024-11-28 19:16:23.336033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.336151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.336177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.490 qpair failed and we were unable to recover it. 00:28:02.490 [2024-11-28 19:16:23.336342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.336451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.336476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.490 qpair failed and we were unable to recover it. 00:28:02.490 [2024-11-28 19:16:23.336559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.336654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.336678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.490 qpair failed and we were unable to recover it. 00:28:02.490 [2024-11-28 19:16:23.336817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.336916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.336943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.490 qpair failed and we were unable to recover it. 00:28:02.490 [2024-11-28 19:16:23.337037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.337201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.337225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.490 qpair failed and we were unable to recover it. 00:28:02.490 [2024-11-28 19:16:23.337313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.337401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.337426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.490 qpair failed and we were unable to recover it. 00:28:02.490 [2024-11-28 19:16:23.337567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.337669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.337696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.490 qpair failed and we were unable to recover it. 00:28:02.490 [2024-11-28 19:16:23.337788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.337911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.337938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.490 qpair failed and we were unable to recover it. 00:28:02.490 [2024-11-28 19:16:23.338065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.338177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.338204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.490 qpair failed and we were unable to recover it. 00:28:02.490 [2024-11-28 19:16:23.338353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.338470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.338495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.490 qpair failed and we were unable to recover it. 00:28:02.490 [2024-11-28 19:16:23.338602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.338752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.338781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.490 qpair failed and we were unable to recover it. 00:28:02.490 [2024-11-28 19:16:23.338903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.339022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.339049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.490 qpair failed and we were unable to recover it. 00:28:02.490 [2024-11-28 19:16:23.339169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.339301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.339333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.490 qpair failed and we were unable to recover it. 00:28:02.490 [2024-11-28 19:16:23.339493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.339605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.339630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.490 qpair failed and we were unable to recover it. 00:28:02.490 [2024-11-28 19:16:23.339807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.339927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.339954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.490 qpair failed and we were unable to recover it. 00:28:02.490 [2024-11-28 19:16:23.340072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.340170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.340197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.490 qpair failed and we were unable to recover it. 00:28:02.490 [2024-11-28 19:16:23.340328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.340413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.340442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.490 qpair failed and we were unable to recover it. 00:28:02.490 [2024-11-28 19:16:23.340546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.340618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.340643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.490 qpair failed and we were unable to recover it. 00:28:02.490 [2024-11-28 19:16:23.340758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.340886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.340913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.490 qpair failed and we were unable to recover it. 00:28:02.490 [2024-11-28 19:16:23.341012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.341167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.490 [2024-11-28 19:16:23.341191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.490 qpair failed and we were unable to recover it. 00:28:02.490 [2024-11-28 19:16:23.341298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.341421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.341449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.491 qpair failed and we were unable to recover it. 00:28:02.491 [2024-11-28 19:16:23.341567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.341676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.341699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.491 qpair failed and we were unable to recover it. 00:28:02.491 [2024-11-28 19:16:23.341849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.341973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.342000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.491 qpair failed and we were unable to recover it. 00:28:02.491 [2024-11-28 19:16:23.342131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.342298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.342323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.491 qpair failed and we were unable to recover it. 00:28:02.491 [2024-11-28 19:16:23.342419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.342502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.342527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.491 qpair failed and we were unable to recover it. 00:28:02.491 [2024-11-28 19:16:23.342637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.342743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.342768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.491 qpair failed and we were unable to recover it. 00:28:02.491 [2024-11-28 19:16:23.342896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.343018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.343044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.491 qpair failed and we were unable to recover it. 00:28:02.491 [2024-11-28 19:16:23.343164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.343285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.343313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.491 qpair failed and we were unable to recover it. 00:28:02.491 [2024-11-28 19:16:23.343448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.343582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.343607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.491 qpair failed and we were unable to recover it. 00:28:02.491 [2024-11-28 19:16:23.343743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.343856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.343881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.491 qpair failed and we were unable to recover it. 00:28:02.491 [2024-11-28 19:16:23.344016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.344108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.344136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.491 qpair failed and we were unable to recover it. 00:28:02.491 [2024-11-28 19:16:23.344259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.344349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.344376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.491 qpair failed and we were unable to recover it. 00:28:02.491 [2024-11-28 19:16:23.344511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.344677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.344702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.491 qpair failed and we were unable to recover it. 00:28:02.491 [2024-11-28 19:16:23.344823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.344906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.344930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.491 qpair failed and we were unable to recover it. 00:28:02.491 [2024-11-28 19:16:23.345045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.345198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.345226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.491 qpair failed and we were unable to recover it. 00:28:02.491 [2024-11-28 19:16:23.345351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.345512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.345540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.491 qpair failed and we were unable to recover it. 00:28:02.491 [2024-11-28 19:16:23.345656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.345782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.345806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.491 qpair failed and we were unable to recover it. 00:28:02.491 [2024-11-28 19:16:23.345949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.346033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.346058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.491 qpair failed and we were unable to recover it. 00:28:02.491 [2024-11-28 19:16:23.346181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.346300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.346327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.491 qpair failed and we were unable to recover it. 00:28:02.491 [2024-11-28 19:16:23.346424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.346546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.346572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.491 qpair failed and we were unable to recover it. 00:28:02.491 [2024-11-28 19:16:23.346670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.346789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.346816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.491 qpair failed and we were unable to recover it. 00:28:02.491 [2024-11-28 19:16:23.346938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.347051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.347076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.491 qpair failed and we were unable to recover it. 00:28:02.491 [2024-11-28 19:16:23.347160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.347300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.347325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.491 qpair failed and we were unable to recover it. 00:28:02.491 [2024-11-28 19:16:23.347463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.347584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.347612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.491 qpair failed and we were unable to recover it. 00:28:02.491 [2024-11-28 19:16:23.347743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.347887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.347912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.491 qpair failed and we were unable to recover it. 00:28:02.491 [2024-11-28 19:16:23.348049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.348162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.348186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.491 qpair failed and we were unable to recover it. 00:28:02.491 [2024-11-28 19:16:23.348311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.348448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.348474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.491 qpair failed and we were unable to recover it. 00:28:02.491 [2024-11-28 19:16:23.348560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.348670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.348694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.491 qpair failed and we were unable to recover it. 00:28:02.491 [2024-11-28 19:16:23.348800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.348884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.491 [2024-11-28 19:16:23.348908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.491 qpair failed and we were unable to recover it. 00:28:02.492 [2024-11-28 19:16:23.349048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.349155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.349180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.492 qpair failed and we were unable to recover it. 00:28:02.492 [2024-11-28 19:16:23.349292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.349410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.349439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.492 qpair failed and we were unable to recover it. 00:28:02.492 [2024-11-28 19:16:23.349559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.349677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.349704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.492 qpair failed and we were unable to recover it. 00:28:02.492 [2024-11-28 19:16:23.349819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.349914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.349942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.492 qpair failed and we were unable to recover it. 00:28:02.492 [2024-11-28 19:16:23.350078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.350165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.350191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.492 qpair failed and we were unable to recover it. 00:28:02.492 [2024-11-28 19:16:23.350295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.350406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.350435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.492 qpair failed and we were unable to recover it. 00:28:02.492 [2024-11-28 19:16:23.350563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.350715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.350742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.492 qpair failed and we were unable to recover it. 00:28:02.492 [2024-11-28 19:16:23.350894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.350982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.351009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.492 qpair failed and we were unable to recover it. 00:28:02.492 [2024-11-28 19:16:23.351116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.351226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.351251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.492 qpair failed and we were unable to recover it. 00:28:02.492 [2024-11-28 19:16:23.351387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.351501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.351527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.492 qpair failed and we were unable to recover it. 00:28:02.492 [2024-11-28 19:16:23.351657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.351742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.351769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.492 qpair failed and we were unable to recover it. 00:28:02.492 [2024-11-28 19:16:23.351897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.351990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.352018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.492 qpair failed and we were unable to recover it. 00:28:02.492 [2024-11-28 19:16:23.352120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.352237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.352262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.492 qpair failed and we were unable to recover it. 00:28:02.492 [2024-11-28 19:16:23.352352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.352436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.352462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.492 qpair failed and we were unable to recover it. 00:28:02.492 [2024-11-28 19:16:23.352596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.352692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.352720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.492 qpair failed and we were unable to recover it. 00:28:02.492 [2024-11-28 19:16:23.352811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.352917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.352945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.492 qpair failed and we were unable to recover it. 00:28:02.492 [2024-11-28 19:16:23.353118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.353234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.353259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.492 qpair failed and we were unable to recover it. 00:28:02.492 [2024-11-28 19:16:23.353364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.353464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.353493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.492 qpair failed and we were unable to recover it. 00:28:02.492 [2024-11-28 19:16:23.353649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.353768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.353796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.492 qpair failed and we were unable to recover it. 00:28:02.492 [2024-11-28 19:16:23.353891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.353976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.354006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.492 qpair failed and we were unable to recover it. 00:28:02.492 [2024-11-28 19:16:23.354113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.354204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.354227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.492 qpair failed and we were unable to recover it. 00:28:02.492 [2024-11-28 19:16:23.354337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.354424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.354449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.492 qpair failed and we were unable to recover it. 00:28:02.492 [2024-11-28 19:16:23.354538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.354621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.354645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.492 qpair failed and we were unable to recover it. 00:28:02.492 [2024-11-28 19:16:23.354737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.354848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.354873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.492 qpair failed and we were unable to recover it. 00:28:02.492 [2024-11-28 19:16:23.354952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.355081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.355106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.492 qpair failed and we were unable to recover it. 00:28:02.492 [2024-11-28 19:16:23.355225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.355333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.355358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.492 qpair failed and we were unable to recover it. 00:28:02.492 [2024-11-28 19:16:23.355452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.355534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.355558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.492 qpair failed and we were unable to recover it. 00:28:02.492 [2024-11-28 19:16:23.355697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.355780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.355805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.492 qpair failed and we were unable to recover it. 00:28:02.492 [2024-11-28 19:16:23.355882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.355968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.492 [2024-11-28 19:16:23.355992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.492 qpair failed and we were unable to recover it. 00:28:02.492 [2024-11-28 19:16:23.356075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.356187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.356211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.493 qpair failed and we were unable to recover it. 00:28:02.493 [2024-11-28 19:16:23.356306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.356418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.356443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.493 qpair failed and we were unable to recover it. 00:28:02.493 [2024-11-28 19:16:23.356531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.356616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.356640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.493 qpair failed and we were unable to recover it. 00:28:02.493 [2024-11-28 19:16:23.356727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.356873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.356898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.493 qpair failed and we were unable to recover it. 00:28:02.493 [2024-11-28 19:16:23.356979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.357126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.357151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.493 qpair failed and we were unable to recover it. 00:28:02.493 [2024-11-28 19:16:23.357256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.357361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.357384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.493 qpair failed and we were unable to recover it. 00:28:02.493 [2024-11-28 19:16:23.357490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.357631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.357656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.493 qpair failed and we were unable to recover it. 00:28:02.493 [2024-11-28 19:16:23.357731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.357840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.357865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.493 qpair failed and we were unable to recover it. 00:28:02.493 [2024-11-28 19:16:23.357980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.358084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.358108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.493 qpair failed and we were unable to recover it. 00:28:02.493 [2024-11-28 19:16:23.358192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.358270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.358294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.493 qpair failed and we were unable to recover it. 00:28:02.493 [2024-11-28 19:16:23.358380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.358459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.358483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.493 qpair failed and we were unable to recover it. 00:28:02.493 [2024-11-28 19:16:23.358571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.358653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.358678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.493 qpair failed and we were unable to recover it. 00:28:02.493 [2024-11-28 19:16:23.358785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.358863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.358888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.493 qpair failed and we were unable to recover it. 00:28:02.493 [2024-11-28 19:16:23.358995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.359103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.359126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.493 qpair failed and we were unable to recover it. 00:28:02.493 [2024-11-28 19:16:23.359219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.359305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.359329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.493 qpair failed and we were unable to recover it. 00:28:02.493 [2024-11-28 19:16:23.359439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.359554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.359578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.493 qpair failed and we were unable to recover it. 00:28:02.493 [2024-11-28 19:16:23.359726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.359835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.359860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.493 qpair failed and we were unable to recover it. 00:28:02.493 [2024-11-28 19:16:23.359976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.360080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.360105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.493 qpair failed and we were unable to recover it. 00:28:02.493 [2024-11-28 19:16:23.360223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.360342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.360367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.493 qpair failed and we were unable to recover it. 00:28:02.493 [2024-11-28 19:16:23.360458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.360529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.360554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.493 qpair failed and we were unable to recover it. 00:28:02.493 [2024-11-28 19:16:23.360693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.360785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.360811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.493 qpair failed and we were unable to recover it. 00:28:02.493 [2024-11-28 19:16:23.360924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.361004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.361028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.493 qpair failed and we were unable to recover it. 00:28:02.493 [2024-11-28 19:16:23.361106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.361216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.361241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.493 qpair failed and we were unable to recover it. 00:28:02.493 [2024-11-28 19:16:23.361353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.361437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.361462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.493 qpair failed and we were unable to recover it. 00:28:02.493 [2024-11-28 19:16:23.361566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.361678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.361703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.493 qpair failed and we were unable to recover it. 00:28:02.493 [2024-11-28 19:16:23.361791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.361875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.361900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.493 qpair failed and we were unable to recover it. 00:28:02.493 [2024-11-28 19:16:23.362018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.362112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.362137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.493 qpair failed and we were unable to recover it. 00:28:02.493 [2024-11-28 19:16:23.362272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.362384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.362415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.493 qpair failed and we were unable to recover it. 00:28:02.493 [2024-11-28 19:16:23.362508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.362585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.493 [2024-11-28 19:16:23.362610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.493 qpair failed and we were unable to recover it. 00:28:02.493 [2024-11-28 19:16:23.362718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.362822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.362847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.494 qpair failed and we were unable to recover it. 00:28:02.494 [2024-11-28 19:16:23.362957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.363044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.363068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.494 qpair failed and we were unable to recover it. 00:28:02.494 [2024-11-28 19:16:23.363177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.363286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.363311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.494 qpair failed and we were unable to recover it. 00:28:02.494 [2024-11-28 19:16:23.363427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.363538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.363562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.494 qpair failed and we were unable to recover it. 00:28:02.494 [2024-11-28 19:16:23.363643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.363726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.363750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.494 qpair failed and we were unable to recover it. 00:28:02.494 [2024-11-28 19:16:23.363862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.363975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.363998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.494 qpair failed and we were unable to recover it. 00:28:02.494 [2024-11-28 19:16:23.364104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.364214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.364239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.494 qpair failed and we were unable to recover it. 00:28:02.494 [2024-11-28 19:16:23.364354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.364451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.364479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.494 qpair failed and we were unable to recover it. 00:28:02.494 [2024-11-28 19:16:23.364592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.364681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.364706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.494 qpair failed and we were unable to recover it. 00:28:02.494 [2024-11-28 19:16:23.364784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.364886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.364911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.494 qpair failed and we were unable to recover it. 00:28:02.494 [2024-11-28 19:16:23.365028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.365113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.365137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.494 qpair failed and we were unable to recover it. 00:28:02.494 [2024-11-28 19:16:23.365227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.365300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.365325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.494 qpair failed and we were unable to recover it. 00:28:02.494 [2024-11-28 19:16:23.365440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.365556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.365581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.494 qpair failed and we were unable to recover it. 00:28:02.494 [2024-11-28 19:16:23.365725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.365832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.365857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.494 qpair failed and we were unable to recover it. 00:28:02.494 [2024-11-28 19:16:23.365942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.366054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.366078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.494 qpair failed and we were unable to recover it. 00:28:02.494 [2024-11-28 19:16:23.366167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.366275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.366301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.494 qpair failed and we were unable to recover it. 00:28:02.494 [2024-11-28 19:16:23.366445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.366531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.366555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.494 qpair failed and we were unable to recover it. 00:28:02.494 [2024-11-28 19:16:23.366697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.366778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.366806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.494 qpair failed and we were unable to recover it. 00:28:02.494 [2024-11-28 19:16:23.366906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.367008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.367032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.494 qpair failed and we were unable to recover it. 00:28:02.494 [2024-11-28 19:16:23.367111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.367215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.367239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.494 qpair failed and we were unable to recover it. 00:28:02.494 [2024-11-28 19:16:23.367353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.367471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.367497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.494 qpair failed and we were unable to recover it. 00:28:02.494 [2024-11-28 19:16:23.367577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.367687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.367710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.494 qpair failed and we were unable to recover it. 00:28:02.494 [2024-11-28 19:16:23.367849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.367942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.367966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.494 qpair failed and we were unable to recover it. 00:28:02.494 [2024-11-28 19:16:23.368083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.368190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.368215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.494 qpair failed and we were unable to recover it. 00:28:02.494 [2024-11-28 19:16:23.368322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.368407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.368432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.494 qpair failed and we were unable to recover it. 00:28:02.494 [2024-11-28 19:16:23.368526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.368605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.494 [2024-11-28 19:16:23.368631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.494 qpair failed and we were unable to recover it. 00:28:02.494 [2024-11-28 19:16:23.368713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.368817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.368841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.495 qpair failed and we were unable to recover it. 00:28:02.495 [2024-11-28 19:16:23.368913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.369020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.369043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.495 qpair failed and we were unable to recover it. 00:28:02.495 [2024-11-28 19:16:23.369155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.369230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.369254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.495 qpair failed and we were unable to recover it. 00:28:02.495 [2024-11-28 19:16:23.369345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.369457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.369481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.495 qpair failed and we were unable to recover it. 00:28:02.495 [2024-11-28 19:16:23.369568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.369705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.369729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.495 qpair failed and we were unable to recover it. 00:28:02.495 [2024-11-28 19:16:23.369820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.369924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.369949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.495 qpair failed and we were unable to recover it. 00:28:02.495 [2024-11-28 19:16:23.370031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.370140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.370165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.495 qpair failed and we were unable to recover it. 00:28:02.495 [2024-11-28 19:16:23.370261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.370413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.370439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.495 qpair failed and we were unable to recover it. 00:28:02.495 [2024-11-28 19:16:23.370556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.370642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.370666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.495 qpair failed and we were unable to recover it. 00:28:02.495 [2024-11-28 19:16:23.370777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.370885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.370910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.495 qpair failed and we were unable to recover it. 00:28:02.495 [2024-11-28 19:16:23.371032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.371143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.371168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.495 qpair failed and we were unable to recover it. 00:28:02.495 [2024-11-28 19:16:23.371254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.371332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.371357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.495 qpair failed and we were unable to recover it. 00:28:02.495 [2024-11-28 19:16:23.371447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.371524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.371548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.495 qpair failed and we were unable to recover it. 00:28:02.495 [2024-11-28 19:16:23.371666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.371745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.371769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.495 qpair failed and we were unable to recover it. 00:28:02.495 [2024-11-28 19:16:23.371858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.371973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.371998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.495 qpair failed and we were unable to recover it. 00:28:02.495 [2024-11-28 19:16:23.372080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.372155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.372179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.495 qpair failed and we were unable to recover it. 00:28:02.495 [2024-11-28 19:16:23.372295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.372409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.372433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.495 qpair failed and we were unable to recover it. 00:28:02.495 [2024-11-28 19:16:23.372518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.372602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.372626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.495 qpair failed and we were unable to recover it. 00:28:02.495 [2024-11-28 19:16:23.372712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.372854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.372878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.495 qpair failed and we were unable to recover it. 00:28:02.495 [2024-11-28 19:16:23.373015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.373099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.373130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.495 qpair failed and we were unable to recover it. 00:28:02.495 [2024-11-28 19:16:23.373244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.373321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.373345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.495 qpair failed and we were unable to recover it. 00:28:02.495 [2024-11-28 19:16:23.373467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.373556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.373580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.495 qpair failed and we were unable to recover it. 00:28:02.495 [2024-11-28 19:16:23.373664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.373757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.373781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.495 qpair failed and we were unable to recover it. 00:28:02.495 [2024-11-28 19:16:23.373872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.373979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.374003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.495 qpair failed and we were unable to recover it. 00:28:02.495 [2024-11-28 19:16:23.374139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.374228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.374252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.495 qpair failed and we were unable to recover it. 00:28:02.495 [2024-11-28 19:16:23.374362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.374453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.374478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.495 qpair failed and we were unable to recover it. 00:28:02.495 [2024-11-28 19:16:23.374564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.374648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.374673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.495 qpair failed and we were unable to recover it. 00:28:02.495 [2024-11-28 19:16:23.374752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.374862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.495 [2024-11-28 19:16:23.374887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.495 qpair failed and we were unable to recover it. 00:28:02.495 [2024-11-28 19:16:23.375000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.375113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.375139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.496 qpair failed and we were unable to recover it. 00:28:02.496 [2024-11-28 19:16:23.375229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.375337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.375362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.496 qpair failed and we were unable to recover it. 00:28:02.496 [2024-11-28 19:16:23.375463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.375545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.375569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.496 qpair failed and we were unable to recover it. 00:28:02.496 [2024-11-28 19:16:23.375656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.375744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.375768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.496 qpair failed and we were unable to recover it. 00:28:02.496 [2024-11-28 19:16:23.375841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.375919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.375944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.496 qpair failed and we were unable to recover it. 00:28:02.496 [2024-11-28 19:16:23.376021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.376112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.376135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.496 qpair failed and we were unable to recover it. 00:28:02.496 [2024-11-28 19:16:23.376216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.376355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.376379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.496 qpair failed and we were unable to recover it. 00:28:02.496 [2024-11-28 19:16:23.376483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.376562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.376586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.496 qpair failed and we were unable to recover it. 00:28:02.496 [2024-11-28 19:16:23.376699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.376807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.376831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.496 qpair failed and we were unable to recover it. 00:28:02.496 [2024-11-28 19:16:23.376935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.377012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.377037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.496 qpair failed and we were unable to recover it. 00:28:02.496 [2024-11-28 19:16:23.377119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.377230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.377255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.496 qpair failed and we were unable to recover it. 00:28:02.496 [2024-11-28 19:16:23.377337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.377469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.377494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.496 qpair failed and we were unable to recover it. 00:28:02.496 [2024-11-28 19:16:23.377602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.377682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.377707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.496 qpair failed and we were unable to recover it. 00:28:02.496 [2024-11-28 19:16:23.377789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.377898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.377922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.496 qpair failed and we were unable to recover it. 00:28:02.496 [2024-11-28 19:16:23.378003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.378109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.378138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.496 qpair failed and we were unable to recover it. 00:28:02.496 [2024-11-28 19:16:23.378254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.378333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.378358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.496 qpair failed and we were unable to recover it. 00:28:02.496 [2024-11-28 19:16:23.378474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.378565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.378590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.496 qpair failed and we were unable to recover it. 00:28:02.496 [2024-11-28 19:16:23.378709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.378820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.378844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.496 qpair failed and we were unable to recover it. 00:28:02.496 [2024-11-28 19:16:23.378958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.379037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.379061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.496 qpair failed and we were unable to recover it. 00:28:02.496 [2024-11-28 19:16:23.379143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.379259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.379283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.496 qpair failed and we were unable to recover it. 00:28:02.496 [2024-11-28 19:16:23.379404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.379513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.379539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.496 qpair failed and we were unable to recover it. 00:28:02.496 [2024-11-28 19:16:23.379627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.379712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.379736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.496 qpair failed and we were unable to recover it. 00:28:02.496 [2024-11-28 19:16:23.379827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.379931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.379955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.496 qpair failed and we were unable to recover it. 00:28:02.496 [2024-11-28 19:16:23.380105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.380191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.380214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.496 qpair failed and we were unable to recover it. 00:28:02.496 [2024-11-28 19:16:23.380308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.380446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.380471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.496 qpair failed and we were unable to recover it. 00:28:02.496 [2024-11-28 19:16:23.380591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.380701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.380725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.496 qpair failed and we were unable to recover it. 00:28:02.496 [2024-11-28 19:16:23.380804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.380879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.380903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.496 qpair failed and we were unable to recover it. 00:28:02.496 [2024-11-28 19:16:23.381023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.381100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.381124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.496 qpair failed and we were unable to recover it. 00:28:02.496 [2024-11-28 19:16:23.381200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.496 [2024-11-28 19:16:23.381318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.381341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.497 qpair failed and we were unable to recover it. 00:28:02.497 [2024-11-28 19:16:23.381435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.381519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.381543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.497 qpair failed and we were unable to recover it. 00:28:02.497 [2024-11-28 19:16:23.381652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.381763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.381787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.497 qpair failed and we were unable to recover it. 00:28:02.497 [2024-11-28 19:16:23.381900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.382001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.382026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.497 qpair failed and we were unable to recover it. 00:28:02.497 [2024-11-28 19:16:23.382097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.382180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.382205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.497 qpair failed and we were unable to recover it. 00:28:02.497 [2024-11-28 19:16:23.382318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.382403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.382427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.497 qpair failed and we were unable to recover it. 00:28:02.497 [2024-11-28 19:16:23.382513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.382622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.382646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.497 qpair failed and we were unable to recover it. 00:28:02.497 [2024-11-28 19:16:23.382736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.382811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.382835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.497 qpair failed and we were unable to recover it. 00:28:02.497 [2024-11-28 19:16:23.382922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.383004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.383028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.497 qpair failed and we were unable to recover it. 00:28:02.497 [2024-11-28 19:16:23.383117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.383229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.383254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.497 qpair failed and we were unable to recover it. 00:28:02.497 [2024-11-28 19:16:23.383368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.383481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.383506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.497 qpair failed and we were unable to recover it. 00:28:02.497 [2024-11-28 19:16:23.383601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.383710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.383734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.497 qpair failed and we were unable to recover it. 00:28:02.497 [2024-11-28 19:16:23.383844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.383927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.383950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.497 qpair failed and we were unable to recover it. 00:28:02.497 [2024-11-28 19:16:23.384057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.384167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.384191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.497 qpair failed and we were unable to recover it. 00:28:02.497 [2024-11-28 19:16:23.384285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.384367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.384399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.497 qpair failed and we were unable to recover it. 00:28:02.497 [2024-11-28 19:16:23.384507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.384616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.384640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.497 qpair failed and we were unable to recover it. 00:28:02.497 [2024-11-28 19:16:23.384724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.384864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.384888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.497 qpair failed and we were unable to recover it. 00:28:02.497 [2024-11-28 19:16:23.385000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.385113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.385137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.497 qpair failed and we were unable to recover it. 00:28:02.497 [2024-11-28 19:16:23.385214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.385325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.385349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.497 qpair failed and we were unable to recover it. 00:28:02.497 [2024-11-28 19:16:23.385452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.385563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.385587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.497 qpair failed and we were unable to recover it. 00:28:02.497 [2024-11-28 19:16:23.385701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.385798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.385823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.497 qpair failed and we were unable to recover it. 00:28:02.497 [2024-11-28 19:16:23.385935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.386045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.386069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.497 qpair failed and we were unable to recover it. 00:28:02.497 [2024-11-28 19:16:23.386152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.386259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.386283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.497 qpair failed and we were unable to recover it. 00:28:02.497 [2024-11-28 19:16:23.386366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.386501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.386526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.497 qpair failed and we were unable to recover it. 00:28:02.497 [2024-11-28 19:16:23.386608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.386713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.386737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.497 qpair failed and we were unable to recover it. 00:28:02.497 [2024-11-28 19:16:23.386829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.386904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.386928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.497 qpair failed and we were unable to recover it. 00:28:02.497 [2024-11-28 19:16:23.387003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.387110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.387134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.497 qpair failed and we were unable to recover it. 00:28:02.497 [2024-11-28 19:16:23.387435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.387557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.387583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.497 qpair failed and we were unable to recover it. 00:28:02.497 [2024-11-28 19:16:23.387666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.388441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.388471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.497 qpair failed and we were unable to recover it. 00:28:02.497 [2024-11-28 19:16:23.388591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.497 [2024-11-28 19:16:23.388710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.388734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.498 qpair failed and we were unable to recover it. 00:28:02.498 [2024-11-28 19:16:23.388861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.388941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.388967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.498 qpair failed and we were unable to recover it. 00:28:02.498 [2024-11-28 19:16:23.389079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.389195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.389219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.498 qpair failed and we were unable to recover it. 00:28:02.498 [2024-11-28 19:16:23.389334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.389424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.389449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.498 qpair failed and we were unable to recover it. 00:28:02.498 [2024-11-28 19:16:23.389566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.389715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.389739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.498 qpair failed and we were unable to recover it. 00:28:02.498 [2024-11-28 19:16:23.389850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.389960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.389984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.498 qpair failed and we were unable to recover it. 00:28:02.498 [2024-11-28 19:16:23.390098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.390186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.390210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.498 qpair failed and we were unable to recover it. 00:28:02.498 [2024-11-28 19:16:23.390299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.390418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.390443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.498 qpair failed and we were unable to recover it. 00:28:02.498 [2024-11-28 19:16:23.390554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.390657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.390685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.498 qpair failed and we were unable to recover it. 00:28:02.498 [2024-11-28 19:16:23.390772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.390852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.390876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.498 qpair failed and we were unable to recover it. 00:28:02.498 [2024-11-28 19:16:23.390991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.391079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.391102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.498 qpair failed and we were unable to recover it. 00:28:02.498 [2024-11-28 19:16:23.391214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.391301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.391325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.498 qpair failed and we were unable to recover it. 00:28:02.498 [2024-11-28 19:16:23.391428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.391544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.391568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.498 qpair failed and we were unable to recover it. 00:28:02.498 [2024-11-28 19:16:23.391655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.391768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.391792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.498 qpair failed and we were unable to recover it. 00:28:02.498 [2024-11-28 19:16:23.391871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.391983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.392007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.498 qpair failed and we were unable to recover it. 00:28:02.498 [2024-11-28 19:16:23.392113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.392225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.392249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.498 qpair failed and we were unable to recover it. 00:28:02.498 [2024-11-28 19:16:23.392338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.392449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.392474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.498 qpair failed and we were unable to recover it. 00:28:02.498 [2024-11-28 19:16:23.392564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.392652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.392678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.498 qpair failed and we were unable to recover it. 00:28:02.498 [2024-11-28 19:16:23.392765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.392854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.392878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.498 qpair failed and we were unable to recover it. 00:28:02.498 [2024-11-28 19:16:23.393024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.393105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.393129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.498 qpair failed and we were unable to recover it. 00:28:02.498 [2024-11-28 19:16:23.393238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.393320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.393344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.498 qpair failed and we were unable to recover it. 00:28:02.498 [2024-11-28 19:16:23.393463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.393551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.393576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.498 qpair failed and we were unable to recover it. 00:28:02.498 [2024-11-28 19:16:23.393693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.393800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.393824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.498 qpair failed and we were unable to recover it. 00:28:02.498 [2024-11-28 19:16:23.393941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.394019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.394044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.498 qpair failed and we were unable to recover it. 00:28:02.498 [2024-11-28 19:16:23.394165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.394246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.394270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.498 qpair failed and we were unable to recover it. 00:28:02.498 [2024-11-28 19:16:23.394382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.394479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.394504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.498 qpair failed and we were unable to recover it. 00:28:02.498 [2024-11-28 19:16:23.394585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.394693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.394717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.498 qpair failed and we were unable to recover it. 00:28:02.498 [2024-11-28 19:16:23.394804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.394947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.394971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.498 qpair failed and we were unable to recover it. 00:28:02.498 [2024-11-28 19:16:23.395110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.395224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.498 [2024-11-28 19:16:23.395250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.498 qpair failed and we were unable to recover it. 00:28:02.498 [2024-11-28 19:16:23.395390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.395527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.395553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.499 qpair failed and we were unable to recover it. 00:28:02.499 [2024-11-28 19:16:23.395639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.395727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.395751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.499 qpair failed and we were unable to recover it. 00:28:02.499 [2024-11-28 19:16:23.395865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.395942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.395966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.499 qpair failed and we were unable to recover it. 00:28:02.499 [2024-11-28 19:16:23.396052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.396156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.396180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.499 qpair failed and we were unable to recover it. 00:28:02.499 [2024-11-28 19:16:23.396295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.396382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.396414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.499 qpair failed and we were unable to recover it. 00:28:02.499 [2024-11-28 19:16:23.396510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.396626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.396650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.499 qpair failed and we were unable to recover it. 00:28:02.499 [2024-11-28 19:16:23.396736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.396852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.396877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.499 qpair failed and we were unable to recover it. 00:28:02.499 [2024-11-28 19:16:23.396957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.397063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.397088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.499 qpair failed and we were unable to recover it. 00:28:02.499 [2024-11-28 19:16:23.397207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.397292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.397317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.499 qpair failed and we were unable to recover it. 00:28:02.499 [2024-11-28 19:16:23.397432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.397516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.397540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.499 qpair failed and we were unable to recover it. 00:28:02.499 [2024-11-28 19:16:23.397650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.397783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.397820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.499 qpair failed and we were unable to recover it. 00:28:02.499 [2024-11-28 19:16:23.397941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.398079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.398111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.499 qpair failed and we were unable to recover it. 00:28:02.499 [2024-11-28 19:16:23.398239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.398334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.398366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.499 qpair failed and we were unable to recover it. 00:28:02.499 [2024-11-28 19:16:23.398502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.398590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.398622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:02.499 qpair failed and we were unable to recover it. 00:28:02.499 [2024-11-28 19:16:23.398724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.398836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.398861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.499 qpair failed and we were unable to recover it. 00:28:02.499 [2024-11-28 19:16:23.398967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.399084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.399109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.499 qpair failed and we were unable to recover it. 00:28:02.499 [2024-11-28 19:16:23.399187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.399269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.399294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.499 qpair failed and we were unable to recover it. 00:28:02.499 [2024-11-28 19:16:23.399410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.399519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.399564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.499 qpair failed and we were unable to recover it. 00:28:02.499 [2024-11-28 19:16:23.399680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.399771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.399812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.499 qpair failed and we were unable to recover it. 00:28:02.499 [2024-11-28 19:16:23.399929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.400037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.400061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.499 qpair failed and we were unable to recover it. 00:28:02.499 [2024-11-28 19:16:23.400204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.400343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.400368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.499 qpair failed and we were unable to recover it. 00:28:02.499 [2024-11-28 19:16:23.400528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.400622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.400646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.499 qpair failed and we were unable to recover it. 00:28:02.499 [2024-11-28 19:16:23.400726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.400831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.400858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.499 qpair failed and we were unable to recover it. 00:28:02.499 [2024-11-28 19:16:23.400952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.401096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.401125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.499 qpair failed and we were unable to recover it. 00:28:02.499 [2024-11-28 19:16:23.401254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.401363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.401388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.499 qpair failed and we were unable to recover it. 00:28:02.499 [2024-11-28 19:16:23.401486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.499 [2024-11-28 19:16:23.401619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.401662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.500 qpair failed and we were unable to recover it. 00:28:02.500 [2024-11-28 19:16:23.401763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.401856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.401899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.500 qpair failed and we were unable to recover it. 00:28:02.500 [2024-11-28 19:16:23.402010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.402096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.402121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.500 qpair failed and we were unable to recover it. 00:28:02.500 [2024-11-28 19:16:23.402198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.402278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.402303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.500 qpair failed and we were unable to recover it. 00:28:02.500 [2024-11-28 19:16:23.402431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.402546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.402574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.500 qpair failed and we were unable to recover it. 00:28:02.500 [2024-11-28 19:16:23.402753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.402868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.402900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.500 qpair failed and we were unable to recover it. 00:28:02.500 [2024-11-28 19:16:23.402993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.403082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.403109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.500 qpair failed and we were unable to recover it. 00:28:02.500 [2024-11-28 19:16:23.403236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.403368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.403399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.500 qpair failed and we were unable to recover it. 00:28:02.500 [2024-11-28 19:16:23.403495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.403575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.403599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.500 qpair failed and we were unable to recover it. 00:28:02.500 [2024-11-28 19:16:23.403718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.403832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.403859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.500 qpair failed and we were unable to recover it. 00:28:02.500 [2024-11-28 19:16:23.403981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.404121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.404148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.500 qpair failed and we were unable to recover it. 00:28:02.500 [2024-11-28 19:16:23.404254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.404349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.404377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.500 qpair failed and we were unable to recover it. 00:28:02.500 [2024-11-28 19:16:23.404516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.404596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.404641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.500 qpair failed and we were unable to recover it. 00:28:02.500 [2024-11-28 19:16:23.404741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.404858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.404886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.500 qpair failed and we were unable to recover it. 00:28:02.500 [2024-11-28 19:16:23.405009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.405093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.405121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.500 qpair failed and we were unable to recover it. 00:28:02.500 [2024-11-28 19:16:23.405251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.405340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.405369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.500 qpair failed and we were unable to recover it. 00:28:02.500 [2024-11-28 19:16:23.405489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.405618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.405645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.500 qpair failed and we were unable to recover it. 00:28:02.500 [2024-11-28 19:16:23.405766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.405888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.405915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.500 qpair failed and we were unable to recover it. 00:28:02.500 [2024-11-28 19:16:23.406034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.406133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.406161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.500 qpair failed and we were unable to recover it. 00:28:02.500 [2024-11-28 19:16:23.406262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.406369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.406402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.500 qpair failed and we were unable to recover it. 00:28:02.500 [2024-11-28 19:16:23.406493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.406582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.406605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.500 qpair failed and we were unable to recover it. 00:28:02.500 [2024-11-28 19:16:23.406706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.406858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.406886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.500 qpair failed and we were unable to recover it. 00:28:02.500 [2024-11-28 19:16:23.406987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.407070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.407096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.500 qpair failed and we were unable to recover it. 00:28:02.500 [2024-11-28 19:16:23.407186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.407276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.407304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.500 qpair failed and we were unable to recover it. 00:28:02.500 [2024-11-28 19:16:23.407421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.407501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.407525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.500 qpair failed and we were unable to recover it. 00:28:02.500 [2024-11-28 19:16:23.407658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.407754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.407781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.500 qpair failed and we were unable to recover it. 00:28:02.500 [2024-11-28 19:16:23.407914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.408002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.408028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.500 qpair failed and we were unable to recover it. 00:28:02.500 [2024-11-28 19:16:23.408121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.408242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.408270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.500 qpair failed and we were unable to recover it. 00:28:02.500 [2024-11-28 19:16:23.408407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.408520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.408545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.500 qpair failed and we were unable to recover it. 00:28:02.500 [2024-11-28 19:16:23.408703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.500 [2024-11-28 19:16:23.408817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.408844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.501 qpair failed and we were unable to recover it. 00:28:02.501 [2024-11-28 19:16:23.408934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.409025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.409052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.501 qpair failed and we were unable to recover it. 00:28:02.501 [2024-11-28 19:16:23.409140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.409221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.409249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.501 qpair failed and we were unable to recover it. 00:28:02.501 [2024-11-28 19:16:23.409337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.409460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.409485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.501 qpair failed and we were unable to recover it. 00:28:02.501 [2024-11-28 19:16:23.409600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.409767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.409794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.501 qpair failed and we were unable to recover it. 00:28:02.501 [2024-11-28 19:16:23.409919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.410041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.410068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.501 qpair failed and we were unable to recover it. 00:28:02.501 [2024-11-28 19:16:23.410197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.410285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.410313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.501 qpair failed and we were unable to recover it. 00:28:02.501 [2024-11-28 19:16:23.410447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.410547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.410572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.501 qpair failed and we were unable to recover it. 00:28:02.501 [2024-11-28 19:16:23.410684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.410815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.410843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.501 qpair failed and we were unable to recover it. 00:28:02.501 [2024-11-28 19:16:23.410975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.411088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.411116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.501 qpair failed and we were unable to recover it. 00:28:02.501 [2024-11-28 19:16:23.411204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.411330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.411358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.501 qpair failed and we were unable to recover it. 00:28:02.501 [2024-11-28 19:16:23.411502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.411587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.411612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.501 qpair failed and we were unable to recover it. 00:28:02.501 [2024-11-28 19:16:23.411719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.411842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.411867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.501 qpair failed and we were unable to recover it. 00:28:02.501 [2024-11-28 19:16:23.411978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.412049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.412074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.501 qpair failed and we were unable to recover it. 00:28:02.501 [2024-11-28 19:16:23.412171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.412281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.412306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.501 qpair failed and we were unable to recover it. 00:28:02.501 [2024-11-28 19:16:23.412385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.412482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.412508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.501 qpair failed and we were unable to recover it. 00:28:02.501 [2024-11-28 19:16:23.412621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.412705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.412731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.501 qpair failed and we were unable to recover it. 00:28:02.501 [2024-11-28 19:16:23.412836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.412924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.412949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.501 qpair failed and we were unable to recover it. 00:28:02.501 [2024-11-28 19:16:23.413027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.413163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.413188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.501 qpair failed and we were unable to recover it. 00:28:02.501 [2024-11-28 19:16:23.413272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.413359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.413385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.501 qpair failed and we were unable to recover it. 00:28:02.501 [2024-11-28 19:16:23.413534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.413657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.413682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.501 qpair failed and we were unable to recover it. 00:28:02.501 [2024-11-28 19:16:23.413797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.413873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.413897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.501 qpair failed and we were unable to recover it. 00:28:02.501 [2024-11-28 19:16:23.414006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.414083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.414108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.501 qpair failed and we were unable to recover it. 00:28:02.501 [2024-11-28 19:16:23.414200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.414330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.414355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.501 qpair failed and we were unable to recover it. 00:28:02.501 [2024-11-28 19:16:23.414475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.414568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.414592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.501 qpair failed and we were unable to recover it. 00:28:02.501 [2024-11-28 19:16:23.414707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.414783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.414807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.501 qpair failed and we were unable to recover it. 00:28:02.501 [2024-11-28 19:16:23.414917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.415055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.415079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.501 qpair failed and we were unable to recover it. 00:28:02.501 [2024-11-28 19:16:23.415191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.415272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.415297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.501 qpair failed and we were unable to recover it. 00:28:02.501 [2024-11-28 19:16:23.415374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.415486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.415510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.501 qpair failed and we were unable to recover it. 00:28:02.501 [2024-11-28 19:16:23.415625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.501 [2024-11-28 19:16:23.415735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.415761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.502 qpair failed and we were unable to recover it. 00:28:02.502 [2024-11-28 19:16:23.415856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.415937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.415961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.502 qpair failed and we were unable to recover it. 00:28:02.502 [2024-11-28 19:16:23.416069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.416148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.416173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.502 qpair failed and we were unable to recover it. 00:28:02.502 [2024-11-28 19:16:23.416280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.416383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.416415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.502 qpair failed and we were unable to recover it. 00:28:02.502 [2024-11-28 19:16:23.416499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.416572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.416597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.502 qpair failed and we were unable to recover it. 00:28:02.502 [2024-11-28 19:16:23.416679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.416791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.416818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.502 qpair failed and we were unable to recover it. 00:28:02.502 [2024-11-28 19:16:23.416934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.417014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.417038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.502 qpair failed and we were unable to recover it. 00:28:02.502 [2024-11-28 19:16:23.417152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.417256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.417280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.502 qpair failed and we were unable to recover it. 00:28:02.502 [2024-11-28 19:16:23.417385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.417502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.417532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.502 qpair failed and we were unable to recover it. 00:28:02.502 [2024-11-28 19:16:23.417622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.417719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.417746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.502 qpair failed and we were unable to recover it. 00:28:02.502 [2024-11-28 19:16:23.417838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.417985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.418013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.502 qpair failed and we were unable to recover it. 00:28:02.502 [2024-11-28 19:16:23.418161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.418273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.418298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.502 qpair failed and we were unable to recover it. 00:28:02.502 [2024-11-28 19:16:23.418437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.418542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.418566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.502 qpair failed and we were unable to recover it. 00:28:02.502 [2024-11-28 19:16:23.418677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.418800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.418829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.502 qpair failed and we were unable to recover it. 00:28:02.502 [2024-11-28 19:16:23.418956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.419079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.419107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.502 qpair failed and we were unable to recover it. 00:28:02.502 [2024-11-28 19:16:23.419214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.419321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.419346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.502 qpair failed and we were unable to recover it. 00:28:02.502 [2024-11-28 19:16:23.419466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.419550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.419575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.502 qpair failed and we were unable to recover it. 00:28:02.502 [2024-11-28 19:16:23.419708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.419857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.419884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.502 qpair failed and we were unable to recover it. 00:28:02.502 [2024-11-28 19:16:23.420006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.420151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.420178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.502 qpair failed and we were unable to recover it. 00:28:02.502 [2024-11-28 19:16:23.420299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.420418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.420444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.502 qpair failed and we were unable to recover it. 00:28:02.502 [2024-11-28 19:16:23.420567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.420645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.420670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.502 qpair failed and we were unable to recover it. 00:28:02.502 [2024-11-28 19:16:23.420750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.420862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.420887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.502 qpair failed and we were unable to recover it. 00:28:02.502 [2024-11-28 19:16:23.420960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.421056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.421083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.502 qpair failed and we were unable to recover it. 00:28:02.502 [2024-11-28 19:16:23.421192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.421331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.421356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.502 qpair failed and we were unable to recover it. 00:28:02.502 [2024-11-28 19:16:23.421477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.421553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.421577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.502 qpair failed and we were unable to recover it. 00:28:02.502 [2024-11-28 19:16:23.421657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.421803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.421828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.502 qpair failed and we were unable to recover it. 00:28:02.502 [2024-11-28 19:16:23.421913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.422060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.422085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.502 qpair failed and we were unable to recover it. 00:28:02.502 [2024-11-28 19:16:23.422160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.422268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.422292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.502 qpair failed and we were unable to recover it. 00:28:02.502 [2024-11-28 19:16:23.422405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.422516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.422541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.502 qpair failed and we were unable to recover it. 00:28:02.502 [2024-11-28 19:16:23.422658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.502 [2024-11-28 19:16:23.422739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.422763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.503 qpair failed and we were unable to recover it. 00:28:02.503 [2024-11-28 19:16:23.422841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.422939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.422966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.503 qpair failed and we were unable to recover it. 00:28:02.503 [2024-11-28 19:16:23.423100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.423216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.423241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.503 qpair failed and we were unable to recover it. 00:28:02.503 [2024-11-28 19:16:23.423323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.423436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.423461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.503 qpair failed and we were unable to recover it. 00:28:02.503 [2024-11-28 19:16:23.423578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.423655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.423694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.503 qpair failed and we were unable to recover it. 00:28:02.503 [2024-11-28 19:16:23.423778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.423894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.423921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.503 qpair failed and we were unable to recover it. 00:28:02.503 [2024-11-28 19:16:23.424016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.424133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.424157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.503 qpair failed and we were unable to recover it. 00:28:02.503 [2024-11-28 19:16:23.424269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.424407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.424435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.503 qpair failed and we were unable to recover it. 00:28:02.503 [2024-11-28 19:16:23.424553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.424672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.424699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.503 qpair failed and we were unable to recover it. 00:28:02.503 [2024-11-28 19:16:23.424787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.424872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.424901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.503 qpair failed and we were unable to recover it. 00:28:02.503 [2024-11-28 19:16:23.425019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.425156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.425181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.503 qpair failed and we were unable to recover it. 00:28:02.503 [2024-11-28 19:16:23.425286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.425438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.425466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.503 qpair failed and we were unable to recover it. 00:28:02.503 [2024-11-28 19:16:23.425554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.425673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.425698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.503 qpair failed and we were unable to recover it. 00:28:02.503 [2024-11-28 19:16:23.425810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.425947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.425972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.503 qpair failed and we were unable to recover it. 00:28:02.503 [2024-11-28 19:16:23.426062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.426168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.426193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.503 qpair failed and we were unable to recover it. 00:28:02.503 [2024-11-28 19:16:23.426282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.426372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.426405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.503 qpair failed and we were unable to recover it. 00:28:02.503 [2024-11-28 19:16:23.426534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.426625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.426652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.503 qpair failed and we were unable to recover it. 00:28:02.503 [2024-11-28 19:16:23.426772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.426924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.426952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.503 qpair failed and we were unable to recover it. 00:28:02.503 [2024-11-28 19:16:23.427093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.427208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.427233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.503 qpair failed and we were unable to recover it. 00:28:02.503 [2024-11-28 19:16:23.427340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.427472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.427501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.503 qpair failed and we were unable to recover it. 00:28:02.503 [2024-11-28 19:16:23.427626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.427782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.427809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.503 qpair failed and we were unable to recover it. 00:28:02.503 [2024-11-28 19:16:23.427934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.428030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.428057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.503 qpair failed and we were unable to recover it. 00:28:02.503 [2024-11-28 19:16:23.428195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.428275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.428300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.503 qpair failed and we were unable to recover it. 00:28:02.503 [2024-11-28 19:16:23.428437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.428528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.428556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.503 qpair failed and we were unable to recover it. 00:28:02.503 [2024-11-28 19:16:23.428650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.428766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.428793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.503 qpair failed and we were unable to recover it. 00:28:02.503 [2024-11-28 19:16:23.428908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.503 [2024-11-28 19:16:23.429010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.504 [2024-11-28 19:16:23.429034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.504 qpair failed and we were unable to recover it. 00:28:02.504 [2024-11-28 19:16:23.429170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.504 [2024-11-28 19:16:23.429280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.504 [2024-11-28 19:16:23.429305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.504 qpair failed and we were unable to recover it. 00:28:02.504 [2024-11-28 19:16:23.429469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.504 [2024-11-28 19:16:23.429586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.504 [2024-11-28 19:16:23.429613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.504 qpair failed and we were unable to recover it. 00:28:02.504 [2024-11-28 19:16:23.429707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.504 [2024-11-28 19:16:23.429792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.504 [2024-11-28 19:16:23.429818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.504 qpair failed and we were unable to recover it. 00:28:02.504 [2024-11-28 19:16:23.429973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.504 [2024-11-28 19:16:23.430085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.504 [2024-11-28 19:16:23.430110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.504 qpair failed and we were unable to recover it. 00:28:02.504 [2024-11-28 19:16:23.430246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.504 [2024-11-28 19:16:23.430355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.504 [2024-11-28 19:16:23.430384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.504 qpair failed and we were unable to recover it. 00:28:02.504 [2024-11-28 19:16:23.430509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.504 [2024-11-28 19:16:23.430591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.504 [2024-11-28 19:16:23.430618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.504 qpair failed and we were unable to recover it. 00:28:02.504 [2024-11-28 19:16:23.430712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.504 [2024-11-28 19:16:23.430826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.504 [2024-11-28 19:16:23.430852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.504 qpair failed and we were unable to recover it. 00:28:02.504 [2024-11-28 19:16:23.431004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.504 [2024-11-28 19:16:23.431087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.504 [2024-11-28 19:16:23.431115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.504 qpair failed and we were unable to recover it. 00:28:02.504 [2024-11-28 19:16:23.431233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.504 [2024-11-28 19:16:23.431340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.504 [2024-11-28 19:16:23.431364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.504 qpair failed and we were unable to recover it. 00:28:02.504 [2024-11-28 19:16:23.431451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.504 [2024-11-28 19:16:23.431525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.504 [2024-11-28 19:16:23.431549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.504 qpair failed and we were unable to recover it. 00:28:02.504 [2024-11-28 19:16:23.431677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.504 [2024-11-28 19:16:23.431802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.504 [2024-11-28 19:16:23.431830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.504 qpair failed and we were unable to recover it. 00:28:02.504 [2024-11-28 19:16:23.431956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.504 [2024-11-28 19:16:23.432072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.504 [2024-11-28 19:16:23.432099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.504 qpair failed and we were unable to recover it. 00:28:02.504 [2024-11-28 19:16:23.432197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.504 [2024-11-28 19:16:23.432309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.504 [2024-11-28 19:16:23.432334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.504 qpair failed and we were unable to recover it. 00:28:02.504 [2024-11-28 19:16:23.432463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.787 [2024-11-28 19:16:23.432551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.787 [2024-11-28 19:16:23.432577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.787 qpair failed and we were unable to recover it. 00:28:02.787 [2024-11-28 19:16:23.432685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.787 [2024-11-28 19:16:23.432793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.787 [2024-11-28 19:16:23.432818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.787 qpair failed and we were unable to recover it. 00:28:02.787 [2024-11-28 19:16:23.432936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.787 [2024-11-28 19:16:23.433095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.787 [2024-11-28 19:16:23.433122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.787 qpair failed and we were unable to recover it. 00:28:02.787 [2024-11-28 19:16:23.433263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.787 [2024-11-28 19:16:23.433403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.787 [2024-11-28 19:16:23.433429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.787 qpair failed and we were unable to recover it. 00:28:02.787 [2024-11-28 19:16:23.433543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.787 [2024-11-28 19:16:23.433699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.787 [2024-11-28 19:16:23.433727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.787 qpair failed and we were unable to recover it. 00:28:02.787 [2024-11-28 19:16:23.433880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.787 [2024-11-28 19:16:23.433977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.787 [2024-11-28 19:16:23.434021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.787 qpair failed and we were unable to recover it. 00:28:02.787 [2024-11-28 19:16:23.434110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.434196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.434220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.788 qpair failed and we were unable to recover it. 00:28:02.788 [2024-11-28 19:16:23.434328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.434412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.434437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.788 qpair failed and we were unable to recover it. 00:28:02.788 [2024-11-28 19:16:23.434530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.434688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.434712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.788 qpair failed and we were unable to recover it. 00:28:02.788 [2024-11-28 19:16:23.434815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.434932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.434961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.788 qpair failed and we were unable to recover it. 00:28:02.788 [2024-11-28 19:16:23.435059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.435141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.435169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.788 qpair failed and we were unable to recover it. 00:28:02.788 [2024-11-28 19:16:23.435267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.435341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.435365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.788 qpair failed and we were unable to recover it. 00:28:02.788 [2024-11-28 19:16:23.435491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.435571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.435595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.788 qpair failed and we were unable to recover it. 00:28:02.788 [2024-11-28 19:16:23.435703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.435829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.435857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.788 qpair failed and we were unable to recover it. 00:28:02.788 [2024-11-28 19:16:23.435949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.436029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.436057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.788 qpair failed and we were unable to recover it. 00:28:02.788 [2024-11-28 19:16:23.436167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.436255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.436280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.788 qpair failed and we were unable to recover it. 00:28:02.788 [2024-11-28 19:16:23.436403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.436479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.436504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.788 qpair failed and we were unable to recover it. 00:28:02.788 [2024-11-28 19:16:23.436583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.436662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.436703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.788 qpair failed and we were unable to recover it. 00:28:02.788 [2024-11-28 19:16:23.436796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.436921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.436948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.788 qpair failed and we were unable to recover it. 00:28:02.788 [2024-11-28 19:16:23.437084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.437225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.437249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.788 qpair failed and we were unable to recover it. 00:28:02.788 [2024-11-28 19:16:23.437349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.437442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.437470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.788 qpair failed and we were unable to recover it. 00:28:02.788 [2024-11-28 19:16:23.437555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.437635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.437663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.788 qpair failed and we were unable to recover it. 00:28:02.788 [2024-11-28 19:16:23.437786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.437900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.437941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.788 qpair failed and we were unable to recover it. 00:28:02.788 [2024-11-28 19:16:23.438053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.438162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.438186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.788 qpair failed and we were unable to recover it. 00:28:02.788 [2024-11-28 19:16:23.438282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.438410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.438438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.788 qpair failed and we were unable to recover it. 00:28:02.788 [2024-11-28 19:16:23.438529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.438617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.438644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.788 qpair failed and we were unable to recover it. 00:28:02.788 [2024-11-28 19:16:23.438764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.438889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.438917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.788 qpair failed and we were unable to recover it. 00:28:02.788 [2024-11-28 19:16:23.439042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.439178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.439203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.788 qpair failed and we were unable to recover it. 00:28:02.788 [2024-11-28 19:16:23.439297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.439431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.439460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.788 qpair failed and we were unable to recover it. 00:28:02.788 [2024-11-28 19:16:23.439548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.439641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.439668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.788 qpair failed and we were unable to recover it. 00:28:02.788 [2024-11-28 19:16:23.439791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.439876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.439903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.788 qpair failed and we were unable to recover it. 00:28:02.788 [2024-11-28 19:16:23.440035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.440110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.440135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.788 qpair failed and we were unable to recover it. 00:28:02.788 [2024-11-28 19:16:23.440272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.440386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.440418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.788 qpair failed and we were unable to recover it. 00:28:02.788 [2024-11-28 19:16:23.440513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.440591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.440616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.788 qpair failed and we were unable to recover it. 00:28:02.788 [2024-11-28 19:16:23.440772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.788 [2024-11-28 19:16:23.440854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.440881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.789 qpair failed and we were unable to recover it. 00:28:02.789 [2024-11-28 19:16:23.440989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.441061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.441086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.789 qpair failed and we were unable to recover it. 00:28:02.789 [2024-11-28 19:16:23.441160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.441264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.441289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.789 qpair failed and we were unable to recover it. 00:28:02.789 [2024-11-28 19:16:23.441452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.441602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.441630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.789 qpair failed and we were unable to recover it. 00:28:02.789 [2024-11-28 19:16:23.441747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.441839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.441868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.789 qpair failed and we were unable to recover it. 00:28:02.789 [2024-11-28 19:16:23.441971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.442078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.442103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.789 qpair failed and we were unable to recover it. 00:28:02.789 [2024-11-28 19:16:23.442266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.442384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.442421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.789 qpair failed and we were unable to recover it. 00:28:02.789 [2024-11-28 19:16:23.442580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.442659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.442683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.789 qpair failed and we were unable to recover it. 00:28:02.789 [2024-11-28 19:16:23.442768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.442871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.442901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.789 qpair failed and we were unable to recover it. 00:28:02.789 [2024-11-28 19:16:23.443051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.443166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.443190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.789 qpair failed and we were unable to recover it. 00:28:02.789 [2024-11-28 19:16:23.443285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.443409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.443437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.789 qpair failed and we were unable to recover it. 00:28:02.789 [2024-11-28 19:16:23.443556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.443666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.443694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.789 qpair failed and we were unable to recover it. 00:28:02.789 [2024-11-28 19:16:23.443786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.443877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.443905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.789 qpair failed and we were unable to recover it. 00:28:02.789 [2024-11-28 19:16:23.444040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.444151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.444177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.789 qpair failed and we were unable to recover it. 00:28:02.789 [2024-11-28 19:16:23.444253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.444355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.444383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.789 qpair failed and we were unable to recover it. 00:28:02.789 [2024-11-28 19:16:23.444511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.444641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.444669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.789 qpair failed and we were unable to recover it. 00:28:02.789 [2024-11-28 19:16:23.444786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.444865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.444892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.789 qpair failed and we were unable to recover it. 00:28:02.789 [2024-11-28 19:16:23.445024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.445162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.445186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.789 qpair failed and we were unable to recover it. 00:28:02.789 [2024-11-28 19:16:23.445348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.445508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.445540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.789 qpair failed and we were unable to recover it. 00:28:02.789 [2024-11-28 19:16:23.445649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.445770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.445797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.789 qpair failed and we were unable to recover it. 00:28:02.789 [2024-11-28 19:16:23.445890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.445978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.446005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.789 qpair failed and we were unable to recover it. 00:28:02.789 [2024-11-28 19:16:23.446102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.446216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.446240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.789 qpair failed and we were unable to recover it. 00:28:02.789 [2024-11-28 19:16:23.446356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.446474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.446499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.789 qpair failed and we were unable to recover it. 00:28:02.789 [2024-11-28 19:16:23.446609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.446720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.446744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.789 qpair failed and we were unable to recover it. 00:28:02.789 [2024-11-28 19:16:23.446852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.446956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.446999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.789 qpair failed and we were unable to recover it. 00:28:02.789 [2024-11-28 19:16:23.447107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.447187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.447212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.789 qpair failed and we were unable to recover it. 00:28:02.789 [2024-11-28 19:16:23.447289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.447416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.447444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.789 qpair failed and we were unable to recover it. 00:28:02.789 [2024-11-28 19:16:23.447537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.447666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.447693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.789 qpair failed and we were unable to recover it. 00:28:02.789 [2024-11-28 19:16:23.447780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.447899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.789 [2024-11-28 19:16:23.447927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.789 qpair failed and we were unable to recover it. 00:28:02.789 [2024-11-28 19:16:23.448095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.448205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.448230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.790 qpair failed and we were unable to recover it. 00:28:02.790 [2024-11-28 19:16:23.448404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.448529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.448557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.790 qpair failed and we were unable to recover it. 00:28:02.790 [2024-11-28 19:16:23.448684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.448804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.448832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.790 qpair failed and we were unable to recover it. 00:28:02.790 [2024-11-28 19:16:23.448929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.449052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.449079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.790 qpair failed and we were unable to recover it. 00:28:02.790 [2024-11-28 19:16:23.449241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.449354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.449379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.790 qpair failed and we were unable to recover it. 00:28:02.790 [2024-11-28 19:16:23.449543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.449675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.449703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.790 qpair failed and we were unable to recover it. 00:28:02.790 [2024-11-28 19:16:23.449826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.449938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.449965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.790 qpair failed and we were unable to recover it. 00:28:02.790 [2024-11-28 19:16:23.450079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.450166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.450194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.790 qpair failed and we were unable to recover it. 00:28:02.790 [2024-11-28 19:16:23.450309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.450415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.450441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.790 qpair failed and we were unable to recover it. 00:28:02.790 [2024-11-28 19:16:23.450518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.450670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.450698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.790 qpair failed and we were unable to recover it. 00:28:02.790 [2024-11-28 19:16:23.450799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.450950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.450978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.790 qpair failed and we were unable to recover it. 00:28:02.790 [2024-11-28 19:16:23.451068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.451180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.451207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.790 qpair failed and we were unable to recover it. 00:28:02.790 [2024-11-28 19:16:23.451375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.451490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.451515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.790 qpair failed and we were unable to recover it. 00:28:02.790 [2024-11-28 19:16:23.451675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.451827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.451852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.790 qpair failed and we were unable to recover it. 00:28:02.790 [2024-11-28 19:16:23.451959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.452085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.452112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.790 qpair failed and we were unable to recover it. 00:28:02.790 [2024-11-28 19:16:23.452196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.452315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.452344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.790 qpair failed and we were unable to recover it. 00:28:02.790 [2024-11-28 19:16:23.452479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.452594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.452619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.790 qpair failed and we were unable to recover it. 00:28:02.790 [2024-11-28 19:16:23.452747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.452846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.452871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.790 qpair failed and we were unable to recover it. 00:28:02.790 [2024-11-28 19:16:23.452984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.453117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.453145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.790 qpair failed and we were unable to recover it. 00:28:02.790 [2024-11-28 19:16:23.453308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.453418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.453445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.790 qpair failed and we were unable to recover it. 00:28:02.790 [2024-11-28 19:16:23.453532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.453619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.453643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.790 qpair failed and we were unable to recover it. 00:28:02.790 [2024-11-28 19:16:23.453774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.453873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.453900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.790 qpair failed and we were unable to recover it. 00:28:02.790 [2024-11-28 19:16:23.454022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.454115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.454142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.790 qpair failed and we were unable to recover it. 00:28:02.790 [2024-11-28 19:16:23.454289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.454408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.454436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.790 qpair failed and we were unable to recover it. 00:28:02.790 [2024-11-28 19:16:23.454538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.454647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.454671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.790 qpair failed and we were unable to recover it. 00:28:02.790 [2024-11-28 19:16:23.454754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.454854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.454882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.790 qpair failed and we were unable to recover it. 00:28:02.790 [2024-11-28 19:16:23.454997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.455088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.455113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.790 qpair failed and we were unable to recover it. 00:28:02.790 [2024-11-28 19:16:23.455278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.455424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.455452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.790 qpair failed and we were unable to recover it. 00:28:02.790 [2024-11-28 19:16:23.455558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.455632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.790 [2024-11-28 19:16:23.455657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.790 qpair failed and we were unable to recover it. 00:28:02.790 [2024-11-28 19:16:23.455793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.455912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.455938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.791 qpair failed and we were unable to recover it. 00:28:02.791 [2024-11-28 19:16:23.456055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.456141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.456168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.791 qpair failed and we were unable to recover it. 00:28:02.791 [2024-11-28 19:16:23.456317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.456428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.456457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.791 qpair failed and we were unable to recover it. 00:28:02.791 [2024-11-28 19:16:23.456573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.456648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.456673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.791 qpair failed and we were unable to recover it. 00:28:02.791 [2024-11-28 19:16:23.456787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.456891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.456932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.791 qpair failed and we were unable to recover it. 00:28:02.791 [2024-11-28 19:16:23.457022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.457146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.457174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.791 qpair failed and we were unable to recover it. 00:28:02.791 [2024-11-28 19:16:23.457335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.457446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.457472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.791 qpair failed and we were unable to recover it. 00:28:02.791 [2024-11-28 19:16:23.457584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.457700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.457726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.791 qpair failed and we were unable to recover it. 00:28:02.791 [2024-11-28 19:16:23.457855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.457973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.457999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.791 qpair failed and we were unable to recover it. 00:28:02.791 [2024-11-28 19:16:23.458115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.458269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.458293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.791 qpair failed and we were unable to recover it. 00:28:02.791 [2024-11-28 19:16:23.458447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.458537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.458564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.791 qpair failed and we were unable to recover it. 00:28:02.791 [2024-11-28 19:16:23.458720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.458832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.458861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.791 qpair failed and we were unable to recover it. 00:28:02.791 [2024-11-28 19:16:23.458966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.459090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.459130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.791 qpair failed and we were unable to recover it. 00:28:02.791 [2024-11-28 19:16:23.459216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.459305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.459330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.791 qpair failed and we were unable to recover it. 00:28:02.791 [2024-11-28 19:16:23.459456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.459613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.459640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.791 qpair failed and we were unable to recover it. 00:28:02.791 [2024-11-28 19:16:23.459748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.459820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.459845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.791 qpair failed and we were unable to recover it. 00:28:02.791 [2024-11-28 19:16:23.459984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.460118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.460146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.791 qpair failed and we were unable to recover it. 00:28:02.791 [2024-11-28 19:16:23.460274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.460360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.460388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.791 qpair failed and we were unable to recover it. 00:28:02.791 [2024-11-28 19:16:23.460521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.460637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.460664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.791 qpair failed and we were unable to recover it. 00:28:02.791 [2024-11-28 19:16:23.460807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.460952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.460977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.791 qpair failed and we were unable to recover it. 00:28:02.791 [2024-11-28 19:16:23.461059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.461191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.461218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.791 qpair failed and we were unable to recover it. 00:28:02.791 [2024-11-28 19:16:23.461340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.461441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.461470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.791 qpair failed and we were unable to recover it. 00:28:02.791 [2024-11-28 19:16:23.461599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.461743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.461770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.791 qpair failed and we were unable to recover it. 00:28:02.791 [2024-11-28 19:16:23.461907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.461985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.462010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.791 qpair failed and we were unable to recover it. 00:28:02.791 [2024-11-28 19:16:23.462096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.462218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.462243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.791 qpair failed and we were unable to recover it. 00:28:02.791 [2024-11-28 19:16:23.462398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.462482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.462509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.791 qpair failed and we were unable to recover it. 00:28:02.791 [2024-11-28 19:16:23.462641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.462750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.462777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.791 qpair failed and we were unable to recover it. 00:28:02.791 [2024-11-28 19:16:23.462915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.463022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.463047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.791 qpair failed and we were unable to recover it. 00:28:02.791 [2024-11-28 19:16:23.463158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.463274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.791 [2024-11-28 19:16:23.463302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.791 qpair failed and we were unable to recover it. 00:28:02.791 [2024-11-28 19:16:23.463417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.463541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.463568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.792 qpair failed and we were unable to recover it. 00:28:02.792 [2024-11-28 19:16:23.463646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.463765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.463793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.792 qpair failed and we were unable to recover it. 00:28:02.792 [2024-11-28 19:16:23.463905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.463985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.464011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.792 qpair failed and we were unable to recover it. 00:28:02.792 [2024-11-28 19:16:23.464115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.464219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.464243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.792 qpair failed and we were unable to recover it. 00:28:02.792 [2024-11-28 19:16:23.464373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.464523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.464551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.792 qpair failed and we were unable to recover it. 00:28:02.792 [2024-11-28 19:16:23.464686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.464822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.464847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.792 qpair failed and we were unable to recover it. 00:28:02.792 [2024-11-28 19:16:23.464928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.465037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.465061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.792 qpair failed and we were unable to recover it. 00:28:02.792 [2024-11-28 19:16:23.465212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.465334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.465362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.792 qpair failed and we were unable to recover it. 00:28:02.792 [2024-11-28 19:16:23.465502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.465618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.465643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.792 qpair failed and we were unable to recover it. 00:28:02.792 [2024-11-28 19:16:23.465772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.465897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.465924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.792 qpair failed and we were unable to recover it. 00:28:02.792 [2024-11-28 19:16:23.466066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.466172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.466197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.792 qpair failed and we were unable to recover it. 00:28:02.792 [2024-11-28 19:16:23.466319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.466450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.466479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.792 qpair failed and we were unable to recover it. 00:28:02.792 [2024-11-28 19:16:23.466601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.466755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.466780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.792 qpair failed and we were unable to recover it. 00:28:02.792 [2024-11-28 19:16:23.466927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.467054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.467081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.792 qpair failed and we were unable to recover it. 00:28:02.792 [2024-11-28 19:16:23.467174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.467290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.467315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.792 qpair failed and we were unable to recover it. 00:28:02.792 [2024-11-28 19:16:23.467451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.467538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.467565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.792 qpair failed and we were unable to recover it. 00:28:02.792 [2024-11-28 19:16:23.467713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.467802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.467832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.792 qpair failed and we were unable to recover it. 00:28:02.792 [2024-11-28 19:16:23.467918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.468005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.468033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.792 qpair failed and we were unable to recover it. 00:28:02.792 [2024-11-28 19:16:23.468135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.468241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.468265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.792 qpair failed and we were unable to recover it. 00:28:02.792 [2024-11-28 19:16:23.468423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.468521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.468548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.792 qpair failed and we were unable to recover it. 00:28:02.792 [2024-11-28 19:16:23.468668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.468818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.468845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.792 qpair failed and we were unable to recover it. 00:28:02.792 [2024-11-28 19:16:23.468978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.469125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.469152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.792 qpair failed and we were unable to recover it. 00:28:02.792 [2024-11-28 19:16:23.469310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.469386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.469443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.792 qpair failed and we were unable to recover it. 00:28:02.792 [2024-11-28 19:16:23.469612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.469770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.792 [2024-11-28 19:16:23.469821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.792 qpair failed and we were unable to recover it. 00:28:02.792 [2024-11-28 19:16:23.469917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.470084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.470109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.793 qpair failed and we were unable to recover it. 00:28:02.793 [2024-11-28 19:16:23.470228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.470305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.470329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.793 qpair failed and we were unable to recover it. 00:28:02.793 [2024-11-28 19:16:23.470440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.470588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.470613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.793 qpair failed and we were unable to recover it. 00:28:02.793 [2024-11-28 19:16:23.470714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.470832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.470860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.793 qpair failed and we were unable to recover it. 00:28:02.793 [2024-11-28 19:16:23.470958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.471076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.471104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.793 qpair failed and we were unable to recover it. 00:28:02.793 [2024-11-28 19:16:23.471215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.471323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.471348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.793 qpair failed and we were unable to recover it. 00:28:02.793 [2024-11-28 19:16:23.471493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.471576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.471602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.793 qpair failed and we were unable to recover it. 00:28:02.793 [2024-11-28 19:16:23.471680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.471815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.471840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.793 qpair failed and we were unable to recover it. 00:28:02.793 [2024-11-28 19:16:23.471913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.472021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.472045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.793 qpair failed and we were unable to recover it. 00:28:02.793 [2024-11-28 19:16:23.472129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.472251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.472283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.793 qpair failed and we were unable to recover it. 00:28:02.793 [2024-11-28 19:16:23.472423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.472513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.472537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.793 qpair failed and we were unable to recover it. 00:28:02.793 [2024-11-28 19:16:23.472648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.472764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.472791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.793 qpair failed and we were unable to recover it. 00:28:02.793 [2024-11-28 19:16:23.472944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.473057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.473084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.793 qpair failed and we were unable to recover it. 00:28:02.793 [2024-11-28 19:16:23.473178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.473299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.473327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.793 qpair failed and we were unable to recover it. 00:28:02.793 [2024-11-28 19:16:23.473489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.473605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.473629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.793 qpair failed and we were unable to recover it. 00:28:02.793 [2024-11-28 19:16:23.473766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.473887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.473914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.793 qpair failed and we were unable to recover it. 00:28:02.793 [2024-11-28 19:16:23.474017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.474145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.474175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.793 qpair failed and we were unable to recover it. 00:28:02.793 [2024-11-28 19:16:23.474312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.474434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.474460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.793 qpair failed and we were unable to recover it. 00:28:02.793 [2024-11-28 19:16:23.474554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.474670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.474695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.793 qpair failed and we were unable to recover it. 00:28:02.793 [2024-11-28 19:16:23.474824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.474970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.474999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.793 qpair failed and we were unable to recover it. 00:28:02.793 [2024-11-28 19:16:23.475091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.475168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.475196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.793 qpair failed and we were unable to recover it. 00:28:02.793 [2024-11-28 19:16:23.475287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.475407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.475435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.793 qpair failed and we were unable to recover it. 00:28:02.793 [2024-11-28 19:16:23.475573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.475656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.475681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.793 qpair failed and we were unable to recover it. 00:28:02.793 [2024-11-28 19:16:23.475754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.475849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.475876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.793 qpair failed and we were unable to recover it. 00:28:02.793 [2024-11-28 19:16:23.475993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.476118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.476146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.793 qpair failed and we were unable to recover it. 00:28:02.793 [2024-11-28 19:16:23.476312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.476421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.476447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.793 qpair failed and we were unable to recover it. 00:28:02.793 [2024-11-28 19:16:23.476528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.476601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.476625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.793 qpair failed and we were unable to recover it. 00:28:02.793 [2024-11-28 19:16:23.476742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.476865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.476890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.793 qpair failed and we were unable to recover it. 00:28:02.793 [2024-11-28 19:16:23.477019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.477105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.793 [2024-11-28 19:16:23.477131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.793 qpair failed and we were unable to recover it. 00:28:02.793 [2024-11-28 19:16:23.477257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.477374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.477413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.794 qpair failed and we were unable to recover it. 00:28:02.794 [2024-11-28 19:16:23.477575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.477680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.477704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.794 qpair failed and we were unable to recover it. 00:28:02.794 [2024-11-28 19:16:23.477866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.477957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.477984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.794 qpair failed and we were unable to recover it. 00:28:02.794 [2024-11-28 19:16:23.478103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.478204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.478232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.794 qpair failed and we were unable to recover it. 00:28:02.794 [2024-11-28 19:16:23.478351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.478457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.478485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.794 qpair failed and we were unable to recover it. 00:28:02.794 [2024-11-28 19:16:23.478611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.478749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.478773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.794 qpair failed and we were unable to recover it. 00:28:02.794 [2024-11-28 19:16:23.478939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.479107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.479131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.794 qpair failed and we were unable to recover it. 00:28:02.794 [2024-11-28 19:16:23.479213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.479292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.479316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.794 qpair failed and we were unable to recover it. 00:28:02.794 [2024-11-28 19:16:23.479475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.479586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.479610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.794 qpair failed and we were unable to recover it. 00:28:02.794 [2024-11-28 19:16:23.479716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.479819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.479844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.794 qpair failed and we were unable to recover it. 00:28:02.794 [2024-11-28 19:16:23.479983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.480072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.480099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.794 qpair failed and we were unable to recover it. 00:28:02.794 [2024-11-28 19:16:23.480256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.480407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.480433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.794 qpair failed and we were unable to recover it. 00:28:02.794 [2024-11-28 19:16:23.480507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.480586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.480610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.794 qpair failed and we were unable to recover it. 00:28:02.794 [2024-11-28 19:16:23.480788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.480877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.480901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.794 qpair failed and we were unable to recover it. 00:28:02.794 [2024-11-28 19:16:23.480985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.481092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.481116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.794 qpair failed and we were unable to recover it. 00:28:02.794 [2024-11-28 19:16:23.481242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.481359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.481386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.794 qpair failed and we were unable to recover it. 00:28:02.794 [2024-11-28 19:16:23.481488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.481610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.481638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.794 qpair failed and we were unable to recover it. 00:28:02.794 [2024-11-28 19:16:23.481797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.481899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.481924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.794 qpair failed and we were unable to recover it. 00:28:02.794 [2024-11-28 19:16:23.482009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.482135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.482163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.794 qpair failed and we were unable to recover it. 00:28:02.794 [2024-11-28 19:16:23.482287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.482436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.482465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.794 qpair failed and we were unable to recover it. 00:28:02.794 [2024-11-28 19:16:23.482560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.482694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.482719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.794 qpair failed and we were unable to recover it. 00:28:02.794 [2024-11-28 19:16:23.482837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.482980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.483005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.794 qpair failed and we were unable to recover it. 00:28:02.794 [2024-11-28 19:16:23.483166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.483312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.483339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.794 qpair failed and we were unable to recover it. 00:28:02.794 [2024-11-28 19:16:23.483426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.483517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.483546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.794 qpair failed and we were unable to recover it. 00:28:02.794 [2024-11-28 19:16:23.483698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.483814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.483841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.794 qpair failed and we were unable to recover it. 00:28:02.794 [2024-11-28 19:16:23.484006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.484145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.484169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.794 qpair failed and we were unable to recover it. 00:28:02.794 [2024-11-28 19:16:23.484275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.484401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.484430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.794 qpair failed and we were unable to recover it. 00:28:02.794 [2024-11-28 19:16:23.484583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.484704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.484731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.794 qpair failed and we were unable to recover it. 00:28:02.794 [2024-11-28 19:16:23.484818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.484932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.794 [2024-11-28 19:16:23.484972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.794 qpair failed and we were unable to recover it. 00:28:02.794 [2024-11-28 19:16:23.485062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.485199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.485224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.795 qpair failed and we were unable to recover it. 00:28:02.795 [2024-11-28 19:16:23.485380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.485531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.485559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.795 qpair failed and we were unable to recover it. 00:28:02.795 [2024-11-28 19:16:23.485673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.485791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.485823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.795 qpair failed and we were unable to recover it. 00:28:02.795 [2024-11-28 19:16:23.485938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.486084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.486112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.795 qpair failed and we were unable to recover it. 00:28:02.795 [2024-11-28 19:16:23.486270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.486375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.486405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.795 qpair failed and we were unable to recover it. 00:28:02.795 [2024-11-28 19:16:23.486539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.486662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.486690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.795 qpair failed and we were unable to recover it. 00:28:02.795 [2024-11-28 19:16:23.486779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.486898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.486927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.795 qpair failed and we were unable to recover it. 00:28:02.795 [2024-11-28 19:16:23.487056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.487178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.487205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.795 qpair failed and we were unable to recover it. 00:28:02.795 [2024-11-28 19:16:23.487326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.487406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.487432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.795 qpair failed and we were unable to recover it. 00:28:02.795 [2024-11-28 19:16:23.487576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.487718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.487768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.795 qpair failed and we were unable to recover it. 00:28:02.795 [2024-11-28 19:16:23.487889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.488011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.488038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.795 qpair failed and we were unable to recover it. 00:28:02.795 [2024-11-28 19:16:23.488159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.488284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.488311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.795 qpair failed and we were unable to recover it. 00:28:02.795 [2024-11-28 19:16:23.488417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.488530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.488555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.795 qpair failed and we were unable to recover it. 00:28:02.795 [2024-11-28 19:16:23.488641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.488781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.488805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.795 qpair failed and we were unable to recover it. 00:28:02.795 [2024-11-28 19:16:23.488946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.489073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.489100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.795 qpair failed and we were unable to recover it. 00:28:02.795 [2024-11-28 19:16:23.489252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.489368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.489418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.795 qpair failed and we were unable to recover it. 00:28:02.795 [2024-11-28 19:16:23.489537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.489628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.489653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.795 qpair failed and we were unable to recover it. 00:28:02.795 [2024-11-28 19:16:23.489770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.489853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.489877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.795 qpair failed and we were unable to recover it. 00:28:02.795 [2024-11-28 19:16:23.489981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.490093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.490117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.795 qpair failed and we were unable to recover it. 00:28:02.795 [2024-11-28 19:16:23.490219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.490324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.490348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.795 qpair failed and we were unable to recover it. 00:28:02.795 [2024-11-28 19:16:23.490429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.490538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.490562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.795 qpair failed and we were unable to recover it. 00:28:02.795 [2024-11-28 19:16:23.490722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.490800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.490827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.795 qpair failed and we were unable to recover it. 00:28:02.795 [2024-11-28 19:16:23.490940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.491052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.491080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.795 qpair failed and we were unable to recover it. 00:28:02.795 [2024-11-28 19:16:23.491211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.491346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.491372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.795 qpair failed and we were unable to recover it. 00:28:02.795 [2024-11-28 19:16:23.491523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.491608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.491634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.795 qpair failed and we were unable to recover it. 00:28:02.795 [2024-11-28 19:16:23.491728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.491839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.491863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.795 qpair failed and we were unable to recover it. 00:28:02.795 [2024-11-28 19:16:23.491970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.492100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.492127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.795 qpair failed and we were unable to recover it. 00:28:02.795 [2024-11-28 19:16:23.492251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.492384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.492417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.795 qpair failed and we were unable to recover it. 00:28:02.795 [2024-11-28 19:16:23.492512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.492582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.795 [2024-11-28 19:16:23.492607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.795 qpair failed and we were unable to recover it. 00:28:02.795 [2024-11-28 19:16:23.492702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.492827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.492854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.796 qpair failed and we were unable to recover it. 00:28:02.796 [2024-11-28 19:16:23.492973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.493098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.493126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.796 qpair failed and we were unable to recover it. 00:28:02.796 [2024-11-28 19:16:23.493276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.493406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.493435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.796 qpair failed and we were unable to recover it. 00:28:02.796 [2024-11-28 19:16:23.493563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.493650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.493674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.796 qpair failed and we were unable to recover it. 00:28:02.796 [2024-11-28 19:16:23.493757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.493908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.493935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.796 qpair failed and we were unable to recover it. 00:28:02.796 [2024-11-28 19:16:23.494088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.494200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.494224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.796 qpair failed and we were unable to recover it. 00:28:02.796 [2024-11-28 19:16:23.494326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.494474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.494503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.796 qpair failed and we were unable to recover it. 00:28:02.796 [2024-11-28 19:16:23.494604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.494737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.494761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.796 qpair failed and we were unable to recover it. 00:28:02.796 [2024-11-28 19:16:23.494910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.495047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.495074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.796 qpair failed and we were unable to recover it. 00:28:02.796 [2024-11-28 19:16:23.495186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.495281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.495310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.796 qpair failed and we were unable to recover it. 00:28:02.796 [2024-11-28 19:16:23.495438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.495548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.495573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.796 qpair failed and we were unable to recover it. 00:28:02.796 [2024-11-28 19:16:23.495715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.495797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.495822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.796 qpair failed and we were unable to recover it. 00:28:02.796 [2024-11-28 19:16:23.495952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.496040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.496067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.796 qpair failed and we were unable to recover it. 00:28:02.796 [2024-11-28 19:16:23.496155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.496240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.496266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.796 qpair failed and we were unable to recover it. 00:28:02.796 [2024-11-28 19:16:23.496382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.496516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.496543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.796 qpair failed and we were unable to recover it. 00:28:02.796 [2024-11-28 19:16:23.496659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.496766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.496790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.796 qpair failed and we were unable to recover it. 00:28:02.796 [2024-11-28 19:16:23.496905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.497039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.497080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.796 qpair failed and we were unable to recover it. 00:28:02.796 [2024-11-28 19:16:23.497193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.497347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.497374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.796 qpair failed and we were unable to recover it. 00:28:02.796 [2024-11-28 19:16:23.497473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.497618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.497646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.796 qpair failed and we were unable to recover it. 00:28:02.796 [2024-11-28 19:16:23.497782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.497923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.497947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.796 qpair failed and we were unable to recover it. 00:28:02.796 [2024-11-28 19:16:23.498083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.498180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.498204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.796 qpair failed and we were unable to recover it. 00:28:02.796 [2024-11-28 19:16:23.498287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.498401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.498442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.796 qpair failed and we were unable to recover it. 00:28:02.796 [2024-11-28 19:16:23.498567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.498679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.498707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.796 qpair failed and we were unable to recover it. 00:28:02.796 [2024-11-28 19:16:23.498873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.498983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.499007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.796 qpair failed and we were unable to recover it. 00:28:02.796 [2024-11-28 19:16:23.499106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.499218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.499250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.796 qpair failed and we were unable to recover it. 00:28:02.796 [2024-11-28 19:16:23.499381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.499539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.796 [2024-11-28 19:16:23.499582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.796 qpair failed and we were unable to recover it. 00:28:02.797 [2024-11-28 19:16:23.499693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.499796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.499820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.797 qpair failed and we were unable to recover it. 00:28:02.797 [2024-11-28 19:16:23.499901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.500012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.500038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.797 qpair failed and we were unable to recover it. 00:28:02.797 [2024-11-28 19:16:23.500190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.500341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.500369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.797 qpair failed and we were unable to recover it. 00:28:02.797 [2024-11-28 19:16:23.500478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.500596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.500620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.797 qpair failed and we were unable to recover it. 00:28:02.797 [2024-11-28 19:16:23.500708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.500833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.500861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.797 qpair failed and we were unable to recover it. 00:28:02.797 [2024-11-28 19:16:23.501001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.501112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.501137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.797 qpair failed and we were unable to recover it. 00:28:02.797 [2024-11-28 19:16:23.501220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.501336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.501361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.797 qpair failed and we were unable to recover it. 00:28:02.797 [2024-11-28 19:16:23.501510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.501616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.501641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.797 qpair failed and we were unable to recover it. 00:28:02.797 [2024-11-28 19:16:23.501771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.501892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.501924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.797 qpair failed and we were unable to recover it. 00:28:02.797 [2024-11-28 19:16:23.502049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.502165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.502189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.797 qpair failed and we were unable to recover it. 00:28:02.797 [2024-11-28 19:16:23.502318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.502410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.502440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.797 qpair failed and we were unable to recover it. 00:28:02.797 [2024-11-28 19:16:23.502557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.502652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.502680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.797 qpair failed and we were unable to recover it. 00:28:02.797 [2024-11-28 19:16:23.502803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.502893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.502921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.797 qpair failed and we were unable to recover it. 00:28:02.797 [2024-11-28 19:16:23.503059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.503146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.503171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.797 qpair failed and we were unable to recover it. 00:28:02.797 [2024-11-28 19:16:23.503266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.503386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.503420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.797 qpair failed and we were unable to recover it. 00:28:02.797 [2024-11-28 19:16:23.503539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.503690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.503717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.797 qpair failed and we were unable to recover it. 00:28:02.797 [2024-11-28 19:16:23.503834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.503951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.503978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.797 qpair failed and we were unable to recover it. 00:28:02.797 [2024-11-28 19:16:23.504089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.504169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.504193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.797 qpair failed and we were unable to recover it. 00:28:02.797 [2024-11-28 19:16:23.504298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.504482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.504507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.797 qpair failed and we were unable to recover it. 00:28:02.797 [2024-11-28 19:16:23.504603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.504730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.504758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.797 qpair failed and we were unable to recover it. 00:28:02.797 [2024-11-28 19:16:23.504880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.504961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.504989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.797 qpair failed and we were unable to recover it. 00:28:02.797 [2024-11-28 19:16:23.505099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.505239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.505263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.797 qpair failed and we were unable to recover it. 00:28:02.797 [2024-11-28 19:16:23.505377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.505513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.505541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.797 qpair failed and we were unable to recover it. 00:28:02.797 [2024-11-28 19:16:23.505630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.505754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.505783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.797 qpair failed and we were unable to recover it. 00:28:02.797 [2024-11-28 19:16:23.505895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.506023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.506050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.797 qpair failed and we were unable to recover it. 00:28:02.797 [2024-11-28 19:16:23.506164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.506254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.506279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.797 qpair failed and we were unable to recover it. 00:28:02.797 [2024-11-28 19:16:23.506360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.506478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.506503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.797 qpair failed and we were unable to recover it. 00:28:02.797 [2024-11-28 19:16:23.506631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.506748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.506775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.797 qpair failed and we were unable to recover it. 00:28:02.797 [2024-11-28 19:16:23.506897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.507023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.797 [2024-11-28 19:16:23.507051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.797 qpair failed and we were unable to recover it. 00:28:02.798 [2024-11-28 19:16:23.507197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.507314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.507339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.798 qpair failed and we were unable to recover it. 00:28:02.798 [2024-11-28 19:16:23.507445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.507569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.507597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.798 qpair failed and we were unable to recover it. 00:28:02.798 [2024-11-28 19:16:23.507718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.507839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.507867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.798 qpair failed and we were unable to recover it. 00:28:02.798 [2024-11-28 19:16:23.507992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.508084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.508111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.798 qpair failed and we were unable to recover it. 00:28:02.798 [2024-11-28 19:16:23.508208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.508288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.508311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.798 qpair failed and we were unable to recover it. 00:28:02.798 [2024-11-28 19:16:23.508391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.508507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.508537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.798 qpair failed and we were unable to recover it. 00:28:02.798 [2024-11-28 19:16:23.508666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.508811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.508839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.798 qpair failed and we were unable to recover it. 00:28:02.798 [2024-11-28 19:16:23.508964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.509045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.509073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.798 qpair failed and we were unable to recover it. 00:28:02.798 [2024-11-28 19:16:23.509200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.509311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.509337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.798 qpair failed and we were unable to recover it. 00:28:02.798 [2024-11-28 19:16:23.509431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.509581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.509609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.798 qpair failed and we were unable to recover it. 00:28:02.798 [2024-11-28 19:16:23.509699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.509799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.509828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.798 qpair failed and we were unable to recover it. 00:28:02.798 [2024-11-28 19:16:23.509945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.510081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.510106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.798 qpair failed and we were unable to recover it. 00:28:02.798 [2024-11-28 19:16:23.510214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.510329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.510353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.798 qpair failed and we were unable to recover it. 00:28:02.798 [2024-11-28 19:16:23.510488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.510599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.510627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.798 qpair failed and we were unable to recover it. 00:28:02.798 [2024-11-28 19:16:23.510755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.510868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.510895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.798 qpair failed and we were unable to recover it. 00:28:02.798 [2024-11-28 19:16:23.510974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.511121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.511148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.798 qpair failed and we were unable to recover it. 00:28:02.798 [2024-11-28 19:16:23.511281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.511404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.511430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.798 qpair failed and we were unable to recover it. 00:28:02.798 [2024-11-28 19:16:23.511529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.511642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.511669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.798 qpair failed and we were unable to recover it. 00:28:02.798 [2024-11-28 19:16:23.511794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.511910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.511937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.798 qpair failed and we were unable to recover it. 00:28:02.798 [2024-11-28 19:16:23.512060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.512149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.512177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.798 qpair failed and we were unable to recover it. 00:28:02.798 [2024-11-28 19:16:23.512305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.512421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.512447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.798 qpair failed and we were unable to recover it. 00:28:02.798 [2024-11-28 19:16:23.512555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.512666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.512693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.798 qpair failed and we were unable to recover it. 00:28:02.798 [2024-11-28 19:16:23.512780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.512892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.512919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.798 qpair failed and we were unable to recover it. 00:28:02.798 [2024-11-28 19:16:23.513072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.513221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.513249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.798 qpair failed and we were unable to recover it. 00:28:02.798 [2024-11-28 19:16:23.513344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.513443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.513468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.798 qpair failed and we were unable to recover it. 00:28:02.798 [2024-11-28 19:16:23.513582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.513662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.513686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.798 qpair failed and we were unable to recover it. 00:28:02.798 [2024-11-28 19:16:23.513796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.513903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.513946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.798 qpair failed and we were unable to recover it. 00:28:02.798 [2024-11-28 19:16:23.514062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.514178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.514207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.798 qpair failed and we were unable to recover it. 00:28:02.798 [2024-11-28 19:16:23.514347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.514461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.798 [2024-11-28 19:16:23.514486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.798 qpair failed and we were unable to recover it. 00:28:02.799 [2024-11-28 19:16:23.514626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.514750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.514778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.799 qpair failed and we were unable to recover it. 00:28:02.799 [2024-11-28 19:16:23.514927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.515025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.515057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.799 qpair failed and we were unable to recover it. 00:28:02.799 [2024-11-28 19:16:23.515182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.515318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.515347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.799 qpair failed and we were unable to recover it. 00:28:02.799 [2024-11-28 19:16:23.515490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.515600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.515625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.799 qpair failed and we were unable to recover it. 00:28:02.799 [2024-11-28 19:16:23.515764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.515859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.515886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.799 qpair failed and we were unable to recover it. 00:28:02.799 [2024-11-28 19:16:23.516002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.516149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.516176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.799 qpair failed and we were unable to recover it. 00:28:02.799 [2024-11-28 19:16:23.516274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.516423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.516452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.799 qpair failed and we were unable to recover it. 00:28:02.799 [2024-11-28 19:16:23.516579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.516655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.516679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.799 qpair failed and we were unable to recover it. 00:28:02.799 [2024-11-28 19:16:23.516840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.516958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.516986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.799 qpair failed and we were unable to recover it. 00:28:02.799 [2024-11-28 19:16:23.517118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.517190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.517213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.799 qpair failed and we were unable to recover it. 00:28:02.799 [2024-11-28 19:16:23.517289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.517410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.517439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.799 qpair failed and we were unable to recover it. 00:28:02.799 [2024-11-28 19:16:23.517597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.517680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.517705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.799 qpair failed and we were unable to recover it. 00:28:02.799 [2024-11-28 19:16:23.517831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.517912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.517940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.799 qpair failed and we were unable to recover it. 00:28:02.799 [2024-11-28 19:16:23.518019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.518105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.518133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.799 qpair failed and we were unable to recover it. 00:28:02.799 [2024-11-28 19:16:23.518226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.518372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.518418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.799 qpair failed and we were unable to recover it. 00:28:02.799 [2024-11-28 19:16:23.518545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.518616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.518641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.799 qpair failed and we were unable to recover it. 00:28:02.799 [2024-11-28 19:16:23.518781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.518863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.518905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.799 qpair failed and we were unable to recover it. 00:28:02.799 [2024-11-28 19:16:23.519040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.519127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.519152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.799 qpair failed and we were unable to recover it. 00:28:02.799 [2024-11-28 19:16:23.519224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.519330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.519357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.799 qpair failed and we were unable to recover it. 00:28:02.799 [2024-11-28 19:16:23.519503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.519614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.519638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.799 qpair failed and we were unable to recover it. 00:28:02.799 [2024-11-28 19:16:23.519761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.519911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.519938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.799 qpair failed and we were unable to recover it. 00:28:02.799 [2024-11-28 19:16:23.520072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.520191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.520219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.799 qpair failed and we were unable to recover it. 00:28:02.799 [2024-11-28 19:16:23.520305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.520443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.520469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.799 qpair failed and we were unable to recover it. 00:28:02.799 [2024-11-28 19:16:23.520585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.520692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.520717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.799 qpair failed and we were unable to recover it. 00:28:02.799 [2024-11-28 19:16:23.520803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.520928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.520971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.799 qpair failed and we were unable to recover it. 00:28:02.799 [2024-11-28 19:16:23.521094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.521326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.521354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.799 qpair failed and we were unable to recover it. 00:28:02.799 [2024-11-28 19:16:23.521481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.521573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.521600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.799 qpair failed and we were unable to recover it. 00:28:02.799 [2024-11-28 19:16:23.521741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.521824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.521849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.799 qpair failed and we were unable to recover it. 00:28:02.799 [2024-11-28 19:16:23.521935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.522029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.799 [2024-11-28 19:16:23.522056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.800 qpair failed and we were unable to recover it. 00:28:02.800 [2024-11-28 19:16:23.522206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.522304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.522332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.800 qpair failed and we were unable to recover it. 00:28:02.800 [2024-11-28 19:16:23.522427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.522544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.522571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.800 qpair failed and we were unable to recover it. 00:28:02.800 [2024-11-28 19:16:23.522737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.522844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.522868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.800 qpair failed and we were unable to recover it. 00:28:02.800 [2024-11-28 19:16:23.523035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.523118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.523145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.800 qpair failed and we were unable to recover it. 00:28:02.800 [2024-11-28 19:16:23.523259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.523382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.523417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.800 qpair failed and we were unable to recover it. 00:28:02.800 [2024-11-28 19:16:23.523540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.523623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.523652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.800 qpair failed and we were unable to recover it. 00:28:02.800 [2024-11-28 19:16:23.523779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.523884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.523909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.800 qpair failed and we were unable to recover it. 00:28:02.800 [2024-11-28 19:16:23.524035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.524156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.524183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.800 qpair failed and we were unable to recover it. 00:28:02.800 [2024-11-28 19:16:23.524420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.524506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.524535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.800 qpair failed and we were unable to recover it. 00:28:02.800 [2024-11-28 19:16:23.524662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.524786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.524813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.800 qpair failed and we were unable to recover it. 00:28:02.800 [2024-11-28 19:16:23.524945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.525017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.525041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.800 qpair failed and we were unable to recover it. 00:28:02.800 [2024-11-28 19:16:23.525195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.525313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.525340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.800 qpair failed and we were unable to recover it. 00:28:02.800 [2024-11-28 19:16:23.525437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.525562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.525590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.800 qpair failed and we were unable to recover it. 00:28:02.800 [2024-11-28 19:16:23.525716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.525809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.525836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.800 qpair failed and we were unable to recover it. 00:28:02.800 [2024-11-28 19:16:23.525940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.526030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.526054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.800 qpair failed and we were unable to recover it. 00:28:02.800 [2024-11-28 19:16:23.526139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.526300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.526328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.800 qpair failed and we were unable to recover it. 00:28:02.800 [2024-11-28 19:16:23.526451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.526542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.526572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.800 qpair failed and we were unable to recover it. 00:28:02.800 [2024-11-28 19:16:23.526666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.526783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.526810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.800 qpair failed and we were unable to recover it. 00:28:02.800 [2024-11-28 19:16:23.526906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.527011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.527036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.800 qpair failed and we were unable to recover it. 00:28:02.800 [2024-11-28 19:16:23.527169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.527289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.527316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.800 qpair failed and we were unable to recover it. 00:28:02.800 [2024-11-28 19:16:23.527403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.527555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.527582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.800 qpair failed and we were unable to recover it. 00:28:02.800 [2024-11-28 19:16:23.527702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.527791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.527817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.800 qpair failed and we were unable to recover it. 00:28:02.800 [2024-11-28 19:16:23.527944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.528077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.528101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.800 qpair failed and we were unable to recover it. 00:28:02.800 [2024-11-28 19:16:23.528242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.528334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.528367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.800 qpair failed and we were unable to recover it. 00:28:02.800 [2024-11-28 19:16:23.528518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.528658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.528683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.800 qpair failed and we were unable to recover it. 00:28:02.800 [2024-11-28 19:16:23.528768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.528901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.528929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.800 qpair failed and we were unable to recover it. 00:28:02.800 [2024-11-28 19:16:23.529035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.529141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.529166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.800 qpair failed and we were unable to recover it. 00:28:02.800 [2024-11-28 19:16:23.529324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.529435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.529476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.800 qpair failed and we were unable to recover it. 00:28:02.800 [2024-11-28 19:16:23.529592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.800 [2024-11-28 19:16:23.529722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.529750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.801 qpair failed and we were unable to recover it. 00:28:02.801 [2024-11-28 19:16:23.529870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.529996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.530023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.801 qpair failed and we were unable to recover it. 00:28:02.801 [2024-11-28 19:16:23.530142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.530254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.530279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.801 qpair failed and we were unable to recover it. 00:28:02.801 [2024-11-28 19:16:23.530405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.530508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.530535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.801 qpair failed and we were unable to recover it. 00:28:02.801 [2024-11-28 19:16:23.530631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.530753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.530778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.801 qpair failed and we were unable to recover it. 00:28:02.801 [2024-11-28 19:16:23.530932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.531023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.531051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.801 qpair failed and we were unable to recover it. 00:28:02.801 [2024-11-28 19:16:23.531179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.531340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.531367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.801 qpair failed and we were unable to recover it. 00:28:02.801 [2024-11-28 19:16:23.531507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.531622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.531646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.801 qpair failed and we were unable to recover it. 00:28:02.801 [2024-11-28 19:16:23.531747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.531888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.531913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.801 qpair failed and we were unable to recover it. 00:28:02.801 [2024-11-28 19:16:23.531986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.532097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.532137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.801 qpair failed and we were unable to recover it. 00:28:02.801 [2024-11-28 19:16:23.532277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.532424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.532449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.801 qpair failed and we were unable to recover it. 00:28:02.801 [2024-11-28 19:16:23.532556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.532721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.532746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.801 qpair failed and we were unable to recover it. 00:28:02.801 [2024-11-28 19:16:23.532855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.532982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.533009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.801 qpair failed and we were unable to recover it. 00:28:02.801 [2024-11-28 19:16:23.533099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.533215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.533242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.801 qpair failed and we were unable to recover it. 00:28:02.801 [2024-11-28 19:16:23.533351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.533472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.533498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.801 qpair failed and we were unable to recover it. 00:28:02.801 [2024-11-28 19:16:23.533612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.533727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.533754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.801 qpair failed and we were unable to recover it. 00:28:02.801 [2024-11-28 19:16:23.533910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.534039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.534068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.801 qpair failed and we were unable to recover it. 00:28:02.801 [2024-11-28 19:16:23.534160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.534247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.534274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.801 qpair failed and we were unable to recover it. 00:28:02.801 [2024-11-28 19:16:23.534412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.534526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.534552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.801 qpair failed and we were unable to recover it. 00:28:02.801 [2024-11-28 19:16:23.534724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.534879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.534904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.801 qpair failed and we were unable to recover it. 00:28:02.801 [2024-11-28 19:16:23.535012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.535119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.535144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.801 qpair failed and we were unable to recover it. 00:28:02.801 [2024-11-28 19:16:23.535234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.535319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.535343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.801 qpair failed and we were unable to recover it. 00:28:02.801 [2024-11-28 19:16:23.535491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.535598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.535623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.801 qpair failed and we were unable to recover it. 00:28:02.801 [2024-11-28 19:16:23.535720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.535813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.535841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.801 qpair failed and we were unable to recover it. 00:28:02.801 [2024-11-28 19:16:23.535966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.536118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.536145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.801 qpair failed and we were unable to recover it. 00:28:02.801 [2024-11-28 19:16:23.536281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.536368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.801 [2024-11-28 19:16:23.536404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.801 qpair failed and we were unable to recover it. 00:28:02.802 [2024-11-28 19:16:23.536533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.536639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.536663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.802 qpair failed and we were unable to recover it. 00:28:02.802 [2024-11-28 19:16:23.536767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.536893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.536920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.802 qpair failed and we were unable to recover it. 00:28:02.802 [2024-11-28 19:16:23.537042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.537129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.537156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.802 qpair failed and we were unable to recover it. 00:28:02.802 [2024-11-28 19:16:23.537285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.537407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.537437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.802 qpair failed and we were unable to recover it. 00:28:02.802 [2024-11-28 19:16:23.537581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.537720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.537745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.802 qpair failed and we were unable to recover it. 00:28:02.802 [2024-11-28 19:16:23.537849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.537961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.537989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.802 qpair failed and we were unable to recover it. 00:28:02.802 [2024-11-28 19:16:23.538105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.538190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.538217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.802 qpair failed and we were unable to recover it. 00:28:02.802 [2024-11-28 19:16:23.538352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.538449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.538475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.802 qpair failed and we were unable to recover it. 00:28:02.802 [2024-11-28 19:16:23.538583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.538720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.538745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.802 qpair failed and we were unable to recover it. 00:28:02.802 [2024-11-28 19:16:23.538842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.538956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.538984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.802 qpair failed and we were unable to recover it. 00:28:02.802 [2024-11-28 19:16:23.539117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.539232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.539256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.802 qpair failed and we were unable to recover it. 00:28:02.802 [2024-11-28 19:16:23.539371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.539469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.539495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.802 qpair failed and we were unable to recover it. 00:28:02.802 [2024-11-28 19:16:23.539625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.539733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.539758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.802 qpair failed and we were unable to recover it. 00:28:02.802 [2024-11-28 19:16:23.539926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.540002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.540028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.802 qpair failed and we were unable to recover it. 00:28:02.802 [2024-11-28 19:16:23.540139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.540274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.540303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.802 qpair failed and we were unable to recover it. 00:28:02.802 [2024-11-28 19:16:23.540432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.540542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.540570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.802 qpair failed and we were unable to recover it. 00:28:02.802 [2024-11-28 19:16:23.540702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.540790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.540814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.802 qpair failed and we were unable to recover it. 00:28:02.802 [2024-11-28 19:16:23.540954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.541076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.541104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.802 qpair failed and we were unable to recover it. 00:28:02.802 [2024-11-28 19:16:23.541243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.541319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.541344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.802 qpair failed and we were unable to recover it. 00:28:02.802 [2024-11-28 19:16:23.541466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.541558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.541586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.802 qpair failed and we were unable to recover it. 00:28:02.802 [2024-11-28 19:16:23.541675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.541810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.541839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.802 qpair failed and we were unable to recover it. 00:28:02.802 [2024-11-28 19:16:23.541950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.542099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.542127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.802 qpair failed and we were unable to recover it. 00:28:02.802 [2024-11-28 19:16:23.542246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.542337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.542364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.802 qpair failed and we were unable to recover it. 00:28:02.802 [2024-11-28 19:16:23.542467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.542585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.542612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.802 qpair failed and we were unable to recover it. 00:28:02.802 [2024-11-28 19:16:23.542738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.542840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.542864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.802 qpair failed and we were unable to recover it. 00:28:02.802 [2024-11-28 19:16:23.542991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.543102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.543130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.802 qpair failed and we were unable to recover it. 00:28:02.802 [2024-11-28 19:16:23.543254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.543341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.543370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.802 qpair failed and we were unable to recover it. 00:28:02.802 [2024-11-28 19:16:23.543498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.543614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.543641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.802 qpair failed and we were unable to recover it. 00:28:02.802 [2024-11-28 19:16:23.543774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.802 [2024-11-28 19:16:23.543884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.543909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.803 qpair failed and we were unable to recover it. 00:28:02.803 [2024-11-28 19:16:23.544012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.544129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.544157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.803 qpair failed and we were unable to recover it. 00:28:02.803 [2024-11-28 19:16:23.544305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.544435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.544468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.803 qpair failed and we were unable to recover it. 00:28:02.803 [2024-11-28 19:16:23.544585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.544734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.544775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.803 qpair failed and we were unable to recover it. 00:28:02.803 [2024-11-28 19:16:23.544964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.545038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.545062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.803 qpair failed and we were unable to recover it. 00:28:02.803 [2024-11-28 19:16:23.545149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.545260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.545285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.803 qpair failed and we were unable to recover it. 00:28:02.803 [2024-11-28 19:16:23.545456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.545576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.545603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.803 qpair failed and we were unable to recover it. 00:28:02.803 [2024-11-28 19:16:23.545722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.545841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.545869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.803 qpair failed and we were unable to recover it. 00:28:02.803 [2024-11-28 19:16:23.545987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.546063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.546089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.803 qpair failed and we were unable to recover it. 00:28:02.803 [2024-11-28 19:16:23.546245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.546333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.546360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.803 qpair failed and we were unable to recover it. 00:28:02.803 [2024-11-28 19:16:23.546577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.546735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.546763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.803 qpair failed and we were unable to recover it. 00:28:02.803 [2024-11-28 19:16:23.546904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.547053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.547080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.803 qpair failed and we were unable to recover it. 00:28:02.803 [2024-11-28 19:16:23.547192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.547300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.547324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.803 qpair failed and we were unable to recover it. 00:28:02.803 [2024-11-28 19:16:23.547431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.547543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.547568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.803 qpair failed and we were unable to recover it. 00:28:02.803 [2024-11-28 19:16:23.547654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.547784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.547811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.803 qpair failed and we were unable to recover it. 00:28:02.803 [2024-11-28 19:16:23.547897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.548044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.548071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.803 qpair failed and we were unable to recover it. 00:28:02.803 [2024-11-28 19:16:23.548248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.548356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.548381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.803 qpair failed and we were unable to recover it. 00:28:02.803 [2024-11-28 19:16:23.548512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.548634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.548662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.803 qpair failed and we were unable to recover it. 00:28:02.803 [2024-11-28 19:16:23.548794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.548889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.548916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.803 qpair failed and we were unable to recover it. 00:28:02.803 [2024-11-28 19:16:23.549047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.549167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.549191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.803 qpair failed and we were unable to recover it. 00:28:02.803 [2024-11-28 19:16:23.549332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.549416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.549443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.803 qpair failed and we were unable to recover it. 00:28:02.803 [2024-11-28 19:16:23.549537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.549686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.549714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.803 qpair failed and we were unable to recover it. 00:28:02.803 [2024-11-28 19:16:23.549906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.550041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.550066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.803 qpair failed and we were unable to recover it. 00:28:02.803 [2024-11-28 19:16:23.550207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.550361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.550388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.803 qpair failed and we were unable to recover it. 00:28:02.803 [2024-11-28 19:16:23.550503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.550593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.550618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.803 qpair failed and we were unable to recover it. 00:28:02.803 [2024-11-28 19:16:23.550775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.550863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.550889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.803 qpair failed and we were unable to recover it. 00:28:02.803 [2024-11-28 19:16:23.551016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.551171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.551198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.803 qpair failed and we were unable to recover it. 00:28:02.803 [2024-11-28 19:16:23.551320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.551412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.551441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.803 qpair failed and we were unable to recover it. 00:28:02.803 [2024-11-28 19:16:23.551543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.551658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.551683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.803 qpair failed and we were unable to recover it. 00:28:02.803 [2024-11-28 19:16:23.551909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.803 [2024-11-28 19:16:23.552022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.552051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.804 qpair failed and we were unable to recover it. 00:28:02.804 [2024-11-28 19:16:23.552200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.552287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.552314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.804 qpair failed and we were unable to recover it. 00:28:02.804 [2024-11-28 19:16:23.552447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.552599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.552627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.804 qpair failed and we were unable to recover it. 00:28:02.804 [2024-11-28 19:16:23.552761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.552897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.552921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.804 qpair failed and we were unable to recover it. 00:28:02.804 [2024-11-28 19:16:23.553031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.553168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.553196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.804 qpair failed and we were unable to recover it. 00:28:02.804 [2024-11-28 19:16:23.553331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.553447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.553476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.804 qpair failed and we were unable to recover it. 00:28:02.804 [2024-11-28 19:16:23.553617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.553722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.553748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.804 qpair failed and we were unable to recover it. 00:28:02.804 [2024-11-28 19:16:23.553826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.553908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.553933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.804 qpair failed and we were unable to recover it. 00:28:02.804 [2024-11-28 19:16:23.554019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.554131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.554155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.804 qpair failed and we were unable to recover it. 00:28:02.804 [2024-11-28 19:16:23.554229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.554341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.554368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.804 qpair failed and we were unable to recover it. 00:28:02.804 [2024-11-28 19:16:23.554510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.554659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.554687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.804 qpair failed and we were unable to recover it. 00:28:02.804 [2024-11-28 19:16:23.554850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.554926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.554951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.804 qpair failed and we were unable to recover it. 00:28:02.804 [2024-11-28 19:16:23.555040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.555131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.555159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.804 qpair failed and we were unable to recover it. 00:28:02.804 [2024-11-28 19:16:23.555249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.555337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.555364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.804 qpair failed and we were unable to recover it. 00:28:02.804 [2024-11-28 19:16:23.555522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.555648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.555677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.804 qpair failed and we were unable to recover it. 00:28:02.804 [2024-11-28 19:16:23.555838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.555929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.555953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.804 qpair failed and we were unable to recover it. 00:28:02.804 [2024-11-28 19:16:23.556040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.556150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.556174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.804 qpair failed and we were unable to recover it. 00:28:02.804 [2024-11-28 19:16:23.556256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.556365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.556390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.804 qpair failed and we were unable to recover it. 00:28:02.804 [2024-11-28 19:16:23.556513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.556658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.556685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.804 qpair failed and we were unable to recover it. 00:28:02.804 [2024-11-28 19:16:23.556848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.556983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.557008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.804 qpair failed and we were unable to recover it. 00:28:02.804 [2024-11-28 19:16:23.557158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.557245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.557271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.804 qpair failed and we were unable to recover it. 00:28:02.804 [2024-11-28 19:16:23.557374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.557507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.557537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.804 qpair failed and we were unable to recover it. 00:28:02.804 [2024-11-28 19:16:23.557673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.557789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.557817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.804 qpair failed and we were unable to recover it. 00:28:02.804 [2024-11-28 19:16:23.557954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.558037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.558062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.804 qpair failed and we were unable to recover it. 00:28:02.804 [2024-11-28 19:16:23.558186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.558290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.558336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.804 qpair failed and we were unable to recover it. 00:28:02.804 [2024-11-28 19:16:23.558482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.558623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.558648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.804 qpair failed and we were unable to recover it. 00:28:02.804 [2024-11-28 19:16:23.558774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.558933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.558961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.804 qpair failed and we were unable to recover it. 00:28:02.804 [2024-11-28 19:16:23.559061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.559210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.559235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.804 qpair failed and we were unable to recover it. 00:28:02.804 [2024-11-28 19:16:23.559369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.559486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.559511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.804 qpair failed and we were unable to recover it. 00:28:02.804 [2024-11-28 19:16:23.559642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.559759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.804 [2024-11-28 19:16:23.559787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.805 qpair failed and we were unable to recover it. 00:28:02.805 [2024-11-28 19:16:23.559912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.559997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.560024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.805 qpair failed and we were unable to recover it. 00:28:02.805 [2024-11-28 19:16:23.560128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.560214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.560239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.805 qpair failed and we were unable to recover it. 00:28:02.805 [2024-11-28 19:16:23.560313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.560477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.560505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.805 qpair failed and we were unable to recover it. 00:28:02.805 [2024-11-28 19:16:23.560628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.560757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.560783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.805 qpair failed and we were unable to recover it. 00:28:02.805 [2024-11-28 19:16:23.560927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.561014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.561059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.805 qpair failed and we were unable to recover it. 00:28:02.805 [2024-11-28 19:16:23.561230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.561350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.561375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.805 qpair failed and we were unable to recover it. 00:28:02.805 [2024-11-28 19:16:23.561467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.561580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.561621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.805 qpair failed and we were unable to recover it. 00:28:02.805 [2024-11-28 19:16:23.561745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.561832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.561858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.805 qpair failed and we were unable to recover it. 00:28:02.805 [2024-11-28 19:16:23.561971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.562086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.562112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.805 qpair failed and we were unable to recover it. 00:28:02.805 [2024-11-28 19:16:23.562244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.562383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.562434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.805 qpair failed and we were unable to recover it. 00:28:02.805 [2024-11-28 19:16:23.562552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.562678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.562706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.805 qpair failed and we were unable to recover it. 00:28:02.805 [2024-11-28 19:16:23.562869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.562972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.562997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.805 qpair failed and we were unable to recover it. 00:28:02.805 [2024-11-28 19:16:23.563082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.563196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.563223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.805 qpair failed and we were unable to recover it. 00:28:02.805 [2024-11-28 19:16:23.563357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.563476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.563501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.805 qpair failed and we were unable to recover it. 00:28:02.805 [2024-11-28 19:16:23.563595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.563720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.563747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.805 qpair failed and we were unable to recover it. 00:28:02.805 [2024-11-28 19:16:23.563912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.563982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.564007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.805 qpair failed and we were unable to recover it. 00:28:02.805 [2024-11-28 19:16:23.564144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.564276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.564303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.805 qpair failed and we were unable to recover it. 00:28:02.805 [2024-11-28 19:16:23.564442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.564581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.564606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.805 qpair failed and we were unable to recover it. 00:28:02.805 [2024-11-28 19:16:23.564797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.565018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.565045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.805 qpair failed and we were unable to recover it. 00:28:02.805 [2024-11-28 19:16:23.565166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.565282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.565310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.805 qpair failed and we were unable to recover it. 00:28:02.805 [2024-11-28 19:16:23.565409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.565533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.565575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.805 qpair failed and we were unable to recover it. 00:28:02.805 [2024-11-28 19:16:23.565663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.565771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.565795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.805 qpair failed and we were unable to recover it. 00:28:02.805 [2024-11-28 19:16:23.565898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.565989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.566015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.805 qpair failed and we were unable to recover it. 00:28:02.805 [2024-11-28 19:16:23.566132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.566249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.566276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.805 qpair failed and we were unable to recover it. 00:28:02.805 [2024-11-28 19:16:23.566389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.566494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.566520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.805 qpair failed and we were unable to recover it. 00:28:02.805 [2024-11-28 19:16:23.566638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.566745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.566769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.805 qpair failed and we were unable to recover it. 00:28:02.805 [2024-11-28 19:16:23.566905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.567053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.567080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.805 qpair failed and we were unable to recover it. 00:28:02.805 [2024-11-28 19:16:23.567205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.567351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.805 [2024-11-28 19:16:23.567378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.805 qpair failed and we were unable to recover it. 00:28:02.805 [2024-11-28 19:16:23.567534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.567621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.567649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.806 qpair failed and we were unable to recover it. 00:28:02.806 [2024-11-28 19:16:23.567789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.567896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.567920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.806 qpair failed and we were unable to recover it. 00:28:02.806 [2024-11-28 19:16:23.567997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.568088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.568112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.806 qpair failed and we were unable to recover it. 00:28:02.806 [2024-11-28 19:16:23.568197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.568324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.568352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.806 qpair failed and we were unable to recover it. 00:28:02.806 [2024-11-28 19:16:23.568483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.568577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.568604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.806 qpair failed and we were unable to recover it. 00:28:02.806 [2024-11-28 19:16:23.568733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.568875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.568899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.806 qpair failed and we were unable to recover it. 00:28:02.806 [2024-11-28 19:16:23.569057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.569153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.569181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.806 qpair failed and we were unable to recover it. 00:28:02.806 [2024-11-28 19:16:23.569268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.569390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.569427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.806 qpair failed and we were unable to recover it. 00:28:02.806 [2024-11-28 19:16:23.569554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.569719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.569744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.806 qpair failed and we were unable to recover it. 00:28:02.806 [2024-11-28 19:16:23.569882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.569995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.570020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.806 qpair failed and we were unable to recover it. 00:28:02.806 [2024-11-28 19:16:23.570124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.570212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.570236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.806 qpair failed and we were unable to recover it. 00:28:02.806 [2024-11-28 19:16:23.570362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.570460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.570506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.806 qpair failed and we were unable to recover it. 00:28:02.806 [2024-11-28 19:16:23.570586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.570696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.570721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.806 qpair failed and we were unable to recover it. 00:28:02.806 [2024-11-28 19:16:23.570802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.570915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.570940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.806 qpair failed and we were unable to recover it. 00:28:02.806 [2024-11-28 19:16:23.571052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.571160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.571185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.806 qpair failed and we were unable to recover it. 00:28:02.806 [2024-11-28 19:16:23.571341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.571467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.571495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.806 qpair failed and we were unable to recover it. 00:28:02.806 [2024-11-28 19:16:23.571598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.571762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.571787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.806 qpair failed and we were unable to recover it. 00:28:02.806 [2024-11-28 19:16:23.571930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.572041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.572069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.806 qpair failed and we were unable to recover it. 00:28:02.806 [2024-11-28 19:16:23.572232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.572354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.572382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.806 qpair failed and we were unable to recover it. 00:28:02.806 [2024-11-28 19:16:23.572539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.572685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.572712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.806 qpair failed and we were unable to recover it. 00:28:02.806 [2024-11-28 19:16:23.572809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.572927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.572955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.806 qpair failed and we were unable to recover it. 00:28:02.806 [2024-11-28 19:16:23.573115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.573229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.573253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.806 qpair failed and we were unable to recover it. 00:28:02.806 [2024-11-28 19:16:23.573360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.573517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.573545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.806 qpair failed and we were unable to recover it. 00:28:02.806 [2024-11-28 19:16:23.573666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.573778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.573806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.806 qpair failed and we were unable to recover it. 00:28:02.806 [2024-11-28 19:16:23.573929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.574052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.574079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.806 qpair failed and we were unable to recover it. 00:28:02.806 [2024-11-28 19:16:23.574215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.574325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.574349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.806 qpair failed and we were unable to recover it. 00:28:02.806 [2024-11-28 19:16:23.574521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.806 [2024-11-28 19:16:23.574610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.574637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.807 qpair failed and we were unable to recover it. 00:28:02.807 [2024-11-28 19:16:23.574728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.574875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.574903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.807 qpair failed and we were unable to recover it. 00:28:02.807 [2024-11-28 19:16:23.574997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.575084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.575112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.807 qpair failed and we were unable to recover it. 00:28:02.807 [2024-11-28 19:16:23.575219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.575354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.575379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.807 qpair failed and we were unable to recover it. 00:28:02.807 [2024-11-28 19:16:23.575533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.575624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.575651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.807 qpair failed and we were unable to recover it. 00:28:02.807 [2024-11-28 19:16:23.575779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.575869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.575896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.807 qpair failed and we were unable to recover it. 00:28:02.807 [2024-11-28 19:16:23.576009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.576102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.576130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.807 qpair failed and we were unable to recover it. 00:28:02.807 [2024-11-28 19:16:23.576260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.576352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.576376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.807 qpair failed and we were unable to recover it. 00:28:02.807 [2024-11-28 19:16:23.576520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.576607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.576633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.807 qpair failed and we were unable to recover it. 00:28:02.807 [2024-11-28 19:16:23.576778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.576862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.576891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.807 qpair failed and we were unable to recover it. 00:28:02.807 [2024-11-28 19:16:23.576984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.577141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.577169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.807 qpair failed and we were unable to recover it. 00:28:02.807 [2024-11-28 19:16:23.577300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.577446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.577472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.807 qpair failed and we were unable to recover it. 00:28:02.807 [2024-11-28 19:16:23.577597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.577722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.577750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.807 qpair failed and we were unable to recover it. 00:28:02.807 [2024-11-28 19:16:23.577853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.577969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.577997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.807 qpair failed and we were unable to recover it. 00:28:02.807 [2024-11-28 19:16:23.578089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.578168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.578196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.807 qpair failed and we were unable to recover it. 00:28:02.807 [2024-11-28 19:16:23.578331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.578414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.578440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.807 qpair failed and we were unable to recover it. 00:28:02.807 [2024-11-28 19:16:23.578570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.578689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.578716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.807 qpair failed and we were unable to recover it. 00:28:02.807 [2024-11-28 19:16:23.578841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.578928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.578956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.807 qpair failed and we were unable to recover it. 00:28:02.807 [2024-11-28 19:16:23.579040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.579162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.579189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.807 qpair failed and we were unable to recover it. 00:28:02.807 [2024-11-28 19:16:23.579294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.579379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.579414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.807 qpair failed and we were unable to recover it. 00:28:02.807 [2024-11-28 19:16:23.579534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.579673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.579700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.807 qpair failed and we were unable to recover it. 00:28:02.807 [2024-11-28 19:16:23.579821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.579934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.579959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.807 qpair failed and we were unable to recover it. 00:28:02.807 [2024-11-28 19:16:23.580050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.580200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.580227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.807 qpair failed and we were unable to recover it. 00:28:02.807 [2024-11-28 19:16:23.580331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.580411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.580438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.807 qpair failed and we were unable to recover it. 00:28:02.807 [2024-11-28 19:16:23.580547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.580719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.580744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.807 qpair failed and we were unable to recover it. 00:28:02.807 [2024-11-28 19:16:23.580857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.580943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.580968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.807 qpair failed and we were unable to recover it. 00:28:02.807 [2024-11-28 19:16:23.581123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.581269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.581297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.807 qpair failed and we were unable to recover it. 00:28:02.807 [2024-11-28 19:16:23.581407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.581484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.581509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.807 qpair failed and we were unable to recover it. 00:28:02.807 [2024-11-28 19:16:23.581619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.581730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.581757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.807 qpair failed and we were unable to recover it. 00:28:02.807 [2024-11-28 19:16:23.581847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.807 [2024-11-28 19:16:23.581938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.581965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.808 qpair failed and we were unable to recover it. 00:28:02.808 [2024-11-28 19:16:23.582114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.582211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.582238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.808 qpair failed and we were unable to recover it. 00:28:02.808 [2024-11-28 19:16:23.582368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.582478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.582503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.808 qpair failed and we were unable to recover it. 00:28:02.808 [2024-11-28 19:16:23.582636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.582768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.582795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.808 qpair failed and we were unable to recover it. 00:28:02.808 [2024-11-28 19:16:23.582919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.583066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.583093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.808 qpair failed and we were unable to recover it. 00:28:02.808 [2024-11-28 19:16:23.583213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.583342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.583367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.808 qpair failed and we were unable to recover it. 00:28:02.808 [2024-11-28 19:16:23.583485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.583602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.583627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.808 qpair failed and we were unable to recover it. 00:28:02.808 [2024-11-28 19:16:23.583724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.583840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.583867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.808 qpair failed and we were unable to recover it. 00:28:02.808 [2024-11-28 19:16:23.584015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.584101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.584129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.808 qpair failed and we were unable to recover it. 00:28:02.808 [2024-11-28 19:16:23.584220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.584338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.584365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.808 qpair failed and we were unable to recover it. 00:28:02.808 [2024-11-28 19:16:23.584469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.584581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.584605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.808 qpair failed and we were unable to recover it. 00:28:02.808 [2024-11-28 19:16:23.584689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.584815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.584841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.808 qpair failed and we were unable to recover it. 00:28:02.808 [2024-11-28 19:16:23.584998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.585104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.585128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.808 qpair failed and we were unable to recover it. 00:28:02.808 [2024-11-28 19:16:23.585263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.585379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.585422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.808 qpair failed and we were unable to recover it. 00:28:02.808 [2024-11-28 19:16:23.585527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.585664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.585689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.808 qpair failed and we were unable to recover it. 00:28:02.808 [2024-11-28 19:16:23.585812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.585961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.585986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.808 qpair failed and we were unable to recover it. 00:28:02.808 [2024-11-28 19:16:23.586147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.586238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.586266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.808 qpair failed and we were unable to recover it. 00:28:02.808 [2024-11-28 19:16:23.586423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.586547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.586575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.808 qpair failed and we were unable to recover it. 00:28:02.808 [2024-11-28 19:16:23.586688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.586770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.586794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.808 qpair failed and we were unable to recover it. 00:28:02.808 [2024-11-28 19:16:23.586876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.586967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.586994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.808 qpair failed and we were unable to recover it. 00:28:02.808 [2024-11-28 19:16:23.587118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.587243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.587270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.808 qpair failed and we were unable to recover it. 00:28:02.808 [2024-11-28 19:16:23.587423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.587539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.587567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.808 qpair failed and we were unable to recover it. 00:28:02.808 [2024-11-28 19:16:23.587704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.587787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.587812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.808 qpair failed and we were unable to recover it. 00:28:02.808 [2024-11-28 19:16:23.587915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.588001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.588025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.808 qpair failed and we were unable to recover it. 00:28:02.808 [2024-11-28 19:16:23.588137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.588213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.588237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.808 qpair failed and we were unable to recover it. 00:28:02.808 [2024-11-28 19:16:23.588349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.588447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.588475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.808 qpair failed and we were unable to recover it. 00:28:02.808 [2024-11-28 19:16:23.588609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.588720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.588745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.808 qpair failed and we were unable to recover it. 00:28:02.808 [2024-11-28 19:16:23.588900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.589058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.589085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.808 qpair failed and we were unable to recover it. 00:28:02.808 [2024-11-28 19:16:23.589239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.589356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.808 [2024-11-28 19:16:23.589385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.808 qpair failed and we were unable to recover it. 00:28:02.808 [2024-11-28 19:16:23.589515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.589641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.589668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.809 qpair failed and we were unable to recover it. 00:28:02.809 [2024-11-28 19:16:23.589772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.589885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.589909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.809 qpair failed and we were unable to recover it. 00:28:02.809 [2024-11-28 19:16:23.590045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.590161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.590188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.809 qpair failed and we were unable to recover it. 00:28:02.809 [2024-11-28 19:16:23.590268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.590389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.590425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.809 qpair failed and we were unable to recover it. 00:28:02.809 [2024-11-28 19:16:23.590504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.590624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.590652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.809 qpair failed and we were unable to recover it. 00:28:02.809 [2024-11-28 19:16:23.590831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.590946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.590970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.809 qpair failed and we were unable to recover it. 00:28:02.809 [2024-11-28 19:16:23.591090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.591196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.591221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.809 qpair failed and we were unable to recover it. 00:28:02.809 [2024-11-28 19:16:23.591324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.591411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.591440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.809 qpair failed and we were unable to recover it. 00:28:02.809 [2024-11-28 19:16:23.591553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.591700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.591728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.809 qpair failed and we were unable to recover it. 00:28:02.809 [2024-11-28 19:16:23.591855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.591970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.591995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.809 qpair failed and we were unable to recover it. 00:28:02.809 [2024-11-28 19:16:23.592105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.592221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.592248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.809 qpair failed and we were unable to recover it. 00:28:02.809 [2024-11-28 19:16:23.592404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.592497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.592525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.809 qpair failed and we were unable to recover it. 00:28:02.809 [2024-11-28 19:16:23.592642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.592785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.592812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.809 qpair failed and we were unable to recover it. 00:28:02.809 [2024-11-28 19:16:23.592912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.593027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.593051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.809 qpair failed and we were unable to recover it. 00:28:02.809 [2024-11-28 19:16:23.593171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.593254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.593281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.809 qpair failed and we were unable to recover it. 00:28:02.809 [2024-11-28 19:16:23.593409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.593567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.593593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.809 qpair failed and we were unable to recover it. 00:28:02.809 [2024-11-28 19:16:23.593746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.593865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.593893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.809 qpair failed and we were unable to recover it. 00:28:02.809 [2024-11-28 19:16:23.594025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.594128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.594152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.809 qpair failed and we were unable to recover it. 00:28:02.809 [2024-11-28 19:16:23.594243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.594358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.594385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.809 qpair failed and we were unable to recover it. 00:28:02.809 [2024-11-28 19:16:23.594515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.594663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.594691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.809 qpair failed and we were unable to recover it. 00:28:02.809 [2024-11-28 19:16:23.594785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.594872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.594900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.809 qpair failed and we were unable to recover it. 00:28:02.809 [2024-11-28 19:16:23.595014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.595122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.595147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.809 qpair failed and we were unable to recover it. 00:28:02.809 [2024-11-28 19:16:23.595289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.595409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.595438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.809 qpair failed and we were unable to recover it. 00:28:02.809 [2024-11-28 19:16:23.595534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.595655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.595684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.809 qpair failed and we were unable to recover it. 00:28:02.809 [2024-11-28 19:16:23.595837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.595975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.596000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.809 qpair failed and we were unable to recover it. 00:28:02.809 [2024-11-28 19:16:23.596115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.596228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.596253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.809 qpair failed and we were unable to recover it. 00:28:02.809 [2024-11-28 19:16:23.596354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.596484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.596513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.809 qpair failed and we were unable to recover it. 00:28:02.809 [2024-11-28 19:16:23.596677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.596759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.596785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.809 qpair failed and we were unable to recover it. 00:28:02.809 [2024-11-28 19:16:23.596903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.597041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.809 [2024-11-28 19:16:23.597069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.809 qpair failed and we were unable to recover it. 00:28:02.809 [2024-11-28 19:16:23.597204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.597322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.597347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.810 qpair failed and we were unable to recover it. 00:28:02.810 [2024-11-28 19:16:23.597448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.597597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.597625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.810 qpair failed and we were unable to recover it. 00:28:02.810 [2024-11-28 19:16:23.597747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.597835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.597863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.810 qpair failed and we were unable to recover it. 00:28:02.810 [2024-11-28 19:16:23.597984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.598076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.598104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.810 qpair failed and we were unable to recover it. 00:28:02.810 [2024-11-28 19:16:23.598260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.598363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.598388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.810 qpair failed and we were unable to recover it. 00:28:02.810 [2024-11-28 19:16:23.598526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.598614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.598643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.810 qpair failed and we were unable to recover it. 00:28:02.810 [2024-11-28 19:16:23.598765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.598890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.598923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.810 qpair failed and we were unable to recover it. 00:28:02.810 [2024-11-28 19:16:23.599025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.599140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.599168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.810 qpair failed and we were unable to recover it. 00:28:02.810 [2024-11-28 19:16:23.599325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.599409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.599434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.810 qpair failed and we were unable to recover it. 00:28:02.810 [2024-11-28 19:16:23.599571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.599692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.599743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.810 qpair failed and we were unable to recover it. 00:28:02.810 [2024-11-28 19:16:23.599857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.599973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.600001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.810 qpair failed and we were unable to recover it. 00:28:02.810 [2024-11-28 19:16:23.600131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.600247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.600275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.810 qpair failed and we were unable to recover it. 00:28:02.810 [2024-11-28 19:16:23.600376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.600496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.600521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.810 qpair failed and we were unable to recover it. 00:28:02.810 [2024-11-28 19:16:23.600681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.600801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.600828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.810 qpair failed and we were unable to recover it. 00:28:02.810 [2024-11-28 19:16:23.600923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.601036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.601064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.810 qpair failed and we were unable to recover it. 00:28:02.810 [2024-11-28 19:16:23.601150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.601296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.601324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.810 qpair failed and we were unable to recover it. 00:28:02.810 [2024-11-28 19:16:23.601459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.601615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.601644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.810 qpair failed and we were unable to recover it. 00:28:02.810 [2024-11-28 19:16:23.601783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.601934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.601961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.810 qpair failed and we were unable to recover it. 00:28:02.810 [2024-11-28 19:16:23.602086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.602198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.602226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.810 qpair failed and we were unable to recover it. 00:28:02.810 [2024-11-28 19:16:23.602352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.602503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.602532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.810 qpair failed and we were unable to recover it. 00:28:02.810 [2024-11-28 19:16:23.602691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.602830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.602855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.810 qpair failed and we were unable to recover it. 00:28:02.810 [2024-11-28 19:16:23.602957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.603077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.603104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.810 qpair failed and we were unable to recover it. 00:28:02.810 [2024-11-28 19:16:23.603186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.603307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.603335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.810 qpair failed and we were unable to recover it. 00:28:02.810 [2024-11-28 19:16:23.603456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.603581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.603609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.810 qpair failed and we were unable to recover it. 00:28:02.810 [2024-11-28 19:16:23.603710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.603798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.603823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.810 qpair failed and we were unable to recover it. 00:28:02.810 [2024-11-28 19:16:23.603911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.603987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.810 [2024-11-28 19:16:23.604012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.810 qpair failed and we were unable to recover it. 00:28:02.811 [2024-11-28 19:16:23.604111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.604182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.604207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.811 qpair failed and we were unable to recover it. 00:28:02.811 [2024-11-28 19:16:23.604293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.604410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.604436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.811 qpair failed and we were unable to recover it. 00:28:02.811 [2024-11-28 19:16:23.604518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.604622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.604647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.811 qpair failed and we were unable to recover it. 00:28:02.811 [2024-11-28 19:16:23.604757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.604868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.604893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.811 qpair failed and we were unable to recover it. 00:28:02.811 [2024-11-28 19:16:23.604976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.605086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.605111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.811 qpair failed and we were unable to recover it. 00:28:02.811 [2024-11-28 19:16:23.605187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.605297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.605321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.811 qpair failed and we were unable to recover it. 00:28:02.811 [2024-11-28 19:16:23.605406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.605497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.605522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.811 qpair failed and we were unable to recover it. 00:28:02.811 [2024-11-28 19:16:23.605630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.605713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.605737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.811 qpair failed and we were unable to recover it. 00:28:02.811 [2024-11-28 19:16:23.605849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.605926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.605950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.811 qpair failed and we were unable to recover it. 00:28:02.811 [2024-11-28 19:16:23.606072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.606179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.606204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.811 qpair failed and we were unable to recover it. 00:28:02.811 [2024-11-28 19:16:23.606284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.606365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.606389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.811 qpair failed and we were unable to recover it. 00:28:02.811 [2024-11-28 19:16:23.606504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.606587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.606612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.811 qpair failed and we were unable to recover it. 00:28:02.811 [2024-11-28 19:16:23.606696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.606775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.606799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.811 qpair failed and we were unable to recover it. 00:28:02.811 [2024-11-28 19:16:23.606914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.607029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.607053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.811 qpair failed and we were unable to recover it. 00:28:02.811 [2024-11-28 19:16:23.607138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.607248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.607273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.811 qpair failed and we were unable to recover it. 00:28:02.811 [2024-11-28 19:16:23.607386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.607478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.607502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.811 qpair failed and we were unable to recover it. 00:28:02.811 [2024-11-28 19:16:23.607592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.607664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.607688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.811 qpair failed and we were unable to recover it. 00:28:02.811 [2024-11-28 19:16:23.607793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.607885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.607909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.811 qpair failed and we were unable to recover it. 00:28:02.811 [2024-11-28 19:16:23.608015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.608100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.608125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.811 qpair failed and we were unable to recover it. 00:28:02.811 [2024-11-28 19:16:23.608216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.608322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.608345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.811 qpair failed and we were unable to recover it. 00:28:02.811 [2024-11-28 19:16:23.608430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.608519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.608543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.811 qpair failed and we were unable to recover it. 00:28:02.811 [2024-11-28 19:16:23.608630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.608716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.608741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.811 qpair failed and we were unable to recover it. 00:28:02.811 [2024-11-28 19:16:23.608813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.608915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.608939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.811 qpair failed and we were unable to recover it. 00:28:02.811 [2024-11-28 19:16:23.609049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.609160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.609184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.811 qpair failed and we were unable to recover it. 00:28:02.811 [2024-11-28 19:16:23.609298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.609401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.609426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.811 qpair failed and we were unable to recover it. 00:28:02.811 [2024-11-28 19:16:23.609536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.609622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.609646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.811 qpair failed and we were unable to recover it. 00:28:02.811 [2024-11-28 19:16:23.609734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.609847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.609872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.811 qpair failed and we were unable to recover it. 00:28:02.811 [2024-11-28 19:16:23.609957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.610029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.610054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.811 qpair failed and we were unable to recover it. 00:28:02.811 [2024-11-28 19:16:23.610160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.610242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.811 [2024-11-28 19:16:23.610267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.812 qpair failed and we were unable to recover it. 00:28:02.812 [2024-11-28 19:16:23.610381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.610470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.610495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.812 qpair failed and we were unable to recover it. 00:28:02.812 [2024-11-28 19:16:23.610605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.610686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.610710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.812 qpair failed and we were unable to recover it. 00:28:02.812 [2024-11-28 19:16:23.610798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.610942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.610968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.812 qpair failed and we were unable to recover it. 00:28:02.812 [2024-11-28 19:16:23.611082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.611190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.611213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.812 qpair failed and we were unable to recover it. 00:28:02.812 [2024-11-28 19:16:23.611290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.611373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.611405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.812 qpair failed and we were unable to recover it. 00:28:02.812 [2024-11-28 19:16:23.611493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.611581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.611606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.812 qpair failed and we were unable to recover it. 00:28:02.812 [2024-11-28 19:16:23.611695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.611782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.611808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.812 qpair failed and we were unable to recover it. 00:28:02.812 [2024-11-28 19:16:23.611921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.612032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.612057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.812 qpair failed and we were unable to recover it. 00:28:02.812 [2024-11-28 19:16:23.612164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.612269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.612294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.812 qpair failed and we were unable to recover it. 00:28:02.812 [2024-11-28 19:16:23.612380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.612527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.612553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.812 qpair failed and we were unable to recover it. 00:28:02.812 [2024-11-28 19:16:23.612665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.612758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.612783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.812 qpair failed and we were unable to recover it. 00:28:02.812 [2024-11-28 19:16:23.612865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.612976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.613000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.812 qpair failed and we were unable to recover it. 00:28:02.812 [2024-11-28 19:16:23.613111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.613198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.613227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.812 qpair failed and we were unable to recover it. 00:28:02.812 [2024-11-28 19:16:23.613315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.613424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.613450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.812 qpair failed and we were unable to recover it. 00:28:02.812 [2024-11-28 19:16:23.613543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.613619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.613642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.812 qpair failed and we were unable to recover it. 00:28:02.812 [2024-11-28 19:16:23.613736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.613837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.613861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.812 qpair failed and we were unable to recover it. 00:28:02.812 [2024-11-28 19:16:23.613968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.614052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.614075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.812 qpair failed and we were unable to recover it. 00:28:02.812 [2024-11-28 19:16:23.614162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.614240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.614265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.812 qpair failed and we were unable to recover it. 00:28:02.812 [2024-11-28 19:16:23.614375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.614467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.614492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.812 qpair failed and we were unable to recover it. 00:28:02.812 [2024-11-28 19:16:23.614605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.614692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.614717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.812 qpair failed and we were unable to recover it. 00:28:02.812 [2024-11-28 19:16:23.614829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.614909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.614934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.812 qpair failed and we were unable to recover it. 00:28:02.812 [2024-11-28 19:16:23.615029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.615142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.615168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.812 qpair failed and we were unable to recover it. 00:28:02.812 [2024-11-28 19:16:23.615247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.615380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.615411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.812 qpair failed and we were unable to recover it. 00:28:02.812 [2024-11-28 19:16:23.615495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.615607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.615631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.812 qpair failed and we were unable to recover it. 00:28:02.812 [2024-11-28 19:16:23.615712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.615798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.615823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.812 qpair failed and we were unable to recover it. 00:28:02.812 [2024-11-28 19:16:23.615940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.616024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.616049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.812 qpair failed and we were unable to recover it. 00:28:02.812 [2024-11-28 19:16:23.616160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.616295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.616319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.812 qpair failed and we were unable to recover it. 00:28:02.812 [2024-11-28 19:16:23.616435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.616539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.616564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.812 qpair failed and we were unable to recover it. 00:28:02.812 [2024-11-28 19:16:23.616645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.812 [2024-11-28 19:16:23.616720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.616743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.813 qpair failed and we were unable to recover it. 00:28:02.813 [2024-11-28 19:16:23.616852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.616960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.616984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.813 qpair failed and we were unable to recover it. 00:28:02.813 [2024-11-28 19:16:23.617085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.617187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.617211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.813 qpair failed and we were unable to recover it. 00:28:02.813 [2024-11-28 19:16:23.617324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.617445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.617470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.813 qpair failed and we were unable to recover it. 00:28:02.813 [2024-11-28 19:16:23.617586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.617671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.617695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.813 qpair failed and we were unable to recover it. 00:28:02.813 [2024-11-28 19:16:23.617815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.617897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.617921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.813 qpair failed and we were unable to recover it. 00:28:02.813 [2024-11-28 19:16:23.618008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.618079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.618103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.813 qpair failed and we were unable to recover it. 00:28:02.813 [2024-11-28 19:16:23.618204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.618319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.618346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.813 qpair failed and we were unable to recover it. 00:28:02.813 [2024-11-28 19:16:23.618445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.618538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.618562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.813 qpair failed and we were unable to recover it. 00:28:02.813 [2024-11-28 19:16:23.618644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.618736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.618760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.813 qpair failed and we were unable to recover it. 00:28:02.813 [2024-11-28 19:16:23.618878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.618997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.619031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.813 qpair failed and we were unable to recover it. 00:28:02.813 [2024-11-28 19:16:23.619142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.619259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.619283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.813 qpair failed and we were unable to recover it. 00:28:02.813 [2024-11-28 19:16:23.619376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.619488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.619512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.813 qpair failed and we were unable to recover it. 00:28:02.813 [2024-11-28 19:16:23.619592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.619704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.619729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.813 qpair failed and we were unable to recover it. 00:28:02.813 [2024-11-28 19:16:23.619835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.619913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.619937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.813 qpair failed and we were unable to recover it. 00:28:02.813 [2024-11-28 19:16:23.620029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.620116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.620140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.813 qpair failed and we were unable to recover it. 00:28:02.813 [2024-11-28 19:16:23.620253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.620332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.620356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.813 qpair failed and we were unable to recover it. 00:28:02.813 [2024-11-28 19:16:23.620482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.620609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.620634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.813 qpair failed and we were unable to recover it. 00:28:02.813 [2024-11-28 19:16:23.620732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.620814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.620840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.813 qpair failed and we were unable to recover it. 00:28:02.813 [2024-11-28 19:16:23.620933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.621047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.621072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.813 qpair failed and we were unable to recover it. 00:28:02.813 [2024-11-28 19:16:23.621183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.621276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.621300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.813 qpair failed and we were unable to recover it. 00:28:02.813 [2024-11-28 19:16:23.621448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.621557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.621581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.813 qpair failed and we were unable to recover it. 00:28:02.813 [2024-11-28 19:16:23.621669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.621754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.621779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.813 qpair failed and we were unable to recover it. 00:28:02.813 [2024-11-28 19:16:23.621872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.621957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.621982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.813 qpair failed and we were unable to recover it. 00:28:02.813 [2024-11-28 19:16:23.622088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.622211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.622236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.813 qpair failed and we were unable to recover it. 00:28:02.813 [2024-11-28 19:16:23.622346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.622450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.622475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.813 qpair failed and we were unable to recover it. 00:28:02.813 [2024-11-28 19:16:23.622562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.622650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.622674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.813 qpair failed and we were unable to recover it. 00:28:02.813 [2024-11-28 19:16:23.622763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.622872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.622897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.813 qpair failed and we were unable to recover it. 00:28:02.813 [2024-11-28 19:16:23.623004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.623085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.623109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.813 qpair failed and we were unable to recover it. 00:28:02.813 [2024-11-28 19:16:23.623187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.813 [2024-11-28 19:16:23.623298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.623324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.814 qpair failed and we were unable to recover it. 00:28:02.814 [2024-11-28 19:16:23.623448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.623537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.623563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.814 qpair failed and we were unable to recover it. 00:28:02.814 [2024-11-28 19:16:23.623656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.623771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.623795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.814 qpair failed and we were unable to recover it. 00:28:02.814 [2024-11-28 19:16:23.623933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.624037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.624062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.814 qpair failed and we were unable to recover it. 00:28:02.814 [2024-11-28 19:16:23.624142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.624225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.624249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.814 qpair failed and we were unable to recover it. 00:28:02.814 [2024-11-28 19:16:23.624333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.624421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.624447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.814 qpair failed and we were unable to recover it. 00:28:02.814 [2024-11-28 19:16:23.624532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.624644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.624672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.814 qpair failed and we were unable to recover it. 00:28:02.814 [2024-11-28 19:16:23.624772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.624860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.624884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.814 qpair failed and we were unable to recover it. 00:28:02.814 [2024-11-28 19:16:23.624968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.625050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.625075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.814 qpair failed and we were unable to recover it. 00:28:02.814 [2024-11-28 19:16:23.625190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.625264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.625288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.814 qpair failed and we were unable to recover it. 00:28:02.814 [2024-11-28 19:16:23.625371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.625466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.625492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.814 qpair failed and we were unable to recover it. 00:28:02.814 [2024-11-28 19:16:23.625598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.625704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.625728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.814 qpair failed and we were unable to recover it. 00:28:02.814 [2024-11-28 19:16:23.625810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.625922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.625947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.814 qpair failed and we were unable to recover it. 00:28:02.814 [2024-11-28 19:16:23.626063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.626168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.626193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.814 qpair failed and we were unable to recover it. 00:28:02.814 [2024-11-28 19:16:23.626278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.626363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.626389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.814 qpair failed and we were unable to recover it. 00:28:02.814 [2024-11-28 19:16:23.626485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.626620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.626645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.814 qpair failed and we were unable to recover it. 00:28:02.814 [2024-11-28 19:16:23.626740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.626828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.626853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.814 qpair failed and we were unable to recover it. 00:28:02.814 [2024-11-28 19:16:23.626947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.627024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.627049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.814 qpair failed and we were unable to recover it. 00:28:02.814 [2024-11-28 19:16:23.627127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.627208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.627232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.814 qpair failed and we were unable to recover it. 00:28:02.814 [2024-11-28 19:16:23.627337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.627428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.627453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.814 qpair failed and we were unable to recover it. 00:28:02.814 [2024-11-28 19:16:23.627535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.627616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.627641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.814 qpair failed and we were unable to recover it. 00:28:02.814 [2024-11-28 19:16:23.627791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.627896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.627924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.814 qpair failed and we were unable to recover it. 00:28:02.814 [2024-11-28 19:16:23.628097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.628215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.628239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.814 qpair failed and we were unable to recover it. 00:28:02.814 [2024-11-28 19:16:23.628333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.628455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.628481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.814 qpair failed and we were unable to recover it. 00:28:02.814 [2024-11-28 19:16:23.628570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.628651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.628675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.814 qpair failed and we were unable to recover it. 00:28:02.814 [2024-11-28 19:16:23.628790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.628878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.628903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.814 qpair failed and we were unable to recover it. 00:28:02.814 [2024-11-28 19:16:23.629018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.629101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.629125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.814 qpair failed and we were unable to recover it. 00:28:02.814 [2024-11-28 19:16:23.629247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.629349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.629390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.814 qpair failed and we were unable to recover it. 00:28:02.814 [2024-11-28 19:16:23.629510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.629596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.629622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.814 qpair failed and we were unable to recover it. 00:28:02.814 [2024-11-28 19:16:23.629719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.814 [2024-11-28 19:16:23.629848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.629875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.815 qpair failed and we were unable to recover it. 00:28:02.815 [2024-11-28 19:16:23.629967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.630085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.630110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.815 qpair failed and we were unable to recover it. 00:28:02.815 [2024-11-28 19:16:23.630230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.630366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.630409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.815 qpair failed and we were unable to recover it. 00:28:02.815 [2024-11-28 19:16:23.630502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.630590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.630615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.815 qpair failed and we were unable to recover it. 00:28:02.815 [2024-11-28 19:16:23.630713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.630808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.630833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.815 qpair failed and we were unable to recover it. 00:28:02.815 [2024-11-28 19:16:23.630919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.631003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.631028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.815 qpair failed and we were unable to recover it. 00:28:02.815 [2024-11-28 19:16:23.631171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.631276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.631304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.815 qpair failed and we were unable to recover it. 00:28:02.815 [2024-11-28 19:16:23.631418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.631506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.631531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.815 qpair failed and we were unable to recover it. 00:28:02.815 [2024-11-28 19:16:23.631631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.631725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.631750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.815 qpair failed and we were unable to recover it. 00:28:02.815 [2024-11-28 19:16:23.631836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.631946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.631970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.815 qpair failed and we were unable to recover it. 00:28:02.815 [2024-11-28 19:16:23.632082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.632229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.632254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.815 qpair failed and we were unable to recover it. 00:28:02.815 [2024-11-28 19:16:23.632337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.632447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.632474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.815 qpair failed and we were unable to recover it. 00:28:02.815 [2024-11-28 19:16:23.632570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.632647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.632670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.815 qpair failed and we were unable to recover it. 00:28:02.815 [2024-11-28 19:16:23.632840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.632925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.632949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.815 qpair failed and we were unable to recover it. 00:28:02.815 [2024-11-28 19:16:23.633034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.633118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.633142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.815 qpair failed and we were unable to recover it. 00:28:02.815 [2024-11-28 19:16:23.633280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.633354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.633378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.815 qpair failed and we were unable to recover it. 00:28:02.815 [2024-11-28 19:16:23.633474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.633560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.633585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.815 qpair failed and we were unable to recover it. 00:28:02.815 [2024-11-28 19:16:23.633669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.633807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.633832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.815 qpair failed and we were unable to recover it. 00:28:02.815 [2024-11-28 19:16:23.633929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.634041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.634065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.815 qpair failed and we were unable to recover it. 00:28:02.815 [2024-11-28 19:16:23.634153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.634239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.634263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.815 qpair failed and we were unable to recover it. 00:28:02.815 [2024-11-28 19:16:23.634350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.634469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.634493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.815 qpair failed and we were unable to recover it. 00:28:02.815 [2024-11-28 19:16:23.634579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.634687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.634712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.815 qpair failed and we were unable to recover it. 00:28:02.815 [2024-11-28 19:16:23.634792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.634902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.634927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.815 qpair failed and we were unable to recover it. 00:28:02.815 [2024-11-28 19:16:23.635011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.635118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.635143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.815 qpair failed and we were unable to recover it. 00:28:02.815 [2024-11-28 19:16:23.635250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.635369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.635405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.815 qpair failed and we were unable to recover it. 00:28:02.815 [2024-11-28 19:16:23.635512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.635629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.635655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.815 qpair failed and we were unable to recover it. 00:28:02.815 [2024-11-28 19:16:23.635745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.815 [2024-11-28 19:16:23.635883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.635908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.816 qpair failed and we were unable to recover it. 00:28:02.816 [2024-11-28 19:16:23.635988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.636059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.636084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.816 qpair failed and we were unable to recover it. 00:28:02.816 [2024-11-28 19:16:23.636170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.636288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.636319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.816 qpair failed and we were unable to recover it. 00:28:02.816 [2024-11-28 19:16:23.636442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.636573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.636601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.816 qpair failed and we were unable to recover it. 00:28:02.816 [2024-11-28 19:16:23.636751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.636864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.636898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.816 qpair failed and we were unable to recover it. 00:28:02.816 [2024-11-28 19:16:23.637064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.637197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.637224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.816 qpair failed and we were unable to recover it. 00:28:02.816 [2024-11-28 19:16:23.637326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.637473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.637502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.816 qpair failed and we were unable to recover it. 00:28:02.816 [2024-11-28 19:16:23.637600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.637736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.637772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.816 qpair failed and we were unable to recover it. 00:28:02.816 [2024-11-28 19:16:23.637871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.637967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.637998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.816 qpair failed and we were unable to recover it. 00:28:02.816 [2024-11-28 19:16:23.638099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.638207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.638238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.816 qpair failed and we were unable to recover it. 00:28:02.816 [2024-11-28 19:16:23.638334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.638432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.638464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.816 qpair failed and we were unable to recover it. 00:28:02.816 [2024-11-28 19:16:23.638587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.638731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.638765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.816 qpair failed and we were unable to recover it. 00:28:02.816 [2024-11-28 19:16:23.638920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.639028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.639062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.816 qpair failed and we were unable to recover it. 00:28:02.816 [2024-11-28 19:16:23.639162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.639287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.639318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.816 qpair failed and we were unable to recover it. 00:28:02.816 [2024-11-28 19:16:23.639448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.639567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.639593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.816 qpair failed and we were unable to recover it. 00:28:02.816 [2024-11-28 19:16:23.639692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.639811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.639837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.816 qpair failed and we were unable to recover it. 00:28:02.816 [2024-11-28 19:16:23.639964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.640135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.640162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.816 qpair failed and we were unable to recover it. 00:28:02.816 [2024-11-28 19:16:23.640315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.640436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.640469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.816 qpair failed and we were unable to recover it. 00:28:02.816 [2024-11-28 19:16:23.640608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.640732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.640759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.816 qpair failed and we were unable to recover it. 00:28:02.816 [2024-11-28 19:16:23.640875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.640979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.641013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.816 qpair failed and we were unable to recover it. 00:28:02.816 [2024-11-28 19:16:23.641103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.641215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.641248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.816 qpair failed and we were unable to recover it. 00:28:02.816 [2024-11-28 19:16:23.641387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.641513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.641543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.816 qpair failed and we were unable to recover it. 00:28:02.816 [2024-11-28 19:16:23.641671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.641805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.641845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.816 qpair failed and we were unable to recover it. 00:28:02.816 [2024-11-28 19:16:23.641954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.642103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.642132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.816 qpair failed and we were unable to recover it. 00:28:02.816 [2024-11-28 19:16:23.642255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.642345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.642375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.816 qpair failed and we were unable to recover it. 00:28:02.816 [2024-11-28 19:16:23.642508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.642608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.642639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.816 qpair failed and we were unable to recover it. 00:28:02.816 [2024-11-28 19:16:23.642742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.642837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.642868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.816 qpair failed and we were unable to recover it. 00:28:02.816 [2024-11-28 19:16:23.642993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.643127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.643159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.816 qpair failed and we were unable to recover it. 00:28:02.816 [2024-11-28 19:16:23.643249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.643362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.816 [2024-11-28 19:16:23.643399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.816 qpair failed and we were unable to recover it. 00:28:02.817 [2024-11-28 19:16:23.643525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.643649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.643676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.817 qpair failed and we were unable to recover it. 00:28:02.817 [2024-11-28 19:16:23.643816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.643960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.643995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.817 qpair failed and we were unable to recover it. 00:28:02.817 [2024-11-28 19:16:23.644137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.644229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.644260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.817 qpair failed and we were unable to recover it. 00:28:02.817 [2024-11-28 19:16:23.644385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.644514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.644543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.817 qpair failed and we were unable to recover it. 00:28:02.817 [2024-11-28 19:16:23.644719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.644816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.644847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.817 qpair failed and we were unable to recover it. 00:28:02.817 [2024-11-28 19:16:23.644987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.645097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.645135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.817 qpair failed and we were unable to recover it. 00:28:02.817 [2024-11-28 19:16:23.645256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.645345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.645387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.817 qpair failed and we were unable to recover it. 00:28:02.817 [2024-11-28 19:16:23.645494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.645614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.645646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.817 qpair failed and we were unable to recover it. 00:28:02.817 [2024-11-28 19:16:23.645805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.645909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.645940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.817 qpair failed and we were unable to recover it. 00:28:02.817 [2024-11-28 19:16:23.646034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.646149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.646180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.817 qpair failed and we were unable to recover it. 00:28:02.817 [2024-11-28 19:16:23.646283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.646413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.646443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.817 qpair failed and we were unable to recover it. 00:28:02.817 [2024-11-28 19:16:23.646568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.646692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.646722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.817 qpair failed and we were unable to recover it. 00:28:02.817 [2024-11-28 19:16:23.646852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.646948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.646977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.817 qpair failed and we were unable to recover it. 00:28:02.817 [2024-11-28 19:16:23.647081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.647195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.647221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.817 qpair failed and we were unable to recover it. 00:28:02.817 [2024-11-28 19:16:23.647418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.647534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.647563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.817 qpair failed and we were unable to recover it. 00:28:02.817 [2024-11-28 19:16:23.647692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.647795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.647841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.817 qpair failed and we were unable to recover it. 00:28:02.817 [2024-11-28 19:16:23.647966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.648086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.648116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.817 qpair failed and we were unable to recover it. 00:28:02.817 [2024-11-28 19:16:23.648207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.648300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.648332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.817 qpair failed and we were unable to recover it. 00:28:02.817 [2024-11-28 19:16:23.648470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.648607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.648646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.817 qpair failed and we were unable to recover it. 00:28:02.817 [2024-11-28 19:16:23.648798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.648917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.648943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.817 qpair failed and we were unable to recover it. 00:28:02.817 [2024-11-28 19:16:23.649076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.649163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.649192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.817 qpair failed and we were unable to recover it. 00:28:02.817 [2024-11-28 19:16:23.649298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.649424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.649455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.817 qpair failed and we were unable to recover it. 00:28:02.817 [2024-11-28 19:16:23.649579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.649685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.649713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.817 qpair failed and we were unable to recover it. 00:28:02.817 [2024-11-28 19:16:23.649843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.649956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.649985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.817 qpair failed and we were unable to recover it. 00:28:02.817 [2024-11-28 19:16:23.650115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.650255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.650285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.817 qpair failed and we were unable to recover it. 00:28:02.817 [2024-11-28 19:16:23.650439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.650598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.650625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.817 qpair failed and we were unable to recover it. 00:28:02.817 [2024-11-28 19:16:23.650749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.650844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.650871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.817 qpair failed and we were unable to recover it. 00:28:02.817 [2024-11-28 19:16:23.651025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.651172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.651203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.817 qpair failed and we were unable to recover it. 00:28:02.817 [2024-11-28 19:16:23.651329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.817 [2024-11-28 19:16:23.651429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.651461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.818 qpair failed and we were unable to recover it. 00:28:02.818 [2024-11-28 19:16:23.651555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.651640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.651666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.818 qpair failed and we were unable to recover it. 00:28:02.818 [2024-11-28 19:16:23.651802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.651897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.651933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.818 qpair failed and we were unable to recover it. 00:28:02.818 [2024-11-28 19:16:23.652030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.652117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.652144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.818 qpair failed and we were unable to recover it. 00:28:02.818 [2024-11-28 19:16:23.652272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.652367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.652414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.818 qpair failed and we were unable to recover it. 00:28:02.818 [2024-11-28 19:16:23.652539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.652625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.652655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.818 qpair failed and we were unable to recover it. 00:28:02.818 [2024-11-28 19:16:23.652785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.652886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.652918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.818 qpair failed and we were unable to recover it. 00:28:02.818 [2024-11-28 19:16:23.653039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.653157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.653188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.818 qpair failed and we were unable to recover it. 00:28:02.818 [2024-11-28 19:16:23.653291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.653430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.653461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.818 qpair failed and we were unable to recover it. 00:28:02.818 [2024-11-28 19:16:23.653550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.653633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.653660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.818 qpair failed and we were unable to recover it. 00:28:02.818 [2024-11-28 19:16:23.653769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.653913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.653942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.818 qpair failed and we were unable to recover it. 00:28:02.818 [2024-11-28 19:16:23.654054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.654232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.654259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.818 qpair failed and we were unable to recover it. 00:28:02.818 [2024-11-28 19:16:23.654385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.654500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.654528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.818 qpair failed and we were unable to recover it. 00:28:02.818 [2024-11-28 19:16:23.654654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.654784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.654815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.818 qpair failed and we were unable to recover it. 00:28:02.818 [2024-11-28 19:16:23.654953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.655080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.655122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.818 qpair failed and we were unable to recover it. 00:28:02.818 [2024-11-28 19:16:23.655228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.655326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.655358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.818 qpair failed and we were unable to recover it. 00:28:02.818 [2024-11-28 19:16:23.655512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.655603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.655633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.818 qpair failed and we were unable to recover it. 00:28:02.818 [2024-11-28 19:16:23.655791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.655911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.655940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.818 qpair failed and we were unable to recover it. 00:28:02.818 [2024-11-28 19:16:23.656116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.656213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.656248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.818 qpair failed and we were unable to recover it. 00:28:02.818 [2024-11-28 19:16:23.656406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.656510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.656541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.818 qpair failed and we were unable to recover it. 00:28:02.818 [2024-11-28 19:16:23.656633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.656730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.656761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.818 qpair failed and we were unable to recover it. 00:28:02.818 [2024-11-28 19:16:23.656919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.657040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.657067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.818 qpair failed and we were unable to recover it. 00:28:02.818 [2024-11-28 19:16:23.657197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.657307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.657339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.818 qpair failed and we were unable to recover it. 00:28:02.818 [2024-11-28 19:16:23.657480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.657578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.657607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.818 qpair failed and we were unable to recover it. 00:28:02.818 [2024-11-28 19:16:23.657738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.657881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.657911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.818 qpair failed and we were unable to recover it. 00:28:02.818 [2024-11-28 19:16:23.658043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.658188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.658231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.818 qpair failed and we were unable to recover it. 00:28:02.818 [2024-11-28 19:16:23.658369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.658474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.658502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.818 qpair failed and we were unable to recover it. 00:28:02.818 [2024-11-28 19:16:23.658650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.658748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.658781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.818 qpair failed and we were unable to recover it. 00:28:02.818 [2024-11-28 19:16:23.658925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.659013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.818 [2024-11-28 19:16:23.659044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.818 qpair failed and we were unable to recover it. 00:28:02.818 [2024-11-28 19:16:23.659202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.659337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.659371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.819 qpair failed and we were unable to recover it. 00:28:02.819 [2024-11-28 19:16:23.659477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.659616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.659645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.819 qpair failed and we were unable to recover it. 00:28:02.819 [2024-11-28 19:16:23.659748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.659866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.659895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.819 qpair failed and we were unable to recover it. 00:28:02.819 [2024-11-28 19:16:23.660020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.660106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.660137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.819 qpair failed and we were unable to recover it. 00:28:02.819 [2024-11-28 19:16:23.660260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.660342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.660370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.819 qpair failed and we were unable to recover it. 00:28:02.819 [2024-11-28 19:16:23.660480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.660589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.660624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.819 qpair failed and we were unable to recover it. 00:28:02.819 [2024-11-28 19:16:23.660755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.660877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.660906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.819 qpair failed and we were unable to recover it. 00:28:02.819 [2024-11-28 19:16:23.661011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.661128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.661159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.819 qpair failed and we were unable to recover it. 00:28:02.819 [2024-11-28 19:16:23.661285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.661430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.661464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.819 qpair failed and we were unable to recover it. 00:28:02.819 [2024-11-28 19:16:23.661565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.661712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.661738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.819 qpair failed and we were unable to recover it. 00:28:02.819 [2024-11-28 19:16:23.661878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.662025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.662053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.819 qpair failed and we were unable to recover it. 00:28:02.819 [2024-11-28 19:16:23.662156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.662244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.662270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.819 qpair failed and we were unable to recover it. 00:28:02.819 [2024-11-28 19:16:23.662416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.662547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.662593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.819 qpair failed and we were unable to recover it. 00:28:02.819 [2024-11-28 19:16:23.662726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.662829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.662858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.819 qpair failed and we were unable to recover it. 00:28:02.819 [2024-11-28 19:16:23.662957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.663068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.663098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.819 qpair failed and we were unable to recover it. 00:28:02.819 [2024-11-28 19:16:23.663202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.663319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.663349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.819 qpair failed and we were unable to recover it. 00:28:02.819 [2024-11-28 19:16:23.663499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.663585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.663615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.819 qpair failed and we were unable to recover it. 00:28:02.819 [2024-11-28 19:16:23.663731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.663872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.663900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.819 qpair failed and we were unable to recover it. 00:28:02.819 [2024-11-28 19:16:23.664002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.664125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.664151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.819 qpair failed and we were unable to recover it. 00:28:02.819 [2024-11-28 19:16:23.664243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.664381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.664423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.819 qpair failed and we were unable to recover it. 00:28:02.819 [2024-11-28 19:16:23.664522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.664628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.664661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.819 qpair failed and we were unable to recover it. 00:28:02.819 [2024-11-28 19:16:23.664786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.664931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.664968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.819 qpair failed and we were unable to recover it. 00:28:02.819 [2024-11-28 19:16:23.665075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.665211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.665248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.819 qpair failed and we were unable to recover it. 00:28:02.819 [2024-11-28 19:16:23.665440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.665557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.665590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.819 qpair failed and we were unable to recover it. 00:28:02.819 [2024-11-28 19:16:23.665732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.665845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.819 [2024-11-28 19:16:23.665871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.819 qpair failed and we were unable to recover it. 00:28:02.819 [2024-11-28 19:16:23.665985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.666084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.666110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.820 qpair failed and we were unable to recover it. 00:28:02.820 [2024-11-28 19:16:23.666221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.666307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.666332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.820 qpair failed and we were unable to recover it. 00:28:02.820 [2024-11-28 19:16:23.666455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.666552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.666579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.820 qpair failed and we were unable to recover it. 00:28:02.820 [2024-11-28 19:16:23.666703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.666784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.666809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.820 qpair failed and we were unable to recover it. 00:28:02.820 [2024-11-28 19:16:23.666896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.666976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.667002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.820 qpair failed and we were unable to recover it. 00:28:02.820 [2024-11-28 19:16:23.667142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.667225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.667250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.820 qpair failed and we were unable to recover it. 00:28:02.820 [2024-11-28 19:16:23.667336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.667436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.667461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.820 qpair failed and we were unable to recover it. 00:28:02.820 [2024-11-28 19:16:23.667547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.667664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.667699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.820 qpair failed and we were unable to recover it. 00:28:02.820 [2024-11-28 19:16:23.667820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.667963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.667990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.820 qpair failed and we were unable to recover it. 00:28:02.820 [2024-11-28 19:16:23.668120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.668225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.668256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.820 qpair failed and we were unable to recover it. 00:28:02.820 [2024-11-28 19:16:23.668344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.668442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.668468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.820 qpair failed and we were unable to recover it. 00:28:02.820 [2024-11-28 19:16:23.668555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.668628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.668654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.820 qpair failed and we were unable to recover it. 00:28:02.820 [2024-11-28 19:16:23.668747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.668869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.668895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.820 qpair failed and we were unable to recover it. 00:28:02.820 [2024-11-28 19:16:23.669011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.669089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.669114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.820 qpair failed and we were unable to recover it. 00:28:02.820 [2024-11-28 19:16:23.669199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.669296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.669322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.820 qpair failed and we were unable to recover it. 00:28:02.820 [2024-11-28 19:16:23.669436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.669520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.669546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.820 qpair failed and we were unable to recover it. 00:28:02.820 [2024-11-28 19:16:23.669625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.669722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.669747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.820 qpair failed and we were unable to recover it. 00:28:02.820 [2024-11-28 19:16:23.669842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.669954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.669980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.820 qpair failed and we were unable to recover it. 00:28:02.820 [2024-11-28 19:16:23.670077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.670202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.670229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.820 qpair failed and we were unable to recover it. 00:28:02.820 [2024-11-28 19:16:23.670343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.670475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.670501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.820 qpair failed and we were unable to recover it. 00:28:02.820 [2024-11-28 19:16:23.670616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.670735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.670762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.820 qpair failed and we were unable to recover it. 00:28:02.820 [2024-11-28 19:16:23.670894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.670974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.671000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.820 qpair failed and we were unable to recover it. 00:28:02.820 [2024-11-28 19:16:23.671115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.671199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.671226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.820 qpair failed and we were unable to recover it. 00:28:02.820 [2024-11-28 19:16:23.671308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.671417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.671443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.820 qpair failed and we were unable to recover it. 00:28:02.820 [2024-11-28 19:16:23.671559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.671676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.671701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.820 qpair failed and we were unable to recover it. 00:28:02.820 [2024-11-28 19:16:23.671793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.671889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.671916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.820 qpair failed and we were unable to recover it. 00:28:02.820 [2024-11-28 19:16:23.672013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.672151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.672177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.820 qpair failed and we were unable to recover it. 00:28:02.820 [2024-11-28 19:16:23.672272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.672359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.672384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.820 qpair failed and we were unable to recover it. 00:28:02.820 [2024-11-28 19:16:23.672481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.672577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.820 [2024-11-28 19:16:23.672602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.820 qpair failed and we were unable to recover it. 00:28:02.821 [2024-11-28 19:16:23.672715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.672832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.672857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.821 qpair failed and we were unable to recover it. 00:28:02.821 [2024-11-28 19:16:23.672939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.673044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.673069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.821 qpair failed and we were unable to recover it. 00:28:02.821 [2024-11-28 19:16:23.673183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.673268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.673294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.821 qpair failed and we were unable to recover it. 00:28:02.821 [2024-11-28 19:16:23.673389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.673518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.673545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.821 qpair failed and we were unable to recover it. 00:28:02.821 [2024-11-28 19:16:23.673665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.673789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.673815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.821 qpair failed and we were unable to recover it. 00:28:02.821 [2024-11-28 19:16:23.673913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.674010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.674036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.821 qpair failed and we were unable to recover it. 00:28:02.821 [2024-11-28 19:16:23.674148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.674288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.674312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.821 qpair failed and we were unable to recover it. 00:28:02.821 [2024-11-28 19:16:23.674418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.674517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.674543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.821 qpair failed and we were unable to recover it. 00:28:02.821 [2024-11-28 19:16:23.674624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.674747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.674773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.821 qpair failed and we were unable to recover it. 00:28:02.821 [2024-11-28 19:16:23.674886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.675029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.675054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.821 qpair failed and we were unable to recover it. 00:28:02.821 [2024-11-28 19:16:23.675142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.675222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.675247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.821 qpair failed and we were unable to recover it. 00:28:02.821 [2024-11-28 19:16:23.675329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.675451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.675477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.821 qpair failed and we were unable to recover it. 00:28:02.821 [2024-11-28 19:16:23.675590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.675697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.675722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.821 qpair failed and we were unable to recover it. 00:28:02.821 [2024-11-28 19:16:23.675806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.675935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.675969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.821 qpair failed and we were unable to recover it. 00:28:02.821 [2024-11-28 19:16:23.676061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.676172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.676198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.821 qpair failed and we were unable to recover it. 00:28:02.821 [2024-11-28 19:16:23.676285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.676408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.676436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.821 qpair failed and we were unable to recover it. 00:28:02.821 [2024-11-28 19:16:23.676522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.676604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.676629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.821 qpair failed and we were unable to recover it. 00:28:02.821 [2024-11-28 19:16:23.676721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.676802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.676828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.821 qpair failed and we were unable to recover it. 00:28:02.821 [2024-11-28 19:16:23.676936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.677037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.677062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.821 qpair failed and we were unable to recover it. 00:28:02.821 [2024-11-28 19:16:23.677184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.677295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.677320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.821 qpair failed and we were unable to recover it. 00:28:02.821 [2024-11-28 19:16:23.677417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.677508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.677534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.821 qpair failed and we were unable to recover it. 00:28:02.821 [2024-11-28 19:16:23.677652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.677746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.677773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.821 qpair failed and we were unable to recover it. 00:28:02.821 [2024-11-28 19:16:23.677852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.677965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.677991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.821 qpair failed and we were unable to recover it. 00:28:02.821 [2024-11-28 19:16:23.678072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.678161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.678191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.821 qpair failed and we were unable to recover it. 00:28:02.821 [2024-11-28 19:16:23.678307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.678415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.678441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.821 qpair failed and we were unable to recover it. 00:28:02.821 [2024-11-28 19:16:23.678527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.678620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.678646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.821 qpair failed and we were unable to recover it. 00:28:02.821 [2024-11-28 19:16:23.678733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.678816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.678843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.821 qpair failed and we were unable to recover it. 00:28:02.821 [2024-11-28 19:16:23.678962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.679045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.679072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.821 qpair failed and we were unable to recover it. 00:28:02.821 [2024-11-28 19:16:23.679213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.679329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.821 [2024-11-28 19:16:23.679354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.822 qpair failed and we were unable to recover it. 00:28:02.822 [2024-11-28 19:16:23.679506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.679598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.679623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.822 qpair failed and we were unable to recover it. 00:28:02.822 [2024-11-28 19:16:23.679700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.679792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.679818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.822 qpair failed and we were unable to recover it. 00:28:02.822 [2024-11-28 19:16:23.679908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.680048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.680074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.822 qpair failed and we were unable to recover it. 00:28:02.822 [2024-11-28 19:16:23.680186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.680271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.680296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.822 qpair failed and we were unable to recover it. 00:28:02.822 [2024-11-28 19:16:23.680419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.680504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.680535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.822 qpair failed and we were unable to recover it. 00:28:02.822 [2024-11-28 19:16:23.680652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.680765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.680790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.822 qpair failed and we were unable to recover it. 00:28:02.822 [2024-11-28 19:16:23.680874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.680991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.681016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.822 qpair failed and we were unable to recover it. 00:28:02.822 [2024-11-28 19:16:23.681109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.681192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.681217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.822 qpair failed and we were unable to recover it. 00:28:02.822 [2024-11-28 19:16:23.681303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.681432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.681460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.822 qpair failed and we were unable to recover it. 00:28:02.822 [2024-11-28 19:16:23.681541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.681626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.681651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.822 qpair failed and we were unable to recover it. 00:28:02.822 [2024-11-28 19:16:23.681762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.681851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.681878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.822 qpair failed and we were unable to recover it. 00:28:02.822 [2024-11-28 19:16:23.682019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.682135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.682160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.822 qpair failed and we were unable to recover it. 00:28:02.822 [2024-11-28 19:16:23.682274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.682387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.682436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.822 qpair failed and we were unable to recover it. 00:28:02.822 [2024-11-28 19:16:23.682529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.682616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.682643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.822 qpair failed and we were unable to recover it. 00:28:02.822 [2024-11-28 19:16:23.682734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.682840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.682869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.822 qpair failed and we were unable to recover it. 00:28:02.822 [2024-11-28 19:16:23.682997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.683114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.683148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.822 qpair failed and we were unable to recover it. 00:28:02.822 [2024-11-28 19:16:23.683241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.683321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.683346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.822 qpair failed and we were unable to recover it. 00:28:02.822 [2024-11-28 19:16:23.683441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.683521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.683547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.822 qpair failed and we were unable to recover it. 00:28:02.822 [2024-11-28 19:16:23.683667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.683743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.683767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.822 qpair failed and we were unable to recover it. 00:28:02.822 [2024-11-28 19:16:23.683846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.683957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.683982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.822 qpair failed and we were unable to recover it. 00:28:02.822 [2024-11-28 19:16:23.684118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.684227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.684251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.822 qpair failed and we were unable to recover it. 00:28:02.822 [2024-11-28 19:16:23.684377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.684468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.684494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.822 qpair failed and we were unable to recover it. 00:28:02.822 [2024-11-28 19:16:23.684620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.684735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.684761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.822 qpair failed and we were unable to recover it. 00:28:02.822 [2024-11-28 19:16:23.684872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.684984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.685010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.822 qpair failed and we were unable to recover it. 00:28:02.822 [2024-11-28 19:16:23.685136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.685242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.685268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.822 qpair failed and we were unable to recover it. 00:28:02.822 [2024-11-28 19:16:23.685390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.685488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.685514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.822 qpair failed and we were unable to recover it. 00:28:02.822 [2024-11-28 19:16:23.685594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.685787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.685813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.822 qpair failed and we were unable to recover it. 00:28:02.822 [2024-11-28 19:16:23.685917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.686040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.686065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.822 qpair failed and we were unable to recover it. 00:28:02.822 [2024-11-28 19:16:23.686151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.822 [2024-11-28 19:16:23.686232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.686258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.823 qpair failed and we were unable to recover it. 00:28:02.823 [2024-11-28 19:16:23.686368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.686515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.686542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.823 qpair failed and we were unable to recover it. 00:28:02.823 [2024-11-28 19:16:23.686623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.686759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.686789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.823 qpair failed and we were unable to recover it. 00:28:02.823 [2024-11-28 19:16:23.686909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.687003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.687038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.823 qpair failed and we were unable to recover it. 00:28:02.823 [2024-11-28 19:16:23.687137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.687282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.687309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.823 qpair failed and we were unable to recover it. 00:28:02.823 [2024-11-28 19:16:23.687413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.687501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.687531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.823 qpair failed and we were unable to recover it. 00:28:02.823 [2024-11-28 19:16:23.687654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.687782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.687815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.823 qpair failed and we were unable to recover it. 00:28:02.823 [2024-11-28 19:16:23.687916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.688008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.688038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.823 qpair failed and we were unable to recover it. 00:28:02.823 [2024-11-28 19:16:23.688163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.688281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.688322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.823 qpair failed and we were unable to recover it. 00:28:02.823 [2024-11-28 19:16:23.688434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.688523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.688549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.823 qpair failed and we were unable to recover it. 00:28:02.823 [2024-11-28 19:16:23.688644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.688776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.688805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.823 qpair failed and we were unable to recover it. 00:28:02.823 [2024-11-28 19:16:23.688934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.689088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.689115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.823 qpair failed and we were unable to recover it. 00:28:02.823 [2024-11-28 19:16:23.689247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.689331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.689364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:02.823 qpair failed and we were unable to recover it. 00:28:02.823 [2024-11-28 19:16:23.689523] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1d92600 is same with the state(5) to be set 00:28:02.823 Read completed with error (sct=0, sc=8) 00:28:02.823 starting I/O failed 00:28:02.823 Read completed with error (sct=0, sc=8) 00:28:02.823 starting I/O failed 00:28:02.823 Read completed with error (sct=0, sc=8) 00:28:02.823 starting I/O failed 00:28:02.823 Read completed with error (sct=0, sc=8) 00:28:02.823 starting I/O failed 00:28:02.823 Read completed with error (sct=0, sc=8) 00:28:02.823 starting I/O failed 00:28:02.823 Read completed with error (sct=0, sc=8) 00:28:02.823 starting I/O failed 00:28:02.823 Read completed with error (sct=0, sc=8) 00:28:02.823 starting I/O failed 00:28:02.823 Read completed with error (sct=0, sc=8) 00:28:02.823 starting I/O failed 00:28:02.823 Read completed with error (sct=0, sc=8) 00:28:02.823 starting I/O failed 00:28:02.823 Read completed with error (sct=0, sc=8) 00:28:02.823 starting I/O failed 00:28:02.823 Read completed with error (sct=0, sc=8) 00:28:02.823 starting I/O failed 00:28:02.823 Read completed with error (sct=0, sc=8) 00:28:02.823 starting I/O failed 00:28:02.823 Write completed with error (sct=0, sc=8) 00:28:02.823 starting I/O failed 00:28:02.823 Write completed with error (sct=0, sc=8) 00:28:02.823 starting I/O failed 00:28:02.823 Write completed with error (sct=0, sc=8) 00:28:02.823 starting I/O failed 00:28:02.823 Read completed with error (sct=0, sc=8) 00:28:02.823 starting I/O failed 00:28:02.823 Write completed with error (sct=0, sc=8) 00:28:02.823 starting I/O failed 00:28:02.823 Read completed with error (sct=0, sc=8) 00:28:02.823 starting I/O failed 00:28:02.823 Read completed with error (sct=0, sc=8) 00:28:02.823 starting I/O failed 00:28:02.823 Read completed with error (sct=0, sc=8) 00:28:02.823 starting I/O failed 00:28:02.823 Write completed with error (sct=0, sc=8) 00:28:02.823 starting I/O failed 00:28:02.823 Write completed with error (sct=0, sc=8) 00:28:02.823 starting I/O failed 00:28:02.823 Write completed with error (sct=0, sc=8) 00:28:02.823 starting I/O failed 00:28:02.823 Write completed with error (sct=0, sc=8) 00:28:02.823 starting I/O failed 00:28:02.823 Read completed with error (sct=0, sc=8) 00:28:02.823 starting I/O failed 00:28:02.823 Read completed with error (sct=0, sc=8) 00:28:02.823 starting I/O failed 00:28:02.823 Write completed with error (sct=0, sc=8) 00:28:02.823 starting I/O failed 00:28:02.823 Read completed with error (sct=0, sc=8) 00:28:02.823 starting I/O failed 00:28:02.823 Read completed with error (sct=0, sc=8) 00:28:02.823 starting I/O failed 00:28:02.823 Read completed with error (sct=0, sc=8) 00:28:02.823 starting I/O failed 00:28:02.823 Read completed with error (sct=0, sc=8) 00:28:02.823 starting I/O failed 00:28:02.823 Read completed with error (sct=0, sc=8) 00:28:02.823 starting I/O failed 00:28:02.823 [2024-11-28 19:16:23.689920] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:28:02.823 [2024-11-28 19:16:23.690075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.690186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.690213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.823 qpair failed and we were unable to recover it. 00:28:02.823 [2024-11-28 19:16:23.690305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.690431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.690457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.823 qpair failed and we were unable to recover it. 00:28:02.823 [2024-11-28 19:16:23.690548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.690629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.690655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.823 qpair failed and we were unable to recover it. 00:28:02.823 [2024-11-28 19:16:23.690769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.690894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.690918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.823 qpair failed and we were unable to recover it. 00:28:02.823 [2024-11-28 19:16:23.691026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.691105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.691129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.823 qpair failed and we were unable to recover it. 00:28:02.823 [2024-11-28 19:16:23.691234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.691315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.691340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.823 qpair failed and we were unable to recover it. 00:28:02.823 [2024-11-28 19:16:23.691457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.691551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.691576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.823 qpair failed and we were unable to recover it. 00:28:02.823 [2024-11-28 19:16:23.691660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.691743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.823 [2024-11-28 19:16:23.691768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.823 qpair failed and we were unable to recover it. 00:28:02.824 [2024-11-28 19:16:23.691873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.691984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.692013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.824 qpair failed and we were unable to recover it. 00:28:02.824 [2024-11-28 19:16:23.692104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.692216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.692240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.824 qpair failed and we were unable to recover it. 00:28:02.824 [2024-11-28 19:16:23.692320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.692417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.692442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.824 qpair failed and we were unable to recover it. 00:28:02.824 [2024-11-28 19:16:23.692526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.692611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.692636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.824 qpair failed and we were unable to recover it. 00:28:02.824 [2024-11-28 19:16:23.692745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.692887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.692914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.824 qpair failed and we were unable to recover it. 00:28:02.824 [2024-11-28 19:16:23.693060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.693183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.693207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.824 qpair failed and we were unable to recover it. 00:28:02.824 [2024-11-28 19:16:23.693294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.693409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.693436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.824 qpair failed and we were unable to recover it. 00:28:02.824 [2024-11-28 19:16:23.693554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.693641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.693666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.824 qpair failed and we were unable to recover it. 00:28:02.824 [2024-11-28 19:16:23.693755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.693838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.693862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.824 qpair failed and we were unable to recover it. 00:28:02.824 [2024-11-28 19:16:23.693969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.694071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.694097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.824 qpair failed and we were unable to recover it. 00:28:02.824 [2024-11-28 19:16:23.694210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.694296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.694341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.824 qpair failed and we were unable to recover it. 00:28:02.824 [2024-11-28 19:16:23.694467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.694563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.694587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.824 qpair failed and we were unable to recover it. 00:28:02.824 [2024-11-28 19:16:23.694672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.694764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.694788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.824 qpair failed and we were unable to recover it. 00:28:02.824 [2024-11-28 19:16:23.694904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.695052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.695076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.824 qpair failed and we were unable to recover it. 00:28:02.824 [2024-11-28 19:16:23.695219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.695304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.695329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.824 qpair failed and we were unable to recover it. 00:28:02.824 [2024-11-28 19:16:23.695431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.695509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.695533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.824 qpair failed and we were unable to recover it. 00:28:02.824 [2024-11-28 19:16:23.695642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.695756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.695779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.824 qpair failed and we were unable to recover it. 00:28:02.824 [2024-11-28 19:16:23.695887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.696005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.696030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.824 qpair failed and we were unable to recover it. 00:28:02.824 [2024-11-28 19:16:23.696109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.696222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.696248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.824 qpair failed and we were unable to recover it. 00:28:02.824 [2024-11-28 19:16:23.696360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.696471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.696497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.824 qpair failed and we were unable to recover it. 00:28:02.824 [2024-11-28 19:16:23.696579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.696661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.696685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.824 qpair failed and we were unable to recover it. 00:28:02.824 [2024-11-28 19:16:23.696784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.696892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.696916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.824 qpair failed and we were unable to recover it. 00:28:02.824 [2024-11-28 19:16:23.697032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.697149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.697173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.824 qpair failed and we were unable to recover it. 00:28:02.824 [2024-11-28 19:16:23.697262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.697369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.697400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.824 qpair failed and we were unable to recover it. 00:28:02.824 [2024-11-28 19:16:23.697485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.697560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.824 [2024-11-28 19:16:23.697584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.824 qpair failed and we were unable to recover it. 00:28:02.824 [2024-11-28 19:16:23.697664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.697776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.697801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.825 qpair failed and we were unable to recover it. 00:28:02.825 [2024-11-28 19:16:23.697929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.698032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.698057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.825 qpair failed and we were unable to recover it. 00:28:02.825 [2024-11-28 19:16:23.698176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.698287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.698312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.825 qpair failed and we were unable to recover it. 00:28:02.825 [2024-11-28 19:16:23.698432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.698541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.698567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.825 qpair failed and we were unable to recover it. 00:28:02.825 [2024-11-28 19:16:23.698654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.698768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.698793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.825 qpair failed and we were unable to recover it. 00:28:02.825 [2024-11-28 19:16:23.698877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.698985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.699012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.825 qpair failed and we were unable to recover it. 00:28:02.825 [2024-11-28 19:16:23.699121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.699246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.699273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.825 qpair failed and we were unable to recover it. 00:28:02.825 [2024-11-28 19:16:23.699388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.699499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.699523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.825 qpair failed and we were unable to recover it. 00:28:02.825 [2024-11-28 19:16:23.699607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.699687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.699712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.825 qpair failed and we were unable to recover it. 00:28:02.825 [2024-11-28 19:16:23.699792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.699883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.699907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.825 qpair failed and we were unable to recover it. 00:28:02.825 [2024-11-28 19:16:23.699989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.700068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.700094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.825 qpair failed and we were unable to recover it. 00:28:02.825 [2024-11-28 19:16:23.700212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.700294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.700320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.825 qpair failed and we were unable to recover it. 00:28:02.825 [2024-11-28 19:16:23.700413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.700524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.700549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.825 qpair failed and we were unable to recover it. 00:28:02.825 [2024-11-28 19:16:23.700633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.700740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.700765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.825 qpair failed and we were unable to recover it. 00:28:02.825 [2024-11-28 19:16:23.700901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.700985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.701009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.825 qpair failed and we were unable to recover it. 00:28:02.825 [2024-11-28 19:16:23.701094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.701177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.701201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.825 qpair failed and we were unable to recover it. 00:28:02.825 [2024-11-28 19:16:23.701316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.701418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.701443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.825 qpair failed and we were unable to recover it. 00:28:02.825 [2024-11-28 19:16:23.701524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.701640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.701665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.825 qpair failed and we were unable to recover it. 00:28:02.825 [2024-11-28 19:16:23.701756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.701878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.701903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.825 qpair failed and we were unable to recover it. 00:28:02.825 [2024-11-28 19:16:23.702046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.702127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.702151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.825 qpair failed and we were unable to recover it. 00:28:02.825 [2024-11-28 19:16:23.702266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.702363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.702387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.825 qpair failed and we were unable to recover it. 00:28:02.825 [2024-11-28 19:16:23.702481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.702569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.702594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.825 qpair failed and we were unable to recover it. 00:28:02.825 [2024-11-28 19:16:23.702740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.702823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.702851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.825 qpair failed and we were unable to recover it. 00:28:02.825 [2024-11-28 19:16:23.702936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.703018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.703043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.825 qpair failed and we were unable to recover it. 00:28:02.825 [2024-11-28 19:16:23.703185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.703277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.825 [2024-11-28 19:16:23.703302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.826 qpair failed and we were unable to recover it. 00:28:02.826 [2024-11-28 19:16:23.703382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.703463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.703488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.826 qpair failed and we were unable to recover it. 00:28:02.826 [2024-11-28 19:16:23.703605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.703709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.703738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.826 qpair failed and we were unable to recover it. 00:28:02.826 [2024-11-28 19:16:23.703897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.704011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.704039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.826 qpair failed and we were unable to recover it. 00:28:02.826 [2024-11-28 19:16:23.704162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.704248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.704272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.826 qpair failed and we were unable to recover it. 00:28:02.826 [2024-11-28 19:16:23.704345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.704442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.704467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.826 qpair failed and we were unable to recover it. 00:28:02.826 [2024-11-28 19:16:23.704557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.704637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.704663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.826 qpair failed and we were unable to recover it. 00:28:02.826 [2024-11-28 19:16:23.704788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.704859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.704883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.826 qpair failed and we were unable to recover it. 00:28:02.826 [2024-11-28 19:16:23.704962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.705074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.705099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.826 qpair failed and we were unable to recover it. 00:28:02.826 [2024-11-28 19:16:23.705178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.705250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.705275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.826 qpair failed and we were unable to recover it. 00:28:02.826 [2024-11-28 19:16:23.705388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.705473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.705498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.826 qpair failed and we were unable to recover it. 00:28:02.826 [2024-11-28 19:16:23.705580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.705683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.705708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.826 qpair failed and we were unable to recover it. 00:28:02.826 [2024-11-28 19:16:23.705789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.705905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.705934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.826 qpair failed and we were unable to recover it. 00:28:02.826 [2024-11-28 19:16:23.706016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.706115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.706140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.826 qpair failed and we were unable to recover it. 00:28:02.826 [2024-11-28 19:16:23.706232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.706321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.706345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.826 qpair failed and we were unable to recover it. 00:28:02.826 [2024-11-28 19:16:23.706503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.706614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.706638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.826 qpair failed and we were unable to recover it. 00:28:02.826 [2024-11-28 19:16:23.706785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.706862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.706886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.826 qpair failed and we were unable to recover it. 00:28:02.826 [2024-11-28 19:16:23.706971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.707054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.707079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.826 qpair failed and we were unable to recover it. 00:28:02.826 [2024-11-28 19:16:23.707169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.707257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.707281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.826 qpair failed and we were unable to recover it. 00:28:02.826 [2024-11-28 19:16:23.707397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.707482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.707506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.826 qpair failed and we were unable to recover it. 00:28:02.826 [2024-11-28 19:16:23.707597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.707677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.707707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.826 qpair failed and we were unable to recover it. 00:28:02.826 [2024-11-28 19:16:23.707817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.707899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.707944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.826 qpair failed and we were unable to recover it. 00:28:02.826 [2024-11-28 19:16:23.708110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.708222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.708247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.826 qpair failed and we were unable to recover it. 00:28:02.826 [2024-11-28 19:16:23.708413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.708493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.708518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.826 qpair failed and we were unable to recover it. 00:28:02.826 [2024-11-28 19:16:23.708605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.708733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.708760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.826 qpair failed and we were unable to recover it. 00:28:02.826 [2024-11-28 19:16:23.708865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.708981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.709006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.826 qpair failed and we were unable to recover it. 00:28:02.826 [2024-11-28 19:16:23.709121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.709231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.709273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.826 qpair failed and we were unable to recover it. 00:28:02.826 [2024-11-28 19:16:23.709428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.709536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.709560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.826 qpair failed and we were unable to recover it. 00:28:02.826 [2024-11-28 19:16:23.709699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.709801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.709825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.826 qpair failed and we were unable to recover it. 00:28:02.826 [2024-11-28 19:16:23.709938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.826 [2024-11-28 19:16:23.710059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.710087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.827 qpair failed and we were unable to recover it. 00:28:02.827 [2024-11-28 19:16:23.710224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.710345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.710370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.827 qpair failed and we were unable to recover it. 00:28:02.827 [2024-11-28 19:16:23.710473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.710587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.710612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.827 qpair failed and we were unable to recover it. 00:28:02.827 [2024-11-28 19:16:23.710724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.710880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.710907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.827 qpair failed and we were unable to recover it. 00:28:02.827 [2024-11-28 19:16:23.711049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.711142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.711169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.827 qpair failed and we were unable to recover it. 00:28:02.827 [2024-11-28 19:16:23.711309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.711453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.711494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.827 qpair failed and we were unable to recover it. 00:28:02.827 [2024-11-28 19:16:23.711589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.711760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.711792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.827 qpair failed and we were unable to recover it. 00:28:02.827 [2024-11-28 19:16:23.711931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.712113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.712137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.827 qpair failed and we were unable to recover it. 00:28:02.827 [2024-11-28 19:16:23.712216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.712305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.712330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.827 qpair failed and we were unable to recover it. 00:28:02.827 [2024-11-28 19:16:23.712455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.712594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.712622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.827 qpair failed and we were unable to recover it. 00:28:02.827 [2024-11-28 19:16:23.712739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.712831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.712858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.827 qpair failed and we were unable to recover it. 00:28:02.827 [2024-11-28 19:16:23.712974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.713084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.713108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.827 qpair failed and we were unable to recover it. 00:28:02.827 [2024-11-28 19:16:23.713218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.713305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.713329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.827 qpair failed and we were unable to recover it. 00:28:02.827 [2024-11-28 19:16:23.713437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.713548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.713573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.827 qpair failed and we were unable to recover it. 00:28:02.827 [2024-11-28 19:16:23.713661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.713744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.713768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.827 qpair failed and we were unable to recover it. 00:28:02.827 [2024-11-28 19:16:23.713879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.713974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.713998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.827 qpair failed and we were unable to recover it. 00:28:02.827 [2024-11-28 19:16:23.714087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.714201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.714226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.827 qpair failed and we were unable to recover it. 00:28:02.827 [2024-11-28 19:16:23.714304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.714384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.714433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.827 qpair failed and we were unable to recover it. 00:28:02.827 [2024-11-28 19:16:23.714520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.714652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.714692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.827 qpair failed and we were unable to recover it. 00:28:02.827 [2024-11-28 19:16:23.714784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.714869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.714893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.827 qpair failed and we were unable to recover it. 00:28:02.827 [2024-11-28 19:16:23.714990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.715151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.715176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.827 qpair failed and we were unable to recover it. 00:28:02.827 [2024-11-28 19:16:23.715293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.715380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.715411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.827 qpair failed and we were unable to recover it. 00:28:02.827 [2024-11-28 19:16:23.715520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.715603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.715628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.827 qpair failed and we were unable to recover it. 00:28:02.827 [2024-11-28 19:16:23.715720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.715812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.715836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.827 qpair failed and we were unable to recover it. 00:28:02.827 [2024-11-28 19:16:23.715963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.716057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.716084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.827 qpair failed and we were unable to recover it. 00:28:02.827 [2024-11-28 19:16:23.716211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.716329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.716356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.827 qpair failed and we were unable to recover it. 00:28:02.827 [2024-11-28 19:16:23.716465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.716554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.716579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.827 qpair failed and we were unable to recover it. 00:28:02.827 [2024-11-28 19:16:23.716666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.716749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.716774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.827 qpair failed and we were unable to recover it. 00:28:02.827 [2024-11-28 19:16:23.716867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.716977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.717001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.827 qpair failed and we were unable to recover it. 00:28:02.827 [2024-11-28 19:16:23.717139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.827 [2024-11-28 19:16:23.717229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.717254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.828 qpair failed and we were unable to recover it. 00:28:02.828 [2024-11-28 19:16:23.717344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.717429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.717455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.828 qpair failed and we were unable to recover it. 00:28:02.828 [2024-11-28 19:16:23.717554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.717692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.717719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.828 qpair failed and we were unable to recover it. 00:28:02.828 [2024-11-28 19:16:23.717814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.717926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.717952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.828 qpair failed and we were unable to recover it. 00:28:02.828 [2024-11-28 19:16:23.718040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.718177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.718204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.828 qpair failed and we were unable to recover it. 00:28:02.828 [2024-11-28 19:16:23.718328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.718490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.718522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.828 qpair failed and we were unable to recover it. 00:28:02.828 [2024-11-28 19:16:23.718620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.718737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.718767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.828 qpair failed and we were unable to recover it. 00:28:02.828 [2024-11-28 19:16:23.718882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.718996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.719021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.828 qpair failed and we were unable to recover it. 00:28:02.828 [2024-11-28 19:16:23.719111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.719221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.719246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.828 qpair failed and we were unable to recover it. 00:28:02.828 [2024-11-28 19:16:23.719349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.719427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.719452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.828 qpair failed and we were unable to recover it. 00:28:02.828 [2024-11-28 19:16:23.719527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.719608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.719633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.828 qpair failed and we were unable to recover it. 00:28:02.828 [2024-11-28 19:16:23.719723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.719842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.719867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.828 qpair failed and we were unable to recover it. 00:28:02.828 [2024-11-28 19:16:23.719980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.720051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.720076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.828 qpair failed and we were unable to recover it. 00:28:02.828 [2024-11-28 19:16:23.720196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.720301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.720329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.828 qpair failed and we were unable to recover it. 00:28:02.828 [2024-11-28 19:16:23.720474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.720567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.720592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.828 qpair failed and we were unable to recover it. 00:28:02.828 [2024-11-28 19:16:23.720687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.720769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.720793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.828 qpair failed and we were unable to recover it. 00:28:02.828 [2024-11-28 19:16:23.720908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.721076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.721104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.828 qpair failed and we were unable to recover it. 00:28:02.828 [2024-11-28 19:16:23.721234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.721323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.721356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.828 qpair failed and we were unable to recover it. 00:28:02.828 [2024-11-28 19:16:23.721496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.721583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.721607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.828 qpair failed and we were unable to recover it. 00:28:02.828 [2024-11-28 19:16:23.721757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.721916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.721948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.828 qpair failed and we were unable to recover it. 00:28:02.828 [2024-11-28 19:16:23.722081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.722188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.722213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.828 qpair failed and we were unable to recover it. 00:28:02.828 [2024-11-28 19:16:23.722296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.722410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.722435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.828 qpair failed and we were unable to recover it. 00:28:02.828 [2024-11-28 19:16:23.722523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.722606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.722630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.828 qpair failed and we were unable to recover it. 00:28:02.828 [2024-11-28 19:16:23.722764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.722871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.722900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.828 qpair failed and we were unable to recover it. 00:28:02.828 [2024-11-28 19:16:23.723063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.723146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.723171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.828 qpair failed and we were unable to recover it. 00:28:02.828 [2024-11-28 19:16:23.723266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.828 [2024-11-28 19:16:23.723385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.723424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.829 qpair failed and we were unable to recover it. 00:28:02.829 [2024-11-28 19:16:23.723535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.723639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.723664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.829 qpair failed and we were unable to recover it. 00:28:02.829 [2024-11-28 19:16:23.723752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.723899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.723924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.829 qpair failed and we were unable to recover it. 00:28:02.829 [2024-11-28 19:16:23.724055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.724146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.724174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.829 qpair failed and we were unable to recover it. 00:28:02.829 [2024-11-28 19:16:23.724325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.724444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.724473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.829 qpair failed and we were unable to recover it. 00:28:02.829 [2024-11-28 19:16:23.724580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.724690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.724715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.829 qpair failed and we were unable to recover it. 00:28:02.829 [2024-11-28 19:16:23.724802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.724941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.724967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.829 qpair failed and we were unable to recover it. 00:28:02.829 [2024-11-28 19:16:23.725051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.725180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.725208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.829 qpair failed and we were unable to recover it. 00:28:02.829 [2024-11-28 19:16:23.725323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.725408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.725433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.829 qpair failed and we were unable to recover it. 00:28:02.829 [2024-11-28 19:16:23.725519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.725600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.725624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.829 qpair failed and we were unable to recover it. 00:28:02.829 [2024-11-28 19:16:23.725761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.725889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.725916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.829 qpair failed and we were unable to recover it. 00:28:02.829 [2024-11-28 19:16:23.726046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.726126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.726151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.829 qpair failed and we were unable to recover it. 00:28:02.829 [2024-11-28 19:16:23.726280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.726365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.726402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.829 qpair failed and we were unable to recover it. 00:28:02.829 [2024-11-28 19:16:23.726486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.726614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.726641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.829 qpair failed and we were unable to recover it. 00:28:02.829 [2024-11-28 19:16:23.726804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.726938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.726962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.829 qpair failed and we were unable to recover it. 00:28:02.829 [2024-11-28 19:16:23.727102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.727221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.727248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.829 qpair failed and we were unable to recover it. 00:28:02.829 [2024-11-28 19:16:23.727337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.727426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.727455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.829 qpair failed and we were unable to recover it. 00:28:02.829 [2024-11-28 19:16:23.727569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.727651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.727675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.829 qpair failed and we were unable to recover it. 00:28:02.829 [2024-11-28 19:16:23.727807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.727920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.727948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.829 qpair failed and we were unable to recover it. 00:28:02.829 [2024-11-28 19:16:23.728071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.728214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.728242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.829 qpair failed and we were unable to recover it. 00:28:02.829 [2024-11-28 19:16:23.728415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.728493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.728518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.829 qpair failed and we were unable to recover it. 00:28:02.829 [2024-11-28 19:16:23.728648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.728778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.728805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.829 qpair failed and we were unable to recover it. 00:28:02.829 [2024-11-28 19:16:23.728899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.729049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.729076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.829 qpair failed and we were unable to recover it. 00:28:02.829 [2024-11-28 19:16:23.729219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.729298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.729322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.829 qpair failed and we were unable to recover it. 00:28:02.829 [2024-11-28 19:16:23.729410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.729555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.729580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.829 qpair failed and we were unable to recover it. 00:28:02.829 [2024-11-28 19:16:23.729670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.729751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.729776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.829 qpair failed and we were unable to recover it. 00:28:02.829 [2024-11-28 19:16:23.729889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.729998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.829 [2024-11-28 19:16:23.730023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.829 qpair failed and we were unable to recover it. 00:28:02.829 [2024-11-28 19:16:23.730147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.730263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.730288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.830 qpair failed and we were unable to recover it. 00:28:02.830 [2024-11-28 19:16:23.730390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.730485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.730513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.830 qpair failed and we were unable to recover it. 00:28:02.830 [2024-11-28 19:16:23.730652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.730779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.730803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.830 qpair failed and we were unable to recover it. 00:28:02.830 [2024-11-28 19:16:23.730882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.730965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.731006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.830 qpair failed and we were unable to recover it. 00:28:02.830 [2024-11-28 19:16:23.731126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.731274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.731306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.830 qpair failed and we were unable to recover it. 00:28:02.830 [2024-11-28 19:16:23.731446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.731527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.731552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.830 qpair failed and we were unable to recover it. 00:28:02.830 [2024-11-28 19:16:23.731642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.731777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.731802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.830 qpair failed and we were unable to recover it. 00:28:02.830 [2024-11-28 19:16:23.731879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.732051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.732075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.830 qpair failed and we were unable to recover it. 00:28:02.830 [2024-11-28 19:16:23.732209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.732288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.732313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.830 qpair failed and we were unable to recover it. 00:28:02.830 [2024-11-28 19:16:23.732445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.732561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.732589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.830 qpair failed and we were unable to recover it. 00:28:02.830 [2024-11-28 19:16:23.732724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.732865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.732889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.830 qpair failed and we were unable to recover it. 00:28:02.830 [2024-11-28 19:16:23.732996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.733078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.733103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.830 qpair failed and we were unable to recover it. 00:28:02.830 [2024-11-28 19:16:23.733178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.733259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.733284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.830 qpair failed and we were unable to recover it. 00:28:02.830 [2024-11-28 19:16:23.733428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.733554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.733582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.830 qpair failed and we were unable to recover it. 00:28:02.830 [2024-11-28 19:16:23.733727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.733834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.733859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.830 qpair failed and we were unable to recover it. 00:28:02.830 [2024-11-28 19:16:23.733982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.734148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.734174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.830 qpair failed and we were unable to recover it. 00:28:02.830 [2024-11-28 19:16:23.734285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.734418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.734446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.830 qpair failed and we were unable to recover it. 00:28:02.830 [2024-11-28 19:16:23.734558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.734641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.734665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.830 qpair failed and we were unable to recover it. 00:28:02.830 [2024-11-28 19:16:23.734744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.734824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.734849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.830 qpair failed and we were unable to recover it. 00:28:02.830 [2024-11-28 19:16:23.734931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.735036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.735060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.830 qpair failed and we were unable to recover it. 00:28:02.830 [2024-11-28 19:16:23.735140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.735222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.735246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.830 qpair failed and we were unable to recover it. 00:28:02.830 [2024-11-28 19:16:23.735370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.735505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.735533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.830 qpair failed and we were unable to recover it. 00:28:02.830 [2024-11-28 19:16:23.735626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.735714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.735742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.830 qpair failed and we were unable to recover it. 00:28:02.830 [2024-11-28 19:16:23.735848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.735970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.735995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.830 qpair failed and we were unable to recover it. 00:28:02.830 [2024-11-28 19:16:23.736160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.736257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.736285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.830 qpair failed and we were unable to recover it. 00:28:02.830 [2024-11-28 19:16:23.736422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.736517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.736545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.830 qpair failed and we were unable to recover it. 00:28:02.830 [2024-11-28 19:16:23.736644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.736789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.736814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.830 qpair failed and we were unable to recover it. 00:28:02.830 [2024-11-28 19:16:23.736922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.737013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.830 [2024-11-28 19:16:23.737038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.830 qpair failed and we were unable to recover it. 00:28:02.831 [2024-11-28 19:16:23.737134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.737230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.737257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.831 qpair failed and we were unable to recover it. 00:28:02.831 [2024-11-28 19:16:23.737361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.737477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.737502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.831 qpair failed and we were unable to recover it. 00:28:02.831 [2024-11-28 19:16:23.737602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.737726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.737766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.831 qpair failed and we were unable to recover it. 00:28:02.831 [2024-11-28 19:16:23.737865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.737945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.737970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.831 qpair failed and we were unable to recover it. 00:28:02.831 [2024-11-28 19:16:23.738076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.738190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.738214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.831 qpair failed and we were unable to recover it. 00:28:02.831 [2024-11-28 19:16:23.738344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.738459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.738488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.831 qpair failed and we were unable to recover it. 00:28:02.831 [2024-11-28 19:16:23.738586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.738702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.738729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.831 qpair failed and we were unable to recover it. 00:28:02.831 [2024-11-28 19:16:23.738869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.738949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.738973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.831 qpair failed and we were unable to recover it. 00:28:02.831 [2024-11-28 19:16:23.739093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.739183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.739224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.831 qpair failed and we were unable to recover it. 00:28:02.831 [2024-11-28 19:16:23.739334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.739429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.739472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.831 qpair failed and we were unable to recover it. 00:28:02.831 [2024-11-28 19:16:23.739580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.739657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.739682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.831 qpair failed and we were unable to recover it. 00:28:02.831 [2024-11-28 19:16:23.739799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.739901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.739926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.831 qpair failed and we were unable to recover it. 00:28:02.831 [2024-11-28 19:16:23.740053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.740152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.740179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.831 qpair failed and we were unable to recover it. 00:28:02.831 [2024-11-28 19:16:23.740344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.740484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.740525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.831 qpair failed and we were unable to recover it. 00:28:02.831 [2024-11-28 19:16:23.740624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.740724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.740752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.831 qpair failed and we were unable to recover it. 00:28:02.831 [2024-11-28 19:16:23.740847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.740962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.740990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.831 qpair failed and we were unable to recover it. 00:28:02.831 [2024-11-28 19:16:23.741113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.741247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.741271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.831 qpair failed and we were unable to recover it. 00:28:02.831 [2024-11-28 19:16:23.741400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.741498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.741526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.831 qpair failed and we were unable to recover it. 00:28:02.831 [2024-11-28 19:16:23.741617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.741737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.741765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.831 qpair failed and we were unable to recover it. 00:28:02.831 [2024-11-28 19:16:23.741869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.741982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.742007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.831 qpair failed and we were unable to recover it. 00:28:02.831 [2024-11-28 19:16:23.742120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.742225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.742250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.831 qpair failed and we were unable to recover it. 00:28:02.831 [2024-11-28 19:16:23.742338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.742428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.742470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.831 qpair failed and we were unable to recover it. 00:28:02.831 [2024-11-28 19:16:23.742641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.742761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.742786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.831 qpair failed and we were unable to recover it. 00:28:02.831 [2024-11-28 19:16:23.742863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.742975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.743002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.831 qpair failed and we were unable to recover it. 00:28:02.831 [2024-11-28 19:16:23.743139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.743226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.743253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.831 qpair failed and we were unable to recover it. 00:28:02.831 [2024-11-28 19:16:23.743367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.743452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.743477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.831 qpair failed and we were unable to recover it. 00:28:02.831 [2024-11-28 19:16:23.743589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.743708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.743732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.831 qpair failed and we were unable to recover it. 00:28:02.831 [2024-11-28 19:16:23.743867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.743970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.744003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.831 qpair failed and we were unable to recover it. 00:28:02.831 [2024-11-28 19:16:23.744143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.744254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.744279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.831 qpair failed and we were unable to recover it. 00:28:02.831 [2024-11-28 19:16:23.744437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.744560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.744588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.831 qpair failed and we were unable to recover it. 00:28:02.831 [2024-11-28 19:16:23.744721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.744845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.831 [2024-11-28 19:16:23.744873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.831 qpair failed and we were unable to recover it. 00:28:02.831 [2024-11-28 19:16:23.744969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.745098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.745123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.832 qpair failed and we were unable to recover it. 00:28:02.832 [2024-11-28 19:16:23.745289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.745410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.745438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.832 qpair failed and we were unable to recover it. 00:28:02.832 [2024-11-28 19:16:23.745561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.745650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.745678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.832 qpair failed and we were unable to recover it. 00:28:02.832 [2024-11-28 19:16:23.745782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.745861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.745885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.832 qpair failed and we were unable to recover it. 00:28:02.832 [2024-11-28 19:16:23.746000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.746097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.746125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.832 qpair failed and we were unable to recover it. 00:28:02.832 [2024-11-28 19:16:23.746271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.746354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.746383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.832 qpair failed and we were unable to recover it. 00:28:02.832 [2024-11-28 19:16:23.746555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.746632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.746662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.832 qpair failed and we were unable to recover it. 00:28:02.832 [2024-11-28 19:16:23.746771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.746902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.746929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.832 qpair failed and we were unable to recover it. 00:28:02.832 [2024-11-28 19:16:23.747015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.747135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.747162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.832 qpair failed and we were unable to recover it. 00:28:02.832 [2024-11-28 19:16:23.747260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.747403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.747429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.832 qpair failed and we were unable to recover it. 00:28:02.832 [2024-11-28 19:16:23.747537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.747628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.747655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.832 qpair failed and we were unable to recover it. 00:28:02.832 [2024-11-28 19:16:23.747816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.747927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.747952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.832 qpair failed and we were unable to recover it. 00:28:02.832 [2024-11-28 19:16:23.748033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.748168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.748192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.832 qpair failed and we were unable to recover it. 00:28:02.832 [2024-11-28 19:16:23.748302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.748419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.748445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.832 qpair failed and we were unable to recover it. 00:28:02.832 [2024-11-28 19:16:23.748573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.748696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.748724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.832 qpair failed and we were unable to recover it. 00:28:02.832 [2024-11-28 19:16:23.748849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.748936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.748961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.832 qpair failed and we were unable to recover it. 00:28:02.832 [2024-11-28 19:16:23.749068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.749172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.749200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.832 qpair failed and we were unable to recover it. 00:28:02.832 [2024-11-28 19:16:23.749313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.749403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.749431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.832 qpair failed and we were unable to recover it. 00:28:02.832 [2024-11-28 19:16:23.749544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.749654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.749679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.832 qpair failed and we were unable to recover it. 00:28:02.832 [2024-11-28 19:16:23.749787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.749900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.749925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.832 qpair failed and we were unable to recover it. 00:28:02.832 [2024-11-28 19:16:23.750032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.750119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.750146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.832 qpair failed and we were unable to recover it. 00:28:02.832 [2024-11-28 19:16:23.750310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.750451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.750492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.832 qpair failed and we were unable to recover it. 00:28:02.832 [2024-11-28 19:16:23.750620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.750732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.750760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.832 qpair failed and we were unable to recover it. 00:28:02.832 [2024-11-28 19:16:23.750882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.750979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.751007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.832 qpair failed and we were unable to recover it. 00:28:02.832 [2024-11-28 19:16:23.751142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.751214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.751239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.832 qpair failed and we were unable to recover it. 00:28:02.832 [2024-11-28 19:16:23.751397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.751488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.751516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.832 qpair failed and we were unable to recover it. 00:28:02.832 [2024-11-28 19:16:23.751615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.751734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.751762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.832 qpair failed and we were unable to recover it. 00:28:02.832 [2024-11-28 19:16:23.751926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.752038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.752063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.832 qpair failed and we were unable to recover it. 00:28:02.832 [2024-11-28 19:16:23.752180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.752290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.752317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.832 qpair failed and we were unable to recover it. 00:28:02.832 [2024-11-28 19:16:23.752422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.752549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.752577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.832 qpair failed and we were unable to recover it. 00:28:02.832 [2024-11-28 19:16:23.752722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.752860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.832 [2024-11-28 19:16:23.752885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.832 qpair failed and we were unable to recover it. 00:28:02.832 [2024-11-28 19:16:23.753044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.753165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.753192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.833 qpair failed and we were unable to recover it. 00:28:02.833 [2024-11-28 19:16:23.753284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.753371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.753406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.833 qpair failed and we were unable to recover it. 00:28:02.833 [2024-11-28 19:16:23.753564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.753645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.753672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.833 qpair failed and we were unable to recover it. 00:28:02.833 [2024-11-28 19:16:23.753768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.753877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.753902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.833 qpair failed and we were unable to recover it. 00:28:02.833 [2024-11-28 19:16:23.754029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.754140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.754168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.833 qpair failed and we were unable to recover it. 00:28:02.833 [2024-11-28 19:16:23.754302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.754453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.754478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.833 qpair failed and we were unable to recover it. 00:28:02.833 [2024-11-28 19:16:23.754612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.754729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.754757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.833 qpair failed and we were unable to recover it. 00:28:02.833 [2024-11-28 19:16:23.754891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.755013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.755042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.833 qpair failed and we were unable to recover it. 00:28:02.833 [2024-11-28 19:16:23.755179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.755259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.755283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.833 qpair failed and we were unable to recover it. 00:28:02.833 [2024-11-28 19:16:23.755400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.755473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.755498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.833 qpair failed and we were unable to recover it. 00:28:02.833 [2024-11-28 19:16:23.755607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.755733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.755763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.833 qpair failed and we were unable to recover it. 00:28:02.833 [2024-11-28 19:16:23.755927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.756006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.756030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.833 qpair failed and we were unable to recover it. 00:28:02.833 [2024-11-28 19:16:23.756185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.756305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.756332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.833 qpair failed and we were unable to recover it. 00:28:02.833 [2024-11-28 19:16:23.756463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.756546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.756572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.833 qpair failed and we were unable to recover it. 00:28:02.833 [2024-11-28 19:16:23.756669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.756804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.756829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.833 qpair failed and we were unable to recover it. 00:28:02.833 [2024-11-28 19:16:23.756927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.757022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.757049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.833 qpair failed and we were unable to recover it. 00:28:02.833 [2024-11-28 19:16:23.757143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.757241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.757269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.833 qpair failed and we were unable to recover it. 00:28:02.833 [2024-11-28 19:16:23.757400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.757492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.757517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.833 qpair failed and we were unable to recover it. 00:28:02.833 [2024-11-28 19:16:23.757605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.757734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.757761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.833 qpair failed and we were unable to recover it. 00:28:02.833 [2024-11-28 19:16:23.757851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.757977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.758004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.833 qpair failed and we were unable to recover it. 00:28:02.833 [2024-11-28 19:16:23.758133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.758272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.758297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.833 qpair failed and we were unable to recover it. 00:28:02.833 [2024-11-28 19:16:23.758413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.758505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.758530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.833 qpair failed and we were unable to recover it. 00:28:02.833 [2024-11-28 19:16:23.758635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.758721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.758745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.833 qpair failed and we were unable to recover it. 00:28:02.833 [2024-11-28 19:16:23.758884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.759019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.759059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.833 qpair failed and we were unable to recover it. 00:28:02.833 [2024-11-28 19:16:23.759182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.759302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.833 [2024-11-28 19:16:23.759331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.834 qpair failed and we were unable to recover it. 00:28:02.834 [2024-11-28 19:16:23.759464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.759584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.759612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.834 qpair failed and we were unable to recover it. 00:28:02.834 [2024-11-28 19:16:23.759730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.759869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.759898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.834 qpair failed and we were unable to recover it. 00:28:02.834 [2024-11-28 19:16:23.760063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.760221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.760246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.834 qpair failed and we were unable to recover it. 00:28:02.834 [2024-11-28 19:16:23.760340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.760426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.760467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.834 qpair failed and we were unable to recover it. 00:28:02.834 [2024-11-28 19:16:23.760627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.760718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.760742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.834 qpair failed and we were unable to recover it. 00:28:02.834 [2024-11-28 19:16:23.760830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.760944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.760969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.834 qpair failed and we were unable to recover it. 00:28:02.834 [2024-11-28 19:16:23.761075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.761197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.761222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.834 qpair failed and we were unable to recover it. 00:28:02.834 [2024-11-28 19:16:23.761310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.761449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.761474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.834 qpair failed and we were unable to recover it. 00:28:02.834 [2024-11-28 19:16:23.761666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.761804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.761830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.834 qpair failed and we were unable to recover it. 00:28:02.834 [2024-11-28 19:16:23.761967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.762125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.762153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.834 qpair failed and we were unable to recover it. 00:28:02.834 [2024-11-28 19:16:23.762303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.762402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.762428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.834 qpair failed and we were unable to recover it. 00:28:02.834 [2024-11-28 19:16:23.762588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.762736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.762764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.834 qpair failed and we were unable to recover it. 00:28:02.834 [2024-11-28 19:16:23.762892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.763048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.763076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.834 qpair failed and we were unable to recover it. 00:28:02.834 [2024-11-28 19:16:23.763180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.763268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.763294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.834 qpair failed and we were unable to recover it. 00:28:02.834 [2024-11-28 19:16:23.763408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.763517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.763545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.834 qpair failed and we were unable to recover it. 00:28:02.834 [2024-11-28 19:16:23.763638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.763843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.763871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.834 qpair failed and we were unable to recover it. 00:28:02.834 [2024-11-28 19:16:23.764006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.764120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.764144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.834 qpair failed and we were unable to recover it. 00:28:02.834 [2024-11-28 19:16:23.764217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.764430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.764459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.834 qpair failed and we were unable to recover it. 00:28:02.834 [2024-11-28 19:16:23.764582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.764708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.764735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.834 qpair failed and we were unable to recover it. 00:28:02.834 [2024-11-28 19:16:23.764844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.764925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.764950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.834 qpair failed and we were unable to recover it. 00:28:02.834 [2024-11-28 19:16:23.765032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.765138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.765164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.834 qpair failed and we were unable to recover it. 00:28:02.834 [2024-11-28 19:16:23.765255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.765385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.834 [2024-11-28 19:16:23.765428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.834 qpair failed and we were unable to recover it. 00:28:02.834 [2024-11-28 19:16:23.765563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.765650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.765675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.835 qpair failed and we were unable to recover it. 00:28:02.835 [2024-11-28 19:16:23.765796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.765884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.765924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.835 qpair failed and we were unable to recover it. 00:28:02.835 [2024-11-28 19:16:23.766051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.766143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.766171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.835 qpair failed and we were unable to recover it. 00:28:02.835 [2024-11-28 19:16:23.766280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.766402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.766428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.835 qpair failed and we were unable to recover it. 00:28:02.835 [2024-11-28 19:16:23.766510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.766636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.766663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.835 qpair failed and we were unable to recover it. 00:28:02.835 [2024-11-28 19:16:23.766748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.766873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.766900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.835 qpair failed and we were unable to recover it. 00:28:02.835 [2024-11-28 19:16:23.767061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.767198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.767223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.835 qpair failed and we were unable to recover it. 00:28:02.835 [2024-11-28 19:16:23.767365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.767496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.767524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.835 qpair failed and we were unable to recover it. 00:28:02.835 [2024-11-28 19:16:23.767638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.767798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.767825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.835 qpair failed and we were unable to recover it. 00:28:02.835 [2024-11-28 19:16:23.767979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.768101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.768125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.835 qpair failed and we were unable to recover it. 00:28:02.835 [2024-11-28 19:16:23.768272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.768365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.768417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.835 qpair failed and we were unable to recover it. 00:28:02.835 [2024-11-28 19:16:23.768547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.768646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.768674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.835 qpair failed and we were unable to recover it. 00:28:02.835 [2024-11-28 19:16:23.768785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.768928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.768953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.835 qpair failed and we were unable to recover it. 00:28:02.835 [2024-11-28 19:16:23.769077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.769178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.769205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.835 qpair failed and we were unable to recover it. 00:28:02.835 [2024-11-28 19:16:23.769306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.769430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.769458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.835 qpair failed and we were unable to recover it. 00:28:02.835 [2024-11-28 19:16:23.769594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.769730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.769754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.835 qpair failed and we were unable to recover it. 00:28:02.835 [2024-11-28 19:16:23.769914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.770062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.770090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.835 qpair failed and we were unable to recover it. 00:28:02.835 [2024-11-28 19:16:23.770242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.770363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.770390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.835 qpair failed and we were unable to recover it. 00:28:02.835 [2024-11-28 19:16:23.770517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.770638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.770663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.835 qpair failed and we were unable to recover it. 00:28:02.835 [2024-11-28 19:16:23.770787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.770897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.770924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.835 qpair failed and we were unable to recover it. 00:28:02.835 [2024-11-28 19:16:23.771013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.771140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.771168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.835 qpair failed and we were unable to recover it. 00:28:02.835 [2024-11-28 19:16:23.771296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.771403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.771429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.835 qpair failed and we were unable to recover it. 00:28:02.835 [2024-11-28 19:16:23.771581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.771673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.771701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.835 qpair failed and we were unable to recover it. 00:28:02.835 [2024-11-28 19:16:23.771787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.771876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.771904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.835 qpair failed and we were unable to recover it. 00:28:02.835 [2024-11-28 19:16:23.772041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.772148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.772174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.835 qpair failed and we were unable to recover it. 00:28:02.835 [2024-11-28 19:16:23.772298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.772467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.772493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.835 qpair failed and we were unable to recover it. 00:28:02.835 [2024-11-28 19:16:23.772606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.772770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.772797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.835 qpair failed and we were unable to recover it. 00:28:02.835 [2024-11-28 19:16:23.772899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.773019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.773045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.835 qpair failed and we were unable to recover it. 00:28:02.835 [2024-11-28 19:16:23.773177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.773292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.773320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.835 qpair failed and we were unable to recover it. 00:28:02.835 [2024-11-28 19:16:23.773452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.773593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.773619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.835 qpair failed and we were unable to recover it. 00:28:02.835 [2024-11-28 19:16:23.773756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.773836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.773865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.835 qpair failed and we were unable to recover it. 00:28:02.835 [2024-11-28 19:16:23.774002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.774123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.835 [2024-11-28 19:16:23.774147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.835 qpair failed and we were unable to recover it. 00:28:02.836 [2024-11-28 19:16:23.774306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.774400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.774443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.836 qpair failed and we were unable to recover it. 00:28:02.836 [2024-11-28 19:16:23.774557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.774666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.774691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.836 qpair failed and we were unable to recover it. 00:28:02.836 [2024-11-28 19:16:23.774795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.774909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.774936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.836 qpair failed and we were unable to recover it. 00:28:02.836 [2024-11-28 19:16:23.775084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.775213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.775240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.836 qpair failed and we were unable to recover it. 00:28:02.836 [2024-11-28 19:16:23.775353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.775466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.775492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.836 qpair failed and we were unable to recover it. 00:28:02.836 [2024-11-28 19:16:23.775596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.775745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.775773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.836 qpair failed and we were unable to recover it. 00:28:02.836 [2024-11-28 19:16:23.775905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.776000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.776027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.836 qpair failed and we were unable to recover it. 00:28:02.836 [2024-11-28 19:16:23.776157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.776272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.776296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.836 qpair failed and we were unable to recover it. 00:28:02.836 [2024-11-28 19:16:23.776377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.776491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.776517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.836 qpair failed and we were unable to recover it. 00:28:02.836 [2024-11-28 19:16:23.776665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.776786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.776814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.836 qpair failed and we were unable to recover it. 00:28:02.836 [2024-11-28 19:16:23.776917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.777022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.777047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.836 qpair failed and we were unable to recover it. 00:28:02.836 [2024-11-28 19:16:23.777122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.777279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.777306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.836 qpair failed and we were unable to recover it. 00:28:02.836 [2024-11-28 19:16:23.777422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.777536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.777564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.836 qpair failed and we were unable to recover it. 00:28:02.836 [2024-11-28 19:16:23.777701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.777779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.777804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.836 qpair failed and we were unable to recover it. 00:28:02.836 [2024-11-28 19:16:23.777886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.778018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.778045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.836 qpair failed and we were unable to recover it. 00:28:02.836 [2024-11-28 19:16:23.778174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.778298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.778325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.836 qpair failed and we were unable to recover it. 00:28:02.836 [2024-11-28 19:16:23.778459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.778569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.778594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.836 qpair failed and we were unable to recover it. 00:28:02.836 [2024-11-28 19:16:23.778701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.778789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.778817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.836 qpair failed and we were unable to recover it. 00:28:02.836 [2024-11-28 19:16:23.778964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.779047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.779074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.836 qpair failed and we were unable to recover it. 00:28:02.836 [2024-11-28 19:16:23.779204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.779306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.779330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.836 qpair failed and we were unable to recover it. 00:28:02.836 [2024-11-28 19:16:23.779445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.779575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.779602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.836 qpair failed and we were unable to recover it. 00:28:02.836 [2024-11-28 19:16:23.779686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.779775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.779803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.836 qpair failed and we were unable to recover it. 00:28:02.836 [2024-11-28 19:16:23.779946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.780024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.780049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.836 qpair failed and we were unable to recover it. 00:28:02.836 [2024-11-28 19:16:23.780156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.780281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.780309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.836 qpair failed and we were unable to recover it. 00:28:02.836 [2024-11-28 19:16:23.780414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.780509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.780537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.836 qpair failed and we were unable to recover it. 00:28:02.836 [2024-11-28 19:16:23.780646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.780748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.780773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.836 qpair failed and we were unable to recover it. 00:28:02.836 [2024-11-28 19:16:23.780848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.780982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.781009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.836 qpair failed and we were unable to recover it. 00:28:02.836 [2024-11-28 19:16:23.781131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.781246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.781273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.836 qpair failed and we were unable to recover it. 00:28:02.836 [2024-11-28 19:16:23.781407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.781547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.781573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.836 qpair failed and we were unable to recover it. 00:28:02.836 [2024-11-28 19:16:23.781656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.781772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.781800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.836 qpair failed and we were unable to recover it. 00:28:02.836 [2024-11-28 19:16:23.781925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.836 [2024-11-28 19:16:23.782043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.782070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.837 qpair failed and we were unable to recover it. 00:28:02.837 [2024-11-28 19:16:23.782184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.782319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.782347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.837 qpair failed and we were unable to recover it. 00:28:02.837 [2024-11-28 19:16:23.782495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.782605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.782630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.837 qpair failed and we were unable to recover it. 00:28:02.837 [2024-11-28 19:16:23.782792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.782909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.782950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.837 qpair failed and we were unable to recover it. 00:28:02.837 [2024-11-28 19:16:23.783039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.783153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.783178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.837 qpair failed and we were unable to recover it. 00:28:02.837 [2024-11-28 19:16:23.783292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.783379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.783409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.837 qpair failed and we were unable to recover it. 00:28:02.837 [2024-11-28 19:16:23.783497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.783608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.783632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.837 qpair failed and we were unable to recover it. 00:28:02.837 [2024-11-28 19:16:23.783750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.783865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.783890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.837 qpair failed and we were unable to recover it. 00:28:02.837 [2024-11-28 19:16:23.783972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.784128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.784155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.837 qpair failed and we were unable to recover it. 00:28:02.837 [2024-11-28 19:16:23.784279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.784482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.784512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.837 qpair failed and we were unable to recover it. 00:28:02.837 [2024-11-28 19:16:23.784673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.784788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.784813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.837 qpair failed and we were unable to recover it. 00:28:02.837 [2024-11-28 19:16:23.784902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.785013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.785037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.837 qpair failed and we were unable to recover it. 00:28:02.837 [2024-11-28 19:16:23.785144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.785220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.785245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.837 qpair failed and we were unable to recover it. 00:28:02.837 [2024-11-28 19:16:23.785327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.785405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.785431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.837 qpair failed and we were unable to recover it. 00:28:02.837 [2024-11-28 19:16:23.785521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.785636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.785660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.837 qpair failed and we were unable to recover it. 00:28:02.837 [2024-11-28 19:16:23.785772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.785877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.785905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.837 qpair failed and we were unable to recover it. 00:28:02.837 [2024-11-28 19:16:23.786008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.786122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.786147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.837 qpair failed and we were unable to recover it. 00:28:02.837 [2024-11-28 19:16:23.786229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.786334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.786361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.837 qpair failed and we were unable to recover it. 00:28:02.837 [2024-11-28 19:16:23.786502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.786612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.786637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.837 qpair failed and we were unable to recover it. 00:28:02.837 [2024-11-28 19:16:23.786749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.786863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.786892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.837 qpair failed and we were unable to recover it. 00:28:02.837 [2024-11-28 19:16:23.787033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.787136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.787164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.837 qpair failed and we were unable to recover it. 00:28:02.837 [2024-11-28 19:16:23.787258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.787369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.787402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.837 qpair failed and we were unable to recover it. 00:28:02.837 [2024-11-28 19:16:23.787511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.787631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.787655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.837 qpair failed and we were unable to recover it. 00:28:02.837 [2024-11-28 19:16:23.787768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.787870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.787899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.837 qpair failed and we were unable to recover it. 00:28:02.837 [2024-11-28 19:16:23.788023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.788145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.788173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.837 qpair failed and we were unable to recover it. 00:28:02.837 [2024-11-28 19:16:23.788331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.788419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.788445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.837 qpair failed and we were unable to recover it. 00:28:02.837 [2024-11-28 19:16:23.788560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.788655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.788680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.837 qpair failed and we were unable to recover it. 00:28:02.837 [2024-11-28 19:16:23.788803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.788893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.788936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.837 qpair failed and we were unable to recover it. 00:28:02.837 [2024-11-28 19:16:23.789067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.789173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.789197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.837 qpair failed and we were unable to recover it. 00:28:02.837 [2024-11-28 19:16:23.789285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.789419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.789452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.837 qpair failed and we were unable to recover it. 00:28:02.837 [2024-11-28 19:16:23.789537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.789622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.837 [2024-11-28 19:16:23.789647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.837 qpair failed and we were unable to recover it. 00:28:02.837 [2024-11-28 19:16:23.789761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.789883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.789907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.838 qpair failed and we were unable to recover it. 00:28:02.838 [2024-11-28 19:16:23.790015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.790141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.790169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.838 qpair failed and we were unable to recover it. 00:28:02.838 [2024-11-28 19:16:23.790298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.790383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.790416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.838 qpair failed and we were unable to recover it. 00:28:02.838 [2024-11-28 19:16:23.790554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.790666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.790690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.838 qpair failed and we were unable to recover it. 00:28:02.838 [2024-11-28 19:16:23.790814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.790902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.790930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.838 qpair failed and we were unable to recover it. 00:28:02.838 [2024-11-28 19:16:23.791023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.791110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.791139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.838 qpair failed and we were unable to recover it. 00:28:02.838 [2024-11-28 19:16:23.791298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.791408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.791433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.838 qpair failed and we were unable to recover it. 00:28:02.838 [2024-11-28 19:16:23.791567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.791721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.791748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.838 qpair failed and we were unable to recover it. 00:28:02.838 [2024-11-28 19:16:23.791898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.792021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.792048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.838 qpair failed and we were unable to recover it. 00:28:02.838 [2024-11-28 19:16:23.792184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.792266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.792290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.838 qpair failed and we were unable to recover it. 00:28:02.838 [2024-11-28 19:16:23.792428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.792550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.792578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.838 qpair failed and we were unable to recover it. 00:28:02.838 [2024-11-28 19:16:23.792727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.792860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.792885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.838 qpair failed and we were unable to recover it. 00:28:02.838 [2024-11-28 19:16:23.793010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.793091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.793116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.838 qpair failed and we were unable to recover it. 00:28:02.838 [2024-11-28 19:16:23.793278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.793365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.793400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.838 qpair failed and we were unable to recover it. 00:28:02.838 [2024-11-28 19:16:23.793548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.793645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.793673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.838 qpair failed and we were unable to recover it. 00:28:02.838 [2024-11-28 19:16:23.793804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.793916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.793940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.838 qpair failed and we were unable to recover it. 00:28:02.838 [2024-11-28 19:16:23.794101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.794189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.794218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.838 qpair failed and we were unable to recover it. 00:28:02.838 [2024-11-28 19:16:23.794341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.794459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.794487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.838 qpair failed and we were unable to recover it. 00:28:02.838 [2024-11-28 19:16:23.794615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.794694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.794718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.838 qpair failed and we were unable to recover it. 00:28:02.838 [2024-11-28 19:16:23.794795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.794895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.794923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.838 qpair failed and we were unable to recover it. 00:28:02.838 [2024-11-28 19:16:23.795052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.795200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.795227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.838 qpair failed and we were unable to recover it. 00:28:02.838 [2024-11-28 19:16:23.795317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.795453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.795478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.838 qpair failed and we were unable to recover it. 00:28:02.838 [2024-11-28 19:16:23.795575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.795663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.795691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.838 qpair failed and we were unable to recover it. 00:28:02.838 [2024-11-28 19:16:23.795817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.795918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.795946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.838 qpair failed and we were unable to recover it. 00:28:02.838 [2024-11-28 19:16:23.796090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.796225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.796249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.838 qpair failed and we were unable to recover it. 00:28:02.838 [2024-11-28 19:16:23.796354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.838 [2024-11-28 19:16:23.796497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.796526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.839 qpair failed and we were unable to recover it. 00:28:02.839 [2024-11-28 19:16:23.796616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.796729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.796756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.839 qpair failed and we were unable to recover it. 00:28:02.839 [2024-11-28 19:16:23.796884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.797002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.797027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.839 qpair failed and we were unable to recover it. 00:28:02.839 [2024-11-28 19:16:23.797110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.797189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.797215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.839 qpair failed and we were unable to recover it. 00:28:02.839 [2024-11-28 19:16:23.797378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.797476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.797505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.839 qpair failed and we were unable to recover it. 00:28:02.839 [2024-11-28 19:16:23.797641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.797781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.797806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.839 qpair failed and we were unable to recover it. 00:28:02.839 [2024-11-28 19:16:23.797940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.798056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.798096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.839 qpair failed and we were unable to recover it. 00:28:02.839 [2024-11-28 19:16:23.798209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.798346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.798373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.839 qpair failed and we were unable to recover it. 00:28:02.839 [2024-11-28 19:16:23.798543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.798656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.798681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.839 qpair failed and we were unable to recover it. 00:28:02.839 [2024-11-28 19:16:23.798762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.798871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.798896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.839 qpair failed and we were unable to recover it. 00:28:02.839 [2024-11-28 19:16:23.799010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.799171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.799199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.839 qpair failed and we were unable to recover it. 00:28:02.839 [2024-11-28 19:16:23.799343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.799452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.799478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.839 qpair failed and we were unable to recover it. 00:28:02.839 [2024-11-28 19:16:23.799566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.799678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.799718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.839 qpair failed and we were unable to recover it. 00:28:02.839 [2024-11-28 19:16:23.799833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.799985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.800012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.839 qpair failed and we were unable to recover it. 00:28:02.839 [2024-11-28 19:16:23.800141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.800333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.800372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.839 qpair failed and we were unable to recover it. 00:28:02.839 [2024-11-28 19:16:23.800500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.800634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.800661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.839 qpair failed and we were unable to recover it. 00:28:02.839 [2024-11-28 19:16:23.800823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.800935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.800959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.839 qpair failed and we were unable to recover it. 00:28:02.839 [2024-11-28 19:16:23.801072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.801177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.801201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.839 qpair failed and we were unable to recover it. 00:28:02.839 [2024-11-28 19:16:23.801301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.801420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.801449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.839 qpair failed and we were unable to recover it. 00:28:02.839 [2024-11-28 19:16:23.801597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.801679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.801707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.839 qpair failed and we were unable to recover it. 00:28:02.839 [2024-11-28 19:16:23.801837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.801948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.801972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.839 qpair failed and we were unable to recover it. 00:28:02.839 [2024-11-28 19:16:23.802128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.802275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.802320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.839 qpair failed and we were unable to recover it. 00:28:02.839 [2024-11-28 19:16:23.802438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.802513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.802553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.839 qpair failed and we were unable to recover it. 00:28:02.839 [2024-11-28 19:16:23.802720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.802801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.802826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.839 qpair failed and we were unable to recover it. 00:28:02.839 [2024-11-28 19:16:23.802958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.803076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.803108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.839 qpair failed and we were unable to recover it. 00:28:02.839 [2024-11-28 19:16:23.803211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.803332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.803360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.839 qpair failed and we were unable to recover it. 00:28:02.839 [2024-11-28 19:16:23.803475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.803558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.803584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.839 qpair failed and we were unable to recover it. 00:28:02.839 [2024-11-28 19:16:23.803711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.803830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.803859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.839 qpair failed and we were unable to recover it. 00:28:02.839 [2024-11-28 19:16:23.803978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.804095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.804122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.839 qpair failed and we were unable to recover it. 00:28:02.839 [2024-11-28 19:16:23.804236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.804351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.804376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.839 qpair failed and we were unable to recover it. 00:28:02.839 [2024-11-28 19:16:23.804502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.804628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.804656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.839 qpair failed and we were unable to recover it. 00:28:02.839 [2024-11-28 19:16:23.804743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.804832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.804860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.839 qpair failed and we were unable to recover it. 00:28:02.839 [2024-11-28 19:16:23.804972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.805089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.805115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.839 qpair failed and we were unable to recover it. 00:28:02.839 [2024-11-28 19:16:23.805227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.805345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.805370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.839 qpair failed and we were unable to recover it. 00:28:02.839 [2024-11-28 19:16:23.805566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.805723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.805751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.839 qpair failed and we were unable to recover it. 00:28:02.839 [2024-11-28 19:16:23.805889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.805996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.839 [2024-11-28 19:16:23.806020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.839 qpair failed and we were unable to recover it. 00:28:02.840 [2024-11-28 19:16:23.806162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.840 [2024-11-28 19:16:23.806269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.840 [2024-11-28 19:16:23.806294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.840 qpair failed and we were unable to recover it. 00:28:02.840 [2024-11-28 19:16:23.806408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.840 [2024-11-28 19:16:23.806510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.840 [2024-11-28 19:16:23.806539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.840 qpair failed and we were unable to recover it. 00:28:02.840 [2024-11-28 19:16:23.806667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.840 [2024-11-28 19:16:23.806774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.840 [2024-11-28 19:16:23.806798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.840 qpair failed and we were unable to recover it. 00:28:02.840 [2024-11-28 19:16:23.806937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.840 [2024-11-28 19:16:23.807087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.840 [2024-11-28 19:16:23.807115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.840 qpair failed and we were unable to recover it. 00:28:02.840 [2024-11-28 19:16:23.807239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.840 [2024-11-28 19:16:23.807340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.840 [2024-11-28 19:16:23.807367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.840 qpair failed and we were unable to recover it. 00:28:02.840 [2024-11-28 19:16:23.807504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.840 [2024-11-28 19:16:23.807591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.840 [2024-11-28 19:16:23.807615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.840 qpair failed and we were unable to recover it. 00:28:02.840 [2024-11-28 19:16:23.807725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.840 [2024-11-28 19:16:23.807804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.840 [2024-11-28 19:16:23.807829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.840 qpair failed and we were unable to recover it. 00:28:02.840 [2024-11-28 19:16:23.807975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.840 [2024-11-28 19:16:23.808102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.840 [2024-11-28 19:16:23.808129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.840 qpair failed and we were unable to recover it. 00:28:02.840 [2024-11-28 19:16:23.808264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.840 [2024-11-28 19:16:23.808368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.840 [2024-11-28 19:16:23.808397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.840 qpair failed and we were unable to recover it. 00:28:02.840 [2024-11-28 19:16:23.808507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.840 [2024-11-28 19:16:23.808602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.840 [2024-11-28 19:16:23.808629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.840 qpair failed and we were unable to recover it. 00:28:02.840 [2024-11-28 19:16:23.808742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.840 [2024-11-28 19:16:23.808864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.840 [2024-11-28 19:16:23.808892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.840 qpair failed and we were unable to recover it. 00:28:02.840 [2024-11-28 19:16:23.809019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.840 [2024-11-28 19:16:23.809119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.840 [2024-11-28 19:16:23.809144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.840 qpair failed and we were unable to recover it. 00:28:02.840 [2024-11-28 19:16:23.809259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.840 [2024-11-28 19:16:23.809345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:02.840 [2024-11-28 19:16:23.809388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:02.840 qpair failed and we were unable to recover it. 00:28:02.840 [2024-11-28 19:16:23.809517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.125 [2024-11-28 19:16:23.809663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.125 [2024-11-28 19:16:23.809696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.125 qpair failed and we were unable to recover it. 00:28:03.125 [2024-11-28 19:16:23.809827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.125 [2024-11-28 19:16:23.809939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.125 [2024-11-28 19:16:23.809964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.125 qpair failed and we were unable to recover it. 00:28:03.125 [2024-11-28 19:16:23.810089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.125 [2024-11-28 19:16:23.810214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.125 [2024-11-28 19:16:23.810242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.125 qpair failed and we were unable to recover it. 00:28:03.125 [2024-11-28 19:16:23.810322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.125 [2024-11-28 19:16:23.810454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.125 [2024-11-28 19:16:23.810483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.125 qpair failed and we were unable to recover it. 00:28:03.125 [2024-11-28 19:16:23.810589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.125 [2024-11-28 19:16:23.810702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.125 [2024-11-28 19:16:23.810727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.125 qpair failed and we were unable to recover it. 00:28:03.125 [2024-11-28 19:16:23.810852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.125 [2024-11-28 19:16:23.810975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.125 [2024-11-28 19:16:23.811003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.125 qpair failed and we were unable to recover it. 00:28:03.125 [2024-11-28 19:16:23.811085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.125 [2024-11-28 19:16:23.811207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.125 [2024-11-28 19:16:23.811235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.125 qpair failed and we were unable to recover it. 00:28:03.125 [2024-11-28 19:16:23.811380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.125 [2024-11-28 19:16:23.811499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.125 [2024-11-28 19:16:23.811524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.125 qpair failed and we were unable to recover it. 00:28:03.125 [2024-11-28 19:16:23.811612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.125 [2024-11-28 19:16:23.811693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.125 [2024-11-28 19:16:23.811718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.125 qpair failed and we were unable to recover it. 00:28:03.125 [2024-11-28 19:16:23.811884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.125 [2024-11-28 19:16:23.811980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.125 [2024-11-28 19:16:23.812007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.125 qpair failed and we were unable to recover it. 00:28:03.125 [2024-11-28 19:16:23.812151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.125 [2024-11-28 19:16:23.812259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.125 [2024-11-28 19:16:23.812284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.125 qpair failed and we were unable to recover it. 00:28:03.125 [2024-11-28 19:16:23.812430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.125 [2024-11-28 19:16:23.812524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.812552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.126 qpair failed and we were unable to recover it. 00:28:03.126 [2024-11-28 19:16:23.812674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.812804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.812829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.126 qpair failed and we were unable to recover it. 00:28:03.126 [2024-11-28 19:16:23.812966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.813118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.813160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.126 qpair failed and we were unable to recover it. 00:28:03.126 [2024-11-28 19:16:23.813290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.813421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.813450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.126 qpair failed and we were unable to recover it. 00:28:03.126 [2024-11-28 19:16:23.813576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.813667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.813694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.126 qpair failed and we were unable to recover it. 00:28:03.126 [2024-11-28 19:16:23.813800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.813905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.813930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.126 qpair failed and we were unable to recover it. 00:28:03.126 [2024-11-28 19:16:23.814015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.814110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.814137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.126 qpair failed and we were unable to recover it. 00:28:03.126 [2024-11-28 19:16:23.814278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.814385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.814437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.126 qpair failed and we were unable to recover it. 00:28:03.126 [2024-11-28 19:16:23.814536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.814617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.814643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.126 qpair failed and we were unable to recover it. 00:28:03.126 [2024-11-28 19:16:23.814750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.814912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.814939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.126 qpair failed and we were unable to recover it. 00:28:03.126 [2024-11-28 19:16:23.815060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.815207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.815234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.126 qpair failed and we were unable to recover it. 00:28:03.126 [2024-11-28 19:16:23.815368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.815483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.815509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.126 qpair failed and we were unable to recover it. 00:28:03.126 [2024-11-28 19:16:23.815614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.815744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.815769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.126 qpair failed and we were unable to recover it. 00:28:03.126 [2024-11-28 19:16:23.815906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.816009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.816033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.126 qpair failed and we were unable to recover it. 00:28:03.126 [2024-11-28 19:16:23.816118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.816225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.816250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.126 qpair failed and we were unable to recover it. 00:28:03.126 [2024-11-28 19:16:23.816324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.816423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.816453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.126 qpair failed and we were unable to recover it. 00:28:03.126 [2024-11-28 19:16:23.816592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.816744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.816771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.126 qpair failed and we were unable to recover it. 00:28:03.126 [2024-11-28 19:16:23.816931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.817042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.817066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.126 qpair failed and we were unable to recover it. 00:28:03.126 [2024-11-28 19:16:23.817198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.817283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.817325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.126 qpair failed and we were unable to recover it. 00:28:03.126 [2024-11-28 19:16:23.817456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.817570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.817610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.126 qpair failed and we were unable to recover it. 00:28:03.126 [2024-11-28 19:16:23.817773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.817910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.817935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.126 qpair failed and we were unable to recover it. 00:28:03.126 [2024-11-28 19:16:23.818058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.818179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.818206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.126 qpair failed and we were unable to recover it. 00:28:03.126 [2024-11-28 19:16:23.818328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.818441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.126 [2024-11-28 19:16:23.818470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.127 qpair failed and we were unable to recover it. 00:28:03.127 [2024-11-28 19:16:23.818599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.818713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.818738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.127 qpair failed and we were unable to recover it. 00:28:03.127 [2024-11-28 19:16:23.818856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.818946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.818988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.127 qpair failed and we were unable to recover it. 00:28:03.127 [2024-11-28 19:16:23.819129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.819239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.819263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.127 qpair failed and we were unable to recover it. 00:28:03.127 [2024-11-28 19:16:23.819397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.819506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.819531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.127 qpair failed and we were unable to recover it. 00:28:03.127 [2024-11-28 19:16:23.819655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.819772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.819800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.127 qpair failed and we were unable to recover it. 00:28:03.127 [2024-11-28 19:16:23.819888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.820012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.820037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.127 qpair failed and we were unable to recover it. 00:28:03.127 [2024-11-28 19:16:23.820127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.820209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.820234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.127 qpair failed and we were unable to recover it. 00:28:03.127 [2024-11-28 19:16:23.820380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.820504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.820532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.127 qpair failed and we were unable to recover it. 00:28:03.127 [2024-11-28 19:16:23.820648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.820772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.820800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.127 qpair failed and we were unable to recover it. 00:28:03.127 [2024-11-28 19:16:23.820935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.821050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.821076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.127 qpair failed and we were unable to recover it. 00:28:03.127 [2024-11-28 19:16:23.821185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.821286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.821314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.127 qpair failed and we were unable to recover it. 00:28:03.127 [2024-11-28 19:16:23.821439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.821518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.821546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.127 qpair failed and we were unable to recover it. 00:28:03.127 [2024-11-28 19:16:23.821709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.821795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.821820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.127 qpair failed and we were unable to recover it. 00:28:03.127 [2024-11-28 19:16:23.821954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.822034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.822059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.127 qpair failed and we were unable to recover it. 00:28:03.127 [2024-11-28 19:16:23.822150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.822292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.822316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.127 qpair failed and we were unable to recover it. 00:28:03.127 [2024-11-28 19:16:23.822426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.822533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.822558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.127 qpair failed and we were unable to recover it. 00:28:03.127 [2024-11-28 19:16:23.822643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.822727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.822751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.127 qpair failed and we were unable to recover it. 00:28:03.127 [2024-11-28 19:16:23.822842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.823001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.823030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.127 qpair failed and we were unable to recover it. 00:28:03.127 [2024-11-28 19:16:23.823198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.823318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.823343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.127 qpair failed and we were unable to recover it. 00:28:03.127 [2024-11-28 19:16:23.823485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.823605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.823633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.127 qpair failed and we were unable to recover it. 00:28:03.127 [2024-11-28 19:16:23.823755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.823847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.823875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.127 qpair failed and we were unable to recover it. 00:28:03.127 [2024-11-28 19:16:23.824005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.824148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.824173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.127 qpair failed and we were unable to recover it. 00:28:03.127 [2024-11-28 19:16:23.824279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.127 [2024-11-28 19:16:23.824425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.824453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.128 qpair failed and we were unable to recover it. 00:28:03.128 [2024-11-28 19:16:23.824577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.824722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.824749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.128 qpair failed and we were unable to recover it. 00:28:03.128 [2024-11-28 19:16:23.824878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.824967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.824993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.128 qpair failed and we were unable to recover it. 00:28:03.128 [2024-11-28 19:16:23.825073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.825180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.825205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.128 qpair failed and we were unable to recover it. 00:28:03.128 [2024-11-28 19:16:23.825294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.825408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.825434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.128 qpair failed and we were unable to recover it. 00:28:03.128 [2024-11-28 19:16:23.825545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.825618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.825642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.128 qpair failed and we were unable to recover it. 00:28:03.128 [2024-11-28 19:16:23.825721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.825804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.825829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.128 qpair failed and we were unable to recover it. 00:28:03.128 [2024-11-28 19:16:23.825908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.826012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.826037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.128 qpair failed and we were unable to recover it. 00:28:03.128 [2024-11-28 19:16:23.826181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.826286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.826311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.128 qpair failed and we were unable to recover it. 00:28:03.128 [2024-11-28 19:16:23.826467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.826589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.826617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.128 qpair failed and we were unable to recover it. 00:28:03.128 [2024-11-28 19:16:23.826704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.826802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.826829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.128 qpair failed and we were unable to recover it. 00:28:03.128 [2024-11-28 19:16:23.826989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.827147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.827174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.128 qpair failed and we were unable to recover it. 00:28:03.128 [2024-11-28 19:16:23.827266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.827362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.827390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.128 qpair failed and we were unable to recover it. 00:28:03.128 [2024-11-28 19:16:23.827549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.827646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.827673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.128 qpair failed and we were unable to recover it. 00:28:03.128 [2024-11-28 19:16:23.827812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.827922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.827948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.128 qpair failed and we were unable to recover it. 00:28:03.128 [2024-11-28 19:16:23.828104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.828196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.828226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.128 qpair failed and we were unable to recover it. 00:28:03.128 [2024-11-28 19:16:23.828343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.828464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.828492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.128 qpair failed and we were unable to recover it. 00:28:03.128 [2024-11-28 19:16:23.828627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.828707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.828732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.128 qpair failed and we were unable to recover it. 00:28:03.128 [2024-11-28 19:16:23.828855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.828974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.829001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.128 qpair failed and we were unable to recover it. 00:28:03.128 [2024-11-28 19:16:23.829100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.829245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.829272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.128 qpair failed and we were unable to recover it. 00:28:03.128 [2024-11-28 19:16:23.829428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.829539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.128 [2024-11-28 19:16:23.829564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.129 qpair failed and we were unable to recover it. 00:28:03.129 [2024-11-28 19:16:23.829738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.829813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.829846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.129 qpair failed and we were unable to recover it. 00:28:03.129 [2024-11-28 19:16:23.829958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.830037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.830078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.129 qpair failed and we were unable to recover it. 00:28:03.129 [2024-11-28 19:16:23.830190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.830299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.830324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.129 qpair failed and we were unable to recover it. 00:28:03.129 [2024-11-28 19:16:23.830415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.830517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.830542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.129 qpair failed and we were unable to recover it. 00:28:03.129 [2024-11-28 19:16:23.830694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.830813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.830842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.129 qpair failed and we were unable to recover it. 00:28:03.129 [2024-11-28 19:16:23.830948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.831056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.831080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.129 qpair failed and we were unable to recover it. 00:28:03.129 [2024-11-28 19:16:23.831207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.831288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.831315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.129 qpair failed and we were unable to recover it. 00:28:03.129 [2024-11-28 19:16:23.831408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.831494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.831522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.129 qpair failed and we were unable to recover it. 00:28:03.129 [2024-11-28 19:16:23.831689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.831827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.831852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.129 qpair failed and we were unable to recover it. 00:28:03.129 [2024-11-28 19:16:23.831955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.832123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.832148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.129 qpair failed and we were unable to recover it. 00:28:03.129 [2024-11-28 19:16:23.832242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.832363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.832388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.129 qpair failed and we were unable to recover it. 00:28:03.129 [2024-11-28 19:16:23.832515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.832604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.832629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.129 qpair failed and we were unable to recover it. 00:28:03.129 [2024-11-28 19:16:23.832709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.832818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.832843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.129 qpair failed and we were unable to recover it. 00:28:03.129 [2024-11-28 19:16:23.832927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.833047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.833086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.129 qpair failed and we were unable to recover it. 00:28:03.129 [2024-11-28 19:16:23.833193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.833307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.833331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.129 qpair failed and we were unable to recover it. 00:28:03.129 [2024-11-28 19:16:23.833469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.833553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.833580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.129 qpair failed and we were unable to recover it. 00:28:03.129 [2024-11-28 19:16:23.833752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.833887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.833911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.129 qpair failed and we were unable to recover it. 00:28:03.129 [2024-11-28 19:16:23.833992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.834079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.834104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.129 qpair failed and we were unable to recover it. 00:28:03.129 [2024-11-28 19:16:23.834187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.834314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.834342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.129 qpair failed and we were unable to recover it. 00:28:03.129 [2024-11-28 19:16:23.834440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.834568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.834593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.129 qpair failed and we were unable to recover it. 00:28:03.129 [2024-11-28 19:16:23.834665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.834747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.129 [2024-11-28 19:16:23.834772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.129 qpair failed and we were unable to recover it. 00:28:03.129 [2024-11-28 19:16:23.834887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.834968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.834993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.130 qpair failed and we were unable to recover it. 00:28:03.130 [2024-11-28 19:16:23.835068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.835185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.835212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.130 qpair failed and we were unable to recover it. 00:28:03.130 [2024-11-28 19:16:23.835339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.835462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.835488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.130 qpair failed and we were unable to recover it. 00:28:03.130 [2024-11-28 19:16:23.835598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.835760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.835788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.130 qpair failed and we were unable to recover it. 00:28:03.130 [2024-11-28 19:16:23.835910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.836034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.836061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.130 qpair failed and we were unable to recover it. 00:28:03.130 [2024-11-28 19:16:23.836185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.836269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.836294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.130 qpair failed and we were unable to recover it. 00:28:03.130 [2024-11-28 19:16:23.836422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.836546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.836573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.130 qpair failed and we were unable to recover it. 00:28:03.130 [2024-11-28 19:16:23.836705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.836787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.836811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.130 qpair failed and we were unable to recover it. 00:28:03.130 [2024-11-28 19:16:23.836918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.836992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.837016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.130 qpair failed and we were unable to recover it. 00:28:03.130 [2024-11-28 19:16:23.837088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.837256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.837296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.130 qpair failed and we were unable to recover it. 00:28:03.130 [2024-11-28 19:16:23.837439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.837568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.837596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.130 qpair failed and we were unable to recover it. 00:28:03.130 [2024-11-28 19:16:23.837734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.837822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.837848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.130 qpair failed and we were unable to recover it. 00:28:03.130 [2024-11-28 19:16:23.837928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.838000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.838025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.130 qpair failed and we were unable to recover it. 00:28:03.130 [2024-11-28 19:16:23.838114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.838244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.838271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.130 qpair failed and we were unable to recover it. 00:28:03.130 [2024-11-28 19:16:23.838376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.838498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.838522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.130 qpair failed and we were unable to recover it. 00:28:03.130 [2024-11-28 19:16:23.838605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.838715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.838739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.130 qpair failed and we were unable to recover it. 00:28:03.130 [2024-11-28 19:16:23.838828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.838937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.838962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.130 qpair failed and we were unable to recover it. 00:28:03.130 [2024-11-28 19:16:23.839101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.839172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.839196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.130 qpair failed and we were unable to recover it. 00:28:03.130 [2024-11-28 19:16:23.839302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.839449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.839477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.130 qpair failed and we were unable to recover it. 00:28:03.130 [2024-11-28 19:16:23.839627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.839774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.839801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.130 qpair failed and we were unable to recover it. 00:28:03.130 [2024-11-28 19:16:23.839936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.840054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.840080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.130 qpair failed and we were unable to recover it. 00:28:03.130 [2024-11-28 19:16:23.840212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.840298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.130 [2024-11-28 19:16:23.840325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.130 qpair failed and we were unable to recover it. 00:28:03.130 [2024-11-28 19:16:23.840440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.131 [2024-11-28 19:16:23.840536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.131 [2024-11-28 19:16:23.840563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.131 qpair failed and we were unable to recover it. 00:28:03.131 [2024-11-28 19:16:23.840727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.131 [2024-11-28 19:16:23.840842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.131 [2024-11-28 19:16:23.840867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.131 qpair failed and we were unable to recover it. 00:28:03.131 [2024-11-28 19:16:23.840975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.131 [2024-11-28 19:16:23.841052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.131 [2024-11-28 19:16:23.841076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.131 qpair failed and we were unable to recover it. 00:28:03.131 [2024-11-28 19:16:23.841179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.131 [2024-11-28 19:16:23.841265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.131 [2024-11-28 19:16:23.841292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.131 qpair failed and we were unable to recover it. 00:28:03.131 [2024-11-28 19:16:23.841403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.131 [2024-11-28 19:16:23.841590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.131 [2024-11-28 19:16:23.841615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.131 qpair failed and we were unable to recover it. 00:28:03.131 [2024-11-28 19:16:23.841781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.131 [2024-11-28 19:16:23.841892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.131 [2024-11-28 19:16:23.841920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.131 qpair failed and we were unable to recover it. 00:28:03.131 [2024-11-28 19:16:23.842013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.131 [2024-11-28 19:16:23.842108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.131 [2024-11-28 19:16:23.842132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.131 qpair failed and we were unable to recover it. 00:28:03.131 [2024-11-28 19:16:23.842245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.131 [2024-11-28 19:16:23.842321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.131 [2024-11-28 19:16:23.842346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.131 qpair failed and we were unable to recover it. 00:28:03.131 [2024-11-28 19:16:23.842433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.131 [2024-11-28 19:16:23.842515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.131 [2024-11-28 19:16:23.842544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.131 qpair failed and we were unable to recover it. 00:28:03.131 [2024-11-28 19:16:23.842632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.131 [2024-11-28 19:16:23.842746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.131 [2024-11-28 19:16:23.842774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.131 qpair failed and we were unable to recover it. 00:28:03.131 [2024-11-28 19:16:23.842904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.131 [2024-11-28 19:16:23.843014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.131 [2024-11-28 19:16:23.843038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.131 qpair failed and we were unable to recover it. 00:28:03.131 [2024-11-28 19:16:23.843149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.131 [2024-11-28 19:16:23.843234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.131 [2024-11-28 19:16:23.843260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.131 qpair failed and we were unable to recover it. 00:28:03.131 [2024-11-28 19:16:23.843404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.131 [2024-11-28 19:16:23.843524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.131 [2024-11-28 19:16:23.843564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.131 qpair failed and we were unable to recover it. 00:28:03.131 [2024-11-28 19:16:23.843652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.131 [2024-11-28 19:16:23.843736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.131 [2024-11-28 19:16:23.843761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.131 qpair failed and we were unable to recover it. 00:28:03.131 [2024-11-28 19:16:23.843871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.131 [2024-11-28 19:16:23.843977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.131 [2024-11-28 19:16:23.844004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.131 qpair failed and we were unable to recover it. 00:28:03.131 [2024-11-28 19:16:23.844089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.131 [2024-11-28 19:16:23.844206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.131 [2024-11-28 19:16:23.844233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.131 qpair failed and we were unable to recover it. 00:28:03.131 [2024-11-28 19:16:23.844339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.131 [2024-11-28 19:16:23.844417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.844442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.132 qpair failed and we were unable to recover it. 00:28:03.132 [2024-11-28 19:16:23.844529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.844636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.844665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.132 qpair failed and we were unable to recover it. 00:28:03.132 [2024-11-28 19:16:23.844814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.844925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.844957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.132 qpair failed and we were unable to recover it. 00:28:03.132 [2024-11-28 19:16:23.845151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.845268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.845293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.132 qpair failed and we were unable to recover it. 00:28:03.132 [2024-11-28 19:16:23.845402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.845557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.845586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.132 qpair failed and we were unable to recover it. 00:28:03.132 [2024-11-28 19:16:23.845714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.845803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.845832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.132 qpair failed and we were unable to recover it. 00:28:03.132 [2024-11-28 19:16:23.845958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.846048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.846073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.132 qpair failed and we were unable to recover it. 00:28:03.132 [2024-11-28 19:16:23.846182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.846312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.846339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.132 qpair failed and we were unable to recover it. 00:28:03.132 [2024-11-28 19:16:23.846472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.846585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.846610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.132 qpair failed and we were unable to recover it. 00:28:03.132 [2024-11-28 19:16:23.846753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.846831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.846855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.132 qpair failed and we were unable to recover it. 00:28:03.132 [2024-11-28 19:16:23.846979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.847105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.847133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.132 qpair failed and we were unable to recover it. 00:28:03.132 [2024-11-28 19:16:23.847220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.847367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.847417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.132 qpair failed and we were unable to recover it. 00:28:03.132 [2024-11-28 19:16:23.847586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.847702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.847727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.132 qpair failed and we were unable to recover it. 00:28:03.132 [2024-11-28 19:16:23.847834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.847983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.848010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.132 qpair failed and we were unable to recover it. 00:28:03.132 [2024-11-28 19:16:23.848172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.848263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.848291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.132 qpair failed and we were unable to recover it. 00:28:03.132 [2024-11-28 19:16:23.848447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.848540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.848566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.132 qpair failed and we were unable to recover it. 00:28:03.132 [2024-11-28 19:16:23.848654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.848746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.848771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.132 qpair failed and we were unable to recover it. 00:28:03.132 [2024-11-28 19:16:23.848876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.848956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.848981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.132 qpair failed and we were unable to recover it. 00:28:03.132 [2024-11-28 19:16:23.849103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.849208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.849233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.132 qpair failed and we were unable to recover it. 00:28:03.132 [2024-11-28 19:16:23.849357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.849454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.849482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.132 qpair failed and we were unable to recover it. 00:28:03.132 [2024-11-28 19:16:23.849601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.849698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.849725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.132 qpair failed and we were unable to recover it. 00:28:03.132 [2024-11-28 19:16:23.849818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.849924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.849948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.132 qpair failed and we were unable to recover it. 00:28:03.132 [2024-11-28 19:16:23.850069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.850152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.850180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.132 qpair failed and we were unable to recover it. 00:28:03.132 [2024-11-28 19:16:23.850276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.132 [2024-11-28 19:16:23.850400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.850429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.133 qpair failed and we were unable to recover it. 00:28:03.133 [2024-11-28 19:16:23.850529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.850601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.850626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.133 qpair failed and we were unable to recover it. 00:28:03.133 [2024-11-28 19:16:23.850737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.850854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.850879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.133 qpair failed and we were unable to recover it. 00:28:03.133 [2024-11-28 19:16:23.850956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.851068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.851095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.133 qpair failed and we were unable to recover it. 00:28:03.133 [2024-11-28 19:16:23.851189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.851328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.851353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.133 qpair failed and we were unable to recover it. 00:28:03.133 [2024-11-28 19:16:23.851467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.851586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.851613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.133 qpair failed and we were unable to recover it. 00:28:03.133 [2024-11-28 19:16:23.851704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.851849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.851877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.133 qpair failed and we were unable to recover it. 00:28:03.133 [2024-11-28 19:16:23.852006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.852138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.852162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.133 qpair failed and we were unable to recover it. 00:28:03.133 [2024-11-28 19:16:23.852290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.852406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.852436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.133 qpair failed and we were unable to recover it. 00:28:03.133 [2024-11-28 19:16:23.852568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.852661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.852688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.133 qpair failed and we were unable to recover it. 00:28:03.133 [2024-11-28 19:16:23.852858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.852948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.852974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.133 qpair failed and we were unable to recover it. 00:28:03.133 [2024-11-28 19:16:23.853080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.853178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.853205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.133 qpair failed and we were unable to recover it. 00:28:03.133 [2024-11-28 19:16:23.853344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.853461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.853486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.133 qpair failed and we were unable to recover it. 00:28:03.133 [2024-11-28 19:16:23.853606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.853685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.853709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.133 qpair failed and we were unable to recover it. 00:28:03.133 [2024-11-28 19:16:23.853827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.853953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.853979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.133 qpair failed and we were unable to recover it. 00:28:03.133 [2024-11-28 19:16:23.854112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.854209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.854236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.133 qpair failed and we were unable to recover it. 00:28:03.133 [2024-11-28 19:16:23.854432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.854512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.854538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.133 qpair failed and we were unable to recover it. 00:28:03.133 [2024-11-28 19:16:23.854650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.854835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.854860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.133 qpair failed and we were unable to recover it. 00:28:03.133 [2024-11-28 19:16:23.854943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.855062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.855087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.133 qpair failed and we were unable to recover it. 00:28:03.133 [2024-11-28 19:16:23.855168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.855254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.855278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.133 qpair failed and we were unable to recover it. 00:28:03.133 [2024-11-28 19:16:23.855362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.855463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.855488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.133 qpair failed and we were unable to recover it. 00:28:03.133 [2024-11-28 19:16:23.855573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.855681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.855706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.133 qpair failed and we were unable to recover it. 00:28:03.133 [2024-11-28 19:16:23.855793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.855900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.133 [2024-11-28 19:16:23.855925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.134 qpair failed and we were unable to recover it. 00:28:03.134 [2024-11-28 19:16:23.856036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.856134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.856176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.134 qpair failed and we were unable to recover it. 00:28:03.134 [2024-11-28 19:16:23.856258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.856369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.856399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.134 qpair failed and we were unable to recover it. 00:28:03.134 [2024-11-28 19:16:23.856515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.856593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.856618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.134 qpair failed and we were unable to recover it. 00:28:03.134 [2024-11-28 19:16:23.856826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.856942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.856969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.134 qpair failed and we were unable to recover it. 00:28:03.134 [2024-11-28 19:16:23.857063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.857198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.857223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.134 qpair failed and we were unable to recover it. 00:28:03.134 [2024-11-28 19:16:23.857310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.857404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.857430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.134 qpair failed and we were unable to recover it. 00:28:03.134 [2024-11-28 19:16:23.857541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.857727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.857768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.134 qpair failed and we were unable to recover it. 00:28:03.134 [2024-11-28 19:16:23.857926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.858011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.858040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.134 qpair failed and we were unable to recover it. 00:28:03.134 [2024-11-28 19:16:23.858132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.858210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.858234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.134 qpair failed and we were unable to recover it. 00:28:03.134 [2024-11-28 19:16:23.858319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.858427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.858456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.134 qpair failed and we were unable to recover it. 00:28:03.134 [2024-11-28 19:16:23.858590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.858687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.858711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.134 qpair failed and we were unable to recover it. 00:28:03.134 [2024-11-28 19:16:23.858821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.858930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.858955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.134 qpair failed and we were unable to recover it. 00:28:03.134 [2024-11-28 19:16:23.859067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.859157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.859182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.134 qpair failed and we were unable to recover it. 00:28:03.134 [2024-11-28 19:16:23.859295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.859379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.859409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.134 qpair failed and we were unable to recover it. 00:28:03.134 [2024-11-28 19:16:23.859538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.859623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.859647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.134 qpair failed and we were unable to recover it. 00:28:03.134 [2024-11-28 19:16:23.859739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.859875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.859900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.134 qpair failed and we were unable to recover it. 00:28:03.134 [2024-11-28 19:16:23.859995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.860107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.860133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.134 qpair failed and we were unable to recover it. 00:28:03.134 [2024-11-28 19:16:23.860247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.860335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.860360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.134 qpair failed and we were unable to recover it. 00:28:03.134 [2024-11-28 19:16:23.860465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.860550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.860575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.134 qpair failed and we were unable to recover it. 00:28:03.134 [2024-11-28 19:16:23.860688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.860772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.860796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.134 qpair failed and we were unable to recover it. 00:28:03.134 [2024-11-28 19:16:23.860910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.860985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.861010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.134 qpair failed and we were unable to recover it. 00:28:03.134 [2024-11-28 19:16:23.861090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.861178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.861202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.134 qpair failed and we were unable to recover it. 00:28:03.134 [2024-11-28 19:16:23.861314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.861387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.861416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.134 qpair failed and we were unable to recover it. 00:28:03.134 [2024-11-28 19:16:23.861523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.134 [2024-11-28 19:16:23.861601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.861625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.135 qpair failed and we were unable to recover it. 00:28:03.135 [2024-11-28 19:16:23.861714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.861900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.861925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.135 qpair failed and we were unable to recover it. 00:28:03.135 [2024-11-28 19:16:23.862044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.862165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.862193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.135 qpair failed and we were unable to recover it. 00:28:03.135 [2024-11-28 19:16:23.862304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.862429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.862455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.135 qpair failed and we were unable to recover it. 00:28:03.135 [2024-11-28 19:16:23.862644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.862743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.862771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.135 qpair failed and we were unable to recover it. 00:28:03.135 [2024-11-28 19:16:23.862897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.863010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.863035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.135 qpair failed and we were unable to recover it. 00:28:03.135 [2024-11-28 19:16:23.863151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.863282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.863306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.135 qpair failed and we were unable to recover it. 00:28:03.135 [2024-11-28 19:16:23.863388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.863477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.863504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.135 qpair failed and we were unable to recover it. 00:28:03.135 [2024-11-28 19:16:23.863591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.863712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.863738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.135 qpair failed and we were unable to recover it. 00:28:03.135 [2024-11-28 19:16:23.863852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.864037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.864062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.135 qpair failed and we were unable to recover it. 00:28:03.135 [2024-11-28 19:16:23.864223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.864340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.864368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.135 qpair failed and we were unable to recover it. 00:28:03.135 [2024-11-28 19:16:23.864475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.864580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.864604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.135 qpair failed and we were unable to recover it. 00:28:03.135 [2024-11-28 19:16:23.864744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.864832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.864856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.135 qpair failed and we were unable to recover it. 00:28:03.135 [2024-11-28 19:16:23.865045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.865183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.865207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.135 qpair failed and we were unable to recover it. 00:28:03.135 [2024-11-28 19:16:23.865291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.865367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.865391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.135 qpair failed and we were unable to recover it. 00:28:03.135 [2024-11-28 19:16:23.865498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.865604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.865635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.135 qpair failed and we were unable to recover it. 00:28:03.135 [2024-11-28 19:16:23.865750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.865835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.865862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.135 qpair failed and we were unable to recover it. 00:28:03.135 [2024-11-28 19:16:23.865978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.866090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.866115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.135 qpair failed and we were unable to recover it. 00:28:03.135 [2024-11-28 19:16:23.866235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.866350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.866375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.135 qpair failed and we were unable to recover it. 00:28:03.135 [2024-11-28 19:16:23.866501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.866593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.866619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.135 qpair failed and we were unable to recover it. 00:28:03.135 [2024-11-28 19:16:23.866733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.866843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.866869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.135 qpair failed and we were unable to recover it. 00:28:03.135 [2024-11-28 19:16:23.866958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.867073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.867098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.135 qpair failed and we were unable to recover it. 00:28:03.135 [2024-11-28 19:16:23.867182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.867291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.867316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.135 qpair failed and we were unable to recover it. 00:28:03.135 [2024-11-28 19:16:23.867444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.135 [2024-11-28 19:16:23.867561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.867586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.136 qpair failed and we were unable to recover it. 00:28:03.136 [2024-11-28 19:16:23.867675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.867787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.867812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.136 qpair failed and we were unable to recover it. 00:28:03.136 [2024-11-28 19:16:23.867910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.868026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.868053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.136 qpair failed and we were unable to recover it. 00:28:03.136 [2024-11-28 19:16:23.868169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.868256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.868282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.136 qpair failed and we were unable to recover it. 00:28:03.136 [2024-11-28 19:16:23.868391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.868482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.868507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.136 qpair failed and we were unable to recover it. 00:28:03.136 [2024-11-28 19:16:23.868613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.868690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.868716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.136 qpair failed and we were unable to recover it. 00:28:03.136 [2024-11-28 19:16:23.868814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.868901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.868930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.136 qpair failed and we were unable to recover it. 00:28:03.136 [2024-11-28 19:16:23.869042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.869160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.869187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.136 qpair failed and we were unable to recover it. 00:28:03.136 [2024-11-28 19:16:23.869300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.869417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.869444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.136 qpair failed and we were unable to recover it. 00:28:03.136 [2024-11-28 19:16:23.869560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.869647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.869677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.136 qpair failed and we were unable to recover it. 00:28:03.136 [2024-11-28 19:16:23.869764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.869903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.869929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.136 qpair failed and we were unable to recover it. 00:28:03.136 [2024-11-28 19:16:23.870016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.870139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.870165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.136 qpair failed and we were unable to recover it. 00:28:03.136 [2024-11-28 19:16:23.870256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.870402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.870429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.136 qpair failed and we were unable to recover it. 00:28:03.136 [2024-11-28 19:16:23.870545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.870652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.870677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.136 qpair failed and we were unable to recover it. 00:28:03.136 [2024-11-28 19:16:23.870791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.870901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.870928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.136 qpair failed and we were unable to recover it. 00:28:03.136 [2024-11-28 19:16:23.871012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.871130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.871157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.136 qpair failed and we were unable to recover it. 00:28:03.136 [2024-11-28 19:16:23.871248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.871362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.871387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.136 qpair failed and we were unable to recover it. 00:28:03.136 [2024-11-28 19:16:23.871484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.871574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.871599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.136 qpair failed and we were unable to recover it. 00:28:03.136 [2024-11-28 19:16:23.871691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.871768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.871793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.136 qpair failed and we were unable to recover it. 00:28:03.136 [2024-11-28 19:16:23.871918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.872037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.872065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.136 qpair failed and we were unable to recover it. 00:28:03.136 [2024-11-28 19:16:23.872151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.872244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.872287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.136 qpair failed and we were unable to recover it. 00:28:03.136 [2024-11-28 19:16:23.872376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.872572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.872599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.136 qpair failed and we were unable to recover it. 00:28:03.136 [2024-11-28 19:16:23.872793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.872916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.136 [2024-11-28 19:16:23.872943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.136 qpair failed and we were unable to recover it. 00:28:03.137 [2024-11-28 19:16:23.873060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.137 [2024-11-28 19:16:23.873172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.137 [2024-11-28 19:16:23.873200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.137 qpair failed and we were unable to recover it. 00:28:03.137 [2024-11-28 19:16:23.873333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.137 [2024-11-28 19:16:23.873417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.137 [2024-11-28 19:16:23.873444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.137 qpair failed and we were unable to recover it. 00:28:03.137 [2024-11-28 19:16:23.873553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.137 [2024-11-28 19:16:23.873702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.137 [2024-11-28 19:16:23.873729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.137 qpair failed and we were unable to recover it. 00:28:03.137 [2024-11-28 19:16:23.873813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.137 [2024-11-28 19:16:23.873924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.137 [2024-11-28 19:16:23.873952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.137 qpair failed and we were unable to recover it. 00:28:03.137 [2024-11-28 19:16:23.874049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.137 [2024-11-28 19:16:23.874243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.137 [2024-11-28 19:16:23.874283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.137 qpair failed and we were unable to recover it. 00:28:03.137 [2024-11-28 19:16:23.874447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.137 [2024-11-28 19:16:23.874570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.137 [2024-11-28 19:16:23.874597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.137 qpair failed and we were unable to recover it. 00:28:03.137 [2024-11-28 19:16:23.874688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.137 [2024-11-28 19:16:23.874790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.137 [2024-11-28 19:16:23.874818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.137 qpair failed and we were unable to recover it. 00:28:03.137 [2024-11-28 19:16:23.874948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.137 [2024-11-28 19:16:23.875029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.137 [2024-11-28 19:16:23.875057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.137 qpair failed and we were unable to recover it. 00:28:03.137 [2024-11-28 19:16:23.875187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.137 [2024-11-28 19:16:23.875264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.137 [2024-11-28 19:16:23.875289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.137 qpair failed and we were unable to recover it. 00:28:03.137 [2024-11-28 19:16:23.875422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.137 [2024-11-28 19:16:23.875495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.137 [2024-11-28 19:16:23.875525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.137 qpair failed and we were unable to recover it. 00:28:03.137 [2024-11-28 19:16:23.875600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.137 [2024-11-28 19:16:23.875684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.137 [2024-11-28 19:16:23.875710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.137 qpair failed and we were unable to recover it. 00:28:03.137 [2024-11-28 19:16:23.875850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.137 [2024-11-28 19:16:23.875944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.137 [2024-11-28 19:16:23.875971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.137 qpair failed and we were unable to recover it. 00:28:03.137 [2024-11-28 19:16:23.876059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.137 [2024-11-28 19:16:23.876173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.137 [2024-11-28 19:16:23.876201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.137 qpair failed and we were unable to recover it. 00:28:03.137 [2024-11-28 19:16:23.876332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.137 [2024-11-28 19:16:23.876448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.137 [2024-11-28 19:16:23.876473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.137 qpair failed and we were unable to recover it. 00:28:03.137 [2024-11-28 19:16:23.876589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.137 [2024-11-28 19:16:23.876690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.137 [2024-11-28 19:16:23.876717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.137 qpair failed and we were unable to recover it. 00:28:03.137 [2024-11-28 19:16:23.876865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.137 [2024-11-28 19:16:23.876955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.137 [2024-11-28 19:16:23.876985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.137 qpair failed and we were unable to recover it. 00:28:03.137 [2024-11-28 19:16:23.877139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.137 [2024-11-28 19:16:23.877231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.137 [2024-11-28 19:16:23.877272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.137 qpair failed and we were unable to recover it. 00:28:03.137 [2024-11-28 19:16:23.877351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.137 [2024-11-28 19:16:23.877502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.137 [2024-11-28 19:16:23.877528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.137 qpair failed and we were unable to recover it. 00:28:03.138 [2024-11-28 19:16:23.877611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.877742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.877770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.138 qpair failed and we were unable to recover it. 00:28:03.138 [2024-11-28 19:16:23.877864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.877983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.878010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.138 qpair failed and we were unable to recover it. 00:28:03.138 [2024-11-28 19:16:23.878138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.878235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.878262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.138 qpair failed and we were unable to recover it. 00:28:03.138 [2024-11-28 19:16:23.878363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.878491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.878516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.138 qpair failed and we were unable to recover it. 00:28:03.138 [2024-11-28 19:16:23.878669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.878759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.878787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.138 qpair failed and we were unable to recover it. 00:28:03.138 [2024-11-28 19:16:23.878908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.879073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.879102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.138 qpair failed and we were unable to recover it. 00:28:03.138 [2024-11-28 19:16:23.879231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.879337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.879362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.138 qpair failed and we were unable to recover it. 00:28:03.138 [2024-11-28 19:16:23.879485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.879564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.879605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.138 qpair failed and we were unable to recover it. 00:28:03.138 [2024-11-28 19:16:23.879727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.879850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.879877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.138 qpair failed and we were unable to recover it. 00:28:03.138 [2024-11-28 19:16:23.879965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.880053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.880081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.138 qpair failed and we were unable to recover it. 00:28:03.138 [2024-11-28 19:16:23.880198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.880276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.880302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.138 qpair failed and we were unable to recover it. 00:28:03.138 [2024-11-28 19:16:23.880415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.880517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.880542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.138 qpair failed and we were unable to recover it. 00:28:03.138 [2024-11-28 19:16:23.880661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.880758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.880785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.138 qpair failed and we were unable to recover it. 00:28:03.138 [2024-11-28 19:16:23.880911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.880997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.881026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.138 qpair failed and we were unable to recover it. 00:28:03.138 [2024-11-28 19:16:23.881206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.881368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.881398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.138 qpair failed and we were unable to recover it. 00:28:03.138 [2024-11-28 19:16:23.881491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.881573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.881598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.138 qpair failed and we were unable to recover it. 00:28:03.138 [2024-11-28 19:16:23.881710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.881818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.881859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.138 qpair failed and we were unable to recover it. 00:28:03.138 [2024-11-28 19:16:23.882006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.882126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.882154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.138 qpair failed and we were unable to recover it. 00:28:03.138 [2024-11-28 19:16:23.882276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.882369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.882408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.138 qpair failed and we were unable to recover it. 00:28:03.138 [2024-11-28 19:16:23.882576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.882704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.882732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.138 qpair failed and we were unable to recover it. 00:28:03.138 [2024-11-28 19:16:23.882832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.882931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.882959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.138 qpair failed and we were unable to recover it. 00:28:03.138 [2024-11-28 19:16:23.883086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.883199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.138 [2024-11-28 19:16:23.883226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.138 qpair failed and we were unable to recover it. 00:28:03.138 [2024-11-28 19:16:23.883320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.883455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.883481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.139 qpair failed and we were unable to recover it. 00:28:03.139 [2024-11-28 19:16:23.883589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.883676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.883703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.139 qpair failed and we were unable to recover it. 00:28:03.139 [2024-11-28 19:16:23.883804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.883955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.883983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.139 qpair failed and we were unable to recover it. 00:28:03.139 [2024-11-28 19:16:23.884078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.884165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.884192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.139 qpair failed and we were unable to recover it. 00:28:03.139 [2024-11-28 19:16:23.884295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.884376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.884417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.139 qpair failed and we were unable to recover it. 00:28:03.139 [2024-11-28 19:16:23.884509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.884648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.884675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.139 qpair failed and we were unable to recover it. 00:28:03.139 [2024-11-28 19:16:23.884769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.884883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.884910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.139 qpair failed and we were unable to recover it. 00:28:03.139 [2024-11-28 19:16:23.885004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.885122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.885165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.139 qpair failed and we were unable to recover it. 00:28:03.139 [2024-11-28 19:16:23.885354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.885472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.885499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.139 qpair failed and we were unable to recover it. 00:28:03.139 [2024-11-28 19:16:23.885589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.885715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.885743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.139 qpair failed and we were unable to recover it. 00:28:03.139 [2024-11-28 19:16:23.885845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.885944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.885972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.139 qpair failed and we were unable to recover it. 00:28:03.139 [2024-11-28 19:16:23.886119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.886216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.886243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.139 qpair failed and we were unable to recover it. 00:28:03.139 [2024-11-28 19:16:23.886342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.886428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.886454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.139 qpair failed and we were unable to recover it. 00:28:03.139 [2024-11-28 19:16:23.886573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.886687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.886714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.139 qpair failed and we were unable to recover it. 00:28:03.139 [2024-11-28 19:16:23.886807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.886916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.886943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.139 qpair failed and we were unable to recover it. 00:28:03.139 [2024-11-28 19:16:23.887028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.887174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.887201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.139 qpair failed and we were unable to recover it. 00:28:03.139 [2024-11-28 19:16:23.887331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.887430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.887459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.139 qpair failed and we were unable to recover it. 00:28:03.139 [2024-11-28 19:16:23.887568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.887670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.887713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.139 qpair failed and we were unable to recover it. 00:28:03.139 [2024-11-28 19:16:23.887838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.887976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.888004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.139 qpair failed and we were unable to recover it. 00:28:03.139 [2024-11-28 19:16:23.888118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.888233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.888259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.139 qpair failed and we were unable to recover it. 00:28:03.139 [2024-11-28 19:16:23.888349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.888442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.888474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.139 qpair failed and we were unable to recover it. 00:28:03.139 [2024-11-28 19:16:23.888565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.888650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.888675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.139 qpair failed and we were unable to recover it. 00:28:03.139 [2024-11-28 19:16:23.888784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.139 [2024-11-28 19:16:23.888870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.888896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.140 qpair failed and we were unable to recover it. 00:28:03.140 [2024-11-28 19:16:23.888993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.889136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.889163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.140 qpair failed and we were unable to recover it. 00:28:03.140 [2024-11-28 19:16:23.889304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.889385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.889416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.140 qpair failed and we were unable to recover it. 00:28:03.140 [2024-11-28 19:16:23.889504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.889614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.889645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.140 qpair failed and we were unable to recover it. 00:28:03.140 [2024-11-28 19:16:23.889758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.889856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.889882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.140 qpair failed and we were unable to recover it. 00:28:03.140 [2024-11-28 19:16:23.889972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.890090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.890115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.140 qpair failed and we were unable to recover it. 00:28:03.140 [2024-11-28 19:16:23.890205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.890321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.890346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.140 qpair failed and we were unable to recover it. 00:28:03.140 [2024-11-28 19:16:23.890434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.890526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.890551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.140 qpair failed and we were unable to recover it. 00:28:03.140 [2024-11-28 19:16:23.890639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.890745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.890779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.140 qpair failed and we were unable to recover it. 00:28:03.140 [2024-11-28 19:16:23.890911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.891044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.891069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.140 qpair failed and we were unable to recover it. 00:28:03.140 [2024-11-28 19:16:23.891183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.891373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.891404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.140 qpair failed and we were unable to recover it. 00:28:03.140 [2024-11-28 19:16:23.891513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.891594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.891621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.140 qpair failed and we were unable to recover it. 00:28:03.140 [2024-11-28 19:16:23.891741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.891862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.891890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.140 qpair failed and we were unable to recover it. 00:28:03.140 [2024-11-28 19:16:23.892007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.892097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.892124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.140 qpair failed and we were unable to recover it. 00:28:03.140 [2024-11-28 19:16:23.892223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.892342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.892384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.140 qpair failed and we were unable to recover it. 00:28:03.140 [2024-11-28 19:16:23.892504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.892601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.892629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.140 qpair failed and we were unable to recover it. 00:28:03.140 [2024-11-28 19:16:23.892752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.892863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.892891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.140 qpair failed and we were unable to recover it. 00:28:03.140 [2024-11-28 19:16:23.893001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.893079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.893104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.140 qpair failed and we were unable to recover it. 00:28:03.140 [2024-11-28 19:16:23.893193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.893275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.893300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.140 qpair failed and we were unable to recover it. 00:28:03.140 [2024-11-28 19:16:23.893420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.893555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.893583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.140 qpair failed and we were unable to recover it. 00:28:03.140 [2024-11-28 19:16:23.893699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.893787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.893814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.140 qpair failed and we were unable to recover it. 00:28:03.140 [2024-11-28 19:16:23.893902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.894022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.140 [2024-11-28 19:16:23.894049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.140 qpair failed and we were unable to recover it. 00:28:03.141 [2024-11-28 19:16:23.894160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.894271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.894295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.141 qpair failed and we were unable to recover it. 00:28:03.141 [2024-11-28 19:16:23.894383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.894471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.894497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.141 qpair failed and we were unable to recover it. 00:28:03.141 [2024-11-28 19:16:23.894597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.894686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.894713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.141 qpair failed and we were unable to recover it. 00:28:03.141 [2024-11-28 19:16:23.894829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.894919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.894946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.141 qpair failed and we were unable to recover it. 00:28:03.141 [2024-11-28 19:16:23.895025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.895136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.895161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.141 qpair failed and we were unable to recover it. 00:28:03.141 [2024-11-28 19:16:23.895295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.895406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.895448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.141 qpair failed and we were unable to recover it. 00:28:03.141 [2024-11-28 19:16:23.895571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.895658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.895685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.141 qpair failed and we were unable to recover it. 00:28:03.141 [2024-11-28 19:16:23.895814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.895937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.895965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.141 qpair failed and we were unable to recover it. 00:28:03.141 [2024-11-28 19:16:23.896073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.896168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.896194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.141 qpair failed and we were unable to recover it. 00:28:03.141 [2024-11-28 19:16:23.896281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.896362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.896387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.141 qpair failed and we were unable to recover it. 00:28:03.141 [2024-11-28 19:16:23.896486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.896574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.896603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.141 qpair failed and we were unable to recover it. 00:28:03.141 [2024-11-28 19:16:23.896699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.896784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.896812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.141 qpair failed and we were unable to recover it. 00:28:03.141 [2024-11-28 19:16:23.896895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.896974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.896999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.141 qpair failed and we were unable to recover it. 00:28:03.141 [2024-11-28 19:16:23.897089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.897228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.897253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.141 qpair failed and we were unable to recover it. 00:28:03.141 [2024-11-28 19:16:23.897347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.897434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.897459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.141 qpair failed and we were unable to recover it. 00:28:03.141 [2024-11-28 19:16:23.897543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.897655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.897680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.141 qpair failed and we were unable to recover it. 00:28:03.141 [2024-11-28 19:16:23.897764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.897869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.897896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.141 qpair failed and we were unable to recover it. 00:28:03.141 [2024-11-28 19:16:23.898025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.898122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.898147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.141 qpair failed and we were unable to recover it. 00:28:03.141 [2024-11-28 19:16:23.898238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.898348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.898374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.141 qpair failed and we were unable to recover it. 00:28:03.141 [2024-11-28 19:16:23.898472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.898567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.898593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.141 qpair failed and we were unable to recover it. 00:28:03.141 [2024-11-28 19:16:23.898706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.898814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.898840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.141 qpair failed and we were unable to recover it. 00:28:03.141 [2024-11-28 19:16:23.898932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.899020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.141 [2024-11-28 19:16:23.899046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.141 qpair failed and we were unable to recover it. 00:28:03.142 [2024-11-28 19:16:23.899158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.899243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.899268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.142 qpair failed and we were unable to recover it. 00:28:03.142 [2024-11-28 19:16:23.899352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.899434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.899460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.142 qpair failed and we were unable to recover it. 00:28:03.142 [2024-11-28 19:16:23.899577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.899715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.899740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.142 qpair failed and we were unable to recover it. 00:28:03.142 [2024-11-28 19:16:23.899822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.899908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.899932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.142 qpair failed and we were unable to recover it. 00:28:03.142 [2024-11-28 19:16:23.900019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.900130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.900155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.142 qpair failed and we were unable to recover it. 00:28:03.142 [2024-11-28 19:16:23.900257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.900385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.900429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.142 qpair failed and we were unable to recover it. 00:28:03.142 [2024-11-28 19:16:23.900566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.900669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.900702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.142 qpair failed and we were unable to recover it. 00:28:03.142 [2024-11-28 19:16:23.900827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.900916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.900950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.142 qpair failed and we were unable to recover it. 00:28:03.142 [2024-11-28 19:16:23.901044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.901138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.901169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.142 qpair failed and we were unable to recover it. 00:28:03.142 [2024-11-28 19:16:23.901291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.901410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.901457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.142 qpair failed and we were unable to recover it. 00:28:03.142 [2024-11-28 19:16:23.901569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.901696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.901738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.142 qpair failed and we were unable to recover it. 00:28:03.142 [2024-11-28 19:16:23.901899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.901994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.902022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.142 qpair failed and we were unable to recover it. 00:28:03.142 [2024-11-28 19:16:23.902115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.902215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.902242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.142 qpair failed and we were unable to recover it. 00:28:03.142 [2024-11-28 19:16:23.902374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.902543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.902571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.142 qpair failed and we were unable to recover it. 00:28:03.142 [2024-11-28 19:16:23.902663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.902780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.902807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.142 qpair failed and we were unable to recover it. 00:28:03.142 [2024-11-28 19:16:23.902956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.903057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.903085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.142 qpair failed and we were unable to recover it. 00:28:03.142 [2024-11-28 19:16:23.903176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.903309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.903334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.142 qpair failed and we were unable to recover it. 00:28:03.142 [2024-11-28 19:16:23.903447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.903529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.903555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.142 qpair failed and we were unable to recover it. 00:28:03.142 [2024-11-28 19:16:23.903686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.903768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.903809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.142 qpair failed and we were unable to recover it. 00:28:03.142 [2024-11-28 19:16:23.903918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.904024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.904049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.142 qpair failed and we were unable to recover it. 00:28:03.142 [2024-11-28 19:16:23.904169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.904248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.142 [2024-11-28 19:16:23.904273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.142 qpair failed and we were unable to recover it. 00:28:03.142 [2024-11-28 19:16:23.904347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.143 [2024-11-28 19:16:23.904420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.143 [2024-11-28 19:16:23.904445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.143 qpair failed and we were unable to recover it. 00:28:03.143 [2024-11-28 19:16:23.904541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.143 [2024-11-28 19:16:23.904689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.143 [2024-11-28 19:16:23.904717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.143 qpair failed and we were unable to recover it. 00:28:03.143 [2024-11-28 19:16:23.904836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.143 [2024-11-28 19:16:23.904955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.143 [2024-11-28 19:16:23.904982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.143 qpair failed and we were unable to recover it. 00:28:03.143 [2024-11-28 19:16:23.905104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.143 [2024-11-28 19:16:23.905217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.143 [2024-11-28 19:16:23.905244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.143 qpair failed and we were unable to recover it. 00:28:03.143 [2024-11-28 19:16:23.905341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.143 [2024-11-28 19:16:23.905533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.143 [2024-11-28 19:16:23.905566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.143 qpair failed and we were unable to recover it. 00:28:03.143 [2024-11-28 19:16:23.905720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.143 [2024-11-28 19:16:23.905843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.143 [2024-11-28 19:16:23.905872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.143 qpair failed and we were unable to recover it. 00:28:03.143 [2024-11-28 19:16:23.906037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.143 [2024-11-28 19:16:23.906165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.143 [2024-11-28 19:16:23.906191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.143 qpair failed and we were unable to recover it. 00:28:03.143 [2024-11-28 19:16:23.906276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.143 [2024-11-28 19:16:23.906354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.143 [2024-11-28 19:16:23.906379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.143 qpair failed and we were unable to recover it. 00:28:03.143 [2024-11-28 19:16:23.906501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.143 [2024-11-28 19:16:23.906590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.143 [2024-11-28 19:16:23.906616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.143 qpair failed and we were unable to recover it. 00:28:03.143 [2024-11-28 19:16:23.906727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.143 [2024-11-28 19:16:23.906812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.143 [2024-11-28 19:16:23.906837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.143 qpair failed and we were unable to recover it. 00:28:03.143 [2024-11-28 19:16:23.906949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.143 [2024-11-28 19:16:23.907061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.143 [2024-11-28 19:16:23.907086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.143 qpair failed and we were unable to recover it. 00:28:03.143 [2024-11-28 19:16:23.907193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.143 [2024-11-28 19:16:23.907281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.143 [2024-11-28 19:16:23.907306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.143 qpair failed and we were unable to recover it. 00:28:03.143 [2024-11-28 19:16:23.907424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.143 [2024-11-28 19:16:23.907504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.143 [2024-11-28 19:16:23.907533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.143 qpair failed and we were unable to recover it. 00:28:03.143 [2024-11-28 19:16:23.907623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.143 [2024-11-28 19:16:23.907729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.143 [2024-11-28 19:16:23.907754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.143 qpair failed and we were unable to recover it. 00:28:03.143 [2024-11-28 19:16:23.907846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.143 [2024-11-28 19:16:23.907955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.143 [2024-11-28 19:16:23.907989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.143 qpair failed and we were unable to recover it. 00:28:03.143 [2024-11-28 19:16:23.908079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.143 [2024-11-28 19:16:23.908190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.143 [2024-11-28 19:16:23.908217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.143 qpair failed and we were unable to recover it. 00:28:03.143 [2024-11-28 19:16:23.908334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.143 [2024-11-28 19:16:23.908422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.143 [2024-11-28 19:16:23.908448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.143 qpair failed and we were unable to recover it. 00:28:03.144 [2024-11-28 19:16:23.908533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.908648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.908674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.144 qpair failed and we were unable to recover it. 00:28:03.144 [2024-11-28 19:16:23.908786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.908861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.908886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.144 qpair failed and we were unable to recover it. 00:28:03.144 [2024-11-28 19:16:23.908971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.909061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.909086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.144 qpair failed and we were unable to recover it. 00:28:03.144 [2024-11-28 19:16:23.909198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.909314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.909338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.144 qpair failed and we were unable to recover it. 00:28:03.144 [2024-11-28 19:16:23.909423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.909512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.909536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.144 qpair failed and we were unable to recover it. 00:28:03.144 [2024-11-28 19:16:23.909652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.909732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.909757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.144 qpair failed and we were unable to recover it. 00:28:03.144 [2024-11-28 19:16:23.909875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.909985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.910011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.144 qpair failed and we were unable to recover it. 00:28:03.144 [2024-11-28 19:16:23.910106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.910214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.910244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.144 qpair failed and we were unable to recover it. 00:28:03.144 [2024-11-28 19:16:23.910361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.910489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.910517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.144 qpair failed and we were unable to recover it. 00:28:03.144 [2024-11-28 19:16:23.910608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.910689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.910715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.144 qpair failed and we were unable to recover it. 00:28:03.144 [2024-11-28 19:16:23.910830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.910941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.910966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.144 qpair failed and we were unable to recover it. 00:28:03.144 [2024-11-28 19:16:23.911101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.911214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.911240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.144 qpair failed and we were unable to recover it. 00:28:03.144 [2024-11-28 19:16:23.911354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.911470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.911496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.144 qpair failed and we were unable to recover it. 00:28:03.144 [2024-11-28 19:16:23.911593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.911711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.911736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.144 qpair failed and we were unable to recover it. 00:28:03.144 [2024-11-28 19:16:23.911852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.911963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.911989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.144 qpair failed and we were unable to recover it. 00:28:03.144 [2024-11-28 19:16:23.912075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.912184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.912210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.144 qpair failed and we were unable to recover it. 00:28:03.144 [2024-11-28 19:16:23.912299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.912414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.912440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.144 qpair failed and we were unable to recover it. 00:28:03.144 [2024-11-28 19:16:23.912527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.912617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.912646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.144 qpair failed and we were unable to recover it. 00:28:03.144 [2024-11-28 19:16:23.912766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.912859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.912883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.144 qpair failed and we were unable to recover it. 00:28:03.144 [2024-11-28 19:16:23.912969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.913053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.913078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.144 qpair failed and we were unable to recover it. 00:28:03.144 [2024-11-28 19:16:23.913222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.144 [2024-11-28 19:16:23.913358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.913383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.145 qpair failed and we were unable to recover it. 00:28:03.145 [2024-11-28 19:16:23.913472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.913553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.913579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.145 qpair failed and we were unable to recover it. 00:28:03.145 [2024-11-28 19:16:23.913659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.913738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.913763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.145 qpair failed and we were unable to recover it. 00:28:03.145 [2024-11-28 19:16:23.913855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.913997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.914022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.145 qpair failed and we were unable to recover it. 00:28:03.145 [2024-11-28 19:16:23.914102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.914213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.914237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.145 qpair failed and we were unable to recover it. 00:28:03.145 [2024-11-28 19:16:23.914319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.914405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.914430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.145 qpair failed and we were unable to recover it. 00:28:03.145 [2024-11-28 19:16:23.914512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.914621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.914648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.145 qpair failed and we were unable to recover it. 00:28:03.145 [2024-11-28 19:16:23.914733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.914850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.914875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.145 qpair failed and we were unable to recover it. 00:28:03.145 [2024-11-28 19:16:23.914990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.915096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.915121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.145 qpair failed and we were unable to recover it. 00:28:03.145 [2024-11-28 19:16:23.915210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.915322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.915346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.145 qpair failed and we were unable to recover it. 00:28:03.145 [2024-11-28 19:16:23.915432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.915520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.915545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.145 qpair failed and we were unable to recover it. 00:28:03.145 [2024-11-28 19:16:23.915688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.915799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.915824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.145 qpair failed and we were unable to recover it. 00:28:03.145 [2024-11-28 19:16:23.915945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.916062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.916087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.145 qpair failed and we were unable to recover it. 00:28:03.145 [2024-11-28 19:16:23.916183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.916318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.916343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.145 qpair failed and we were unable to recover it. 00:28:03.145 [2024-11-28 19:16:23.916448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.916567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.916592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.145 qpair failed and we were unable to recover it. 00:28:03.145 [2024-11-28 19:16:23.916708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.916797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.916823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.145 qpair failed and we were unable to recover it. 00:28:03.145 [2024-11-28 19:16:23.916943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.917057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.917081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.145 qpair failed and we were unable to recover it. 00:28:03.145 [2024-11-28 19:16:23.917197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.917316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.917341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.145 qpair failed and we were unable to recover it. 00:28:03.145 [2024-11-28 19:16:23.917455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.917579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.917612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.145 qpair failed and we were unable to recover it. 00:28:03.145 [2024-11-28 19:16:23.917741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.917858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.917889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.145 qpair failed and we were unable to recover it. 00:28:03.145 [2024-11-28 19:16:23.918043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.918165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.918193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.145 qpair failed and we were unable to recover it. 00:28:03.145 [2024-11-28 19:16:23.918306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.145 [2024-11-28 19:16:23.918412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.918460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.146 qpair failed and we were unable to recover it. 00:28:03.146 [2024-11-28 19:16:23.918587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.918713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.918746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.146 qpair failed and we were unable to recover it. 00:28:03.146 [2024-11-28 19:16:23.918871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.919013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.919045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.146 qpair failed and we were unable to recover it. 00:28:03.146 [2024-11-28 19:16:23.919157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.919245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.919286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.146 qpair failed and we were unable to recover it. 00:28:03.146 [2024-11-28 19:16:23.919406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.919490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.919516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.146 qpair failed and we were unable to recover it. 00:28:03.146 [2024-11-28 19:16:23.919600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.919693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.919718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.146 qpair failed and we were unable to recover it. 00:28:03.146 [2024-11-28 19:16:23.919834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.919943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.919970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.146 qpair failed and we were unable to recover it. 00:28:03.146 [2024-11-28 19:16:23.920094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.920180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.920207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.146 qpair failed and we were unable to recover it. 00:28:03.146 [2024-11-28 19:16:23.920332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.920446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.920472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.146 qpair failed and we were unable to recover it. 00:28:03.146 [2024-11-28 19:16:23.920603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.920700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.920727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.146 qpair failed and we were unable to recover it. 00:28:03.146 [2024-11-28 19:16:23.920845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.920952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.920980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.146 qpair failed and we were unable to recover it. 00:28:03.146 [2024-11-28 19:16:23.921077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.921191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.921219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.146 qpair failed and we were unable to recover it. 00:28:03.146 [2024-11-28 19:16:23.921326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.921414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.921440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.146 qpair failed and we were unable to recover it. 00:28:03.146 [2024-11-28 19:16:23.921523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.921652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.921678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.146 qpair failed and we were unable to recover it. 00:28:03.146 [2024-11-28 19:16:23.921768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.921911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.921939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.146 qpair failed and we were unable to recover it. 00:28:03.146 [2024-11-28 19:16:23.922046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.922175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.922203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.146 qpair failed and we were unable to recover it. 00:28:03.146 [2024-11-28 19:16:23.922310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.922382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.922414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.146 qpair failed and we were unable to recover it. 00:28:03.146 [2024-11-28 19:16:23.922552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.922650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.922678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.146 qpair failed and we were unable to recover it. 00:28:03.146 [2024-11-28 19:16:23.922766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.922860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.922887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.146 qpair failed and we were unable to recover it. 00:28:03.146 [2024-11-28 19:16:23.923010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.923143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.923173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.146 qpair failed and we were unable to recover it. 00:28:03.146 [2024-11-28 19:16:23.923297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.923421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.923463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.146 qpair failed and we were unable to recover it. 00:28:03.146 [2024-11-28 19:16:23.923564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.923679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.146 [2024-11-28 19:16:23.923708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.146 qpair failed and we were unable to recover it. 00:28:03.147 [2024-11-28 19:16:23.923832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.923922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.923950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.147 qpair failed and we were unable to recover it. 00:28:03.147 [2024-11-28 19:16:23.924042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.924162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.924189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.147 qpair failed and we were unable to recover it. 00:28:03.147 [2024-11-28 19:16:23.924318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.924407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.924433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.147 qpair failed and we were unable to recover it. 00:28:03.147 [2024-11-28 19:16:23.924523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.924608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.924633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.147 qpair failed and we were unable to recover it. 00:28:03.147 [2024-11-28 19:16:23.924775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.924863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.924890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.147 qpair failed and we were unable to recover it. 00:28:03.147 [2024-11-28 19:16:23.924993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.925118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.925145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.147 qpair failed and we were unable to recover it. 00:28:03.147 [2024-11-28 19:16:23.925267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.925355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.925383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.147 qpair failed and we were unable to recover it. 00:28:03.147 [2024-11-28 19:16:23.925500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.925610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.925637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.147 qpair failed and we were unable to recover it. 00:28:03.147 [2024-11-28 19:16:23.925732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.925821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.925849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.147 qpair failed and we were unable to recover it. 00:28:03.147 [2024-11-28 19:16:23.925973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.926058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.926087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.147 qpair failed and we were unable to recover it. 00:28:03.147 [2024-11-28 19:16:23.926220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.926302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.926327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.147 qpair failed and we were unable to recover it. 00:28:03.147 [2024-11-28 19:16:23.926410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.926498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.926522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.147 qpair failed and we were unable to recover it. 00:28:03.147 [2024-11-28 19:16:23.926633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.926782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.926806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.147 qpair failed and we were unable to recover it. 00:28:03.147 [2024-11-28 19:16:23.926948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.927027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.927052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.147 qpair failed and we were unable to recover it. 00:28:03.147 [2024-11-28 19:16:23.927153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.927237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.927262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.147 qpair failed and we were unable to recover it. 00:28:03.147 [2024-11-28 19:16:23.927347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.927464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.927489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.147 qpair failed and we were unable to recover it. 00:28:03.147 [2024-11-28 19:16:23.927607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.927692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.927717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.147 qpair failed and we were unable to recover it. 00:28:03.147 [2024-11-28 19:16:23.927799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.927902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.927927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.147 qpair failed and we were unable to recover it. 00:28:03.147 [2024-11-28 19:16:23.928014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.928100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.928126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.147 qpair failed and we were unable to recover it. 00:28:03.147 [2024-11-28 19:16:23.928250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.928323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.928364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.147 qpair failed and we were unable to recover it. 00:28:03.147 [2024-11-28 19:16:23.928467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.928542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.147 [2024-11-28 19:16:23.928567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.147 qpair failed and we were unable to recover it. 00:28:03.148 [2024-11-28 19:16:23.928680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.928758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.928783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.148 qpair failed and we were unable to recover it. 00:28:03.148 [2024-11-28 19:16:23.928860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.928946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.928972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.148 qpair failed and we were unable to recover it. 00:28:03.148 [2024-11-28 19:16:23.929058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.929168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.929193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.148 qpair failed and we were unable to recover it. 00:28:03.148 [2024-11-28 19:16:23.929306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.929402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.929428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.148 qpair failed and we were unable to recover it. 00:28:03.148 [2024-11-28 19:16:23.929517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.929643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.929676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.148 qpair failed and we were unable to recover it. 00:28:03.148 [2024-11-28 19:16:23.929793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.929911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.929939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.148 qpair failed and we were unable to recover it. 00:28:03.148 [2024-11-28 19:16:23.930101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.930219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.930249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.148 qpair failed and we were unable to recover it. 00:28:03.148 [2024-11-28 19:16:23.930352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.930473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.930501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.148 qpair failed and we were unable to recover it. 00:28:03.148 [2024-11-28 19:16:23.930592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.930681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.930713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.148 qpair failed and we were unable to recover it. 00:28:03.148 [2024-11-28 19:16:23.930837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.930935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.930962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.148 qpair failed and we were unable to recover it. 00:28:03.148 [2024-11-28 19:16:23.931055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.931145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.931170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.148 qpair failed and we were unable to recover it. 00:28:03.148 [2024-11-28 19:16:23.931307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.931399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.931427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.148 qpair failed and we were unable to recover it. 00:28:03.148 [2024-11-28 19:16:23.931521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.931632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.931657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.148 qpair failed and we were unable to recover it. 00:28:03.148 [2024-11-28 19:16:23.931749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.931855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.931881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.148 qpair failed and we were unable to recover it. 00:28:03.148 [2024-11-28 19:16:23.931961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.932076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.932101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.148 qpair failed and we were unable to recover it. 00:28:03.148 [2024-11-28 19:16:23.932172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.932282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.932307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.148 qpair failed and we were unable to recover it. 00:28:03.148 [2024-11-28 19:16:23.932418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.932507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.932533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.148 qpair failed and we were unable to recover it. 00:28:03.148 [2024-11-28 19:16:23.932614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.932728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.932752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.148 qpair failed and we were unable to recover it. 00:28:03.148 [2024-11-28 19:16:23.932854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.932970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.932995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.148 qpair failed and we were unable to recover it. 00:28:03.148 [2024-11-28 19:16:23.933078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.933162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.933186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.148 qpair failed and we were unable to recover it. 00:28:03.148 [2024-11-28 19:16:23.933323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.148 [2024-11-28 19:16:23.933409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.933435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.149 qpair failed and we were unable to recover it. 00:28:03.149 [2024-11-28 19:16:23.933527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.933616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.933641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.149 qpair failed and we were unable to recover it. 00:28:03.149 [2024-11-28 19:16:23.933753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.933858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.933899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.149 qpair failed and we were unable to recover it. 00:28:03.149 [2024-11-28 19:16:23.934011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.934093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.934118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.149 qpair failed and we were unable to recover it. 00:28:03.149 [2024-11-28 19:16:23.934204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.934318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.934344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.149 qpair failed and we were unable to recover it. 00:28:03.149 [2024-11-28 19:16:23.934456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.934535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.934560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.149 qpair failed and we were unable to recover it. 00:28:03.149 [2024-11-28 19:16:23.934648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.934725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.934751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.149 qpair failed and we were unable to recover it. 00:28:03.149 [2024-11-28 19:16:23.934838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.934954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.934982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.149 qpair failed and we were unable to recover it. 00:28:03.149 [2024-11-28 19:16:23.935085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.935172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.935196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.149 qpair failed and we were unable to recover it. 00:28:03.149 [2024-11-28 19:16:23.935276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.935398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.935424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.149 qpair failed and we were unable to recover it. 00:28:03.149 [2024-11-28 19:16:23.935509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.935589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.935614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.149 qpair failed and we were unable to recover it. 00:28:03.149 [2024-11-28 19:16:23.935703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.935822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.935847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.149 qpair failed and we were unable to recover it. 00:28:03.149 [2024-11-28 19:16:23.936001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.936081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.936105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.149 qpair failed and we were unable to recover it. 00:28:03.149 [2024-11-28 19:16:23.936196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.936280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.936305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.149 qpair failed and we were unable to recover it. 00:28:03.149 [2024-11-28 19:16:23.936419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.936601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.936643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.149 qpair failed and we were unable to recover it. 00:28:03.149 [2024-11-28 19:16:23.936729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.936809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.936834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.149 qpair failed and we were unable to recover it. 00:28:03.149 [2024-11-28 19:16:23.936926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.937064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.937090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.149 qpair failed and we were unable to recover it. 00:28:03.149 [2024-11-28 19:16:23.937198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.937292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.937333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.149 qpair failed and we were unable to recover it. 00:28:03.149 [2024-11-28 19:16:23.937461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.937547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.937572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.149 qpair failed and we were unable to recover it. 00:28:03.149 [2024-11-28 19:16:23.937659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.937789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.149 [2024-11-28 19:16:23.937817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.150 qpair failed and we were unable to recover it. 00:28:03.150 [2024-11-28 19:16:23.937957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.938042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.938068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.150 qpair failed and we were unable to recover it. 00:28:03.150 [2024-11-28 19:16:23.938179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.938318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.938343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.150 qpair failed and we were unable to recover it. 00:28:03.150 [2024-11-28 19:16:23.938468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.938582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.938606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.150 qpair failed and we were unable to recover it. 00:28:03.150 [2024-11-28 19:16:23.938698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.938795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.938821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.150 qpair failed and we were unable to recover it. 00:28:03.150 [2024-11-28 19:16:23.938904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.939023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.939049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.150 qpair failed and we were unable to recover it. 00:28:03.150 [2024-11-28 19:16:23.939150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.939262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.939287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.150 qpair failed and we were unable to recover it. 00:28:03.150 [2024-11-28 19:16:23.939370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.939459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.939484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.150 qpair failed and we were unable to recover it. 00:28:03.150 [2024-11-28 19:16:23.939602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.939687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.939712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.150 qpair failed and we were unable to recover it. 00:28:03.150 [2024-11-28 19:16:23.939847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.939924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.939949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.150 qpair failed and we were unable to recover it. 00:28:03.150 [2024-11-28 19:16:23.940031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.940143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.940168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.150 qpair failed and we were unable to recover it. 00:28:03.150 [2024-11-28 19:16:23.940247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.940354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.940378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.150 qpair failed and we were unable to recover it. 00:28:03.150 [2024-11-28 19:16:23.940472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.940608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.940636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.150 qpair failed and we were unable to recover it. 00:28:03.150 [2024-11-28 19:16:23.940761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.940870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.940896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.150 qpair failed and we were unable to recover it. 00:28:03.150 [2024-11-28 19:16:23.941010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.941121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.941145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.150 qpair failed and we were unable to recover it. 00:28:03.150 [2024-11-28 19:16:23.941232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.941313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.941342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.150 qpair failed and we were unable to recover it. 00:28:03.150 [2024-11-28 19:16:23.941426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.941537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.941579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.150 qpair failed and we were unable to recover it. 00:28:03.150 [2024-11-28 19:16:23.941750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.941871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.941895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.150 qpair failed and we were unable to recover it. 00:28:03.150 [2024-11-28 19:16:23.942008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.942115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.942140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.150 qpair failed and we were unable to recover it. 00:28:03.150 [2024-11-28 19:16:23.942268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.942379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.942409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.150 qpair failed and we were unable to recover it. 00:28:03.150 [2024-11-28 19:16:23.942518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.942629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.942654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.150 qpair failed and we were unable to recover it. 00:28:03.150 [2024-11-28 19:16:23.942815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.942915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.942943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.150 qpair failed and we were unable to recover it. 00:28:03.150 [2024-11-28 19:16:23.943045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.943179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.150 [2024-11-28 19:16:23.943205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.150 qpair failed and we were unable to recover it. 00:28:03.151 [2024-11-28 19:16:23.943320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.943410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.943437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.151 qpair failed and we were unable to recover it. 00:28:03.151 [2024-11-28 19:16:23.943542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.943672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.943709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.151 qpair failed and we were unable to recover it. 00:28:03.151 [2024-11-28 19:16:23.943841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.944001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.944031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.151 qpair failed and we were unable to recover it. 00:28:03.151 [2024-11-28 19:16:23.944150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.944228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.944253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.151 qpair failed and we were unable to recover it. 00:28:03.151 [2024-11-28 19:16:23.944343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.944460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.944500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.151 qpair failed and we were unable to recover it. 00:28:03.151 [2024-11-28 19:16:23.944635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.944758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.944786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.151 qpair failed and we were unable to recover it. 00:28:03.151 [2024-11-28 19:16:23.944940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.945081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.945122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.151 qpair failed and we were unable to recover it. 00:28:03.151 [2024-11-28 19:16:23.945290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.945409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.945435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.151 qpair failed and we were unable to recover it. 00:28:03.151 [2024-11-28 19:16:23.945515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.945621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.945649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.151 qpair failed and we were unable to recover it. 00:28:03.151 [2024-11-28 19:16:23.945818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.945929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.945955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.151 qpair failed and we were unable to recover it. 00:28:03.151 [2024-11-28 19:16:23.946067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.946237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.946262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.151 qpair failed and we were unable to recover it. 00:28:03.151 [2024-11-28 19:16:23.946377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.946524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.946552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.151 qpair failed and we were unable to recover it. 00:28:03.151 [2024-11-28 19:16:23.946657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.946775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.946805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.151 qpair failed and we were unable to recover it. 00:28:03.151 [2024-11-28 19:16:23.946887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.947048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.947076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.151 qpair failed and we were unable to recover it. 00:28:03.151 [2024-11-28 19:16:23.947205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.947327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.947354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.151 qpair failed and we were unable to recover it. 00:28:03.151 [2024-11-28 19:16:23.947466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.947604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.947629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.151 qpair failed and we were unable to recover it. 00:28:03.151 [2024-11-28 19:16:23.947764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.947848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.947876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.151 qpair failed and we were unable to recover it. 00:28:03.151 [2024-11-28 19:16:23.948021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.948110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.948134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.151 qpair failed and we were unable to recover it. 00:28:03.151 [2024-11-28 19:16:23.948244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.948362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.948387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.151 qpair failed and we were unable to recover it. 00:28:03.151 [2024-11-28 19:16:23.948485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.948598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.948622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.151 qpair failed and we were unable to recover it. 00:28:03.151 [2024-11-28 19:16:23.948752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.948877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.948905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.151 qpair failed and we were unable to recover it. 00:28:03.151 [2024-11-28 19:16:23.949012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.949119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.151 [2024-11-28 19:16:23.949144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.152 qpair failed and we were unable to recover it. 00:28:03.152 [2024-11-28 19:16:23.949236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.949430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.949464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.152 qpair failed and we were unable to recover it. 00:28:03.152 [2024-11-28 19:16:23.949617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.949738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.949767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.152 qpair failed and we were unable to recover it. 00:28:03.152 [2024-11-28 19:16:23.949913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.950022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.950048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.152 qpair failed and we were unable to recover it. 00:28:03.152 [2024-11-28 19:16:23.950184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.950334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.950362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.152 qpair failed and we were unable to recover it. 00:28:03.152 [2024-11-28 19:16:23.950493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.950616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.950644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.152 qpair failed and we were unable to recover it. 00:28:03.152 [2024-11-28 19:16:23.950760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.950869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.950894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.152 qpair failed and we were unable to recover it. 00:28:03.152 [2024-11-28 19:16:23.951003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.951084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.951109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.152 qpair failed and we were unable to recover it. 00:28:03.152 [2024-11-28 19:16:23.951188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.951328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.951355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.152 qpair failed and we were unable to recover it. 00:28:03.152 [2024-11-28 19:16:23.951466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.951609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.951634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.152 qpair failed and we were unable to recover it. 00:28:03.152 [2024-11-28 19:16:23.951786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.951870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.951898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.152 qpair failed and we were unable to recover it. 00:28:03.152 [2024-11-28 19:16:23.952021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.952142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.952170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.152 qpair failed and we were unable to recover it. 00:28:03.152 [2024-11-28 19:16:23.952335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.952420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.952456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.152 qpair failed and we were unable to recover it. 00:28:03.152 [2024-11-28 19:16:23.952598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.952723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.952750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.152 qpair failed and we were unable to recover it. 00:28:03.152 [2024-11-28 19:16:23.952868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.952984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.953011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.152 qpair failed and we were unable to recover it. 00:28:03.152 [2024-11-28 19:16:23.953112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.953251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.953276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.152 qpair failed and we were unable to recover it. 00:28:03.152 [2024-11-28 19:16:23.953409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.953522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.953550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.152 qpair failed and we were unable to recover it. 00:28:03.152 [2024-11-28 19:16:23.953645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.953774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.953801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.152 qpair failed and we were unable to recover it. 00:28:03.152 [2024-11-28 19:16:23.953913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.953997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.954022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.152 qpair failed and we were unable to recover it. 00:28:03.152 [2024-11-28 19:16:23.954136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.954262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.954288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.152 qpair failed and we were unable to recover it. 00:28:03.152 [2024-11-28 19:16:23.954439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.954570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.954597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.152 qpair failed and we were unable to recover it. 00:28:03.152 [2024-11-28 19:16:23.954707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.954816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.954840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.152 qpair failed and we were unable to recover it. 00:28:03.152 [2024-11-28 19:16:23.954941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.152 [2024-11-28 19:16:23.955027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.955055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.153 qpair failed and we were unable to recover it. 00:28:03.153 [2024-11-28 19:16:23.955146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.955226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.955253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.153 qpair failed and we were unable to recover it. 00:28:03.153 [2024-11-28 19:16:23.955414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.955526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.955551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.153 qpair failed and we were unable to recover it. 00:28:03.153 [2024-11-28 19:16:23.955679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.955773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.955814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.153 qpair failed and we were unable to recover it. 00:28:03.153 [2024-11-28 19:16:23.955926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.956057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.956084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.153 qpair failed and we were unable to recover it. 00:28:03.153 [2024-11-28 19:16:23.956260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.956366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.956398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.153 qpair failed and we were unable to recover it. 00:28:03.153 [2024-11-28 19:16:23.956486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.956604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.956632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.153 qpair failed and we were unable to recover it. 00:28:03.153 [2024-11-28 19:16:23.956764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.956886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.956914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.153 qpair failed and we were unable to recover it. 00:28:03.153 [2024-11-28 19:16:23.957038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.957121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.957145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.153 qpair failed and we were unable to recover it. 00:28:03.153 [2024-11-28 19:16:23.957288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.957425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.957453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.153 qpair failed and we were unable to recover it. 00:28:03.153 [2024-11-28 19:16:23.957585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.957683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.957712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.153 qpair failed and we were unable to recover it. 00:28:03.153 [2024-11-28 19:16:23.957873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.957952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.957979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.153 qpair failed and we were unable to recover it. 00:28:03.153 [2024-11-28 19:16:23.958094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.958207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.958248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.153 qpair failed and we were unable to recover it. 00:28:03.153 [2024-11-28 19:16:23.958401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.958509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.958536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.153 qpair failed and we were unable to recover it. 00:28:03.153 [2024-11-28 19:16:23.958670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.958793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.958818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.153 qpair failed and we were unable to recover it. 00:28:03.153 [2024-11-28 19:16:23.958928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.959043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.959068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.153 qpair failed and we were unable to recover it. 00:28:03.153 [2024-11-28 19:16:23.959160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.959268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.959296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.153 qpair failed and we were unable to recover it. 00:28:03.153 [2024-11-28 19:16:23.959446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.959560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.959585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.153 qpair failed and we were unable to recover it. 00:28:03.153 [2024-11-28 19:16:23.959696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.959816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.959841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.153 qpair failed and we were unable to recover it. 00:28:03.153 [2024-11-28 19:16:23.959965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.960101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.960126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.153 qpair failed and we were unable to recover it. 00:28:03.153 [2024-11-28 19:16:23.960272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.960379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.960408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.153 qpair failed and we were unable to recover it. 00:28:03.153 [2024-11-28 19:16:23.960524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.960613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.153 [2024-11-28 19:16:23.960640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.154 qpair failed and we were unable to recover it. 00:28:03.154 [2024-11-28 19:16:23.960761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.960873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.960901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.154 qpair failed and we were unable to recover it. 00:28:03.154 [2024-11-28 19:16:23.961029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.961143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.961168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.154 qpair failed and we were unable to recover it. 00:28:03.154 [2024-11-28 19:16:23.961330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.961481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.961510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.154 qpair failed and we were unable to recover it. 00:28:03.154 [2024-11-28 19:16:23.961637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.961725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.961753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.154 qpair failed and we were unable to recover it. 00:28:03.154 [2024-11-28 19:16:23.961882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.962029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.962054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.154 qpair failed and we were unable to recover it. 00:28:03.154 [2024-11-28 19:16:23.962159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.962307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.962335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.154 qpair failed and we were unable to recover it. 00:28:03.154 [2024-11-28 19:16:23.962452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.962594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.962619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.154 qpair failed and we were unable to recover it. 00:28:03.154 [2024-11-28 19:16:23.962740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.962843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.962868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.154 qpair failed and we were unable to recover it. 00:28:03.154 [2024-11-28 19:16:23.963007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.963084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.963111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.154 qpair failed and we were unable to recover it. 00:28:03.154 [2024-11-28 19:16:23.963209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.963329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.963357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.154 qpair failed and we were unable to recover it. 00:28:03.154 [2024-11-28 19:16:23.963507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.963614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.963639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.154 qpair failed and we were unable to recover it. 00:28:03.154 [2024-11-28 19:16:23.963734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.963866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.963891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.154 qpair failed and we were unable to recover it. 00:28:03.154 [2024-11-28 19:16:23.964006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.964085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.964111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.154 qpair failed and we were unable to recover it. 00:28:03.154 [2024-11-28 19:16:23.964188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.964325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.964350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.154 qpair failed and we were unable to recover it. 00:28:03.154 [2024-11-28 19:16:23.964462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.964543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.964568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.154 qpair failed and we were unable to recover it. 00:28:03.154 [2024-11-28 19:16:23.964685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.964822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.964847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.154 qpair failed and we were unable to recover it. 00:28:03.154 [2024-11-28 19:16:23.964965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.965083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.965107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.154 qpair failed and we were unable to recover it. 00:28:03.154 [2024-11-28 19:16:23.965266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.965379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.965420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.154 qpair failed and we were unable to recover it. 00:28:03.154 [2024-11-28 19:16:23.965560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.965681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.965709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.154 qpair failed and we were unable to recover it. 00:28:03.154 [2024-11-28 19:16:23.965828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.965932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.965957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.154 qpair failed and we were unable to recover it. 00:28:03.154 [2024-11-28 19:16:23.966068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.966208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.154 [2024-11-28 19:16:23.966236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.154 qpair failed and we were unable to recover it. 00:28:03.155 [2024-11-28 19:16:23.966332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.155 [2024-11-28 19:16:23.966458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.155 [2024-11-28 19:16:23.966501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.155 qpair failed and we were unable to recover it. 00:28:03.155 [2024-11-28 19:16:23.966582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.155 [2024-11-28 19:16:23.966730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.155 [2024-11-28 19:16:23.966755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.155 qpair failed and we were unable to recover it. 00:28:03.155 [2024-11-28 19:16:23.966884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.155 [2024-11-28 19:16:23.967006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.155 [2024-11-28 19:16:23.967034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.155 qpair failed and we were unable to recover it. 00:28:03.155 [2024-11-28 19:16:23.967149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.155 [2024-11-28 19:16:23.967273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.155 [2024-11-28 19:16:23.967314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.155 qpair failed and we were unable to recover it. 00:28:03.155 [2024-11-28 19:16:23.967427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.155 [2024-11-28 19:16:23.967526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.155 [2024-11-28 19:16:23.967551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.155 qpair failed and we were unable to recover it. 00:28:03.155 [2024-11-28 19:16:23.967665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.155 [2024-11-28 19:16:23.967789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.155 [2024-11-28 19:16:23.967816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.155 qpair failed and we were unable to recover it. 00:28:03.155 [2024-11-28 19:16:23.967930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.155 [2024-11-28 19:16:23.968052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.155 [2024-11-28 19:16:23.968094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.155 qpair failed and we were unable to recover it. 00:28:03.155 [2024-11-28 19:16:23.968181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.155 [2024-11-28 19:16:23.968261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.155 [2024-11-28 19:16:23.968286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.155 qpair failed and we were unable to recover it. 00:28:03.155 [2024-11-28 19:16:23.968400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.155 [2024-11-28 19:16:23.968532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.155 [2024-11-28 19:16:23.968561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.155 qpair failed and we were unable to recover it. 00:28:03.155 [2024-11-28 19:16:23.968714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.155 [2024-11-28 19:16:23.968860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.155 [2024-11-28 19:16:23.968887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.155 qpair failed and we were unable to recover it. 00:28:03.155 [2024-11-28 19:16:23.969023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.155 [2024-11-28 19:16:23.969106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.155 [2024-11-28 19:16:23.969130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.155 qpair failed and we were unable to recover it. 00:28:03.155 [2024-11-28 19:16:23.969258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.155 [2024-11-28 19:16:23.969389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.155 [2024-11-28 19:16:23.969420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.155 qpair failed and we were unable to recover it. 00:28:03.155 [2024-11-28 19:16:23.969511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.155 [2024-11-28 19:16:23.969640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.155 [2024-11-28 19:16:23.969667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.155 qpair failed and we were unable to recover it. 00:28:03.155 [2024-11-28 19:16:23.969828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.155 [2024-11-28 19:16:23.969942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.155 [2024-11-28 19:16:23.969967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.155 qpair failed and we were unable to recover it. 00:28:03.155 [2024-11-28 19:16:23.970075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.155 [2024-11-28 19:16:23.970229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.155 [2024-11-28 19:16:23.970257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.155 qpair failed and we were unable to recover it. 00:28:03.155 [2024-11-28 19:16:23.970347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.155 [2024-11-28 19:16:23.970470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.155 [2024-11-28 19:16:23.970498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.155 qpair failed and we were unable to recover it. 00:28:03.155 [2024-11-28 19:16:23.970624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.155 [2024-11-28 19:16:23.970775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.970799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.156 qpair failed and we were unable to recover it. 00:28:03.156 [2024-11-28 19:16:23.970967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.971091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.971119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.156 qpair failed and we were unable to recover it. 00:28:03.156 [2024-11-28 19:16:23.971268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.971361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.971389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.156 qpair failed and we were unable to recover it. 00:28:03.156 [2024-11-28 19:16:23.971540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.971646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.971671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.156 qpair failed and we were unable to recover it. 00:28:03.156 [2024-11-28 19:16:23.971765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.971872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.971897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.156 qpair failed and we were unable to recover it. 00:28:03.156 [2024-11-28 19:16:23.971989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.972155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.972182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.156 qpair failed and we were unable to recover it. 00:28:03.156 [2024-11-28 19:16:23.972280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.972421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.972447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.156 qpair failed and we were unable to recover it. 00:28:03.156 [2024-11-28 19:16:23.972531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.972660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.972687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.156 qpair failed and we were unable to recover it. 00:28:03.156 [2024-11-28 19:16:23.972769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.972909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.972933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.156 qpair failed and we were unable to recover it. 00:28:03.156 [2024-11-28 19:16:23.973040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.973122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.973146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.156 qpair failed and we were unable to recover it. 00:28:03.156 [2024-11-28 19:16:23.973232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.973370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.973415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.156 qpair failed and we were unable to recover it. 00:28:03.156 [2024-11-28 19:16:23.973537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.973662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.973690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.156 qpair failed and we were unable to recover it. 00:28:03.156 [2024-11-28 19:16:23.973811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.973926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.973953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.156 qpair failed and we were unable to recover it. 00:28:03.156 [2024-11-28 19:16:23.974078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.974188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.974213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.156 qpair failed and we were unable to recover it. 00:28:03.156 [2024-11-28 19:16:23.974301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.974385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.974416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.156 qpair failed and we were unable to recover it. 00:28:03.156 [2024-11-28 19:16:23.974501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.974620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.974644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.156 qpair failed and we were unable to recover it. 00:28:03.156 [2024-11-28 19:16:23.974771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.974851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.974876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.156 qpair failed and we were unable to recover it. 00:28:03.156 [2024-11-28 19:16:23.974989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.975123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.975151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.156 qpair failed and we were unable to recover it. 00:28:03.156 [2024-11-28 19:16:23.975292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.975405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.975431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.156 qpair failed and we were unable to recover it. 00:28:03.156 [2024-11-28 19:16:23.975544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.975691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.975718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.156 qpair failed and we were unable to recover it. 00:28:03.156 [2024-11-28 19:16:23.975817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.975945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.975973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.156 qpair failed and we were unable to recover it. 00:28:03.156 [2024-11-28 19:16:23.976115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.976241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.156 [2024-11-28 19:16:23.976266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.156 qpair failed and we were unable to recover it. 00:28:03.156 [2024-11-28 19:16:23.976435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.976546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.976574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.157 qpair failed and we were unable to recover it. 00:28:03.157 [2024-11-28 19:16:23.976695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.976831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.976858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.157 qpair failed and we were unable to recover it. 00:28:03.157 [2024-11-28 19:16:23.976996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.977082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.977107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.157 qpair failed and we were unable to recover it. 00:28:03.157 [2024-11-28 19:16:23.977203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.977333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.977360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.157 qpair failed and we were unable to recover it. 00:28:03.157 [2024-11-28 19:16:23.977489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.977611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.977641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.157 qpair failed and we were unable to recover it. 00:28:03.157 [2024-11-28 19:16:23.977790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.977878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.977903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.157 qpair failed and we were unable to recover it. 00:28:03.157 [2024-11-28 19:16:23.978027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.978112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.978140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.157 qpair failed and we were unable to recover it. 00:28:03.157 [2024-11-28 19:16:23.978296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.978432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.978458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.157 qpair failed and we were unable to recover it. 00:28:03.157 [2024-11-28 19:16:23.978572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.978653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.978678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.157 qpair failed and we were unable to recover it. 00:28:03.157 [2024-11-28 19:16:23.978818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.978893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.978918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.157 qpair failed and we were unable to recover it. 00:28:03.157 [2024-11-28 19:16:23.979037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.979152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.979194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.157 qpair failed and we were unable to recover it. 00:28:03.157 [2024-11-28 19:16:23.979300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.979416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.979441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.157 qpair failed and we were unable to recover it. 00:28:03.157 [2024-11-28 19:16:23.979555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.979631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.979656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.157 qpair failed and we were unable to recover it. 00:28:03.157 [2024-11-28 19:16:23.979779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.979909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.979938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.157 qpair failed and we were unable to recover it. 00:28:03.157 [2024-11-28 19:16:23.980072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.980189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.980214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.157 qpair failed and we were unable to recover it. 00:28:03.157 [2024-11-28 19:16:23.980349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.980461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.980491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.157 qpair failed and we were unable to recover it. 00:28:03.157 [2024-11-28 19:16:23.980645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.980742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.980770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.157 qpair failed and we were unable to recover it. 00:28:03.157 [2024-11-28 19:16:23.980898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.980980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.981005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.157 qpair failed and we were unable to recover it. 00:28:03.157 [2024-11-28 19:16:23.981137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.981259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.981287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.157 qpair failed and we were unable to recover it. 00:28:03.157 [2024-11-28 19:16:23.981391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.981513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.981541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.157 qpair failed and we were unable to recover it. 00:28:03.157 [2024-11-28 19:16:23.981648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.981726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.981751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.157 qpair failed and we were unable to recover it. 00:28:03.157 [2024-11-28 19:16:23.981876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.157 [2024-11-28 19:16:23.981994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.982035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.158 qpair failed and we were unable to recover it. 00:28:03.158 [2024-11-28 19:16:23.982156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.982240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.982282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.158 qpair failed and we were unable to recover it. 00:28:03.158 [2024-11-28 19:16:23.982376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.982493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.982519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.158 qpair failed and we were unable to recover it. 00:28:03.158 [2024-11-28 19:16:23.982634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.982714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.982739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.158 qpair failed and we were unable to recover it. 00:28:03.158 [2024-11-28 19:16:23.982822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.982954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.982982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.158 qpair failed and we were unable to recover it. 00:28:03.158 [2024-11-28 19:16:23.983114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.983255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.983280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.158 qpair failed and we were unable to recover it. 00:28:03.158 [2024-11-28 19:16:23.983423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.983546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.983574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.158 qpair failed and we were unable to recover it. 00:28:03.158 [2024-11-28 19:16:23.983704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.983852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.983880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.158 qpair failed and we were unable to recover it. 00:28:03.158 [2024-11-28 19:16:23.984011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.984123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.984152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.158 qpair failed and we were unable to recover it. 00:28:03.158 [2024-11-28 19:16:23.984286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.984411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.984439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.158 qpair failed and we were unable to recover it. 00:28:03.158 [2024-11-28 19:16:23.984560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.984701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.984727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.158 qpair failed and we were unable to recover it. 00:28:03.158 [2024-11-28 19:16:23.984842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.984951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.984977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.158 qpair failed and we were unable to recover it. 00:28:03.158 [2024-11-28 19:16:23.985111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.985259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.985287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.158 qpair failed and we were unable to recover it. 00:28:03.158 [2024-11-28 19:16:23.985372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.985489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.985517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.158 qpair failed and we were unable to recover it. 00:28:03.158 [2024-11-28 19:16:23.985655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.985729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.985754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.158 qpair failed and we were unable to recover it. 00:28:03.158 [2024-11-28 19:16:23.985904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.986054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.986081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.158 qpair failed and we were unable to recover it. 00:28:03.158 [2024-11-28 19:16:23.986237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.986323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.986351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.158 qpair failed and we were unable to recover it. 00:28:03.158 [2024-11-28 19:16:23.986506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.986628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.986653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.158 qpair failed and we were unable to recover it. 00:28:03.158 [2024-11-28 19:16:23.986791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.986865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.986894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.158 qpair failed and we were unable to recover it. 00:28:03.158 [2024-11-28 19:16:23.987086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.987237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.987265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.158 qpair failed and we were unable to recover it. 00:28:03.158 [2024-11-28 19:16:23.987433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.987573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.987615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.158 qpair failed and we were unable to recover it. 00:28:03.158 [2024-11-28 19:16:23.987776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.987962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.158 [2024-11-28 19:16:23.987987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.158 qpair failed and we were unable to recover it. 00:28:03.158 [2024-11-28 19:16:23.988133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.988226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.988253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.159 qpair failed and we were unable to recover it. 00:28:03.159 [2024-11-28 19:16:23.988365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.988556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.988597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.159 qpair failed and we were unable to recover it. 00:28:03.159 [2024-11-28 19:16:23.988754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.988877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.988904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.159 qpair failed and we were unable to recover it. 00:28:03.159 [2024-11-28 19:16:23.989019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.989133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.989160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.159 qpair failed and we were unable to recover it. 00:28:03.159 [2024-11-28 19:16:23.989290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.989405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.989430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.159 qpair failed and we were unable to recover it. 00:28:03.159 [2024-11-28 19:16:23.989563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.989714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.989742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.159 qpair failed and we were unable to recover it. 00:28:03.159 [2024-11-28 19:16:23.989877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.989992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.990021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.159 qpair failed and we were unable to recover it. 00:28:03.159 [2024-11-28 19:16:23.990137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.990217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.990244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.159 qpair failed and we were unable to recover it. 00:28:03.159 [2024-11-28 19:16:23.990318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.990468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.990497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.159 qpair failed and we were unable to recover it. 00:28:03.159 [2024-11-28 19:16:23.990612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.990702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.990736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.159 qpair failed and we were unable to recover it. 00:28:03.159 [2024-11-28 19:16:23.990844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.990983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.991008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.159 qpair failed and we were unable to recover it. 00:28:03.159 [2024-11-28 19:16:23.991120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.991249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.991277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.159 qpair failed and we were unable to recover it. 00:28:03.159 [2024-11-28 19:16:23.991412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.991499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.991527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.159 qpair failed and we were unable to recover it. 00:28:03.159 [2024-11-28 19:16:23.991661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.991798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.991823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.159 qpair failed and we were unable to recover it. 00:28:03.159 [2024-11-28 19:16:23.991969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.992105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.992131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.159 qpair failed and we were unable to recover it. 00:28:03.159 [2024-11-28 19:16:23.992249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.992336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.992379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.159 qpair failed and we were unable to recover it. 00:28:03.159 [2024-11-28 19:16:23.992524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.992634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.992666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.159 qpair failed and we were unable to recover it. 00:28:03.159 [2024-11-28 19:16:23.992765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.992928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.992953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.159 qpair failed and we were unable to recover it. 00:28:03.159 [2024-11-28 19:16:23.993070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.993181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.993205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.159 qpair failed and we were unable to recover it. 00:28:03.159 [2024-11-28 19:16:23.993325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.993425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.993450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.159 qpair failed and we were unable to recover it. 00:28:03.159 [2024-11-28 19:16:23.993568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.993648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.159 [2024-11-28 19:16:23.993673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.159 qpair failed and we were unable to recover it. 00:28:03.159 [2024-11-28 19:16:23.993796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.993915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.993959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.160 qpair failed and we were unable to recover it. 00:28:03.160 [2024-11-28 19:16:23.994098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.994210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.994235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.160 qpair failed and we were unable to recover it. 00:28:03.160 [2024-11-28 19:16:23.994348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.994459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.994485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.160 qpair failed and we were unable to recover it. 00:28:03.160 [2024-11-28 19:16:23.994599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.994679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.994709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.160 qpair failed and we were unable to recover it. 00:28:03.160 [2024-11-28 19:16:23.994826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.994932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.994957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.160 qpair failed and we were unable to recover it. 00:28:03.160 [2024-11-28 19:16:23.995048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.995128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.995153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.160 qpair failed and we were unable to recover it. 00:28:03.160 [2024-11-28 19:16:23.995271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.995424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.995452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.160 qpair failed and we were unable to recover it. 00:28:03.160 [2024-11-28 19:16:23.995590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.995708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.995733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.160 qpair failed and we were unable to recover it. 00:28:03.160 [2024-11-28 19:16:23.995838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.995959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.995984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.160 qpair failed and we were unable to recover it. 00:28:03.160 [2024-11-28 19:16:23.996071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.996184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.996211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.160 qpair failed and we were unable to recover it. 00:28:03.160 [2024-11-28 19:16:23.996322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.996436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.996463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.160 qpair failed and we were unable to recover it. 00:28:03.160 [2024-11-28 19:16:23.996569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.996691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.996720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.160 qpair failed and we were unable to recover it. 00:28:03.160 [2024-11-28 19:16:23.996802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.996955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.996983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.160 qpair failed and we were unable to recover it. 00:28:03.160 [2024-11-28 19:16:23.997106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.997239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.997265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.160 qpair failed and we were unable to recover it. 00:28:03.160 [2024-11-28 19:16:23.997434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.997575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.997600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.160 qpair failed and we were unable to recover it. 00:28:03.160 [2024-11-28 19:16:23.997710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.997822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.997849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.160 qpair failed and we were unable to recover it. 00:28:03.160 [2024-11-28 19:16:23.997967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.998116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.998141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.160 qpair failed and we were unable to recover it. 00:28:03.160 [2024-11-28 19:16:23.998253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.998373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.998425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.160 qpair failed and we were unable to recover it. 00:28:03.160 [2024-11-28 19:16:23.998550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.998666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.998694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.160 qpair failed and we were unable to recover it. 00:28:03.160 [2024-11-28 19:16:23.998826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.998932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.998958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.160 qpair failed and we were unable to recover it. 00:28:03.160 [2024-11-28 19:16:23.999103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.999254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.999282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.160 qpair failed and we were unable to recover it. 00:28:03.160 [2024-11-28 19:16:23.999434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.999561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.160 [2024-11-28 19:16:23.999590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.161 qpair failed and we were unable to recover it. 00:28:03.161 [2024-11-28 19:16:23.999722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.161 [2024-11-28 19:16:23.999804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.161 [2024-11-28 19:16:23.999829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.161 qpair failed and we were unable to recover it. 00:28:03.161 [2024-11-28 19:16:23.999919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.161 [2024-11-28 19:16:24.000029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.161 [2024-11-28 19:16:24.000054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.161 qpair failed and we were unable to recover it. 00:28:03.161 [2024-11-28 19:16:24.000245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.161 [2024-11-28 19:16:24.000405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.161 [2024-11-28 19:16:24.000434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.161 qpair failed and we were unable to recover it. 00:28:03.161 [2024-11-28 19:16:24.000572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.161 [2024-11-28 19:16:24.000658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.161 [2024-11-28 19:16:24.000683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.161 qpair failed and we were unable to recover it. 00:28:03.161 [2024-11-28 19:16:24.000811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.161 [2024-11-28 19:16:24.000961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.161 [2024-11-28 19:16:24.000988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.161 qpair failed and we were unable to recover it. 00:28:03.161 [2024-11-28 19:16:24.001092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.161 [2024-11-28 19:16:24.001211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.161 [2024-11-28 19:16:24.001239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.161 qpair failed and we were unable to recover it. 00:28:03.161 [2024-11-28 19:16:24.001433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.161 [2024-11-28 19:16:24.001539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.161 [2024-11-28 19:16:24.001565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.161 qpair failed and we were unable to recover it. 00:28:03.161 [2024-11-28 19:16:24.001679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.161 [2024-11-28 19:16:24.001770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.161 [2024-11-28 19:16:24.001799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.161 qpair failed and we were unable to recover it. 00:28:03.161 [2024-11-28 19:16:24.001885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.161 [2024-11-28 19:16:24.001974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.161 [2024-11-28 19:16:24.002003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.161 qpair failed and we were unable to recover it. 00:28:03.161 [2024-11-28 19:16:24.002172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.161 [2024-11-28 19:16:24.002310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.161 [2024-11-28 19:16:24.002335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.161 qpair failed and we were unable to recover it. 00:28:03.161 [2024-11-28 19:16:24.002455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.161 [2024-11-28 19:16:24.002615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.161 [2024-11-28 19:16:24.002641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.161 qpair failed and we were unable to recover it. 00:28:03.161 [2024-11-28 19:16:24.002752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.161 [2024-11-28 19:16:24.002830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.161 [2024-11-28 19:16:24.002872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.161 qpair failed and we were unable to recover it. 00:28:03.161 [2024-11-28 19:16:24.002988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.161 [2024-11-28 19:16:24.003138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.161 [2024-11-28 19:16:24.003163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.161 qpair failed and we were unable to recover it. 00:28:03.161 [2024-11-28 19:16:24.003269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.161 [2024-11-28 19:16:24.003389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.161 [2024-11-28 19:16:24.003426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.161 qpair failed and we were unable to recover it. 00:28:03.161 [2024-11-28 19:16:24.003557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.161 [2024-11-28 19:16:24.003685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.161 [2024-11-28 19:16:24.003713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.161 qpair failed and we were unable to recover it. 00:28:03.161 [2024-11-28 19:16:24.003824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.161 [2024-11-28 19:16:24.003965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.161 [2024-11-28 19:16:24.004001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.161 qpair failed and we were unable to recover it. 00:28:03.161 [2024-11-28 19:16:24.004134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.161 [2024-11-28 19:16:24.004285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.161 [2024-11-28 19:16:24.004322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.161 qpair failed and we were unable to recover it. 00:28:03.162 [2024-11-28 19:16:24.004446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.004539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.004568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.162 qpair failed and we were unable to recover it. 00:28:03.162 [2024-11-28 19:16:24.004671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.004807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.004832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.162 qpair failed and we were unable to recover it. 00:28:03.162 [2024-11-28 19:16:24.004924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.005051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.005079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.162 qpair failed and we were unable to recover it. 00:28:03.162 [2024-11-28 19:16:24.005232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.005366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.005397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.162 qpair failed and we were unable to recover it. 00:28:03.162 [2024-11-28 19:16:24.005515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.005630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.005656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.162 qpair failed and we were unable to recover it. 00:28:03.162 [2024-11-28 19:16:24.005740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.005852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.005878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.162 qpair failed and we were unable to recover it. 00:28:03.162 [2024-11-28 19:16:24.005964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.006102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.006130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.162 qpair failed and we were unable to recover it. 00:28:03.162 [2024-11-28 19:16:24.006238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.006358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.006385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.162 qpair failed and we were unable to recover it. 00:28:03.162 [2024-11-28 19:16:24.006603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.006704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.006732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.162 qpair failed and we were unable to recover it. 00:28:03.162 [2024-11-28 19:16:24.006848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.006970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.006999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.162 qpair failed and we were unable to recover it. 00:28:03.162 [2024-11-28 19:16:24.007101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.007206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.007231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.162 qpair failed and we were unable to recover it. 00:28:03.162 [2024-11-28 19:16:24.007314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.007417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.007446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.162 qpair failed and we were unable to recover it. 00:28:03.162 [2024-11-28 19:16:24.007571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.007680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.007705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.162 qpair failed and we were unable to recover it. 00:28:03.162 [2024-11-28 19:16:24.007795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.007903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.007928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.162 qpair failed and we were unable to recover it. 00:28:03.162 [2024-11-28 19:16:24.008079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.008231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.008259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.162 qpair failed and we were unable to recover it. 00:28:03.162 [2024-11-28 19:16:24.008352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.008462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.008492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.162 qpair failed and we were unable to recover it. 00:28:03.162 [2024-11-28 19:16:24.008607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.008746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.008772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.162 qpair failed and we were unable to recover it. 00:28:03.162 [2024-11-28 19:16:24.008906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.008994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.009022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.162 qpair failed and we were unable to recover it. 00:28:03.162 [2024-11-28 19:16:24.009137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.009227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.009258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.162 qpair failed and we were unable to recover it. 00:28:03.162 [2024-11-28 19:16:24.009434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.009519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.009545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.162 qpair failed and we were unable to recover it. 00:28:03.162 [2024-11-28 19:16:24.009673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.009757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.009787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.162 qpair failed and we were unable to recover it. 00:28:03.162 [2024-11-28 19:16:24.009910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.010011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.010040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.162 qpair failed and we were unable to recover it. 00:28:03.162 [2024-11-28 19:16:24.010176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.010293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.162 [2024-11-28 19:16:24.010319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.163 qpair failed and we were unable to recover it. 00:28:03.163 [2024-11-28 19:16:24.010463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.010550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.010575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.163 qpair failed and we were unable to recover it. 00:28:03.163 [2024-11-28 19:16:24.010688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.010818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.010846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.163 qpair failed and we were unable to recover it. 00:28:03.163 [2024-11-28 19:16:24.010955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.011062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.011087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.163 qpair failed and we were unable to recover it. 00:28:03.163 [2024-11-28 19:16:24.011176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.011386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.011420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.163 qpair failed and we were unable to recover it. 00:28:03.163 [2024-11-28 19:16:24.011561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.011702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.011728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.163 qpair failed and we were unable to recover it. 00:28:03.163 [2024-11-28 19:16:24.011842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.011933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.011958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.163 qpair failed and we were unable to recover it. 00:28:03.163 [2024-11-28 19:16:24.012097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.012232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.012261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.163 qpair failed and we were unable to recover it. 00:28:03.163 [2024-11-28 19:16:24.012455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.012600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.012629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.163 qpair failed and we were unable to recover it. 00:28:03.163 [2024-11-28 19:16:24.012749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.012829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.012854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.163 qpair failed and we were unable to recover it. 00:28:03.163 [2024-11-28 19:16:24.012965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.013111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.013140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.163 qpair failed and we were unable to recover it. 00:28:03.163 [2024-11-28 19:16:24.013274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.013400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.013428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.163 qpair failed and we were unable to recover it. 00:28:03.163 [2024-11-28 19:16:24.013525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.013638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.013663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.163 qpair failed and we were unable to recover it. 00:28:03.163 [2024-11-28 19:16:24.013796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.013920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.013948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.163 qpair failed and we were unable to recover it. 00:28:03.163 [2024-11-28 19:16:24.014076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.014198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.014225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.163 qpair failed and we were unable to recover it. 00:28:03.163 [2024-11-28 19:16:24.014353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.014480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.014506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.163 qpair failed and we were unable to recover it. 00:28:03.163 [2024-11-28 19:16:24.014644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.014730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.014758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.163 qpair failed and we were unable to recover it. 00:28:03.163 [2024-11-28 19:16:24.014882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.014972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.015014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.163 qpair failed and we were unable to recover it. 00:28:03.163 [2024-11-28 19:16:24.015111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.015318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.015345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.163 qpair failed and we were unable to recover it. 00:28:03.163 [2024-11-28 19:16:24.015453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.015563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.015587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.163 qpair failed and we were unable to recover it. 00:28:03.163 [2024-11-28 19:16:24.015680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.015772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.015815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.163 qpair failed and we were unable to recover it. 00:28:03.163 [2024-11-28 19:16:24.015947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.016040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.016065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.163 qpair failed and we were unable to recover it. 00:28:03.163 [2024-11-28 19:16:24.016181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.163 [2024-11-28 19:16:24.016264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.016290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.164 qpair failed and we were unable to recover it. 00:28:03.164 [2024-11-28 19:16:24.016368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.016454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.016481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.164 qpair failed and we were unable to recover it. 00:28:03.164 [2024-11-28 19:16:24.016623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.016716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.016741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.164 qpair failed and we were unable to recover it. 00:28:03.164 [2024-11-28 19:16:24.016854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.016955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.016984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.164 qpair failed and we were unable to recover it. 00:28:03.164 [2024-11-28 19:16:24.017138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.017229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.017272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.164 qpair failed and we were unable to recover it. 00:28:03.164 [2024-11-28 19:16:24.017389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.017484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.017509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.164 qpair failed and we were unable to recover it. 00:28:03.164 [2024-11-28 19:16:24.017585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.017726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.017750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.164 qpair failed and we were unable to recover it. 00:28:03.164 [2024-11-28 19:16:24.017830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.017966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.017995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.164 qpair failed and we were unable to recover it. 00:28:03.164 [2024-11-28 19:16:24.018101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.018178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.018204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.164 qpair failed and we were unable to recover it. 00:28:03.164 [2024-11-28 19:16:24.018293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.018418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.018461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.164 qpair failed and we were unable to recover it. 00:28:03.164 [2024-11-28 19:16:24.018556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.018742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.018768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.164 qpair failed and we were unable to recover it. 00:28:03.164 [2024-11-28 19:16:24.018886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.018969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.018996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.164 qpair failed and we were unable to recover it. 00:28:03.164 [2024-11-28 19:16:24.019077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.019188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.019214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.164 qpair failed and we were unable to recover it. 00:28:03.164 [2024-11-28 19:16:24.019327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.019486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.019515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.164 qpair failed and we were unable to recover it. 00:28:03.164 [2024-11-28 19:16:24.019653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.019758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.019783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.164 qpair failed and we were unable to recover it. 00:28:03.164 [2024-11-28 19:16:24.019913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.020040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.020070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.164 qpair failed and we were unable to recover it. 00:28:03.164 [2024-11-28 19:16:24.020165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.020357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.020385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.164 qpair failed and we were unable to recover it. 00:28:03.164 [2024-11-28 19:16:24.020498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.020636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.020660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.164 qpair failed and we were unable to recover it. 00:28:03.164 [2024-11-28 19:16:24.020818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.020938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.020966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.164 qpair failed and we were unable to recover it. 00:28:03.164 [2024-11-28 19:16:24.021080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.021175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.021203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.164 qpair failed and we were unable to recover it. 00:28:03.164 [2024-11-28 19:16:24.021333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.021430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.021456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.164 qpair failed and we were unable to recover it. 00:28:03.164 [2024-11-28 19:16:24.021595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.021718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.021746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.164 qpair failed and we were unable to recover it. 00:28:03.164 [2024-11-28 19:16:24.021868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.021987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.164 [2024-11-28 19:16:24.022014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.164 qpair failed and we were unable to recover it. 00:28:03.165 [2024-11-28 19:16:24.022127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.022236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.022261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.165 qpair failed and we were unable to recover it. 00:28:03.165 [2024-11-28 19:16:24.022343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.022520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.022548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.165 qpair failed and we were unable to recover it. 00:28:03.165 [2024-11-28 19:16:24.022645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.022761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.022789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.165 qpair failed and we were unable to recover it. 00:28:03.165 [2024-11-28 19:16:24.022924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.023035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.023061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.165 qpair failed and we were unable to recover it. 00:28:03.165 [2024-11-28 19:16:24.023174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.023312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.023341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.165 qpair failed and we were unable to recover it. 00:28:03.165 [2024-11-28 19:16:24.023441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.023538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.023566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.165 qpair failed and we were unable to recover it. 00:28:03.165 [2024-11-28 19:16:24.023669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.023833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.023858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.165 qpair failed and we were unable to recover it. 00:28:03.165 [2024-11-28 19:16:24.023991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.024148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.024176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.165 qpair failed and we were unable to recover it. 00:28:03.165 [2024-11-28 19:16:24.024270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.024388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.024423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.165 qpair failed and we were unable to recover it. 00:28:03.165 [2024-11-28 19:16:24.024513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.024616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.024640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.165 qpair failed and we were unable to recover it. 00:28:03.165 [2024-11-28 19:16:24.024769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.024936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.024961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.165 qpair failed and we were unable to recover it. 00:28:03.165 [2024-11-28 19:16:24.025073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.025179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.025207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.165 qpair failed and we were unable to recover it. 00:28:03.165 [2024-11-28 19:16:24.025371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.025496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.025522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.165 qpair failed and we were unable to recover it. 00:28:03.165 [2024-11-28 19:16:24.025636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.025754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.025779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.165 qpair failed and we were unable to recover it. 00:28:03.165 [2024-11-28 19:16:24.025902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.026064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.026089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.165 qpair failed and we were unable to recover it. 00:28:03.165 [2024-11-28 19:16:24.026209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.026326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.026350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.165 qpair failed and we were unable to recover it. 00:28:03.165 [2024-11-28 19:16:24.026544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.026643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.026668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.165 qpair failed and we were unable to recover it. 00:28:03.165 [2024-11-28 19:16:24.026758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.026865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.026890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.165 qpair failed and we were unable to recover it. 00:28:03.165 [2024-11-28 19:16:24.026997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.027103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.027128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.165 qpair failed and we were unable to recover it. 00:28:03.165 [2024-11-28 19:16:24.027208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.027314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.027339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.165 qpair failed and we were unable to recover it. 00:28:03.165 [2024-11-28 19:16:24.027464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.027594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.165 [2024-11-28 19:16:24.027623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.166 qpair failed and we were unable to recover it. 00:28:03.166 [2024-11-28 19:16:24.027707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.027821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.027846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.166 qpair failed and we were unable to recover it. 00:28:03.166 [2024-11-28 19:16:24.027962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.028101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.028129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.166 qpair failed and we were unable to recover it. 00:28:03.166 [2024-11-28 19:16:24.028249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.028344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.028372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.166 qpair failed and we were unable to recover it. 00:28:03.166 [2024-11-28 19:16:24.028511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.028635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.028660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.166 qpair failed and we were unable to recover it. 00:28:03.166 [2024-11-28 19:16:24.028828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.028924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.028951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.166 qpair failed and we were unable to recover it. 00:28:03.166 [2024-11-28 19:16:24.029066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.029195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.029222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.166 qpair failed and we were unable to recover it. 00:28:03.166 [2024-11-28 19:16:24.029333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.029458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.029484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.166 qpair failed and we were unable to recover it. 00:28:03.166 [2024-11-28 19:16:24.029646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.029795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.029822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.166 qpair failed and we were unable to recover it. 00:28:03.166 [2024-11-28 19:16:24.029975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.030068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.030095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.166 qpair failed and we were unable to recover it. 00:28:03.166 [2024-11-28 19:16:24.030219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.030355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.030387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.166 qpair failed and we were unable to recover it. 00:28:03.166 [2024-11-28 19:16:24.030543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.030658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.030682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.166 qpair failed and we were unable to recover it. 00:28:03.166 [2024-11-28 19:16:24.030768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.030880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.030905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.166 qpair failed and we were unable to recover it. 00:28:03.166 [2024-11-28 19:16:24.031016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.031132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.031158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.166 qpair failed and we were unable to recover it. 00:28:03.166 [2024-11-28 19:16:24.031253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.031422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.031449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.166 qpair failed and we were unable to recover it. 00:28:03.166 [2024-11-28 19:16:24.031539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.031625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.031649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.166 qpair failed and we were unable to recover it. 00:28:03.166 [2024-11-28 19:16:24.031789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.031938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.031962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.166 qpair failed and we were unable to recover it. 00:28:03.166 [2024-11-28 19:16:24.032090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.032181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.032209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.166 qpair failed and we were unable to recover it. 00:28:03.166 [2024-11-28 19:16:24.032362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.032519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.032545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.166 qpair failed and we were unable to recover it. 00:28:03.166 [2024-11-28 19:16:24.032652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.032736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.032761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.166 qpair failed and we were unable to recover it. 00:28:03.166 [2024-11-28 19:16:24.032841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.032978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.033028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.166 qpair failed and we were unable to recover it. 00:28:03.166 [2024-11-28 19:16:24.033144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.033268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.033295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.166 qpair failed and we were unable to recover it. 00:28:03.166 [2024-11-28 19:16:24.033391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.166 [2024-11-28 19:16:24.033502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.167 [2024-11-28 19:16:24.033528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.167 qpair failed and we were unable to recover it. 00:28:03.167 [2024-11-28 19:16:24.033615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.167 [2024-11-28 19:16:24.033796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.167 [2024-11-28 19:16:24.033821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.167 qpair failed and we were unable to recover it. 00:28:03.167 [2024-11-28 19:16:24.033907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.167 [2024-11-28 19:16:24.034078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.167 [2024-11-28 19:16:24.034107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.167 qpair failed and we were unable to recover it. 00:28:03.167 [2024-11-28 19:16:24.034269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.167 [2024-11-28 19:16:24.034475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.167 [2024-11-28 19:16:24.034504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.167 qpair failed and we were unable to recover it. 00:28:03.167 [2024-11-28 19:16:24.034622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.167 [2024-11-28 19:16:24.034758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.167 [2024-11-28 19:16:24.034786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.167 qpair failed and we were unable to recover it. 00:28:03.167 [2024-11-28 19:16:24.034878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.167 [2024-11-28 19:16:24.035010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.167 [2024-11-28 19:16:24.035037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.167 qpair failed and we were unable to recover it. 00:28:03.167 [2024-11-28 19:16:24.035174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.167 [2024-11-28 19:16:24.035318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.167 [2024-11-28 19:16:24.035360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.167 qpair failed and we were unable to recover it. 00:28:03.167 [2024-11-28 19:16:24.035508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.167 [2024-11-28 19:16:24.035620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.167 [2024-11-28 19:16:24.035645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.167 qpair failed and we were unable to recover it. 00:28:03.167 [2024-11-28 19:16:24.035760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.167 [2024-11-28 19:16:24.035946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.167 [2024-11-28 19:16:24.035970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.167 qpair failed and we were unable to recover it. 00:28:03.167 [2024-11-28 19:16:24.036086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.167 [2024-11-28 19:16:24.036200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.167 [2024-11-28 19:16:24.036225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.167 qpair failed and we were unable to recover it. 00:28:03.167 [2024-11-28 19:16:24.036415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.167 [2024-11-28 19:16:24.036510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.167 [2024-11-28 19:16:24.036538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.167 qpair failed and we were unable to recover it. 00:28:03.167 [2024-11-28 19:16:24.036672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.167 [2024-11-28 19:16:24.036806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.167 [2024-11-28 19:16:24.036831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.167 qpair failed and we were unable to recover it. 00:28:03.167 [2024-11-28 19:16:24.036944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.167 [2024-11-28 19:16:24.037059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.167 [2024-11-28 19:16:24.037084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.167 qpair failed and we were unable to recover it. 00:28:03.167 [2024-11-28 19:16:24.037209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.167 [2024-11-28 19:16:24.037298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.167 [2024-11-28 19:16:24.037326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.167 qpair failed and we were unable to recover it. 00:28:03.167 [2024-11-28 19:16:24.037483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.167 [2024-11-28 19:16:24.037598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.167 [2024-11-28 19:16:24.037623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.167 qpair failed and we were unable to recover it. 00:28:03.167 [2024-11-28 19:16:24.037746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.167 [2024-11-28 19:16:24.037859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.167 [2024-11-28 19:16:24.037884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.167 qpair failed and we were unable to recover it. 00:28:03.167 [2024-11-28 19:16:24.037990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.167 [2024-11-28 19:16:24.038112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.167 [2024-11-28 19:16:24.038140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.167 qpair failed and we were unable to recover it. 00:28:03.167 [2024-11-28 19:16:24.038239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.038387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.038423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.168 qpair failed and we were unable to recover it. 00:28:03.168 [2024-11-28 19:16:24.038533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.038622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.038647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.168 qpair failed and we were unable to recover it. 00:28:03.168 [2024-11-28 19:16:24.038773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.038866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.038894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.168 qpair failed and we were unable to recover it. 00:28:03.168 [2024-11-28 19:16:24.039027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.039121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.039148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.168 qpair failed and we were unable to recover it. 00:28:03.168 [2024-11-28 19:16:24.039282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.039407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.039434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.168 qpair failed and we were unable to recover it. 00:28:03.168 [2024-11-28 19:16:24.039562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.039679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.039707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.168 qpair failed and we were unable to recover it. 00:28:03.168 [2024-11-28 19:16:24.039902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.040046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.040074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.168 qpair failed and we were unable to recover it. 00:28:03.168 [2024-11-28 19:16:24.040233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.040319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.040345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.168 qpair failed and we were unable to recover it. 00:28:03.168 [2024-11-28 19:16:24.040460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.040601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.040626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.168 qpair failed and we were unable to recover it. 00:28:03.168 [2024-11-28 19:16:24.040721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.040869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.040897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.168 qpair failed and we were unable to recover it. 00:28:03.168 [2024-11-28 19:16:24.041031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.041124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.041149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.168 qpair failed and we were unable to recover it. 00:28:03.168 [2024-11-28 19:16:24.041237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.041365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.041399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.168 qpair failed and we were unable to recover it. 00:28:03.168 [2024-11-28 19:16:24.041526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.041620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.041648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.168 qpair failed and we were unable to recover it. 00:28:03.168 [2024-11-28 19:16:24.041807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.041889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.041915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.168 qpair failed and we were unable to recover it. 00:28:03.168 [2024-11-28 19:16:24.042011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.042137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.042165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.168 qpair failed and we were unable to recover it. 00:28:03.168 [2024-11-28 19:16:24.042286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.042419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.042458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.168 qpair failed and we were unable to recover it. 00:28:03.168 [2024-11-28 19:16:24.042595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.042736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.042762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.168 qpair failed and we were unable to recover it. 00:28:03.168 [2024-11-28 19:16:24.042893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.042986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.043013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.168 qpair failed and we were unable to recover it. 00:28:03.168 [2024-11-28 19:16:24.043128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.043222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.043250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.168 qpair failed and we were unable to recover it. 00:28:03.168 [2024-11-28 19:16:24.043354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.043438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.043464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.168 qpair failed and we were unable to recover it. 00:28:03.168 [2024-11-28 19:16:24.043547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.043675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.168 [2024-11-28 19:16:24.043704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.168 qpair failed and we were unable to recover it. 00:28:03.168 [2024-11-28 19:16:24.043820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.044010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.044035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.169 qpair failed and we were unable to recover it. 00:28:03.169 [2024-11-28 19:16:24.044219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.044307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.044332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.169 qpair failed and we were unable to recover it. 00:28:03.169 [2024-11-28 19:16:24.044458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.044664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.044689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.169 qpair failed and we were unable to recover it. 00:28:03.169 [2024-11-28 19:16:24.044863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.045013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.045041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.169 qpair failed and we were unable to recover it. 00:28:03.169 [2024-11-28 19:16:24.045179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.045294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.045319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.169 qpair failed and we were unable to recover it. 00:28:03.169 [2024-11-28 19:16:24.045433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.045566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.045594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.169 qpair failed and we were unable to recover it. 00:28:03.169 [2024-11-28 19:16:24.045684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.045782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.045809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.169 qpair failed and we were unable to recover it. 00:28:03.169 [2024-11-28 19:16:24.045904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.046010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.046035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.169 qpair failed and we were unable to recover it. 00:28:03.169 [2024-11-28 19:16:24.046124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.046219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.046246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.169 qpair failed and we were unable to recover it. 00:28:03.169 [2024-11-28 19:16:24.046376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.046543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.046572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.169 qpair failed and we were unable to recover it. 00:28:03.169 [2024-11-28 19:16:24.046694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.046797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.046822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.169 qpair failed and we were unable to recover it. 00:28:03.169 [2024-11-28 19:16:24.046938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.047072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.047099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.169 qpair failed and we were unable to recover it. 00:28:03.169 [2024-11-28 19:16:24.047294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.047409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.047438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.169 qpair failed and we were unable to recover it. 00:28:03.169 [2024-11-28 19:16:24.047573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.047717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.047743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.169 qpair failed and we were unable to recover it. 00:28:03.169 [2024-11-28 19:16:24.047879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.048027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.048055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.169 qpair failed and we were unable to recover it. 00:28:03.169 [2024-11-28 19:16:24.048155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.048247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.048276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.169 qpair failed and we were unable to recover it. 00:28:03.169 [2024-11-28 19:16:24.048471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.048566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.048591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.169 qpair failed and we were unable to recover it. 00:28:03.169 [2024-11-28 19:16:24.048675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.048796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.048821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.169 qpair failed and we were unable to recover it. 00:28:03.169 [2024-11-28 19:16:24.048904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.049038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.049079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.169 qpair failed and we were unable to recover it. 00:28:03.169 [2024-11-28 19:16:24.049166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.049278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.049304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.169 qpair failed and we were unable to recover it. 00:28:03.169 [2024-11-28 19:16:24.049444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.049594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.049622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.169 qpair failed and we were unable to recover it. 00:28:03.169 [2024-11-28 19:16:24.049752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.049872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.049900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.169 qpair failed and we were unable to recover it. 00:28:03.169 [2024-11-28 19:16:24.050030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.050176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.050202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.169 qpair failed and we were unable to recover it. 00:28:03.169 [2024-11-28 19:16:24.050369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.169 [2024-11-28 19:16:24.050497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.050526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.170 qpair failed and we were unable to recover it. 00:28:03.170 [2024-11-28 19:16:24.050652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.050741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.050769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.170 qpair failed and we were unable to recover it. 00:28:03.170 [2024-11-28 19:16:24.050931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.051046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.051071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.170 qpair failed and we were unable to recover it. 00:28:03.170 [2024-11-28 19:16:24.051181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.051299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.051327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.170 qpair failed and we were unable to recover it. 00:28:03.170 [2024-11-28 19:16:24.051426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.051548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.051589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.170 qpair failed and we were unable to recover it. 00:28:03.170 [2024-11-28 19:16:24.051785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.051903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.051928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.170 qpair failed and we were unable to recover it. 00:28:03.170 [2024-11-28 19:16:24.052069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.052177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.052205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.170 qpair failed and we were unable to recover it. 00:28:03.170 [2024-11-28 19:16:24.052320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.052451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.052479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.170 qpair failed and we were unable to recover it. 00:28:03.170 [2024-11-28 19:16:24.052585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.052675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.052708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.170 qpair failed and we were unable to recover it. 00:28:03.170 [2024-11-28 19:16:24.052835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.052974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.053016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.170 qpair failed and we were unable to recover it. 00:28:03.170 [2024-11-28 19:16:24.053095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.053284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.053312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.170 qpair failed and we were unable to recover it. 00:28:03.170 [2024-11-28 19:16:24.053406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.053547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.053573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.170 qpair failed and we were unable to recover it. 00:28:03.170 [2024-11-28 19:16:24.053685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.053838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.053866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.170 qpair failed and we were unable to recover it. 00:28:03.170 [2024-11-28 19:16:24.053990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.054130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.054155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.170 qpair failed and we were unable to recover it. 00:28:03.170 [2024-11-28 19:16:24.054294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.054405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.054431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.170 qpair failed and we were unable to recover it. 00:28:03.170 [2024-11-28 19:16:24.054563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.054682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.054709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.170 qpair failed and we were unable to recover it. 00:28:03.170 [2024-11-28 19:16:24.054847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.054952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.054994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.170 qpair failed and we were unable to recover it. 00:28:03.170 [2024-11-28 19:16:24.055094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.055181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.055206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.170 qpair failed and we were unable to recover it. 00:28:03.170 [2024-11-28 19:16:24.055341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.055502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.055531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.170 qpair failed and we were unable to recover it. 00:28:03.170 [2024-11-28 19:16:24.055680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.055811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.055836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.170 qpair failed and we were unable to recover it. 00:28:03.170 [2024-11-28 19:16:24.055950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.056086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.056111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.170 qpair failed and we were unable to recover it. 00:28:03.170 [2024-11-28 19:16:24.056246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.056378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.056446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.170 qpair failed and we were unable to recover it. 00:28:03.170 [2024-11-28 19:16:24.056598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.056725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.056755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.170 qpair failed and we were unable to recover it. 00:28:03.170 [2024-11-28 19:16:24.056903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.170 [2024-11-28 19:16:24.057041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.057083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.171 qpair failed and we were unable to recover it. 00:28:03.171 [2024-11-28 19:16:24.057231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.057350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.057379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.171 qpair failed and we were unable to recover it. 00:28:03.171 [2024-11-28 19:16:24.057491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.057587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.057616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.171 qpair failed and we were unable to recover it. 00:28:03.171 [2024-11-28 19:16:24.057779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.057866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.057891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.171 qpair failed and we were unable to recover it. 00:28:03.171 [2024-11-28 19:16:24.058002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.058087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.058112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.171 qpair failed and we were unable to recover it. 00:28:03.171 [2024-11-28 19:16:24.058218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.058298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.058323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.171 qpair failed and we were unable to recover it. 00:28:03.171 [2024-11-28 19:16:24.058417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.058509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.058534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.171 qpair failed and we were unable to recover it. 00:28:03.171 [2024-11-28 19:16:24.058620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.058748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.058776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.171 qpair failed and we were unable to recover it. 00:28:03.171 [2024-11-28 19:16:24.058926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.059024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.059053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.171 qpair failed and we were unable to recover it. 00:28:03.171 [2024-11-28 19:16:24.059151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.059254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.059279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.171 qpair failed and we were unable to recover it. 00:28:03.171 [2024-11-28 19:16:24.059379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.059493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.059521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.171 qpair failed and we were unable to recover it. 00:28:03.171 [2024-11-28 19:16:24.059652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.059791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.059816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.171 qpair failed and we were unable to recover it. 00:28:03.171 [2024-11-28 19:16:24.059906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.060018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.060043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.171 qpair failed and we were unable to recover it. 00:28:03.171 [2024-11-28 19:16:24.060176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.060293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.060321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.171 qpair failed and we were unable to recover it. 00:28:03.171 [2024-11-28 19:16:24.060444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.060536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.060566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.171 qpair failed and we were unable to recover it. 00:28:03.171 [2024-11-28 19:16:24.060671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.060792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.060817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.171 qpair failed and we were unable to recover it. 00:28:03.171 [2024-11-28 19:16:24.060939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.061038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.061067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.171 qpair failed and we were unable to recover it. 00:28:03.171 [2024-11-28 19:16:24.061173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.061297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.061323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.171 qpair failed and we were unable to recover it. 00:28:03.171 [2024-11-28 19:16:24.061440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.061557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.061582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.171 qpair failed and we were unable to recover it. 00:28:03.171 [2024-11-28 19:16:24.061660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.061813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.061841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.171 qpair failed and we were unable to recover it. 00:28:03.171 [2024-11-28 19:16:24.061920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.062076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.062105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.171 qpair failed and we were unable to recover it. 00:28:03.171 [2024-11-28 19:16:24.062231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.062342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.062367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.171 qpair failed and we were unable to recover it. 00:28:03.171 [2024-11-28 19:16:24.062535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.062622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.062647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.171 qpair failed and we were unable to recover it. 00:28:03.171 [2024-11-28 19:16:24.062764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.062892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.171 [2024-11-28 19:16:24.062919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.172 qpair failed and we were unable to recover it. 00:28:03.172 [2024-11-28 19:16:24.063056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.063165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.063191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.172 qpair failed and we were unable to recover it. 00:28:03.172 [2024-11-28 19:16:24.063303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.063422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.063451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.172 qpair failed and we were unable to recover it. 00:28:03.172 [2024-11-28 19:16:24.063573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.063660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.063689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.172 qpair failed and we were unable to recover it. 00:28:03.172 [2024-11-28 19:16:24.063815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.063920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.063945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.172 qpair failed and we were unable to recover it. 00:28:03.172 [2024-11-28 19:16:24.064040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.064151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.064178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.172 qpair failed and we were unable to recover it. 00:28:03.172 [2024-11-28 19:16:24.064268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.064352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.064380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.172 qpair failed and we were unable to recover it. 00:28:03.172 [2024-11-28 19:16:24.064499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.064583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.064608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.172 qpair failed and we were unable to recover it. 00:28:03.172 [2024-11-28 19:16:24.064712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.064820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.064862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.172 qpair failed and we were unable to recover it. 00:28:03.172 [2024-11-28 19:16:24.064954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.065057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.065082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.172 qpair failed and we were unable to recover it. 00:28:03.172 [2024-11-28 19:16:24.065195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.065303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.065328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.172 qpair failed and we were unable to recover it. 00:28:03.172 [2024-11-28 19:16:24.065498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.065616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.065645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.172 qpair failed and we were unable to recover it. 00:28:03.172 [2024-11-28 19:16:24.065770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.065933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.065960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.172 qpair failed and we were unable to recover it. 00:28:03.172 [2024-11-28 19:16:24.066121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.066240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.066265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.172 qpair failed and we were unable to recover it. 00:28:03.172 [2024-11-28 19:16:24.066373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.066472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.066498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.172 qpair failed and we were unable to recover it. 00:28:03.172 [2024-11-28 19:16:24.066612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.066706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.066732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.172 qpair failed and we were unable to recover it. 00:28:03.172 [2024-11-28 19:16:24.066812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.066919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.066943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.172 qpair failed and we were unable to recover it. 00:28:03.172 [2024-11-28 19:16:24.067055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.067194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.067222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.172 qpair failed and we were unable to recover it. 00:28:03.172 [2024-11-28 19:16:24.067332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.067459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.067485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.172 qpair failed and we were unable to recover it. 00:28:03.172 [2024-11-28 19:16:24.067597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.067695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.067720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.172 qpair failed and we were unable to recover it. 00:28:03.172 [2024-11-28 19:16:24.067811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.067898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.067923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.172 qpair failed and we were unable to recover it. 00:28:03.172 [2024-11-28 19:16:24.068050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.068136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.068165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.172 qpair failed and we were unable to recover it. 00:28:03.172 [2024-11-28 19:16:24.068277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.068403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.068433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.172 qpair failed and we were unable to recover it. 00:28:03.172 [2024-11-28 19:16:24.068569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.068698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.068726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.172 qpair failed and we were unable to recover it. 00:28:03.172 [2024-11-28 19:16:24.068844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.068964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.068989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.172 qpair failed and we were unable to recover it. 00:28:03.172 [2024-11-28 19:16:24.069079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.172 [2024-11-28 19:16:24.069184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.069209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.173 qpair failed and we were unable to recover it. 00:28:03.173 [2024-11-28 19:16:24.069291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.069371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.069432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.173 qpair failed and we were unable to recover it. 00:28:03.173 [2024-11-28 19:16:24.069528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.069651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.069678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.173 qpair failed and we were unable to recover it. 00:28:03.173 [2024-11-28 19:16:24.069814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.069896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.069921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.173 qpair failed and we were unable to recover it. 00:28:03.173 [2024-11-28 19:16:24.070092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.070183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.070211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.173 qpair failed and we were unable to recover it. 00:28:03.173 [2024-11-28 19:16:24.070297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.070461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.070487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.173 qpair failed and we were unable to recover it. 00:28:03.173 [2024-11-28 19:16:24.070599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.070712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.070737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.173 qpair failed and we were unable to recover it. 00:28:03.173 [2024-11-28 19:16:24.070861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.071019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.071048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.173 qpair failed and we were unable to recover it. 00:28:03.173 [2024-11-28 19:16:24.071208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.071331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.071358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.173 qpair failed and we were unable to recover it. 00:28:03.173 [2024-11-28 19:16:24.071492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.071625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.071650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.173 qpair failed and we were unable to recover it. 00:28:03.173 [2024-11-28 19:16:24.071795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.071922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.071949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.173 qpair failed and we were unable to recover it. 00:28:03.173 [2024-11-28 19:16:24.072074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.072162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.072191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.173 qpair failed and we were unable to recover it. 00:28:03.173 [2024-11-28 19:16:24.072320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.072434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.072460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.173 qpair failed and we were unable to recover it. 00:28:03.173 [2024-11-28 19:16:24.072554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.072683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.072724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.173 qpair failed and we were unable to recover it. 00:28:03.173 [2024-11-28 19:16:24.072804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.072913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.072938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.173 qpair failed and we were unable to recover it. 00:28:03.173 [2024-11-28 19:16:24.073054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.073165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.073190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.173 qpair failed and we were unable to recover it. 00:28:03.173 [2024-11-28 19:16:24.073274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.073375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.073412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.173 qpair failed and we were unable to recover it. 00:28:03.173 [2024-11-28 19:16:24.073498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.073613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.073648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.173 qpair failed and we were unable to recover it. 00:28:03.173 [2024-11-28 19:16:24.073767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.073907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.073932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.173 qpair failed and we were unable to recover it. 00:28:03.173 [2024-11-28 19:16:24.074031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.074132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.074160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.173 qpair failed and we were unable to recover it. 00:28:03.173 [2024-11-28 19:16:24.074247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.074339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.074367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.173 qpair failed and we were unable to recover it. 00:28:03.173 [2024-11-28 19:16:24.074526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.074610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.173 [2024-11-28 19:16:24.074636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.174 qpair failed and we were unable to recover it. 00:28:03.174 [2024-11-28 19:16:24.074761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.074840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.074865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.174 qpair failed and we were unable to recover it. 00:28:03.174 [2024-11-28 19:16:24.075011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.075122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.075150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.174 qpair failed and we were unable to recover it. 00:28:03.174 [2024-11-28 19:16:24.075294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.075421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.075447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.174 qpair failed and we were unable to recover it. 00:28:03.174 [2024-11-28 19:16:24.075611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.075733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.075760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.174 qpair failed and we were unable to recover it. 00:28:03.174 [2024-11-28 19:16:24.075874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.076022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.076049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.174 qpair failed and we were unable to recover it. 00:28:03.174 [2024-11-28 19:16:24.076145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.076255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.076283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.174 qpair failed and we were unable to recover it. 00:28:03.174 [2024-11-28 19:16:24.076445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.076526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.076551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.174 qpair failed and we were unable to recover it. 00:28:03.174 [2024-11-28 19:16:24.076666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.076821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.076848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.174 qpair failed and we were unable to recover it. 00:28:03.174 [2024-11-28 19:16:24.076985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.077074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.077098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.174 qpair failed and we were unable to recover it. 00:28:03.174 [2024-11-28 19:16:24.077215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.077347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.077375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.174 qpair failed and we were unable to recover it. 00:28:03.174 [2024-11-28 19:16:24.077510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.077626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.077654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.174 qpair failed and we were unable to recover it. 00:28:03.174 [2024-11-28 19:16:24.077804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.077889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.077912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.174 qpair failed and we were unable to recover it. 00:28:03.174 [2024-11-28 19:16:24.078043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.078139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.078165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.174 qpair failed and we were unable to recover it. 00:28:03.174 [2024-11-28 19:16:24.078324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.078422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.078447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.174 qpair failed and we were unable to recover it. 00:28:03.174 [2024-11-28 19:16:24.078537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.078659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.078684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.174 qpair failed and we were unable to recover it. 00:28:03.174 [2024-11-28 19:16:24.078796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.078917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.078942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.174 qpair failed and we were unable to recover it. 00:28:03.174 [2024-11-28 19:16:24.079064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.079149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.079174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.174 qpair failed and we were unable to recover it. 00:28:03.174 [2024-11-28 19:16:24.079264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.079399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.079426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.174 qpair failed and we were unable to recover it. 00:28:03.174 [2024-11-28 19:16:24.079553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.079647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.079675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.174 qpair failed and we were unable to recover it. 00:28:03.174 [2024-11-28 19:16:24.079783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.079943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.079969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.174 qpair failed and we were unable to recover it. 00:28:03.174 [2024-11-28 19:16:24.080058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.080199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.080224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.174 qpair failed and we were unable to recover it. 00:28:03.174 [2024-11-28 19:16:24.080313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.080406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.080431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.174 qpair failed and we were unable to recover it. 00:28:03.174 [2024-11-28 19:16:24.080529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.080639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.080664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.174 qpair failed and we were unable to recover it. 00:28:03.174 [2024-11-28 19:16:24.080743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.080827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.080852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.174 qpair failed and we were unable to recover it. 00:28:03.174 [2024-11-28 19:16:24.080962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.081088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.081113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.174 qpair failed and we were unable to recover it. 00:28:03.174 [2024-11-28 19:16:24.081241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.081370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.174 [2024-11-28 19:16:24.081405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.174 qpair failed and we were unable to recover it. 00:28:03.174 [2024-11-28 19:16:24.081514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.081597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.081622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.175 qpair failed and we were unable to recover it. 00:28:03.175 [2024-11-28 19:16:24.081720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.081835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.081860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.175 qpair failed and we were unable to recover it. 00:28:03.175 [2024-11-28 19:16:24.081969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.082052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.082077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.175 qpair failed and we were unable to recover it. 00:28:03.175 [2024-11-28 19:16:24.082156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.082267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.082291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.175 qpair failed and we were unable to recover it. 00:28:03.175 [2024-11-28 19:16:24.082385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.082507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.082531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.175 qpair failed and we were unable to recover it. 00:28:03.175 [2024-11-28 19:16:24.082647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.082744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.082769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.175 qpair failed and we were unable to recover it. 00:28:03.175 [2024-11-28 19:16:24.082917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.082997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.083022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.175 qpair failed and we were unable to recover it. 00:28:03.175 [2024-11-28 19:16:24.083117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.083209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.083234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.175 qpair failed and we were unable to recover it. 00:28:03.175 [2024-11-28 19:16:24.083320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.083436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.083462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.175 qpair failed and we were unable to recover it. 00:28:03.175 [2024-11-28 19:16:24.083569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.083676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.083701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.175 qpair failed and we were unable to recover it. 00:28:03.175 [2024-11-28 19:16:24.083823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.083902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.083927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.175 qpair failed and we were unable to recover it. 00:28:03.175 [2024-11-28 19:16:24.084008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.084099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.084124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.175 qpair failed and we were unable to recover it. 00:28:03.175 [2024-11-28 19:16:24.084234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.084349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.084374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.175 qpair failed and we were unable to recover it. 00:28:03.175 [2024-11-28 19:16:24.084463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.084567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.084592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.175 qpair failed and we were unable to recover it. 00:28:03.175 [2024-11-28 19:16:24.084700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.084814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.084857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.175 qpair failed and we were unable to recover it. 00:28:03.175 [2024-11-28 19:16:24.084968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.085077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.085102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.175 qpair failed and we were unable to recover it. 00:28:03.175 [2024-11-28 19:16:24.085180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.085291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.085316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.175 qpair failed and we were unable to recover it. 00:28:03.175 [2024-11-28 19:16:24.085436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.085524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.085549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.175 qpair failed and we were unable to recover it. 00:28:03.175 [2024-11-28 19:16:24.085629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.085749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.085775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.175 qpair failed and we were unable to recover it. 00:28:03.175 [2024-11-28 19:16:24.085916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.086012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.086037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.175 qpair failed and we were unable to recover it. 00:28:03.175 [2024-11-28 19:16:24.086119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.086254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.086281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.175 qpair failed and we were unable to recover it. 00:28:03.175 [2024-11-28 19:16:24.086382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.086460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.086486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.175 qpair failed and we were unable to recover it. 00:28:03.175 [2024-11-28 19:16:24.086581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.086665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.086691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.175 qpair failed and we were unable to recover it. 00:28:03.175 [2024-11-28 19:16:24.086830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.086917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.086947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.175 qpair failed and we were unable to recover it. 00:28:03.175 [2024-11-28 19:16:24.087048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.087152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.087177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.175 qpair failed and we were unable to recover it. 00:28:03.175 [2024-11-28 19:16:24.087291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.087364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.087389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.175 qpair failed and we were unable to recover it. 00:28:03.175 [2024-11-28 19:16:24.087486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.087569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.175 [2024-11-28 19:16:24.087594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.175 qpair failed and we were unable to recover it. 00:28:03.176 [2024-11-28 19:16:24.087673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.087778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.087803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.176 qpair failed and we were unable to recover it. 00:28:03.176 [2024-11-28 19:16:24.087909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.088003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.088028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.176 qpair failed and we were unable to recover it. 00:28:03.176 [2024-11-28 19:16:24.088114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.088221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.088246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.176 qpair failed and we were unable to recover it. 00:28:03.176 [2024-11-28 19:16:24.088365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.088452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.088479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.176 qpair failed and we were unable to recover it. 00:28:03.176 [2024-11-28 19:16:24.088607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.088730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.088758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.176 qpair failed and we were unable to recover it. 00:28:03.176 [2024-11-28 19:16:24.088877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.088984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.089010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.176 qpair failed and we were unable to recover it. 00:28:03.176 [2024-11-28 19:16:24.089088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.089166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.089191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.176 qpair failed and we were unable to recover it. 00:28:03.176 [2024-11-28 19:16:24.089303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.089383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.089420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.176 qpair failed and we were unable to recover it. 00:28:03.176 [2024-11-28 19:16:24.089544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.089625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.089650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.176 qpair failed and we were unable to recover it. 00:28:03.176 [2024-11-28 19:16:24.089727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.089833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.089858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.176 qpair failed and we were unable to recover it. 00:28:03.176 [2024-11-28 19:16:24.089936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.090047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.090073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.176 qpair failed and we were unable to recover it. 00:28:03.176 [2024-11-28 19:16:24.090163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.090276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.090303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.176 qpair failed and we were unable to recover it. 00:28:03.176 [2024-11-28 19:16:24.090427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.090513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.090540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.176 qpair failed and we were unable to recover it. 00:28:03.176 [2024-11-28 19:16:24.090631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.090719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.090745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.176 qpair failed and we were unable to recover it. 00:28:03.176 [2024-11-28 19:16:24.090863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.090948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.090973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.176 qpair failed and we were unable to recover it. 00:28:03.176 [2024-11-28 19:16:24.091085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.091195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.091221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.176 qpair failed and we were unable to recover it. 00:28:03.176 [2024-11-28 19:16:24.091327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.091457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.091482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.176 qpair failed and we were unable to recover it. 00:28:03.176 [2024-11-28 19:16:24.091577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.091685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.091710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.176 qpair failed and we were unable to recover it. 00:28:03.176 [2024-11-28 19:16:24.091796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.091875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.091901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.176 qpair failed and we were unable to recover it. 00:28:03.176 [2024-11-28 19:16:24.092055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.092185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.092227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.176 qpair failed and we were unable to recover it. 00:28:03.176 [2024-11-28 19:16:24.092340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.092455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.092481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.176 qpair failed and we were unable to recover it. 00:28:03.176 [2024-11-28 19:16:24.092559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.092637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.092662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.176 qpair failed and we were unable to recover it. 00:28:03.176 [2024-11-28 19:16:24.092744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.092864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.092892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.176 qpair failed and we were unable to recover it. 00:28:03.176 [2024-11-28 19:16:24.093015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.093094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.093122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.176 qpair failed and we were unable to recover it. 00:28:03.176 [2024-11-28 19:16:24.093232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.093343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.093368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.176 qpair failed and we were unable to recover it. 00:28:03.176 [2024-11-28 19:16:24.093484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.176 [2024-11-28 19:16:24.093563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.093588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.177 qpair failed and we were unable to recover it. 00:28:03.177 [2024-11-28 19:16:24.093668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.093757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.093782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.177 qpair failed and we were unable to recover it. 00:28:03.177 [2024-11-28 19:16:24.093890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.093980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.094005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.177 qpair failed and we were unable to recover it. 00:28:03.177 [2024-11-28 19:16:24.094088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.094172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.094197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.177 qpair failed and we were unable to recover it. 00:28:03.177 [2024-11-28 19:16:24.094277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.094374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.094407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.177 qpair failed and we were unable to recover it. 00:28:03.177 [2024-11-28 19:16:24.094525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.094603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.094627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.177 qpair failed and we were unable to recover it. 00:28:03.177 [2024-11-28 19:16:24.094728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.094833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.094858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.177 qpair failed and we were unable to recover it. 00:28:03.177 [2024-11-28 19:16:24.095001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.095087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.095113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.177 qpair failed and we were unable to recover it. 00:28:03.177 [2024-11-28 19:16:24.095222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.095315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.095358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.177 qpair failed and we were unable to recover it. 00:28:03.177 [2024-11-28 19:16:24.095477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.095614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.095639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.177 qpair failed and we were unable to recover it. 00:28:03.177 [2024-11-28 19:16:24.095721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.095798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.095823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.177 qpair failed and we were unable to recover it. 00:28:03.177 [2024-11-28 19:16:24.095935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.096084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.096109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.177 qpair failed and we were unable to recover it. 00:28:03.177 [2024-11-28 19:16:24.096229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.096342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.096367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.177 qpair failed and we were unable to recover it. 00:28:03.177 [2024-11-28 19:16:24.096465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.096572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.096596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.177 qpair failed and we were unable to recover it. 00:28:03.177 [2024-11-28 19:16:24.096693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.096774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.096800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.177 qpair failed and we were unable to recover it. 00:28:03.177 [2024-11-28 19:16:24.096915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.096999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.097024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.177 qpair failed and we were unable to recover it. 00:28:03.177 [2024-11-28 19:16:24.097144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.097230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.097255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.177 qpair failed and we were unable to recover it. 00:28:03.177 [2024-11-28 19:16:24.097344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.097468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.097494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.177 qpair failed and we were unable to recover it. 00:28:03.177 [2024-11-28 19:16:24.097603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.097713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.097743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.177 qpair failed and we were unable to recover it. 00:28:03.177 [2024-11-28 19:16:24.097833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.097928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.097957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.177 qpair failed and we were unable to recover it. 00:28:03.177 [2024-11-28 19:16:24.098065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.098142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.098167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.177 qpair failed and we were unable to recover it. 00:28:03.177 [2024-11-28 19:16:24.098261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.098407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.098451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.177 qpair failed and we were unable to recover it. 00:28:03.177 [2024-11-28 19:16:24.098541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.098635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.098663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.177 qpair failed and we were unable to recover it. 00:28:03.177 [2024-11-28 19:16:24.098799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.098881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.098906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.177 qpair failed and we were unable to recover it. 00:28:03.177 [2024-11-28 19:16:24.099024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.099117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.099145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.177 qpair failed and we were unable to recover it. 00:28:03.177 [2024-11-28 19:16:24.099277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.099369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.177 [2024-11-28 19:16:24.099415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.177 qpair failed and we were unable to recover it. 00:28:03.178 [2024-11-28 19:16:24.099514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.099621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.099646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.178 qpair failed and we were unable to recover it. 00:28:03.178 [2024-11-28 19:16:24.099752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.099851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.099879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.178 qpair failed and we were unable to recover it. 00:28:03.178 [2024-11-28 19:16:24.099990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.100089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.100115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.178 qpair failed and we were unable to recover it. 00:28:03.178 [2024-11-28 19:16:24.100217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.100303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.100331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.178 qpair failed and we were unable to recover it. 00:28:03.178 [2024-11-28 19:16:24.100431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.100536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.100561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.178 qpair failed and we were unable to recover it. 00:28:03.178 [2024-11-28 19:16:24.100650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.100762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.100787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.178 qpair failed and we were unable to recover it. 00:28:03.178 [2024-11-28 19:16:24.100868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.100938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.100963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.178 qpair failed and we were unable to recover it. 00:28:03.178 [2024-11-28 19:16:24.101052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.101177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.101202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.178 qpair failed and we were unable to recover it. 00:28:03.178 [2024-11-28 19:16:24.101307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.101403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.101429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.178 qpair failed and we were unable to recover it. 00:28:03.178 [2024-11-28 19:16:24.101519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.101629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.101655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.178 qpair failed and we were unable to recover it. 00:28:03.178 [2024-11-28 19:16:24.101769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.101850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.101876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.178 qpair failed and we were unable to recover it. 00:28:03.178 [2024-11-28 19:16:24.101962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.102054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.102078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.178 qpair failed and we were unable to recover it. 00:28:03.178 [2024-11-28 19:16:24.102216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.102305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.102330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.178 qpair failed and we were unable to recover it. 00:28:03.178 [2024-11-28 19:16:24.102423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.102564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.102590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.178 qpair failed and we were unable to recover it. 00:28:03.178 [2024-11-28 19:16:24.102706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.102810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.102836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.178 qpair failed and we were unable to recover it. 00:28:03.178 [2024-11-28 19:16:24.102947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.103029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.103054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.178 qpair failed and we were unable to recover it. 00:28:03.178 [2024-11-28 19:16:24.103184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.103284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.103309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.178 qpair failed and we were unable to recover it. 00:28:03.178 [2024-11-28 19:16:24.103435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.103519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.103544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.178 qpair failed and we were unable to recover it. 00:28:03.178 [2024-11-28 19:16:24.103631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.103746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.103770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.178 qpair failed and we were unable to recover it. 00:28:03.178 [2024-11-28 19:16:24.103852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.103935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.103960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.178 qpair failed and we were unable to recover it. 00:28:03.178 [2024-11-28 19:16:24.104068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.104147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.104172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.178 qpair failed and we were unable to recover it. 00:28:03.178 [2024-11-28 19:16:24.104269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.104353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.178 [2024-11-28 19:16:24.104381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.178 qpair failed and we were unable to recover it. 00:28:03.178 [2024-11-28 19:16:24.104488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.104572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.104598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.179 qpair failed and we were unable to recover it. 00:28:03.179 [2024-11-28 19:16:24.104694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.104780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.104806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.179 qpair failed and we were unable to recover it. 00:28:03.179 [2024-11-28 19:16:24.104924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.105004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.105029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.179 qpair failed and we were unable to recover it. 00:28:03.179 [2024-11-28 19:16:24.105163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.105258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.105286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.179 qpair failed and we were unable to recover it. 00:28:03.179 [2024-11-28 19:16:24.105405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.105511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.105536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.179 qpair failed and we were unable to recover it. 00:28:03.179 [2024-11-28 19:16:24.105616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.105704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.105730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.179 qpair failed and we were unable to recover it. 00:28:03.179 [2024-11-28 19:16:24.105863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.105950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.105994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.179 qpair failed and we were unable to recover it. 00:28:03.179 [2024-11-28 19:16:24.106130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.106238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.106263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.179 qpair failed and we were unable to recover it. 00:28:03.179 [2024-11-28 19:16:24.106373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.106495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.106522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.179 qpair failed and we were unable to recover it. 00:28:03.179 [2024-11-28 19:16:24.106609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.106685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.106712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.179 qpair failed and we were unable to recover it. 00:28:03.179 [2024-11-28 19:16:24.106828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.106907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.106936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.179 qpair failed and we were unable to recover it. 00:28:03.179 [2024-11-28 19:16:24.107021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.107101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.107126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.179 qpair failed and we were unable to recover it. 00:28:03.179 [2024-11-28 19:16:24.107236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.107324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.107348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.179 qpair failed and we were unable to recover it. 00:28:03.179 [2024-11-28 19:16:24.107431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.107541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.107566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.179 qpair failed and we were unable to recover it. 00:28:03.179 [2024-11-28 19:16:24.107673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.107767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.107792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.179 qpair failed and we were unable to recover it. 00:28:03.179 [2024-11-28 19:16:24.107885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.107969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.107994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.179 qpair failed and we were unable to recover it. 00:28:03.179 [2024-11-28 19:16:24.108083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.108206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.108234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.179 qpair failed and we were unable to recover it. 00:28:03.179 [2024-11-28 19:16:24.108422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.108545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.108571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.179 qpair failed and we were unable to recover it. 00:28:03.179 [2024-11-28 19:16:24.108658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.108777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.108802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.179 qpair failed and we were unable to recover it. 00:28:03.179 [2024-11-28 19:16:24.108885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.108975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.109000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.179 qpair failed and we were unable to recover it. 00:28:03.179 [2024-11-28 19:16:24.109074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.109185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.109216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.179 qpair failed and we were unable to recover it. 00:28:03.179 [2024-11-28 19:16:24.109309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.109407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.109433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.179 qpair failed and we were unable to recover it. 00:28:03.179 [2024-11-28 19:16:24.109548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.109634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.109659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.179 qpair failed and we were unable to recover it. 00:28:03.179 [2024-11-28 19:16:24.109803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.109890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.109914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.179 qpair failed and we were unable to recover it. 00:28:03.179 [2024-11-28 19:16:24.110002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.110085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.110110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.179 qpair failed and we were unable to recover it. 00:28:03.179 [2024-11-28 19:16:24.110222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.110305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.110330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.179 qpair failed and we were unable to recover it. 00:28:03.179 [2024-11-28 19:16:24.110456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.110579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.110604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.179 qpair failed and we were unable to recover it. 00:28:03.179 [2024-11-28 19:16:24.110680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.110793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.110818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.179 qpair failed and we were unable to recover it. 00:28:03.179 [2024-11-28 19:16:24.110908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.111016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.179 [2024-11-28 19:16:24.111040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.179 qpair failed and we were unable to recover it. 00:28:03.180 [2024-11-28 19:16:24.111150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.111222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.111247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.180 qpair failed and we were unable to recover it. 00:28:03.180 [2024-11-28 19:16:24.111325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.111417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.111447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.180 qpair failed and we were unable to recover it. 00:28:03.180 [2024-11-28 19:16:24.111561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.111637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.111662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.180 qpair failed and we were unable to recover it. 00:28:03.180 [2024-11-28 19:16:24.111774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.111881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.111905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.180 qpair failed and we were unable to recover it. 00:28:03.180 [2024-11-28 19:16:24.111995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.112080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.112105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.180 qpair failed and we were unable to recover it. 00:28:03.180 [2024-11-28 19:16:24.112183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.112290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.112315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.180 qpair failed and we were unable to recover it. 00:28:03.180 [2024-11-28 19:16:24.112439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.112518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.112543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.180 qpair failed and we were unable to recover it. 00:28:03.180 [2024-11-28 19:16:24.112632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.112741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.112766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.180 qpair failed and we were unable to recover it. 00:28:03.180 [2024-11-28 19:16:24.112877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.112966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.112991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.180 qpair failed and we were unable to recover it. 00:28:03.180 [2024-11-28 19:16:24.113096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.113210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.113234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.180 qpair failed and we were unable to recover it. 00:28:03.180 [2024-11-28 19:16:24.113360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.113497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.113523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.180 qpair failed and we were unable to recover it. 00:28:03.180 [2024-11-28 19:16:24.113605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.113694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.113723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.180 qpair failed and we were unable to recover it. 00:28:03.180 [2024-11-28 19:16:24.113837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.113942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.113967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.180 qpair failed and we were unable to recover it. 00:28:03.180 [2024-11-28 19:16:24.114115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.114224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.114249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.180 qpair failed and we were unable to recover it. 00:28:03.180 [2024-11-28 19:16:24.114363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.114471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.114497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.180 qpair failed and we were unable to recover it. 00:28:03.180 [2024-11-28 19:16:24.114574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.114681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.114705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.180 qpair failed and we were unable to recover it. 00:28:03.180 [2024-11-28 19:16:24.114820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.114901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.114926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.180 qpair failed and we were unable to recover it. 00:28:03.180 [2024-11-28 19:16:24.115033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.115153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.115180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.180 qpair failed and we were unable to recover it. 00:28:03.180 [2024-11-28 19:16:24.115283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.115367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.115391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.180 qpair failed and we were unable to recover it. 00:28:03.180 [2024-11-28 19:16:24.115485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.115606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.115632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.180 qpair failed and we were unable to recover it. 00:28:03.180 [2024-11-28 19:16:24.115717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.115797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.115822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.180 qpair failed and we were unable to recover it. 00:28:03.180 [2024-11-28 19:16:24.115961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.116045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.116070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.180 qpair failed and we were unable to recover it. 00:28:03.180 [2024-11-28 19:16:24.116186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.116272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.116297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.180 qpair failed and we were unable to recover it. 00:28:03.180 [2024-11-28 19:16:24.116380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.116465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.116491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.180 qpair failed and we were unable to recover it. 00:28:03.180 [2024-11-28 19:16:24.116578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.116681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.116706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.180 qpair failed and we were unable to recover it. 00:28:03.180 [2024-11-28 19:16:24.116785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.116893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.116918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.180 qpair failed and we were unable to recover it. 00:28:03.180 [2024-11-28 19:16:24.117056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.117197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.117222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.180 qpair failed and we were unable to recover it. 00:28:03.180 [2024-11-28 19:16:24.117310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.117399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.180 [2024-11-28 19:16:24.117425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.180 qpair failed and we were unable to recover it. 00:28:03.181 [2024-11-28 19:16:24.117532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.117615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.117639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.181 qpair failed and we were unable to recover it. 00:28:03.181 [2024-11-28 19:16:24.117743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.117864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.117891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.181 qpair failed and we were unable to recover it. 00:28:03.181 [2024-11-28 19:16:24.118002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.118087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.118112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.181 qpair failed and we were unable to recover it. 00:28:03.181 [2024-11-28 19:16:24.118223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.118306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.118330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.181 qpair failed and we were unable to recover it. 00:28:03.181 [2024-11-28 19:16:24.118417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.118525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.118550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.181 qpair failed and we were unable to recover it. 00:28:03.181 [2024-11-28 19:16:24.118625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.118727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.118752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.181 qpair failed and we were unable to recover it. 00:28:03.181 [2024-11-28 19:16:24.118863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.118949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.118974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.181 qpair failed and we were unable to recover it. 00:28:03.181 [2024-11-28 19:16:24.119051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.119143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.119186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.181 qpair failed and we were unable to recover it. 00:28:03.181 [2024-11-28 19:16:24.119339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.119448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.119473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.181 qpair failed and we were unable to recover it. 00:28:03.181 [2024-11-28 19:16:24.119550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.119633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.119658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.181 qpair failed and we were unable to recover it. 00:28:03.181 [2024-11-28 19:16:24.119798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.119884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.119910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.181 qpair failed and we were unable to recover it. 00:28:03.181 [2024-11-28 19:16:24.120021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.120135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.120159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.181 qpair failed and we were unable to recover it. 00:28:03.181 [2024-11-28 19:16:24.120249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.120339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.120366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.181 qpair failed and we were unable to recover it. 00:28:03.181 [2024-11-28 19:16:24.120510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.120593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.120619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.181 qpair failed and we were unable to recover it. 00:28:03.181 [2024-11-28 19:16:24.120734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.120828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.120853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.181 qpair failed and we were unable to recover it. 00:28:03.181 [2024-11-28 19:16:24.120981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.121073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.121116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.181 qpair failed and we were unable to recover it. 00:28:03.181 [2024-11-28 19:16:24.121194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.121281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.121306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.181 qpair failed and we were unable to recover it. 00:28:03.181 [2024-11-28 19:16:24.121407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.121509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.121534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.181 qpair failed and we were unable to recover it. 00:28:03.181 [2024-11-28 19:16:24.121621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.121716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.121741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.181 qpair failed and we were unable to recover it. 00:28:03.181 [2024-11-28 19:16:24.121856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.121963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.121987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.181 qpair failed and we were unable to recover it. 00:28:03.181 [2024-11-28 19:16:24.122071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.122190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.122218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.181 qpair failed and we were unable to recover it. 00:28:03.181 [2024-11-28 19:16:24.122310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.122437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.122463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.181 qpair failed and we were unable to recover it. 00:28:03.181 [2024-11-28 19:16:24.122576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.122701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.122726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.181 qpair failed and we were unable to recover it. 00:28:03.181 [2024-11-28 19:16:24.122811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.122950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.122975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.181 qpair failed and we were unable to recover it. 00:28:03.181 [2024-11-28 19:16:24.123117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.123196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.123221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.181 qpair failed and we were unable to recover it. 00:28:03.181 [2024-11-28 19:16:24.123353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.123453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.123495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.181 qpair failed and we were unable to recover it. 00:28:03.181 [2024-11-28 19:16:24.123613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.123717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.123742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.181 qpair failed and we were unable to recover it. 00:28:03.181 [2024-11-28 19:16:24.123820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.123909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.123934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.181 qpair failed and we were unable to recover it. 00:28:03.181 [2024-11-28 19:16:24.124010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.124095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.124120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.181 qpair failed and we were unable to recover it. 00:28:03.181 [2024-11-28 19:16:24.124232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.124340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.181 [2024-11-28 19:16:24.124365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.181 qpair failed and we were unable to recover it. 00:28:03.182 [2024-11-28 19:16:24.124486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.124594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.124620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.182 qpair failed and we were unable to recover it. 00:28:03.182 [2024-11-28 19:16:24.124765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.124885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.124910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.182 qpair failed and we were unable to recover it. 00:28:03.182 [2024-11-28 19:16:24.124998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.125150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.125175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.182 qpair failed and we were unable to recover it. 00:28:03.182 [2024-11-28 19:16:24.125276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.125420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.125447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.182 qpair failed and we were unable to recover it. 00:28:03.182 [2024-11-28 19:16:24.125532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.125616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.125642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.182 qpair failed and we were unable to recover it. 00:28:03.182 [2024-11-28 19:16:24.125760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.125832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.125857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.182 qpair failed and we were unable to recover it. 00:28:03.182 [2024-11-28 19:16:24.125978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.126064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.126104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.182 qpair failed and we were unable to recover it. 00:28:03.182 [2024-11-28 19:16:24.126232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.126336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.126361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.182 qpair failed and we were unable to recover it. 00:28:03.182 [2024-11-28 19:16:24.126466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.126544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.126569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.182 qpair failed and we were unable to recover it. 00:28:03.182 [2024-11-28 19:16:24.126686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.126816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.126844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.182 qpair failed and we were unable to recover it. 00:28:03.182 [2024-11-28 19:16:24.126996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.127112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.127137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.182 qpair failed and we were unable to recover it. 00:28:03.182 [2024-11-28 19:16:24.127228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.127306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.127331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.182 qpair failed and we were unable to recover it. 00:28:03.182 [2024-11-28 19:16:24.127419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.127508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.127549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.182 qpair failed and we were unable to recover it. 00:28:03.182 [2024-11-28 19:16:24.127671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.127797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.127821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.182 qpair failed and we were unable to recover it. 00:28:03.182 [2024-11-28 19:16:24.127918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.127999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.128025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.182 qpair failed and we were unable to recover it. 00:28:03.182 [2024-11-28 19:16:24.128113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.128191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.128235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.182 qpair failed and we were unable to recover it. 00:28:03.182 [2024-11-28 19:16:24.128342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.128472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.128501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.182 qpair failed and we were unable to recover it. 00:28:03.182 [2024-11-28 19:16:24.128631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.128717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.128742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.182 qpair failed and we were unable to recover it. 00:28:03.182 [2024-11-28 19:16:24.128833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.128968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.128993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.182 qpair failed and we were unable to recover it. 00:28:03.182 [2024-11-28 19:16:24.129079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.129224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.129252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.182 qpair failed and we were unable to recover it. 00:28:03.182 [2024-11-28 19:16:24.129351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.129459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.129484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.182 qpair failed and we were unable to recover it. 00:28:03.182 [2024-11-28 19:16:24.129592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.129683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.129708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.182 qpair failed and we were unable to recover it. 00:28:03.182 [2024-11-28 19:16:24.129848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.129997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.130021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.182 qpair failed and we were unable to recover it. 00:28:03.182 [2024-11-28 19:16:24.130111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.130192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.130217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.182 qpair failed and we were unable to recover it. 00:28:03.182 [2024-11-28 19:16:24.130342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.130435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.130461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.182 qpair failed and we were unable to recover it. 00:28:03.182 [2024-11-28 19:16:24.130548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.130633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.130658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.182 qpair failed and we were unable to recover it. 00:28:03.182 [2024-11-28 19:16:24.130761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.130845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.130870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.182 qpair failed and we were unable to recover it. 00:28:03.182 [2024-11-28 19:16:24.130952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.131023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.131047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.182 qpair failed and we were unable to recover it. 00:28:03.182 [2024-11-28 19:16:24.131154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.131272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.131297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.182 qpair failed and we were unable to recover it. 00:28:03.182 [2024-11-28 19:16:24.131422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.182 [2024-11-28 19:16:24.131540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.183 [2024-11-28 19:16:24.131565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.183 qpair failed and we were unable to recover it. 00:28:03.183 [2024-11-28 19:16:24.131656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.183 [2024-11-28 19:16:24.131743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.183 [2024-11-28 19:16:24.131768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.183 qpair failed and we were unable to recover it. 00:28:03.183 [2024-11-28 19:16:24.131841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.183 [2024-11-28 19:16:24.131928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.183 [2024-11-28 19:16:24.131953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.183 qpair failed and we were unable to recover it. 00:28:03.183 [2024-11-28 19:16:24.132038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.183 [2024-11-28 19:16:24.132117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.183 [2024-11-28 19:16:24.132143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.183 qpair failed and we were unable to recover it. 00:28:03.183 [2024-11-28 19:16:24.132221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.183 [2024-11-28 19:16:24.132330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.183 [2024-11-28 19:16:24.132355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.183 qpair failed and we were unable to recover it. 00:28:03.183 [2024-11-28 19:16:24.132461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.183 [2024-11-28 19:16:24.132589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.183 [2024-11-28 19:16:24.132616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.183 qpair failed and we were unable to recover it. 00:28:03.183 [2024-11-28 19:16:24.132729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.183 [2024-11-28 19:16:24.132842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.183 [2024-11-28 19:16:24.132868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.183 qpair failed and we were unable to recover it. 00:28:03.183 [2024-11-28 19:16:24.133007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.183 [2024-11-28 19:16:24.133085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.183 [2024-11-28 19:16:24.133110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.183 qpair failed and we were unable to recover it. 00:28:03.183 [2024-11-28 19:16:24.133245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.183 [2024-11-28 19:16:24.133322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.183 [2024-11-28 19:16:24.133347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.183 qpair failed and we were unable to recover it. 00:28:03.183 [2024-11-28 19:16:24.133458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.183 [2024-11-28 19:16:24.133545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.183 [2024-11-28 19:16:24.133572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.183 qpair failed and we were unable to recover it. 00:28:03.183 [2024-11-28 19:16:24.133663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.183 [2024-11-28 19:16:24.133774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.183 [2024-11-28 19:16:24.133799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.183 qpair failed and we were unable to recover it. 00:28:03.183 [2024-11-28 19:16:24.133889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.183 [2024-11-28 19:16:24.133974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.183 [2024-11-28 19:16:24.134000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.183 qpair failed and we were unable to recover it. 00:28:03.183 [2024-11-28 19:16:24.134112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.183 [2024-11-28 19:16:24.134199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.183 [2024-11-28 19:16:24.134223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.183 qpair failed and we were unable to recover it. 00:28:03.183 [2024-11-28 19:16:24.134343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.183 [2024-11-28 19:16:24.134452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.183 [2024-11-28 19:16:24.134478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.183 qpair failed and we were unable to recover it. 00:28:03.183 [2024-11-28 19:16:24.134561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.183 [2024-11-28 19:16:24.134673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.183 [2024-11-28 19:16:24.134697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.183 qpair failed and we were unable to recover it. 00:28:03.183 [2024-11-28 19:16:24.134781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.183 [2024-11-28 19:16:24.134913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.183 [2024-11-28 19:16:24.134939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.183 qpair failed and we were unable to recover it. 00:28:03.183 [2024-11-28 19:16:24.135034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.183 [2024-11-28 19:16:24.135115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.183 [2024-11-28 19:16:24.135140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.183 qpair failed and we were unable to recover it. 00:28:03.183 [2024-11-28 19:16:24.135223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.183 [2024-11-28 19:16:24.135332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.183 [2024-11-28 19:16:24.135357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.183 qpair failed and we were unable to recover it. 00:28:03.183 [2024-11-28 19:16:24.135446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.183 [2024-11-28 19:16:24.135538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.183 [2024-11-28 19:16:24.135563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.183 qpair failed and we were unable to recover it. 00:28:03.183 [2024-11-28 19:16:24.135656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.135745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.135770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.184 qpair failed and we were unable to recover it. 00:28:03.184 [2024-11-28 19:16:24.135852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.135955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.135980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.184 qpair failed and we were unable to recover it. 00:28:03.184 [2024-11-28 19:16:24.136064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.136180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.136205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.184 qpair failed and we were unable to recover it. 00:28:03.184 [2024-11-28 19:16:24.136283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.136400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.136425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.184 qpair failed and we were unable to recover it. 00:28:03.184 [2024-11-28 19:16:24.136510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.136589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.136614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.184 qpair failed and we were unable to recover it. 00:28:03.184 [2024-11-28 19:16:24.136700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.136774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.136799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.184 qpair failed and we were unable to recover it. 00:28:03.184 [2024-11-28 19:16:24.136904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.137023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.137066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.184 qpair failed and we were unable to recover it. 00:28:03.184 [2024-11-28 19:16:24.137187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.137269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.137294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.184 qpair failed and we were unable to recover it. 00:28:03.184 [2024-11-28 19:16:24.137405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.137482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.137507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.184 qpair failed and we were unable to recover it. 00:28:03.184 [2024-11-28 19:16:24.137592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.137702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.137727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.184 qpair failed and we were unable to recover it. 00:28:03.184 [2024-11-28 19:16:24.137815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.137894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.137919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.184 qpair failed and we were unable to recover it. 00:28:03.184 [2024-11-28 19:16:24.138007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.138114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.138139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.184 qpair failed and we were unable to recover it. 00:28:03.184 [2024-11-28 19:16:24.138226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.138361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.138386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.184 qpair failed and we were unable to recover it. 00:28:03.184 [2024-11-28 19:16:24.138494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.138571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.138597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.184 qpair failed and we were unable to recover it. 00:28:03.184 [2024-11-28 19:16:24.138675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.138760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.138785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.184 qpair failed and we were unable to recover it. 00:28:03.184 [2024-11-28 19:16:24.138875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.138991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.139016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.184 qpair failed and we were unable to recover it. 00:28:03.184 [2024-11-28 19:16:24.139095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.139210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.139235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.184 qpair failed and we were unable to recover it. 00:28:03.184 [2024-11-28 19:16:24.139332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.139416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.139442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.184 qpair failed and we were unable to recover it. 00:28:03.184 [2024-11-28 19:16:24.139554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.139654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.139682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.184 qpair failed and we were unable to recover it. 00:28:03.184 [2024-11-28 19:16:24.139801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.139911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.139936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.184 qpair failed and we were unable to recover it. 00:28:03.184 [2024-11-28 19:16:24.140048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.140201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.140225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.184 qpair failed and we were unable to recover it. 00:28:03.184 [2024-11-28 19:16:24.140324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.140416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.140461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.184 qpair failed and we were unable to recover it. 00:28:03.184 [2024-11-28 19:16:24.140551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.140632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.140657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.184 qpair failed and we were unable to recover it. 00:28:03.184 [2024-11-28 19:16:24.140747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.140863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.140888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.184 qpair failed and we were unable to recover it. 00:28:03.184 [2024-11-28 19:16:24.140980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.184 [2024-11-28 19:16:24.141111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.141137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.185 qpair failed and we were unable to recover it. 00:28:03.185 [2024-11-28 19:16:24.141211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.141344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.141372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.185 qpair failed and we were unable to recover it. 00:28:03.185 [2024-11-28 19:16:24.141496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.141584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.141608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.185 qpair failed and we were unable to recover it. 00:28:03.185 [2024-11-28 19:16:24.141693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.141771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.141795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.185 qpair failed and we were unable to recover it. 00:28:03.185 [2024-11-28 19:16:24.141882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.141965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.141990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.185 qpair failed and we were unable to recover it. 00:28:03.185 [2024-11-28 19:16:24.142100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.142212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.142237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.185 qpair failed and we were unable to recover it. 00:28:03.185 [2024-11-28 19:16:24.142337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.142436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.142464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.185 qpair failed and we were unable to recover it. 00:28:03.185 [2024-11-28 19:16:24.142604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.142714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.142740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.185 qpair failed and we were unable to recover it. 00:28:03.185 [2024-11-28 19:16:24.142828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.142914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.142940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.185 qpair failed and we were unable to recover it. 00:28:03.185 [2024-11-28 19:16:24.143024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.143183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.143208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.185 qpair failed and we were unable to recover it. 00:28:03.185 [2024-11-28 19:16:24.143317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.143426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.143452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.185 qpair failed and we were unable to recover it. 00:28:03.185 [2024-11-28 19:16:24.143566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.143655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.143682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.185 qpair failed and we were unable to recover it. 00:28:03.185 [2024-11-28 19:16:24.143769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.143843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.143876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.185 qpair failed and we were unable to recover it. 00:28:03.185 [2024-11-28 19:16:24.143976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.144087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.144112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.185 qpair failed and we were unable to recover it. 00:28:03.185 [2024-11-28 19:16:24.144196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.144273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.144298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.185 qpair failed and we were unable to recover it. 00:28:03.185 [2024-11-28 19:16:24.144382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.144502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.144527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.185 qpair failed and we were unable to recover it. 00:28:03.185 [2024-11-28 19:16:24.144646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.144735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.144760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.185 qpair failed and we were unable to recover it. 00:28:03.185 [2024-11-28 19:16:24.144876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.144989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.145014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.185 qpair failed and we were unable to recover it. 00:28:03.185 [2024-11-28 19:16:24.145091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.145184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.145208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.185 qpair failed and we were unable to recover it. 00:28:03.185 [2024-11-28 19:16:24.145324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.145476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.145501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.185 qpair failed and we were unable to recover it. 00:28:03.185 [2024-11-28 19:16:24.145587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.145669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.145696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.185 qpair failed and we were unable to recover it. 00:28:03.185 [2024-11-28 19:16:24.145788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.145867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.145893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.185 qpair failed and we were unable to recover it. 00:28:03.185 [2024-11-28 19:16:24.145982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.146060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.146089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.185 qpair failed and we were unable to recover it. 00:28:03.185 [2024-11-28 19:16:24.146180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.146262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.146287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.185 qpair failed and we were unable to recover it. 00:28:03.185 [2024-11-28 19:16:24.146378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.146468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.146493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.185 qpair failed and we were unable to recover it. 00:28:03.185 [2024-11-28 19:16:24.146642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.146727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.146752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.185 qpair failed and we were unable to recover it. 00:28:03.185 [2024-11-28 19:16:24.146873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.185 [2024-11-28 19:16:24.146948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.146972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.478 qpair failed and we were unable to recover it. 00:28:03.478 [2024-11-28 19:16:24.147061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.147139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.147163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.478 qpair failed and we were unable to recover it. 00:28:03.478 [2024-11-28 19:16:24.147244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.147364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.147389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.478 qpair failed and we were unable to recover it. 00:28:03.478 [2024-11-28 19:16:24.147486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.147599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.147625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.478 qpair failed and we were unable to recover it. 00:28:03.478 [2024-11-28 19:16:24.147705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.147780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.147805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.478 qpair failed and we were unable to recover it. 00:28:03.478 [2024-11-28 19:16:24.147896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.147983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.148008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.478 qpair failed and we were unable to recover it. 00:28:03.478 [2024-11-28 19:16:24.148092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.148177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.148207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.478 qpair failed and we were unable to recover it. 00:28:03.478 [2024-11-28 19:16:24.148346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.148443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.148469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.478 qpair failed and we were unable to recover it. 00:28:03.478 [2024-11-28 19:16:24.148559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.148633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.148659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.478 qpair failed and we were unable to recover it. 00:28:03.478 [2024-11-28 19:16:24.148752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.148864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.148888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.478 qpair failed and we were unable to recover it. 00:28:03.478 [2024-11-28 19:16:24.148976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.149064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.149089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.478 qpair failed and we were unable to recover it. 00:28:03.478 [2024-11-28 19:16:24.149162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.149273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.149297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.478 qpair failed and we were unable to recover it. 00:28:03.478 [2024-11-28 19:16:24.149384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.149511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.149536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.478 qpair failed and we were unable to recover it. 00:28:03.478 [2024-11-28 19:16:24.149643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.149749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.149775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.478 qpair failed and we were unable to recover it. 00:28:03.478 [2024-11-28 19:16:24.149883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.149991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.150016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.478 qpair failed and we were unable to recover it. 00:28:03.478 [2024-11-28 19:16:24.150098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.150207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.150232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.478 qpair failed and we were unable to recover it. 00:28:03.478 [2024-11-28 19:16:24.150347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.150424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.150459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.478 qpair failed and we were unable to recover it. 00:28:03.478 [2024-11-28 19:16:24.150546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.150654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.150682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.478 qpair failed and we were unable to recover it. 00:28:03.478 [2024-11-28 19:16:24.150784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.150861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.150886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.478 qpair failed and we were unable to recover it. 00:28:03.478 [2024-11-28 19:16:24.150968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.151076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.151101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.478 qpair failed and we were unable to recover it. 00:28:03.478 [2024-11-28 19:16:24.151187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.151266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.151291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.478 qpair failed and we were unable to recover it. 00:28:03.478 [2024-11-28 19:16:24.151374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.151495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.478 [2024-11-28 19:16:24.151521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.478 qpair failed and we were unable to recover it. 00:28:03.479 [2024-11-28 19:16:24.151612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.151691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.151716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.479 qpair failed and we were unable to recover it. 00:28:03.479 [2024-11-28 19:16:24.151822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.151903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.151928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.479 qpair failed and we were unable to recover it. 00:28:03.479 [2024-11-28 19:16:24.152037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.152149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.152173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.479 qpair failed and we were unable to recover it. 00:28:03.479 [2024-11-28 19:16:24.152248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.152325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.152350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.479 qpair failed and we were unable to recover it. 00:28:03.479 [2024-11-28 19:16:24.152476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.152605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.152634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.479 qpair failed and we were unable to recover it. 00:28:03.479 [2024-11-28 19:16:24.152757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.152845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.152869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.479 qpair failed and we were unable to recover it. 00:28:03.479 [2024-11-28 19:16:24.152956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.153036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.153061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.479 qpair failed and we were unable to recover it. 00:28:03.479 [2024-11-28 19:16:24.153156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.153239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.153264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.479 qpair failed and we were unable to recover it. 00:28:03.479 [2024-11-28 19:16:24.153357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.153478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.153504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.479 qpair failed and we were unable to recover it. 00:28:03.479 [2024-11-28 19:16:24.153584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.153674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.153700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.479 qpair failed and we were unable to recover it. 00:28:03.479 [2024-11-28 19:16:24.153779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.153892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.153918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.479 qpair failed and we were unable to recover it. 00:28:03.479 [2024-11-28 19:16:24.154006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.154119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.154144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.479 qpair failed and we were unable to recover it. 00:28:03.479 [2024-11-28 19:16:24.154260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.154379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.154441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.479 qpair failed and we were unable to recover it. 00:28:03.479 [2024-11-28 19:16:24.154526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.154606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.154631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.479 qpair failed and we were unable to recover it. 00:28:03.479 [2024-11-28 19:16:24.154738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.154822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.154846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.479 qpair failed and we were unable to recover it. 00:28:03.479 [2024-11-28 19:16:24.154965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.155051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.155075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.479 qpair failed and we were unable to recover it. 00:28:03.479 [2024-11-28 19:16:24.155157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.155241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.155265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.479 qpair failed and we were unable to recover it. 00:28:03.479 [2024-11-28 19:16:24.155374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.155473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.155498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.479 qpair failed and we were unable to recover it. 00:28:03.479 [2024-11-28 19:16:24.155579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.155665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.155692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.479 qpair failed and we were unable to recover it. 00:28:03.479 [2024-11-28 19:16:24.155798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.155886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.155910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.479 qpair failed and we were unable to recover it. 00:28:03.479 [2024-11-28 19:16:24.156015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.156098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.156123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.479 qpair failed and we were unable to recover it. 00:28:03.479 [2024-11-28 19:16:24.156205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.156315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.156340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.479 qpair failed and we were unable to recover it. 00:28:03.479 [2024-11-28 19:16:24.156414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.156500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.156525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.479 qpair failed and we were unable to recover it. 00:28:03.479 [2024-11-28 19:16:24.156614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.156726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.156752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.479 qpair failed and we were unable to recover it. 00:28:03.479 [2024-11-28 19:16:24.156860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.156968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.156992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.479 qpair failed and we were unable to recover it. 00:28:03.479 [2024-11-28 19:16:24.157110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.157192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.157218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.479 qpair failed and we were unable to recover it. 00:28:03.479 [2024-11-28 19:16:24.157335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.157432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.157459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.479 qpair failed and we were unable to recover it. 00:28:03.479 [2024-11-28 19:16:24.157537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.157674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.157699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.479 qpair failed and we were unable to recover it. 00:28:03.479 [2024-11-28 19:16:24.157814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.479 [2024-11-28 19:16:24.157885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.157910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.480 qpair failed and we were unable to recover it. 00:28:03.480 [2024-11-28 19:16:24.158021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.158102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.158128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.480 qpair failed and we were unable to recover it. 00:28:03.480 [2024-11-28 19:16:24.158242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.158351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.158376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.480 qpair failed and we were unable to recover it. 00:28:03.480 [2024-11-28 19:16:24.158472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.158552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.158577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.480 qpair failed and we were unable to recover it. 00:28:03.480 [2024-11-28 19:16:24.158658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.158748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.158775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.480 qpair failed and we were unable to recover it. 00:28:03.480 [2024-11-28 19:16:24.158882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.159010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.159035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.480 qpair failed and we were unable to recover it. 00:28:03.480 [2024-11-28 19:16:24.159116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.159196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.159222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.480 qpair failed and we were unable to recover it. 00:28:03.480 [2024-11-28 19:16:24.159364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.159515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.159541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.480 qpair failed and we were unable to recover it. 00:28:03.480 [2024-11-28 19:16:24.159629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.159758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.159786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.480 qpair failed and we were unable to recover it. 00:28:03.480 [2024-11-28 19:16:24.159937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.160067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.160108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.480 qpair failed and we were unable to recover it. 00:28:03.480 [2024-11-28 19:16:24.160191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.160317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.160342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.480 qpair failed and we were unable to recover it. 00:28:03.480 [2024-11-28 19:16:24.160480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.160606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.160631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.480 qpair failed and we were unable to recover it. 00:28:03.480 [2024-11-28 19:16:24.160760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.160858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.160886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.480 qpair failed and we were unable to recover it. 00:28:03.480 [2024-11-28 19:16:24.161019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.161102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.161126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.480 qpair failed and we were unable to recover it. 00:28:03.480 [2024-11-28 19:16:24.161201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.161287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.161312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.480 qpair failed and we were unable to recover it. 00:28:03.480 [2024-11-28 19:16:24.161388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.161530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.161556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.480 qpair failed and we were unable to recover it. 00:28:03.480 [2024-11-28 19:16:24.161670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.161805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.161830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.480 qpair failed and we were unable to recover it. 00:28:03.480 [2024-11-28 19:16:24.161943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.162064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.162092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.480 qpair failed and we were unable to recover it. 00:28:03.480 [2024-11-28 19:16:24.162219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.162311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.162338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.480 qpair failed and we were unable to recover it. 00:28:03.480 [2024-11-28 19:16:24.162452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.162570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.162595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.480 qpair failed and we were unable to recover it. 00:28:03.480 [2024-11-28 19:16:24.162680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.162789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.162814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.480 qpair failed and we were unable to recover it. 00:28:03.480 [2024-11-28 19:16:24.162926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.163082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.163109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.480 qpair failed and we were unable to recover it. 00:28:03.480 [2024-11-28 19:16:24.163288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.163445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.163471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.480 qpair failed and we were unable to recover it. 00:28:03.480 [2024-11-28 19:16:24.163552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.163668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.163711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.480 qpair failed and we were unable to recover it. 00:28:03.480 [2024-11-28 19:16:24.163830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.163928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.163956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.480 qpair failed and we were unable to recover it. 00:28:03.480 [2024-11-28 19:16:24.164064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.164141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.164167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.480 qpair failed and we were unable to recover it. 00:28:03.480 [2024-11-28 19:16:24.164273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.164418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.164444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.480 qpair failed and we were unable to recover it. 00:28:03.480 [2024-11-28 19:16:24.164533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.164619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.164644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.480 qpair failed and we were unable to recover it. 00:28:03.480 [2024-11-28 19:16:24.164758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.480 [2024-11-28 19:16:24.164843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.164868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.481 qpair failed and we were unable to recover it. 00:28:03.481 [2024-11-28 19:16:24.164975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.165057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.165082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.481 qpair failed and we were unable to recover it. 00:28:03.481 [2024-11-28 19:16:24.165163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.165319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.165346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.481 qpair failed and we were unable to recover it. 00:28:03.481 [2024-11-28 19:16:24.165494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.165606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.165631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.481 qpair failed and we were unable to recover it. 00:28:03.481 [2024-11-28 19:16:24.165720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.165844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.165869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.481 qpair failed and we were unable to recover it. 00:28:03.481 [2024-11-28 19:16:24.165947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.166057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.166082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.481 qpair failed and we were unable to recover it. 00:28:03.481 [2024-11-28 19:16:24.166237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.166350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.166377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.481 qpair failed and we were unable to recover it. 00:28:03.481 [2024-11-28 19:16:24.166500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.166585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.166610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.481 qpair failed and we were unable to recover it. 00:28:03.481 [2024-11-28 19:16:24.166782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.166900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.166925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.481 qpair failed and we were unable to recover it. 00:28:03.481 [2024-11-28 19:16:24.167042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.167177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.167202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.481 qpair failed and we were unable to recover it. 00:28:03.481 [2024-11-28 19:16:24.167328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.167421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.167450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.481 qpair failed and we were unable to recover it. 00:28:03.481 [2024-11-28 19:16:24.167555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.167685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.167710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.481 qpair failed and we were unable to recover it. 00:28:03.481 [2024-11-28 19:16:24.167791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.167873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.167898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.481 qpair failed and we were unable to recover it. 00:28:03.481 [2024-11-28 19:16:24.167976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.168086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.168111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.481 qpair failed and we were unable to recover it. 00:28:03.481 [2024-11-28 19:16:24.168247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.168367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.168401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.481 qpair failed and we were unable to recover it. 00:28:03.481 [2024-11-28 19:16:24.168521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.168601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.168626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.481 qpair failed and we were unable to recover it. 00:28:03.481 [2024-11-28 19:16:24.168741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.168908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.168936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.481 qpair failed and we were unable to recover it. 00:28:03.481 [2024-11-28 19:16:24.169084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.169203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.169232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.481 qpair failed and we were unable to recover it. 00:28:03.481 [2024-11-28 19:16:24.169324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.169431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.169457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.481 qpair failed and we were unable to recover it. 00:28:03.481 [2024-11-28 19:16:24.169534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.169675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.169701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.481 qpair failed and we were unable to recover it. 00:28:03.481 [2024-11-28 19:16:24.169815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.169951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.169976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.481 qpair failed and we were unable to recover it. 00:28:03.481 [2024-11-28 19:16:24.170057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.170167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.170193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.481 qpair failed and we were unable to recover it. 00:28:03.481 [2024-11-28 19:16:24.170313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.170402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.170428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.481 qpair failed and we were unable to recover it. 00:28:03.481 [2024-11-28 19:16:24.170514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.170630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.170658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.481 qpair failed and we were unable to recover it. 00:28:03.481 [2024-11-28 19:16:24.170818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.170895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.170920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.481 qpair failed and we were unable to recover it. 00:28:03.481 [2024-11-28 19:16:24.171014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.171141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.171168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.481 qpair failed and we were unable to recover it. 00:28:03.481 [2024-11-28 19:16:24.171294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.171425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.171467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.481 qpair failed and we were unable to recover it. 00:28:03.481 [2024-11-28 19:16:24.171610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.171729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.171754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.481 qpair failed and we were unable to recover it. 00:28:03.481 [2024-11-28 19:16:24.171838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.171914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.481 [2024-11-28 19:16:24.171939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.481 qpair failed and we were unable to recover it. 00:28:03.482 [2024-11-28 19:16:24.172058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.172168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.172210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.482 qpair failed and we were unable to recover it. 00:28:03.482 [2024-11-28 19:16:24.172341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.172450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.172476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.482 qpair failed and we were unable to recover it. 00:28:03.482 [2024-11-28 19:16:24.172610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.172696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.172723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.482 qpair failed and we were unable to recover it. 00:28:03.482 [2024-11-28 19:16:24.172845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.172994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.173021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.482 qpair failed and we were unable to recover it. 00:28:03.482 [2024-11-28 19:16:24.173153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.173238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.173264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.482 qpair failed and we were unable to recover it. 00:28:03.482 [2024-11-28 19:16:24.173411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.173571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.173596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.482 qpair failed and we were unable to recover it. 00:28:03.482 [2024-11-28 19:16:24.173685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.173809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.173838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.482 qpair failed and we were unable to recover it. 00:28:03.482 [2024-11-28 19:16:24.173946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.174085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.174110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.482 qpair failed and we were unable to recover it. 00:28:03.482 [2024-11-28 19:16:24.174212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.174331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.174360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.482 qpair failed and we were unable to recover it. 00:28:03.482 [2024-11-28 19:16:24.174462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.174562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.174590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.482 qpair failed and we were unable to recover it. 00:28:03.482 [2024-11-28 19:16:24.174719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.174812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.174837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.482 qpair failed and we were unable to recover it. 00:28:03.482 [2024-11-28 19:16:24.174942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.175029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.175055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.482 qpair failed and we were unable to recover it. 00:28:03.482 [2024-11-28 19:16:24.175195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.175310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.175337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.482 qpair failed and we were unable to recover it. 00:28:03.482 [2024-11-28 19:16:24.175468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.175563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.175588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.482 qpair failed and we were unable to recover it. 00:28:03.482 [2024-11-28 19:16:24.175719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.175836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.175864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.482 qpair failed and we were unable to recover it. 00:28:03.482 [2024-11-28 19:16:24.175958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.176050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.176077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.482 qpair failed and we were unable to recover it. 00:28:03.482 [2024-11-28 19:16:24.176216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.176298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.176323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.482 qpair failed and we were unable to recover it. 00:28:03.482 [2024-11-28 19:16:24.176457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.176609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.176637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.482 qpair failed and we were unable to recover it. 00:28:03.482 [2024-11-28 19:16:24.176788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.176898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.176927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.482 qpair failed and we were unable to recover it. 00:28:03.482 [2024-11-28 19:16:24.177057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.177198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.177223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.482 qpair failed and we were unable to recover it. 00:28:03.482 [2024-11-28 19:16:24.177386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.177547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.177575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.482 qpair failed and we were unable to recover it. 00:28:03.482 [2024-11-28 19:16:24.177746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.177857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.177881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.482 qpair failed and we were unable to recover it. 00:28:03.482 [2024-11-28 19:16:24.177996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.178073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.178099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.482 qpair failed and we were unable to recover it. 00:28:03.482 [2024-11-28 19:16:24.178189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.178362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.482 [2024-11-28 19:16:24.178387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-28 19:16:24.178535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.178639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.178669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-28 19:16:24.178808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.178899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.178924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-28 19:16:24.179034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.179105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.179130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-28 19:16:24.179243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.179339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.179366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-28 19:16:24.179519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.179640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.179664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-28 19:16:24.179800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.179895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.179925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-28 19:16:24.180011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.180159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.180194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-28 19:16:24.180295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.180408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.180434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-28 19:16:24.180548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.180684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.180712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-28 19:16:24.180806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.180929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.180957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-28 19:16:24.181096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.181179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.181205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-28 19:16:24.181325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.181420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.181449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-28 19:16:24.181577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.181706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.181731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-28 19:16:24.181848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.181960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.181985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-28 19:16:24.182117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.182209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.182237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-28 19:16:24.182357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.182520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.182548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-28 19:16:24.182676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.182789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.182818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-28 19:16:24.182920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.183086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.183111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-28 19:16:24.183254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.183332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.183374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-28 19:16:24.183528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.183613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.183638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-28 19:16:24.183721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.183829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.183853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-28 19:16:24.183998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.184088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.184116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-28 19:16:24.184255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.184365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.184390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-28 19:16:24.184505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.184638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.184667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-28 19:16:24.184747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.184856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.184883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-28 19:16:24.185051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.185138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.185167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-28 19:16:24.185264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.185412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.185446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.483 qpair failed and we were unable to recover it. 00:28:03.483 [2024-11-28 19:16:24.185569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.483 [2024-11-28 19:16:24.185724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.185751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.484 qpair failed and we were unable to recover it. 00:28:03.484 [2024-11-28 19:16:24.185882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.185993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.186019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.484 qpair failed and we were unable to recover it. 00:28:03.484 [2024-11-28 19:16:24.186183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.186310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.186335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.484 qpair failed and we were unable to recover it. 00:28:03.484 [2024-11-28 19:16:24.186474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.186566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.186594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.484 qpair failed and we were unable to recover it. 00:28:03.484 [2024-11-28 19:16:24.186739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.186844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.186869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.484 qpair failed and we were unable to recover it. 00:28:03.484 [2024-11-28 19:16:24.186957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.187111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.187135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.484 qpair failed and we were unable to recover it. 00:28:03.484 [2024-11-28 19:16:24.187222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.187333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.187358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.484 qpair failed and we were unable to recover it. 00:28:03.484 [2024-11-28 19:16:24.187471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.187554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.187579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.484 qpair failed and we were unable to recover it. 00:28:03.484 [2024-11-28 19:16:24.187658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.187766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.187790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.484 qpair failed and we were unable to recover it. 00:28:03.484 [2024-11-28 19:16:24.187906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.188047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.188080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.484 qpair failed and we were unable to recover it. 00:28:03.484 [2024-11-28 19:16:24.188215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.188290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.188315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.484 qpair failed and we were unable to recover it. 00:28:03.484 [2024-11-28 19:16:24.188429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.188537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.188566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.484 qpair failed and we were unable to recover it. 00:28:03.484 [2024-11-28 19:16:24.188691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.188803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.188832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.484 qpair failed and we were unable to recover it. 00:28:03.484 [2024-11-28 19:16:24.188967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.189073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.189098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.484 qpair failed and we were unable to recover it. 00:28:03.484 [2024-11-28 19:16:24.189225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.189327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.189355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.484 qpair failed and we were unable to recover it. 00:28:03.484 [2024-11-28 19:16:24.189463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.189577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.189602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.484 qpair failed and we were unable to recover it. 00:28:03.484 [2024-11-28 19:16:24.189684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.189787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.189811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.484 qpair failed and we were unable to recover it. 00:28:03.484 [2024-11-28 19:16:24.189907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.190065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.190092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.484 qpair failed and we were unable to recover it. 00:28:03.484 [2024-11-28 19:16:24.190191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.190281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.190309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.484 qpair failed and we were unable to recover it. 00:28:03.484 [2024-11-28 19:16:24.190473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.190550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.190575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.484 qpair failed and we were unable to recover it. 00:28:03.484 [2024-11-28 19:16:24.190714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.190860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.190888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.484 qpair failed and we were unable to recover it. 00:28:03.484 [2024-11-28 19:16:24.190968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.191088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.191116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.484 qpair failed and we were unable to recover it. 00:28:03.484 [2024-11-28 19:16:24.191221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.191299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.191324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.484 qpair failed and we were unable to recover it. 00:28:03.484 [2024-11-28 19:16:24.191452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.191573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.191602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.484 qpair failed and we were unable to recover it. 00:28:03.484 [2024-11-28 19:16:24.191698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.191849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.191876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.484 qpair failed and we were unable to recover it. 00:28:03.484 [2024-11-28 19:16:24.192035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.192128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.192153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.484 qpair failed and we were unable to recover it. 00:28:03.484 [2024-11-28 19:16:24.192268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.192351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.192400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.484 qpair failed and we were unable to recover it. 00:28:03.484 [2024-11-28 19:16:24.192531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.192662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.192690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.484 qpair failed and we were unable to recover it. 00:28:03.484 [2024-11-28 19:16:24.192798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.192912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.484 [2024-11-28 19:16:24.192937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.484 qpair failed and we were unable to recover it. 00:28:03.485 [2024-11-28 19:16:24.193056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.193186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.193229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.485 qpair failed and we were unable to recover it. 00:28:03.485 [2024-11-28 19:16:24.193309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.193398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.193424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.485 qpair failed and we were unable to recover it. 00:28:03.485 [2024-11-28 19:16:24.193563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.193682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.193707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.485 qpair failed and we were unable to recover it. 00:28:03.485 [2024-11-28 19:16:24.193796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.193924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.193951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.485 qpair failed and we were unable to recover it. 00:28:03.485 [2024-11-28 19:16:24.194066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.194219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.194247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.485 qpair failed and we were unable to recover it. 00:28:03.485 [2024-11-28 19:16:24.194342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.194448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.194473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.485 qpair failed and we were unable to recover it. 00:28:03.485 [2024-11-28 19:16:24.194548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.194684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.194713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.485 qpair failed and we were unable to recover it. 00:28:03.485 [2024-11-28 19:16:24.194861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.195017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.195044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.485 qpair failed and we were unable to recover it. 00:28:03.485 [2024-11-28 19:16:24.195200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.195335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.195360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.485 qpair failed and we were unable to recover it. 00:28:03.485 [2024-11-28 19:16:24.195512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.195602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.195630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.485 qpair failed and we were unable to recover it. 00:28:03.485 [2024-11-28 19:16:24.195747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.195892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.195920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.485 qpair failed and we were unable to recover it. 00:28:03.485 [2024-11-28 19:16:24.196058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.196170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.196195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.485 qpair failed and we were unable to recover it. 00:28:03.485 [2024-11-28 19:16:24.196294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.196380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.196417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.485 qpair failed and we were unable to recover it. 00:28:03.485 [2024-11-28 19:16:24.196513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.196593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.196635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.485 qpair failed and we were unable to recover it. 00:28:03.485 [2024-11-28 19:16:24.196715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.196796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.196821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.485 qpair failed and we were unable to recover it. 00:28:03.485 [2024-11-28 19:16:24.196960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.197062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.197089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.485 qpair failed and we were unable to recover it. 00:28:03.485 [2024-11-28 19:16:24.197208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.197355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.197382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.485 qpair failed and we were unable to recover it. 00:28:03.485 [2024-11-28 19:16:24.197521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.197628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.197653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.485 qpair failed and we were unable to recover it. 00:28:03.485 [2024-11-28 19:16:24.197777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.197867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.197896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.485 qpair failed and we were unable to recover it. 00:28:03.485 [2024-11-28 19:16:24.197985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.198108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.198137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.485 qpair failed and we were unable to recover it. 00:28:03.485 [2024-11-28 19:16:24.198268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.198385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.198418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.485 qpair failed and we were unable to recover it. 00:28:03.485 [2024-11-28 19:16:24.198515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.198629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.198654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.485 qpair failed and we were unable to recover it. 00:28:03.485 [2024-11-28 19:16:24.198740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.198892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.198919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.485 qpair failed and we were unable to recover it. 00:28:03.485 [2024-11-28 19:16:24.199024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.199117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.199143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.485 qpair failed and we were unable to recover it. 00:28:03.485 [2024-11-28 19:16:24.199277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.199364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.199400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.485 qpair failed and we were unable to recover it. 00:28:03.485 [2024-11-28 19:16:24.199563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.199644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.199668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.485 qpair failed and we were unable to recover it. 00:28:03.485 [2024-11-28 19:16:24.199806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.199903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.199928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.485 qpair failed and we were unable to recover it. 00:28:03.485 [2024-11-28 19:16:24.200089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.200175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.485 [2024-11-28 19:16:24.200204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.485 qpair failed and we were unable to recover it. 00:28:03.485 [2024-11-28 19:16:24.200330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.200451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.200481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.486 qpair failed and we were unable to recover it. 00:28:03.486 [2024-11-28 19:16:24.200606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.200720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.200747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.486 qpair failed and we were unable to recover it. 00:28:03.486 [2024-11-28 19:16:24.200920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.201002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.201026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.486 qpair failed and we were unable to recover it. 00:28:03.486 [2024-11-28 19:16:24.201116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.201225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.201253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.486 qpair failed and we were unable to recover it. 00:28:03.486 [2024-11-28 19:16:24.201388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.201511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.201535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.486 qpair failed and we were unable to recover it. 00:28:03.486 [2024-11-28 19:16:24.201613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.201732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.201756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.486 qpair failed and we were unable to recover it. 00:28:03.486 [2024-11-28 19:16:24.201868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.202031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.202059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.486 qpair failed and we were unable to recover it. 00:28:03.486 [2024-11-28 19:16:24.202164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.202240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.202265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.486 qpair failed and we were unable to recover it. 00:28:03.486 [2024-11-28 19:16:24.202379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.202534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.202559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.486 qpair failed and we were unable to recover it. 00:28:03.486 [2024-11-28 19:16:24.202638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.202745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.202770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.486 qpair failed and we were unable to recover it. 00:28:03.486 [2024-11-28 19:16:24.202925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.203038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.203063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.486 qpair failed and we were unable to recover it. 00:28:03.486 [2024-11-28 19:16:24.203171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.203294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.203325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.486 qpair failed and we were unable to recover it. 00:28:03.486 [2024-11-28 19:16:24.203447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.203573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.203600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.486 qpair failed and we were unable to recover it. 00:28:03.486 [2024-11-28 19:16:24.203734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.203844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.203869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.486 qpair failed and we were unable to recover it. 00:28:03.486 [2024-11-28 19:16:24.203958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.204035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.204059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.486 qpair failed and we were unable to recover it. 00:28:03.486 [2024-11-28 19:16:24.204150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.204279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.204307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.486 qpair failed and we were unable to recover it. 00:28:03.486 [2024-11-28 19:16:24.204450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.204563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.204588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.486 qpair failed and we were unable to recover it. 00:28:03.486 [2024-11-28 19:16:24.204702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.204834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.204862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.486 qpair failed and we were unable to recover it. 00:28:03.486 [2024-11-28 19:16:24.204942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.205065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.205093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.486 qpair failed and we were unable to recover it. 00:28:03.486 [2024-11-28 19:16:24.205198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.205270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.205295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.486 qpair failed and we were unable to recover it. 00:28:03.486 [2024-11-28 19:16:24.205400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.205512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.205537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.486 qpair failed and we were unable to recover it. 00:28:03.486 [2024-11-28 19:16:24.205647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.205726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.205752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.486 qpair failed and we were unable to recover it. 00:28:03.486 [2024-11-28 19:16:24.205888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.205963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.205987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.486 qpair failed and we were unable to recover it. 00:28:03.486 [2024-11-28 19:16:24.206098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.206269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.206297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.486 qpair failed and we were unable to recover it. 00:28:03.486 [2024-11-28 19:16:24.206445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.206522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.206547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.486 qpair failed and we were unable to recover it. 00:28:03.486 [2024-11-28 19:16:24.206630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.206768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.206793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.486 qpair failed and we were unable to recover it. 00:28:03.486 [2024-11-28 19:16:24.206873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.206983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.207008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.486 qpair failed and we were unable to recover it. 00:28:03.486 [2024-11-28 19:16:24.207115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.207195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.207220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.486 qpair failed and we were unable to recover it. 00:28:03.486 [2024-11-28 19:16:24.207340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.486 [2024-11-28 19:16:24.207429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.207455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.487 qpair failed and we were unable to recover it. 00:28:03.487 [2024-11-28 19:16:24.207573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.207683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.207710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.487 qpair failed and we were unable to recover it. 00:28:03.487 [2024-11-28 19:16:24.207840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.207958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.207985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.487 qpair failed and we were unable to recover it. 00:28:03.487 [2024-11-28 19:16:24.208082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.208157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.208182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.487 qpair failed and we were unable to recover it. 00:28:03.487 [2024-11-28 19:16:24.208274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.208386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.208421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.487 qpair failed and we were unable to recover it. 00:28:03.487 [2024-11-28 19:16:24.208561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.208684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.208712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.487 qpair failed and we were unable to recover it. 00:28:03.487 [2024-11-28 19:16:24.208820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.208960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.208985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.487 qpair failed and we were unable to recover it. 00:28:03.487 [2024-11-28 19:16:24.209115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.209198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.209226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.487 qpair failed and we were unable to recover it. 00:28:03.487 [2024-11-28 19:16:24.209387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.209480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.209508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.487 qpair failed and we were unable to recover it. 00:28:03.487 [2024-11-28 19:16:24.209612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.209728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.209753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.487 qpair failed and we were unable to recover it. 00:28:03.487 [2024-11-28 19:16:24.209880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.210009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.210036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.487 qpair failed and we were unable to recover it. 00:28:03.487 [2024-11-28 19:16:24.210190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.210282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.210310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.487 qpair failed and we were unable to recover it. 00:28:03.487 [2024-11-28 19:16:24.210473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.210589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.210614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.487 qpair failed and we were unable to recover it. 00:28:03.487 [2024-11-28 19:16:24.210754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.210897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.210924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.487 qpair failed and we were unable to recover it. 00:28:03.487 [2024-11-28 19:16:24.211049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.211172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.211200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.487 qpair failed and we were unable to recover it. 00:28:03.487 [2024-11-28 19:16:24.211303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.211414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.211440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.487 qpair failed and we were unable to recover it. 00:28:03.487 [2024-11-28 19:16:24.211590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.211691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.211719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.487 qpair failed and we were unable to recover it. 00:28:03.487 [2024-11-28 19:16:24.211804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.211954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.211982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.487 qpair failed and we were unable to recover it. 00:28:03.487 [2024-11-28 19:16:24.212083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.212168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.212192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.487 qpair failed and we were unable to recover it. 00:28:03.487 [2024-11-28 19:16:24.212307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.212398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.212424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.487 qpair failed and we were unable to recover it. 00:28:03.487 [2024-11-28 19:16:24.212561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.212685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.212713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.487 qpair failed and we were unable to recover it. 00:28:03.487 [2024-11-28 19:16:24.212851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.212963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.212988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.487 qpair failed and we were unable to recover it. 00:28:03.487 [2024-11-28 19:16:24.213135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.213241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.213266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.487 qpair failed and we were unable to recover it. 00:28:03.487 [2024-11-28 19:16:24.213384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.213507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.213535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.487 qpair failed and we were unable to recover it. 00:28:03.487 [2024-11-28 19:16:24.213675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.213765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.487 [2024-11-28 19:16:24.213790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.487 qpair failed and we were unable to recover it. 00:28:03.488 [2024-11-28 19:16:24.213960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.214043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.214068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.488 qpair failed and we were unable to recover it. 00:28:03.488 [2024-11-28 19:16:24.214207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.214341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.214369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.488 qpair failed and we were unable to recover it. 00:28:03.488 [2024-11-28 19:16:24.214484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.214590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.214614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.488 qpair failed and we were unable to recover it. 00:28:03.488 [2024-11-28 19:16:24.214722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.214857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.214884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.488 qpair failed and we were unable to recover it. 00:28:03.488 [2024-11-28 19:16:24.214966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.215062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.215089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.488 qpair failed and we were unable to recover it. 00:28:03.488 [2024-11-28 19:16:24.215224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.215342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.215367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.488 qpair failed and we were unable to recover it. 00:28:03.488 [2024-11-28 19:16:24.215499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.215615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.215641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.488 qpair failed and we were unable to recover it. 00:28:03.488 [2024-11-28 19:16:24.215787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.215903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.215931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.488 qpair failed and we were unable to recover it. 00:28:03.488 [2024-11-28 19:16:24.216062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.216201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.216225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.488 qpair failed and we were unable to recover it. 00:28:03.488 [2024-11-28 19:16:24.216369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.216477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.216502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.488 qpair failed and we were unable to recover it. 00:28:03.488 [2024-11-28 19:16:24.216588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.216708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.216733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.488 qpair failed and we were unable to recover it. 00:28:03.488 [2024-11-28 19:16:24.216841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.216948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.216973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.488 qpair failed and we were unable to recover it. 00:28:03.488 [2024-11-28 19:16:24.217054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.217135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.217160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.488 qpair failed and we were unable to recover it. 00:28:03.488 [2024-11-28 19:16:24.217298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.217427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.217456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.488 qpair failed and we were unable to recover it. 00:28:03.488 [2024-11-28 19:16:24.217596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.217710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.217735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.488 qpair failed and we were unable to recover it. 00:28:03.488 [2024-11-28 19:16:24.217866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.217988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.218017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.488 qpair failed and we were unable to recover it. 00:28:03.488 [2024-11-28 19:16:24.218110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.218235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.218263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.488 qpair failed and we were unable to recover it. 00:28:03.488 [2024-11-28 19:16:24.218396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.218510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.218535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.488 qpair failed and we were unable to recover it. 00:28:03.488 [2024-11-28 19:16:24.218617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.218746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.218774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.488 qpair failed and we were unable to recover it. 00:28:03.488 [2024-11-28 19:16:24.218867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.218981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.219009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.488 qpair failed and we were unable to recover it. 00:28:03.488 [2024-11-28 19:16:24.219140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.219231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.219256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.488 qpair failed and we were unable to recover it. 00:28:03.488 [2024-11-28 19:16:24.219339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.219497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.219526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.488 qpair failed and we were unable to recover it. 00:28:03.488 [2024-11-28 19:16:24.219652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.219745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.219772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.488 qpair failed and we were unable to recover it. 00:28:03.488 [2024-11-28 19:16:24.219904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.220023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.220048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.488 qpair failed and we were unable to recover it. 00:28:03.488 [2024-11-28 19:16:24.220172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.220262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.220290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.488 qpair failed and we were unable to recover it. 00:28:03.488 [2024-11-28 19:16:24.220408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.220509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.220537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.488 qpair failed and we were unable to recover it. 00:28:03.488 [2024-11-28 19:16:24.220675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.220756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.220781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.488 qpair failed and we were unable to recover it. 00:28:03.488 [2024-11-28 19:16:24.220865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.220943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.220968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.488 qpair failed and we were unable to recover it. 00:28:03.488 [2024-11-28 19:16:24.221083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.488 [2024-11-28 19:16:24.221246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.221273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.489 qpair failed and we were unable to recover it. 00:28:03.489 [2024-11-28 19:16:24.221434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.221522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.221547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.489 qpair failed and we were unable to recover it. 00:28:03.489 [2024-11-28 19:16:24.221678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.221792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.221840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.489 qpair failed and we were unable to recover it. 00:28:03.489 [2024-11-28 19:16:24.221952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.222092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.222117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.489 qpair failed and we were unable to recover it. 00:28:03.489 [2024-11-28 19:16:24.222257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.222363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.222388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.489 qpair failed and we were unable to recover it. 00:28:03.489 [2024-11-28 19:16:24.222528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.222677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.222704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.489 qpair failed and we were unable to recover it. 00:28:03.489 [2024-11-28 19:16:24.222829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.222923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.222952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.489 qpair failed and we were unable to recover it. 00:28:03.489 [2024-11-28 19:16:24.223128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.223216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.223241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.489 qpair failed and we were unable to recover it. 00:28:03.489 [2024-11-28 19:16:24.223364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.223501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.223529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.489 qpair failed and we were unable to recover it. 00:28:03.489 [2024-11-28 19:16:24.223608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.223732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.223759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.489 qpair failed and we were unable to recover it. 00:28:03.489 [2024-11-28 19:16:24.223861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.223970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.223996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.489 qpair failed and we were unable to recover it. 00:28:03.489 [2024-11-28 19:16:24.224149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.224279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.224308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.489 qpair failed and we were unable to recover it. 00:28:03.489 [2024-11-28 19:16:24.224431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.224601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.224631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.489 qpair failed and we were unable to recover it. 00:28:03.489 [2024-11-28 19:16:24.224779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.224859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.224885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.489 qpair failed and we were unable to recover it. 00:28:03.489 [2024-11-28 19:16:24.224990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.225105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.225133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.489 qpair failed and we were unable to recover it. 00:28:03.489 [2024-11-28 19:16:24.225258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.225363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.225389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.489 qpair failed and we were unable to recover it. 00:28:03.489 [2024-11-28 19:16:24.225546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.225656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.225681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.489 qpair failed and we were unable to recover it. 00:28:03.489 [2024-11-28 19:16:24.225793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.225887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.225914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.489 qpair failed and we were unable to recover it. 00:28:03.489 [2024-11-28 19:16:24.226064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.226154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.226183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.489 qpair failed and we were unable to recover it. 00:28:03.489 [2024-11-28 19:16:24.226328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.226436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.226463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.489 qpair failed and we were unable to recover it. 00:28:03.489 [2024-11-28 19:16:24.226617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.226739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.226767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.489 qpair failed and we were unable to recover it. 00:28:03.489 [2024-11-28 19:16:24.226846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.226964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.226992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.489 qpair failed and we were unable to recover it. 00:28:03.489 [2024-11-28 19:16:24.227116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.227228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.227257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.489 qpair failed and we were unable to recover it. 00:28:03.489 [2024-11-28 19:16:24.227356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.227486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.227516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.489 qpair failed and we were unable to recover it. 00:28:03.489 [2024-11-28 19:16:24.227668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.227791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.227819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.489 qpair failed and we were unable to recover it. 00:28:03.489 [2024-11-28 19:16:24.227958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.228098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.228123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.489 qpair failed and we were unable to recover it. 00:28:03.489 [2024-11-28 19:16:24.228240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.228354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.228381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.489 qpair failed and we were unable to recover it. 00:28:03.489 [2024-11-28 19:16:24.228476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.228557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.228585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.489 qpair failed and we were unable to recover it. 00:28:03.489 [2024-11-28 19:16:24.228696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.228810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.489 [2024-11-28 19:16:24.228837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.489 qpair failed and we were unable to recover it. 00:28:03.490 [2024-11-28 19:16:24.228983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.229132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.229160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.490 qpair failed and we were unable to recover it. 00:28:03.490 [2024-11-28 19:16:24.229280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.229399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.229427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.490 qpair failed and we were unable to recover it. 00:28:03.490 [2024-11-28 19:16:24.229533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.229650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.229675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.490 qpair failed and we were unable to recover it. 00:28:03.490 [2024-11-28 19:16:24.229790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.229899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.229929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.490 qpair failed and we were unable to recover it. 00:28:03.490 [2024-11-28 19:16:24.230067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.230217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.230258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.490 qpair failed and we were unable to recover it. 00:28:03.490 [2024-11-28 19:16:24.230383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.230502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.230527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.490 qpair failed and we were unable to recover it. 00:28:03.490 [2024-11-28 19:16:24.230607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.230720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.230745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.490 qpair failed and we were unable to recover it. 00:28:03.490 [2024-11-28 19:16:24.230919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.231036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.231064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.490 qpair failed and we were unable to recover it. 00:28:03.490 [2024-11-28 19:16:24.231217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.231326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.231351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.490 qpair failed and we were unable to recover it. 00:28:03.490 [2024-11-28 19:16:24.231518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.231606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.231630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.490 qpair failed and we were unable to recover it. 00:28:03.490 [2024-11-28 19:16:24.231738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.231829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.231855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.490 qpair failed and we were unable to recover it. 00:28:03.490 [2024-11-28 19:16:24.231974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.232081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.232106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.490 qpair failed and we were unable to recover it. 00:28:03.490 [2024-11-28 19:16:24.232193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.232356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.232384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.490 qpair failed and we were unable to recover it. 00:28:03.490 [2024-11-28 19:16:24.232543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.232663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.232691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.490 qpair failed and we were unable to recover it. 00:28:03.490 [2024-11-28 19:16:24.232804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.232890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.232916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.490 qpair failed and we were unable to recover it. 00:28:03.490 [2024-11-28 19:16:24.233029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.233142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.233167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.490 qpair failed and we were unable to recover it. 00:28:03.490 [2024-11-28 19:16:24.233248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.233355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.233383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.490 qpair failed and we were unable to recover it. 00:28:03.490 [2024-11-28 19:16:24.233509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.233645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.233669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.490 qpair failed and we were unable to recover it. 00:28:03.490 [2024-11-28 19:16:24.233758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.233865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.233890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.490 qpair failed and we were unable to recover it. 00:28:03.490 [2024-11-28 19:16:24.234020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.234180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.234208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.490 qpair failed and we were unable to recover it. 00:28:03.490 [2024-11-28 19:16:24.234340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.234457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.234483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.490 qpair failed and we were unable to recover it. 00:28:03.490 [2024-11-28 19:16:24.234611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.234689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.234716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.490 qpair failed and we were unable to recover it. 00:28:03.490 [2024-11-28 19:16:24.234860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.234967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.234992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.490 qpair failed and we were unable to recover it. 00:28:03.490 [2024-11-28 19:16:24.235074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.235179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.235204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.490 qpair failed and we were unable to recover it. 00:28:03.490 [2024-11-28 19:16:24.235324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.235452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.235479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.490 qpair failed and we were unable to recover it. 00:28:03.490 [2024-11-28 19:16:24.235567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.235678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.235706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.490 qpair failed and we were unable to recover it. 00:28:03.490 [2024-11-28 19:16:24.235801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.235914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.235941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.490 qpair failed and we were unable to recover it. 00:28:03.490 [2024-11-28 19:16:24.236053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.236220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.236248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.490 qpair failed and we were unable to recover it. 00:28:03.490 [2024-11-28 19:16:24.236327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.490 [2024-11-28 19:16:24.236415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.236443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.491 qpair failed and we were unable to recover it. 00:28:03.491 [2024-11-28 19:16:24.236556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.236660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.236685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.491 qpair failed and we were unable to recover it. 00:28:03.491 [2024-11-28 19:16:24.236821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.236911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.236939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.491 qpair failed and we were unable to recover it. 00:28:03.491 [2024-11-28 19:16:24.237059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.237182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.237210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.491 qpair failed and we were unable to recover it. 00:28:03.491 [2024-11-28 19:16:24.237369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.237488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.237514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.491 qpair failed and we were unable to recover it. 00:28:03.491 [2024-11-28 19:16:24.237655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.237789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.237817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.491 qpair failed and we were unable to recover it. 00:28:03.491 [2024-11-28 19:16:24.237920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.238039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.238067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.491 qpair failed and we were unable to recover it. 00:28:03.491 [2024-11-28 19:16:24.238229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.238331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.238356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.491 qpair failed and we were unable to recover it. 00:28:03.491 [2024-11-28 19:16:24.238525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.238651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.238676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.491 qpair failed and we were unable to recover it. 00:28:03.491 [2024-11-28 19:16:24.238797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.238951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.238979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.491 qpair failed and we were unable to recover it. 00:28:03.491 [2024-11-28 19:16:24.239111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.239196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.239222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.491 qpair failed and we were unable to recover it. 00:28:03.491 [2024-11-28 19:16:24.239307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.239414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.239443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.491 qpair failed and we were unable to recover it. 00:28:03.491 [2024-11-28 19:16:24.239530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.239619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.239647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.491 qpair failed and we were unable to recover it. 00:28:03.491 [2024-11-28 19:16:24.239748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.239859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.239883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.491 qpair failed and we were unable to recover it. 00:28:03.491 [2024-11-28 19:16:24.239957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.240058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.240084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.491 qpair failed and we were unable to recover it. 00:28:03.491 [2024-11-28 19:16:24.240210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.240340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.240365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.491 qpair failed and we were unable to recover it. 00:28:03.491 [2024-11-28 19:16:24.240466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.240579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.240603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.491 qpair failed and we were unable to recover it. 00:28:03.491 [2024-11-28 19:16:24.240686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.240851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.240892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.491 qpair failed and we were unable to recover it. 00:28:03.491 [2024-11-28 19:16:24.241031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.241169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.241196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.491 qpair failed and we were unable to recover it. 00:28:03.491 [2024-11-28 19:16:24.241359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.241479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.241504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.491 qpair failed and we were unable to recover it. 00:28:03.491 [2024-11-28 19:16:24.241635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.241754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.241781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.491 qpair failed and we were unable to recover it. 00:28:03.491 [2024-11-28 19:16:24.241872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.241986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.242014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.491 qpair failed and we were unable to recover it. 00:28:03.491 [2024-11-28 19:16:24.242152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.242265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.242289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.491 qpair failed and we were unable to recover it. 00:28:03.491 [2024-11-28 19:16:24.242364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.242457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.242484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.491 qpair failed and we were unable to recover it. 00:28:03.491 [2024-11-28 19:16:24.242575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.242658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.242683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.491 qpair failed and we were unable to recover it. 00:28:03.491 [2024-11-28 19:16:24.242820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.242954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.242994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.491 qpair failed and we were unable to recover it. 00:28:03.491 [2024-11-28 19:16:24.243092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.243211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.243239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.491 qpair failed and we were unable to recover it. 00:28:03.491 [2024-11-28 19:16:24.243360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.243509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.243539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.491 qpair failed and we were unable to recover it. 00:28:03.491 [2024-11-28 19:16:24.243694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.243773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.491 [2024-11-28 19:16:24.243800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.492 qpair failed and we were unable to recover it. 00:28:03.492 [2024-11-28 19:16:24.243904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.244032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.244059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.492 qpair failed and we were unable to recover it. 00:28:03.492 [2024-11-28 19:16:24.244185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.244301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.244330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.492 qpair failed and we were unable to recover it. 00:28:03.492 [2024-11-28 19:16:24.244486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.244599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.244624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.492 qpair failed and we were unable to recover it. 00:28:03.492 [2024-11-28 19:16:24.244762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.244917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.244941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.492 qpair failed and we were unable to recover it. 00:28:03.492 [2024-11-28 19:16:24.245079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.245188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.245216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.492 qpair failed and we were unable to recover it. 00:28:03.492 [2024-11-28 19:16:24.245314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.245405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.245431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.492 qpair failed and we were unable to recover it. 00:28:03.492 [2024-11-28 19:16:24.245515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.245646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.245674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.492 qpair failed and we were unable to recover it. 00:28:03.492 [2024-11-28 19:16:24.245801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.245952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.245980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.492 qpair failed and we were unable to recover it. 00:28:03.492 [2024-11-28 19:16:24.246079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.246154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.246178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.492 qpair failed and we were unable to recover it. 00:28:03.492 [2024-11-28 19:16:24.246289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.246404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.246433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.492 qpair failed and we were unable to recover it. 00:28:03.492 [2024-11-28 19:16:24.246528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.246622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.246650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.492 qpair failed and we were unable to recover it. 00:28:03.492 [2024-11-28 19:16:24.246759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.246879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.246904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.492 qpair failed and we were unable to recover it. 00:28:03.492 [2024-11-28 19:16:24.247002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.247115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.247143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.492 qpair failed and we were unable to recover it. 00:28:03.492 [2024-11-28 19:16:24.247272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.247370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.247412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.492 qpair failed and we were unable to recover it. 00:28:03.492 [2024-11-28 19:16:24.247539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.247652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.247676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.492 qpair failed and we were unable to recover it. 00:28:03.492 [2024-11-28 19:16:24.247846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.247958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.247983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.492 qpair failed and we were unable to recover it. 00:28:03.492 [2024-11-28 19:16:24.248081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.248208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.248235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.492 qpair failed and we were unable to recover it. 00:28:03.492 [2024-11-28 19:16:24.248346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.248472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.248498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.492 qpair failed and we were unable to recover it. 00:28:03.492 [2024-11-28 19:16:24.248626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.248772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.248800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.492 qpair failed and we were unable to recover it. 00:28:03.492 [2024-11-28 19:16:24.248894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.248979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.249008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.492 qpair failed and we were unable to recover it. 00:28:03.492 [2024-11-28 19:16:24.249157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.249263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.249287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.492 qpair failed and we were unable to recover it. 00:28:03.492 [2024-11-28 19:16:24.249377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.249461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.249488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.492 qpair failed and we were unable to recover it. 00:28:03.492 [2024-11-28 19:16:24.249624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.249720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.249747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.492 qpair failed and we were unable to recover it. 00:28:03.492 [2024-11-28 19:16:24.249858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.249999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.250024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.492 qpair failed and we were unable to recover it. 00:28:03.492 [2024-11-28 19:16:24.250162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.250313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.492 [2024-11-28 19:16:24.250341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.492 qpair failed and we were unable to recover it. 00:28:03.492 [2024-11-28 19:16:24.250463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.250557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.250584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.493 qpair failed and we were unable to recover it. 00:28:03.493 [2024-11-28 19:16:24.250715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.250831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.250856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.493 qpair failed and we were unable to recover it. 00:28:03.493 [2024-11-28 19:16:24.251030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.251138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.251164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.493 qpair failed and we were unable to recover it. 00:28:03.493 [2024-11-28 19:16:24.251296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.251380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.251415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.493 qpair failed and we were unable to recover it. 00:28:03.493 [2024-11-28 19:16:24.251525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.251636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.251660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.493 qpair failed and we were unable to recover it. 00:28:03.493 [2024-11-28 19:16:24.251765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.251840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.251866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.493 qpair failed and we were unable to recover it. 00:28:03.493 [2024-11-28 19:16:24.251963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.252085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.252113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.493 qpair failed and we were unable to recover it. 00:28:03.493 [2024-11-28 19:16:24.252248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.252320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.252345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.493 qpair failed and we were unable to recover it. 00:28:03.493 [2024-11-28 19:16:24.252512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.252627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.252655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.493 qpair failed and we were unable to recover it. 00:28:03.493 [2024-11-28 19:16:24.252751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.252851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.252878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.493 qpair failed and we were unable to recover it. 00:28:03.493 [2024-11-28 19:16:24.252988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.253125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.253151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.493 qpair failed and we were unable to recover it. 00:28:03.493 [2024-11-28 19:16:24.253270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.253357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.253385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.493 qpair failed and we were unable to recover it. 00:28:03.493 [2024-11-28 19:16:24.253486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.253639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.253667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.493 qpair failed and we were unable to recover it. 00:28:03.493 [2024-11-28 19:16:24.253803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.253913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.253937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.493 qpair failed and we were unable to recover it. 00:28:03.493 [2024-11-28 19:16:24.254060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.254215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.254243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.493 qpair failed and we were unable to recover it. 00:28:03.493 [2024-11-28 19:16:24.254340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.254465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.254493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.493 qpair failed and we were unable to recover it. 00:28:03.493 [2024-11-28 19:16:24.254635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.254725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.254750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.493 qpair failed and we were unable to recover it. 00:28:03.493 [2024-11-28 19:16:24.254831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.254917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.254942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.493 qpair failed and we were unable to recover it. 00:28:03.493 [2024-11-28 19:16:24.255056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.255166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.255191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.493 qpair failed and we were unable to recover it. 00:28:03.493 [2024-11-28 19:16:24.255271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.255410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.255436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.493 qpair failed and we were unable to recover it. 00:28:03.493 [2024-11-28 19:16:24.255547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.255670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.255697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.493 qpair failed and we were unable to recover it. 00:28:03.493 [2024-11-28 19:16:24.255821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.255912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.255939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.493 qpair failed and we were unable to recover it. 00:28:03.493 [2024-11-28 19:16:24.256101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.256229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.256254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.493 qpair failed and we were unable to recover it. 00:28:03.493 [2024-11-28 19:16:24.256386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.256510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.256551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.493 qpair failed and we were unable to recover it. 00:28:03.493 [2024-11-28 19:16:24.256690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.256819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.256846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.493 qpair failed and we were unable to recover it. 00:28:03.493 [2024-11-28 19:16:24.256949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.257062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.257087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.493 qpair failed and we were unable to recover it. 00:28:03.493 [2024-11-28 19:16:24.257241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.257326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.257353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.493 qpair failed and we were unable to recover it. 00:28:03.493 [2024-11-28 19:16:24.257530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.257645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.257687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.493 qpair failed and we were unable to recover it. 00:28:03.493 [2024-11-28 19:16:24.257818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.257899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.493 [2024-11-28 19:16:24.257924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.494 qpair failed and we were unable to recover it. 00:28:03.494 [2024-11-28 19:16:24.258012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.258178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.258206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.494 qpair failed and we were unable to recover it. 00:28:03.494 [2024-11-28 19:16:24.258333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.258453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.258482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.494 qpair failed and we were unable to recover it. 00:28:03.494 [2024-11-28 19:16:24.258622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.258710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.258736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.494 qpair failed and we were unable to recover it. 00:28:03.494 [2024-11-28 19:16:24.258819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.258961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.258989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.494 qpair failed and we were unable to recover it. 00:28:03.494 [2024-11-28 19:16:24.259123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.259204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.259229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.494 qpair failed and we were unable to recover it. 00:28:03.494 [2024-11-28 19:16:24.259342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.259481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.259507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.494 qpair failed and we were unable to recover it. 00:28:03.494 [2024-11-28 19:16:24.259670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.259760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.259788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.494 qpair failed and we were unable to recover it. 00:28:03.494 [2024-11-28 19:16:24.259909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.260011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.260038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.494 qpair failed and we were unable to recover it. 00:28:03.494 [2024-11-28 19:16:24.260145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.260257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.260282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.494 qpair failed and we were unable to recover it. 00:28:03.494 [2024-11-28 19:16:24.260365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.260523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.260552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.494 qpair failed and we were unable to recover it. 00:28:03.494 [2024-11-28 19:16:24.260634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.260750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.260778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.494 qpair failed and we were unable to recover it. 00:28:03.494 [2024-11-28 19:16:24.260926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.261065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.261090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.494 qpair failed and we were unable to recover it. 00:28:03.494 [2024-11-28 19:16:24.261179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.261271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.261300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.494 qpair failed and we were unable to recover it. 00:28:03.494 [2024-11-28 19:16:24.261466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.261579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.261604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.494 qpair failed and we were unable to recover it. 00:28:03.494 [2024-11-28 19:16:24.261721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.261835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.261860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.494 qpair failed and we were unable to recover it. 00:28:03.494 [2024-11-28 19:16:24.261966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.262053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.262080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.494 qpair failed and we were unable to recover it. 00:28:03.494 [2024-11-28 19:16:24.262203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.262294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.262343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.494 qpair failed and we were unable to recover it. 00:28:03.494 [2024-11-28 19:16:24.262488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.262582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.262607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.494 qpair failed and we were unable to recover it. 00:28:03.494 [2024-11-28 19:16:24.262772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.262889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.262932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.494 qpair failed and we were unable to recover it. 00:28:03.494 [2024-11-28 19:16:24.263071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.263195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.263223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.494 qpair failed and we were unable to recover it. 00:28:03.494 [2024-11-28 19:16:24.263380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.263497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.263523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.494 qpair failed and we were unable to recover it. 00:28:03.494 [2024-11-28 19:16:24.263638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.263731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.263756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.494 qpair failed and we were unable to recover it. 00:28:03.494 [2024-11-28 19:16:24.263865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.264004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.264032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.494 qpair failed and we were unable to recover it. 00:28:03.494 [2024-11-28 19:16:24.264163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.264302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.264331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.494 qpair failed and we were unable to recover it. 00:28:03.494 [2024-11-28 19:16:24.264415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.264515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.264541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.494 qpair failed and we were unable to recover it. 00:28:03.494 [2024-11-28 19:16:24.264634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.264726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.264767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.494 qpair failed and we were unable to recover it. 00:28:03.494 [2024-11-28 19:16:24.264924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.265033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.265058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.494 qpair failed and we were unable to recover it. 00:28:03.494 [2024-11-28 19:16:24.265159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.265280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.494 [2024-11-28 19:16:24.265308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.494 qpair failed and we were unable to recover it. 00:28:03.495 [2024-11-28 19:16:24.265478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.265628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.265654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.495 qpair failed and we were unable to recover it. 00:28:03.495 [2024-11-28 19:16:24.265806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.265915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.265941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.495 qpair failed and we were unable to recover it. 00:28:03.495 [2024-11-28 19:16:24.266052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.266147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.266175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.495 qpair failed and we were unable to recover it. 00:28:03.495 [2024-11-28 19:16:24.266272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.266400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.266429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.495 qpair failed and we were unable to recover it. 00:28:03.495 [2024-11-28 19:16:24.266564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.266676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.266701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.495 qpair failed and we were unable to recover it. 00:28:03.495 [2024-11-28 19:16:24.266858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.266981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.267013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.495 qpair failed and we were unable to recover it. 00:28:03.495 [2024-11-28 19:16:24.267141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.267268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.267296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.495 qpair failed and we were unable to recover it. 00:28:03.495 [2024-11-28 19:16:24.267432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.267522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.267547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.495 qpair failed and we were unable to recover it. 00:28:03.495 [2024-11-28 19:16:24.267664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.267772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.267814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.495 qpair failed and we were unable to recover it. 00:28:03.495 [2024-11-28 19:16:24.267904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.268025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.268054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.495 qpair failed and we were unable to recover it. 00:28:03.495 [2024-11-28 19:16:24.268214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.268321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.268346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.495 qpair failed and we were unable to recover it. 00:28:03.495 [2024-11-28 19:16:24.268443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.268529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.268556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.495 qpair failed and we were unable to recover it. 00:28:03.495 [2024-11-28 19:16:24.268694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.268772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.268799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.495 qpair failed and we were unable to recover it. 00:28:03.495 [2024-11-28 19:16:24.268915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.269026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.269052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.495 qpair failed and we were unable to recover it. 00:28:03.495 [2024-11-28 19:16:24.269188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.269306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.269334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.495 qpair failed and we were unable to recover it. 00:28:03.495 [2024-11-28 19:16:24.269462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.269558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.269591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.495 qpair failed and we were unable to recover it. 00:28:03.495 [2024-11-28 19:16:24.269695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.269829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.269854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.495 qpair failed and we were unable to recover it. 00:28:03.495 [2024-11-28 19:16:24.269970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.270097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.270121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.495 qpair failed and we were unable to recover it. 00:28:03.495 [2024-11-28 19:16:24.270245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.270362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.270390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.495 qpair failed and we were unable to recover it. 00:28:03.495 [2024-11-28 19:16:24.270507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.270583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.270608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.495 qpair failed and we were unable to recover it. 00:28:03.495 [2024-11-28 19:16:24.270725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.270805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.270830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.495 qpair failed and we were unable to recover it. 00:28:03.495 [2024-11-28 19:16:24.270924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.271034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.271059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.495 qpair failed and we were unable to recover it. 00:28:03.495 [2024-11-28 19:16:24.271212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.271296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.271321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.495 qpair failed and we were unable to recover it. 00:28:03.495 [2024-11-28 19:16:24.271436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.271567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.271595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.495 qpair failed and we were unable to recover it. 00:28:03.495 [2024-11-28 19:16:24.271719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.271870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.271910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.495 qpair failed and we were unable to recover it. 00:28:03.495 [2024-11-28 19:16:24.272024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.272139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.272164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.495 qpair failed and we were unable to recover it. 00:28:03.495 [2024-11-28 19:16:24.272273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.272451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.272482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.495 qpair failed and we were unable to recover it. 00:28:03.495 [2024-11-28 19:16:24.272600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.272689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.495 [2024-11-28 19:16:24.272718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.495 qpair failed and we were unable to recover it. 00:28:03.495 [2024-11-28 19:16:24.272854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.272967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.272992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.496 qpair failed and we were unable to recover it. 00:28:03.496 [2024-11-28 19:16:24.273122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.273238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.273266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.496 qpair failed and we were unable to recover it. 00:28:03.496 [2024-11-28 19:16:24.273381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.273531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.273559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.496 qpair failed and we were unable to recover it. 00:28:03.496 [2024-11-28 19:16:24.273657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.273762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.273787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.496 qpair failed and we were unable to recover it. 00:28:03.496 [2024-11-28 19:16:24.273884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.274016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.274044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.496 qpair failed and we were unable to recover it. 00:28:03.496 [2024-11-28 19:16:24.274140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.274235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.274264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.496 qpair failed and we were unable to recover it. 00:28:03.496 [2024-11-28 19:16:24.274425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.274516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.274542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.496 qpair failed and we were unable to recover it. 00:28:03.496 [2024-11-28 19:16:24.274664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.274786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.274814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.496 qpair failed and we were unable to recover it. 00:28:03.496 [2024-11-28 19:16:24.274947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.275031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.275059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.496 qpair failed and we were unable to recover it. 00:28:03.496 [2024-11-28 19:16:24.275183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.275347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.275375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.496 qpair failed and we were unable to recover it. 00:28:03.496 [2024-11-28 19:16:24.275548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.275637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.275662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.496 qpair failed and we were unable to recover it. 00:28:03.496 [2024-11-28 19:16:24.275751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.275866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.275891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.496 qpair failed and we were unable to recover it. 00:28:03.496 [2024-11-28 19:16:24.276012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.276120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.276145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.496 qpair failed and we were unable to recover it. 00:28:03.496 [2024-11-28 19:16:24.276232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.276310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.276335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.496 qpair failed and we were unable to recover it. 00:28:03.496 [2024-11-28 19:16:24.276419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.276571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.276599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.496 qpair failed and we were unable to recover it. 00:28:03.496 [2024-11-28 19:16:24.276711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.276795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.276819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.496 qpair failed and we were unable to recover it. 00:28:03.496 [2024-11-28 19:16:24.276907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.277022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.277047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.496 qpair failed and we were unable to recover it. 00:28:03.496 [2024-11-28 19:16:24.277139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.277246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.277270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.496 qpair failed and we were unable to recover it. 00:28:03.496 [2024-11-28 19:16:24.277415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.277501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.277526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.496 qpair failed and we were unable to recover it. 00:28:03.496 [2024-11-28 19:16:24.277688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.277768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.277796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.496 qpair failed and we were unable to recover it. 00:28:03.496 [2024-11-28 19:16:24.277918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.278044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.278072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.496 qpair failed and we were unable to recover it. 00:28:03.496 [2024-11-28 19:16:24.278204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.278316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.278341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.496 qpair failed and we were unable to recover it. 00:28:03.496 [2024-11-28 19:16:24.278452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.278585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.278610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.496 qpair failed and we were unable to recover it. 00:28:03.496 [2024-11-28 19:16:24.278685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.278797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.278840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.496 qpair failed and we were unable to recover it. 00:28:03.496 [2024-11-28 19:16:24.278949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.496 [2024-11-28 19:16:24.279067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.279092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.497 qpair failed and we were unable to recover it. 00:28:03.497 [2024-11-28 19:16:24.279234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.279369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.279408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.497 qpair failed and we were unable to recover it. 00:28:03.497 [2024-11-28 19:16:24.279503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.279658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.279685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.497 qpair failed and we were unable to recover it. 00:28:03.497 [2024-11-28 19:16:24.279819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.279932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.279957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.497 qpair failed and we were unable to recover it. 00:28:03.497 [2024-11-28 19:16:24.280075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.280173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.280202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.497 qpair failed and we were unable to recover it. 00:28:03.497 [2024-11-28 19:16:24.280336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.280437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.280466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.497 qpair failed and we were unable to recover it. 00:28:03.497 [2024-11-28 19:16:24.280575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.280664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.280689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.497 qpair failed and we were unable to recover it. 00:28:03.497 [2024-11-28 19:16:24.280799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.280913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.280937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.497 qpair failed and we were unable to recover it. 00:28:03.497 [2024-11-28 19:16:24.281050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.281160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.281185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.497 qpair failed and we were unable to recover it. 00:28:03.497 [2024-11-28 19:16:24.281338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.281423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.281466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.497 qpair failed and we were unable to recover it. 00:28:03.497 [2024-11-28 19:16:24.281540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.281653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.281678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.497 qpair failed and we were unable to recover it. 00:28:03.497 [2024-11-28 19:16:24.281762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.281843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.281868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.497 qpair failed and we were unable to recover it. 00:28:03.497 [2024-11-28 19:16:24.281950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.282064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.282089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.497 qpair failed and we were unable to recover it. 00:28:03.497 [2024-11-28 19:16:24.282196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.282342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.282370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.497 qpair failed and we were unable to recover it. 00:28:03.497 [2024-11-28 19:16:24.282513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.282646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.282672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.497 qpair failed and we were unable to recover it. 00:28:03.497 [2024-11-28 19:16:24.282813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.282905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.282930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.497 qpair failed and we were unable to recover it. 00:28:03.497 [2024-11-28 19:16:24.283011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.283170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.283199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.497 qpair failed and we were unable to recover it. 00:28:03.497 [2024-11-28 19:16:24.283295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.283432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.283457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.497 qpair failed and we were unable to recover it. 00:28:03.497 [2024-11-28 19:16:24.283563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.283665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.283689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.497 qpair failed and we were unable to recover it. 00:28:03.497 [2024-11-28 19:16:24.283820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.283944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.283973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.497 qpair failed and we were unable to recover it. 00:28:03.497 [2024-11-28 19:16:24.284072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.284198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.284225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.497 qpair failed and we were unable to recover it. 00:28:03.497 [2024-11-28 19:16:24.284317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.284429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.284456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.497 qpair failed and we were unable to recover it. 00:28:03.497 [2024-11-28 19:16:24.284559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.284709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.284736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.497 qpair failed and we were unable to recover it. 00:28:03.497 [2024-11-28 19:16:24.284840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.284964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.284994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.497 qpair failed and we were unable to recover it. 00:28:03.497 [2024-11-28 19:16:24.285128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.285232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.285257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.497 qpair failed and we were unable to recover it. 00:28:03.497 [2024-11-28 19:16:24.285354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.285484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.285512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.497 qpair failed and we were unable to recover it. 00:28:03.497 [2024-11-28 19:16:24.285619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.285692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.285717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.497 qpair failed and we were unable to recover it. 00:28:03.497 [2024-11-28 19:16:24.285835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.285910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.285934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.497 qpair failed and we were unable to recover it. 00:28:03.497 [2024-11-28 19:16:24.286018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.497 [2024-11-28 19:16:24.286158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.286185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.498 qpair failed and we were unable to recover it. 00:28:03.498 [2024-11-28 19:16:24.286281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.286380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.286414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.498 qpair failed and we were unable to recover it. 00:28:03.498 [2024-11-28 19:16:24.286525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.286610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.286635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.498 qpair failed and we were unable to recover it. 00:28:03.498 [2024-11-28 19:16:24.286767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.286921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.286949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.498 qpair failed and we were unable to recover it. 00:28:03.498 [2024-11-28 19:16:24.287083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.287175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.287200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.498 qpair failed and we were unable to recover it. 00:28:03.498 [2024-11-28 19:16:24.287284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.287424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.287450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.498 qpair failed and we were unable to recover it. 00:28:03.498 [2024-11-28 19:16:24.287563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.287655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.287684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.498 qpair failed and we were unable to recover it. 00:28:03.498 [2024-11-28 19:16:24.287813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.287915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.287943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.498 qpair failed and we were unable to recover it. 00:28:03.498 [2024-11-28 19:16:24.288043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.288147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.288171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.498 qpair failed and we were unable to recover it. 00:28:03.498 [2024-11-28 19:16:24.288302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.288468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.288493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.498 qpair failed and we were unable to recover it. 00:28:03.498 [2024-11-28 19:16:24.288633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.288771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.288799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.498 qpair failed and we were unable to recover it. 00:28:03.498 [2024-11-28 19:16:24.288931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.289012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.289037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.498 qpair failed and we were unable to recover it. 00:28:03.498 [2024-11-28 19:16:24.289190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.289301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.289329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.498 qpair failed and we were unable to recover it. 00:28:03.498 [2024-11-28 19:16:24.289478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.289629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.289656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.498 qpair failed and we were unable to recover it. 00:28:03.498 [2024-11-28 19:16:24.289824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.289942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.289967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.498 qpair failed and we were unable to recover it. 00:28:03.498 [2024-11-28 19:16:24.290107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.290231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.290258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.498 qpair failed and we were unable to recover it. 00:28:03.498 [2024-11-28 19:16:24.290424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.290536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.290561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.498 qpair failed and we were unable to recover it. 00:28:03.498 [2024-11-28 19:16:24.290646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.290759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.290784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.498 qpair failed and we were unable to recover it. 00:28:03.498 [2024-11-28 19:16:24.290913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.291071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.291099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.498 qpair failed and we were unable to recover it. 00:28:03.498 [2024-11-28 19:16:24.291219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.291359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.291389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.498 qpair failed and we were unable to recover it. 00:28:03.498 [2024-11-28 19:16:24.291531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.291637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.291662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.498 qpair failed and we were unable to recover it. 00:28:03.498 [2024-11-28 19:16:24.291753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.291903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.291929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.498 qpair failed and we were unable to recover it. 00:28:03.498 [2024-11-28 19:16:24.292044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.292126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.292167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.498 qpair failed and we were unable to recover it. 00:28:03.498 [2024-11-28 19:16:24.292293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.292377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.292411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.498 qpair failed and we were unable to recover it. 00:28:03.498 [2024-11-28 19:16:24.292524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.292607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.292648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.498 qpair failed and we were unable to recover it. 00:28:03.498 [2024-11-28 19:16:24.292739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.292863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.292890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.498 qpair failed and we were unable to recover it. 00:28:03.498 [2024-11-28 19:16:24.293051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.498 [2024-11-28 19:16:24.293173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.293198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.499 qpair failed and we were unable to recover it. 00:28:03.499 [2024-11-28 19:16:24.293305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.293406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.293435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.499 qpair failed and we were unable to recover it. 00:28:03.499 [2024-11-28 19:16:24.293568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.293652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.293682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.499 qpair failed and we were unable to recover it. 00:28:03.499 [2024-11-28 19:16:24.293810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.293900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.293925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.499 qpair failed and we were unable to recover it. 00:28:03.499 [2024-11-28 19:16:24.294010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.294137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.294164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.499 qpair failed and we were unable to recover it. 00:28:03.499 [2024-11-28 19:16:24.294283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.294407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.294436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.499 qpair failed and we were unable to recover it. 00:28:03.499 [2024-11-28 19:16:24.294562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.294642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.294668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.499 qpair failed and we were unable to recover it. 00:28:03.499 [2024-11-28 19:16:24.294832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.294981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.295008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.499 qpair failed and we were unable to recover it. 00:28:03.499 [2024-11-28 19:16:24.295098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.295219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.295247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.499 qpair failed and we were unable to recover it. 00:28:03.499 [2024-11-28 19:16:24.295373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.295507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.295534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.499 qpair failed and we were unable to recover it. 00:28:03.499 [2024-11-28 19:16:24.295620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.295771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.295799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.499 qpair failed and we were unable to recover it. 00:28:03.499 [2024-11-28 19:16:24.295919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.296045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.296073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.499 qpair failed and we were unable to recover it. 00:28:03.499 [2024-11-28 19:16:24.296212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.296306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.296331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.499 qpair failed and we were unable to recover it. 00:28:03.499 [2024-11-28 19:16:24.296408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.296495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.296520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.499 qpair failed and we were unable to recover it. 00:28:03.499 [2024-11-28 19:16:24.296631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.296735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.296760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.499 qpair failed and we were unable to recover it. 00:28:03.499 [2024-11-28 19:16:24.296869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.296972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.296997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.499 qpair failed and we were unable to recover it. 00:28:03.499 [2024-11-28 19:16:24.297125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.297300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.297325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.499 qpair failed and we were unable to recover it. 00:28:03.499 [2024-11-28 19:16:24.297436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.297549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.297574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.499 qpair failed and we were unable to recover it. 00:28:03.499 [2024-11-28 19:16:24.297716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.297825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.297850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.499 qpair failed and we were unable to recover it. 00:28:03.499 [2024-11-28 19:16:24.297931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.298027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.298055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.499 qpair failed and we were unable to recover it. 00:28:03.499 [2024-11-28 19:16:24.298169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.298299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.298327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.499 qpair failed and we were unable to recover it. 00:28:03.499 [2024-11-28 19:16:24.298433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.298550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.298575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.499 qpair failed and we were unable to recover it. 00:28:03.499 [2024-11-28 19:16:24.298651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.298758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.298787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.499 qpair failed and we were unable to recover it. 00:28:03.499 [2024-11-28 19:16:24.298908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.299028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.299069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.499 qpair failed and we were unable to recover it. 00:28:03.499 [2024-11-28 19:16:24.299230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.299363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.299410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.499 qpair failed and we were unable to recover it. 00:28:03.499 [2024-11-28 19:16:24.299515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.299599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.299625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.499 qpair failed and we were unable to recover it. 00:28:03.499 [2024-11-28 19:16:24.299761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.299876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.299904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.499 qpair failed and we were unable to recover it. 00:28:03.499 [2024-11-28 19:16:24.300041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.300180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.300205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.499 qpair failed and we were unable to recover it. 00:28:03.499 [2024-11-28 19:16:24.300277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.300436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.499 [2024-11-28 19:16:24.300464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.500 qpair failed and we were unable to recover it. 00:28:03.500 [2024-11-28 19:16:24.300588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.300733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.300762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.500 qpair failed and we were unable to recover it. 00:28:03.500 [2024-11-28 19:16:24.300902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.301045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.301070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.500 qpair failed and we were unable to recover it. 00:28:03.500 [2024-11-28 19:16:24.301167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.301263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.301292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.500 qpair failed and we were unable to recover it. 00:28:03.500 [2024-11-28 19:16:24.301418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.301533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.301561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.500 qpair failed and we were unable to recover it. 00:28:03.500 [2024-11-28 19:16:24.301664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.301802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.301827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.500 qpair failed and we were unable to recover it. 00:28:03.500 [2024-11-28 19:16:24.301957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.302111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.302138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.500 qpair failed and we were unable to recover it. 00:28:03.500 [2024-11-28 19:16:24.302260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.302356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.302384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.500 qpair failed and we were unable to recover it. 00:28:03.500 [2024-11-28 19:16:24.302527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.302620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.302645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.500 qpair failed and we were unable to recover it. 00:28:03.500 [2024-11-28 19:16:24.302723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.302824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.302852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.500 qpair failed and we were unable to recover it. 00:28:03.500 [2024-11-28 19:16:24.302941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.303018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.303046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.500 qpair failed and we were unable to recover it. 00:28:03.500 [2024-11-28 19:16:24.303181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.303293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.303318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.500 qpair failed and we were unable to recover it. 00:28:03.500 [2024-11-28 19:16:24.303423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.303504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.303535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.500 qpair failed and we were unable to recover it. 00:28:03.500 [2024-11-28 19:16:24.303699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.303823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.303866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.500 qpair failed and we were unable to recover it. 00:28:03.500 [2024-11-28 19:16:24.303980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.304086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.304110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.500 qpair failed and we were unable to recover it. 00:28:03.500 [2024-11-28 19:16:24.304226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.304338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.304363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.500 qpair failed and we were unable to recover it. 00:28:03.500 [2024-11-28 19:16:24.304526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.304647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.304675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.500 qpair failed and we were unable to recover it. 00:28:03.500 [2024-11-28 19:16:24.304776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.304887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.304912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.500 qpair failed and we were unable to recover it. 00:28:03.500 [2024-11-28 19:16:24.305039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.305152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.305179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.500 qpair failed and we were unable to recover it. 00:28:03.500 [2024-11-28 19:16:24.305273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.305409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.305438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.500 qpair failed and we were unable to recover it. 00:28:03.500 [2024-11-28 19:16:24.305540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.305653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.305678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.500 qpair failed and we were unable to recover it. 00:28:03.500 [2024-11-28 19:16:24.305807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.305931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.305959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.500 qpair failed and we were unable to recover it. 00:28:03.500 [2024-11-28 19:16:24.306051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.306181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.306210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.500 qpair failed and we were unable to recover it. 00:28:03.500 [2024-11-28 19:16:24.306286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.306399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.306425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.500 qpair failed and we were unable to recover it. 00:28:03.500 [2024-11-28 19:16:24.306505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.306582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.306607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.500 qpair failed and we were unable to recover it. 00:28:03.500 [2024-11-28 19:16:24.306696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.306808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.306833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.500 qpair failed and we were unable to recover it. 00:28:03.500 [2024-11-28 19:16:24.306948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.307060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.500 [2024-11-28 19:16:24.307086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.500 qpair failed and we were unable to recover it. 00:28:03.501 [2024-11-28 19:16:24.307212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.307318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.307346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.501 qpair failed and we were unable to recover it. 00:28:03.501 [2024-11-28 19:16:24.307507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.307592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.307618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.501 qpair failed and we were unable to recover it. 00:28:03.501 [2024-11-28 19:16:24.307732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.307851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.307876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.501 qpair failed and we were unable to recover it. 00:28:03.501 [2024-11-28 19:16:24.307954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.308065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.308090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.501 qpair failed and we were unable to recover it. 00:28:03.501 [2024-11-28 19:16:24.308227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.308377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.308426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.501 qpair failed and we were unable to recover it. 00:28:03.501 [2024-11-28 19:16:24.308573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.308649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.308678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.501 qpair failed and we were unable to recover it. 00:28:03.501 [2024-11-28 19:16:24.308785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.308933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.308961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.501 qpair failed and we were unable to recover it. 00:28:03.501 [2024-11-28 19:16:24.309056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.309210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.309237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.501 qpair failed and we were unable to recover it. 00:28:03.501 [2024-11-28 19:16:24.309376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.309475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.309502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.501 qpair failed and we were unable to recover it. 00:28:03.501 [2024-11-28 19:16:24.309602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.309686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.309715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.501 qpair failed and we were unable to recover it. 00:28:03.501 [2024-11-28 19:16:24.309834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.309937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.309964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.501 qpair failed and we were unable to recover it. 00:28:03.501 [2024-11-28 19:16:24.310095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.310198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.310223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.501 qpair failed and we were unable to recover it. 00:28:03.501 [2024-11-28 19:16:24.310323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.310421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.310450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.501 qpair failed and we were unable to recover it. 00:28:03.501 [2024-11-28 19:16:24.310544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.310633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.310661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.501 qpair failed and we were unable to recover it. 00:28:03.501 [2024-11-28 19:16:24.310798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.310937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.310962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.501 qpair failed and we were unable to recover it. 00:28:03.501 [2024-11-28 19:16:24.311099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.311245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.311277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.501 qpair failed and we were unable to recover it. 00:28:03.501 [2024-11-28 19:16:24.311370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.311478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.311506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.501 qpair failed and we were unable to recover it. 00:28:03.501 [2024-11-28 19:16:24.311636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.311725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.311750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.501 qpair failed and we were unable to recover it. 00:28:03.501 [2024-11-28 19:16:24.311831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.311943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.311970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.501 qpair failed and we were unable to recover it. 00:28:03.501 [2024-11-28 19:16:24.312104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.312188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.312216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.501 qpair failed and we were unable to recover it. 00:28:03.501 [2024-11-28 19:16:24.312317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.312441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.312467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.501 qpair failed and we were unable to recover it. 00:28:03.501 [2024-11-28 19:16:24.312543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.312682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.312710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.501 qpair failed and we were unable to recover it. 00:28:03.501 [2024-11-28 19:16:24.312862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.312955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.312984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.501 qpair failed and we were unable to recover it. 00:28:03.501 [2024-11-28 19:16:24.313105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.313210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.501 [2024-11-28 19:16:24.313235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.501 qpair failed and we were unable to recover it. 00:28:03.502 [2024-11-28 19:16:24.313379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.313494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.313519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.502 qpair failed and we were unable to recover it. 00:28:03.502 [2024-11-28 19:16:24.313625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.313737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.313765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.502 qpair failed and we were unable to recover it. 00:28:03.502 [2024-11-28 19:16:24.313892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.314009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.314033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.502 qpair failed and we were unable to recover it. 00:28:03.502 [2024-11-28 19:16:24.314119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.314207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.314232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.502 qpair failed and we were unable to recover it. 00:28:03.502 [2024-11-28 19:16:24.314340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.314422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.314448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.502 qpair failed and we were unable to recover it. 00:28:03.502 [2024-11-28 19:16:24.314562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.314648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.314672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.502 qpair failed and we were unable to recover it. 00:28:03.502 [2024-11-28 19:16:24.314832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.314932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.314958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.502 qpair failed and we were unable to recover it. 00:28:03.502 [2024-11-28 19:16:24.315083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.315211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.315240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.502 qpair failed and we were unable to recover it. 00:28:03.502 [2024-11-28 19:16:24.315337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.315455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.315480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.502 qpair failed and we were unable to recover it. 00:28:03.502 [2024-11-28 19:16:24.315594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.315710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.315738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.502 qpair failed and we were unable to recover it. 00:28:03.502 [2024-11-28 19:16:24.315858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.315988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.316016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.502 qpair failed and we were unable to recover it. 00:28:03.502 [2024-11-28 19:16:24.316158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.316295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.316320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.502 qpair failed and we were unable to recover it. 00:28:03.502 [2024-11-28 19:16:24.316487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.316567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.316592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.502 qpair failed and we were unable to recover it. 00:28:03.502 [2024-11-28 19:16:24.316716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.316828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.316853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.502 qpair failed and we were unable to recover it. 00:28:03.502 [2024-11-28 19:16:24.316978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.317060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.317085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.502 qpair failed and we were unable to recover it. 00:28:03.502 [2024-11-28 19:16:24.317186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.317297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.317325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.502 qpair failed and we were unable to recover it. 00:28:03.502 [2024-11-28 19:16:24.317486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.317598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.317623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.502 qpair failed and we were unable to recover it. 00:28:03.502 [2024-11-28 19:16:24.317706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.317813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.317837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.502 qpair failed and we were unable to recover it. 00:28:03.502 [2024-11-28 19:16:24.317917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.317995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.318020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.502 qpair failed and we were unable to recover it. 00:28:03.502 [2024-11-28 19:16:24.318102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.318227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.318254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.502 qpair failed and we were unable to recover it. 00:28:03.502 [2024-11-28 19:16:24.318387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.318511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.318536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.502 qpair failed and we were unable to recover it. 00:28:03.502 [2024-11-28 19:16:24.318620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.318751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.318779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.502 qpair failed and we were unable to recover it. 00:28:03.502 [2024-11-28 19:16:24.318907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.319031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.319059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.502 qpair failed and we were unable to recover it. 00:28:03.502 [2024-11-28 19:16:24.319209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.319290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.319316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.502 qpair failed and we were unable to recover it. 00:28:03.502 [2024-11-28 19:16:24.319417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.319520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.319546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.502 qpair failed and we were unable to recover it. 00:28:03.502 [2024-11-28 19:16:24.319685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.319806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.502 [2024-11-28 19:16:24.319835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.502 qpair failed and we were unable to recover it. 00:28:03.503 [2024-11-28 19:16:24.319978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.320090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.320115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.503 qpair failed and we were unable to recover it. 00:28:03.503 [2024-11-28 19:16:24.320228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.320342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.320367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.503 qpair failed and we were unable to recover it. 00:28:03.503 [2024-11-28 19:16:24.320494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.320580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.320605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.503 qpair failed and we were unable to recover it. 00:28:03.503 [2024-11-28 19:16:24.320715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.320805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.320830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.503 qpair failed and we were unable to recover it. 00:28:03.503 [2024-11-28 19:16:24.320937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.321050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.321092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.503 qpair failed and we were unable to recover it. 00:28:03.503 [2024-11-28 19:16:24.321243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.321401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.321443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.503 qpair failed and we were unable to recover it. 00:28:03.503 [2024-11-28 19:16:24.321559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.321673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.321698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.503 qpair failed and we were unable to recover it. 00:28:03.503 [2024-11-28 19:16:24.321779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.321885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.321929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.503 qpair failed and we were unable to recover it. 00:28:03.503 [2024-11-28 19:16:24.322026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.322180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.322221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.503 qpair failed and we were unable to recover it. 00:28:03.503 [2024-11-28 19:16:24.322360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.322465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.322490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.503 qpair failed and we were unable to recover it. 00:28:03.503 [2024-11-28 19:16:24.322621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.322710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.322738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.503 qpair failed and we were unable to recover it. 00:28:03.503 [2024-11-28 19:16:24.322858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.322967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.322992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.503 qpair failed and we were unable to recover it. 00:28:03.503 [2024-11-28 19:16:24.323106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.323217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.323242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.503 qpair failed and we were unable to recover it. 00:28:03.503 [2024-11-28 19:16:24.323366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.323505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.323531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.503 qpair failed and we were unable to recover it. 00:28:03.503 [2024-11-28 19:16:24.323611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.323758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.323783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.503 qpair failed and we were unable to recover it. 00:28:03.503 [2024-11-28 19:16:24.323897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.323984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.324009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.503 qpair failed and we were unable to recover it. 00:28:03.503 [2024-11-28 19:16:24.324123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.324279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.324307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.503 qpair failed and we were unable to recover it. 00:28:03.503 [2024-11-28 19:16:24.324477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.324620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.324645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.503 qpair failed and we were unable to recover it. 00:28:03.503 [2024-11-28 19:16:24.324719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.324828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.324853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.503 qpair failed and we were unable to recover it. 00:28:03.503 [2024-11-28 19:16:24.324989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.325074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.325101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.503 qpair failed and we were unable to recover it. 00:28:03.503 [2024-11-28 19:16:24.325214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.325348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.325374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.503 qpair failed and we were unable to recover it. 00:28:03.503 [2024-11-28 19:16:24.325464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.325602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.325628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.503 qpair failed and we were unable to recover it. 00:28:03.503 [2024-11-28 19:16:24.325752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.325851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.325879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.503 qpair failed and we were unable to recover it. 00:28:03.503 [2024-11-28 19:16:24.325971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.326087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.326115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.503 qpair failed and we were unable to recover it. 00:28:03.503 [2024-11-28 19:16:24.326253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.326334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.326359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.503 qpair failed and we were unable to recover it. 00:28:03.503 [2024-11-28 19:16:24.326455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.326535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.326560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.503 qpair failed and we were unable to recover it. 00:28:03.503 [2024-11-28 19:16:24.326648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.326735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.326760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.503 qpair failed and we were unable to recover it. 00:28:03.503 [2024-11-28 19:16:24.326845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.327032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.503 [2024-11-28 19:16:24.327073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.503 qpair failed and we were unable to recover it. 00:28:03.504 [2024-11-28 19:16:24.327225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.327372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.327406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.504 qpair failed and we were unable to recover it. 00:28:03.504 [2024-11-28 19:16:24.327567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.327710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.327735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.504 qpair failed and we were unable to recover it. 00:28:03.504 [2024-11-28 19:16:24.327816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.327929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.327956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.504 qpair failed and we were unable to recover it. 00:28:03.504 [2024-11-28 19:16:24.328091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.328206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.328234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.504 qpair failed and we were unable to recover it. 00:28:03.504 [2024-11-28 19:16:24.328363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.328499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.328527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.504 qpair failed and we were unable to recover it. 00:28:03.504 [2024-11-28 19:16:24.328633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.328750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.328775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.504 qpair failed and we were unable to recover it. 00:28:03.504 [2024-11-28 19:16:24.328884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.329018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.329047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.504 qpair failed and we were unable to recover it. 00:28:03.504 [2024-11-28 19:16:24.329138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.329255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.329283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.504 qpair failed and we were unable to recover it. 00:28:03.504 [2024-11-28 19:16:24.329389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.329515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.329540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.504 qpair failed and we were unable to recover it. 00:28:03.504 [2024-11-28 19:16:24.329655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.329784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.329813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.504 qpair failed and we were unable to recover it. 00:28:03.504 [2024-11-28 19:16:24.329935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.330083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.330111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.504 qpair failed and we were unable to recover it. 00:28:03.504 [2024-11-28 19:16:24.330219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.330350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.330378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.504 qpair failed and we were unable to recover it. 00:28:03.504 [2024-11-28 19:16:24.330548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.330655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.330698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.504 qpair failed and we were unable to recover it. 00:28:03.504 [2024-11-28 19:16:24.330876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.330988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.331013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.504 qpair failed and we were unable to recover it. 00:28:03.504 [2024-11-28 19:16:24.331119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.331191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.331216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.504 qpair failed and we were unable to recover it. 00:28:03.504 [2024-11-28 19:16:24.331351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.331459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.331488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.504 qpair failed and we were unable to recover it. 00:28:03.504 [2024-11-28 19:16:24.331609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.331731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.331760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.504 qpair failed and we were unable to recover it. 00:28:03.504 [2024-11-28 19:16:24.331865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.331971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.331996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.504 qpair failed and we were unable to recover it. 00:28:03.504 [2024-11-28 19:16:24.332157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.332279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.332308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.504 qpair failed and we were unable to recover it. 00:28:03.504 [2024-11-28 19:16:24.332437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.332528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.332556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.504 qpair failed and we were unable to recover it. 00:28:03.504 [2024-11-28 19:16:24.332685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.332825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.332851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.504 qpair failed and we were unable to recover it. 00:28:03.504 [2024-11-28 19:16:24.332952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.333080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.333108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.504 qpair failed and we were unable to recover it. 00:28:03.504 [2024-11-28 19:16:24.333225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.333351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.333378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.504 qpair failed and we were unable to recover it. 00:28:03.504 [2024-11-28 19:16:24.333524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.333602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.333627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.504 qpair failed and we were unable to recover it. 00:28:03.504 [2024-11-28 19:16:24.333760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.333883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.333910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.504 qpair failed and we were unable to recover it. 00:28:03.504 [2024-11-28 19:16:24.334034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.334126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.334153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.504 qpair failed and we were unable to recover it. 00:28:03.504 [2024-11-28 19:16:24.334323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.334426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.334451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.504 qpair failed and we were unable to recover it. 00:28:03.504 [2024-11-28 19:16:24.334600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.334706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.504 [2024-11-28 19:16:24.334731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.504 qpair failed and we were unable to recover it. 00:28:03.504 [2024-11-28 19:16:24.334838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.334924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.334950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.505 qpair failed and we were unable to recover it. 00:28:03.505 [2024-11-28 19:16:24.335087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.335224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.335249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.505 qpair failed and we were unable to recover it. 00:28:03.505 [2024-11-28 19:16:24.335415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.335528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.335553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.505 qpair failed and we were unable to recover it. 00:28:03.505 [2024-11-28 19:16:24.335634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.335749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.335774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.505 qpair failed and we were unable to recover it. 00:28:03.505 [2024-11-28 19:16:24.335862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.335968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.335993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.505 qpair failed and we were unable to recover it. 00:28:03.505 [2024-11-28 19:16:24.336105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.336228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.336270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.505 qpair failed and we were unable to recover it. 00:28:03.505 [2024-11-28 19:16:24.336386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.336521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.336549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.505 qpair failed and we were unable to recover it. 00:28:03.505 [2024-11-28 19:16:24.336679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.336763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.336788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.505 qpair failed and we were unable to recover it. 00:28:03.505 [2024-11-28 19:16:24.336872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.337004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.337031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.505 qpair failed and we were unable to recover it. 00:28:03.505 [2024-11-28 19:16:24.337123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.337272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.337300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.505 qpair failed and we were unable to recover it. 00:28:03.505 [2024-11-28 19:16:24.337454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.337604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.337648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.505 qpair failed and we were unable to recover it. 00:28:03.505 [2024-11-28 19:16:24.337739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.337865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.337893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.505 qpair failed and we were unable to recover it. 00:28:03.505 [2024-11-28 19:16:24.338088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.338206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.338234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.505 qpair failed and we were unable to recover it. 00:28:03.505 [2024-11-28 19:16:24.338339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.338479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.338505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.505 qpair failed and we were unable to recover it. 00:28:03.505 [2024-11-28 19:16:24.338597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.338759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.338787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.505 qpair failed and we were unable to recover it. 00:28:03.505 [2024-11-28 19:16:24.338900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.338981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.339008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.505 qpair failed and we were unable to recover it. 00:28:03.505 [2024-11-28 19:16:24.339123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.339230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.339255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.505 qpair failed and we were unable to recover it. 00:28:03.505 [2024-11-28 19:16:24.339365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.339511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.339540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.505 qpair failed and we were unable to recover it. 00:28:03.505 [2024-11-28 19:16:24.339659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.339777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.339804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.505 qpair failed and we were unable to recover it. 00:28:03.505 [2024-11-28 19:16:24.339909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.339993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.340018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.505 qpair failed and we were unable to recover it. 00:28:03.505 [2024-11-28 19:16:24.340106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.340189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.340214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.505 qpair failed and we were unable to recover it. 00:28:03.505 [2024-11-28 19:16:24.340299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.340429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.340458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.505 qpair failed and we were unable to recover it. 00:28:03.505 [2024-11-28 19:16:24.340563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.340641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.340665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.505 qpair failed and we were unable to recover it. 00:28:03.505 [2024-11-28 19:16:24.340782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.340898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.340923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.505 qpair failed and we were unable to recover it. 00:28:03.505 [2024-11-28 19:16:24.341067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.341188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.341216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.505 qpair failed and we were unable to recover it. 00:28:03.505 [2024-11-28 19:16:24.341407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.341534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.505 [2024-11-28 19:16:24.341560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.505 qpair failed and we were unable to recover it. 00:28:03.506 [2024-11-28 19:16:24.341718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.341815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.341843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.506 qpair failed and we were unable to recover it. 00:28:03.506 [2024-11-28 19:16:24.341980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.342098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.342123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.506 qpair failed and we were unable to recover it. 00:28:03.506 [2024-11-28 19:16:24.342234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.342340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.342364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.506 qpair failed and we were unable to recover it. 00:28:03.506 [2024-11-28 19:16:24.342447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.342635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.342675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.506 qpair failed and we were unable to recover it. 00:28:03.506 [2024-11-28 19:16:24.342795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.342889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.342917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.506 qpair failed and we were unable to recover it. 00:28:03.506 [2024-11-28 19:16:24.343048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.343156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.343180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.506 qpair failed and we were unable to recover it. 00:28:03.506 [2024-11-28 19:16:24.343307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.343431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.343460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.506 qpair failed and we were unable to recover it. 00:28:03.506 [2024-11-28 19:16:24.343553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.343711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.343739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.506 qpair failed and we were unable to recover it. 00:28:03.506 [2024-11-28 19:16:24.343871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.343997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.344022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.506 qpair failed and we were unable to recover it. 00:28:03.506 [2024-11-28 19:16:24.344146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.344250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.344277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.506 qpair failed and we were unable to recover it. 00:28:03.506 [2024-11-28 19:16:24.344382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.344518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.344560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.506 qpair failed and we were unable to recover it. 00:28:03.506 [2024-11-28 19:16:24.344698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.344773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.344798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.506 qpair failed and we were unable to recover it. 00:28:03.506 [2024-11-28 19:16:24.344905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.345005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.345033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.506 qpair failed and we were unable to recover it. 00:28:03.506 [2024-11-28 19:16:24.345138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.345226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.345253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.506 qpair failed and we were unable to recover it. 00:28:03.506 [2024-11-28 19:16:24.345398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.345518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.345547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.506 qpair failed and we were unable to recover it. 00:28:03.506 [2024-11-28 19:16:24.345673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.345827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.345855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.506 qpair failed and we were unable to recover it. 00:28:03.506 [2024-11-28 19:16:24.345949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.346039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.346066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.506 qpair failed and we were unable to recover it. 00:28:03.506 [2024-11-28 19:16:24.346174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.346285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.346311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.506 qpair failed and we were unable to recover it. 00:28:03.506 [2024-11-28 19:16:24.346440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.346553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.346578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.506 qpair failed and we were unable to recover it. 00:28:03.506 [2024-11-28 19:16:24.346768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.346864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.346891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.506 qpair failed and we were unable to recover it. 00:28:03.506 [2024-11-28 19:16:24.346998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.347113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.347138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.506 qpair failed and we were unable to recover it. 00:28:03.506 [2024-11-28 19:16:24.347272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.347432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.347461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.506 qpair failed and we were unable to recover it. 00:28:03.506 [2024-11-28 19:16:24.347582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.347705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.347733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.506 qpair failed and we were unable to recover it. 00:28:03.506 [2024-11-28 19:16:24.347860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.347938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.506 [2024-11-28 19:16:24.347963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.506 qpair failed and we were unable to recover it. 00:28:03.506 [2024-11-28 19:16:24.348084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.348205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.348237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.507 qpair failed and we were unable to recover it. 00:28:03.507 [2024-11-28 19:16:24.348400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.348593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.348618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.507 qpair failed and we were unable to recover it. 00:28:03.507 [2024-11-28 19:16:24.348760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.348842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.348868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.507 qpair failed and we were unable to recover it. 00:28:03.507 [2024-11-28 19:16:24.348971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.349096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.349124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.507 qpair failed and we were unable to recover it. 00:28:03.507 [2024-11-28 19:16:24.349248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.349335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.349364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.507 qpair failed and we were unable to recover it. 00:28:03.507 [2024-11-28 19:16:24.349506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.349621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.349646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.507 qpair failed and we were unable to recover it. 00:28:03.507 [2024-11-28 19:16:24.349747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.349840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.349869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.507 qpair failed and we were unable to recover it. 00:28:03.507 [2024-11-28 19:16:24.349994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.350142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.350170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.507 qpair failed and we were unable to recover it. 00:28:03.507 [2024-11-28 19:16:24.350283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.350470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.350496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.507 qpair failed and we were unable to recover it. 00:28:03.507 [2024-11-28 19:16:24.350662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.350775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.350803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.507 qpair failed and we were unable to recover it. 00:28:03.507 [2024-11-28 19:16:24.350930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.351051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.351083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.507 qpair failed and we were unable to recover it. 00:28:03.507 [2024-11-28 19:16:24.351219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.351345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.351370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.507 qpair failed and we were unable to recover it. 00:28:03.507 [2024-11-28 19:16:24.351487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.351570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.351595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.507 qpair failed and we were unable to recover it. 00:28:03.507 [2024-11-28 19:16:24.351705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.351827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.351856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.507 qpair failed and we were unable to recover it. 00:28:03.507 [2024-11-28 19:16:24.351988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.352126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.352151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.507 qpair failed and we were unable to recover it. 00:28:03.507 [2024-11-28 19:16:24.352259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.352410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.352452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.507 qpair failed and we were unable to recover it. 00:28:03.507 [2024-11-28 19:16:24.352534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.352611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.352637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.507 qpair failed and we were unable to recover it. 00:28:03.507 [2024-11-28 19:16:24.352814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.352899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.352924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.507 qpair failed and we were unable to recover it. 00:28:03.507 [2024-11-28 19:16:24.353087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.353234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.353274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.507 qpair failed and we were unable to recover it. 00:28:03.507 [2024-11-28 19:16:24.353415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.353542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.353570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.507 qpair failed and we were unable to recover it. 00:28:03.507 [2024-11-28 19:16:24.353703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.353794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.353824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.507 qpair failed and we were unable to recover it. 00:28:03.507 [2024-11-28 19:16:24.353962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.354070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.354095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.507 qpair failed and we were unable to recover it. 00:28:03.507 [2024-11-28 19:16:24.354182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.354261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.354286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.507 qpair failed and we were unable to recover it. 00:28:03.507 [2024-11-28 19:16:24.354376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.354467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.354492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.507 qpair failed and we were unable to recover it. 00:28:03.507 [2024-11-28 19:16:24.354612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.354696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.354721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.507 qpair failed and we were unable to recover it. 00:28:03.507 [2024-11-28 19:16:24.354819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.354899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.354924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.507 qpair failed and we were unable to recover it. 00:28:03.507 [2024-11-28 19:16:24.355015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.355101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.355125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.507 qpair failed and we were unable to recover it. 00:28:03.507 [2024-11-28 19:16:24.355250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.355385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.355418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.507 qpair failed and we were unable to recover it. 00:28:03.507 [2024-11-28 19:16:24.355502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.507 [2024-11-28 19:16:24.355588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.355614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.508 qpair failed and we were unable to recover it. 00:28:03.508 [2024-11-28 19:16:24.355716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.355825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.355850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.508 qpair failed and we were unable to recover it. 00:28:03.508 [2024-11-28 19:16:24.355964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.356049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.356074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.508 qpair failed and we were unable to recover it. 00:28:03.508 [2024-11-28 19:16:24.356212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.356297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.356326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.508 qpair failed and we were unable to recover it. 00:28:03.508 [2024-11-28 19:16:24.356445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.356542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.356567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.508 qpair failed and we were unable to recover it. 00:28:03.508 [2024-11-28 19:16:24.356702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.356788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.356813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.508 qpair failed and we were unable to recover it. 00:28:03.508 [2024-11-28 19:16:24.356923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.357029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.357054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.508 qpair failed and we were unable to recover it. 00:28:03.508 [2024-11-28 19:16:24.357169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.357254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.357278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.508 qpair failed and we were unable to recover it. 00:28:03.508 [2024-11-28 19:16:24.357406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.357492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.357518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.508 qpair failed and we were unable to recover it. 00:28:03.508 [2024-11-28 19:16:24.357592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.357704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.357729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.508 qpair failed and we were unable to recover it. 00:28:03.508 [2024-11-28 19:16:24.357829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.357912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.357938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.508 qpair failed and we were unable to recover it. 00:28:03.508 [2024-11-28 19:16:24.358031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.358116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.358141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.508 qpair failed and we were unable to recover it. 00:28:03.508 [2024-11-28 19:16:24.358231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.358338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.358363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.508 qpair failed and we were unable to recover it. 00:28:03.508 [2024-11-28 19:16:24.358456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.358576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.358601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.508 qpair failed and we were unable to recover it. 00:28:03.508 [2024-11-28 19:16:24.358714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.358798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.358824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.508 qpair failed and we were unable to recover it. 00:28:03.508 [2024-11-28 19:16:24.358908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.358996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.359020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.508 qpair failed and we were unable to recover it. 00:28:03.508 [2024-11-28 19:16:24.359135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.359241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.359284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.508 qpair failed and we were unable to recover it. 00:28:03.508 [2024-11-28 19:16:24.359418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.359572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.359598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.508 qpair failed and we were unable to recover it. 00:28:03.508 [2024-11-28 19:16:24.359691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.359776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.359801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.508 qpair failed and we were unable to recover it. 00:28:03.508 [2024-11-28 19:16:24.359912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.360035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.360061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.508 qpair failed and we were unable to recover it. 00:28:03.508 [2024-11-28 19:16:24.360157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.360270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.360295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.508 qpair failed and we were unable to recover it. 00:28:03.508 [2024-11-28 19:16:24.360421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.360513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.360538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.508 qpair failed and we were unable to recover it. 00:28:03.508 [2024-11-28 19:16:24.360620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.360700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.360725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.508 qpair failed and we were unable to recover it. 00:28:03.508 [2024-11-28 19:16:24.360808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.360921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.360946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.508 qpair failed and we were unable to recover it. 00:28:03.508 [2024-11-28 19:16:24.361022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.361111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.361136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.508 qpair failed and we were unable to recover it. 00:28:03.508 [2024-11-28 19:16:24.361225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.361364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.361389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.508 qpair failed and we were unable to recover it. 00:28:03.508 [2024-11-28 19:16:24.361487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.361576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.361602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.508 qpair failed and we were unable to recover it. 00:28:03.508 [2024-11-28 19:16:24.361744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.361852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.361877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.508 qpair failed and we were unable to recover it. 00:28:03.508 [2024-11-28 19:16:24.361970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.508 [2024-11-28 19:16:24.362083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.362109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.509 qpair failed and we were unable to recover it. 00:28:03.509 [2024-11-28 19:16:24.362191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.362295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.362323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.509 qpair failed and we were unable to recover it. 00:28:03.509 [2024-11-28 19:16:24.362418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.362522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.362547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.509 qpair failed and we were unable to recover it. 00:28:03.509 [2024-11-28 19:16:24.362621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.362707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.362733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.509 qpair failed and we were unable to recover it. 00:28:03.509 [2024-11-28 19:16:24.362814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.362925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.362950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.509 qpair failed and we were unable to recover it. 00:28:03.509 [2024-11-28 19:16:24.363039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.363147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.363172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.509 qpair failed and we were unable to recover it. 00:28:03.509 [2024-11-28 19:16:24.363279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.363360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.363386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.509 qpair failed and we were unable to recover it. 00:28:03.509 [2024-11-28 19:16:24.363511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.363626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.363651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.509 qpair failed and we were unable to recover it. 00:28:03.509 [2024-11-28 19:16:24.363762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.363848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.363873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.509 qpair failed and we were unable to recover it. 00:28:03.509 [2024-11-28 19:16:24.363978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.364086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.364111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.509 qpair failed and we were unable to recover it. 00:28:03.509 [2024-11-28 19:16:24.364223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.364312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.364337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.509 qpair failed and we were unable to recover it. 00:28:03.509 [2024-11-28 19:16:24.364426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.364520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.364545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.509 qpair failed and we were unable to recover it. 00:28:03.509 [2024-11-28 19:16:24.364629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.364716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.364741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.509 qpair failed and we were unable to recover it. 00:28:03.509 [2024-11-28 19:16:24.364852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.364938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.364962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.509 qpair failed and we were unable to recover it. 00:28:03.509 [2024-11-28 19:16:24.365078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.365178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.365206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.509 qpair failed and we were unable to recover it. 00:28:03.509 [2024-11-28 19:16:24.365338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.365427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.365469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.509 qpair failed and we were unable to recover it. 00:28:03.509 [2024-11-28 19:16:24.365553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.365674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.365699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.509 qpair failed and we were unable to recover it. 00:28:03.509 [2024-11-28 19:16:24.365793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.365877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.365902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.509 qpair failed and we were unable to recover it. 00:28:03.509 [2024-11-28 19:16:24.365981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.366122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.366146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.509 qpair failed and we were unable to recover it. 00:28:03.509 [2024-11-28 19:16:24.366220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.366302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.366328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.509 qpair failed and we were unable to recover it. 00:28:03.509 [2024-11-28 19:16:24.366413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.366501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.366526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.509 qpair failed and we were unable to recover it. 00:28:03.509 [2024-11-28 19:16:24.366633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.366745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.366770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.509 qpair failed and we were unable to recover it. 00:28:03.509 [2024-11-28 19:16:24.366883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.366979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.367004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.509 qpair failed and we were unable to recover it. 00:28:03.509 [2024-11-28 19:16:24.367095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.367215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.367240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.509 qpair failed and we were unable to recover it. 00:28:03.509 [2024-11-28 19:16:24.367329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.367441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.367467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.509 qpair failed and we were unable to recover it. 00:28:03.509 [2024-11-28 19:16:24.367556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.367644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.367669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.509 qpair failed and we were unable to recover it. 00:28:03.509 [2024-11-28 19:16:24.367749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.367822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.367847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.509 qpair failed and we were unable to recover it. 00:28:03.509 [2024-11-28 19:16:24.367971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.368051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.368077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.509 qpair failed and we were unable to recover it. 00:28:03.509 [2024-11-28 19:16:24.368185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.368271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.509 [2024-11-28 19:16:24.368298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.509 qpair failed and we were unable to recover it. 00:28:03.510 [2024-11-28 19:16:24.368420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.368510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.368537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.510 qpair failed and we were unable to recover it. 00:28:03.510 [2024-11-28 19:16:24.368630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.368715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.368740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.510 qpair failed and we were unable to recover it. 00:28:03.510 [2024-11-28 19:16:24.368858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.368981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.369006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.510 qpair failed and we were unable to recover it. 00:28:03.510 [2024-11-28 19:16:24.369090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.369163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.369188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.510 qpair failed and we were unable to recover it. 00:28:03.510 [2024-11-28 19:16:24.369294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.369428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.369454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.510 qpair failed and we were unable to recover it. 00:28:03.510 [2024-11-28 19:16:24.369562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.369640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.369665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.510 qpair failed and we were unable to recover it. 00:28:03.510 [2024-11-28 19:16:24.369750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.369873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.369898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.510 qpair failed and we were unable to recover it. 00:28:03.510 [2024-11-28 19:16:24.370004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.370080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.370105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.510 qpair failed and we were unable to recover it. 00:28:03.510 [2024-11-28 19:16:24.370217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.370299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.370324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.510 qpair failed and we were unable to recover it. 00:28:03.510 [2024-11-28 19:16:24.370410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.370519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.370544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.510 qpair failed and we were unable to recover it. 00:28:03.510 [2024-11-28 19:16:24.370635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.370749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.370774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.510 qpair failed and we were unable to recover it. 00:28:03.510 [2024-11-28 19:16:24.370858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.370963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.370988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.510 qpair failed and we were unable to recover it. 00:28:03.510 [2024-11-28 19:16:24.371080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.371173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.371198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.510 qpair failed and we were unable to recover it. 00:28:03.510 [2024-11-28 19:16:24.371286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.371415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.371441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.510 qpair failed and we were unable to recover it. 00:28:03.510 [2024-11-28 19:16:24.371565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.371652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.371676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.510 qpair failed and we were unable to recover it. 00:28:03.510 [2024-11-28 19:16:24.371798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.371884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.371909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.510 qpair failed and we were unable to recover it. 00:28:03.510 [2024-11-28 19:16:24.372047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.372167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.372202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.510 qpair failed and we were unable to recover it. 00:28:03.510 [2024-11-28 19:16:24.372324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.372424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.372452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.510 qpair failed and we were unable to recover it. 00:28:03.510 [2024-11-28 19:16:24.372584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.372679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.372710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.510 qpair failed and we were unable to recover it. 00:28:03.510 [2024-11-28 19:16:24.372859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.372980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.373011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.510 qpair failed and we were unable to recover it. 00:28:03.510 [2024-11-28 19:16:24.373108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.373232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.373263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.510 qpair failed and we were unable to recover it. 00:28:03.510 [2024-11-28 19:16:24.373359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.373488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.373517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.510 qpair failed and we were unable to recover it. 00:28:03.510 [2024-11-28 19:16:24.373639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.373736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.373762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.510 qpair failed and we were unable to recover it. 00:28:03.510 [2024-11-28 19:16:24.373887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.373970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.373999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.510 qpair failed and we were unable to recover it. 00:28:03.510 [2024-11-28 19:16:24.374103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.374225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.510 [2024-11-28 19:16:24.374255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.511 qpair failed and we were unable to recover it. 00:28:03.511 [2024-11-28 19:16:24.374338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.374432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.374462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.511 qpair failed and we were unable to recover it. 00:28:03.511 [2024-11-28 19:16:24.374561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.374718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.374748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.511 qpair failed and we were unable to recover it. 00:28:03.511 [2024-11-28 19:16:24.374870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.374974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.375001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.511 qpair failed and we were unable to recover it. 00:28:03.511 [2024-11-28 19:16:24.375130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.375222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.375249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.511 qpair failed and we were unable to recover it. 00:28:03.511 [2024-11-28 19:16:24.375383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.375483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.375514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.511 qpair failed and we were unable to recover it. 00:28:03.511 [2024-11-28 19:16:24.375621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.375740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.375770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.511 qpair failed and we were unable to recover it. 00:28:03.511 [2024-11-28 19:16:24.375912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.376057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.376092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.511 qpair failed and we were unable to recover it. 00:28:03.511 [2024-11-28 19:16:24.376186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.376305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.376332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.511 qpair failed and we were unable to recover it. 00:28:03.511 [2024-11-28 19:16:24.376436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.376530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.376562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.511 qpair failed and we were unable to recover it. 00:28:03.511 [2024-11-28 19:16:24.376660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.376781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.376812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.511 qpair failed and we were unable to recover it. 00:28:03.511 [2024-11-28 19:16:24.376912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.377007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.377036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.511 qpair failed and we were unable to recover it. 00:28:03.511 [2024-11-28 19:16:24.377134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.377253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.377279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.511 qpair failed and we were unable to recover it. 00:28:03.511 [2024-11-28 19:16:24.377414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.377503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.377536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.511 qpair failed and we were unable to recover it. 00:28:03.511 [2024-11-28 19:16:24.377639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.377752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.377778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.511 qpair failed and we were unable to recover it. 00:28:03.511 [2024-11-28 19:16:24.377875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.377995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.378021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.511 qpair failed and we were unable to recover it. 00:28:03.511 [2024-11-28 19:16:24.378106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.378206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.378234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.511 qpair failed and we were unable to recover it. 00:28:03.511 [2024-11-28 19:16:24.378359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.378497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.378527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.511 qpair failed and we were unable to recover it. 00:28:03.511 [2024-11-28 19:16:24.378624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.378753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.378782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.511 qpair failed and we were unable to recover it. 00:28:03.511 [2024-11-28 19:16:24.378910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.379033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.379063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.511 qpair failed and we were unable to recover it. 00:28:03.511 [2024-11-28 19:16:24.379218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.379315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.379345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.511 qpair failed and we were unable to recover it. 00:28:03.511 [2024-11-28 19:16:24.379469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.379595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.379624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.511 qpair failed and we were unable to recover it. 00:28:03.511 [2024-11-28 19:16:24.379748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.379844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.379875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.511 qpair failed and we were unable to recover it. 00:28:03.511 [2024-11-28 19:16:24.379998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.380121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.380152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.511 qpair failed and we were unable to recover it. 00:28:03.511 [2024-11-28 19:16:24.380282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.380372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.380420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.511 qpair failed and we were unable to recover it. 00:28:03.511 [2024-11-28 19:16:24.380547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.380657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.380687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.511 qpair failed and we were unable to recover it. 00:28:03.511 [2024-11-28 19:16:24.380789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.380909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.380940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.511 qpair failed and we were unable to recover it. 00:28:03.511 [2024-11-28 19:16:24.381035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.381127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.381157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.511 qpair failed and we were unable to recover it. 00:28:03.511 [2024-11-28 19:16:24.381254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.381351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.511 [2024-11-28 19:16:24.381378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.511 qpair failed and we were unable to recover it. 00:28:03.512 [2024-11-28 19:16:24.381485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.381605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.381632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.512 qpair failed and we were unable to recover it. 00:28:03.512 [2024-11-28 19:16:24.381722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.381843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.381870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.512 qpair failed and we were unable to recover it. 00:28:03.512 [2024-11-28 19:16:24.381991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.382122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.382150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.512 qpair failed and we were unable to recover it. 00:28:03.512 [2024-11-28 19:16:24.382276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.382404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.382436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.512 qpair failed and we were unable to recover it. 00:28:03.512 [2024-11-28 19:16:24.382549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.382659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.382688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.512 qpair failed and we were unable to recover it. 00:28:03.512 [2024-11-28 19:16:24.382844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.382971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.382998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.512 qpair failed and we were unable to recover it. 00:28:03.512 [2024-11-28 19:16:24.383126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.383215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.383244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.512 qpair failed and we were unable to recover it. 00:28:03.512 [2024-11-28 19:16:24.383331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.383430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.383463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.512 qpair failed and we were unable to recover it. 00:28:03.512 [2024-11-28 19:16:24.383556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.383656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.383685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.512 qpair failed and we were unable to recover it. 00:28:03.512 [2024-11-28 19:16:24.383805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.383897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.383931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.512 qpair failed and we were unable to recover it. 00:28:03.512 [2024-11-28 19:16:24.384064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.384156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.384184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.512 qpair failed and we were unable to recover it. 00:28:03.512 [2024-11-28 19:16:24.384291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.384388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.384431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.512 qpair failed and we were unable to recover it. 00:28:03.512 [2024-11-28 19:16:24.384539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.384633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.384664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.512 qpair failed and we were unable to recover it. 00:28:03.512 [2024-11-28 19:16:24.384792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.384909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.384945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.512 qpair failed and we were unable to recover it. 00:28:03.512 [2024-11-28 19:16:24.385043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.385186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.385217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.512 qpair failed and we were unable to recover it. 00:28:03.512 [2024-11-28 19:16:24.385345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.385451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.385481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.512 qpair failed and we were unable to recover it. 00:28:03.512 [2024-11-28 19:16:24.385584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.385700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.385727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.512 qpair failed and we were unable to recover it. 00:28:03.512 [2024-11-28 19:16:24.385846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.385937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.385967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.512 qpair failed and we were unable to recover it. 00:28:03.512 [2024-11-28 19:16:24.386066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.386161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.386192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.512 qpair failed and we were unable to recover it. 00:28:03.512 [2024-11-28 19:16:24.386291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.386386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.386423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.512 qpair failed and we were unable to recover it. 00:28:03.512 [2024-11-28 19:16:24.386531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.386675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.386710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.512 qpair failed and we were unable to recover it. 00:28:03.512 [2024-11-28 19:16:24.386815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.386918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.386947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.512 qpair failed and we were unable to recover it. 00:28:03.512 [2024-11-28 19:16:24.387063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.387160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.387192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.512 qpair failed and we were unable to recover it. 00:28:03.512 [2024-11-28 19:16:24.387298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.387426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.387460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.512 qpair failed and we were unable to recover it. 00:28:03.512 [2024-11-28 19:16:24.387587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.387683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.387710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.512 qpair failed and we were unable to recover it. 00:28:03.512 [2024-11-28 19:16:24.387841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.387992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.388022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.512 qpair failed and we were unable to recover it. 00:28:03.512 [2024-11-28 19:16:24.388147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.388240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.388266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.512 qpair failed and we were unable to recover it. 00:28:03.512 [2024-11-28 19:16:24.388363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.388476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.388512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.512 qpair failed and we were unable to recover it. 00:28:03.512 [2024-11-28 19:16:24.388662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.512 [2024-11-28 19:16:24.388787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.388823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.513 qpair failed and we were unable to recover it. 00:28:03.513 [2024-11-28 19:16:24.388931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.389054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.389083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.513 qpair failed and we were unable to recover it. 00:28:03.513 [2024-11-28 19:16:24.389208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.389322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.389355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.513 qpair failed and we were unable to recover it. 00:28:03.513 [2024-11-28 19:16:24.389465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.389587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.389617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.513 qpair failed and we were unable to recover it. 00:28:03.513 [2024-11-28 19:16:24.389741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.389851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.389883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.513 qpair failed and we were unable to recover it. 00:28:03.513 [2024-11-28 19:16:24.390034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.390134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.390168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.513 qpair failed and we were unable to recover it. 00:28:03.513 [2024-11-28 19:16:24.390295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.390413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.390447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.513 qpair failed and we were unable to recover it. 00:28:03.513 [2024-11-28 19:16:24.390576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.390698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.390729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.513 qpair failed and we were unable to recover it. 00:28:03.513 [2024-11-28 19:16:24.390830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.390928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.390957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.513 qpair failed and we were unable to recover it. 00:28:03.513 [2024-11-28 19:16:24.391054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.391148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.391178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.513 qpair failed and we were unable to recover it. 00:28:03.513 [2024-11-28 19:16:24.391280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.391372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.391409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.513 qpair failed and we were unable to recover it. 00:28:03.513 [2024-11-28 19:16:24.391532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.391626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.391653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.513 qpair failed and we were unable to recover it. 00:28:03.513 [2024-11-28 19:16:24.391775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.391870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.391896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.513 qpair failed and we were unable to recover it. 00:28:03.513 [2024-11-28 19:16:24.391989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.392094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.392127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.513 qpair failed and we were unable to recover it. 00:28:03.513 [2024-11-28 19:16:24.392258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.392421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.392455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.513 qpair failed and we were unable to recover it. 00:28:03.513 [2024-11-28 19:16:24.392554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.392673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.392704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.513 qpair failed and we were unable to recover it. 00:28:03.513 [2024-11-28 19:16:24.392840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.392932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.392963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.513 qpair failed and we were unable to recover it. 00:28:03.513 [2024-11-28 19:16:24.393095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.393213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.393245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.513 qpair failed and we were unable to recover it. 00:28:03.513 [2024-11-28 19:16:24.393350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.393456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.393483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.513 qpair failed and we were unable to recover it. 00:28:03.513 [2024-11-28 19:16:24.393585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.393734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.393765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.513 qpair failed and we were unable to recover it. 00:28:03.513 [2024-11-28 19:16:24.393882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.394002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.394036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.513 qpair failed and we were unable to recover it. 00:28:03.513 [2024-11-28 19:16:24.394141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.394239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.394270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.513 qpair failed and we were unable to recover it. 00:28:03.513 [2024-11-28 19:16:24.394403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.394521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.394551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.513 qpair failed and we were unable to recover it. 00:28:03.513 [2024-11-28 19:16:24.394675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.394826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.394854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.513 qpair failed and we were unable to recover it. 00:28:03.513 [2024-11-28 19:16:24.394954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.395071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.395100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.513 qpair failed and we were unable to recover it. 00:28:03.513 [2024-11-28 19:16:24.395236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.395379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.395419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.513 qpair failed and we were unable to recover it. 00:28:03.513 [2024-11-28 19:16:24.395564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.395707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.395734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.513 qpair failed and we were unable to recover it. 00:28:03.513 [2024-11-28 19:16:24.395831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.395920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.395952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.513 qpair failed and we were unable to recover it. 00:28:03.513 [2024-11-28 19:16:24.396053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.396181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.513 [2024-11-28 19:16:24.396211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.513 qpair failed and we were unable to recover it. 00:28:03.514 [2024-11-28 19:16:24.396345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.396454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.396487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.514 qpair failed and we were unable to recover it. 00:28:03.514 [2024-11-28 19:16:24.396596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.396743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.396776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.514 qpair failed and we were unable to recover it. 00:28:03.514 [2024-11-28 19:16:24.396898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.396990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.397017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.514 qpair failed and we were unable to recover it. 00:28:03.514 [2024-11-28 19:16:24.397129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.397260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.397290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.514 qpair failed and we were unable to recover it. 00:28:03.514 [2024-11-28 19:16:24.397411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.397492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.397518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.514 qpair failed and we were unable to recover it. 00:28:03.514 [2024-11-28 19:16:24.397603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.397717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.397745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.514 qpair failed and we were unable to recover it. 00:28:03.514 [2024-11-28 19:16:24.397839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.397936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.397966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.514 qpair failed and we were unable to recover it. 00:28:03.514 [2024-11-28 19:16:24.398098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.398191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.398219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.514 qpair failed and we were unable to recover it. 00:28:03.514 [2024-11-28 19:16:24.398345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.398426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.398453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.514 qpair failed and we were unable to recover it. 00:28:03.514 [2024-11-28 19:16:24.398586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.398702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.398729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.514 qpair failed and we were unable to recover it. 00:28:03.514 [2024-11-28 19:16:24.398827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.398943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.398970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.514 qpair failed and we were unable to recover it. 00:28:03.514 [2024-11-28 19:16:24.399095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.399214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.399242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.514 qpair failed and we were unable to recover it. 00:28:03.514 [2024-11-28 19:16:24.399338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.399424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.399450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.514 qpair failed and we were unable to recover it. 00:28:03.514 [2024-11-28 19:16:24.399541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.399647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.399675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.514 qpair failed and we were unable to recover it. 00:28:03.514 [2024-11-28 19:16:24.399783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.399987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.400014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.514 qpair failed and we were unable to recover it. 00:28:03.514 [2024-11-28 19:16:24.400139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.400279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.400304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.514 qpair failed and we were unable to recover it. 00:28:03.514 [2024-11-28 19:16:24.400397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.400503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.400531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.514 qpair failed and we were unable to recover it. 00:28:03.514 [2024-11-28 19:16:24.400628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.400715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.400744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.514 qpair failed and we were unable to recover it. 00:28:03.514 [2024-11-28 19:16:24.400833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.400979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.401007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.514 qpair failed and we were unable to recover it. 00:28:03.514 [2024-11-28 19:16:24.401095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.401197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.401222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.514 qpair failed and we were unable to recover it. 00:28:03.514 [2024-11-28 19:16:24.401310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.401416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.401442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.514 qpair failed and we were unable to recover it. 00:28:03.514 [2024-11-28 19:16:24.401544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.401635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.401663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.514 qpair failed and we were unable to recover it. 00:28:03.514 [2024-11-28 19:16:24.401795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.401888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.401916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.514 qpair failed and we were unable to recover it. 00:28:03.514 [2024-11-28 19:16:24.402015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.402132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.402159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.514 qpair failed and we were unable to recover it. 00:28:03.514 [2024-11-28 19:16:24.402260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.402343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.402367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.514 qpair failed and we were unable to recover it. 00:28:03.514 [2024-11-28 19:16:24.402486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.402594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.402618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.514 qpair failed and we were unable to recover it. 00:28:03.514 [2024-11-28 19:16:24.402743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.402856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.402883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.514 qpair failed and we were unable to recover it. 00:28:03.514 [2024-11-28 19:16:24.403066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.403164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.403206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.514 qpair failed and we were unable to recover it. 00:28:03.514 [2024-11-28 19:16:24.403328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.403441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.514 [2024-11-28 19:16:24.403467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.515 qpair failed and we were unable to recover it. 00:28:03.515 [2024-11-28 19:16:24.403558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.403662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.403687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.515 qpair failed and we were unable to recover it. 00:28:03.515 [2024-11-28 19:16:24.403815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.403929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.403957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.515 qpair failed and we were unable to recover it. 00:28:03.515 [2024-11-28 19:16:24.404080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.404167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.404194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.515 qpair failed and we were unable to recover it. 00:28:03.515 [2024-11-28 19:16:24.404303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.404388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.404417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.515 qpair failed and we were unable to recover it. 00:28:03.515 [2024-11-28 19:16:24.404534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.404636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.404663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.515 qpair failed and we were unable to recover it. 00:28:03.515 [2024-11-28 19:16:24.404788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.404877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.404906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.515 qpair failed and we were unable to recover it. 00:28:03.515 [2024-11-28 19:16:24.405031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.405123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.405150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.515 qpair failed and we were unable to recover it. 00:28:03.515 [2024-11-28 19:16:24.405273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.405362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.405386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.515 qpair failed and we were unable to recover it. 00:28:03.515 [2024-11-28 19:16:24.405493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.405574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.405599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.515 qpair failed and we were unable to recover it. 00:28:03.515 [2024-11-28 19:16:24.405730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.405852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.405881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.515 qpair failed and we were unable to recover it. 00:28:03.515 [2024-11-28 19:16:24.405974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.406072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.406100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.515 qpair failed and we were unable to recover it. 00:28:03.515 [2024-11-28 19:16:24.406203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.406313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.406338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.515 qpair failed and we were unable to recover it. 00:28:03.515 [2024-11-28 19:16:24.406469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.406559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.406586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.515 qpair failed and we were unable to recover it. 00:28:03.515 [2024-11-28 19:16:24.406761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.406851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.406878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.515 qpair failed and we were unable to recover it. 00:28:03.515 [2024-11-28 19:16:24.406997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.407092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.407120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.515 qpair failed and we were unable to recover it. 00:28:03.515 [2024-11-28 19:16:24.407236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.407328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.407353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.515 qpair failed and we were unable to recover it. 00:28:03.515 [2024-11-28 19:16:24.407477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.407555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.407579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.515 qpair failed and we were unable to recover it. 00:28:03.515 [2024-11-28 19:16:24.407670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.407773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.407801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.515 qpair failed and we were unable to recover it. 00:28:03.515 [2024-11-28 19:16:24.407888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.407979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.408011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.515 qpair failed and we were unable to recover it. 00:28:03.515 [2024-11-28 19:16:24.408104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.408229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.408254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.515 qpair failed and we were unable to recover it. 00:28:03.515 [2024-11-28 19:16:24.408361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.408449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.408474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.515 qpair failed and we were unable to recover it. 00:28:03.515 [2024-11-28 19:16:24.408564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.408672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.408699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.515 qpair failed and we were unable to recover it. 00:28:03.515 [2024-11-28 19:16:24.408825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.408947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.408976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.515 qpair failed and we were unable to recover it. 00:28:03.515 [2024-11-28 19:16:24.409097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.515 [2024-11-28 19:16:24.409192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.409233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.516 qpair failed and we were unable to recover it. 00:28:03.516 [2024-11-28 19:16:24.409349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.409455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.409481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.516 qpair failed and we were unable to recover it. 00:28:03.516 [2024-11-28 19:16:24.409580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.409702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.409727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.516 qpair failed and we were unable to recover it. 00:28:03.516 [2024-11-28 19:16:24.409811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.409909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.409936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.516 qpair failed and we were unable to recover it. 00:28:03.516 [2024-11-28 19:16:24.410024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.410130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.410154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.516 qpair failed and we were unable to recover it. 00:28:03.516 [2024-11-28 19:16:24.410241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.410324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.410349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.516 qpair failed and we were unable to recover it. 00:28:03.516 [2024-11-28 19:16:24.410503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.410634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.410661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.516 qpair failed and we were unable to recover it. 00:28:03.516 [2024-11-28 19:16:24.410759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.410883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.410911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.516 qpair failed and we were unable to recover it. 00:28:03.516 [2024-11-28 19:16:24.411081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.411179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.411208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.516 qpair failed and we were unable to recover it. 00:28:03.516 [2024-11-28 19:16:24.411318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.411543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.411572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.516 qpair failed and we were unable to recover it. 00:28:03.516 [2024-11-28 19:16:24.411666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.411786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.411814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.516 qpair failed and we were unable to recover it. 00:28:03.516 [2024-11-28 19:16:24.411938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.412090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.412134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.516 qpair failed and we were unable to recover it. 00:28:03.516 [2024-11-28 19:16:24.412223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.412305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.412346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.516 qpair failed and we were unable to recover it. 00:28:03.516 [2024-11-28 19:16:24.412437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.412553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.412577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.516 qpair failed and we were unable to recover it. 00:28:03.516 [2024-11-28 19:16:24.412686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.412813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.412841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.516 qpair failed and we were unable to recover it. 00:28:03.516 [2024-11-28 19:16:24.413002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.413096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.413124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.516 qpair failed and we were unable to recover it. 00:28:03.516 [2024-11-28 19:16:24.413230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.413363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.413388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.516 qpair failed and we were unable to recover it. 00:28:03.516 [2024-11-28 19:16:24.413494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.413621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.413649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.516 qpair failed and we were unable to recover it. 00:28:03.516 [2024-11-28 19:16:24.413799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.413917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.413945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.516 qpair failed and we were unable to recover it. 00:28:03.516 [2024-11-28 19:16:24.414045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.414180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.414204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.516 qpair failed and we were unable to recover it. 00:28:03.516 [2024-11-28 19:16:24.414323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.414432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.414457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.516 qpair failed and we were unable to recover it. 00:28:03.516 [2024-11-28 19:16:24.414537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.414645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.414672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.516 qpair failed and we were unable to recover it. 00:28:03.516 [2024-11-28 19:16:24.414769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.414860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.414887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.516 qpair failed and we were unable to recover it. 00:28:03.516 [2024-11-28 19:16:24.415041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.415132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.415158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.516 qpair failed and we were unable to recover it. 00:28:03.516 [2024-11-28 19:16:24.415292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.415378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.415410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.516 qpair failed and we were unable to recover it. 00:28:03.516 [2024-11-28 19:16:24.415518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.415617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.415644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.516 qpair failed and we were unable to recover it. 00:28:03.516 [2024-11-28 19:16:24.415757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.415873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.415923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.516 qpair failed and we were unable to recover it. 00:28:03.516 [2024-11-28 19:16:24.416074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.416181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.416210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.516 qpair failed and we were unable to recover it. 00:28:03.516 [2024-11-28 19:16:24.416334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.416418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.516 [2024-11-28 19:16:24.416447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.516 qpair failed and we were unable to recover it. 00:28:03.516 [2024-11-28 19:16:24.416570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.416682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.416708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.517 qpair failed and we were unable to recover it. 00:28:03.517 [2024-11-28 19:16:24.416825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.416912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.416937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.517 qpair failed and we were unable to recover it. 00:28:03.517 [2024-11-28 19:16:24.417021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.417135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.417161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.517 qpair failed and we were unable to recover it. 00:28:03.517 [2024-11-28 19:16:24.417246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.417361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.417386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.517 qpair failed and we were unable to recover it. 00:28:03.517 [2024-11-28 19:16:24.417530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.417609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.417637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.517 qpair failed and we were unable to recover it. 00:28:03.517 [2024-11-28 19:16:24.417734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.417835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.417863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.517 qpair failed and we were unable to recover it. 00:28:03.517 [2024-11-28 19:16:24.417970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.418083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.418108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.517 qpair failed and we were unable to recover it. 00:28:03.517 [2024-11-28 19:16:24.418216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.418330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.418355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.517 qpair failed and we were unable to recover it. 00:28:03.517 [2024-11-28 19:16:24.418520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.418605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.418632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.517 qpair failed and we were unable to recover it. 00:28:03.517 [2024-11-28 19:16:24.418846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.418936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.418963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.517 qpair failed and we were unable to recover it. 00:28:03.517 [2024-11-28 19:16:24.419052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.419148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.419190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.517 qpair failed and we were unable to recover it. 00:28:03.517 [2024-11-28 19:16:24.419379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.419475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.419501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.517 qpair failed and we were unable to recover it. 00:28:03.517 [2024-11-28 19:16:24.419653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.419780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.419807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.517 qpair failed and we were unable to recover it. 00:28:03.517 [2024-11-28 19:16:24.419901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.419990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.420017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.517 qpair failed and we were unable to recover it. 00:28:03.517 [2024-11-28 19:16:24.420146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.420230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.420256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.517 qpair failed and we were unable to recover it. 00:28:03.517 [2024-11-28 19:16:24.420371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.420462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.420488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.517 qpair failed and we were unable to recover it. 00:28:03.517 [2024-11-28 19:16:24.420675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.420756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.420782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.517 qpair failed and we were unable to recover it. 00:28:03.517 [2024-11-28 19:16:24.420860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.420972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.421001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.517 qpair failed and we were unable to recover it. 00:28:03.517 [2024-11-28 19:16:24.421100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.421225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.421250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.517 qpair failed and we were unable to recover it. 00:28:03.517 [2024-11-28 19:16:24.421322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.421442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.421468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.517 qpair failed and we were unable to recover it. 00:28:03.517 [2024-11-28 19:16:24.421559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.421688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.421716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.517 qpair failed and we were unable to recover it. 00:28:03.517 [2024-11-28 19:16:24.421815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.421937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.421964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.517 qpair failed and we were unable to recover it. 00:28:03.517 [2024-11-28 19:16:24.422057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.422161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.422189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.517 qpair failed and we were unable to recover it. 00:28:03.517 [2024-11-28 19:16:24.422356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.422450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.422476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.517 qpair failed and we were unable to recover it. 00:28:03.517 [2024-11-28 19:16:24.422666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.422758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.422788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.517 qpair failed and we were unable to recover it. 00:28:03.517 [2024-11-28 19:16:24.422888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.423008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.423036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.517 qpair failed and we were unable to recover it. 00:28:03.517 [2024-11-28 19:16:24.423116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.423215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.423239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.517 qpair failed and we were unable to recover it. 00:28:03.517 [2024-11-28 19:16:24.423426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.423527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.423555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.517 qpair failed and we were unable to recover it. 00:28:03.517 [2024-11-28 19:16:24.423658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.423750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.517 [2024-11-28 19:16:24.423778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.517 qpair failed and we were unable to recover it. 00:28:03.518 [2024-11-28 19:16:24.423917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.424000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.424024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.518 qpair failed and we were unable to recover it. 00:28:03.518 [2024-11-28 19:16:24.424107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.424221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.424246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.518 qpair failed and we were unable to recover it. 00:28:03.518 [2024-11-28 19:16:24.424327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.424405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.424448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.518 qpair failed and we were unable to recover it. 00:28:03.518 [2024-11-28 19:16:24.424548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.424645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.424674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.518 qpair failed and we were unable to recover it. 00:28:03.518 [2024-11-28 19:16:24.424793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.424913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.424940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.518 qpair failed and we were unable to recover it. 00:28:03.518 [2024-11-28 19:16:24.425032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.425132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.425157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.518 qpair failed and we were unable to recover it. 00:28:03.518 [2024-11-28 19:16:24.425237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.425345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.425370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.518 qpair failed and we were unable to recover it. 00:28:03.518 [2024-11-28 19:16:24.425499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.425622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.425658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.518 qpair failed and we were unable to recover it. 00:28:03.518 [2024-11-28 19:16:24.425770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.425904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.425934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.518 qpair failed and we were unable to recover it. 00:28:03.518 [2024-11-28 19:16:24.426092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.426188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.426217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.518 qpair failed and we were unable to recover it. 00:28:03.518 [2024-11-28 19:16:24.426317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.426441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.426473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.518 qpair failed and we were unable to recover it. 00:28:03.518 [2024-11-28 19:16:24.426598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.426720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.426752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.518 qpair failed and we were unable to recover it. 00:28:03.518 [2024-11-28 19:16:24.426858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.427009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.427040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.518 qpair failed and we were unable to recover it. 00:28:03.518 [2024-11-28 19:16:24.427144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.427235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.427260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.518 qpair failed and we were unable to recover it. 00:28:03.518 [2024-11-28 19:16:24.427342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.427425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.427469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.518 qpair failed and we were unable to recover it. 00:28:03.518 [2024-11-28 19:16:24.427565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.427684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.427713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.518 qpair failed and we were unable to recover it. 00:28:03.518 [2024-11-28 19:16:24.427810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.427904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.427932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.518 qpair failed and we were unable to recover it. 00:28:03.518 [2024-11-28 19:16:24.428030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.428125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.428153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.518 qpair failed and we were unable to recover it. 00:28:03.518 [2024-11-28 19:16:24.428282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.428368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.428398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.518 qpair failed and we were unable to recover it. 00:28:03.518 [2024-11-28 19:16:24.428490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.428626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.428654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.518 qpair failed and we were unable to recover it. 00:28:03.518 [2024-11-28 19:16:24.428736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.428855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.428883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.518 qpair failed and we were unable to recover it. 00:28:03.518 [2024-11-28 19:16:24.428988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.429075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.429102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.518 qpair failed and we were unable to recover it. 00:28:03.518 [2024-11-28 19:16:24.429269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.429365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.429390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.518 qpair failed and we were unable to recover it. 00:28:03.518 [2024-11-28 19:16:24.429480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.429564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.429606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.518 qpair failed and we were unable to recover it. 00:28:03.518 [2024-11-28 19:16:24.429728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.429847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.429874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.518 qpair failed and we were unable to recover it. 00:28:03.518 [2024-11-28 19:16:24.429963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.430114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.430141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.518 qpair failed and we were unable to recover it. 00:28:03.518 [2024-11-28 19:16:24.430233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.430360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.430387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.518 qpair failed and we were unable to recover it. 00:28:03.518 [2024-11-28 19:16:24.430516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.430604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.430633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.518 qpair failed and we were unable to recover it. 00:28:03.518 [2024-11-28 19:16:24.430766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.430869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.518 [2024-11-28 19:16:24.430897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.519 qpair failed and we were unable to recover it. 00:28:03.519 [2024-11-28 19:16:24.431006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.431149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.431177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.519 qpair failed and we were unable to recover it. 00:28:03.519 [2024-11-28 19:16:24.431313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.431416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.431442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.519 qpair failed and we were unable to recover it. 00:28:03.519 [2024-11-28 19:16:24.431553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.431646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.431673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.519 qpair failed and we were unable to recover it. 00:28:03.519 [2024-11-28 19:16:24.431793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.431879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.431906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.519 qpair failed and we were unable to recover it. 00:28:03.519 [2024-11-28 19:16:24.432019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.432132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.432159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.519 qpair failed and we were unable to recover it. 00:28:03.519 [2024-11-28 19:16:24.432290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.432402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.432428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.519 qpair failed and we were unable to recover it. 00:28:03.519 [2024-11-28 19:16:24.432528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.432673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.432700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.519 qpair failed and we were unable to recover it. 00:28:03.519 [2024-11-28 19:16:24.432829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.432932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.432975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.519 qpair failed and we were unable to recover it. 00:28:03.519 [2024-11-28 19:16:24.433124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.433220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.433248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.519 qpair failed and we were unable to recover it. 00:28:03.519 [2024-11-28 19:16:24.433380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.433473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.433499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.519 qpair failed and we were unable to recover it. 00:28:03.519 [2024-11-28 19:16:24.433611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.433721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.433765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.519 qpair failed and we were unable to recover it. 00:28:03.519 [2024-11-28 19:16:24.433947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.434037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.434064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.519 qpair failed and we were unable to recover it. 00:28:03.519 [2024-11-28 19:16:24.434150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.434230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.434257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.519 qpair failed and we were unable to recover it. 00:28:03.519 [2024-11-28 19:16:24.434369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.434496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.434521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.519 qpair failed and we were unable to recover it. 00:28:03.519 [2024-11-28 19:16:24.434633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.434724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.434751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.519 qpair failed and we were unable to recover it. 00:28:03.519 [2024-11-28 19:16:24.434850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.434966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.434993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.519 qpair failed and we were unable to recover it. 00:28:03.519 [2024-11-28 19:16:24.435122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.435216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.435244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.519 qpair failed and we were unable to recover it. 00:28:03.519 [2024-11-28 19:16:24.435343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.435429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.435477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.519 qpair failed and we were unable to recover it. 00:28:03.519 [2024-11-28 19:16:24.435565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.435662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.435691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.519 qpair failed and we were unable to recover it. 00:28:03.519 [2024-11-28 19:16:24.435826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.435946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.435974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.519 qpair failed and we were unable to recover it. 00:28:03.519 [2024-11-28 19:16:24.436104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.436296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.436326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.519 qpair failed and we were unable to recover it. 00:28:03.519 [2024-11-28 19:16:24.436448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.436573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.436600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.519 qpair failed and we were unable to recover it. 00:28:03.519 [2024-11-28 19:16:24.436699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.436801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.436830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.519 qpair failed and we were unable to recover it. 00:28:03.519 [2024-11-28 19:16:24.436926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.437045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.437072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.519 qpair failed and we were unable to recover it. 00:28:03.519 [2024-11-28 19:16:24.437156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.437281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.437321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.519 qpair failed and we were unable to recover it. 00:28:03.519 [2024-11-28 19:16:24.437410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.437491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.437517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.519 qpair failed and we were unable to recover it. 00:28:03.519 [2024-11-28 19:16:24.437619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.437737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.437766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.519 qpair failed and we were unable to recover it. 00:28:03.519 [2024-11-28 19:16:24.437886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.437974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.438001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.519 qpair failed and we were unable to recover it. 00:28:03.519 [2024-11-28 19:16:24.438098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.519 [2024-11-28 19:16:24.438227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.438252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.520 qpair failed and we were unable to recover it. 00:28:03.520 [2024-11-28 19:16:24.438333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.438452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.438480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.520 qpair failed and we were unable to recover it. 00:28:03.520 [2024-11-28 19:16:24.438602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.438706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.438730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.520 qpair failed and we were unable to recover it. 00:28:03.520 [2024-11-28 19:16:24.438831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.438961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.438988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.520 qpair failed and we were unable to recover it. 00:28:03.520 [2024-11-28 19:16:24.439084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.439201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.439226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.520 qpair failed and we were unable to recover it. 00:28:03.520 [2024-11-28 19:16:24.439311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.439400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.439427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.520 qpair failed and we were unable to recover it. 00:28:03.520 [2024-11-28 19:16:24.439535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.439632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.439659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.520 qpair failed and we were unable to recover it. 00:28:03.520 [2024-11-28 19:16:24.439787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.439869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.439896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.520 qpair failed and we were unable to recover it. 00:28:03.520 [2024-11-28 19:16:24.439979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.440098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.440126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.520 qpair failed and we were unable to recover it. 00:28:03.520 [2024-11-28 19:16:24.440260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.440343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.440368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.520 qpair failed and we were unable to recover it. 00:28:03.520 [2024-11-28 19:16:24.440500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.440620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.440647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.520 qpair failed and we were unable to recover it. 00:28:03.520 [2024-11-28 19:16:24.440740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.440829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.440856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.520 qpair failed and we were unable to recover it. 00:28:03.520 [2024-11-28 19:16:24.440972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.441092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.441119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.520 qpair failed and we were unable to recover it. 00:28:03.520 [2024-11-28 19:16:24.441286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.441390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.441421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.520 qpair failed and we were unable to recover it. 00:28:03.520 [2024-11-28 19:16:24.441506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.441582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.441624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.520 qpair failed and we were unable to recover it. 00:28:03.520 [2024-11-28 19:16:24.441712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.441835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.441862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.520 qpair failed and we were unable to recover it. 00:28:03.520 [2024-11-28 19:16:24.441953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.442084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.442109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.520 qpair failed and we were unable to recover it. 00:28:03.520 [2024-11-28 19:16:24.442202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.442280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.442305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.520 qpair failed and we were unable to recover it. 00:28:03.520 [2024-11-28 19:16:24.442414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.442553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.442582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.520 qpair failed and we were unable to recover it. 00:28:03.520 [2024-11-28 19:16:24.442735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.442860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.442887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.520 qpair failed and we were unable to recover it. 00:28:03.520 [2024-11-28 19:16:24.442982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.443097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.443124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.520 qpair failed and we were unable to recover it. 00:28:03.520 [2024-11-28 19:16:24.443274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.443373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.443403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.520 qpair failed and we were unable to recover it. 00:28:03.520 [2024-11-28 19:16:24.443564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.443695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.443722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.520 qpair failed and we were unable to recover it. 00:28:03.520 [2024-11-28 19:16:24.443848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.443941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.443970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.520 qpair failed and we were unable to recover it. 00:28:03.520 [2024-11-28 19:16:24.444063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.444186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.444210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.520 qpair failed and we were unable to recover it. 00:28:03.520 [2024-11-28 19:16:24.444298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.444372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.444402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.520 qpair failed and we were unable to recover it. 00:28:03.520 [2024-11-28 19:16:24.444494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.444599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.444626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.520 qpair failed and we were unable to recover it. 00:28:03.520 [2024-11-28 19:16:24.444727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.444856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.520 [2024-11-28 19:16:24.444884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.521 qpair failed and we were unable to recover it. 00:28:03.521 [2024-11-28 19:16:24.445042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.445138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.445182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.521 qpair failed and we were unable to recover it. 00:28:03.521 [2024-11-28 19:16:24.445263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.445384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.445414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.521 qpair failed and we were unable to recover it. 00:28:03.521 [2024-11-28 19:16:24.445510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.445643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.445670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.521 qpair failed and we were unable to recover it. 00:28:03.521 [2024-11-28 19:16:24.445792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.445946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.445975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.521 qpair failed and we were unable to recover it. 00:28:03.521 [2024-11-28 19:16:24.446107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.446225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.446252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.521 qpair failed and we were unable to recover it. 00:28:03.521 [2024-11-28 19:16:24.446378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.446496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.446522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.521 qpair failed and we were unable to recover it. 00:28:03.521 [2024-11-28 19:16:24.446661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.446741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.446766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.521 qpair failed and we were unable to recover it. 00:28:03.521 [2024-11-28 19:16:24.446848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.446930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.446956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.521 qpair failed and we were unable to recover it. 00:28:03.521 [2024-11-28 19:16:24.447068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.447205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.447233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.521 qpair failed and we were unable to recover it. 00:28:03.521 [2024-11-28 19:16:24.447368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.447517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.447542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.521 qpair failed and we were unable to recover it. 00:28:03.521 [2024-11-28 19:16:24.447632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.447718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.447742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.521 qpair failed and we were unable to recover it. 00:28:03.521 [2024-11-28 19:16:24.447850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.447940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.447964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.521 qpair failed and we were unable to recover it. 00:28:03.521 [2024-11-28 19:16:24.448051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.448185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.448210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.521 qpair failed and we were unable to recover it. 00:28:03.521 [2024-11-28 19:16:24.448289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.448372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.448403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.521 qpair failed and we were unable to recover it. 00:28:03.521 [2024-11-28 19:16:24.448522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.448609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.448634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.521 qpair failed and we were unable to recover it. 00:28:03.521 [2024-11-28 19:16:24.448757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.448839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.448868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.521 qpair failed and we were unable to recover it. 00:28:03.521 [2024-11-28 19:16:24.448952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.449034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.449059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.521 qpair failed and we were unable to recover it. 00:28:03.521 [2024-11-28 19:16:24.449148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.449286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.449310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.521 qpair failed and we were unable to recover it. 00:28:03.521 [2024-11-28 19:16:24.449427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.449504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.449529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.521 qpair failed and we were unable to recover it. 00:28:03.521 [2024-11-28 19:16:24.449640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.449751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.449776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.521 qpair failed and we were unable to recover it. 00:28:03.521 [2024-11-28 19:16:24.449860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.449972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.449997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.521 qpair failed and we were unable to recover it. 00:28:03.521 [2024-11-28 19:16:24.450107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.450213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.450237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.521 qpair failed and we were unable to recover it. 00:28:03.521 [2024-11-28 19:16:24.450324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.450404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.450430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.521 qpair failed and we were unable to recover it. 00:28:03.521 [2024-11-28 19:16:24.450517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.450655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.450680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.521 qpair failed and we were unable to recover it. 00:28:03.521 [2024-11-28 19:16:24.450820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.450958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.450983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.521 qpair failed and we were unable to recover it. 00:28:03.521 [2024-11-28 19:16:24.451101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.451188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.451213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.521 qpair failed and we were unable to recover it. 00:28:03.521 [2024-11-28 19:16:24.451334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.451415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.451440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.521 qpair failed and we were unable to recover it. 00:28:03.521 [2024-11-28 19:16:24.451548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.451634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.451658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.521 qpair failed and we were unable to recover it. 00:28:03.521 [2024-11-28 19:16:24.451739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.451846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.451870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.521 qpair failed and we were unable to recover it. 00:28:03.521 [2024-11-28 19:16:24.451959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.452078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.452102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.521 qpair failed and we were unable to recover it. 00:28:03.521 [2024-11-28 19:16:24.452177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.452262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.521 [2024-11-28 19:16:24.452287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.522 qpair failed and we were unable to recover it. 00:28:03.522 [2024-11-28 19:16:24.452427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.452512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.452538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.522 qpair failed and we were unable to recover it. 00:28:03.522 [2024-11-28 19:16:24.452623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.452727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.452752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.522 qpair failed and we were unable to recover it. 00:28:03.522 [2024-11-28 19:16:24.452863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.452974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.452999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.522 qpair failed and we were unable to recover it. 00:28:03.522 [2024-11-28 19:16:24.453083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.453171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.453196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.522 qpair failed and we were unable to recover it. 00:28:03.522 [2024-11-28 19:16:24.453312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.453424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.453450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.522 qpair failed and we were unable to recover it. 00:28:03.522 [2024-11-28 19:16:24.453536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.453672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.453697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.522 qpair failed and we were unable to recover it. 00:28:03.522 [2024-11-28 19:16:24.453784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.453860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.453885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.522 qpair failed and we were unable to recover it. 00:28:03.522 [2024-11-28 19:16:24.453982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.454095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.454120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.522 qpair failed and we were unable to recover it. 00:28:03.522 [2024-11-28 19:16:24.454222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.454318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.454346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.522 qpair failed and we were unable to recover it. 00:28:03.522 [2024-11-28 19:16:24.454486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.454565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.454590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.522 qpair failed and we were unable to recover it. 00:28:03.522 [2024-11-28 19:16:24.454681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.454761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.454786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.522 qpair failed and we were unable to recover it. 00:28:03.522 [2024-11-28 19:16:24.454873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.454954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.454978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.522 qpair failed and we were unable to recover it. 00:28:03.522 [2024-11-28 19:16:24.455061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.455175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.455201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.522 qpair failed and we were unable to recover it. 00:28:03.522 [2024-11-28 19:16:24.455290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.455405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.455431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.522 qpair failed and we were unable to recover it. 00:28:03.522 [2024-11-28 19:16:24.455539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.455623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.455648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.522 qpair failed and we were unable to recover it. 00:28:03.522 [2024-11-28 19:16:24.455780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.455884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.455918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.522 qpair failed and we were unable to recover it. 00:28:03.522 [2024-11-28 19:16:24.456020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.456143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.456171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.522 qpair failed and we were unable to recover it. 00:28:03.522 [2024-11-28 19:16:24.456269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.456366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.456404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.522 qpair failed and we were unable to recover it. 00:28:03.522 [2024-11-28 19:16:24.456500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.456595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.456624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.522 qpair failed and we were unable to recover it. 00:28:03.522 [2024-11-28 19:16:24.456759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.456870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.456902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.522 qpair failed and we were unable to recover it. 00:28:03.522 [2024-11-28 19:16:24.457004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.457100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.457127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.522 qpair failed and we were unable to recover it. 00:28:03.522 [2024-11-28 19:16:24.457271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.457386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.457417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.522 qpair failed and we were unable to recover it. 00:28:03.522 [2024-11-28 19:16:24.457561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.457651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.457691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.522 qpair failed and we were unable to recover it. 00:28:03.522 [2024-11-28 19:16:24.457809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.457922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.457947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.522 qpair failed and we were unable to recover it. 00:28:03.522 [2024-11-28 19:16:24.458064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.458144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.458169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.522 qpair failed and we were unable to recover it. 00:28:03.522 [2024-11-28 19:16:24.458256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.458372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.458426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.522 qpair failed and we were unable to recover it. 00:28:03.522 [2024-11-28 19:16:24.458513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.458617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.458642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.522 qpair failed and we were unable to recover it. 00:28:03.522 [2024-11-28 19:16:24.458733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.458849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.458873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.522 qpair failed and we were unable to recover it. 00:28:03.522 [2024-11-28 19:16:24.458982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.459066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.459091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.522 qpair failed and we were unable to recover it. 00:28:03.522 [2024-11-28 19:16:24.459208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.459314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.459339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.522 qpair failed and we were unable to recover it. 00:28:03.522 [2024-11-28 19:16:24.459458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.522 [2024-11-28 19:16:24.459568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.459593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.523 qpair failed and we were unable to recover it. 00:28:03.523 [2024-11-28 19:16:24.459702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.459781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.459805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.523 qpair failed and we were unable to recover it. 00:28:03.523 [2024-11-28 19:16:24.459892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.460005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.460029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.523 qpair failed and we were unable to recover it. 00:28:03.523 [2024-11-28 19:16:24.460169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.460251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.460276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.523 qpair failed and we were unable to recover it. 00:28:03.523 [2024-11-28 19:16:24.460354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.460440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.460465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.523 qpair failed and we were unable to recover it. 00:28:03.523 [2024-11-28 19:16:24.460556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.460644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.460669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.523 qpair failed and we were unable to recover it. 00:28:03.523 [2024-11-28 19:16:24.460746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.460874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.460901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.523 qpair failed and we were unable to recover it. 00:28:03.523 [2024-11-28 19:16:24.461026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.461162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.461187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.523 qpair failed and we were unable to recover it. 00:28:03.523 [2024-11-28 19:16:24.461299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.461377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.461407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.523 qpair failed and we were unable to recover it. 00:28:03.523 [2024-11-28 19:16:24.461525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.461640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.461665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.523 qpair failed and we were unable to recover it. 00:28:03.523 [2024-11-28 19:16:24.461750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.461876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.461904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.523 qpair failed and we were unable to recover it. 00:28:03.523 [2024-11-28 19:16:24.462019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.462153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.462178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.523 qpair failed and we were unable to recover it. 00:28:03.523 [2024-11-28 19:16:24.462259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.462346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.462371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.523 qpair failed and we were unable to recover it. 00:28:03.523 [2024-11-28 19:16:24.462478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.462593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.462618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.523 qpair failed and we were unable to recover it. 00:28:03.523 [2024-11-28 19:16:24.462694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.462800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.462825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.523 qpair failed and we were unable to recover it. 00:28:03.523 [2024-11-28 19:16:24.462911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.462987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.463016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.523 qpair failed and we were unable to recover it. 00:28:03.523 [2024-11-28 19:16:24.463106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.463194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.463218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.523 qpair failed and we were unable to recover it. 00:28:03.523 [2024-11-28 19:16:24.463298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.463373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.463406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.523 qpair failed and we were unable to recover it. 00:28:03.523 [2024-11-28 19:16:24.463494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.463573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.463599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.523 qpair failed and we were unable to recover it. 00:28:03.523 [2024-11-28 19:16:24.463722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.463805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.463830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.523 qpair failed and we were unable to recover it. 00:28:03.523 [2024-11-28 19:16:24.463954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.464072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.464096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.523 qpair failed and we were unable to recover it. 00:28:03.523 [2024-11-28 19:16:24.464177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.464383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.464418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.523 qpair failed and we were unable to recover it. 00:28:03.523 [2024-11-28 19:16:24.464520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.464633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.464657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.523 qpair failed and we were unable to recover it. 00:28:03.523 [2024-11-28 19:16:24.464813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.464925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.464949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.523 qpair failed and we were unable to recover it. 00:28:03.523 [2024-11-28 19:16:24.465032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.465108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.465132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.523 qpair failed and we were unable to recover it. 00:28:03.523 [2024-11-28 19:16:24.465247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.465331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.465355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.523 qpair failed and we were unable to recover it. 00:28:03.523 [2024-11-28 19:16:24.465510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.465589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.465613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.523 qpair failed and we were unable to recover it. 00:28:03.523 [2024-11-28 19:16:24.465769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.465870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.465896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.523 qpair failed and we were unable to recover it. 00:28:03.523 [2024-11-28 19:16:24.465981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.466071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.466095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.523 qpair failed and we were unable to recover it. 00:28:03.523 [2024-11-28 19:16:24.466202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.466284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.466308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.523 qpair failed and we were unable to recover it. 00:28:03.523 [2024-11-28 19:16:24.466403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.466482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.466507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.523 qpair failed and we were unable to recover it. 00:28:03.523 [2024-11-28 19:16:24.466596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.466684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.523 [2024-11-28 19:16:24.466709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.524 qpair failed and we were unable to recover it. 00:28:03.524 [2024-11-28 19:16:24.466851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.466923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.466948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.524 qpair failed and we were unable to recover it. 00:28:03.524 [2024-11-28 19:16:24.467034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.467200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.467224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.524 qpair failed and we were unable to recover it. 00:28:03.524 [2024-11-28 19:16:24.467376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.467489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.467517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.524 qpair failed and we were unable to recover it. 00:28:03.524 [2024-11-28 19:16:24.467627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.467736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.467762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.524 qpair failed and we were unable to recover it. 00:28:03.524 [2024-11-28 19:16:24.467930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.468028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.468055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.524 qpair failed and we were unable to recover it. 00:28:03.524 [2024-11-28 19:16:24.468148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.468242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.468270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.524 qpair failed and we were unable to recover it. 00:28:03.524 [2024-11-28 19:16:24.468407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.468494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.468520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.524 qpair failed and we were unable to recover it. 00:28:03.524 [2024-11-28 19:16:24.468622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.468743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.468771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.524 qpair failed and we were unable to recover it. 00:28:03.524 [2024-11-28 19:16:24.468901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.468996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.469024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.524 qpair failed and we were unable to recover it. 00:28:03.524 [2024-11-28 19:16:24.469126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.469244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.469285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.524 qpair failed and we were unable to recover it. 00:28:03.524 [2024-11-28 19:16:24.469373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.469539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.469565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.524 qpair failed and we were unable to recover it. 00:28:03.524 [2024-11-28 19:16:24.469650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.469786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.469814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.524 qpair failed and we were unable to recover it. 00:28:03.524 [2024-11-28 19:16:24.469911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.470049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.470073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.524 qpair failed and we were unable to recover it. 00:28:03.524 [2024-11-28 19:16:24.470154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.470289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.470316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.524 qpair failed and we were unable to recover it. 00:28:03.524 [2024-11-28 19:16:24.470476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.470563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.470592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.524 qpair failed and we were unable to recover it. 00:28:03.524 [2024-11-28 19:16:24.470709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.470825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.470851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.524 qpair failed and we were unable to recover it. 00:28:03.524 [2024-11-28 19:16:24.471011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.471132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.471161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.524 qpair failed and we were unable to recover it. 00:28:03.524 [2024-11-28 19:16:24.471303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.471434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.471460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.524 qpair failed and we were unable to recover it. 00:28:03.524 [2024-11-28 19:16:24.471581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.471689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.471715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.524 qpair failed and we were unable to recover it. 00:28:03.524 [2024-11-28 19:16:24.471837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.471976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.472001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.524 qpair failed and we were unable to recover it. 00:28:03.524 [2024-11-28 19:16:24.472113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.472199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.472223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.524 qpair failed and we were unable to recover it. 00:28:03.524 [2024-11-28 19:16:24.472349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.472433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.472458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.524 qpair failed and we were unable to recover it. 00:28:03.524 [2024-11-28 19:16:24.472585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.472721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.472747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.524 qpair failed and we were unable to recover it. 00:28:03.524 [2024-11-28 19:16:24.472898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.473032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.473057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.524 qpair failed and we were unable to recover it. 00:28:03.524 [2024-11-28 19:16:24.473144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.473285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.473310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.524 qpair failed and we were unable to recover it. 00:28:03.524 [2024-11-28 19:16:24.473424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.473539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.473567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.524 qpair failed and we were unable to recover it. 00:28:03.524 [2024-11-28 19:16:24.473729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.473844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.524 [2024-11-28 19:16:24.473870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.524 qpair failed and we were unable to recover it. 00:28:03.525 [2024-11-28 19:16:24.474010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.525 [2024-11-28 19:16:24.474120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.525 [2024-11-28 19:16:24.474145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.525 qpair failed and we were unable to recover it. 00:28:03.525 [2024-11-28 19:16:24.474277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.525 [2024-11-28 19:16:24.474407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.525 [2024-11-28 19:16:24.474435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.525 qpair failed and we were unable to recover it. 00:28:03.525 [2024-11-28 19:16:24.474553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.525 [2024-11-28 19:16:24.474646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.525 [2024-11-28 19:16:24.474671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.525 qpair failed and we were unable to recover it. 00:28:03.525 [2024-11-28 19:16:24.474781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.525 [2024-11-28 19:16:24.474904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.525 [2024-11-28 19:16:24.474930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.525 qpair failed and we were unable to recover it. 00:28:03.525 [2024-11-28 19:16:24.475063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.525 [2024-11-28 19:16:24.475150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.525 [2024-11-28 19:16:24.475177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.525 qpair failed and we were unable to recover it. 00:28:03.525 [2024-11-28 19:16:24.475299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.525 [2024-11-28 19:16:24.475451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.525 [2024-11-28 19:16:24.475479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.525 qpair failed and we were unable to recover it. 00:28:03.525 [2024-11-28 19:16:24.475610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.525 [2024-11-28 19:16:24.475724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.525 [2024-11-28 19:16:24.475748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.525 qpair failed and we were unable to recover it. 00:28:03.525 [2024-11-28 19:16:24.475858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.525 [2024-11-28 19:16:24.475951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.525 [2024-11-28 19:16:24.475980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.525 qpair failed and we were unable to recover it. 00:28:03.525 [2024-11-28 19:16:24.476108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.525 [2024-11-28 19:16:24.476226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.525 [2024-11-28 19:16:24.476269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.525 qpair failed and we were unable to recover it. 00:28:03.525 [2024-11-28 19:16:24.476360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.525 [2024-11-28 19:16:24.476500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.525 [2024-11-28 19:16:24.476526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.525 qpair failed and we were unable to recover it. 00:28:03.525 [2024-11-28 19:16:24.476612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.525 [2024-11-28 19:16:24.476697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.525 [2024-11-28 19:16:24.476722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.525 qpair failed and we were unable to recover it. 00:28:03.525 [2024-11-28 19:16:24.476882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.525 [2024-11-28 19:16:24.477010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.525 [2024-11-28 19:16:24.477037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.525 qpair failed and we were unable to recover it. 00:28:03.525 [2024-11-28 19:16:24.477198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.525 [2024-11-28 19:16:24.477308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.525 [2024-11-28 19:16:24.477332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.525 qpair failed and we were unable to recover it. 00:28:03.525 [2024-11-28 19:16:24.477474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.525 [2024-11-28 19:16:24.477625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.525 [2024-11-28 19:16:24.477653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.525 qpair failed and we were unable to recover it. 00:28:03.525 [2024-11-28 19:16:24.477773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.525 [2024-11-28 19:16:24.477895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.525 [2024-11-28 19:16:24.477921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.525 qpair failed and we were unable to recover it. 00:28:03.525 [2024-11-28 19:16:24.478065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.525 [2024-11-28 19:16:24.478137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.525 [2024-11-28 19:16:24.478162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.525 qpair failed and we were unable to recover it. 00:28:03.526 [2024-11-28 19:16:24.478293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.478399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.478428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.526 qpair failed and we were unable to recover it. 00:28:03.526 [2024-11-28 19:16:24.478551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.478639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.478667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.526 qpair failed and we were unable to recover it. 00:28:03.526 [2024-11-28 19:16:24.478833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.478955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.478980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.526 qpair failed and we were unable to recover it. 00:28:03.526 [2024-11-28 19:16:24.479091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.479239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.479281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.526 qpair failed and we were unable to recover it. 00:28:03.526 [2024-11-28 19:16:24.479375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.479509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.479538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.526 qpair failed and we were unable to recover it. 00:28:03.526 [2024-11-28 19:16:24.479633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.479772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.479796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.526 qpair failed and we were unable to recover it. 00:28:03.526 [2024-11-28 19:16:24.479870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.479968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.479995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.526 qpair failed and we were unable to recover it. 00:28:03.526 [2024-11-28 19:16:24.480125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.480217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.480244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.526 qpair failed and we were unable to recover it. 00:28:03.526 [2024-11-28 19:16:24.480343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.480457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.480483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.526 qpair failed and we were unable to recover it. 00:28:03.526 [2024-11-28 19:16:24.480608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.480697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.480725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.526 qpair failed and we were unable to recover it. 00:28:03.526 [2024-11-28 19:16:24.480846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.480964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.480992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.526 qpair failed and we were unable to recover it. 00:28:03.526 [2024-11-28 19:16:24.481122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.481206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.481231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.526 qpair failed and we were unable to recover it. 00:28:03.526 [2024-11-28 19:16:24.481359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.481503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.481531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.526 qpair failed and we were unable to recover it. 00:28:03.526 [2024-11-28 19:16:24.481618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.481741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.481769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.526 qpair failed and we were unable to recover it. 00:28:03.526 [2024-11-28 19:16:24.481877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.482063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.482088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.526 qpair failed and we were unable to recover it. 00:28:03.526 [2024-11-28 19:16:24.482263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.482344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.482369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.526 qpair failed and we were unable to recover it. 00:28:03.526 [2024-11-28 19:16:24.482487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.482600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.482628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.526 qpair failed and we were unable to recover it. 00:28:03.526 [2024-11-28 19:16:24.482770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.482910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.482951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.526 qpair failed and we were unable to recover it. 00:28:03.526 [2024-11-28 19:16:24.483079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.483198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.483226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.526 qpair failed and we were unable to recover it. 00:28:03.526 [2024-11-28 19:16:24.483401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.483483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.483508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.526 qpair failed and we were unable to recover it. 00:28:03.526 [2024-11-28 19:16:24.483590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.483704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.483728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.526 qpair failed and we were unable to recover it. 00:28:03.526 [2024-11-28 19:16:24.483826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.483938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.483966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.526 qpair failed and we were unable to recover it. 00:28:03.526 [2024-11-28 19:16:24.484091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.484210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.484238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.526 qpair failed and we were unable to recover it. 00:28:03.526 [2024-11-28 19:16:24.484340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.484455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.484480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.526 qpair failed and we were unable to recover it. 00:28:03.526 [2024-11-28 19:16:24.484567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.484670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.484695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.526 qpair failed and we were unable to recover it. 00:28:03.526 [2024-11-28 19:16:24.484838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.484954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.484981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.526 qpair failed and we were unable to recover it. 00:28:03.526 [2024-11-28 19:16:24.485175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.485284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.485308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.526 qpair failed and we were unable to recover it. 00:28:03.526 [2024-11-28 19:16:24.485438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.485565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.485592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.526 qpair failed and we were unable to recover it. 00:28:03.526 [2024-11-28 19:16:24.485695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.485846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.485873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.526 qpair failed and we were unable to recover it. 00:28:03.526 [2024-11-28 19:16:24.485981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.486060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.486084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.526 qpair failed and we were unable to recover it. 00:28:03.526 [2024-11-28 19:16:24.486196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.486306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.486331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.526 qpair failed and we were unable to recover it. 00:28:03.526 [2024-11-28 19:16:24.486480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.486577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.486605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.526 qpair failed and we were unable to recover it. 00:28:03.526 [2024-11-28 19:16:24.486712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.526 [2024-11-28 19:16:24.486827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.486853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.527 qpair failed and we were unable to recover it. 00:28:03.527 [2024-11-28 19:16:24.487008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.487117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.487142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.527 qpair failed and we were unable to recover it. 00:28:03.527 [2024-11-28 19:16:24.487234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.487454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.487479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.527 qpair failed and we were unable to recover it. 00:28:03.527 [2024-11-28 19:16:24.487591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.487670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.487695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.527 qpair failed and we were unable to recover it. 00:28:03.527 [2024-11-28 19:16:24.487796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.487917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.487944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.527 qpair failed and we were unable to recover it. 00:28:03.527 [2024-11-28 19:16:24.488035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.488149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.488176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.527 qpair failed and we were unable to recover it. 00:28:03.527 [2024-11-28 19:16:24.488335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.488450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.488476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.527 qpair failed and we were unable to recover it. 00:28:03.527 [2024-11-28 19:16:24.488591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.488720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.488747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.527 qpair failed and we were unable to recover it. 00:28:03.527 [2024-11-28 19:16:24.488873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.488964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.488991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.527 qpair failed and we were unable to recover it. 00:28:03.527 [2024-11-28 19:16:24.489154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.489267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.489291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.527 qpair failed and we were unable to recover it. 00:28:03.527 [2024-11-28 19:16:24.489420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.489567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.489601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.527 qpair failed and we were unable to recover it. 00:28:03.527 [2024-11-28 19:16:24.489698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.489823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.489850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.527 qpair failed and we were unable to recover it. 00:28:03.527 [2024-11-28 19:16:24.489955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.490067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.490093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.527 qpair failed and we were unable to recover it. 00:28:03.527 [2024-11-28 19:16:24.490204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.490349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.490376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.527 qpair failed and we were unable to recover it. 00:28:03.527 [2024-11-28 19:16:24.490488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.490575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.490603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.527 qpair failed and we were unable to recover it. 00:28:03.527 [2024-11-28 19:16:24.490702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.490820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.490845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.527 qpair failed and we were unable to recover it. 00:28:03.527 [2024-11-28 19:16:24.490929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.491047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.491072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.527 qpair failed and we were unable to recover it. 00:28:03.527 [2024-11-28 19:16:24.491157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.491272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.491299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.527 qpair failed and we were unable to recover it. 00:28:03.527 [2024-11-28 19:16:24.491434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.491550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.491575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.527 qpair failed and we were unable to recover it. 00:28:03.527 [2024-11-28 19:16:24.491666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.491793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.491821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.527 qpair failed and we were unable to recover it. 00:28:03.527 [2024-11-28 19:16:24.491943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.492038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.492071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.527 qpair failed and we were unable to recover it. 00:28:03.527 [2024-11-28 19:16:24.492175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.492323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.492347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.527 qpair failed and we were unable to recover it. 00:28:03.527 [2024-11-28 19:16:24.492456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.492583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.492624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.527 qpair failed and we were unable to recover it. 00:28:03.527 [2024-11-28 19:16:24.492709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.492862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.492889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.527 qpair failed and we were unable to recover it. 00:28:03.527 [2024-11-28 19:16:24.492986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.493093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.527 [2024-11-28 19:16:24.493117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.527 qpair failed and we were unable to recover it. 00:28:03.527 [2024-11-28 19:16:24.493196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.843 [2024-11-28 19:16:24.493330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.843 [2024-11-28 19:16:24.493359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.843 qpair failed and we were unable to recover it. 00:28:03.843 [2024-11-28 19:16:24.493526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.843 [2024-11-28 19:16:24.493641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.843 [2024-11-28 19:16:24.493667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.843 qpair failed and we were unable to recover it. 00:28:03.843 [2024-11-28 19:16:24.493818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.843 [2024-11-28 19:16:24.493934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.843 [2024-11-28 19:16:24.493959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.844 qpair failed and we were unable to recover it. 00:28:03.844 [2024-11-28 19:16:24.494097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.494220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.494249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.844 qpair failed and we were unable to recover it. 00:28:03.844 [2024-11-28 19:16:24.494370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.494529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.494557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.844 qpair failed and we were unable to recover it. 00:28:03.844 [2024-11-28 19:16:24.494688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.494828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.494852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.844 qpair failed and we were unable to recover it. 00:28:03.844 [2024-11-28 19:16:24.494981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.495071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.495096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.844 qpair failed and we were unable to recover it. 00:28:03.844 [2024-11-28 19:16:24.495234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.495353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.495380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.844 qpair failed and we were unable to recover it. 00:28:03.844 [2024-11-28 19:16:24.495503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.495627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.495652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.844 qpair failed and we were unable to recover it. 00:28:03.844 [2024-11-28 19:16:24.495789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.495911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.495938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.844 qpair failed and we were unable to recover it. 00:28:03.844 [2024-11-28 19:16:24.496064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.496195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.496223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.844 qpair failed and we were unable to recover it. 00:28:03.844 [2024-11-28 19:16:24.496351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.496472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.496498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.844 qpair failed and we were unable to recover it. 00:28:03.844 [2024-11-28 19:16:24.496613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.496689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.496714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.844 qpair failed and we were unable to recover it. 00:28:03.844 [2024-11-28 19:16:24.496794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.496903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.496928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.844 qpair failed and we were unable to recover it. 00:28:03.844 [2024-11-28 19:16:24.497033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.497138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.497162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.844 qpair failed and we were unable to recover it. 00:28:03.844 [2024-11-28 19:16:24.497268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.497359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.497387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.844 qpair failed and we were unable to recover it. 00:28:03.844 [2024-11-28 19:16:24.497563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.497640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.497666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.844 qpair failed and we were unable to recover it. 00:28:03.844 [2024-11-28 19:16:24.497810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.497947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.497972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.844 qpair failed and we were unable to recover it. 00:28:03.844 [2024-11-28 19:16:24.498105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.498196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.498225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.844 qpair failed and we were unable to recover it. 00:28:03.844 [2024-11-28 19:16:24.498380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.498518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.498543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.844 qpair failed and we were unable to recover it. 00:28:03.844 [2024-11-28 19:16:24.498680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.498787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.498811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.844 qpair failed and we were unable to recover it. 00:28:03.844 [2024-11-28 19:16:24.498973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.499102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.499126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.844 qpair failed and we were unable to recover it. 00:28:03.844 [2024-11-28 19:16:24.499316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.499426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.499454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.844 qpair failed and we were unable to recover it. 00:28:03.844 [2024-11-28 19:16:24.499610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.844 [2024-11-28 19:16:24.499691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.499717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.845 qpair failed and we were unable to recover it. 00:28:03.845 [2024-11-28 19:16:24.499876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.499999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.500026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.845 qpair failed and we were unable to recover it. 00:28:03.845 [2024-11-28 19:16:24.500120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.500272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.500300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.845 qpair failed and we were unable to recover it. 00:28:03.845 [2024-11-28 19:16:24.500418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.500549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.500574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.845 qpair failed and we were unable to recover it. 00:28:03.845 [2024-11-28 19:16:24.500705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.500898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.500925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.845 qpair failed and we were unable to recover it. 00:28:03.845 [2024-11-28 19:16:24.501119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.501236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.501263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.845 qpair failed and we were unable to recover it. 00:28:03.845 [2024-11-28 19:16:24.501366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.501508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.501534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.845 qpair failed and we were unable to recover it. 00:28:03.845 [2024-11-28 19:16:24.501629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.501739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.501764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.845 qpair failed and we were unable to recover it. 00:28:03.845 [2024-11-28 19:16:24.501891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.501971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.501998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.845 qpair failed and we were unable to recover it. 00:28:03.845 [2024-11-28 19:16:24.502097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.502185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.502211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.845 qpair failed and we were unable to recover it. 00:28:03.845 [2024-11-28 19:16:24.502365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.502516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.502541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.845 qpair failed and we were unable to recover it. 00:28:03.845 [2024-11-28 19:16:24.502730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.502839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.502863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.845 qpair failed and we were unable to recover it. 00:28:03.845 [2024-11-28 19:16:24.502954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.503042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.503067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.845 qpair failed and we were unable to recover it. 00:28:03.845 [2024-11-28 19:16:24.503157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.503267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.503292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.845 qpair failed and we were unable to recover it. 00:28:03.845 [2024-11-28 19:16:24.503482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.503602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.503631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.845 qpair failed and we were unable to recover it. 00:28:03.845 [2024-11-28 19:16:24.503767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.503880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.503905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.845 qpair failed and we were unable to recover it. 00:28:03.845 [2024-11-28 19:16:24.504042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.504158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.504185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.845 qpair failed and we were unable to recover it. 00:28:03.845 [2024-11-28 19:16:24.504283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.504369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.504414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.845 qpair failed and we were unable to recover it. 00:28:03.845 [2024-11-28 19:16:24.504524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.504661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.504686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.845 qpair failed and we were unable to recover it. 00:28:03.845 [2024-11-28 19:16:24.504791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.504892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.504935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.845 qpair failed and we were unable to recover it. 00:28:03.845 [2024-11-28 19:16:24.505018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.505102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.505126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.845 qpair failed and we were unable to recover it. 00:28:03.845 [2024-11-28 19:16:24.505216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.845 [2024-11-28 19:16:24.505337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.505364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.846 qpair failed and we were unable to recover it. 00:28:03.846 [2024-11-28 19:16:24.505508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.505588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.505614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.846 qpair failed and we were unable to recover it. 00:28:03.846 [2024-11-28 19:16:24.505714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.505827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.505860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.846 qpair failed and we were unable to recover it. 00:28:03.846 [2024-11-28 19:16:24.505968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.506068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.506092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.846 qpair failed and we were unable to recover it. 00:28:03.846 [2024-11-28 19:16:24.506172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.506283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.506308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.846 qpair failed and we were unable to recover it. 00:28:03.846 [2024-11-28 19:16:24.506428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.506523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.506548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.846 qpair failed and we were unable to recover it. 00:28:03.846 [2024-11-28 19:16:24.506738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.506924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.506948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.846 qpair failed and we were unable to recover it. 00:28:03.846 [2024-11-28 19:16:24.507068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.507175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.507200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.846 qpair failed and we were unable to recover it. 00:28:03.846 [2024-11-28 19:16:24.507305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.507387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.507419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.846 qpair failed and we were unable to recover it. 00:28:03.846 [2024-11-28 19:16:24.507559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.507677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.507702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.846 qpair failed and we were unable to recover it. 00:28:03.846 [2024-11-28 19:16:24.507815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.507962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.507990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.846 qpair failed and we were unable to recover it. 00:28:03.846 [2024-11-28 19:16:24.508088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.508167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.508194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.846 qpair failed and we were unable to recover it. 00:28:03.846 [2024-11-28 19:16:24.508300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.508437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.508462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.846 qpair failed and we were unable to recover it. 00:28:03.846 [2024-11-28 19:16:24.508545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.508670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.508698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.846 qpair failed and we were unable to recover it. 00:28:03.846 [2024-11-28 19:16:24.508810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.508899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.508928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.846 qpair failed and we were unable to recover it. 00:28:03.846 [2024-11-28 19:16:24.509030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.509140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.509166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.846 qpair failed and we were unable to recover it. 00:28:03.846 [2024-11-28 19:16:24.509314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.509428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.509457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.846 qpair failed and we were unable to recover it. 00:28:03.846 [2024-11-28 19:16:24.509582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.509696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.509723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.846 qpair failed and we were unable to recover it. 00:28:03.846 [2024-11-28 19:16:24.509874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.510012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.510053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.846 qpair failed and we were unable to recover it. 00:28:03.846 [2024-11-28 19:16:24.510172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.510262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.510290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.846 qpair failed and we were unable to recover it. 00:28:03.846 [2024-11-28 19:16:24.510379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.510522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.510563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.846 qpair failed and we were unable to recover it. 00:28:03.846 [2024-11-28 19:16:24.510674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.846 [2024-11-28 19:16:24.510788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.510815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.847 qpair failed and we were unable to recover it. 00:28:03.847 [2024-11-28 19:16:24.510940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.511084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.511112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.847 qpair failed and we were unable to recover it. 00:28:03.847 [2024-11-28 19:16:24.511316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.511444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.511473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.847 qpair failed and we were unable to recover it. 00:28:03.847 [2024-11-28 19:16:24.511597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.511704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.511729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.847 qpair failed and we were unable to recover it. 00:28:03.847 [2024-11-28 19:16:24.511919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.512076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.512103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.847 qpair failed and we were unable to recover it. 00:28:03.847 [2024-11-28 19:16:24.512226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.512346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.512373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.847 qpair failed and we were unable to recover it. 00:28:03.847 [2024-11-28 19:16:24.512489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.512633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.512658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.847 qpair failed and we were unable to recover it. 00:28:03.847 [2024-11-28 19:16:24.512760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.512854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.512881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.847 qpair failed and we were unable to recover it. 00:28:03.847 [2024-11-28 19:16:24.512997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.513107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.513134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.847 qpair failed and we were unable to recover it. 00:28:03.847 [2024-11-28 19:16:24.513260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.513332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.513356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.847 qpair failed and we were unable to recover it. 00:28:03.847 [2024-11-28 19:16:24.513445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.513531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.513556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.847 qpair failed and we were unable to recover it. 00:28:03.847 [2024-11-28 19:16:24.513639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.513713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.513738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.847 qpair failed and we were unable to recover it. 00:28:03.847 [2024-11-28 19:16:24.513872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.514014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.514044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.847 qpair failed and we were unable to recover it. 00:28:03.847 [2024-11-28 19:16:24.514197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.514326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.514351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.847 qpair failed and we were unable to recover it. 00:28:03.847 [2024-11-28 19:16:24.514445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.514581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.514625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.847 qpair failed and we were unable to recover it. 00:28:03.847 [2024-11-28 19:16:24.514709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.514819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.514844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.847 qpair failed and we were unable to recover it. 00:28:03.847 [2024-11-28 19:16:24.514959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.515066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.515090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.847 qpair failed and we were unable to recover it. 00:28:03.847 [2024-11-28 19:16:24.515203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.515285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.515310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.847 qpair failed and we were unable to recover it. 00:28:03.847 [2024-11-28 19:16:24.515391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.515476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.515501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.847 qpair failed and we were unable to recover it. 00:28:03.847 [2024-11-28 19:16:24.515619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.515706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.515731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.847 qpair failed and we were unable to recover it. 00:28:03.847 [2024-11-28 19:16:24.515824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.515903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.515928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.847 qpair failed and we were unable to recover it. 00:28:03.847 [2024-11-28 19:16:24.516038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.516144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.516169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.847 qpair failed and we were unable to recover it. 00:28:03.847 [2024-11-28 19:16:24.516254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.516447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.847 [2024-11-28 19:16:24.516473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.847 qpair failed and we were unable to recover it. 00:28:03.848 [2024-11-28 19:16:24.516610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.516700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.516725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.848 qpair failed and we were unable to recover it. 00:28:03.848 [2024-11-28 19:16:24.516822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.516947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.516974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.848 qpair failed and we were unable to recover it. 00:28:03.848 [2024-11-28 19:16:24.517105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.517202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.517229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.848 qpair failed and we were unable to recover it. 00:28:03.848 [2024-11-28 19:16:24.517323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.517415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.517457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.848 qpair failed and we were unable to recover it. 00:28:03.848 [2024-11-28 19:16:24.517575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.517659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.517685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.848 qpair failed and we were unable to recover it. 00:28:03.848 [2024-11-28 19:16:24.517821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.517970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.517997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.848 qpair failed and we were unable to recover it. 00:28:03.848 [2024-11-28 19:16:24.518124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.518244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.518272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.848 qpair failed and we were unable to recover it. 00:28:03.848 [2024-11-28 19:16:24.518406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.518595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.518620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.848 qpair failed and we were unable to recover it. 00:28:03.848 [2024-11-28 19:16:24.518784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.518907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.518935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.848 qpair failed and we were unable to recover it. 00:28:03.848 [2024-11-28 19:16:24.519067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.519187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.519219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.848 qpair failed and we were unable to recover it. 00:28:03.848 [2024-11-28 19:16:24.519315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.519426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.519452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.848 qpair failed and we were unable to recover it. 00:28:03.848 [2024-11-28 19:16:24.519569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.519653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.519677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.848 qpair failed and we were unable to recover it. 00:28:03.848 [2024-11-28 19:16:24.519763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.519886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.519913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.848 qpair failed and we were unable to recover it. 00:28:03.848 [2024-11-28 19:16:24.520016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.520122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.520151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.848 qpair failed and we were unable to recover it. 00:28:03.848 [2024-11-28 19:16:24.520305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.520390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.520438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.848 qpair failed and we were unable to recover it. 00:28:03.848 [2024-11-28 19:16:24.520512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.520626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.520651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.848 qpair failed and we were unable to recover it. 00:28:03.848 [2024-11-28 19:16:24.520775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.520895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.520922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.848 qpair failed and we were unable to recover it. 00:28:03.848 [2024-11-28 19:16:24.521012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.521103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.521130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.848 qpair failed and we were unable to recover it. 00:28:03.848 [2024-11-28 19:16:24.521230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.521350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.521377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.848 qpair failed and we were unable to recover it. 00:28:03.848 [2024-11-28 19:16:24.521528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.521610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.521639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.848 qpair failed and we were unable to recover it. 00:28:03.848 [2024-11-28 19:16:24.521713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.521801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.521825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.848 qpair failed and we were unable to recover it. 00:28:03.848 [2024-11-28 19:16:24.521966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.522049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.848 [2024-11-28 19:16:24.522077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.848 qpair failed and we were unable to recover it. 00:28:03.849 [2024-11-28 19:16:24.522245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.522415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.522458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.849 qpair failed and we were unable to recover it. 00:28:03.849 [2024-11-28 19:16:24.522546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.522631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.522656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.849 qpair failed and we were unable to recover it. 00:28:03.849 [2024-11-28 19:16:24.522732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.522826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.522853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.849 qpair failed and we were unable to recover it. 00:28:03.849 [2024-11-28 19:16:24.522973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.523089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.523116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.849 qpair failed and we were unable to recover it. 00:28:03.849 [2024-11-28 19:16:24.523198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.523330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.523354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.849 qpair failed and we were unable to recover it. 00:28:03.849 [2024-11-28 19:16:24.523444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.523522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.523547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.849 qpair failed and we were unable to recover it. 00:28:03.849 [2024-11-28 19:16:24.523656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.523726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.523768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.849 qpair failed and we were unable to recover it. 00:28:03.849 [2024-11-28 19:16:24.523848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.523971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.523998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.849 qpair failed and we were unable to recover it. 00:28:03.849 [2024-11-28 19:16:24.524127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.524244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.524272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.849 qpair failed and we were unable to recover it. 00:28:03.849 [2024-11-28 19:16:24.524406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.524507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.524533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.849 qpair failed and we were unable to recover it. 00:28:03.849 [2024-11-28 19:16:24.524627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.524721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.524749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.849 qpair failed and we were unable to recover it. 00:28:03.849 [2024-11-28 19:16:24.524879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.525029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.525056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.849 qpair failed and we were unable to recover it. 00:28:03.849 [2024-11-28 19:16:24.525248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.525368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.525402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.849 qpair failed and we were unable to recover it. 00:28:03.849 [2024-11-28 19:16:24.525504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.525607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.525632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.849 qpair failed and we were unable to recover it. 00:28:03.849 [2024-11-28 19:16:24.525721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.525841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.525869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.849 qpair failed and we were unable to recover it. 00:28:03.849 [2024-11-28 19:16:24.526017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.526113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.526140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.849 qpair failed and we were unable to recover it. 00:28:03.849 [2024-11-28 19:16:24.526234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.526355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.526382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.849 qpair failed and we were unable to recover it. 00:28:03.849 [2024-11-28 19:16:24.526525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.526640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.526664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.849 qpair failed and we were unable to recover it. 00:28:03.849 [2024-11-28 19:16:24.526786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.526864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.849 [2024-11-28 19:16:24.526888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.850 qpair failed and we were unable to recover it. 00:28:03.850 [2024-11-28 19:16:24.526962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.527058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.527085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.850 qpair failed and we were unable to recover it. 00:28:03.850 [2024-11-28 19:16:24.527206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.527295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.527323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.850 qpair failed and we were unable to recover it. 00:28:03.850 [2024-11-28 19:16:24.527455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.527561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.527586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.850 qpair failed and we were unable to recover it. 00:28:03.850 [2024-11-28 19:16:24.527676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.527757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.527782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.850 qpair failed and we were unable to recover it. 00:28:03.850 [2024-11-28 19:16:24.527871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.527997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.528025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.850 qpair failed and we were unable to recover it. 00:28:03.850 [2024-11-28 19:16:24.528129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.528243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.528267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.850 qpair failed and we were unable to recover it. 00:28:03.850 [2024-11-28 19:16:24.528386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.528491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.528519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.850 qpair failed and we were unable to recover it. 00:28:03.850 [2024-11-28 19:16:24.528607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.528699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.528726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.850 qpair failed and we were unable to recover it. 00:28:03.850 [2024-11-28 19:16:24.528854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.528959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.528983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.850 qpair failed and we were unable to recover it. 00:28:03.850 [2024-11-28 19:16:24.529114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.529236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.529263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.850 qpair failed and we were unable to recover it. 00:28:03.850 [2024-11-28 19:16:24.529353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.529495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.529521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.850 qpair failed and we were unable to recover it. 00:28:03.850 [2024-11-28 19:16:24.529597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.529783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.529807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.850 qpair failed and we were unable to recover it. 00:28:03.850 [2024-11-28 19:16:24.529943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.530065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.530092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.850 qpair failed and we were unable to recover it. 00:28:03.850 [2024-11-28 19:16:24.530176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.530264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.530291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.850 qpair failed and we were unable to recover it. 00:28:03.850 [2024-11-28 19:16:24.530438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.530545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.530570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.850 qpair failed and we were unable to recover it. 00:28:03.850 [2024-11-28 19:16:24.530675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.530813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.530852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.850 qpair failed and we were unable to recover it. 00:28:03.850 [2024-11-28 19:16:24.530928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.531070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.531094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.850 qpair failed and we were unable to recover it. 00:28:03.850 [2024-11-28 19:16:24.531179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.531255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.531279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.850 qpair failed and we were unable to recover it. 00:28:03.850 [2024-11-28 19:16:24.531352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.531465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.531491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.850 qpair failed and we were unable to recover it. 00:28:03.850 [2024-11-28 19:16:24.531604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.531681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.850 [2024-11-28 19:16:24.531706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.851 qpair failed and we were unable to recover it. 00:28:03.851 [2024-11-28 19:16:24.531897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.532050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.532077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.851 qpair failed and we were unable to recover it. 00:28:03.851 [2024-11-28 19:16:24.532171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.532295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.532322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.851 qpair failed and we were unable to recover it. 00:28:03.851 [2024-11-28 19:16:24.532423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.532551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.532576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.851 qpair failed and we were unable to recover it. 00:28:03.851 [2024-11-28 19:16:24.532694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.532773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.532797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.851 qpair failed and we were unable to recover it. 00:28:03.851 [2024-11-28 19:16:24.532907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.533013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.533040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.851 qpair failed and we were unable to recover it. 00:28:03.851 [2024-11-28 19:16:24.533189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.533308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.533335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.851 qpair failed and we were unable to recover it. 00:28:03.851 [2024-11-28 19:16:24.533435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.533549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.533574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.851 qpair failed and we were unable to recover it. 00:28:03.851 [2024-11-28 19:16:24.533708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.533835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.533862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.851 qpair failed and we were unable to recover it. 00:28:03.851 [2024-11-28 19:16:24.533950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.534072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.534099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.851 qpair failed and we were unable to recover it. 00:28:03.851 [2024-11-28 19:16:24.534203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.534312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.534341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.851 qpair failed and we were unable to recover it. 00:28:03.851 [2024-11-28 19:16:24.534452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.534533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.534561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.851 qpair failed and we were unable to recover it. 00:28:03.851 [2024-11-28 19:16:24.534709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.534806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.534833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.851 qpair failed and we were unable to recover it. 00:28:03.851 [2024-11-28 19:16:24.535026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.535099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.535124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.851 qpair failed and we were unable to recover it. 00:28:03.851 [2024-11-28 19:16:24.535254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.535373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.535407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.851 qpair failed and we were unable to recover it. 00:28:03.851 [2024-11-28 19:16:24.535531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.535611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.535653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.851 qpair failed and we were unable to recover it. 00:28:03.851 [2024-11-28 19:16:24.535794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.535907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.535931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.851 qpair failed and we were unable to recover it. 00:28:03.851 [2024-11-28 19:16:24.536026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.536120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.536149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.851 qpair failed and we were unable to recover it. 00:28:03.851 [2024-11-28 19:16:24.536297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.536403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.536432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.851 qpair failed and we were unable to recover it. 00:28:03.851 [2024-11-28 19:16:24.536532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.536645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.536669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.851 qpair failed and we were unable to recover it. 00:28:03.851 [2024-11-28 19:16:24.536750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.536821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.536846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.851 qpair failed and we were unable to recover it. 00:28:03.851 [2024-11-28 19:16:24.536933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.537017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.537042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.851 qpair failed and we were unable to recover it. 00:28:03.851 [2024-11-28 19:16:24.537187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.537297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.851 [2024-11-28 19:16:24.537322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.852 qpair failed and we were unable to recover it. 00:28:03.852 [2024-11-28 19:16:24.537444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.537532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.537557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.852 qpair failed and we were unable to recover it. 00:28:03.852 [2024-11-28 19:16:24.537638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.537817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.537842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.852 qpair failed and we were unable to recover it. 00:28:03.852 [2024-11-28 19:16:24.537953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.538062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.538086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.852 qpair failed and we were unable to recover it. 00:28:03.852 [2024-11-28 19:16:24.538216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.538302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.538330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.852 qpair failed and we were unable to recover it. 00:28:03.852 [2024-11-28 19:16:24.538420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.538535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.538563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.852 qpair failed and we were unable to recover it. 00:28:03.852 [2024-11-28 19:16:24.538693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.538802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.538826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.852 qpair failed and we were unable to recover it. 00:28:03.852 [2024-11-28 19:16:24.538901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.539050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.539077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.852 qpair failed and we were unable to recover it. 00:28:03.852 [2024-11-28 19:16:24.539160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.539284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.539311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.852 qpair failed and we were unable to recover it. 00:28:03.852 [2024-11-28 19:16:24.539423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.539499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.539524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.852 qpair failed and we were unable to recover it. 00:28:03.852 [2024-11-28 19:16:24.539622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.539826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.539853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.852 qpair failed and we were unable to recover it. 00:28:03.852 [2024-11-28 19:16:24.539972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.540092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.540120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.852 qpair failed and we were unable to recover it. 00:28:03.852 [2024-11-28 19:16:24.540262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.540374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.540404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.852 qpair failed and we were unable to recover it. 00:28:03.852 [2024-11-28 19:16:24.540493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.540580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.540623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.852 qpair failed and we were unable to recover it. 00:28:03.852 [2024-11-28 19:16:24.540744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.540897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.540925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.852 qpair failed and we were unable to recover it. 00:28:03.852 [2024-11-28 19:16:24.541053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.541164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.541189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.852 qpair failed and we were unable to recover it. 00:28:03.852 [2024-11-28 19:16:24.541324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.541485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.541511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.852 qpair failed and we were unable to recover it. 00:28:03.852 [2024-11-28 19:16:24.541593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.541712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.541740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.852 qpair failed and we were unable to recover it. 00:28:03.852 [2024-11-28 19:16:24.541878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.541988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.542013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.852 qpair failed and we were unable to recover it. 00:28:03.852 [2024-11-28 19:16:24.542147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.542235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.542263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.852 qpair failed and we were unable to recover it. 00:28:03.852 [2024-11-28 19:16:24.542390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.542548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.542573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.852 qpair failed and we were unable to recover it. 00:28:03.852 [2024-11-28 19:16:24.542685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.542770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.542796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.852 qpair failed and we were unable to recover it. 00:28:03.852 [2024-11-28 19:16:24.542878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.542961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.852 [2024-11-28 19:16:24.542986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.852 qpair failed and we were unable to recover it. 00:28:03.853 [2024-11-28 19:16:24.543083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.543173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.543215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.853 qpair failed and we were unable to recover it. 00:28:03.853 [2024-11-28 19:16:24.543351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.543474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.543500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.853 qpair failed and we were unable to recover it. 00:28:03.853 [2024-11-28 19:16:24.543637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.543755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.543784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.853 qpair failed and we were unable to recover it. 00:28:03.853 [2024-11-28 19:16:24.543912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.544032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.544061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.853 qpair failed and we were unable to recover it. 00:28:03.853 [2024-11-28 19:16:24.544216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.544325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.544350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.853 qpair failed and we were unable to recover it. 00:28:03.853 [2024-11-28 19:16:24.544439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.544626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.544651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.853 qpair failed and we were unable to recover it. 00:28:03.853 [2024-11-28 19:16:24.544762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.544918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.544945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.853 qpair failed and we were unable to recover it. 00:28:03.853 [2024-11-28 19:16:24.545039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.545121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.545163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.853 qpair failed and we were unable to recover it. 00:28:03.853 [2024-11-28 19:16:24.545283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.545410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.545452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.853 qpair failed and we were unable to recover it. 00:28:03.853 [2024-11-28 19:16:24.545539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.545615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.545640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.853 qpair failed and we were unable to recover it. 00:28:03.853 [2024-11-28 19:16:24.545819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.545933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.545957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.853 qpair failed and we were unable to recover it. 00:28:03.853 [2024-11-28 19:16:24.546065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.546179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.546206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.853 qpair failed and we were unable to recover it. 00:28:03.853 [2024-11-28 19:16:24.546304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.546420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.546449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.853 qpair failed and we were unable to recover it. 00:28:03.853 [2024-11-28 19:16:24.546585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.546724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.546748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.853 qpair failed and we were unable to recover it. 00:28:03.853 [2024-11-28 19:16:24.546847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.546992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.547019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.853 qpair failed and we were unable to recover it. 00:28:03.853 [2024-11-28 19:16:24.547171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.547291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.547318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.853 qpair failed and we were unable to recover it. 00:28:03.853 [2024-11-28 19:16:24.547460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.547576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.547605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.853 qpair failed and we were unable to recover it. 00:28:03.853 [2024-11-28 19:16:24.547723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.547809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.547836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.853 qpair failed and we were unable to recover it. 00:28:03.853 [2024-11-28 19:16:24.547984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.548116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.548140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.853 qpair failed and we were unable to recover it. 00:28:03.853 [2024-11-28 19:16:24.548244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.548320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.548344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.853 qpair failed and we were unable to recover it. 00:28:03.853 [2024-11-28 19:16:24.548424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.548534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.548561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.853 qpair failed and we were unable to recover it. 00:28:03.853 [2024-11-28 19:16:24.548641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.548728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.548755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.853 qpair failed and we were unable to recover it. 00:28:03.853 [2024-11-28 19:16:24.548887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.853 [2024-11-28 19:16:24.548964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.548990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.854 qpair failed and we were unable to recover it. 00:28:03.854 [2024-11-28 19:16:24.549179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.549284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.549309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.854 qpair failed and we were unable to recover it. 00:28:03.854 [2024-11-28 19:16:24.549443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.549533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.549560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.854 qpair failed and we were unable to recover it. 00:28:03.854 [2024-11-28 19:16:24.549662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.549762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.549787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.854 qpair failed and we were unable to recover it. 00:28:03.854 [2024-11-28 19:16:24.549920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.550040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.550067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.854 qpair failed and we were unable to recover it. 00:28:03.854 [2024-11-28 19:16:24.550162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.550275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.550302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.854 qpair failed and we were unable to recover it. 00:28:03.854 [2024-11-28 19:16:24.550439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.550554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.550579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.854 qpair failed and we were unable to recover it. 00:28:03.854 [2024-11-28 19:16:24.550653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.550758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.550783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.854 qpair failed and we were unable to recover it. 00:28:03.854 [2024-11-28 19:16:24.550870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.550978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.551007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.854 qpair failed and we were unable to recover it. 00:28:03.854 [2024-11-28 19:16:24.551145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.551261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.551286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.854 qpair failed and we were unable to recover it. 00:28:03.854 [2024-11-28 19:16:24.551385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.551539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.551567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.854 qpair failed and we were unable to recover it. 00:28:03.854 [2024-11-28 19:16:24.551662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.551757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.551784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.854 qpair failed and we were unable to recover it. 00:28:03.854 [2024-11-28 19:16:24.551882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.552030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.552054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.854 qpair failed and we were unable to recover it. 00:28:03.854 [2024-11-28 19:16:24.552187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.552354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.552378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.854 qpair failed and we were unable to recover it. 00:28:03.854 [2024-11-28 19:16:24.552490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.552594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.552622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.854 qpair failed and we were unable to recover it. 00:28:03.854 [2024-11-28 19:16:24.552725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.552815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.552841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.854 qpair failed and we were unable to recover it. 00:28:03.854 [2024-11-28 19:16:24.552953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.553031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.553055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.854 qpair failed and we were unable to recover it. 00:28:03.854 [2024-11-28 19:16:24.553153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.553273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.553300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.854 qpair failed and we were unable to recover it. 00:28:03.854 [2024-11-28 19:16:24.553437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.553554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.553580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.854 qpair failed and we were unable to recover it. 00:28:03.854 [2024-11-28 19:16:24.553683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.553770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.553798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.854 qpair failed and we were unable to recover it. 00:28:03.854 [2024-11-28 19:16:24.553932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.554045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.554072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.854 qpair failed and we were unable to recover it. 00:28:03.854 [2024-11-28 19:16:24.554203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.554316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.854 [2024-11-28 19:16:24.554340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.854 qpair failed and we were unable to recover it. 00:28:03.855 [2024-11-28 19:16:24.554510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.554665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.554689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.855 qpair failed and we were unable to recover it. 00:28:03.855 [2024-11-28 19:16:24.554821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.554934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.554961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.855 qpair failed and we were unable to recover it. 00:28:03.855 [2024-11-28 19:16:24.555092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.555233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.555257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.855 qpair failed and we were unable to recover it. 00:28:03.855 [2024-11-28 19:16:24.555471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.555545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.555570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.855 qpair failed and we were unable to recover it. 00:28:03.855 [2024-11-28 19:16:24.555649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.555781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.555809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.855 qpair failed and we were unable to recover it. 00:28:03.855 [2024-11-28 19:16:24.555939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.556018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.556044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.855 qpair failed and we were unable to recover it. 00:28:03.855 [2024-11-28 19:16:24.556138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.556232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.556260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.855 qpair failed and we were unable to recover it. 00:28:03.855 [2024-11-28 19:16:24.556351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.556471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.556499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.855 qpair failed and we were unable to recover it. 00:28:03.855 [2024-11-28 19:16:24.556641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.556752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.556776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.855 qpair failed and we were unable to recover it. 00:28:03.855 [2024-11-28 19:16:24.556914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.557030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.557058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.855 qpair failed and we were unable to recover it. 00:28:03.855 [2024-11-28 19:16:24.557177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.557273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.557300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.855 qpair failed and we were unable to recover it. 00:28:03.855 [2024-11-28 19:16:24.557399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.557478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.557502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.855 qpair failed and we were unable to recover it. 00:28:03.855 [2024-11-28 19:16:24.557595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.557732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.557761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.855 qpair failed and we were unable to recover it. 00:28:03.855 [2024-11-28 19:16:24.557885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.558005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.558032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.855 qpair failed and we were unable to recover it. 00:28:03.855 [2024-11-28 19:16:24.558200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.558283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.558307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.855 qpair failed and we were unable to recover it. 00:28:03.855 [2024-11-28 19:16:24.558461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.558563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.558587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.855 qpair failed and we were unable to recover it. 00:28:03.855 [2024-11-28 19:16:24.558703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.558834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.558861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.855 qpair failed and we were unable to recover it. 00:28:03.855 [2024-11-28 19:16:24.559005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.559113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.559138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.855 qpair failed and we were unable to recover it. 00:28:03.855 [2024-11-28 19:16:24.559267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.559356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.559406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.855 qpair failed and we were unable to recover it. 00:28:03.855 [2024-11-28 19:16:24.559520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.559601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.855 [2024-11-28 19:16:24.559627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.855 qpair failed and we were unable to recover it. 00:28:03.855 [2024-11-28 19:16:24.559745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.559932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.559957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.856 qpair failed and we were unable to recover it. 00:28:03.856 [2024-11-28 19:16:24.560097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.560223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.560250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.856 qpair failed and we were unable to recover it. 00:28:03.856 [2024-11-28 19:16:24.560347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.560485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.560510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.856 qpair failed and we were unable to recover it. 00:28:03.856 [2024-11-28 19:16:24.560593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.560676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.560705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.856 qpair failed and we were unable to recover it. 00:28:03.856 [2024-11-28 19:16:24.560798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.560898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.560941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.856 qpair failed and we were unable to recover it. 00:28:03.856 [2024-11-28 19:16:24.561033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.561115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.561141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.856 qpair failed and we were unable to recover it. 00:28:03.856 [2024-11-28 19:16:24.561270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.561386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.561433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.856 qpair failed and we were unable to recover it. 00:28:03.856 [2024-11-28 19:16:24.561539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.561653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.561678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.856 qpair failed and we were unable to recover it. 00:28:03.856 [2024-11-28 19:16:24.561780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.561873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.561900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.856 qpair failed and we were unable to recover it. 00:28:03.856 [2024-11-28 19:16:24.562002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.562119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.562144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.856 qpair failed and we were unable to recover it. 00:28:03.856 [2024-11-28 19:16:24.562282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.562365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.562391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.856 qpair failed and we were unable to recover it. 00:28:03.856 [2024-11-28 19:16:24.562487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.562597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.562621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.856 qpair failed and we were unable to recover it. 00:28:03.856 [2024-11-28 19:16:24.562737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.562842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.562867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.856 qpair failed and we were unable to recover it. 00:28:03.856 [2024-11-28 19:16:24.563055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.563190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.563218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.856 qpair failed and we were unable to recover it. 00:28:03.856 [2024-11-28 19:16:24.563325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.563413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.563441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.856 qpair failed and we were unable to recover it. 00:28:03.856 [2024-11-28 19:16:24.563547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.563628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.563652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.856 qpair failed and we were unable to recover it. 00:28:03.856 [2024-11-28 19:16:24.563727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.563848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.563889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.856 qpair failed and we were unable to recover it. 00:28:03.856 [2024-11-28 19:16:24.563975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.564052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.564078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.856 qpair failed and we were unable to recover it. 00:28:03.856 [2024-11-28 19:16:24.564161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.564268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.564293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.856 qpair failed and we were unable to recover it. 00:28:03.856 [2024-11-28 19:16:24.564408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.564538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.856 [2024-11-28 19:16:24.564567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.857 qpair failed and we were unable to recover it. 00:28:03.857 [2024-11-28 19:16:24.564695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.564828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.564856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.857 qpair failed and we were unable to recover it. 00:28:03.857 [2024-11-28 19:16:24.565011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.565197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.565222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.857 qpair failed and we were unable to recover it. 00:28:03.857 [2024-11-28 19:16:24.565358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.565481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.565509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.857 qpair failed and we were unable to recover it. 00:28:03.857 [2024-11-28 19:16:24.565597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.565688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.565715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.857 qpair failed and we were unable to recover it. 00:28:03.857 [2024-11-28 19:16:24.565854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.565938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.565964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.857 qpair failed and we were unable to recover it. 00:28:03.857 [2024-11-28 19:16:24.566092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.566175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.566203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.857 qpair failed and we were unable to recover it. 00:28:03.857 [2024-11-28 19:16:24.566325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.566440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.566469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.857 qpair failed and we were unable to recover it. 00:28:03.857 [2024-11-28 19:16:24.566564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.566642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.566666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.857 qpair failed and we were unable to recover it. 00:28:03.857 [2024-11-28 19:16:24.566751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.566884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.566911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.857 qpair failed and we were unable to recover it. 00:28:03.857 [2024-11-28 19:16:24.567010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.567086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.567111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.857 qpair failed and we were unable to recover it. 00:28:03.857 [2024-11-28 19:16:24.567229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.567306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.567331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.857 qpair failed and we were unable to recover it. 00:28:03.857 [2024-11-28 19:16:24.567447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.567576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.567603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.857 qpair failed and we were unable to recover it. 00:28:03.857 [2024-11-28 19:16:24.567687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.567771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.567799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.857 qpair failed and we were unable to recover it. 00:28:03.857 [2024-11-28 19:16:24.567957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.568028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.568052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.857 qpair failed and we were unable to recover it. 00:28:03.857 [2024-11-28 19:16:24.568171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.568335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.568362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.857 qpair failed and we were unable to recover it. 00:28:03.857 [2024-11-28 19:16:24.568498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.568706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.568757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.857 qpair failed and we were unable to recover it. 00:28:03.857 [2024-11-28 19:16:24.568867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.568976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.569001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.857 qpair failed and we were unable to recover it. 00:28:03.857 [2024-11-28 19:16:24.569160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.569282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.569323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.857 qpair failed and we were unable to recover it. 00:28:03.857 [2024-11-28 19:16:24.569463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.569567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.569595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.857 qpair failed and we were unable to recover it. 00:28:03.857 [2024-11-28 19:16:24.569727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.569837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.569862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.857 qpair failed and we were unable to recover it. 00:28:03.857 [2024-11-28 19:16:24.569964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.570113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.857 [2024-11-28 19:16:24.570153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.857 qpair failed and we were unable to recover it. 00:28:03.857 [2024-11-28 19:16:24.570250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.570380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.570413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.858 qpair failed and we were unable to recover it. 00:28:03.858 [2024-11-28 19:16:24.570569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.570683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.570707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.858 qpair failed and we were unable to recover it. 00:28:03.858 [2024-11-28 19:16:24.570786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.570893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.570918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.858 qpair failed and we were unable to recover it. 00:28:03.858 [2024-11-28 19:16:24.571001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.571111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.571136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.858 qpair failed and we were unable to recover it. 00:28:03.858 [2024-11-28 19:16:24.571249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.571341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.571366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.858 qpair failed and we were unable to recover it. 00:28:03.858 [2024-11-28 19:16:24.571491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.571568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.571593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.858 qpair failed and we were unable to recover it. 00:28:03.858 [2024-11-28 19:16:24.571709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.571805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.571833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.858 qpair failed and we were unable to recover it. 00:28:03.858 [2024-11-28 19:16:24.571971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.572048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.572073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.858 qpair failed and we were unable to recover it. 00:28:03.858 [2024-11-28 19:16:24.572200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.572283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.572310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.858 qpair failed and we were unable to recover it. 00:28:03.858 [2024-11-28 19:16:24.572404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.572555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.572583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.858 qpair failed and we were unable to recover it. 00:28:03.858 [2024-11-28 19:16:24.572747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.572860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.572884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.858 qpair failed and we were unable to recover it. 00:28:03.858 [2024-11-28 19:16:24.573011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.573090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.573117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.858 qpair failed and we were unable to recover it. 00:28:03.858 [2024-11-28 19:16:24.573206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.573296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.573323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.858 qpair failed and we were unable to recover it. 00:28:03.858 [2024-11-28 19:16:24.573427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.573532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.573562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.858 qpair failed and we were unable to recover it. 00:28:03.858 [2024-11-28 19:16:24.573654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.573801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.573829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.858 qpair failed and we were unable to recover it. 00:28:03.858 [2024-11-28 19:16:24.573924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.574012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.574040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.858 qpair failed and we were unable to recover it. 00:28:03.858 [2024-11-28 19:16:24.574196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.574302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.574327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.858 qpair failed and we were unable to recover it. 00:28:03.858 [2024-11-28 19:16:24.574457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.574558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.574586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.858 qpair failed and we were unable to recover it. 00:28:03.858 [2024-11-28 19:16:24.574678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.574794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.574822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.858 qpair failed and we were unable to recover it. 00:28:03.858 [2024-11-28 19:16:24.574924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.575111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.575135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.858 qpair failed and we were unable to recover it. 00:28:03.858 [2024-11-28 19:16:24.575278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.575400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.575428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.858 qpair failed and we were unable to recover it. 00:28:03.858 [2024-11-28 19:16:24.575575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.575688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.858 [2024-11-28 19:16:24.575716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.858 qpair failed and we were unable to recover it. 00:28:03.858 [2024-11-28 19:16:24.575819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.575891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.575915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.859 qpair failed and we were unable to recover it. 00:28:03.859 [2024-11-28 19:16:24.576022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.576157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.576189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.859 qpair failed and we were unable to recover it. 00:28:03.859 [2024-11-28 19:16:24.576284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.576406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.576435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.859 qpair failed and we were unable to recover it. 00:28:03.859 [2024-11-28 19:16:24.576574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.576664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.576689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.859 qpair failed and we were unable to recover it. 00:28:03.859 [2024-11-28 19:16:24.576777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.576854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.576880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.859 qpair failed and we were unable to recover it. 00:28:03.859 [2024-11-28 19:16:24.577007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.577136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.577161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.859 qpair failed and we were unable to recover it. 00:28:03.859 [2024-11-28 19:16:24.577269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.577375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.577406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.859 qpair failed and we were unable to recover it. 00:28:03.859 [2024-11-28 19:16:24.577538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.577631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.577658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.859 qpair failed and we were unable to recover it. 00:28:03.859 [2024-11-28 19:16:24.577777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.577907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.577934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.859 qpair failed and we were unable to recover it. 00:28:03.859 [2024-11-28 19:16:24.578038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.578149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.578174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.859 qpair failed and we were unable to recover it. 00:28:03.859 [2024-11-28 19:16:24.578305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.578450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.578477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.859 qpair failed and we were unable to recover it. 00:28:03.859 [2024-11-28 19:16:24.578585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.578657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.578682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.859 qpair failed and we were unable to recover it. 00:28:03.859 [2024-11-28 19:16:24.578802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.578942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.578967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.859 qpair failed and we were unable to recover it. 00:28:03.859 [2024-11-28 19:16:24.579072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.579184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.579211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.859 qpair failed and we were unable to recover it. 00:28:03.859 [2024-11-28 19:16:24.579330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.579450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.579478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.859 qpair failed and we were unable to recover it. 00:28:03.859 [2024-11-28 19:16:24.579641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.579721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.579746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.859 qpair failed and we were unable to recover it. 00:28:03.859 [2024-11-28 19:16:24.579820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.579928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.579952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.859 qpair failed and we were unable to recover it. 00:28:03.859 [2024-11-28 19:16:24.580082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.580201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.580228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.859 qpair failed and we were unable to recover it. 00:28:03.859 [2024-11-28 19:16:24.580422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.580577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.580602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.859 qpair failed and we were unable to recover it. 00:28:03.859 [2024-11-28 19:16:24.580731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.580818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.580847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.859 qpair failed and we were unable to recover it. 00:28:03.859 [2024-11-28 19:16:24.580965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.581047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.581074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.859 qpair failed and we were unable to recover it. 00:28:03.859 [2024-11-28 19:16:24.581169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.581286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.859 [2024-11-28 19:16:24.581311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.859 qpair failed and we were unable to recover it. 00:28:03.860 [2024-11-28 19:16:24.581427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.581614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.581639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.860 qpair failed and we were unable to recover it. 00:28:03.860 [2024-11-28 19:16:24.581804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.581883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.581911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.860 qpair failed and we were unable to recover it. 00:28:03.860 [2024-11-28 19:16:24.582016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.582127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.582153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.860 qpair failed and we were unable to recover it. 00:28:03.860 [2024-11-28 19:16:24.582228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.582433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.582462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.860 qpair failed and we were unable to recover it. 00:28:03.860 [2024-11-28 19:16:24.582599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.582724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.582751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.860 qpair failed and we were unable to recover it. 00:28:03.860 [2024-11-28 19:16:24.582844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.582960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.582984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.860 qpair failed and we were unable to recover it. 00:28:03.860 [2024-11-28 19:16:24.583123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.583252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.583279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.860 qpair failed and we were unable to recover it. 00:28:03.860 [2024-11-28 19:16:24.583401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.583514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.583542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.860 qpair failed and we were unable to recover it. 00:28:03.860 [2024-11-28 19:16:24.583671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.583784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.583810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.860 qpair failed and we were unable to recover it. 00:28:03.860 [2024-11-28 19:16:24.583937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.584051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.584078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.860 qpair failed and we were unable to recover it. 00:28:03.860 [2024-11-28 19:16:24.584214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.584300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.584325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.860 qpair failed and we were unable to recover it. 00:28:03.860 [2024-11-28 19:16:24.584410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.584493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.584518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.860 qpair failed and we were unable to recover it. 00:28:03.860 [2024-11-28 19:16:24.584614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.584698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.584723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.860 qpair failed and we were unable to recover it. 00:28:03.860 [2024-11-28 19:16:24.584801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.584873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.584897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.860 qpair failed and we were unable to recover it. 00:28:03.860 [2024-11-28 19:16:24.585003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.585141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.585166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.860 qpair failed and we were unable to recover it. 00:28:03.860 [2024-11-28 19:16:24.585248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.585376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.585409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.860 qpair failed and we were unable to recover it. 00:28:03.860 [2024-11-28 19:16:24.585534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.585652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.585680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.860 qpair failed and we were unable to recover it. 00:28:03.860 [2024-11-28 19:16:24.585853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.586042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.586070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.860 qpair failed and we were unable to recover it. 00:28:03.860 [2024-11-28 19:16:24.586189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.586309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.586338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.860 qpair failed and we were unable to recover it. 00:28:03.860 [2024-11-28 19:16:24.586492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.586618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.586646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.860 qpair failed and we were unable to recover it. 00:28:03.860 [2024-11-28 19:16:24.586787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.586873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.860 [2024-11-28 19:16:24.586899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.860 qpair failed and we were unable to recover it. 00:28:03.860 [2024-11-28 19:16:24.587011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.587150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.587178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.861 qpair failed and we were unable to recover it. 00:28:03.861 [2024-11-28 19:16:24.587296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.587413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.587454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.861 qpair failed and we were unable to recover it. 00:28:03.861 [2024-11-28 19:16:24.587538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.587663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.587688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.861 qpair failed and we were unable to recover it. 00:28:03.861 [2024-11-28 19:16:24.587806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.587884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.587912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.861 qpair failed and we were unable to recover it. 00:28:03.861 [2024-11-28 19:16:24.588002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.588086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.588114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.861 qpair failed and we were unable to recover it. 00:28:03.861 [2024-11-28 19:16:24.588270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.588384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.588413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.861 qpair failed and we were unable to recover it. 00:28:03.861 [2024-11-28 19:16:24.588547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.588676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.588703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.861 qpair failed and we were unable to recover it. 00:28:03.861 [2024-11-28 19:16:24.588795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.588882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.588925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.861 qpair failed and we were unable to recover it. 00:28:03.861 [2024-11-28 19:16:24.589042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.589180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.589205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.861 qpair failed and we were unable to recover it. 00:28:03.861 [2024-11-28 19:16:24.589328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.589409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.589444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.861 qpair failed and we were unable to recover it. 00:28:03.861 [2024-11-28 19:16:24.589568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.589660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.589687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.861 qpair failed and we were unable to recover it. 00:28:03.861 [2024-11-28 19:16:24.589828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.589942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.589967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.861 qpair failed and we were unable to recover it. 00:28:03.861 [2024-11-28 19:16:24.590074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.590163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.590190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.861 qpair failed and we were unable to recover it. 00:28:03.861 [2024-11-28 19:16:24.590305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.590418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.590461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.861 qpair failed and we were unable to recover it. 00:28:03.861 [2024-11-28 19:16:24.590570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.590646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.590671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.861 qpair failed and we were unable to recover it. 00:28:03.861 [2024-11-28 19:16:24.590796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.590964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.590989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.861 qpair failed and we were unable to recover it. 00:28:03.861 [2024-11-28 19:16:24.591078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.591199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.591224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.861 qpair failed and we were unable to recover it. 00:28:03.861 [2024-11-28 19:16:24.591337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.591426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.591452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.861 qpair failed and we were unable to recover it. 00:28:03.861 [2024-11-28 19:16:24.591577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.591710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.591734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.861 qpair failed and we were unable to recover it. 00:28:03.861 [2024-11-28 19:16:24.591858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.591973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.592015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.861 qpair failed and we were unable to recover it. 00:28:03.861 [2024-11-28 19:16:24.592128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.592280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.592305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.861 qpair failed and we were unable to recover it. 00:28:03.861 [2024-11-28 19:16:24.592465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.592549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.592578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.861 qpair failed and we were unable to recover it. 00:28:03.861 [2024-11-28 19:16:24.592685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.861 [2024-11-28 19:16:24.592794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.862 [2024-11-28 19:16:24.592822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.862 qpair failed and we were unable to recover it. 00:28:03.862 [2024-11-28 19:16:24.592931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.862 [2024-11-28 19:16:24.593034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.862 [2024-11-28 19:16:24.593059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.862 qpair failed and we were unable to recover it. 00:28:03.862 [2024-11-28 19:16:24.593193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.862 [2024-11-28 19:16:24.593286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.862 [2024-11-28 19:16:24.593315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.862 qpair failed and we were unable to recover it. 00:28:03.862 [2024-11-28 19:16:24.593415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.862 [2024-11-28 19:16:24.593564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.862 [2024-11-28 19:16:24.593591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.862 qpair failed and we were unable to recover it. 00:28:03.862 [2024-11-28 19:16:24.593714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.862 [2024-11-28 19:16:24.593820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.862 [2024-11-28 19:16:24.593844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.862 qpair failed and we were unable to recover it. 00:28:03.862 [2024-11-28 19:16:24.593975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.862 [2024-11-28 19:16:24.594071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.862 [2024-11-28 19:16:24.594099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.862 qpair failed and we were unable to recover it. 00:28:03.862 [2024-11-28 19:16:24.594214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.862 [2024-11-28 19:16:24.594296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.594323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.863 qpair failed and we were unable to recover it. 00:28:03.863 [2024-11-28 19:16:24.594434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.594529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.594553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.863 qpair failed and we were unable to recover it. 00:28:03.863 [2024-11-28 19:16:24.594641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.594720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.594745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.863 qpair failed and we were unable to recover it. 00:28:03.863 [2024-11-28 19:16:24.594883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.595026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.595053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.863 qpair failed and we were unable to recover it. 00:28:03.863 [2024-11-28 19:16:24.595187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.595263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.595287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.863 qpair failed and we were unable to recover it. 00:28:03.863 [2024-11-28 19:16:24.595404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.595531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.595559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.863 qpair failed and we were unable to recover it. 00:28:03.863 [2024-11-28 19:16:24.595699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.595885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.595910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.863 qpair failed and we were unable to recover it. 00:28:03.863 [2024-11-28 19:16:24.596050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.596164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.596188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.863 qpair failed and we were unable to recover it. 00:28:03.863 [2024-11-28 19:16:24.596302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.596412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.596452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.863 qpair failed and we were unable to recover it. 00:28:03.863 [2024-11-28 19:16:24.596576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.596691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.596719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.863 qpair failed and we were unable to recover it. 00:28:03.863 [2024-11-28 19:16:24.596820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.596966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.596990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.863 qpair failed and we were unable to recover it. 00:28:03.863 [2024-11-28 19:16:24.597095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.597221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.597248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.863 qpair failed and we were unable to recover it. 00:28:03.863 [2024-11-28 19:16:24.597349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.597553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.597581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.863 qpair failed and we were unable to recover it. 00:28:03.863 [2024-11-28 19:16:24.597687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.597764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.597789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.863 qpair failed and we were unable to recover it. 00:28:03.863 [2024-11-28 19:16:24.597947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.598071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.598098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.863 qpair failed and we were unable to recover it. 00:28:03.863 [2024-11-28 19:16:24.598220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.598331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.598358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.863 qpair failed and we were unable to recover it. 00:28:03.863 [2024-11-28 19:16:24.598487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.598623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.598648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.863 qpair failed and we were unable to recover it. 00:28:03.863 [2024-11-28 19:16:24.598811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.598927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.598955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.863 qpair failed and we were unable to recover it. 00:28:03.863 [2024-11-28 19:16:24.599050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.599170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.599197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.863 qpair failed and we were unable to recover it. 00:28:03.863 [2024-11-28 19:16:24.599356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.599454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.599479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.863 qpair failed and we were unable to recover it. 00:28:03.863 [2024-11-28 19:16:24.599572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.599687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.599716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.863 qpair failed and we were unable to recover it. 00:28:03.863 [2024-11-28 19:16:24.599805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.599921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.599962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.863 qpair failed and we were unable to recover it. 00:28:03.863 [2024-11-28 19:16:24.600086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.863 [2024-11-28 19:16:24.600212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.600239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.864 qpair failed and we were unable to recover it. 00:28:03.864 [2024-11-28 19:16:24.600354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.600489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.600514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.864 qpair failed and we were unable to recover it. 00:28:03.864 [2024-11-28 19:16:24.600606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.600754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.600794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.864 qpair failed and we were unable to recover it. 00:28:03.864 [2024-11-28 19:16:24.600909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.601052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.601077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.864 qpair failed and we were unable to recover it. 00:28:03.864 [2024-11-28 19:16:24.601231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.601339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.601364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.864 qpair failed and we were unable to recover it. 00:28:03.864 [2024-11-28 19:16:24.601479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.601665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.601689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.864 qpair failed and we were unable to recover it. 00:28:03.864 [2024-11-28 19:16:24.601876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.601979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.602004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.864 qpair failed and we were unable to recover it. 00:28:03.864 [2024-11-28 19:16:24.602168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.602296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.602325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.864 qpair failed and we were unable to recover it. 00:28:03.864 [2024-11-28 19:16:24.602477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.602567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.602594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.864 qpair failed and we were unable to recover it. 00:28:03.864 [2024-11-28 19:16:24.602731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.602801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.602825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.864 qpair failed and we were unable to recover it. 00:28:03.864 [2024-11-28 19:16:24.602957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.603053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.603085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.864 qpair failed and we were unable to recover it. 00:28:03.864 [2024-11-28 19:16:24.603248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.603319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.603343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.864 qpair failed and we were unable to recover it. 00:28:03.864 [2024-11-28 19:16:24.603426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.603539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.603564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.864 qpair failed and we were unable to recover it. 00:28:03.864 [2024-11-28 19:16:24.603701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.603826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.603868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.864 qpair failed and we were unable to recover it. 00:28:03.864 [2024-11-28 19:16:24.604010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.604087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.604113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.864 qpair failed and we were unable to recover it. 00:28:03.864 [2024-11-28 19:16:24.604208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.604291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.604316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.864 qpair failed and we were unable to recover it. 00:28:03.864 [2024-11-28 19:16:24.604412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.604504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.604529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.864 qpair failed and we were unable to recover it. 00:28:03.864 [2024-11-28 19:16:24.604637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.604753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.604780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.864 qpair failed and we were unable to recover it. 00:28:03.864 [2024-11-28 19:16:24.604873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.604962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.604987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.864 qpair failed and we were unable to recover it. 00:28:03.864 [2024-11-28 19:16:24.605072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.605185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.605210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.864 qpair failed and we were unable to recover it. 00:28:03.864 [2024-11-28 19:16:24.605292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.605367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.605397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.864 qpair failed and we were unable to recover it. 00:28:03.864 [2024-11-28 19:16:24.605488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.605569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.605593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.864 qpair failed and we were unable to recover it. 00:28:03.864 [2024-11-28 19:16:24.605710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.605791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.864 [2024-11-28 19:16:24.605816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.865 qpair failed and we were unable to recover it. 00:28:03.865 [2024-11-28 19:16:24.605920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.606023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.606048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.865 qpair failed and we were unable to recover it. 00:28:03.865 [2024-11-28 19:16:24.606134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.606241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.606266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.865 qpair failed and we were unable to recover it. 00:28:03.865 [2024-11-28 19:16:24.606371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.606512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.606537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.865 qpair failed and we were unable to recover it. 00:28:03.865 [2024-11-28 19:16:24.606724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.606810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.606835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.865 qpair failed and we were unable to recover it. 00:28:03.865 [2024-11-28 19:16:24.606929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.607039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.607064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.865 qpair failed and we were unable to recover it. 00:28:03.865 [2024-11-28 19:16:24.607184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.607281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.607308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.865 qpair failed and we were unable to recover it. 00:28:03.865 [2024-11-28 19:16:24.607421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.607504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.607529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.865 qpair failed and we were unable to recover it. 00:28:03.865 [2024-11-28 19:16:24.607644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.607734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.607758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.865 qpair failed and we were unable to recover it. 00:28:03.865 [2024-11-28 19:16:24.607850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.607964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.607989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.865 qpair failed and we were unable to recover it. 00:28:03.865 [2024-11-28 19:16:24.608098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.608251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.608275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.865 qpair failed and we were unable to recover it. 00:28:03.865 [2024-11-28 19:16:24.608361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.608451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.608476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.865 qpair failed and we were unable to recover it. 00:28:03.865 [2024-11-28 19:16:24.608585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.608702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.608743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.865 qpair failed and we were unable to recover it. 00:28:03.865 [2024-11-28 19:16:24.608827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.608922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.608946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.865 qpair failed and we were unable to recover it. 00:28:03.865 [2024-11-28 19:16:24.609030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.609114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.609140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.865 qpair failed and we were unable to recover it. 00:28:03.865 [2024-11-28 19:16:24.609329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.609446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.609471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.865 qpair failed and we were unable to recover it. 00:28:03.865 [2024-11-28 19:16:24.609582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.609664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.609689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.865 qpair failed and we were unable to recover it. 00:28:03.865 [2024-11-28 19:16:24.609801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.609916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.609941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.865 qpair failed and we were unable to recover it. 00:28:03.865 [2024-11-28 19:16:24.610065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.610173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.610197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.865 qpair failed and we were unable to recover it. 00:28:03.865 [2024-11-28 19:16:24.610317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.610479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.610506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.865 qpair failed and we were unable to recover it. 00:28:03.865 [2024-11-28 19:16:24.610618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.610697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.610721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.865 qpair failed and we were unable to recover it. 00:28:03.865 [2024-11-28 19:16:24.610813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.610933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.610957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.865 qpair failed and we were unable to recover it. 00:28:03.865 [2024-11-28 19:16:24.611059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.865 [2024-11-28 19:16:24.611202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.611230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.866 qpair failed and we were unable to recover it. 00:28:03.866 [2024-11-28 19:16:24.611359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.611462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.611488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.866 qpair failed and we were unable to recover it. 00:28:03.866 [2024-11-28 19:16:24.611579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.611663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.611687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.866 qpair failed and we were unable to recover it. 00:28:03.866 [2024-11-28 19:16:24.611805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.611879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.611903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.866 qpair failed and we were unable to recover it. 00:28:03.866 [2024-11-28 19:16:24.612019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.612102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.612128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.866 qpair failed and we were unable to recover it. 00:28:03.866 [2024-11-28 19:16:24.612255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.612338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.612363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.866 qpair failed and we were unable to recover it. 00:28:03.866 [2024-11-28 19:16:24.612487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.612573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.612598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.866 qpair failed and we were unable to recover it. 00:28:03.866 [2024-11-28 19:16:24.612722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.612836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.612861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.866 qpair failed and we were unable to recover it. 00:28:03.866 [2024-11-28 19:16:24.612986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.613096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.613121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.866 qpair failed and we were unable to recover it. 00:28:03.866 [2024-11-28 19:16:24.613261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.613407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.613433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.866 qpair failed and we were unable to recover it. 00:28:03.866 [2024-11-28 19:16:24.613517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.613606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.613630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.866 qpair failed and we were unable to recover it. 00:28:03.866 [2024-11-28 19:16:24.613718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.613835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.613860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.866 qpair failed and we were unable to recover it. 00:28:03.866 [2024-11-28 19:16:24.614025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.614159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.614184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.866 qpair failed and we were unable to recover it. 00:28:03.866 [2024-11-28 19:16:24.614271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.614352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.614377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.866 qpair failed and we were unable to recover it. 00:28:03.866 [2024-11-28 19:16:24.614472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.614554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.614579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.866 qpair failed and we were unable to recover it. 00:28:03.866 [2024-11-28 19:16:24.614686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.614844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.614871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.866 qpair failed and we were unable to recover it. 00:28:03.866 [2024-11-28 19:16:24.615012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.615104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.615129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.866 qpair failed and we were unable to recover it. 00:28:03.866 [2024-11-28 19:16:24.615239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.615340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.615387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.866 qpair failed and we were unable to recover it. 00:28:03.866 [2024-11-28 19:16:24.615486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.615600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.615625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.866 qpair failed and we were unable to recover it. 00:28:03.866 [2024-11-28 19:16:24.615738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.615845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.615869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.866 qpair failed and we were unable to recover it. 00:28:03.866 [2024-11-28 19:16:24.615952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.616069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.616093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.866 qpair failed and we were unable to recover it. 00:28:03.866 [2024-11-28 19:16:24.616205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.616316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.616340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.866 qpair failed and we were unable to recover it. 00:28:03.866 [2024-11-28 19:16:24.616439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.616515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.866 [2024-11-28 19:16:24.616539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.866 qpair failed and we were unable to recover it. 00:28:03.867 [2024-11-28 19:16:24.616632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.616761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.616787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.867 qpair failed and we were unable to recover it. 00:28:03.867 [2024-11-28 19:16:24.616896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.617005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.617029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.867 qpair failed and we were unable to recover it. 00:28:03.867 [2024-11-28 19:16:24.617109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.617191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.617215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.867 qpair failed and we were unable to recover it. 00:28:03.867 [2024-11-28 19:16:24.617305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.617420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.617446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.867 qpair failed and we were unable to recover it. 00:28:03.867 [2024-11-28 19:16:24.617551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.617711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.617743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.867 qpair failed and we were unable to recover it. 00:28:03.867 [2024-11-28 19:16:24.617885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.618000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.618024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.867 qpair failed and we were unable to recover it. 00:28:03.867 [2024-11-28 19:16:24.618099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.618219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.618243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.867 qpair failed and we were unable to recover it. 00:28:03.867 [2024-11-28 19:16:24.618360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.618492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.618521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.867 qpair failed and we were unable to recover it. 00:28:03.867 [2024-11-28 19:16:24.618632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.618744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.618769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.867 qpair failed and we were unable to recover it. 00:28:03.867 [2024-11-28 19:16:24.618857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.618965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.618989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.867 qpair failed and we were unable to recover it. 00:28:03.867 [2024-11-28 19:16:24.619105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.619210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.619235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.867 qpair failed and we were unable to recover it. 00:28:03.867 [2024-11-28 19:16:24.619330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.619465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.619491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.867 qpair failed and we were unable to recover it. 00:28:03.867 [2024-11-28 19:16:24.619570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.619682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.619707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.867 qpair failed and we were unable to recover it. 00:28:03.867 [2024-11-28 19:16:24.619783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.619859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.619884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.867 qpair failed and we were unable to recover it. 00:28:03.867 [2024-11-28 19:16:24.619964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.620047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.620073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.867 qpair failed and we were unable to recover it. 00:28:03.867 [2024-11-28 19:16:24.620165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.620271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.620295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.867 qpair failed and we were unable to recover it. 00:28:03.867 [2024-11-28 19:16:24.620377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.620526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.620551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.867 qpair failed and we were unable to recover it. 00:28:03.867 [2024-11-28 19:16:24.620662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.620752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.620776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.867 qpair failed and we were unable to recover it. 00:28:03.867 [2024-11-28 19:16:24.620857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.620939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.620965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.867 qpair failed and we were unable to recover it. 00:28:03.867 [2024-11-28 19:16:24.621048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.621155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.621197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.867 qpair failed and we were unable to recover it. 00:28:03.867 [2024-11-28 19:16:24.621316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.621472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.621498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.867 qpair failed and we were unable to recover it. 00:28:03.867 [2024-11-28 19:16:24.621578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.621659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.867 [2024-11-28 19:16:24.621684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.868 qpair failed and we were unable to recover it. 00:28:03.868 [2024-11-28 19:16:24.621796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.621891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.621916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.868 qpair failed and we were unable to recover it. 00:28:03.868 [2024-11-28 19:16:24.622001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.622112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.622137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.868 qpair failed and we were unable to recover it. 00:28:03.868 [2024-11-28 19:16:24.622225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.622331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.622359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.868 qpair failed and we were unable to recover it. 00:28:03.868 [2024-11-28 19:16:24.622506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.622616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.622641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.868 qpair failed and we were unable to recover it. 00:28:03.868 [2024-11-28 19:16:24.622727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.622810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.622835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.868 qpair failed and we were unable to recover it. 00:28:03.868 [2024-11-28 19:16:24.622943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.623019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.623044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.868 qpair failed and we were unable to recover it. 00:28:03.868 [2024-11-28 19:16:24.623154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.623248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.623273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.868 qpair failed and we were unable to recover it. 00:28:03.868 [2024-11-28 19:16:24.623385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.623479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.623505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.868 qpair failed and we were unable to recover it. 00:28:03.868 [2024-11-28 19:16:24.623588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.623702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.623727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.868 qpair failed and we were unable to recover it. 00:28:03.868 [2024-11-28 19:16:24.623808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.623897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.623922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.868 qpair failed and we were unable to recover it. 00:28:03.868 [2024-11-28 19:16:24.624001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.624080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.624105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.868 qpair failed and we were unable to recover it. 00:28:03.868 [2024-11-28 19:16:24.624220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.624297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.624322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.868 qpair failed and we were unable to recover it. 00:28:03.868 [2024-11-28 19:16:24.624403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.624488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.624512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.868 qpair failed and we were unable to recover it. 00:28:03.868 [2024-11-28 19:16:24.624596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.624712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.624737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.868 qpair failed and we were unable to recover it. 00:28:03.868 [2024-11-28 19:16:24.624834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.624923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.624952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.868 qpair failed and we were unable to recover it. 00:28:03.868 [2024-11-28 19:16:24.625077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.625163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.625188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.868 qpair failed and we were unable to recover it. 00:28:03.868 [2024-11-28 19:16:24.625318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.625449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.625474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.868 qpair failed and we were unable to recover it. 00:28:03.868 [2024-11-28 19:16:24.625587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.625683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.625707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.868 qpair failed and we were unable to recover it. 00:28:03.868 [2024-11-28 19:16:24.625834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.625972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.868 [2024-11-28 19:16:24.625996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.869 qpair failed and we were unable to recover it. 00:28:03.869 [2024-11-28 19:16:24.626082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.626167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.626192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.869 qpair failed and we were unable to recover it. 00:28:03.869 [2024-11-28 19:16:24.626273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.626387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.626454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.869 qpair failed and we were unable to recover it. 00:28:03.869 [2024-11-28 19:16:24.626554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.626711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.626736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.869 qpair failed and we were unable to recover it. 00:28:03.869 [2024-11-28 19:16:24.626842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.626938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.626962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.869 qpair failed and we were unable to recover it. 00:28:03.869 [2024-11-28 19:16:24.627036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.627123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.627148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.869 qpair failed and we were unable to recover it. 00:28:03.869 [2024-11-28 19:16:24.627263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.627403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.627429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.869 qpair failed and we were unable to recover it. 00:28:03.869 [2024-11-28 19:16:24.627516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.627602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.627627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.869 qpair failed and we were unable to recover it. 00:28:03.869 [2024-11-28 19:16:24.627707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.627815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.627840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.869 qpair failed and we were unable to recover it. 00:28:03.869 [2024-11-28 19:16:24.627954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.628064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.628089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.869 qpair failed and we were unable to recover it. 00:28:03.869 [2024-11-28 19:16:24.628195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.628288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.628315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.869 qpair failed and we were unable to recover it. 00:28:03.869 [2024-11-28 19:16:24.628409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.628518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.628544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.869 qpair failed and we were unable to recover it. 00:28:03.869 [2024-11-28 19:16:24.628666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.628768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.628812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.869 qpair failed and we were unable to recover it. 00:28:03.869 [2024-11-28 19:16:24.628891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.628978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.629004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.869 qpair failed and we were unable to recover it. 00:28:03.869 [2024-11-28 19:16:24.629108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.629216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.629241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.869 qpair failed and we were unable to recover it. 00:28:03.869 [2024-11-28 19:16:24.629324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.629437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.629471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.869 qpair failed and we were unable to recover it. 00:28:03.869 [2024-11-28 19:16:24.629612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.629728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.629752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.869 qpair failed and we were unable to recover it. 00:28:03.869 [2024-11-28 19:16:24.629877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.630015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.630040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.869 qpair failed and we were unable to recover it. 00:28:03.869 [2024-11-28 19:16:24.630127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.630209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.630234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.869 qpair failed and we were unable to recover it. 00:28:03.869 [2024-11-28 19:16:24.630324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.630462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.630488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.869 qpair failed and we were unable to recover it. 00:28:03.869 [2024-11-28 19:16:24.630625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.630724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.630749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.869 qpair failed and we were unable to recover it. 00:28:03.869 [2024-11-28 19:16:24.630869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.630991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.631018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.869 qpair failed and we were unable to recover it. 00:28:03.869 [2024-11-28 19:16:24.631102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.631240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.869 [2024-11-28 19:16:24.631265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.870 qpair failed and we were unable to recover it. 00:28:03.870 [2024-11-28 19:16:24.631353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.631463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.631488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.870 qpair failed and we were unable to recover it. 00:28:03.870 [2024-11-28 19:16:24.631602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.631691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.631715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.870 qpair failed and we were unable to recover it. 00:28:03.870 [2024-11-28 19:16:24.631798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.631910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.631934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.870 qpair failed and we were unable to recover it. 00:28:03.870 [2024-11-28 19:16:24.632051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.632160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.632185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.870 qpair failed and we were unable to recover it. 00:28:03.870 [2024-11-28 19:16:24.632296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.632379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.632409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.870 qpair failed and we were unable to recover it. 00:28:03.870 [2024-11-28 19:16:24.632491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.632578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.632603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.870 qpair failed and we were unable to recover it. 00:28:03.870 [2024-11-28 19:16:24.632713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.632791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.632815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.870 qpair failed and we were unable to recover it. 00:28:03.870 [2024-11-28 19:16:24.632924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.633046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.633073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.870 qpair failed and we were unable to recover it. 00:28:03.870 [2024-11-28 19:16:24.633190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.633280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.633322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.870 qpair failed and we were unable to recover it. 00:28:03.870 [2024-11-28 19:16:24.633416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.633492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.633517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.870 qpair failed and we were unable to recover it. 00:28:03.870 [2024-11-28 19:16:24.633607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.633686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.633711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.870 qpair failed and we were unable to recover it. 00:28:03.870 [2024-11-28 19:16:24.633820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.633929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.633953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.870 qpair failed and we were unable to recover it. 00:28:03.870 [2024-11-28 19:16:24.634058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.634156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.634184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.870 qpair failed and we were unable to recover it. 00:28:03.870 [2024-11-28 19:16:24.634295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.634370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.634415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.870 qpair failed and we were unable to recover it. 00:28:03.870 [2024-11-28 19:16:24.634511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.634591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.634616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.870 qpair failed and we were unable to recover it. 00:28:03.870 [2024-11-28 19:16:24.634713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.634800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.634824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.870 qpair failed and we were unable to recover it. 00:28:03.870 [2024-11-28 19:16:24.634910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.635005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.635030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.870 qpair failed and we were unable to recover it. 00:28:03.870 [2024-11-28 19:16:24.635115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.635226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.635251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.870 qpair failed and we were unable to recover it. 00:28:03.870 [2024-11-28 19:16:24.635363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.635445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.635470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.870 qpair failed and we were unable to recover it. 00:28:03.870 [2024-11-28 19:16:24.635558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.635636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.635661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.870 qpair failed and we were unable to recover it. 00:28:03.870 [2024-11-28 19:16:24.635805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.635889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.635913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.870 qpair failed and we were unable to recover it. 00:28:03.870 [2024-11-28 19:16:24.636015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.636121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.870 [2024-11-28 19:16:24.636146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.870 qpair failed and we were unable to recover it. 00:28:03.870 [2024-11-28 19:16:24.636225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.636346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.636371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.871 qpair failed and we were unable to recover it. 00:28:03.871 [2024-11-28 19:16:24.636493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.636577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.636601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.871 qpair failed and we were unable to recover it. 00:28:03.871 [2024-11-28 19:16:24.636718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.636794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.636819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.871 qpair failed and we were unable to recover it. 00:28:03.871 [2024-11-28 19:16:24.636934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.637050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.637076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.871 qpair failed and we were unable to recover it. 00:28:03.871 [2024-11-28 19:16:24.637204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.637286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.637311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.871 qpair failed and we were unable to recover it. 00:28:03.871 [2024-11-28 19:16:24.637391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.637479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.637503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.871 qpair failed and we were unable to recover it. 00:28:03.871 [2024-11-28 19:16:24.637586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.637696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.637721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.871 qpair failed and we were unable to recover it. 00:28:03.871 [2024-11-28 19:16:24.637809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.637945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.637969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.871 qpair failed and we were unable to recover it. 00:28:03.871 [2024-11-28 19:16:24.638082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.638241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.638268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.871 qpair failed and we were unable to recover it. 00:28:03.871 [2024-11-28 19:16:24.638431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.638542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.638568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.871 qpair failed and we were unable to recover it. 00:28:03.871 [2024-11-28 19:16:24.638655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.638768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.638793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.871 qpair failed and we were unable to recover it. 00:28:03.871 [2024-11-28 19:16:24.638874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.638988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.639013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.871 qpair failed and we were unable to recover it. 00:28:03.871 [2024-11-28 19:16:24.639129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.639235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.639262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.871 qpair failed and we were unable to recover it. 00:28:03.871 [2024-11-28 19:16:24.639414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.639521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.639546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.871 qpair failed and we were unable to recover it. 00:28:03.871 [2024-11-28 19:16:24.639618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.639725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.639750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.871 qpair failed and we were unable to recover it. 00:28:03.871 [2024-11-28 19:16:24.639864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.639938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.639979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.871 qpair failed and we were unable to recover it. 00:28:03.871 [2024-11-28 19:16:24.640120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.640230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.640256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.871 qpair failed and we were unable to recover it. 00:28:03.871 [2024-11-28 19:16:24.640408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.640504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.640531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.871 qpair failed and we were unable to recover it. 00:28:03.871 [2024-11-28 19:16:24.640632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.640761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.640785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.871 qpair failed and we were unable to recover it. 00:28:03.871 [2024-11-28 19:16:24.640869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.640977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.641001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.871 qpair failed and we were unable to recover it. 00:28:03.871 [2024-11-28 19:16:24.641104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.641184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.641212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.871 qpair failed and we were unable to recover it. 00:28:03.871 [2024-11-28 19:16:24.641315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.641403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.641433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.871 qpair failed and we were unable to recover it. 00:28:03.871 [2024-11-28 19:16:24.641543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.641650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.641674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.871 qpair failed and we were unable to recover it. 00:28:03.871 [2024-11-28 19:16:24.641762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.641840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.641865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.871 qpair failed and we were unable to recover it. 00:28:03.871 [2024-11-28 19:16:24.641978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.642070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.642094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.871 qpair failed and we were unable to recover it. 00:28:03.871 [2024-11-28 19:16:24.642228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.871 [2024-11-28 19:16:24.642379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.642445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.872 qpair failed and we were unable to recover it. 00:28:03.872 [2024-11-28 19:16:24.642560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.642673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.642699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.872 qpair failed and we were unable to recover it. 00:28:03.872 [2024-11-28 19:16:24.642823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.642933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.642958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.872 qpair failed and we were unable to recover it. 00:28:03.872 [2024-11-28 19:16:24.643075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.643194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.643218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.872 qpair failed and we were unable to recover it. 00:28:03.872 [2024-11-28 19:16:24.643314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.643406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.643434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.872 qpair failed and we were unable to recover it. 00:28:03.872 [2024-11-28 19:16:24.643541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.643651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.643675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.872 qpair failed and we were unable to recover it. 00:28:03.872 [2024-11-28 19:16:24.643765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.643875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.643901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.872 qpair failed and we were unable to recover it. 00:28:03.872 [2024-11-28 19:16:24.644006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.644100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.644128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.872 qpair failed and we were unable to recover it. 00:28:03.872 [2024-11-28 19:16:24.644231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.644328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.644353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.872 qpair failed and we were unable to recover it. 00:28:03.872 [2024-11-28 19:16:24.644450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.644538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.644563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.872 qpair failed and we were unable to recover it. 00:28:03.872 [2024-11-28 19:16:24.644646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.644758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.644782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.872 qpair failed and we were unable to recover it. 00:28:03.872 [2024-11-28 19:16:24.644908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.644995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.645021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.872 qpair failed and we were unable to recover it. 00:28:03.872 [2024-11-28 19:16:24.645110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.645221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.645246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.872 qpair failed and we were unable to recover it. 00:28:03.872 [2024-11-28 19:16:24.645368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.645496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.645521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.872 qpair failed and we were unable to recover it. 00:28:03.872 [2024-11-28 19:16:24.645599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.645713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.645737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.872 qpair failed and we were unable to recover it. 00:28:03.872 [2024-11-28 19:16:24.645844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.645931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.645956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.872 qpair failed and we were unable to recover it. 00:28:03.872 [2024-11-28 19:16:24.646039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.646121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.646146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.872 qpair failed and we were unable to recover it. 00:28:03.872 [2024-11-28 19:16:24.646234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.646365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.646400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.872 qpair failed and we were unable to recover it. 00:28:03.872 [2024-11-28 19:16:24.646500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.646587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.646612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.872 qpair failed and we were unable to recover it. 00:28:03.872 [2024-11-28 19:16:24.646728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.646867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.646892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.872 qpair failed and we were unable to recover it. 00:28:03.872 [2024-11-28 19:16:24.646991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.647072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.647100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.872 qpair failed and we were unable to recover it. 00:28:03.872 [2024-11-28 19:16:24.647232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.872 [2024-11-28 19:16:24.647340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.647364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.873 qpair failed and we were unable to recover it. 00:28:03.873 [2024-11-28 19:16:24.647454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.647545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.647569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.873 qpair failed and we were unable to recover it. 00:28:03.873 [2024-11-28 19:16:24.647647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.647761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.647786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.873 qpair failed and we were unable to recover it. 00:28:03.873 [2024-11-28 19:16:24.647875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.647959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.647983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.873 qpair failed and we were unable to recover it. 00:28:03.873 [2024-11-28 19:16:24.648066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.648146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.648171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.873 qpair failed and we were unable to recover it. 00:28:03.873 [2024-11-28 19:16:24.648248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.648368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.648399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:03.873 qpair failed and we were unable to recover it. 00:28:03.873 [2024-11-28 19:16:24.648501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.648626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.648655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.873 qpair failed and we were unable to recover it. 00:28:03.873 [2024-11-28 19:16:24.648774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.648857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.648885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.873 qpair failed and we were unable to recover it. 00:28:03.873 [2024-11-28 19:16:24.648977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.649057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.649085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.873 qpair failed and we were unable to recover it. 00:28:03.873 [2024-11-28 19:16:24.649169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.649250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.649276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.873 qpair failed and we were unable to recover it. 00:28:03.873 [2024-11-28 19:16:24.649364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.649497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.649524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.873 qpair failed and we were unable to recover it. 00:28:03.873 [2024-11-28 19:16:24.649604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.649696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.649721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.873 qpair failed and we were unable to recover it. 00:28:03.873 [2024-11-28 19:16:24.649835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.649946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.649970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.873 qpair failed and we were unable to recover it. 00:28:03.873 [2024-11-28 19:16:24.650063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.650154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.650178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.873 qpair failed and we were unable to recover it. 00:28:03.873 [2024-11-28 19:16:24.650262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.650342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.650366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.873 qpair failed and we were unable to recover it. 00:28:03.873 [2024-11-28 19:16:24.650458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.650542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.650568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.873 qpair failed and we were unable to recover it. 00:28:03.873 [2024-11-28 19:16:24.650685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.650810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.650836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.873 qpair failed and we were unable to recover it. 00:28:03.873 [2024-11-28 19:16:24.650976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.651093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.651119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.873 qpair failed and we were unable to recover it. 00:28:03.873 [2024-11-28 19:16:24.651206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.651348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.651373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.873 qpair failed and we were unable to recover it. 00:28:03.873 [2024-11-28 19:16:24.651507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.651652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.651687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.873 qpair failed and we were unable to recover it. 00:28:03.873 [2024-11-28 19:16:24.651801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.651943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.873 [2024-11-28 19:16:24.651992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.873 qpair failed and we were unable to recover it. 00:28:03.874 [2024-11-28 19:16:24.652114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.874 [2024-11-28 19:16:24.652264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.874 [2024-11-28 19:16:24.652294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.874 qpair failed and we were unable to recover it. 00:28:03.874 [2024-11-28 19:16:24.652388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.874 [2024-11-28 19:16:24.652533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.874 [2024-11-28 19:16:24.652582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.874 qpair failed and we were unable to recover it. 00:28:03.874 [2024-11-28 19:16:24.652702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.874 [2024-11-28 19:16:24.652840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.874 [2024-11-28 19:16:24.652874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.874 qpair failed and we were unable to recover it. 00:28:03.874 [2024-11-28 19:16:24.652986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.874 [2024-11-28 19:16:24.653113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.874 [2024-11-28 19:16:24.653147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.874 qpair failed and we were unable to recover it. 00:28:03.874 [2024-11-28 19:16:24.653306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.874 [2024-11-28 19:16:24.653422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.874 [2024-11-28 19:16:24.653452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.874 qpair failed and we were unable to recover it. 00:28:03.874 [2024-11-28 19:16:24.653576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.874 [2024-11-28 19:16:24.653702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.874 [2024-11-28 19:16:24.653737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.874 qpair failed and we were unable to recover it. 00:28:03.874 [2024-11-28 19:16:24.653876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.874 [2024-11-28 19:16:24.654018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.874 [2024-11-28 19:16:24.654048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.874 qpair failed and we were unable to recover it. 00:28:03.874 [2024-11-28 19:16:24.654193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.874 [2024-11-28 19:16:24.654336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.874 [2024-11-28 19:16:24.654367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.874 qpair failed and we were unable to recover it. 00:28:03.874 [2024-11-28 19:16:24.654477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.874 [2024-11-28 19:16:24.654603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.874 [2024-11-28 19:16:24.654631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.874 qpair failed and we were unable to recover it. 00:28:03.874 [2024-11-28 19:16:24.654725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.874 [2024-11-28 19:16:24.654816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.874 [2024-11-28 19:16:24.654841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.874 qpair failed and we were unable to recover it. 00:28:03.874 [2024-11-28 19:16:24.654964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.874 [2024-11-28 19:16:24.655066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.874 [2024-11-28 19:16:24.655095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.874 qpair failed and we were unable to recover it. 00:28:03.874 [2024-11-28 19:16:24.655242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.874 [2024-11-28 19:16:24.655373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.874 [2024-11-28 19:16:24.655407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.874 qpair failed and we were unable to recover it. 00:28:03.874 [2024-11-28 19:16:24.655504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.874 [2024-11-28 19:16:24.655620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.874 [2024-11-28 19:16:24.655645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.874 qpair failed and we were unable to recover it. 00:28:03.874 [2024-11-28 19:16:24.655786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.874 [2024-11-28 19:16:24.655895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.874 [2024-11-28 19:16:24.655923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.874 qpair failed and we were unable to recover it. 00:28:03.874 [2024-11-28 19:16:24.656048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.874 [2024-11-28 19:16:24.656142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.874 [2024-11-28 19:16:24.656172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.874 qpair failed and we were unable to recover it. 00:28:03.874 [2024-11-28 19:16:24.656264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.874 [2024-11-28 19:16:24.656404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.874 [2024-11-28 19:16:24.656449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.874 qpair failed and we were unable to recover it. 00:28:03.874 [2024-11-28 19:16:24.656582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.874 [2024-11-28 19:16:24.656705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.874 [2024-11-28 19:16:24.656732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.874 qpair failed and we were unable to recover it. 00:28:03.874 [2024-11-28 19:16:24.656828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.656919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.656946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.875 qpair failed and we were unable to recover it. 00:28:03.875 [2024-11-28 19:16:24.657069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.657200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.657226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.875 qpair failed and we were unable to recover it. 00:28:03.875 [2024-11-28 19:16:24.657309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.657429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.657456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.875 qpair failed and we were unable to recover it. 00:28:03.875 [2024-11-28 19:16:24.657576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.657657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.657698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.875 qpair failed and we were unable to recover it. 00:28:03.875 [2024-11-28 19:16:24.657793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.657892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.657919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.875 qpair failed and we were unable to recover it. 00:28:03.875 [2024-11-28 19:16:24.658107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.658230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.658257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.875 qpair failed and we were unable to recover it. 00:28:03.875 [2024-11-28 19:16:24.658375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.658492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.658518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.875 qpair failed and we were unable to recover it. 00:28:03.875 [2024-11-28 19:16:24.658599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.658704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.658734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.875 qpair failed and we were unable to recover it. 00:28:03.875 [2024-11-28 19:16:24.658884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.659036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.659064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.875 qpair failed and we were unable to recover it. 00:28:03.875 [2024-11-28 19:16:24.659161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.659282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.659309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.875 qpair failed and we were unable to recover it. 00:28:03.875 [2024-11-28 19:16:24.659423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.659511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.659537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.875 qpair failed and we were unable to recover it. 00:28:03.875 [2024-11-28 19:16:24.659649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.659765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.659794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.875 qpair failed and we were unable to recover it. 00:28:03.875 [2024-11-28 19:16:24.659920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.660003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.660028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.875 qpair failed and we were unable to recover it. 00:28:03.875 [2024-11-28 19:16:24.660118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.660257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.660287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.875 qpair failed and we were unable to recover it. 00:28:03.875 [2024-11-28 19:16:24.660376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.660484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.660511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.875 qpair failed and we were unable to recover it. 00:28:03.875 [2024-11-28 19:16:24.660652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.660738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.660763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.875 qpair failed and we were unable to recover it. 00:28:03.875 [2024-11-28 19:16:24.660872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.660984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.661009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.875 qpair failed and we were unable to recover it. 00:28:03.875 [2024-11-28 19:16:24.661105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.661252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.661277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.875 qpair failed and we were unable to recover it. 00:28:03.875 [2024-11-28 19:16:24.661388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.661513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.661544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.875 qpair failed and we were unable to recover it. 00:28:03.875 [2024-11-28 19:16:24.661658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.661771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.661796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.875 qpair failed and we were unable to recover it. 00:28:03.875 [2024-11-28 19:16:24.661896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.662035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.875 [2024-11-28 19:16:24.662060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.875 qpair failed and we were unable to recover it. 00:28:03.876 [2024-11-28 19:16:24.662164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.662269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.662294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.876 qpair failed and we were unable to recover it. 00:28:03.876 [2024-11-28 19:16:24.662383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.662503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.662531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.876 qpair failed and we were unable to recover it. 00:28:03.876 [2024-11-28 19:16:24.662657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.662780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.662808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.876 qpair failed and we were unable to recover it. 00:28:03.876 [2024-11-28 19:16:24.662933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.663057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.663084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.876 qpair failed and we were unable to recover it. 00:28:03.876 [2024-11-28 19:16:24.663181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.663300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.663328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.876 qpair failed and we were unable to recover it. 00:28:03.876 [2024-11-28 19:16:24.663436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.663561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.663589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.876 qpair failed and we were unable to recover it. 00:28:03.876 [2024-11-28 19:16:24.663685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.663813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.663841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.876 qpair failed and we were unable to recover it. 00:28:03.876 [2024-11-28 19:16:24.663936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.664028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.664060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.876 qpair failed and we were unable to recover it. 00:28:03.876 [2024-11-28 19:16:24.664174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.664265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.664289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.876 qpair failed and we were unable to recover it. 00:28:03.876 [2024-11-28 19:16:24.664434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.664522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.664547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.876 qpair failed and we were unable to recover it. 00:28:03.876 [2024-11-28 19:16:24.664678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.664803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.664833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.876 qpair failed and we were unable to recover it. 00:28:03.876 [2024-11-28 19:16:24.664959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.665105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.665133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.876 qpair failed and we were unable to recover it. 00:28:03.876 [2024-11-28 19:16:24.665227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.665351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.665376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.876 qpair failed and we were unable to recover it. 00:28:03.876 [2024-11-28 19:16:24.665471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.665551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.665576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.876 qpair failed and we were unable to recover it. 00:28:03.876 [2024-11-28 19:16:24.665669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.665790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.665818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.876 qpair failed and we were unable to recover it. 00:28:03.876 [2024-11-28 19:16:24.665905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.665998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.666025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.876 qpair failed and we were unable to recover it. 00:28:03.876 [2024-11-28 19:16:24.666150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.666259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.666284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.876 qpair failed and we were unable to recover it. 00:28:03.876 [2024-11-28 19:16:24.666417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.666497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.666527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.876 qpair failed and we were unable to recover it. 00:28:03.876 [2024-11-28 19:16:24.666636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.666759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.666786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.876 qpair failed and we were unable to recover it. 00:28:03.876 [2024-11-28 19:16:24.666876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.666997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.667039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.876 qpair failed and we were unable to recover it. 00:28:03.876 [2024-11-28 19:16:24.667152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.667283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.667308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.876 qpair failed and we were unable to recover it. 00:28:03.876 [2024-11-28 19:16:24.667452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.667565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.876 [2024-11-28 19:16:24.667591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.876 qpair failed and we were unable to recover it. 00:28:03.876 [2024-11-28 19:16:24.667691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.667771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.667798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.877 qpair failed and we were unable to recover it. 00:28:03.877 [2024-11-28 19:16:24.667959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.668052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.668079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.877 qpair failed and we were unable to recover it. 00:28:03.877 [2024-11-28 19:16:24.668175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.668311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.668335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.877 qpair failed and we were unable to recover it. 00:28:03.877 [2024-11-28 19:16:24.668446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.668583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.668625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.877 qpair failed and we were unable to recover it. 00:28:03.877 [2024-11-28 19:16:24.668729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.668845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.668872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.877 qpair failed and we were unable to recover it. 00:28:03.877 [2024-11-28 19:16:24.668962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.669112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.669145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.877 qpair failed and we were unable to recover it. 00:28:03.877 [2024-11-28 19:16:24.669278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.669359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.669384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.877 qpair failed and we were unable to recover it. 00:28:03.877 [2024-11-28 19:16:24.669464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.669542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.669567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.877 qpair failed and we were unable to recover it. 00:28:03.877 [2024-11-28 19:16:24.669655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.669766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.669794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.877 qpair failed and we were unable to recover it. 00:28:03.877 [2024-11-28 19:16:24.669897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.670013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.670038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.877 qpair failed and we were unable to recover it. 00:28:03.877 [2024-11-28 19:16:24.670166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.670280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.670306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.877 qpair failed and we were unable to recover it. 00:28:03.877 [2024-11-28 19:16:24.670404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.670518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.670543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.877 qpair failed and we were unable to recover it. 00:28:03.877 [2024-11-28 19:16:24.670662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.670778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.670803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.877 qpair failed and we were unable to recover it. 00:28:03.877 [2024-11-28 19:16:24.670889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.670973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.670997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.877 qpair failed and we were unable to recover it. 00:28:03.877 [2024-11-28 19:16:24.671085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.671172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.671198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.877 qpair failed and we were unable to recover it. 00:28:03.877 [2024-11-28 19:16:24.671338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.671446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.671472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.877 qpair failed and we were unable to recover it. 00:28:03.877 [2024-11-28 19:16:24.671562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.671671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.671697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.877 qpair failed and we were unable to recover it. 00:28:03.877 [2024-11-28 19:16:24.671831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.671981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.672008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.877 qpair failed and we were unable to recover it. 00:28:03.877 [2024-11-28 19:16:24.672142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.672230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.672255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.877 qpair failed and we were unable to recover it. 00:28:03.877 [2024-11-28 19:16:24.672349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.672437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.672463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.877 qpair failed and we were unable to recover it. 00:28:03.877 [2024-11-28 19:16:24.672557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.672643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.672669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.877 qpair failed and we were unable to recover it. 00:28:03.877 [2024-11-28 19:16:24.672750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.877 [2024-11-28 19:16:24.672859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.672884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.878 qpair failed and we were unable to recover it. 00:28:03.878 [2024-11-28 19:16:24.672996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.673088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.673114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.878 qpair failed and we were unable to recover it. 00:28:03.878 [2024-11-28 19:16:24.673200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.673314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.673338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.878 qpair failed and we were unable to recover it. 00:28:03.878 [2024-11-28 19:16:24.673452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.673544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.673569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.878 qpair failed and we were unable to recover it. 00:28:03.878 [2024-11-28 19:16:24.673651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.673730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.673755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.878 qpair failed and we were unable to recover it. 00:28:03.878 [2024-11-28 19:16:24.673838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.673946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.673970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.878 qpair failed and we were unable to recover it. 00:28:03.878 [2024-11-28 19:16:24.674053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.674143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.674168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.878 qpair failed and we were unable to recover it. 00:28:03.878 [2024-11-28 19:16:24.674279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.674401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.674445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.878 qpair failed and we were unable to recover it. 00:28:03.878 [2024-11-28 19:16:24.674535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.674614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.674639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.878 qpair failed and we were unable to recover it. 00:28:03.878 [2024-11-28 19:16:24.674817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.674934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.674959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.878 qpair failed and we were unable to recover it. 00:28:03.878 [2024-11-28 19:16:24.675042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.675126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.675151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.878 qpair failed and we were unable to recover it. 00:28:03.878 [2024-11-28 19:16:24.675245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.675353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.675378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.878 qpair failed and we were unable to recover it. 00:28:03.878 [2024-11-28 19:16:24.675515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.675634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.675662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.878 qpair failed and we were unable to recover it. 00:28:03.878 [2024-11-28 19:16:24.675794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.675903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.675928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.878 qpair failed and we were unable to recover it. 00:28:03.878 [2024-11-28 19:16:24.676013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.676123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.676148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.878 qpair failed and we were unable to recover it. 00:28:03.878 [2024-11-28 19:16:24.676240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.676318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.676343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.878 qpair failed and we were unable to recover it. 00:28:03.878 [2024-11-28 19:16:24.676433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.676518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.676543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.878 qpair failed and we were unable to recover it. 00:28:03.878 [2024-11-28 19:16:24.676622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.676715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.676740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.878 qpair failed and we were unable to recover it. 00:28:03.878 [2024-11-28 19:16:24.676821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.676961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.676985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.878 qpair failed and we were unable to recover it. 00:28:03.878 [2024-11-28 19:16:24.677075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.677188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.677212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.878 qpair failed and we were unable to recover it. 00:28:03.878 [2024-11-28 19:16:24.677327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.677432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.677462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.878 qpair failed and we were unable to recover it. 00:28:03.878 [2024-11-28 19:16:24.677588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.677688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.878 [2024-11-28 19:16:24.677713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.878 qpair failed and we were unable to recover it. 00:28:03.879 [2024-11-28 19:16:24.677826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.677964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.677989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.879 qpair failed and we were unable to recover it. 00:28:03.879 [2024-11-28 19:16:24.678074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.678238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.678266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.879 qpair failed and we were unable to recover it. 00:28:03.879 [2024-11-28 19:16:24.678366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.678511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.678537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.879 qpair failed and we were unable to recover it. 00:28:03.879 [2024-11-28 19:16:24.678628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.678741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.678765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.879 qpair failed and we were unable to recover it. 00:28:03.879 [2024-11-28 19:16:24.678877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.678957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.678981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.879 qpair failed and we were unable to recover it. 00:28:03.879 [2024-11-28 19:16:24.679109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.679216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.679241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.879 qpair failed and we were unable to recover it. 00:28:03.879 [2024-11-28 19:16:24.679323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.679432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.679457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.879 qpair failed and we were unable to recover it. 00:28:03.879 [2024-11-28 19:16:24.679553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.679628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.679653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.879 qpair failed and we were unable to recover it. 00:28:03.879 [2024-11-28 19:16:24.679734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.679816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.679840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.879 qpair failed and we were unable to recover it. 00:28:03.879 [2024-11-28 19:16:24.679956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.680032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.680056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.879 qpair failed and we were unable to recover it. 00:28:03.879 [2024-11-28 19:16:24.680149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.680279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.680306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.879 qpair failed and we were unable to recover it. 00:28:03.879 [2024-11-28 19:16:24.680439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.680571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.680597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.879 qpair failed and we were unable to recover it. 00:28:03.879 [2024-11-28 19:16:24.680703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.680814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.680839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.879 qpair failed and we were unable to recover it. 00:28:03.879 [2024-11-28 19:16:24.680972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.681064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.681089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.879 qpair failed and we were unable to recover it. 00:28:03.879 [2024-11-28 19:16:24.681211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.681300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.681327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.879 qpair failed and we were unable to recover it. 00:28:03.879 [2024-11-28 19:16:24.681417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.681505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.681530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.879 qpair failed and we were unable to recover it. 00:28:03.879 [2024-11-28 19:16:24.681619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.681734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.681759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.879 qpair failed and we were unable to recover it. 00:28:03.879 [2024-11-28 19:16:24.681849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.681970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.681996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.879 qpair failed and we were unable to recover it. 00:28:03.879 [2024-11-28 19:16:24.682107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.682211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.682237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.879 qpair failed and we were unable to recover it. 00:28:03.879 [2024-11-28 19:16:24.682352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.682443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.682467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.879 qpair failed and we were unable to recover it. 00:28:03.879 [2024-11-28 19:16:24.682572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.682657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.682699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.879 qpair failed and we were unable to recover it. 00:28:03.879 [2024-11-28 19:16:24.682785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.879 [2024-11-28 19:16:24.682867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.880 [2024-11-28 19:16:24.682892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.880 qpair failed and we were unable to recover it. 00:28:03.880 [2024-11-28 19:16:24.682979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.880 [2024-11-28 19:16:24.683086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.880 [2024-11-28 19:16:24.683110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.880 qpair failed and we were unable to recover it. 00:28:03.880 [2024-11-28 19:16:24.683202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.880 [2024-11-28 19:16:24.683307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.880 [2024-11-28 19:16:24.683331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.880 qpair failed and we were unable to recover it. 00:28:03.880 [2024-11-28 19:16:24.683471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.880 [2024-11-28 19:16:24.683553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.880 [2024-11-28 19:16:24.683577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.880 qpair failed and we were unable to recover it. 00:28:03.880 [2024-11-28 19:16:24.683667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.880 [2024-11-28 19:16:24.683834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.880 [2024-11-28 19:16:24.683861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.880 qpair failed and we were unable to recover it. 00:28:03.880 [2024-11-28 19:16:24.683975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.880 [2024-11-28 19:16:24.684118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.880 [2024-11-28 19:16:24.684143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.880 qpair failed and we were unable to recover it. 00:28:03.880 [2024-11-28 19:16:24.684233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.880 [2024-11-28 19:16:24.684332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.880 [2024-11-28 19:16:24.684360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.880 qpair failed and we were unable to recover it. 00:28:03.880 [2024-11-28 19:16:24.684483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.880 [2024-11-28 19:16:24.684574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.880 [2024-11-28 19:16:24.684598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.880 qpair failed and we were unable to recover it. 00:28:03.880 [2024-11-28 19:16:24.684677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.880 [2024-11-28 19:16:24.684790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.880 [2024-11-28 19:16:24.684814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.880 qpair failed and we were unable to recover it. 00:28:03.880 [2024-11-28 19:16:24.684902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.880 [2024-11-28 19:16:24.685006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.880 [2024-11-28 19:16:24.685030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.880 qpair failed and we were unable to recover it. 00:28:03.880 [2024-11-28 19:16:24.685109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.880 [2024-11-28 19:16:24.685190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.880 [2024-11-28 19:16:24.685216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.880 qpair failed and we were unable to recover it. 00:28:03.880 [2024-11-28 19:16:24.685307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.880 [2024-11-28 19:16:24.685430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.880 [2024-11-28 19:16:24.685457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.880 qpair failed and we were unable to recover it. 00:28:03.880 [2024-11-28 19:16:24.685563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.880 [2024-11-28 19:16:24.685714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.880 [2024-11-28 19:16:24.685761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.880 qpair failed and we were unable to recover it. 00:28:03.880 [2024-11-28 19:16:24.685867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.880 [2024-11-28 19:16:24.686000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.880 [2024-11-28 19:16:24.686026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.880 qpair failed and we were unable to recover it. 00:28:03.880 [2024-11-28 19:16:24.686127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.880 [2024-11-28 19:16:24.686217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.880 [2024-11-28 19:16:24.686243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.880 qpair failed and we were unable to recover it. 00:28:03.880 [2024-11-28 19:16:24.686389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.880 [2024-11-28 19:16:24.686533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.880 [2024-11-28 19:16:24.686559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.880 qpair failed and we were unable to recover it. 00:28:03.880 [2024-11-28 19:16:24.686673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.880 [2024-11-28 19:16:24.686782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.880 [2024-11-28 19:16:24.686806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.880 qpair failed and we were unable to recover it. 00:28:03.880 [2024-11-28 19:16:24.686912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.880 [2024-11-28 19:16:24.687021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.880 [2024-11-28 19:16:24.687045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.881 qpair failed and we were unable to recover it. 00:28:03.881 [2024-11-28 19:16:24.687118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.687193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.687219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.881 qpair failed and we were unable to recover it. 00:28:03.881 [2024-11-28 19:16:24.687332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.687445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.687472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.881 qpair failed and we were unable to recover it. 00:28:03.881 [2024-11-28 19:16:24.687554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.687689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.687714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.881 qpair failed and we were unable to recover it. 00:28:03.881 [2024-11-28 19:16:24.687826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.687940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.687965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.881 qpair failed and we were unable to recover it. 00:28:03.881 [2024-11-28 19:16:24.688058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.688164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.688189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.881 qpair failed and we were unable to recover it. 00:28:03.881 [2024-11-28 19:16:24.688304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.688391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.688424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.881 qpair failed and we were unable to recover it. 00:28:03.881 [2024-11-28 19:16:24.688543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.688652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.688677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.881 qpair failed and we were unable to recover it. 00:28:03.881 [2024-11-28 19:16:24.688757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.688868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.688894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.881 qpair failed and we were unable to recover it. 00:28:03.881 [2024-11-28 19:16:24.689009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.689091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.689115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.881 qpair failed and we were unable to recover it. 00:28:03.881 [2024-11-28 19:16:24.689202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.689291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.689316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.881 qpair failed and we were unable to recover it. 00:28:03.881 [2024-11-28 19:16:24.689425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.689502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.689527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.881 qpair failed and we were unable to recover it. 00:28:03.881 [2024-11-28 19:16:24.689606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.689719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.689745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.881 qpair failed and we were unable to recover it. 00:28:03.881 [2024-11-28 19:16:24.689834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.689909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.689934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.881 qpair failed and we were unable to recover it. 00:28:03.881 [2024-11-28 19:16:24.690041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.690153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.690178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.881 qpair failed and we were unable to recover it. 00:28:03.881 [2024-11-28 19:16:24.690321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.690420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.690446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.881 qpair failed and we were unable to recover it. 00:28:03.881 [2024-11-28 19:16:24.690565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.690648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.690673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.881 qpair failed and we were unable to recover it. 00:28:03.881 [2024-11-28 19:16:24.690784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.690900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.690926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.881 qpair failed and we were unable to recover it. 00:28:03.881 [2024-11-28 19:16:24.691033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.691122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.691146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.881 qpair failed and we were unable to recover it. 00:28:03.881 [2024-11-28 19:16:24.691285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.691374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.691404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.881 qpair failed and we were unable to recover it. 00:28:03.881 [2024-11-28 19:16:24.691500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.691610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.691635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.881 qpair failed and we were unable to recover it. 00:28:03.881 [2024-11-28 19:16:24.691743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.691852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.691876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.881 qpair failed and we were unable to recover it. 00:28:03.881 [2024-11-28 19:16:24.691965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.692073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.881 [2024-11-28 19:16:24.692098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.881 qpair failed and we were unable to recover it. 00:28:03.882 [2024-11-28 19:16:24.692178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.692290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.692315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.882 qpair failed and we were unable to recover it. 00:28:03.882 [2024-11-28 19:16:24.692432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.692550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.692575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.882 qpair failed and we were unable to recover it. 00:28:03.882 [2024-11-28 19:16:24.692667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.692781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.692805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.882 qpair failed and we were unable to recover it. 00:28:03.882 [2024-11-28 19:16:24.692890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.693003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.693028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.882 qpair failed and we were unable to recover it. 00:28:03.882 [2024-11-28 19:16:24.693170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.693282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.693307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.882 qpair failed and we were unable to recover it. 00:28:03.882 [2024-11-28 19:16:24.693419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.693512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.693538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.882 qpair failed and we were unable to recover it. 00:28:03.882 [2024-11-28 19:16:24.693647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.693728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.693754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.882 qpair failed and we were unable to recover it. 00:28:03.882 [2024-11-28 19:16:24.693898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.693984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.694009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.882 qpair failed and we were unable to recover it. 00:28:03.882 [2024-11-28 19:16:24.694098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.694242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.694266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.882 qpair failed and we were unable to recover it. 00:28:03.882 [2024-11-28 19:16:24.694381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.694476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.694500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.882 qpair failed and we were unable to recover it. 00:28:03.882 [2024-11-28 19:16:24.694612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.694695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.694721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.882 qpair failed and we were unable to recover it. 00:28:03.882 [2024-11-28 19:16:24.694815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.694925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.694951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.882 qpair failed and we were unable to recover it. 00:28:03.882 [2024-11-28 19:16:24.695087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.695203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.695228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.882 qpair failed and we were unable to recover it. 00:28:03.882 [2024-11-28 19:16:24.695373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.695478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.695508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.882 qpair failed and we were unable to recover it. 00:28:03.882 [2024-11-28 19:16:24.695625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.695750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.695775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.882 qpair failed and we were unable to recover it. 00:28:03.882 [2024-11-28 19:16:24.695885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.696025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.696050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.882 qpair failed and we were unable to recover it. 00:28:03.882 [2024-11-28 19:16:24.696131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.696241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.696266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.882 qpair failed and we were unable to recover it. 00:28:03.882 [2024-11-28 19:16:24.696411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.696518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.696543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.882 qpair failed and we were unable to recover it. 00:28:03.882 [2024-11-28 19:16:24.696649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.696731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.696756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.882 qpair failed and we were unable to recover it. 00:28:03.882 [2024-11-28 19:16:24.696866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.696955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.696979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.882 qpair failed and we were unable to recover it. 00:28:03.882 [2024-11-28 19:16:24.697122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.697210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.697234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.882 qpair failed and we were unable to recover it. 00:28:03.882 [2024-11-28 19:16:24.697374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.697466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.697491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.882 qpair failed and we were unable to recover it. 00:28:03.882 [2024-11-28 19:16:24.697608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.697700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.882 [2024-11-28 19:16:24.697725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.882 qpair failed and we were unable to recover it. 00:28:03.883 [2024-11-28 19:16:24.697832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.697942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.697967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.883 qpair failed and we were unable to recover it. 00:28:03.883 [2024-11-28 19:16:24.698056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.698168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.698193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.883 qpair failed and we were unable to recover it. 00:28:03.883 [2024-11-28 19:16:24.698309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.698391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.698428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.883 qpair failed and we were unable to recover it. 00:28:03.883 [2024-11-28 19:16:24.698532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.698615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.698640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.883 qpair failed and we were unable to recover it. 00:28:03.883 [2024-11-28 19:16:24.698736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.698814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.698838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.883 qpair failed and we were unable to recover it. 00:28:03.883 [2024-11-28 19:16:24.698955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.699095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.699120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.883 qpair failed and we were unable to recover it. 00:28:03.883 [2024-11-28 19:16:24.699237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.699352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.699378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.883 qpair failed and we were unable to recover it. 00:28:03.883 [2024-11-28 19:16:24.699505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.699616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.699641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.883 qpair failed and we were unable to recover it. 00:28:03.883 [2024-11-28 19:16:24.699725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.699830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.699855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.883 qpair failed and we were unable to recover it. 00:28:03.883 [2024-11-28 19:16:24.699941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.700027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.700057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.883 qpair failed and we were unable to recover it. 00:28:03.883 [2024-11-28 19:16:24.700138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.700224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.700249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.883 qpair failed and we were unable to recover it. 00:28:03.883 [2024-11-28 19:16:24.700363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.700454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.700479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.883 qpair failed and we were unable to recover it. 00:28:03.883 [2024-11-28 19:16:24.700569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.700677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.700702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.883 qpair failed and we were unable to recover it. 00:28:03.883 [2024-11-28 19:16:24.700819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.700902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.700927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.883 qpair failed and we were unable to recover it. 00:28:03.883 [2024-11-28 19:16:24.701049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.701158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.701183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.883 qpair failed and we were unable to recover it. 00:28:03.883 [2024-11-28 19:16:24.701292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.701411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.701437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.883 qpair failed and we were unable to recover it. 00:28:03.883 [2024-11-28 19:16:24.701518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.701610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.701634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.883 qpair failed and we were unable to recover it. 00:28:03.883 [2024-11-28 19:16:24.701745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.701831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.701857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.883 qpair failed and we were unable to recover it. 00:28:03.883 [2024-11-28 19:16:24.701978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.702094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.702119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.883 qpair failed and we were unable to recover it. 00:28:03.883 [2024-11-28 19:16:24.702228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.702341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.702371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:03.883 qpair failed and we were unable to recover it. 00:28:03.883 [2024-11-28 19:16:24.702479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.702611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.702641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.883 qpair failed and we were unable to recover it. 00:28:03.883 [2024-11-28 19:16:24.702762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.883 [2024-11-28 19:16:24.702842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.702868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.884 qpair failed and we were unable to recover it. 00:28:03.884 [2024-11-28 19:16:24.702978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.703092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.703118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.884 qpair failed and we were unable to recover it. 00:28:03.884 [2024-11-28 19:16:24.703224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.703309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.703336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.884 qpair failed and we were unable to recover it. 00:28:03.884 [2024-11-28 19:16:24.703433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.703572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.703598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.884 qpair failed and we were unable to recover it. 00:28:03.884 [2024-11-28 19:16:24.703685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.703799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.703825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.884 qpair failed and we were unable to recover it. 00:28:03.884 [2024-11-28 19:16:24.703929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.704018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.704046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.884 qpair failed and we were unable to recover it. 00:28:03.884 [2024-11-28 19:16:24.704172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.704319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.704347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.884 qpair failed and we were unable to recover it. 00:28:03.884 [2024-11-28 19:16:24.704492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.704629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.704654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.884 qpair failed and we were unable to recover it. 00:28:03.884 [2024-11-28 19:16:24.704758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.704845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.704881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.884 qpair failed and we were unable to recover it. 00:28:03.884 [2024-11-28 19:16:24.705015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.705166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.705194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.884 qpair failed and we were unable to recover it. 00:28:03.884 [2024-11-28 19:16:24.705340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.705483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.705511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.884 qpair failed and we were unable to recover it. 00:28:03.884 [2024-11-28 19:16:24.705620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.705711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.705753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.884 qpair failed and we were unable to recover it. 00:28:03.884 [2024-11-28 19:16:24.705903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.705991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.706019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.884 qpair failed and we were unable to recover it. 00:28:03.884 [2024-11-28 19:16:24.706141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.706292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.706321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.884 qpair failed and we were unable to recover it. 00:28:03.884 [2024-11-28 19:16:24.706489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.706576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.706601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.884 qpair failed and we were unable to recover it. 00:28:03.884 [2024-11-28 19:16:24.706682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.706765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.706793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.884 qpair failed and we were unable to recover it. 00:28:03.884 [2024-11-28 19:16:24.706900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.707013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.707042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.884 qpair failed and we were unable to recover it. 00:28:03.884 [2024-11-28 19:16:24.707158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.707254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.707284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.884 qpair failed and we were unable to recover it. 00:28:03.884 [2024-11-28 19:16:24.707404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.707540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.707570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.884 qpair failed and we were unable to recover it. 00:28:03.884 [2024-11-28 19:16:24.707663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.707745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.707770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.884 qpair failed and we were unable to recover it. 00:28:03.884 [2024-11-28 19:16:24.707856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.707961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.707989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.884 qpair failed and we were unable to recover it. 00:28:03.884 [2024-11-28 19:16:24.708139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.708236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.884 [2024-11-28 19:16:24.708265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.884 qpair failed and we were unable to recover it. 00:28:03.885 [2024-11-28 19:16:24.708426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.708545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.708571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.885 qpair failed and we were unable to recover it. 00:28:03.885 [2024-11-28 19:16:24.708712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.708824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.708850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.885 qpair failed and we were unable to recover it. 00:28:03.885 [2024-11-28 19:16:24.708988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.709104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.709133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.885 qpair failed and we were unable to recover it. 00:28:03.885 [2024-11-28 19:16:24.709287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.709378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.709414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.885 qpair failed and we were unable to recover it. 00:28:03.885 [2024-11-28 19:16:24.709521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.709628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.709653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.885 qpair failed and we were unable to recover it. 00:28:03.885 [2024-11-28 19:16:24.709797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.709888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.709916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.885 qpair failed and we were unable to recover it. 00:28:03.885 [2024-11-28 19:16:24.710020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.710110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.710138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.885 qpair failed and we were unable to recover it. 00:28:03.885 [2024-11-28 19:16:24.710263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.710418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.710461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.885 qpair failed and we were unable to recover it. 00:28:03.885 [2024-11-28 19:16:24.710547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.710666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.710710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.885 qpair failed and we were unable to recover it. 00:28:03.885 [2024-11-28 19:16:24.710862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.711011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.711040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.885 qpair failed and we were unable to recover it. 00:28:03.885 [2024-11-28 19:16:24.711169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.711263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.711291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.885 qpair failed and we were unable to recover it. 00:28:03.885 [2024-11-28 19:16:24.711410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.711540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.711566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.885 qpair failed and we were unable to recover it. 00:28:03.885 [2024-11-28 19:16:24.711704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.711831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.711859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.885 qpair failed and we were unable to recover it. 00:28:03.885 [2024-11-28 19:16:24.711954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.712076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.712105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.885 qpair failed and we were unable to recover it. 00:28:03.885 [2024-11-28 19:16:24.712204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.712293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.712334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.885 qpair failed and we were unable to recover it. 00:28:03.885 [2024-11-28 19:16:24.712445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.712534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.712561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.885 qpair failed and we were unable to recover it. 00:28:03.885 [2024-11-28 19:16:24.712636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.712748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.712775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.885 qpair failed and we were unable to recover it. 00:28:03.885 [2024-11-28 19:16:24.712877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.712991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.713020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.885 qpair failed and we were unable to recover it. 00:28:03.885 [2024-11-28 19:16:24.713122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.713236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.713264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.885 qpair failed and we were unable to recover it. 00:28:03.885 [2024-11-28 19:16:24.713385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.713518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.713544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.885 qpair failed and we were unable to recover it. 00:28:03.885 [2024-11-28 19:16:24.713629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.713782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.713810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.885 qpair failed and we were unable to recover it. 00:28:03.885 [2024-11-28 19:16:24.713903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.714055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.885 [2024-11-28 19:16:24.714084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.885 qpair failed and we were unable to recover it. 00:28:03.886 [2024-11-28 19:16:24.714237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.886 [2024-11-28 19:16:24.714349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.886 [2024-11-28 19:16:24.714378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.886 qpair failed and we were unable to recover it. 00:28:03.886 [2024-11-28 19:16:24.714527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.886 [2024-11-28 19:16:24.714704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.886 [2024-11-28 19:16:24.714730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.886 qpair failed and we were unable to recover it. 00:28:03.886 [2024-11-28 19:16:24.714871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.886 [2024-11-28 19:16:24.714970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.886 [2024-11-28 19:16:24.715000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.886 qpair failed and we were unable to recover it. 00:28:03.886 [2024-11-28 19:16:24.715146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.886 [2024-11-28 19:16:24.715286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.886 [2024-11-28 19:16:24.715311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.886 qpair failed and we were unable to recover it. 00:28:03.886 [2024-11-28 19:16:24.715418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.886 [2024-11-28 19:16:24.715546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.886 [2024-11-28 19:16:24.715574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.886 qpair failed and we were unable to recover it. 00:28:03.886 [2024-11-28 19:16:24.715664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.886 [2024-11-28 19:16:24.715755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.886 [2024-11-28 19:16:24.715783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.886 qpair failed and we were unable to recover it. 00:28:03.886 [2024-11-28 19:16:24.715907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.886 [2024-11-28 19:16:24.716024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.886 [2024-11-28 19:16:24.716052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.886 qpair failed and we were unable to recover it. 00:28:03.886 [2024-11-28 19:16:24.716184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.886 [2024-11-28 19:16:24.716317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.886 [2024-11-28 19:16:24.716342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.886 qpair failed and we were unable to recover it. 00:28:03.886 [2024-11-28 19:16:24.716477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.886 [2024-11-28 19:16:24.716599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.886 [2024-11-28 19:16:24.716629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.886 qpair failed and we were unable to recover it. 00:28:03.886 [2024-11-28 19:16:24.716766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.886 [2024-11-28 19:16:24.716914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.886 [2024-11-28 19:16:24.716942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.886 qpair failed and we were unable to recover it. 00:28:03.886 [2024-11-28 19:16:24.717064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.886 [2024-11-28 19:16:24.717157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.886 [2024-11-28 19:16:24.717186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.886 qpair failed and we were unable to recover it. 00:28:03.886 [2024-11-28 19:16:24.717348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.886 [2024-11-28 19:16:24.717438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.886 [2024-11-28 19:16:24.717464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.886 qpair failed and we were unable to recover it. 00:28:03.886 [2024-11-28 19:16:24.717615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.886 [2024-11-28 19:16:24.717703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.886 [2024-11-28 19:16:24.717731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.886 qpair failed and we were unable to recover it. 00:28:03.886 [2024-11-28 19:16:24.717853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.886 [2024-11-28 19:16:24.717945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.886 [2024-11-28 19:16:24.717975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.886 qpair failed and we were unable to recover it. 00:28:03.886 [2024-11-28 19:16:24.718067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.886 [2024-11-28 19:16:24.718186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.886 [2024-11-28 19:16:24.718214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.886 qpair failed and we were unable to recover it. 00:28:03.886 [2024-11-28 19:16:24.718354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.886 [2024-11-28 19:16:24.718479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.886 [2024-11-28 19:16:24.718505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.886 qpair failed and we were unable to recover it. 00:28:03.886 [2024-11-28 19:16:24.718641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.886 [2024-11-28 19:16:24.718788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.886 [2024-11-28 19:16:24.718816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.886 qpair failed and we were unable to recover it. 00:28:03.886 [2024-11-28 19:16:24.718918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.719012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.719042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.887 qpair failed and we were unable to recover it. 00:28:03.887 [2024-11-28 19:16:24.719130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.719250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.719280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.887 qpair failed and we were unable to recover it. 00:28:03.887 [2024-11-28 19:16:24.719379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.719496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.719522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.887 qpair failed and we were unable to recover it. 00:28:03.887 [2024-11-28 19:16:24.719615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.719706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.719731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.887 qpair failed and we were unable to recover it. 00:28:03.887 [2024-11-28 19:16:24.719853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.719983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.720011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.887 qpair failed and we were unable to recover it. 00:28:03.887 [2024-11-28 19:16:24.720099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.720220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.720248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.887 qpair failed and we were unable to recover it. 00:28:03.887 [2024-11-28 19:16:24.720353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.720452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.720479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.887 qpair failed and we were unable to recover it. 00:28:03.887 [2024-11-28 19:16:24.720573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.720683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.720708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.887 qpair failed and we were unable to recover it. 00:28:03.887 [2024-11-28 19:16:24.720843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.720936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.720964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.887 qpair failed and we were unable to recover it. 00:28:03.887 [2024-11-28 19:16:24.721053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.721201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.721229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.887 qpair failed and we were unable to recover it. 00:28:03.887 [2024-11-28 19:16:24.721365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.721467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.721493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.887 qpair failed and we were unable to recover it. 00:28:03.887 [2024-11-28 19:16:24.721608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.721769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.721798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.887 qpair failed and we were unable to recover it. 00:28:03.887 [2024-11-28 19:16:24.721958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.722071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.722096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.887 qpair failed and we were unable to recover it. 00:28:03.887 [2024-11-28 19:16:24.722197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.722349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.722377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.887 qpair failed and we were unable to recover it. 00:28:03.887 [2024-11-28 19:16:24.722553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.722665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.722692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.887 qpair failed and we were unable to recover it. 00:28:03.887 [2024-11-28 19:16:24.722775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.722932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.722960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.887 qpair failed and we were unable to recover it. 00:28:03.887 [2024-11-28 19:16:24.723063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.723183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.723211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.887 qpair failed and we were unable to recover it. 00:28:03.887 [2024-11-28 19:16:24.723305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.723458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.723488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.887 qpair failed and we were unable to recover it. 00:28:03.887 [2024-11-28 19:16:24.723625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.723730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.723756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.887 qpair failed and we were unable to recover it. 00:28:03.887 [2024-11-28 19:16:24.723891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.724004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.724032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.887 qpair failed and we were unable to recover it. 00:28:03.887 [2024-11-28 19:16:24.724155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.724245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.724274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.887 qpair failed and we were unable to recover it. 00:28:03.887 [2024-11-28 19:16:24.724406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.724509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.724536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.887 qpair failed and we were unable to recover it. 00:28:03.887 [2024-11-28 19:16:24.724654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.724786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.887 [2024-11-28 19:16:24.724812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.887 qpair failed and we were unable to recover it. 00:28:03.888 [2024-11-28 19:16:24.724924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.725002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.725029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.888 qpair failed and we were unable to recover it. 00:28:03.888 [2024-11-28 19:16:24.725167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.725312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.725340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.888 qpair failed and we were unable to recover it. 00:28:03.888 [2024-11-28 19:16:24.725476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.725574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.725603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.888 qpair failed and we were unable to recover it. 00:28:03.888 [2024-11-28 19:16:24.725731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.725813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.725839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.888 qpair failed and we were unable to recover it. 00:28:03.888 [2024-11-28 19:16:24.725945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.726055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.726084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.888 qpair failed and we were unable to recover it. 00:28:03.888 [2024-11-28 19:16:24.726219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.726340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.726370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.888 qpair failed and we were unable to recover it. 00:28:03.888 [2024-11-28 19:16:24.726514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.726603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.726631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.888 qpair failed and we were unable to recover it. 00:28:03.888 [2024-11-28 19:16:24.726739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.726881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.726907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.888 qpair failed and we were unable to recover it. 00:28:03.888 [2024-11-28 19:16:24.726998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.727145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.727174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.888 qpair failed and we were unable to recover it. 00:28:03.888 [2024-11-28 19:16:24.727293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.727421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.727460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.888 qpair failed and we were unable to recover it. 00:28:03.888 [2024-11-28 19:16:24.727581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.727717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.727743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.888 qpair failed and we were unable to recover it. 00:28:03.888 [2024-11-28 19:16:24.727831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.727943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.727971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.888 qpair failed and we were unable to recover it. 00:28:03.888 [2024-11-28 19:16:24.728101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.728194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.728222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.888 qpair failed and we were unable to recover it. 00:28:03.888 [2024-11-28 19:16:24.728313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.728409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.728449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.888 qpair failed and we were unable to recover it. 00:28:03.888 [2024-11-28 19:16:24.728558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.728652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.728681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.888 qpair failed and we were unable to recover it. 00:28:03.888 [2024-11-28 19:16:24.728813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.728919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.728945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.888 qpair failed and we were unable to recover it. 00:28:03.888 [2024-11-28 19:16:24.729034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.729155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.729184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.888 qpair failed and we were unable to recover it. 00:28:03.888 [2024-11-28 19:16:24.729307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.729466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.729495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.888 qpair failed and we were unable to recover it. 00:28:03.888 [2024-11-28 19:16:24.729619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.729770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.729799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.888 qpair failed and we were unable to recover it. 00:28:03.888 [2024-11-28 19:16:24.729931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.730077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.730102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.888 qpair failed and we were unable to recover it. 00:28:03.888 [2024-11-28 19:16:24.730243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.730366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.730400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.888 qpair failed and we were unable to recover it. 00:28:03.888 [2024-11-28 19:16:24.730495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.730616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.730642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.888 qpair failed and we were unable to recover it. 00:28:03.888 [2024-11-28 19:16:24.730757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.730886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.888 [2024-11-28 19:16:24.730915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.888 qpair failed and we were unable to recover it. 00:28:03.889 [2024-11-28 19:16:24.731047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.731161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.731186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.889 qpair failed and we were unable to recover it. 00:28:03.889 [2024-11-28 19:16:24.731296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.731423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.731458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.889 qpair failed and we were unable to recover it. 00:28:03.889 [2024-11-28 19:16:24.731622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.731750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.731776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.889 qpair failed and we were unable to recover it. 00:28:03.889 [2024-11-28 19:16:24.731953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.732038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.732065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.889 qpair failed and we were unable to recover it. 00:28:03.889 [2024-11-28 19:16:24.732202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.732287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.732313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.889 qpair failed and we were unable to recover it. 00:28:03.889 [2024-11-28 19:16:24.732454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.732587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.732617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.889 qpair failed and we were unable to recover it. 00:28:03.889 [2024-11-28 19:16:24.732727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.732848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.732877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.889 qpair failed and we were unable to recover it. 00:28:03.889 [2024-11-28 19:16:24.732973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.733090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.733118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.889 qpair failed and we were unable to recover it. 00:28:03.889 [2024-11-28 19:16:24.733257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.733372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.733403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.889 qpair failed and we were unable to recover it. 00:28:03.889 [2024-11-28 19:16:24.733508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.733619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.733647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.889 qpair failed and we were unable to recover it. 00:28:03.889 [2024-11-28 19:16:24.733767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.733867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.733897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.889 qpair failed and we were unable to recover it. 00:28:03.889 [2024-11-28 19:16:24.733994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.734116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.734146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.889 qpair failed and we were unable to recover it. 00:28:03.889 [2024-11-28 19:16:24.734257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.734373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.734408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.889 qpair failed and we were unable to recover it. 00:28:03.889 [2024-11-28 19:16:24.734569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.734677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.734705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.889 qpair failed and we were unable to recover it. 00:28:03.889 [2024-11-28 19:16:24.734829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.734919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.734948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.889 qpair failed and we were unable to recover it. 00:28:03.889 [2024-11-28 19:16:24.735102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.735222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.735252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.889 qpair failed and we were unable to recover it. 00:28:03.889 [2024-11-28 19:16:24.735425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.735506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.735532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.889 qpair failed and we were unable to recover it. 00:28:03.889 [2024-11-28 19:16:24.735662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.735752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.735780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.889 qpair failed and we were unable to recover it. 00:28:03.889 [2024-11-28 19:16:24.735918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.736056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.736081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.889 qpair failed and we were unable to recover it. 00:28:03.889 [2024-11-28 19:16:24.736169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.736318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.736343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.889 qpair failed and we were unable to recover it. 00:28:03.889 [2024-11-28 19:16:24.736462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.736548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.736574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.889 qpair failed and we were unable to recover it. 00:28:03.889 [2024-11-28 19:16:24.736704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.736798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.736828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.889 qpair failed and we were unable to recover it. 00:28:03.889 [2024-11-28 19:16:24.736977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.737109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.737138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.889 qpair failed and we were unable to recover it. 00:28:03.889 [2024-11-28 19:16:24.737262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.889 [2024-11-28 19:16:24.737352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.737381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.890 qpair failed and we were unable to recover it. 00:28:03.890 [2024-11-28 19:16:24.737553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.737641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.737666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.890 qpair failed and we were unable to recover it. 00:28:03.890 [2024-11-28 19:16:24.737776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.737852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.737877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.890 qpair failed and we were unable to recover it. 00:28:03.890 [2024-11-28 19:16:24.737993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.738159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.738184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.890 qpair failed and we were unable to recover it. 00:28:03.890 [2024-11-28 19:16:24.738264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.738374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.738405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.890 qpair failed and we were unable to recover it. 00:28:03.890 [2024-11-28 19:16:24.738515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.738628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.738654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.890 qpair failed and we were unable to recover it. 00:28:03.890 [2024-11-28 19:16:24.738756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.738879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.738908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.890 qpair failed and we were unable to recover it. 00:28:03.890 [2024-11-28 19:16:24.738998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.739121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.739161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.890 qpair failed and we were unable to recover it. 00:28:03.890 [2024-11-28 19:16:24.739293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.739453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.739483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.890 qpair failed and we were unable to recover it. 00:28:03.890 [2024-11-28 19:16:24.739636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.739748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.739773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.890 qpair failed and we were unable to recover it. 00:28:03.890 [2024-11-28 19:16:24.739883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.740011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.740041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.890 qpair failed and we were unable to recover it. 00:28:03.890 [2024-11-28 19:16:24.740143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.740265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.740295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.890 qpair failed and we were unable to recover it. 00:28:03.890 [2024-11-28 19:16:24.740456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.740609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.740637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.890 qpair failed and we were unable to recover it. 00:28:03.890 [2024-11-28 19:16:24.740773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.740882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.740907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.890 qpair failed and we were unable to recover it. 00:28:03.890 [2024-11-28 19:16:24.741037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.741144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.741169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.890 qpair failed and we were unable to recover it. 00:28:03.890 [2024-11-28 19:16:24.741327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.741452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.741482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.890 qpair failed and we were unable to recover it. 00:28:03.890 [2024-11-28 19:16:24.741570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.741685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.741713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.890 qpair failed and we were unable to recover it. 00:28:03.890 [2024-11-28 19:16:24.741851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.741991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.742017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.890 qpair failed and we were unable to recover it. 00:28:03.890 [2024-11-28 19:16:24.742146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.742242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.742270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.890 qpair failed and we were unable to recover it. 00:28:03.890 [2024-11-28 19:16:24.742405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.742528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.742562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.890 qpair failed and we were unable to recover it. 00:28:03.890 [2024-11-28 19:16:24.742714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.742849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.742875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.890 qpair failed and we were unable to recover it. 00:28:03.890 [2024-11-28 19:16:24.742957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.743069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.743097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.890 qpair failed and we were unable to recover it. 00:28:03.890 [2024-11-28 19:16:24.743251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.743406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.743436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.890 qpair failed and we were unable to recover it. 00:28:03.890 [2024-11-28 19:16:24.743565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.743656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.743684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.890 qpair failed and we were unable to recover it. 00:28:03.890 [2024-11-28 19:16:24.743801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.743886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.890 [2024-11-28 19:16:24.743914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.890 qpair failed and we were unable to recover it. 00:28:03.890 [2024-11-28 19:16:24.744044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.744122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.744147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.891 qpair failed and we were unable to recover it. 00:28:03.891 [2024-11-28 19:16:24.744267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.744423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.744453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.891 qpair failed and we were unable to recover it. 00:28:03.891 [2024-11-28 19:16:24.744591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.744679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.744704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.891 qpair failed and we were unable to recover it. 00:28:03.891 [2024-11-28 19:16:24.744793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.744909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.744934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.891 qpair failed and we were unable to recover it. 00:28:03.891 [2024-11-28 19:16:24.745048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.745161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.745191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.891 qpair failed and we were unable to recover it. 00:28:03.891 [2024-11-28 19:16:24.745296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.745421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.745452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.891 qpair failed and we were unable to recover it. 00:28:03.891 [2024-11-28 19:16:24.745585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.745681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.745709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.891 qpair failed and we were unable to recover it. 00:28:03.891 [2024-11-28 19:16:24.745832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.745928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.745971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.891 qpair failed and we were unable to recover it. 00:28:03.891 [2024-11-28 19:16:24.746045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.746152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.746178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.891 qpair failed and we were unable to recover it. 00:28:03.891 [2024-11-28 19:16:24.746306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.746385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.746421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.891 qpair failed and we were unable to recover it. 00:28:03.891 [2024-11-28 19:16:24.746523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.746616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.746646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.891 qpair failed and we were unable to recover it. 00:28:03.891 [2024-11-28 19:16:24.746766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.746861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.746891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.891 qpair failed and we were unable to recover it. 00:28:03.891 [2024-11-28 19:16:24.747017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.747145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.747170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.891 qpair failed and we were unable to recover it. 00:28:03.891 [2024-11-28 19:16:24.747256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.747409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.747453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.891 qpair failed and we were unable to recover it. 00:28:03.891 [2024-11-28 19:16:24.747566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.747676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.747724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.891 qpair failed and we were unable to recover it. 00:28:03.891 [2024-11-28 19:16:24.747851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.748008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.748036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.891 qpair failed and we were unable to recover it. 00:28:03.891 [2024-11-28 19:16:24.748147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.748255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.748280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.891 qpair failed and we were unable to recover it. 00:28:03.891 [2024-11-28 19:16:24.748369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.748477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.748506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.891 qpair failed and we were unable to recover it. 00:28:03.891 [2024-11-28 19:16:24.748605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.748752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.748780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.891 qpair failed and we were unable to recover it. 00:28:03.891 [2024-11-28 19:16:24.748928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.749013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.749043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.891 qpair failed and we were unable to recover it. 00:28:03.891 [2024-11-28 19:16:24.749182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.749302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.749327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.891 qpair failed and we were unable to recover it. 00:28:03.891 [2024-11-28 19:16:24.749456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.749608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.749637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.891 qpair failed and we were unable to recover it. 00:28:03.891 [2024-11-28 19:16:24.749761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.749885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.749914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.891 qpair failed and we were unable to recover it. 00:28:03.891 [2024-11-28 19:16:24.750013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.750133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.750162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.891 qpair failed and we were unable to recover it. 00:28:03.891 [2024-11-28 19:16:24.750296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.750411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.891 [2024-11-28 19:16:24.750438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.891 qpair failed and we were unable to recover it. 00:28:03.892 [2024-11-28 19:16:24.750607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.750731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.750759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.892 qpair failed and we were unable to recover it. 00:28:03.892 [2024-11-28 19:16:24.750854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.750977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.751005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.892 qpair failed and we were unable to recover it. 00:28:03.892 [2024-11-28 19:16:24.751129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.751216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.751244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.892 qpair failed and we were unable to recover it. 00:28:03.892 [2024-11-28 19:16:24.751417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.751533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.751559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.892 qpair failed and we were unable to recover it. 00:28:03.892 [2024-11-28 19:16:24.751693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.751815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.751845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.892 qpair failed and we were unable to recover it. 00:28:03.892 [2024-11-28 19:16:24.751963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.752111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.752139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.892 qpair failed and we were unable to recover it. 00:28:03.892 [2024-11-28 19:16:24.752233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.752352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.752380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.892 qpair failed and we were unable to recover it. 00:28:03.892 [2024-11-28 19:16:24.752491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.752606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.752631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.892 qpair failed and we were unable to recover it. 00:28:03.892 [2024-11-28 19:16:24.752759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.752876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.752904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.892 qpair failed and we were unable to recover it. 00:28:03.892 [2024-11-28 19:16:24.753007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.753091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.753120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.892 qpair failed and we were unable to recover it. 00:28:03.892 [2024-11-28 19:16:24.753231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.753344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.753387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.892 qpair failed and we were unable to recover it. 00:28:03.892 [2024-11-28 19:16:24.753505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.753593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.753619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.892 qpair failed and we were unable to recover it. 00:28:03.892 [2024-11-28 19:16:24.753758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.753851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.753893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.892 qpair failed and we were unable to recover it. 00:28:03.892 [2024-11-28 19:16:24.754067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.754161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.754186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.892 qpair failed and we were unable to recover it. 00:28:03.892 [2024-11-28 19:16:24.754271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.754383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.754420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.892 qpair failed and we were unable to recover it. 00:28:03.892 [2024-11-28 19:16:24.754525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.754634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.754659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.892 qpair failed and we were unable to recover it. 00:28:03.892 [2024-11-28 19:16:24.754778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.754869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.754897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.892 qpair failed and we were unable to recover it. 00:28:03.892 [2024-11-28 19:16:24.754993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.755139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.755168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.892 qpair failed and we were unable to recover it. 00:28:03.892 [2024-11-28 19:16:24.755266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.755351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.755380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.892 qpair failed and we were unable to recover it. 00:28:03.892 [2024-11-28 19:16:24.755548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.755663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.755689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.892 qpair failed and we were unable to recover it. 00:28:03.892 [2024-11-28 19:16:24.755848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.755965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.755990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.892 qpair failed and we were unable to recover it. 00:28:03.892 [2024-11-28 19:16:24.756105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.756188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.892 [2024-11-28 19:16:24.756217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.893 qpair failed and we were unable to recover it. 00:28:03.893 [2024-11-28 19:16:24.756367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.756496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.756522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.893 qpair failed and we were unable to recover it. 00:28:03.893 [2024-11-28 19:16:24.756635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.756713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.756740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.893 qpair failed and we were unable to recover it. 00:28:03.893 [2024-11-28 19:16:24.756877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.756998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.757029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.893 qpair failed and we were unable to recover it. 00:28:03.893 [2024-11-28 19:16:24.757125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.757278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.757307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.893 qpair failed and we were unable to recover it. 00:28:03.893 [2024-11-28 19:16:24.757467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.757586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.757615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.893 qpair failed and we were unable to recover it. 00:28:03.893 [2024-11-28 19:16:24.757751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.757840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.757867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.893 qpair failed and we were unable to recover it. 00:28:03.893 [2024-11-28 19:16:24.757953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.758082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.758110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.893 qpair failed and we were unable to recover it. 00:28:03.893 [2024-11-28 19:16:24.758237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.758332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.758361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.893 qpair failed and we were unable to recover it. 00:28:03.893 [2024-11-28 19:16:24.758500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.758629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.758657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.893 qpair failed and we were unable to recover it. 00:28:03.893 [2024-11-28 19:16:24.758760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.758841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.758866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.893 qpair failed and we were unable to recover it. 00:28:03.893 [2024-11-28 19:16:24.758949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.759064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.759105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.893 qpair failed and we were unable to recover it. 00:28:03.893 [2024-11-28 19:16:24.759209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.759368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.759407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.893 qpair failed and we were unable to recover it. 00:28:03.893 [2024-11-28 19:16:24.759526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.759659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.759687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.893 qpair failed and we were unable to recover it. 00:28:03.893 [2024-11-28 19:16:24.759846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.759961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.759988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.893 qpair failed and we were unable to recover it. 00:28:03.893 [2024-11-28 19:16:24.760131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.760280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.760305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.893 qpair failed and we were unable to recover it. 00:28:03.893 [2024-11-28 19:16:24.760417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.760559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.760584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.893 qpair failed and we were unable to recover it. 00:28:03.893 [2024-11-28 19:16:24.760702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.760836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.760862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.893 qpair failed and we were unable to recover it. 00:28:03.893 [2024-11-28 19:16:24.760973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.761057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.761082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.893 qpair failed and we were unable to recover it. 00:28:03.893 [2024-11-28 19:16:24.761222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.761319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.761348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.893 qpair failed and we were unable to recover it. 00:28:03.893 [2024-11-28 19:16:24.761483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.761607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.761635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.893 qpair failed and we were unable to recover it. 00:28:03.893 [2024-11-28 19:16:24.761759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.761843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.761872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.893 qpair failed and we were unable to recover it. 00:28:03.893 [2024-11-28 19:16:24.762009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.762122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.762147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.893 qpair failed and we were unable to recover it. 00:28:03.893 [2024-11-28 19:16:24.762321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.762443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.762472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.893 qpair failed and we were unable to recover it. 00:28:03.893 [2024-11-28 19:16:24.762596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.762728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.762753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.893 qpair failed and we were unable to recover it. 00:28:03.893 [2024-11-28 19:16:24.762864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.762984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.893 [2024-11-28 19:16:24.763013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.893 qpair failed and we were unable to recover it. 00:28:03.893 [2024-11-28 19:16:24.763151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.763268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.763294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.894 qpair failed and we were unable to recover it. 00:28:03.894 [2024-11-28 19:16:24.763376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.763510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.763539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.894 qpair failed and we were unable to recover it. 00:28:03.894 [2024-11-28 19:16:24.763634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.763783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.763809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.894 qpair failed and we were unable to recover it. 00:28:03.894 [2024-11-28 19:16:24.763897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.764043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.764088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.894 qpair failed and we were unable to recover it. 00:28:03.894 [2024-11-28 19:16:24.764193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.764306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.764333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.894 qpair failed and we were unable to recover it. 00:28:03.894 [2024-11-28 19:16:24.764469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.764595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.764624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.894 qpair failed and we were unable to recover it. 00:28:03.894 [2024-11-28 19:16:24.764718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.764822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.764848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.894 qpair failed and we were unable to recover it. 00:28:03.894 [2024-11-28 19:16:24.764931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.765075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.765101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.894 qpair failed and we were unable to recover it. 00:28:03.894 [2024-11-28 19:16:24.765252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.765343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.765368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.894 qpair failed and we were unable to recover it. 00:28:03.894 [2024-11-28 19:16:24.765512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.765664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.765693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.894 qpair failed and we were unable to recover it. 00:28:03.894 [2024-11-28 19:16:24.765828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.765966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.765992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.894 qpair failed and we were unable to recover it. 00:28:03.894 [2024-11-28 19:16:24.766100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.766243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.766269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.894 qpair failed and we were unable to recover it. 00:28:03.894 [2024-11-28 19:16:24.766382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.766476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.766502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.894 qpair failed and we were unable to recover it. 00:28:03.894 [2024-11-28 19:16:24.766589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.766705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.766748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.894 qpair failed and we were unable to recover it. 00:28:03.894 [2024-11-28 19:16:24.766847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.766926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.766954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.894 qpair failed and we were unable to recover it. 00:28:03.894 [2024-11-28 19:16:24.767049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.767167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.767195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.894 qpair failed and we were unable to recover it. 00:28:03.894 [2024-11-28 19:16:24.767306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.767441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.767484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.894 qpair failed and we were unable to recover it. 00:28:03.894 [2024-11-28 19:16:24.767608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.767729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.767758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.894 qpair failed and we were unable to recover it. 00:28:03.894 [2024-11-28 19:16:24.767853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.767976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.768004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.894 qpair failed and we were unable to recover it. 00:28:03.894 [2024-11-28 19:16:24.768125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.768219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.768249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.894 qpair failed and we were unable to recover it. 00:28:03.894 [2024-11-28 19:16:24.768383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.768532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.768558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.894 qpair failed and we were unable to recover it. 00:28:03.894 [2024-11-28 19:16:24.768701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.768841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.768866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.894 qpair failed and we were unable to recover it. 00:28:03.894 [2024-11-28 19:16:24.769055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.769165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.769191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:03.894 qpair failed and we were unable to recover it. 00:28:03.894 [2024-11-28 19:16:24.769358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.769525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.769556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.894 qpair failed and we were unable to recover it. 00:28:03.894 [2024-11-28 19:16:24.769686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.769810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.769837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.894 qpair failed and we were unable to recover it. 00:28:03.894 [2024-11-28 19:16:24.769972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.770089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.894 [2024-11-28 19:16:24.770117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.895 qpair failed and we were unable to recover it. 00:28:03.895 [2024-11-28 19:16:24.770220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.770309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.770336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.895 qpair failed and we were unable to recover it. 00:28:03.895 [2024-11-28 19:16:24.770438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.770556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.770584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.895 qpair failed and we were unable to recover it. 00:28:03.895 [2024-11-28 19:16:24.770717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.770831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.770856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.895 qpair failed and we were unable to recover it. 00:28:03.895 [2024-11-28 19:16:24.770991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.771142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.771169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.895 qpair failed and we were unable to recover it. 00:28:03.895 [2024-11-28 19:16:24.771319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.771405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.771433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.895 qpair failed and we were unable to recover it. 00:28:03.895 [2024-11-28 19:16:24.771585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.771685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.771712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.895 qpair failed and we were unable to recover it. 00:28:03.895 [2024-11-28 19:16:24.771820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.771902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.771927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.895 qpair failed and we were unable to recover it. 00:28:03.895 [2024-11-28 19:16:24.772021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.772113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.772140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.895 qpair failed and we were unable to recover it. 00:28:03.895 [2024-11-28 19:16:24.772270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.772400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.772430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.895 qpair failed and we were unable to recover it. 00:28:03.895 [2024-11-28 19:16:24.772582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.772664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.772692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.895 qpair failed and we were unable to recover it. 00:28:03.895 [2024-11-28 19:16:24.772863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.772976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.773001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.895 qpair failed and we were unable to recover it. 00:28:03.895 [2024-11-28 19:16:24.773083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.773170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.773196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.895 qpair failed and we were unable to recover it. 00:28:03.895 [2024-11-28 19:16:24.773330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.773492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.773518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.895 qpair failed and we were unable to recover it. 00:28:03.895 [2024-11-28 19:16:24.773625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.773757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.773786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.895 qpair failed and we were unable to recover it. 00:28:03.895 [2024-11-28 19:16:24.773915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.774025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.774050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.895 qpair failed and we were unable to recover it. 00:28:03.895 [2024-11-28 19:16:24.774172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.774323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.774351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.895 qpair failed and we were unable to recover it. 00:28:03.895 [2024-11-28 19:16:24.774478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.774577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.774605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.895 qpair failed and we were unable to recover it. 00:28:03.895 [2024-11-28 19:16:24.774729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.774831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.774858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.895 qpair failed and we were unable to recover it. 00:28:03.895 [2024-11-28 19:16:24.774986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.775059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.775083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.895 qpair failed and we were unable to recover it. 00:28:03.895 [2024-11-28 19:16:24.775204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.775303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.775333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.895 qpair failed and we were unable to recover it. 00:28:03.895 [2024-11-28 19:16:24.775459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.775611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.775639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.895 qpair failed and we were unable to recover it. 00:28:03.895 [2024-11-28 19:16:24.775768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.775884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.775911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.895 qpair failed and we were unable to recover it. 00:28:03.895 [2024-11-28 19:16:24.776016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.776102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.776128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.895 qpair failed and we were unable to recover it. 00:28:03.895 [2024-11-28 19:16:24.776216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.776319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.776346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.895 qpair failed and we were unable to recover it. 00:28:03.895 [2024-11-28 19:16:24.776477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.776566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.776593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.895 qpair failed and we were unable to recover it. 00:28:03.895 [2024-11-28 19:16:24.776722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.776825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.776848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.895 qpair failed and we were unable to recover it. 00:28:03.895 [2024-11-28 19:16:24.776928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.777008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.895 [2024-11-28 19:16:24.777033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.895 qpair failed and we were unable to recover it. 00:28:03.896 [2024-11-28 19:16:24.777110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.777223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.777248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.896 qpair failed and we were unable to recover it. 00:28:03.896 [2024-11-28 19:16:24.777337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.777469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.777495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.896 qpair failed and we were unable to recover it. 00:28:03.896 [2024-11-28 19:16:24.777604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.777695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.777718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.896 qpair failed and we were unable to recover it. 00:28:03.896 [2024-11-28 19:16:24.777804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.777944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.777969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.896 qpair failed and we were unable to recover it. 00:28:03.896 [2024-11-28 19:16:24.778091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.778217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.778245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.896 qpair failed and we were unable to recover it. 00:28:03.896 [2024-11-28 19:16:24.778365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.778495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.778523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.896 qpair failed and we were unable to recover it. 00:28:03.896 [2024-11-28 19:16:24.778646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.778737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.778764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.896 qpair failed and we were unable to recover it. 00:28:03.896 [2024-11-28 19:16:24.778875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.778982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.779006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.896 qpair failed and we were unable to recover it. 00:28:03.896 [2024-11-28 19:16:24.779090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.779186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.779214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.896 qpair failed and we were unable to recover it. 00:28:03.896 [2024-11-28 19:16:24.779365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.779466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.779490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.896 qpair failed and we were unable to recover it. 00:28:03.896 [2024-11-28 19:16:24.779583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.779721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.779764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.896 qpair failed and we were unable to recover it. 00:28:03.896 [2024-11-28 19:16:24.779899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.780037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.780062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.896 qpair failed and we were unable to recover it. 00:28:03.896 [2024-11-28 19:16:24.780161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.780243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.780270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.896 qpair failed and we were unable to recover it. 00:28:03.896 [2024-11-28 19:16:24.780422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.780534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.780562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.896 qpair failed and we were unable to recover it. 00:28:03.896 [2024-11-28 19:16:24.780654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.780750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.780777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.896 qpair failed and we were unable to recover it. 00:28:03.896 [2024-11-28 19:16:24.780932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.781040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.781065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.896 qpair failed and we were unable to recover it. 00:28:03.896 [2024-11-28 19:16:24.781190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.781318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.781345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.896 qpair failed and we were unable to recover it. 00:28:03.896 [2024-11-28 19:16:24.781473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.781591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.781618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.896 qpair failed and we were unable to recover it. 00:28:03.896 [2024-11-28 19:16:24.781755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.781870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.781895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.896 qpair failed and we were unable to recover it. 00:28:03.896 [2024-11-28 19:16:24.782007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.782131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.782157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.896 qpair failed and we were unable to recover it. 00:28:03.896 [2024-11-28 19:16:24.782295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.782420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.782453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.896 qpair failed and we were unable to recover it. 00:28:03.896 [2024-11-28 19:16:24.782575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.782695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.782722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.896 qpair failed and we were unable to recover it. 00:28:03.896 [2024-11-28 19:16:24.782810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.782927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.782955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.896 qpair failed and we were unable to recover it. 00:28:03.896 [2024-11-28 19:16:24.783060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.783147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.783171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.896 qpair failed and we were unable to recover it. 00:28:03.896 [2024-11-28 19:16:24.783277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.783381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.783410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.896 qpair failed and we were unable to recover it. 00:28:03.896 [2024-11-28 19:16:24.783518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.783620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.783648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.896 qpair failed and we were unable to recover it. 00:28:03.896 [2024-11-28 19:16:24.783779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.896 [2024-11-28 19:16:24.783862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.783886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.897 qpair failed and we were unable to recover it. 00:28:03.897 [2024-11-28 19:16:24.784028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.784145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.784169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.897 qpair failed and we were unable to recover it. 00:28:03.897 [2024-11-28 19:16:24.784272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.784406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.784443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.897 qpair failed and we were unable to recover it. 00:28:03.897 [2024-11-28 19:16:24.784572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.784698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.784726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.897 qpair failed and we were unable to recover it. 00:28:03.897 [2024-11-28 19:16:24.784879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.784967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.785000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.897 qpair failed and we were unable to recover it. 00:28:03.897 [2024-11-28 19:16:24.785138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.785248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.785273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.897 qpair failed and we were unable to recover it. 00:28:03.897 [2024-11-28 19:16:24.785436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.785550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.785575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.897 qpair failed and we were unable to recover it. 00:28:03.897 [2024-11-28 19:16:24.785673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.785816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.785844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.897 qpair failed and we were unable to recover it. 00:28:03.897 [2024-11-28 19:16:24.785994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.786115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.786141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.897 qpair failed and we were unable to recover it. 00:28:03.897 [2024-11-28 19:16:24.786290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.786441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.786482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.897 qpair failed and we were unable to recover it. 00:28:03.897 [2024-11-28 19:16:24.786599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.786769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.786797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.897 qpair failed and we were unable to recover it. 00:28:03.897 [2024-11-28 19:16:24.786921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.787013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.787040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.897 qpair failed and we were unable to recover it. 00:28:03.897 [2024-11-28 19:16:24.787133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.787227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.787254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.897 qpair failed and we were unable to recover it. 00:28:03.897 [2024-11-28 19:16:24.787362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.787526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.787551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.897 qpair failed and we were unable to recover it. 00:28:03.897 [2024-11-28 19:16:24.787691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.787810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.787842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.897 qpair failed and we were unable to recover it. 00:28:03.897 [2024-11-28 19:16:24.787968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.788089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.788116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.897 qpair failed and we were unable to recover it. 00:28:03.897 [2024-11-28 19:16:24.788244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.788336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.788363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.897 qpair failed and we were unable to recover it. 00:28:03.897 [2024-11-28 19:16:24.788479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.788569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.788593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.897 qpair failed and we were unable to recover it. 00:28:03.897 [2024-11-28 19:16:24.788722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.788812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.788839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.897 qpair failed and we were unable to recover it. 00:28:03.897 [2024-11-28 19:16:24.788944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.789070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.789097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.897 qpair failed and we were unable to recover it. 00:28:03.897 [2024-11-28 19:16:24.789221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.789356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.789380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.897 qpair failed and we were unable to recover it. 00:28:03.897 [2024-11-28 19:16:24.789505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.789593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.789617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.897 qpair failed and we were unable to recover it. 00:28:03.897 [2024-11-28 19:16:24.789754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.789848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.789872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.897 qpair failed and we were unable to recover it. 00:28:03.897 [2024-11-28 19:16:24.789981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.790114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.790141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.897 qpair failed and we were unable to recover it. 00:28:03.897 [2024-11-28 19:16:24.790265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.790412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.790446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.897 qpair failed and we were unable to recover it. 00:28:03.897 [2024-11-28 19:16:24.790618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.790700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.790724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.897 qpair failed and we were unable to recover it. 00:28:03.897 [2024-11-28 19:16:24.790838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.790925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.897 [2024-11-28 19:16:24.790948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.897 qpair failed and we were unable to recover it. 00:28:03.898 [2024-11-28 19:16:24.791043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.791157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.791199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.898 qpair failed and we were unable to recover it. 00:28:03.898 [2024-11-28 19:16:24.791297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.791378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.791425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.898 qpair failed and we were unable to recover it. 00:28:03.898 [2024-11-28 19:16:24.791557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.791636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.791661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.898 qpair failed and we were unable to recover it. 00:28:03.898 [2024-11-28 19:16:24.791735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.791839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.791867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.898 qpair failed and we were unable to recover it. 00:28:03.898 [2024-11-28 19:16:24.791969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.792103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.792129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.898 qpair failed and we were unable to recover it. 00:28:03.898 [2024-11-28 19:16:24.792237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.792361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.792390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.898 qpair failed and we were unable to recover it. 00:28:03.898 [2024-11-28 19:16:24.792505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.792621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.792645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.898 qpair failed and we were unable to recover it. 00:28:03.898 [2024-11-28 19:16:24.792802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.792923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.792951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.898 qpair failed and we were unable to recover it. 00:28:03.898 [2024-11-28 19:16:24.793077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.793230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.793254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.898 qpair failed and we were unable to recover it. 00:28:03.898 [2024-11-28 19:16:24.793366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.793452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.793477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.898 qpair failed and we were unable to recover it. 00:28:03.898 [2024-11-28 19:16:24.793559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.793646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.793671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.898 qpair failed and we were unable to recover it. 00:28:03.898 [2024-11-28 19:16:24.793824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.793951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.793977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.898 qpair failed and we were unable to recover it. 00:28:03.898 [2024-11-28 19:16:24.794096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.794222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.794248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.898 qpair failed and we were unable to recover it. 00:28:03.898 [2024-11-28 19:16:24.794402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.794546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.794573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.898 qpair failed and we were unable to recover it. 00:28:03.898 [2024-11-28 19:16:24.794713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.794824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.794849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.898 qpair failed and we were unable to recover it. 00:28:03.898 [2024-11-28 19:16:24.794948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.795088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.795113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.898 qpair failed and we were unable to recover it. 00:28:03.898 [2024-11-28 19:16:24.795221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.795348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.795378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.898 qpair failed and we were unable to recover it. 00:28:03.898 [2024-11-28 19:16:24.795517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.795640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.795668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.898 qpair failed and we were unable to recover it. 00:28:03.898 [2024-11-28 19:16:24.795804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.795915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.795940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.898 qpair failed and we were unable to recover it. 00:28:03.898 [2024-11-28 19:16:24.796063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.796181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.796209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.898 qpair failed and we were unable to recover it. 00:28:03.898 [2024-11-28 19:16:24.796314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.796434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.796463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.898 qpair failed and we were unable to recover it. 00:28:03.898 [2024-11-28 19:16:24.796562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.796651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.796678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.898 qpair failed and we were unable to recover it. 00:28:03.898 [2024-11-28 19:16:24.796804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.796943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.796968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.898 qpair failed and we were unable to recover it. 00:28:03.898 [2024-11-28 19:16:24.797105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.797262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.797290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.898 qpair failed and we were unable to recover it. 00:28:03.898 [2024-11-28 19:16:24.797379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.797486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.797513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.898 qpair failed and we were unable to recover it. 00:28:03.898 [2024-11-28 19:16:24.797629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.797759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.797784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.898 qpair failed and we were unable to recover it. 00:28:03.898 [2024-11-28 19:16:24.797864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.797947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.797972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.898 qpair failed and we were unable to recover it. 00:28:03.898 [2024-11-28 19:16:24.798083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.798225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.798253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.898 qpair failed and we were unable to recover it. 00:28:03.898 [2024-11-28 19:16:24.798399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.798493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.898 [2024-11-28 19:16:24.798518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.898 qpair failed and we were unable to recover it. 00:28:03.899 [2024-11-28 19:16:24.798628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.798721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.798763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.899 qpair failed and we were unable to recover it. 00:28:03.899 [2024-11-28 19:16:24.798842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.798953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.798978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.899 qpair failed and we were unable to recover it. 00:28:03.899 [2024-11-28 19:16:24.799100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.799192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.799220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.899 qpair failed and we were unable to recover it. 00:28:03.899 [2024-11-28 19:16:24.799364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.799483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.799512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.899 qpair failed and we were unable to recover it. 00:28:03.899 [2024-11-28 19:16:24.799638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.799788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.799815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.899 qpair failed and we were unable to recover it. 00:28:03.899 [2024-11-28 19:16:24.799924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.800041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.800065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.899 qpair failed and we were unable to recover it. 00:28:03.899 [2024-11-28 19:16:24.800148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.800301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.800325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.899 qpair failed and we were unable to recover it. 00:28:03.899 [2024-11-28 19:16:24.800446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.800574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.800600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.899 qpair failed and we were unable to recover it. 00:28:03.899 [2024-11-28 19:16:24.800747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.800868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.800894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.899 qpair failed and we were unable to recover it. 00:28:03.899 [2024-11-28 19:16:24.801032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.801121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.801145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.899 qpair failed and we were unable to recover it. 00:28:03.899 [2024-11-28 19:16:24.801233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.801386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.801419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.899 qpair failed and we were unable to recover it. 00:28:03.899 [2024-11-28 19:16:24.801516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.801642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.801669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.899 qpair failed and we were unable to recover it. 00:28:03.899 [2024-11-28 19:16:24.801761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.801907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.801934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.899 qpair failed and we were unable to recover it. 00:28:03.899 [2024-11-28 19:16:24.802066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.802168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.802192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.899 qpair failed and we were unable to recover it. 00:28:03.899 [2024-11-28 19:16:24.802282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.802358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.802383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.899 qpair failed and we were unable to recover it. 00:28:03.899 [2024-11-28 19:16:24.802481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.802591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.802634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.899 qpair failed and we were unable to recover it. 00:28:03.899 [2024-11-28 19:16:24.802744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.802871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.802900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.899 qpair failed and we were unable to recover it. 00:28:03.899 [2024-11-28 19:16:24.803071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.803205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.803229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.899 qpair failed and we were unable to recover it. 00:28:03.899 [2024-11-28 19:16:24.803371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.803509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.803550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.899 qpair failed and we were unable to recover it. 00:28:03.899 [2024-11-28 19:16:24.803674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.803757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.803782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.899 qpair failed and we were unable to recover it. 00:28:03.899 [2024-11-28 19:16:24.803897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.804009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.804050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.899 qpair failed and we were unable to recover it. 00:28:03.899 [2024-11-28 19:16:24.804179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.804271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.804295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.899 qpair failed and we were unable to recover it. 00:28:03.899 [2024-11-28 19:16:24.804409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.804497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.804522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.899 qpair failed and we were unable to recover it. 00:28:03.899 [2024-11-28 19:16:24.804659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.804764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.804789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.899 qpair failed and we were unable to recover it. 00:28:03.899 [2024-11-28 19:16:24.804874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.804990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.805015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.899 qpair failed and we were unable to recover it. 00:28:03.899 [2024-11-28 19:16:24.805099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.805237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.805263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.899 qpair failed and we were unable to recover it. 00:28:03.899 [2024-11-28 19:16:24.805422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.805558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.805582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.899 qpair failed and we were unable to recover it. 00:28:03.899 [2024-11-28 19:16:24.805669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.805778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.805803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.899 qpair failed and we were unable to recover it. 00:28:03.899 [2024-11-28 19:16:24.805953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.806029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.806054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.899 qpair failed and we were unable to recover it. 00:28:03.899 [2024-11-28 19:16:24.806167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.806248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.806274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.899 qpair failed and we were unable to recover it. 00:28:03.899 [2024-11-28 19:16:24.806368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.899 [2024-11-28 19:16:24.806487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.806512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.900 qpair failed and we were unable to recover it. 00:28:03.900 [2024-11-28 19:16:24.806625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.806732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.806759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.900 qpair failed and we were unable to recover it. 00:28:03.900 [2024-11-28 19:16:24.806884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.807013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.807040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.900 qpair failed and we were unable to recover it. 00:28:03.900 [2024-11-28 19:16:24.807156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.807293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.807318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.900 qpair failed and we were unable to recover it. 00:28:03.900 [2024-11-28 19:16:24.807428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.807555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.807584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.900 qpair failed and we were unable to recover it. 00:28:03.900 [2024-11-28 19:16:24.807734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.807824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.807865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.900 qpair failed and we were unable to recover it. 00:28:03.900 [2024-11-28 19:16:24.808000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.808113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.808158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.900 qpair failed and we were unable to recover it. 00:28:03.900 [2024-11-28 19:16:24.808293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.808425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.808451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.900 qpair failed and we were unable to recover it. 00:28:03.900 [2024-11-28 19:16:24.808561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.808648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.808689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.900 qpair failed and we were unable to recover it. 00:28:03.900 [2024-11-28 19:16:24.808846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.808973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.809000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.900 qpair failed and we were unable to recover it. 00:28:03.900 [2024-11-28 19:16:24.809094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.809249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.809275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.900 qpair failed and we were unable to recover it. 00:28:03.900 [2024-11-28 19:16:24.809383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.809467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.809492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.900 qpair failed and we were unable to recover it. 00:28:03.900 [2024-11-28 19:16:24.809620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.809732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.809758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.900 qpair failed and we were unable to recover it. 00:28:03.900 [2024-11-28 19:16:24.809883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.810037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.810062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.900 qpair failed and we were unable to recover it. 00:28:03.900 [2024-11-28 19:16:24.810177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.810355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.810382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.900 qpair failed and we were unable to recover it. 00:28:03.900 [2024-11-28 19:16:24.810493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.810576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.810600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.900 qpair failed and we were unable to recover it. 00:28:03.900 [2024-11-28 19:16:24.810678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.810792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.810820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.900 qpair failed and we were unable to recover it. 00:28:03.900 [2024-11-28 19:16:24.810917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.811006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.811033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.900 qpair failed and we were unable to recover it. 00:28:03.900 [2024-11-28 19:16:24.811154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.811279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.811306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.900 qpair failed and we were unable to recover it. 00:28:03.900 [2024-11-28 19:16:24.811418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.811533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.811558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.900 qpair failed and we were unable to recover it. 00:28:03.900 [2024-11-28 19:16:24.811634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.811743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.811770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.900 qpair failed and we were unable to recover it. 00:28:03.900 [2024-11-28 19:16:24.811887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.811977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.812005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.900 qpair failed and we were unable to recover it. 00:28:03.900 [2024-11-28 19:16:24.812108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.812203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.812231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.900 qpair failed and we were unable to recover it. 00:28:03.900 [2024-11-28 19:16:24.812374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.812483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.812509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.900 qpair failed and we were unable to recover it. 00:28:03.900 [2024-11-28 19:16:24.812591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.812728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.812769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.900 qpair failed and we were unable to recover it. 00:28:03.900 [2024-11-28 19:16:24.812916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.813013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.813041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.900 qpair failed and we were unable to recover it. 00:28:03.900 [2024-11-28 19:16:24.813144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.813255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.813282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.900 qpair failed and we were unable to recover it. 00:28:03.900 [2024-11-28 19:16:24.813417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.813501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.813526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.900 qpair failed and we were unable to recover it. 00:28:03.900 [2024-11-28 19:16:24.813599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.813746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.900 [2024-11-28 19:16:24.813771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.900 qpair failed and we were unable to recover it. 00:28:03.900 [2024-11-28 19:16:24.813884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.813970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.814014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.901 qpair failed and we were unable to recover it. 00:28:03.901 [2024-11-28 19:16:24.814116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.814209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.814238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.901 qpair failed and we were unable to recover it. 00:28:03.901 [2024-11-28 19:16:24.814402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.814517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.814542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.901 qpair failed and we were unable to recover it. 00:28:03.901 [2024-11-28 19:16:24.814673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.814771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.814814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.901 qpair failed and we were unable to recover it. 00:28:03.901 [2024-11-28 19:16:24.814950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.815100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.815127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.901 qpair failed and we were unable to recover it. 00:28:03.901 [2024-11-28 19:16:24.815219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.815372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.815420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.901 qpair failed and we were unable to recover it. 00:28:03.901 [2024-11-28 19:16:24.815534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.815643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.815667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.901 qpair failed and we were unable to recover it. 00:28:03.901 [2024-11-28 19:16:24.815764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.815885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.815914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.901 qpair failed and we were unable to recover it. 00:28:03.901 [2024-11-28 19:16:24.816008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.816103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.816132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.901 qpair failed and we were unable to recover it. 00:28:03.901 [2024-11-28 19:16:24.816236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.816358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.816386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.901 qpair failed and we were unable to recover it. 00:28:03.901 [2024-11-28 19:16:24.816529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.816673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.816699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.901 qpair failed and we were unable to recover it. 00:28:03.901 [2024-11-28 19:16:24.816841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.816995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.817023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.901 qpair failed and we were unable to recover it. 00:28:03.901 [2024-11-28 19:16:24.817122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.817213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.817243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.901 qpair failed and we were unable to recover it. 00:28:03.901 [2024-11-28 19:16:24.817326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.817458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.817486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.901 qpair failed and we were unable to recover it. 00:28:03.901 [2024-11-28 19:16:24.817598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.817682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.817708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.901 qpair failed and we were unable to recover it. 00:28:03.901 [2024-11-28 19:16:24.817791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.817934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.817959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.901 qpair failed and we were unable to recover it. 00:28:03.901 [2024-11-28 19:16:24.818037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.818125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.818151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.901 qpair failed and we were unable to recover it. 00:28:03.901 [2024-11-28 19:16:24.818259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.818356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.818383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.901 qpair failed and we were unable to recover it. 00:28:03.901 [2024-11-28 19:16:24.818490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.818599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.818625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.901 qpair failed and we were unable to recover it. 00:28:03.901 [2024-11-28 19:16:24.818703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.818827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.818855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.901 qpair failed and we were unable to recover it. 00:28:03.901 [2024-11-28 19:16:24.818982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.819110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.819149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.901 qpair failed and we were unable to recover it. 00:28:03.901 [2024-11-28 19:16:24.819272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.819420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.819449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.901 qpair failed and we were unable to recover it. 00:28:03.901 [2024-11-28 19:16:24.819612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.819697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.819722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.901 qpair failed and we were unable to recover it. 00:28:03.901 [2024-11-28 19:16:24.819817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.819933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.819961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.901 qpair failed and we were unable to recover it. 00:28:03.901 [2024-11-28 19:16:24.820063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.820182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.820209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.901 qpair failed and we were unable to recover it. 00:28:03.901 [2024-11-28 19:16:24.820323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.820478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.901 [2024-11-28 19:16:24.820503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.901 qpair failed and we were unable to recover it. 00:28:03.902 [2024-11-28 19:16:24.820587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.820696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.820721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.902 qpair failed and we were unable to recover it. 00:28:03.902 [2024-11-28 19:16:24.820798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.820906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.820933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.902 qpair failed and we were unable to recover it. 00:28:03.902 [2024-11-28 19:16:24.821059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.821155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.821180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.902 qpair failed and we were unable to recover it. 00:28:03.902 [2024-11-28 19:16:24.821298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.824526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.824557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.902 qpair failed and we were unable to recover it. 00:28:03.902 [2024-11-28 19:16:24.824686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.824778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.824803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.902 qpair failed and we were unable to recover it. 00:28:03.902 [2024-11-28 19:16:24.824892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.825034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.825059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.902 qpair failed and we were unable to recover it. 00:28:03.902 [2024-11-28 19:16:24.825136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.825221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.825247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.902 qpair failed and we were unable to recover it. 00:28:03.902 [2024-11-28 19:16:24.825359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.825508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.825536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.902 qpair failed and we were unable to recover it. 00:28:03.902 [2024-11-28 19:16:24.825668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.825777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.825801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.902 qpair failed and we were unable to recover it. 00:28:03.902 [2024-11-28 19:16:24.825943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.826073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.826099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.902 qpair failed and we were unable to recover it. 00:28:03.902 [2024-11-28 19:16:24.826227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.826317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.826346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.902 qpair failed and we were unable to recover it. 00:28:03.902 [2024-11-28 19:16:24.826482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.826574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.826601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.902 qpair failed and we were unable to recover it. 00:28:03.902 [2024-11-28 19:16:24.826733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.826809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.826833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.902 qpair failed and we were unable to recover it. 00:28:03.902 [2024-11-28 19:16:24.826971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.827099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.827126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.902 qpair failed and we were unable to recover it. 00:28:03.902 [2024-11-28 19:16:24.827247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.827349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.827378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.902 qpair failed and we were unable to recover it. 00:28:03.902 [2024-11-28 19:16:24.827510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.827602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.827646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.902 qpair failed and we were unable to recover it. 00:28:03.902 [2024-11-28 19:16:24.827761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.827848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.827873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.902 qpair failed and we were unable to recover it. 00:28:03.902 [2024-11-28 19:16:24.827962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.828086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.828112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.902 qpair failed and we were unable to recover it. 00:28:03.902 [2024-11-28 19:16:24.828234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.828357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.828384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.902 qpair failed and we were unable to recover it. 00:28:03.902 [2024-11-28 19:16:24.828504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.828590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.902 [2024-11-28 19:16:24.828616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.902 qpair failed and we were unable to recover it. 00:28:03.903 [2024-11-28 19:16:24.828707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.828842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.828867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.903 qpair failed and we were unable to recover it. 00:28:03.903 [2024-11-28 19:16:24.828970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.829091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.829117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.903 qpair failed and we were unable to recover it. 00:28:03.903 [2024-11-28 19:16:24.829209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.829353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.829382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.903 qpair failed and we were unable to recover it. 00:28:03.903 [2024-11-28 19:16:24.829520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.829645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.829672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.903 qpair failed and we were unable to recover it. 00:28:03.903 [2024-11-28 19:16:24.829769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.829892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.829922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.903 qpair failed and we were unable to recover it. 00:28:03.903 [2024-11-28 19:16:24.830014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.830173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.830201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.903 qpair failed and we were unable to recover it. 00:28:03.903 [2024-11-28 19:16:24.830291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.830376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.830412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.903 qpair failed and we were unable to recover it. 00:28:03.903 [2024-11-28 19:16:24.830550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.830683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.830710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.903 qpair failed and we were unable to recover it. 00:28:03.903 [2024-11-28 19:16:24.830845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.830967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.830991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.903 qpair failed and we were unable to recover it. 00:28:03.903 [2024-11-28 19:16:24.831089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.831201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.831228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.903 qpair failed and we were unable to recover it. 00:28:03.903 [2024-11-28 19:16:24.831357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.831473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.831501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.903 qpair failed and we were unable to recover it. 00:28:03.903 [2024-11-28 19:16:24.831595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.831711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.831737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.903 qpair failed and we were unable to recover it. 00:28:03.903 [2024-11-28 19:16:24.831831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.831966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.831991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.903 qpair failed and we were unable to recover it. 00:28:03.903 [2024-11-28 19:16:24.832095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.832197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.832224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.903 qpair failed and we were unable to recover it. 00:28:03.903 [2024-11-28 19:16:24.832374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.832546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.832579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.903 qpair failed and we were unable to recover it. 00:28:03.903 [2024-11-28 19:16:24.832702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.832821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.832850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.903 qpair failed and we were unable to recover it. 00:28:03.903 [2024-11-28 19:16:24.832972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.833083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.833107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.903 qpair failed and we were unable to recover it. 00:28:03.903 [2024-11-28 19:16:24.833179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.833279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.833306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.903 qpair failed and we were unable to recover it. 00:28:03.903 [2024-11-28 19:16:24.833409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.833531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.833558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.903 qpair failed and we were unable to recover it. 00:28:03.903 [2024-11-28 19:16:24.833653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.833742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.833769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.903 qpair failed and we were unable to recover it. 00:28:03.903 [2024-11-28 19:16:24.833879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.833994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.834018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.903 qpair failed and we were unable to recover it. 00:28:03.903 [2024-11-28 19:16:24.834126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.834263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.834290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.903 qpair failed and we were unable to recover it. 00:28:03.903 [2024-11-28 19:16:24.834451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.834604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.834632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.903 qpair failed and we were unable to recover it. 00:28:03.903 [2024-11-28 19:16:24.834747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.834838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.834866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.903 qpair failed and we were unable to recover it. 00:28:03.903 [2024-11-28 19:16:24.835002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.835116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.835145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.903 qpair failed and we were unable to recover it. 00:28:03.903 [2024-11-28 19:16:24.835290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.835415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.835443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.903 qpair failed and we were unable to recover it. 00:28:03.903 [2024-11-28 19:16:24.835566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.835665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.835692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.903 qpair failed and we were unable to recover it. 00:28:03.903 [2024-11-28 19:16:24.835785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.835874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.835902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.903 qpair failed and we were unable to recover it. 00:28:03.903 [2024-11-28 19:16:24.836016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.903 [2024-11-28 19:16:24.836131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.836156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.904 qpair failed and we were unable to recover it. 00:28:03.904 [2024-11-28 19:16:24.836312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.836459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.836488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.904 qpair failed and we were unable to recover it. 00:28:03.904 [2024-11-28 19:16:24.836637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.836799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.836823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.904 qpair failed and we were unable to recover it. 00:28:03.904 [2024-11-28 19:16:24.836910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.837021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.837045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.904 qpair failed and we were unable to recover it. 00:28:03.904 [2024-11-28 19:16:24.837187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.837294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.837318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.904 qpair failed and we were unable to recover it. 00:28:03.904 [2024-11-28 19:16:24.837452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.837573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.837601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.904 qpair failed and we were unable to recover it. 00:28:03.904 [2024-11-28 19:16:24.837729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.837883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.837910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.904 qpair failed and we were unable to recover it. 00:28:03.904 [2024-11-28 19:16:24.838040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.838162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.838189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.904 qpair failed and we were unable to recover it. 00:28:03.904 [2024-11-28 19:16:24.838303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.838388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.838422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.904 qpair failed and we were unable to recover it. 00:28:03.904 [2024-11-28 19:16:24.838535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.838646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.838674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.904 qpair failed and we were unable to recover it. 00:28:03.904 [2024-11-28 19:16:24.838825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.838986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.839013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.904 qpair failed and we were unable to recover it. 00:28:03.904 [2024-11-28 19:16:24.839136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.839225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.839252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.904 qpair failed and we were unable to recover it. 00:28:03.904 [2024-11-28 19:16:24.839355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.839480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.839505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.904 qpair failed and we were unable to recover it. 00:28:03.904 [2024-11-28 19:16:24.839659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.839805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.839846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.904 qpair failed and we were unable to recover it. 00:28:03.904 [2024-11-28 19:16:24.839959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.840068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.840092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.904 qpair failed and we were unable to recover it. 00:28:03.904 [2024-11-28 19:16:24.840224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.840306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.840334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.904 qpair failed and we were unable to recover it. 00:28:03.904 [2024-11-28 19:16:24.840481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.840566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.840591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.904 qpair failed and we were unable to recover it. 00:28:03.904 [2024-11-28 19:16:24.840678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.840815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.840842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.904 qpair failed and we were unable to recover it. 00:28:03.904 [2024-11-28 19:16:24.840965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.841054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.841081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.904 qpair failed and we were unable to recover it. 00:28:03.904 [2024-11-28 19:16:24.841177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.841263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.841290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.904 qpair failed and we were unable to recover it. 00:28:03.904 [2024-11-28 19:16:24.841428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.841506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.841532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.904 qpair failed and we were unable to recover it. 00:28:03.904 [2024-11-28 19:16:24.841619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.841750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.841779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.904 qpair failed and we were unable to recover it. 00:28:03.904 [2024-11-28 19:16:24.841927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.842013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.842054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.904 qpair failed and we were unable to recover it. 00:28:03.904 [2024-11-28 19:16:24.842180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.842255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.842297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.904 qpair failed and we were unable to recover it. 00:28:03.904 [2024-11-28 19:16:24.842427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.842539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.842565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.904 qpair failed and we were unable to recover it. 00:28:03.904 [2024-11-28 19:16:24.842677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.842811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.842839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.904 qpair failed and we were unable to recover it. 00:28:03.904 [2024-11-28 19:16:24.842993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.843123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.843150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.904 qpair failed and we were unable to recover it. 00:28:03.904 [2024-11-28 19:16:24.843304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.843489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.843518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.904 qpair failed and we were unable to recover it. 00:28:03.904 [2024-11-28 19:16:24.843653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.843800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.904 [2024-11-28 19:16:24.843825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.905 qpair failed and we were unable to recover it. 00:28:03.905 [2024-11-28 19:16:24.843929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.844067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.844092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.905 qpair failed and we were unable to recover it. 00:28:03.905 [2024-11-28 19:16:24.844211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.844319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.844360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.905 qpair failed and we were unable to recover it. 00:28:03.905 [2024-11-28 19:16:24.844525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.844655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.844682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.905 qpair failed and we were unable to recover it. 00:28:03.905 [2024-11-28 19:16:24.844775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.844858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.844882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.905 qpair failed and we were unable to recover it. 00:28:03.905 [2024-11-28 19:16:24.844973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.845078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.845107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.905 qpair failed and we were unable to recover it. 00:28:03.905 [2024-11-28 19:16:24.845239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.845341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.845366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.905 qpair failed and we were unable to recover it. 00:28:03.905 [2024-11-28 19:16:24.845467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.845618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.845644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.905 qpair failed and we were unable to recover it. 00:28:03.905 [2024-11-28 19:16:24.845760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.845868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.845893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.905 qpair failed and we were unable to recover it. 00:28:03.905 [2024-11-28 19:16:24.845994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.846120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.846161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.905 qpair failed and we were unable to recover it. 00:28:03.905 [2024-11-28 19:16:24.846247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.846326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.846351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.905 qpair failed and we were unable to recover it. 00:28:03.905 [2024-11-28 19:16:24.846442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.846518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.846542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.905 qpair failed and we were unable to recover it. 00:28:03.905 [2024-11-28 19:16:24.846659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.846771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.846796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.905 qpair failed and we were unable to recover it. 00:28:03.905 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 328045 Killed "${NVMF_APP[@]}" "$@" 00:28:03.905 [2024-11-28 19:16:24.846918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.847042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.847070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.905 qpair failed and we were unable to recover it. 00:28:03.905 [2024-11-28 19:16:24.847169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 19:16:24 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:28:03.905 [2024-11-28 19:16:24.847283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.847310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.905 qpair failed and we were unable to recover it. 00:28:03.905 19:16:24 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:28:03.905 [2024-11-28 19:16:24.847443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.847545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.847572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.905 19:16:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:03.905 qpair failed and we were unable to recover it. 00:28:03.905 [2024-11-28 19:16:24.847683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 19:16:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:03.905 [2024-11-28 19:16:24.847767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.847792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.905 qpair failed and we were unable to recover it. 00:28:03.905 19:16:24 -- common/autotest_common.sh@10 -- # set +x 00:28:03.905 [2024-11-28 19:16:24.847879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.848013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.848040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.905 qpair failed and we were unable to recover it. 00:28:03.905 [2024-11-28 19:16:24.848144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.848237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.848265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.905 qpair failed and we were unable to recover it. 00:28:03.905 [2024-11-28 19:16:24.848361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.848526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.848551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.905 qpair failed and we were unable to recover it. 00:28:03.905 [2024-11-28 19:16:24.848663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.848799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.848824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.905 qpair failed and we were unable to recover it. 00:28:03.905 [2024-11-28 19:16:24.848960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.849079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.849106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.905 qpair failed and we were unable to recover it. 00:28:03.905 [2024-11-28 19:16:24.849207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.849328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.849355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.905 qpair failed and we were unable to recover it. 00:28:03.905 [2024-11-28 19:16:24.849467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.849589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.849616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.905 qpair failed and we were unable to recover it. 00:28:03.905 [2024-11-28 19:16:24.849774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.849864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.849889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.905 qpair failed and we were unable to recover it. 00:28:03.905 [2024-11-28 19:16:24.850013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.850104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.850132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.905 qpair failed and we were unable to recover it. 00:28:03.905 [2024-11-28 19:16:24.850232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.850320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.905 [2024-11-28 19:16:24.850347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.905 qpair failed and we were unable to recover it. 00:28:03.905 [2024-11-28 19:16:24.850483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.906 [2024-11-28 19:16:24.850606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.906 [2024-11-28 19:16:24.850635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.906 qpair failed and we were unable to recover it. 00:28:03.906 [2024-11-28 19:16:24.850750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.906 [2024-11-28 19:16:24.850898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.906 [2024-11-28 19:16:24.850923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.906 qpair failed and we were unable to recover it. 00:28:03.906 [2024-11-28 19:16:24.851065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.906 [2024-11-28 19:16:24.851185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.906 [2024-11-28 19:16:24.851213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.906 qpair failed and we were unable to recover it. 00:28:03.906 [2024-11-28 19:16:24.851311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.906 [2024-11-28 19:16:24.851438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.906 [2024-11-28 19:16:24.851467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.906 qpair failed and we were unable to recover it. 00:28:03.906 [2024-11-28 19:16:24.851575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.906 [2024-11-28 19:16:24.851705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.906 [2024-11-28 19:16:24.851730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.906 qpair failed and we were unable to recover it. 00:28:03.906 [2024-11-28 19:16:24.851845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.906 19:16:24 -- nvmf/common.sh@469 -- # nvmfpid=328714 00:28:03.906 [2024-11-28 19:16:24.851935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.906 19:16:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:28:03.906 [2024-11-28 19:16:24.851962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.906 qpair failed and we were unable to recover it. 00:28:03.906 19:16:24 -- nvmf/common.sh@470 -- # waitforlisten 328714 00:28:03.906 [2024-11-28 19:16:24.852122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.906 [2024-11-28 19:16:24.852212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.906 [2024-11-28 19:16:24.852240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.906 19:16:24 -- common/autotest_common.sh@829 -- # '[' -z 328714 ']' 00:28:03.906 qpair failed and we were unable to recover it. 00:28:03.906 [2024-11-28 19:16:24.852402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.906 19:16:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:03.906 [2024-11-28 19:16:24.852496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.906 [2024-11-28 19:16:24.852524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.906 qpair failed and we were unable to recover it. 00:28:03.906 19:16:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:03.906 [2024-11-28 19:16:24.852639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.906 19:16:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:03.906 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:03.906 [2024-11-28 19:16:24.852725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.906 [2024-11-28 19:16:24.852752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.906 qpair failed and we were unable to recover it. 00:28:03.906 [2024-11-28 19:16:24.852843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.906 19:16:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:03.906 [2024-11-28 19:16:24.852932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.906 [2024-11-28 19:16:24.852959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.906 qpair failed and we were unable to recover it. 00:28:03.906 19:16:24 -- common/autotest_common.sh@10 -- # set +x 00:28:03.906 [2024-11-28 19:16:24.853042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.906 [2024-11-28 19:16:24.853187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.906 [2024-11-28 19:16:24.853212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.906 qpair failed and we were unable to recover it. 00:28:03.906 [2024-11-28 19:16:24.853328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.906 [2024-11-28 19:16:24.853458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.853483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.907 qpair failed and we were unable to recover it. 00:28:03.907 [2024-11-28 19:16:24.853575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.853660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.853684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.907 qpair failed and we were unable to recover it. 00:28:03.907 [2024-11-28 19:16:24.853778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.853893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.853916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.907 qpair failed and we were unable to recover it. 00:28:03.907 [2024-11-28 19:16:24.854046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.854199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.854226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.907 qpair failed and we were unable to recover it. 00:28:03.907 [2024-11-28 19:16:24.854323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.854439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.854470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.907 qpair failed and we were unable to recover it. 00:28:03.907 [2024-11-28 19:16:24.854569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.854668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.854695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.907 qpair failed and we were unable to recover it. 00:28:03.907 [2024-11-28 19:16:24.854855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.854949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.854973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.907 qpair failed and we were unable to recover it. 00:28:03.907 [2024-11-28 19:16:24.855065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.855151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.855176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.907 qpair failed and we were unable to recover it. 00:28:03.907 [2024-11-28 19:16:24.855262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.855353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.855378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.907 qpair failed and we were unable to recover it. 00:28:03.907 [2024-11-28 19:16:24.855487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.855568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.855594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.907 qpair failed and we were unable to recover it. 00:28:03.907 [2024-11-28 19:16:24.855674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.855753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.855777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.907 qpair failed and we were unable to recover it. 00:28:03.907 [2024-11-28 19:16:24.855918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.855995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.856020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.907 qpair failed and we were unable to recover it. 00:28:03.907 [2024-11-28 19:16:24.856121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.856205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.856229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.907 qpair failed and we were unable to recover it. 00:28:03.907 [2024-11-28 19:16:24.856320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.856430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.856456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.907 qpair failed and we were unable to recover it. 00:28:03.907 [2024-11-28 19:16:24.856542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.856659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.856684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.907 qpair failed and we were unable to recover it. 00:28:03.907 [2024-11-28 19:16:24.856771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.856868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.856892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.907 qpair failed and we were unable to recover it. 00:28:03.907 [2024-11-28 19:16:24.856986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.857091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.857116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.907 qpair failed and we were unable to recover it. 00:28:03.907 [2024-11-28 19:16:24.857246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.857342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.857373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.907 qpair failed and we were unable to recover it. 00:28:03.907 [2024-11-28 19:16:24.857504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.857594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.857618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.907 qpair failed and we were unable to recover it. 00:28:03.907 [2024-11-28 19:16:24.857721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.857796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.857821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.907 qpair failed and we were unable to recover it. 00:28:03.907 [2024-11-28 19:16:24.857906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.857998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.858022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.907 qpair failed and we were unable to recover it. 00:28:03.907 [2024-11-28 19:16:24.858101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.858210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.858234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.907 qpair failed and we were unable to recover it. 00:28:03.907 [2024-11-28 19:16:24.858352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.858451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.858475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.907 qpair failed and we were unable to recover it. 00:28:03.907 [2024-11-28 19:16:24.858592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.858679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.858704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.907 qpair failed and we were unable to recover it. 00:28:03.907 [2024-11-28 19:16:24.858791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.858905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.907 [2024-11-28 19:16:24.858929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.907 qpair failed and we were unable to recover it. 00:28:03.907 [2024-11-28 19:16:24.859014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.908 [2024-11-28 19:16:24.859127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.908 [2024-11-28 19:16:24.859152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.908 qpair failed and we were unable to recover it. 00:28:03.908 [2024-11-28 19:16:24.859231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.908 [2024-11-28 19:16:24.859344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.908 [2024-11-28 19:16:24.859369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.908 qpair failed and we were unable to recover it. 00:28:03.908 [2024-11-28 19:16:24.859463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.908 [2024-11-28 19:16:24.859538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.908 [2024-11-28 19:16:24.859563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.908 qpair failed and we were unable to recover it. 00:28:03.908 [2024-11-28 19:16:24.859651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.908 [2024-11-28 19:16:24.859762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.908 [2024-11-28 19:16:24.859788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.908 qpair failed and we were unable to recover it. 00:28:03.908 [2024-11-28 19:16:24.859874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.908 [2024-11-28 19:16:24.859955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.908 [2024-11-28 19:16:24.859980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.908 qpair failed and we were unable to recover it. 00:28:03.908 [2024-11-28 19:16:24.860090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.908 [2024-11-28 19:16:24.860205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.908 [2024-11-28 19:16:24.860230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.908 qpair failed and we were unable to recover it. 00:28:03.908 [2024-11-28 19:16:24.860339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.908 [2024-11-28 19:16:24.860472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.908 [2024-11-28 19:16:24.860496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.908 qpair failed and we were unable to recover it. 00:28:03.908 [2024-11-28 19:16:24.860591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.908 [2024-11-28 19:16:24.860672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:03.908 [2024-11-28 19:16:24.860696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:03.908 qpair failed and we were unable to recover it. 00:28:03.908 [2024-11-28 19:16:24.860769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.860849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.860875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.208 qpair failed and we were unable to recover it. 00:28:04.208 [2024-11-28 19:16:24.860970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.861061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.861087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.208 qpair failed and we were unable to recover it. 00:28:04.208 [2024-11-28 19:16:24.861172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.861255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.861280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.208 qpair failed and we were unable to recover it. 00:28:04.208 [2024-11-28 19:16:24.861403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.861502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.861527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.208 qpair failed and we were unable to recover it. 00:28:04.208 [2024-11-28 19:16:24.861620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.861734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.861759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.208 qpair failed and we were unable to recover it. 00:28:04.208 [2024-11-28 19:16:24.861874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.862001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.862056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.208 qpair failed and we were unable to recover it. 00:28:04.208 [2024-11-28 19:16:24.862188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.862314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.862345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.208 qpair failed and we were unable to recover it. 00:28:04.208 [2024-11-28 19:16:24.862460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.862553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.862582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.208 qpair failed and we were unable to recover it. 00:28:04.208 [2024-11-28 19:16:24.862689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.862810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.862838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.208 qpair failed and we were unable to recover it. 00:28:04.208 [2024-11-28 19:16:24.862933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.863021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.863057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.208 qpair failed and we were unable to recover it. 00:28:04.208 [2024-11-28 19:16:24.863161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.863263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.863294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.208 qpair failed and we were unable to recover it. 00:28:04.208 [2024-11-28 19:16:24.863414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.863529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.863565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.208 qpair failed and we were unable to recover it. 00:28:04.208 [2024-11-28 19:16:24.863677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.863787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.863822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.208 qpair failed and we were unable to recover it. 00:28:04.208 [2024-11-28 19:16:24.863961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.864070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.864105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.208 qpair failed and we were unable to recover it. 00:28:04.208 [2024-11-28 19:16:24.864235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.864348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.864382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.208 qpair failed and we were unable to recover it. 00:28:04.208 [2024-11-28 19:16:24.864497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.864589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.864614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.208 qpair failed and we were unable to recover it. 00:28:04.208 [2024-11-28 19:16:24.864707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.864849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.864875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.208 qpair failed and we were unable to recover it. 00:28:04.208 [2024-11-28 19:16:24.864988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.865104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.865129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.208 qpair failed and we were unable to recover it. 00:28:04.208 [2024-11-28 19:16:24.865211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.865319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.865344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.208 qpair failed and we were unable to recover it. 00:28:04.208 [2024-11-28 19:16:24.865459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.865551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.865579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.208 qpair failed and we were unable to recover it. 00:28:04.208 [2024-11-28 19:16:24.865687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.865773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.865800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.208 qpair failed and we were unable to recover it. 00:28:04.208 [2024-11-28 19:16:24.865893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.865977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.866002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.208 qpair failed and we were unable to recover it. 00:28:04.208 [2024-11-28 19:16:24.866118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.866230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.866255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.208 qpair failed and we were unable to recover it. 00:28:04.208 [2024-11-28 19:16:24.866344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.866435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.866461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.208 qpair failed and we were unable to recover it. 00:28:04.208 [2024-11-28 19:16:24.866548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.866634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.866669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.208 qpair failed and we were unable to recover it. 00:28:04.208 [2024-11-28 19:16:24.866784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.208 [2024-11-28 19:16:24.866872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.866905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.209 qpair failed and we were unable to recover it. 00:28:04.209 [2024-11-28 19:16:24.866989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.867076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.867104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.209 qpair failed and we were unable to recover it. 00:28:04.209 [2024-11-28 19:16:24.867194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.867311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.867336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.209 qpair failed and we were unable to recover it. 00:28:04.209 [2024-11-28 19:16:24.867428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.867523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.867548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.209 qpair failed and we were unable to recover it. 00:28:04.209 [2024-11-28 19:16:24.867676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.867760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.867791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.209 qpair failed and we were unable to recover it. 00:28:04.209 [2024-11-28 19:16:24.867881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.867967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.867991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.209 qpair failed and we were unable to recover it. 00:28:04.209 [2024-11-28 19:16:24.868106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.868212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.868240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.209 qpair failed and we were unable to recover it. 00:28:04.209 [2024-11-28 19:16:24.868328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.868424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.868451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.209 qpair failed and we were unable to recover it. 00:28:04.209 [2024-11-28 19:16:24.868540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.868627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.868651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.209 qpair failed and we were unable to recover it. 00:28:04.209 [2024-11-28 19:16:24.868766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.868877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.868902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.209 qpair failed and we were unable to recover it. 00:28:04.209 [2024-11-28 19:16:24.868999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.869091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.869116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.209 qpair failed and we were unable to recover it. 00:28:04.209 [2024-11-28 19:16:24.869198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.869308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.869334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.209 qpair failed and we were unable to recover it. 00:28:04.209 [2024-11-28 19:16:24.869415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.869499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.869525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.209 qpair failed and we were unable to recover it. 00:28:04.209 [2024-11-28 19:16:24.869606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.869700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.869724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.209 qpair failed and we were unable to recover it. 00:28:04.209 [2024-11-28 19:16:24.869840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.869928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.869954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.209 qpair failed and we were unable to recover it. 00:28:04.209 [2024-11-28 19:16:24.870039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.870151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.870179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.209 qpair failed and we were unable to recover it. 00:28:04.209 [2024-11-28 19:16:24.870275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.870386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.870420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.209 qpair failed and we were unable to recover it. 00:28:04.209 [2024-11-28 19:16:24.870507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.870592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.870616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.209 qpair failed and we were unable to recover it. 00:28:04.209 [2024-11-28 19:16:24.870711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.870813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.870842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.209 qpair failed and we were unable to recover it. 00:28:04.209 [2024-11-28 19:16:24.870927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.871010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.871039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.209 qpair failed and we were unable to recover it. 00:28:04.209 [2024-11-28 19:16:24.871127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.871241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.871268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.209 qpair failed and we were unable to recover it. 00:28:04.209 [2024-11-28 19:16:24.871362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.871469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.871494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.209 qpair failed and we were unable to recover it. 00:28:04.209 [2024-11-28 19:16:24.871617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.871704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.871729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.209 qpair failed and we were unable to recover it. 00:28:04.209 [2024-11-28 19:16:24.871838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.871933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.871960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.209 qpair failed and we were unable to recover it. 00:28:04.209 [2024-11-28 19:16:24.872101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.872214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.872240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.209 qpair failed and we were unable to recover it. 00:28:04.209 [2024-11-28 19:16:24.872354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.872446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.872471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.209 qpair failed and we were unable to recover it. 00:28:04.209 [2024-11-28 19:16:24.872556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.872648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.872673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.209 qpair failed and we were unable to recover it. 00:28:04.209 [2024-11-28 19:16:24.872766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.872849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.872878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.209 qpair failed and we were unable to recover it. 00:28:04.209 [2024-11-28 19:16:24.872990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.873132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.209 [2024-11-28 19:16:24.873159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.210 qpair failed and we were unable to recover it. 00:28:04.210 [2024-11-28 19:16:24.873249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.873331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.873358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.210 qpair failed and we were unable to recover it. 00:28:04.210 [2024-11-28 19:16:24.873456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.873546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.873578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.210 qpair failed and we were unable to recover it. 00:28:04.210 [2024-11-28 19:16:24.873663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.873800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.873826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.210 qpair failed and we were unable to recover it. 00:28:04.210 [2024-11-28 19:16:24.873918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.874032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.874058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.210 qpair failed and we were unable to recover it. 00:28:04.210 [2024-11-28 19:16:24.874144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.874225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.874251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.210 qpair failed and we were unable to recover it. 00:28:04.210 [2024-11-28 19:16:24.874372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.874464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.874489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.210 qpair failed and we were unable to recover it. 00:28:04.210 [2024-11-28 19:16:24.874583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.874708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.874741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.210 qpair failed and we were unable to recover it. 00:28:04.210 [2024-11-28 19:16:24.874872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.874961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.874994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.210 qpair failed and we were unable to recover it. 00:28:04.210 [2024-11-28 19:16:24.875118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.875246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.875277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.210 qpair failed and we were unable to recover it. 00:28:04.210 [2024-11-28 19:16:24.875371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.875475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.875504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.210 qpair failed and we were unable to recover it. 00:28:04.210 [2024-11-28 19:16:24.875609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.875760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.875791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.210 qpair failed and we were unable to recover it. 00:28:04.210 [2024-11-28 19:16:24.875939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.876029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.876069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.210 qpair failed and we were unable to recover it. 00:28:04.210 [2024-11-28 19:16:24.876223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.876315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.876344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.210 qpair failed and we were unable to recover it. 00:28:04.210 [2024-11-28 19:16:24.876475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.876575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.876605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.210 qpair failed and we were unable to recover it. 00:28:04.210 [2024-11-28 19:16:24.876706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.876866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.876896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.210 qpair failed and we were unable to recover it. 00:28:04.210 [2024-11-28 19:16:24.876987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.877082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.877114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.210 qpair failed and we were unable to recover it. 00:28:04.210 [2024-11-28 19:16:24.877232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.877356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.877386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.210 qpair failed and we were unable to recover it. 00:28:04.210 [2024-11-28 19:16:24.877510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.877604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.877642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.210 qpair failed and we were unable to recover it. 00:28:04.210 [2024-11-28 19:16:24.877740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.877863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.877892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.210 qpair failed and we were unable to recover it. 00:28:04.210 [2024-11-28 19:16:24.878042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.878134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.878162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.210 qpair failed and we were unable to recover it. 00:28:04.210 [2024-11-28 19:16:24.878280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.878371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.878407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.210 qpair failed and we were unable to recover it. 00:28:04.210 [2024-11-28 19:16:24.878544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.878637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.878670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.210 qpair failed and we were unable to recover it. 00:28:04.210 [2024-11-28 19:16:24.878792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.878906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.878941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.210 qpair failed and we were unable to recover it. 00:28:04.210 [2024-11-28 19:16:24.879051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.879141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.879173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.210 qpair failed and we were unable to recover it. 00:28:04.210 [2024-11-28 19:16:24.879297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.879387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.879427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.210 qpair failed and we were unable to recover it. 00:28:04.210 [2024-11-28 19:16:24.879532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.879636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.879667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.210 qpair failed and we were unable to recover it. 00:28:04.210 [2024-11-28 19:16:24.879795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.879922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.879954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.210 qpair failed and we were unable to recover it. 00:28:04.210 [2024-11-28 19:16:24.880090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.880240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.210 [2024-11-28 19:16:24.880272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.210 qpair failed and we were unable to recover it. 00:28:04.210 [2024-11-28 19:16:24.880401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.880492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.880524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.211 qpair failed and we were unable to recover it. 00:28:04.211 [2024-11-28 19:16:24.880628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.880722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.880754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.211 qpair failed and we were unable to recover it. 00:28:04.211 [2024-11-28 19:16:24.880858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.880979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.881012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.211 qpair failed and we were unable to recover it. 00:28:04.211 [2024-11-28 19:16:24.881177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.881271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.881305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.211 qpair failed and we were unable to recover it. 00:28:04.211 [2024-11-28 19:16:24.881419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.881529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.881560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.211 qpair failed and we were unable to recover it. 00:28:04.211 [2024-11-28 19:16:24.881662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.881754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.881780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.211 qpair failed and we were unable to recover it. 00:28:04.211 [2024-11-28 19:16:24.881881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.881980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.882014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.211 qpair failed and we were unable to recover it. 00:28:04.211 [2024-11-28 19:16:24.882109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.882233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.882261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.211 qpair failed and we were unable to recover it. 00:28:04.211 [2024-11-28 19:16:24.882368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.882535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.882567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.211 qpair failed and we were unable to recover it. 00:28:04.211 [2024-11-28 19:16:24.882722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.882826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.882857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.211 qpair failed and we were unable to recover it. 00:28:04.211 [2024-11-28 19:16:24.882955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.883075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.883102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.211 qpair failed and we were unable to recover it. 00:28:04.211 [2024-11-28 19:16:24.883241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.883343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.883373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.211 qpair failed and we were unable to recover it. 00:28:04.211 [2024-11-28 19:16:24.883507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.883610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.883640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.211 qpair failed and we were unable to recover it. 00:28:04.211 [2024-11-28 19:16:24.883766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.883856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.883882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.211 qpair failed and we were unable to recover it. 00:28:04.211 [2024-11-28 19:16:24.883973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.884078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.884103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.211 qpair failed and we were unable to recover it. 00:28:04.211 [2024-11-28 19:16:24.884234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.884348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.884373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.211 qpair failed and we were unable to recover it. 00:28:04.211 [2024-11-28 19:16:24.884482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.884571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.884606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.211 qpair failed and we were unable to recover it. 00:28:04.211 [2024-11-28 19:16:24.884734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.884862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.884893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.211 qpair failed and we were unable to recover it. 00:28:04.211 [2024-11-28 19:16:24.884994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.885135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.885170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.211 qpair failed and we were unable to recover it. 00:28:04.211 [2024-11-28 19:16:24.885298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.885390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.885427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.211 qpair failed and we were unable to recover it. 00:28:04.211 [2024-11-28 19:16:24.885517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.885639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.885671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.211 qpair failed and we were unable to recover it. 00:28:04.211 [2024-11-28 19:16:24.885801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.885900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.885933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.211 qpair failed and we were unable to recover it. 00:28:04.211 [2024-11-28 19:16:24.886031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.886156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.886183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.211 qpair failed and we were unable to recover it. 00:28:04.211 [2024-11-28 19:16:24.886319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.886431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.886464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.211 qpair failed and we were unable to recover it. 00:28:04.211 [2024-11-28 19:16:24.886590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.886687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.886716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.211 qpair failed and we were unable to recover it. 00:28:04.211 [2024-11-28 19:16:24.886812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.886934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.886961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.211 qpair failed and we were unable to recover it. 00:28:04.211 [2024-11-28 19:16:24.887067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.887188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.887218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.211 qpair failed and we were unable to recover it. 00:28:04.211 [2024-11-28 19:16:24.887343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.887441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.887474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.211 qpair failed and we were unable to recover it. 00:28:04.211 [2024-11-28 19:16:24.887580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.887668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.211 [2024-11-28 19:16:24.887698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.211 qpair failed and we were unable to recover it. 00:28:04.212 [2024-11-28 19:16:24.887802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.887920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.887949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.212 qpair failed and we were unable to recover it. 00:28:04.212 [2024-11-28 19:16:24.888076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.888177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.888203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.212 qpair failed and we were unable to recover it. 00:28:04.212 [2024-11-28 19:16:24.888326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.888416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.888459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.212 qpair failed and we were unable to recover it. 00:28:04.212 [2024-11-28 19:16:24.888554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.888635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.888661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.212 qpair failed and we were unable to recover it. 00:28:04.212 [2024-11-28 19:16:24.888754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.888837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.888862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.212 qpair failed and we were unable to recover it. 00:28:04.212 [2024-11-28 19:16:24.888961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.889073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.889098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.212 qpair failed and we were unable to recover it. 00:28:04.212 [2024-11-28 19:16:24.889210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.889322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.889346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.212 qpair failed and we were unable to recover it. 00:28:04.212 [2024-11-28 19:16:24.889448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.889561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.889587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.212 qpair failed and we were unable to recover it. 00:28:04.212 [2024-11-28 19:16:24.889674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.889787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.889813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.212 qpair failed and we were unable to recover it. 00:28:04.212 [2024-11-28 19:16:24.889930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.890043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.890068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.212 qpair failed and we were unable to recover it. 00:28:04.212 [2024-11-28 19:16:24.890160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.890273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.890298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.212 qpair failed and we were unable to recover it. 00:28:04.212 [2024-11-28 19:16:24.890386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.890488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.890513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.212 qpair failed and we were unable to recover it. 00:28:04.212 [2024-11-28 19:16:24.890598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.890716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.890741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.212 qpair failed and we were unable to recover it. 00:28:04.212 [2024-11-28 19:16:24.890881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.890970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.890995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.212 qpair failed and we were unable to recover it. 00:28:04.212 [2024-11-28 19:16:24.891102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.891177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.891202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.212 qpair failed and we were unable to recover it. 00:28:04.212 [2024-11-28 19:16:24.891328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.891448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.891477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.212 qpair failed and we were unable to recover it. 00:28:04.212 [2024-11-28 19:16:24.891572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.891681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.891708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.212 qpair failed and we were unable to recover it. 00:28:04.212 [2024-11-28 19:16:24.891837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.891954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.891990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.212 qpair failed and we were unable to recover it. 00:28:04.212 [2024-11-28 19:16:24.892088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.892227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.892258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.212 qpair failed and we were unable to recover it. 00:28:04.212 [2024-11-28 19:16:24.892386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.892533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.892564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.212 qpair failed and we were unable to recover it. 00:28:04.212 [2024-11-28 19:16:24.892661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.892749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.892781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.212 qpair failed and we were unable to recover it. 00:28:04.212 [2024-11-28 19:16:24.892871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.892958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.892988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.212 qpair failed and we were unable to recover it. 00:28:04.212 [2024-11-28 19:16:24.893118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.893216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.893247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.212 qpair failed and we were unable to recover it. 00:28:04.212 [2024-11-28 19:16:24.893351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.893480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.212 [2024-11-28 19:16:24.893511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.212 qpair failed and we were unable to recover it. 00:28:04.213 [2024-11-28 19:16:24.893607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.893704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.893731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.213 qpair failed and we were unable to recover it. 00:28:04.213 [2024-11-28 19:16:24.893855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.893956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.893987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.213 qpair failed and we were unable to recover it. 00:28:04.213 [2024-11-28 19:16:24.894071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.894187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.894217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.213 qpair failed and we were unable to recover it. 00:28:04.213 [2024-11-28 19:16:24.894332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.894451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.894479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.213 qpair failed and we were unable to recover it. 00:28:04.213 [2024-11-28 19:16:24.894584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.894696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.894725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.213 qpair failed and we were unable to recover it. 00:28:04.213 [2024-11-28 19:16:24.894827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.894943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.894971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.213 qpair failed and we were unable to recover it. 00:28:04.213 [2024-11-28 19:16:24.895123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.895215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.895225] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:04.213 [2024-11-28 19:16:24.895246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.213 qpair failed and we were unable to recover it. 00:28:04.213 [2024-11-28 19:16:24.895286] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:04.213 [2024-11-28 19:16:24.895350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.895480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.895504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.213 qpair failed and we were unable to recover it. 00:28:04.213 [2024-11-28 19:16:24.895623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.895719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.895743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.213 qpair failed and we were unable to recover it. 00:28:04.213 [2024-11-28 19:16:24.895849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.895938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.895963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.213 qpair failed and we were unable to recover it. 00:28:04.213 [2024-11-28 19:16:24.896095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.896211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.896240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.213 qpair failed and we were unable to recover it. 00:28:04.213 [2024-11-28 19:16:24.896363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.896481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.896507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.213 qpair failed and we were unable to recover it. 00:28:04.213 [2024-11-28 19:16:24.896600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.896689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.896715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.213 qpair failed and we were unable to recover it. 00:28:04.213 [2024-11-28 19:16:24.896799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.896903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.896928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.213 qpair failed and we were unable to recover it. 00:28:04.213 [2024-11-28 19:16:24.897020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.897099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.897123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.213 qpair failed and we were unable to recover it. 00:28:04.213 [2024-11-28 19:16:24.897233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.897421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.897447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.213 qpair failed and we were unable to recover it. 00:28:04.213 [2024-11-28 19:16:24.897567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.897652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.897677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.213 qpair failed and we were unable to recover it. 00:28:04.213 [2024-11-28 19:16:24.897760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.897868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.897893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.213 qpair failed and we were unable to recover it. 00:28:04.213 [2024-11-28 19:16:24.898006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.898091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.898116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.213 qpair failed and we were unable to recover it. 00:28:04.213 [2024-11-28 19:16:24.898203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.898309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.898333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.213 qpair failed and we were unable to recover it. 00:28:04.213 [2024-11-28 19:16:24.898423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.898508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.898537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.213 qpair failed and we were unable to recover it. 00:28:04.213 [2024-11-28 19:16:24.898625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.898745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.898769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.213 qpair failed and we were unable to recover it. 00:28:04.213 [2024-11-28 19:16:24.898957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.899142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.899166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.213 qpair failed and we were unable to recover it. 00:28:04.213 [2024-11-28 19:16:24.899282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.899404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.899429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.213 qpair failed and we were unable to recover it. 00:28:04.213 [2024-11-28 19:16:24.899516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.899604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.899629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.213 qpair failed and we were unable to recover it. 00:28:04.213 [2024-11-28 19:16:24.899759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.899844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.899870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.213 qpair failed and we were unable to recover it. 00:28:04.213 [2024-11-28 19:16:24.900007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.900117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.900142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.213 qpair failed and we were unable to recover it. 00:28:04.213 [2024-11-28 19:16:24.900254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.213 [2024-11-28 19:16:24.900364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.900388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.214 qpair failed and we were unable to recover it. 00:28:04.214 [2024-11-28 19:16:24.900483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.900563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.900589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.214 qpair failed and we were unable to recover it. 00:28:04.214 [2024-11-28 19:16:24.900709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.900843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.900869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.214 qpair failed and we were unable to recover it. 00:28:04.214 [2024-11-28 19:16:24.901008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.901092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.901117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.214 qpair failed and we were unable to recover it. 00:28:04.214 [2024-11-28 19:16:24.901206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.901283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.901307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.214 qpair failed and we were unable to recover it. 00:28:04.214 [2024-11-28 19:16:24.901413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.901531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.901556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.214 qpair failed and we were unable to recover it. 00:28:04.214 [2024-11-28 19:16:24.901668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.901753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.901778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.214 qpair failed and we were unable to recover it. 00:28:04.214 [2024-11-28 19:16:24.901861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.901976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.902001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.214 qpair failed and we were unable to recover it. 00:28:04.214 [2024-11-28 19:16:24.902190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.902279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.902305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.214 qpair failed and we were unable to recover it. 00:28:04.214 [2024-11-28 19:16:24.902420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.902495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.902520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.214 qpair failed and we were unable to recover it. 00:28:04.214 [2024-11-28 19:16:24.902631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.902719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.902744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.214 qpair failed and we were unable to recover it. 00:28:04.214 [2024-11-28 19:16:24.902858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.902945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.902970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.214 qpair failed and we were unable to recover it. 00:28:04.214 [2024-11-28 19:16:24.903056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.903143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.903168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.214 qpair failed and we were unable to recover it. 00:28:04.214 [2024-11-28 19:16:24.903286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.903361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.903386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.214 qpair failed and we were unable to recover it. 00:28:04.214 [2024-11-28 19:16:24.903490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.903563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.903588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.214 qpair failed and we were unable to recover it. 00:28:04.214 [2024-11-28 19:16:24.903715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.903851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.903875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.214 qpair failed and we were unable to recover it. 00:28:04.214 [2024-11-28 19:16:24.903985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.904098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.904123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.214 qpair failed and we were unable to recover it. 00:28:04.214 [2024-11-28 19:16:24.904204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.904322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.904347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.214 qpair failed and we were unable to recover it. 00:28:04.214 [2024-11-28 19:16:24.904444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.904556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.904581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.214 qpair failed and we were unable to recover it. 00:28:04.214 [2024-11-28 19:16:24.904668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.904772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.904797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.214 qpair failed and we were unable to recover it. 00:28:04.214 [2024-11-28 19:16:24.904912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.904998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.905023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.214 qpair failed and we were unable to recover it. 00:28:04.214 [2024-11-28 19:16:24.905133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.905214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.214 [2024-11-28 19:16:24.905239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.214 qpair failed and we were unable to recover it. 00:28:04.214 [2024-11-28 19:16:24.905321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.905418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.905444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.215 qpair failed and we were unable to recover it. 00:28:04.215 [2024-11-28 19:16:24.905561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.905645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.905668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.215 qpair failed and we were unable to recover it. 00:28:04.215 [2024-11-28 19:16:24.905748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.905838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.905862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.215 qpair failed and we were unable to recover it. 00:28:04.215 [2024-11-28 19:16:24.905981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.906058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.906082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.215 qpair failed and we were unable to recover it. 00:28:04.215 [2024-11-28 19:16:24.906194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.906305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.906330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.215 qpair failed and we were unable to recover it. 00:28:04.215 [2024-11-28 19:16:24.906417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.906503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.906528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.215 qpair failed and we were unable to recover it. 00:28:04.215 [2024-11-28 19:16:24.906649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.906770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.906794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.215 qpair failed and we were unable to recover it. 00:28:04.215 [2024-11-28 19:16:24.906886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.906998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.907022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.215 qpair failed and we were unable to recover it. 00:28:04.215 [2024-11-28 19:16:24.907113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.907194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.907219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.215 qpair failed and we were unable to recover it. 00:28:04.215 [2024-11-28 19:16:24.907330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.907421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.907447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.215 qpair failed and we were unable to recover it. 00:28:04.215 [2024-11-28 19:16:24.907535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.907643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.907667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.215 qpair failed and we were unable to recover it. 00:28:04.215 [2024-11-28 19:16:24.907748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.907829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.907855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.215 qpair failed and we were unable to recover it. 00:28:04.215 [2024-11-28 19:16:24.907967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.908055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.908081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.215 qpair failed and we were unable to recover it. 00:28:04.215 [2024-11-28 19:16:24.908173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.908279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.908302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.215 qpair failed and we were unable to recover it. 00:28:04.215 [2024-11-28 19:16:24.908418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.908503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.908527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.215 qpair failed and we were unable to recover it. 00:28:04.215 [2024-11-28 19:16:24.908616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.908727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.908753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.215 qpair failed and we were unable to recover it. 00:28:04.215 [2024-11-28 19:16:24.908866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.908947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.908972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.215 qpair failed and we were unable to recover it. 00:28:04.215 [2024-11-28 19:16:24.909081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.909189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.909213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.215 qpair failed and we were unable to recover it. 00:28:04.215 [2024-11-28 19:16:24.909352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.909449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.909474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.215 qpair failed and we were unable to recover it. 00:28:04.215 [2024-11-28 19:16:24.909558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.909642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.909667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.215 qpair failed and we were unable to recover it. 00:28:04.215 [2024-11-28 19:16:24.909802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.909914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.909939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.215 qpair failed and we were unable to recover it. 00:28:04.215 [2024-11-28 19:16:24.910030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.910138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.910163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.215 qpair failed and we were unable to recover it. 00:28:04.215 [2024-11-28 19:16:24.910300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.910413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.910444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.215 qpair failed and we were unable to recover it. 00:28:04.215 [2024-11-28 19:16:24.910647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.910806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.910831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.215 qpair failed and we were unable to recover it. 00:28:04.215 [2024-11-28 19:16:24.910918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.911058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.911083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.215 qpair failed and we were unable to recover it. 00:28:04.215 [2024-11-28 19:16:24.911161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.911241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.911265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.215 qpair failed and we were unable to recover it. 00:28:04.215 [2024-11-28 19:16:24.911353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.911484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.911510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.215 qpair failed and we were unable to recover it. 00:28:04.215 [2024-11-28 19:16:24.911594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.911673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.215 [2024-11-28 19:16:24.911697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.215 qpair failed and we were unable to recover it. 00:28:04.216 [2024-11-28 19:16:24.911817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.911907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.911931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.216 qpair failed and we were unable to recover it. 00:28:04.216 [2024-11-28 19:16:24.912041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.912124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.912148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.216 qpair failed and we were unable to recover it. 00:28:04.216 [2024-11-28 19:16:24.912236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.912346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.912371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.216 qpair failed and we were unable to recover it. 00:28:04.216 [2024-11-28 19:16:24.912495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.912607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.912632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.216 qpair failed and we were unable to recover it. 00:28:04.216 [2024-11-28 19:16:24.912755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.912862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.912885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.216 qpair failed and we were unable to recover it. 00:28:04.216 [2024-11-28 19:16:24.913002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.913081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.913105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.216 qpair failed and we were unable to recover it. 00:28:04.216 [2024-11-28 19:16:24.913190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.913266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.913289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.216 qpair failed and we were unable to recover it. 00:28:04.216 [2024-11-28 19:16:24.913405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.913495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.913520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.216 qpair failed and we were unable to recover it. 00:28:04.216 [2024-11-28 19:16:24.913632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.913748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.913772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.216 qpair failed and we were unable to recover it. 00:28:04.216 [2024-11-28 19:16:24.913885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.913969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.913993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.216 qpair failed and we were unable to recover it. 00:28:04.216 [2024-11-28 19:16:24.914080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.914159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.914184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.216 qpair failed and we were unable to recover it. 00:28:04.216 [2024-11-28 19:16:24.914303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.914422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.914446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.216 qpair failed and we were unable to recover it. 00:28:04.216 [2024-11-28 19:16:24.914528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.914634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.914658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.216 qpair failed and we were unable to recover it. 00:28:04.216 [2024-11-28 19:16:24.914781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.914858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.914882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.216 qpair failed and we were unable to recover it. 00:28:04.216 [2024-11-28 19:16:24.914997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.915074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.915098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.216 qpair failed and we were unable to recover it. 00:28:04.216 [2024-11-28 19:16:24.915195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.915305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.915330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.216 qpair failed and we were unable to recover it. 00:28:04.216 [2024-11-28 19:16:24.915440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.915524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.915549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.216 qpair failed and we were unable to recover it. 00:28:04.216 [2024-11-28 19:16:24.915632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.915719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.915743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.216 qpair failed and we were unable to recover it. 00:28:04.216 [2024-11-28 19:16:24.915830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.915941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.915966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.216 qpair failed and we were unable to recover it. 00:28:04.216 [2024-11-28 19:16:24.916061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.916137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.916161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.216 qpair failed and we were unable to recover it. 00:28:04.216 [2024-11-28 19:16:24.916247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.916357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.916382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.216 qpair failed and we were unable to recover it. 00:28:04.216 [2024-11-28 19:16:24.916468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.916578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.916602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.216 qpair failed and we were unable to recover it. 00:28:04.216 [2024-11-28 19:16:24.916718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.916791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.916816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.216 qpair failed and we were unable to recover it. 00:28:04.216 [2024-11-28 19:16:24.916906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.917018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.917043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.216 qpair failed and we were unable to recover it. 00:28:04.216 [2024-11-28 19:16:24.917156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.917259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.216 [2024-11-28 19:16:24.917284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.216 qpair failed and we were unable to recover it. 00:28:04.216 [2024-11-28 19:16:24.917404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.917517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.917542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.217 qpair failed and we were unable to recover it. 00:28:04.217 [2024-11-28 19:16:24.917621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.917718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.917742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.217 qpair failed and we were unable to recover it. 00:28:04.217 [2024-11-28 19:16:24.917858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.917939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.917963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.217 qpair failed and we were unable to recover it. 00:28:04.217 [2024-11-28 19:16:24.918044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.918153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.918178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.217 qpair failed and we were unable to recover it. 00:28:04.217 [2024-11-28 19:16:24.918267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.918352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.918376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.217 qpair failed and we were unable to recover it. 00:28:04.217 [2024-11-28 19:16:24.918470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.918604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.918628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.217 qpair failed and we were unable to recover it. 00:28:04.217 [2024-11-28 19:16:24.918720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.918831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.918855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.217 qpair failed and we were unable to recover it. 00:28:04.217 [2024-11-28 19:16:24.918969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.919060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.919084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.217 qpair failed and we were unable to recover it. 00:28:04.217 [2024-11-28 19:16:24.919169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.919276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.919300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.217 qpair failed and we were unable to recover it. 00:28:04.217 [2024-11-28 19:16:24.919420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.919535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.919558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.217 qpair failed and we were unable to recover it. 00:28:04.217 [2024-11-28 19:16:24.919669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.919767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.919791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.217 qpair failed and we were unable to recover it. 00:28:04.217 [2024-11-28 19:16:24.919932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.920019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.920044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.217 qpair failed and we were unable to recover it. 00:28:04.217 [2024-11-28 19:16:24.920133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.920215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.920239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.217 qpair failed and we were unable to recover it. 00:28:04.217 [2024-11-28 19:16:24.920329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.920445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.920469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.217 qpair failed and we were unable to recover it. 00:28:04.217 [2024-11-28 19:16:24.920589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.920709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.920734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.217 qpair failed and we were unable to recover it. 00:28:04.217 [2024-11-28 19:16:24.920815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.920893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.920916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.217 qpair failed and we were unable to recover it. 00:28:04.217 [2024-11-28 19:16:24.921029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.921119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.921143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.217 qpair failed and we were unable to recover it. 00:28:04.217 [2024-11-28 19:16:24.921255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.921366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.921390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.217 qpair failed and we were unable to recover it. 00:28:04.217 [2024-11-28 19:16:24.921532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.921642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.921667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.217 qpair failed and we were unable to recover it. 00:28:04.217 [2024-11-28 19:16:24.921777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.921874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.921899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.217 qpair failed and we were unable to recover it. 00:28:04.217 [2024-11-28 19:16:24.921982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.922089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.922119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.217 qpair failed and we were unable to recover it. 00:28:04.217 [2024-11-28 19:16:24.922206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.922311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.217 [2024-11-28 19:16:24.922336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.217 qpair failed and we were unable to recover it. 00:28:04.218 [2024-11-28 19:16:24.922471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.922562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.922587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.218 qpair failed and we were unable to recover it. 00:28:04.218 [2024-11-28 19:16:24.922678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.922792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.922815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.218 qpair failed and we were unable to recover it. 00:28:04.218 [2024-11-28 19:16:24.922900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.922983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.923007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.218 qpair failed and we were unable to recover it. 00:28:04.218 [2024-11-28 19:16:24.923087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.923173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.923198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.218 qpair failed and we were unable to recover it. 00:28:04.218 [2024-11-28 19:16:24.923281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.923371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.923402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.218 qpair failed and we were unable to recover it. 00:28:04.218 [2024-11-28 19:16:24.923493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.923573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.923598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.218 qpair failed and we were unable to recover it. 00:28:04.218 [2024-11-28 19:16:24.923722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.923831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.923856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.218 qpair failed and we were unable to recover it. 00:28:04.218 [2024-11-28 19:16:24.923943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.924024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.924048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.218 qpair failed and we were unable to recover it. 00:28:04.218 [2024-11-28 19:16:24.924160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.924273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.924297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.218 qpair failed and we were unable to recover it. 00:28:04.218 [2024-11-28 19:16:24.924421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.924532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.924556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.218 qpair failed and we were unable to recover it. 00:28:04.218 [2024-11-28 19:16:24.924669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.924783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.924808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.218 qpair failed and we were unable to recover it. 00:28:04.218 [2024-11-28 19:16:24.924916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.925006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.925031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.218 qpair failed and we were unable to recover it. 00:28:04.218 [2024-11-28 19:16:24.925138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.925248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.925272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.218 qpair failed and we were unable to recover it. 00:28:04.218 [2024-11-28 19:16:24.925350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.925430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.925455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.218 qpair failed and we were unable to recover it. 00:28:04.218 [2024-11-28 19:16:24.925543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.925628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.925653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.218 qpair failed and we were unable to recover it. 00:28:04.218 [2024-11-28 19:16:24.925819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.925896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.925919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.218 qpair failed and we were unable to recover it. 00:28:04.218 [2024-11-28 19:16:24.926005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.926088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.926113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.218 qpair failed and we were unable to recover it. 00:28:04.218 [2024-11-28 19:16:24.926192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.926283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.926307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.218 qpair failed and we were unable to recover it. 00:28:04.218 [2024-11-28 19:16:24.926399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.926486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.926510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.218 qpair failed and we were unable to recover it. 00:28:04.218 [2024-11-28 19:16:24.926593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.926672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.926698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.218 qpair failed and we were unable to recover it. 00:28:04.218 [2024-11-28 19:16:24.926815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.926899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.926925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.218 qpair failed and we were unable to recover it. 00:28:04.218 [2024-11-28 19:16:24.927038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.927148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.927172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.218 qpair failed and we were unable to recover it. 00:28:04.218 [2024-11-28 19:16:24.927263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.927375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.927405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.218 qpair failed and we were unable to recover it. 00:28:04.218 [2024-11-28 19:16:24.927511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.927625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.927649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.218 qpair failed and we were unable to recover it. 00:28:04.218 [2024-11-28 19:16:24.927736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.927848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.927871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.218 qpair failed and we were unable to recover it. 00:28:04.218 [2024-11-28 19:16:24.927993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.928112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.928136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.218 qpair failed and we were unable to recover it. 00:28:04.218 [2024-11-28 19:16:24.928219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.218 [2024-11-28 19:16:24.928305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.928329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.219 qpair failed and we were unable to recover it. 00:28:04.219 [2024-11-28 19:16:24.928428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.928506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.928532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.219 qpair failed and we were unable to recover it. 00:28:04.219 [2024-11-28 19:16:24.928642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.928727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.928751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.219 qpair failed and we were unable to recover it. 00:28:04.219 [2024-11-28 19:16:24.928867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.928953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.928977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.219 qpair failed and we were unable to recover it. 00:28:04.219 [2024-11-28 19:16:24.929086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.929205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.929229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.219 qpair failed and we were unable to recover it. 00:28:04.219 [2024-11-28 19:16:24.929345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.929433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.929458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.219 qpair failed and we were unable to recover it. 00:28:04.219 [2024-11-28 19:16:24.929539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.929647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.929671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.219 qpair failed and we were unable to recover it. 00:28:04.219 [2024-11-28 19:16:24.929756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.929840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.929864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.219 qpair failed and we were unable to recover it. 00:28:04.219 [2024-11-28 19:16:24.929976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.930050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.930074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.219 qpair failed and we were unable to recover it. 00:28:04.219 [2024-11-28 19:16:24.930200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.930312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.930336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.219 qpair failed and we were unable to recover it. 00:28:04.219 [2024-11-28 19:16:24.930420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.930508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.930532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.219 qpair failed and we were unable to recover it. 00:28:04.219 [2024-11-28 19:16:24.930643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.930728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.930752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.219 qpair failed and we were unable to recover it. 00:28:04.219 [2024-11-28 19:16:24.930877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.930960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.930984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.219 qpair failed and we were unable to recover it. 00:28:04.219 [2024-11-28 19:16:24.931072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.931157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.931181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.219 qpair failed and we were unable to recover it. 00:28:04.219 [2024-11-28 19:16:24.931268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.931344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.931369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.219 qpair failed and we were unable to recover it. 00:28:04.219 [2024-11-28 19:16:24.931461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.931572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.931596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.219 qpair failed and we were unable to recover it. 00:28:04.219 [2024-11-28 19:16:24.931678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.931787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.931810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.219 qpair failed and we were unable to recover it. 00:28:04.219 [2024-11-28 19:16:24.931902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.932009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.932033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.219 qpair failed and we were unable to recover it. 00:28:04.219 [2024-11-28 19:16:24.932108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.932189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.932214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.219 qpair failed and we were unable to recover it. 00:28:04.219 [2024-11-28 19:16:24.932307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.932430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.932456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.219 qpair failed and we were unable to recover it. 00:28:04.219 [2024-11-28 19:16:24.932550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.932629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.932654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.219 qpair failed and we were unable to recover it. 00:28:04.219 [2024-11-28 19:16:24.932769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.932855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.932879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.219 qpair failed and we were unable to recover it. 00:28:04.219 [2024-11-28 19:16:24.932953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.933031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.933055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.219 qpair failed and we were unable to recover it. 00:28:04.219 [2024-11-28 19:16:24.933140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.219 [2024-11-28 19:16:24.933212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.933240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.220 qpair failed and we were unable to recover it. 00:28:04.220 [2024-11-28 19:16:24.933327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.933435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.933460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.220 qpair failed and we were unable to recover it. 00:28:04.220 [2024-11-28 19:16:24.933600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.933715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.933739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.220 qpair failed and we were unable to recover it. 00:28:04.220 [2024-11-28 19:16:24.933852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.933938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.933963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.220 qpair failed and we were unable to recover it. 00:28:04.220 [2024-11-28 19:16:24.934063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.934173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.934200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.220 qpair failed and we were unable to recover it. 00:28:04.220 [2024-11-28 19:16:24.934337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.934416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.934442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.220 qpair failed and we were unable to recover it. 00:28:04.220 [2024-11-28 19:16:24.934553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 EAL: No free 2048 kB hugepages reported on node 1 00:28:04.220 [2024-11-28 19:16:24.934642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.934668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.220 qpair failed and we were unable to recover it. 00:28:04.220 [2024-11-28 19:16:24.934748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.934862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.934885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.220 qpair failed and we were unable to recover it. 00:28:04.220 [2024-11-28 19:16:24.934976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.935087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.935112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.220 qpair failed and we were unable to recover it. 00:28:04.220 [2024-11-28 19:16:24.935228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.935321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.935345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.220 qpair failed and we were unable to recover it. 00:28:04.220 [2024-11-28 19:16:24.935453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.935544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.935575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.220 qpair failed and we were unable to recover it. 00:28:04.220 [2024-11-28 19:16:24.935651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.935744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.935769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.220 qpair failed and we were unable to recover it. 00:28:04.220 [2024-11-28 19:16:24.935882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.935960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.935986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.220 qpair failed and we were unable to recover it. 00:28:04.220 [2024-11-28 19:16:24.936074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.936186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.936211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.220 qpair failed and we were unable to recover it. 00:28:04.220 [2024-11-28 19:16:24.936299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.936411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.936435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.220 qpair failed and we were unable to recover it. 00:28:04.220 [2024-11-28 19:16:24.936520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.936605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.936630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.220 qpair failed and we were unable to recover it. 00:28:04.220 [2024-11-28 19:16:24.936741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.936855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.936879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.220 qpair failed and we were unable to recover it. 00:28:04.220 [2024-11-28 19:16:24.936963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.937078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.937103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.220 qpair failed and we were unable to recover it. 00:28:04.220 [2024-11-28 19:16:24.937238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.937319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.937343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.220 qpair failed and we were unable to recover it. 00:28:04.220 [2024-11-28 19:16:24.937443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.937553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.937577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.220 qpair failed and we were unable to recover it. 00:28:04.220 [2024-11-28 19:16:24.937659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.937802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.937827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.220 qpair failed and we were unable to recover it. 00:28:04.220 [2024-11-28 19:16:24.937919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.938060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.938084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.220 qpair failed and we were unable to recover it. 00:28:04.220 [2024-11-28 19:16:24.938175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.938258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.938282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.220 qpair failed and we were unable to recover it. 00:28:04.220 [2024-11-28 19:16:24.938365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.938491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.938518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.220 qpair failed and we were unable to recover it. 00:28:04.220 [2024-11-28 19:16:24.938615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.938727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.938751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.220 qpair failed and we were unable to recover it. 00:28:04.220 [2024-11-28 19:16:24.938845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.938954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.938978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.220 qpair failed and we were unable to recover it. 00:28:04.220 [2024-11-28 19:16:24.939066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.939153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.939177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.220 qpair failed and we were unable to recover it. 00:28:04.220 [2024-11-28 19:16:24.939265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.939348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.220 [2024-11-28 19:16:24.939372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.220 qpair failed and we were unable to recover it. 00:28:04.221 [2024-11-28 19:16:24.939521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.939623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.939652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.221 qpair failed and we were unable to recover it. 00:28:04.221 [2024-11-28 19:16:24.939770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.939860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.939886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.221 qpair failed and we were unable to recover it. 00:28:04.221 [2024-11-28 19:16:24.939975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.940065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.940091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.221 qpair failed and we were unable to recover it. 00:28:04.221 [2024-11-28 19:16:24.940196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.940316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.940342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.221 qpair failed and we were unable to recover it. 00:28:04.221 [2024-11-28 19:16:24.940471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.940582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.940608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.221 qpair failed and we were unable to recover it. 00:28:04.221 [2024-11-28 19:16:24.940698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.940812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.940838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.221 qpair failed and we were unable to recover it. 00:28:04.221 [2024-11-28 19:16:24.940926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.941041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.941066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.221 qpair failed and we were unable to recover it. 00:28:04.221 [2024-11-28 19:16:24.941178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.941263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.941291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.221 qpair failed and we were unable to recover it. 00:28:04.221 [2024-11-28 19:16:24.941433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.941516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.941541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.221 qpair failed and we were unable to recover it. 00:28:04.221 [2024-11-28 19:16:24.941626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.941740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.941764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.221 qpair failed and we were unable to recover it. 00:28:04.221 [2024-11-28 19:16:24.941851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.941960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.941985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.221 qpair failed and we were unable to recover it. 00:28:04.221 [2024-11-28 19:16:24.942093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.942179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.942204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.221 qpair failed and we were unable to recover it. 00:28:04.221 [2024-11-28 19:16:24.942286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.942373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.942403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.221 qpair failed and we were unable to recover it. 00:28:04.221 [2024-11-28 19:16:24.942493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.942578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.942602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.221 qpair failed and we were unable to recover it. 00:28:04.221 [2024-11-28 19:16:24.942711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.942818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.942843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.221 qpair failed and we were unable to recover it. 00:28:04.221 [2024-11-28 19:16:24.942925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.943039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.943062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.221 qpair failed and we were unable to recover it. 00:28:04.221 [2024-11-28 19:16:24.943142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.943224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.943249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.221 qpair failed and we were unable to recover it. 00:28:04.221 [2024-11-28 19:16:24.943337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.943444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.943470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.221 qpair failed and we were unable to recover it. 00:28:04.221 [2024-11-28 19:16:24.943556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.943641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.943665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.221 qpair failed and we were unable to recover it. 00:28:04.221 [2024-11-28 19:16:24.943753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.943853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.943877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.221 qpair failed and we were unable to recover it. 00:28:04.221 [2024-11-28 19:16:24.943965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.944048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.944072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.221 qpair failed and we were unable to recover it. 00:28:04.221 [2024-11-28 19:16:24.944160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.221 [2024-11-28 19:16:24.944281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.944306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.222 qpair failed and we were unable to recover it. 00:28:04.222 [2024-11-28 19:16:24.944387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.944475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.944499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.222 qpair failed and we were unable to recover it. 00:28:04.222 [2024-11-28 19:16:24.944593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.944679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.944704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.222 qpair failed and we were unable to recover it. 00:28:04.222 [2024-11-28 19:16:24.944813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.944927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.944952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.222 qpair failed and we were unable to recover it. 00:28:04.222 [2024-11-28 19:16:24.945035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.945119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.945144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.222 qpair failed and we were unable to recover it. 00:28:04.222 [2024-11-28 19:16:24.945283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.945356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.945380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.222 qpair failed and we were unable to recover it. 00:28:04.222 [2024-11-28 19:16:24.945466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.945550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.945574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.222 qpair failed and we were unable to recover it. 00:28:04.222 [2024-11-28 19:16:24.945645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.945757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.945781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.222 qpair failed and we were unable to recover it. 00:28:04.222 [2024-11-28 19:16:24.945896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.945983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.946007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.222 qpair failed and we were unable to recover it. 00:28:04.222 [2024-11-28 19:16:24.946122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.946206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.946232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.222 qpair failed and we were unable to recover it. 00:28:04.222 [2024-11-28 19:16:24.946372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.946460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.946484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.222 qpair failed and we were unable to recover it. 00:28:04.222 [2024-11-28 19:16:24.946570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.946660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.946685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.222 qpair failed and we were unable to recover it. 00:28:04.222 [2024-11-28 19:16:24.946789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.946881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.946907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.222 qpair failed and we were unable to recover it. 00:28:04.222 [2024-11-28 19:16:24.947013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.947095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.947119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.222 qpair failed and we were unable to recover it. 00:28:04.222 [2024-11-28 19:16:24.947230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.947346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.947370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.222 qpair failed and we were unable to recover it. 00:28:04.222 [2024-11-28 19:16:24.947452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.947566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.947590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.222 qpair failed and we were unable to recover it. 00:28:04.222 [2024-11-28 19:16:24.947686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.947818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.947843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.222 qpair failed and we were unable to recover it. 00:28:04.222 [2024-11-28 19:16:24.947956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.948045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.948070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.222 qpair failed and we were unable to recover it. 00:28:04.222 [2024-11-28 19:16:24.948156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.948244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.948267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.222 qpair failed and we were unable to recover it. 00:28:04.222 [2024-11-28 19:16:24.948348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.948441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.948466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.222 qpair failed and we were unable to recover it. 00:28:04.222 [2024-11-28 19:16:24.948554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.948632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.948656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.222 qpair failed and we were unable to recover it. 00:28:04.222 [2024-11-28 19:16:24.948813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.948923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.948947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.222 qpair failed and we were unable to recover it. 00:28:04.222 [2024-11-28 19:16:24.949043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.949152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.949181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.222 qpair failed and we were unable to recover it. 00:28:04.222 [2024-11-28 19:16:24.949289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.949371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.949426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.222 qpair failed and we were unable to recover it. 00:28:04.222 [2024-11-28 19:16:24.949524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.949663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.949688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.222 qpair failed and we were unable to recover it. 00:28:04.222 [2024-11-28 19:16:24.949771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.949905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.949930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.222 qpair failed and we were unable to recover it. 00:28:04.222 [2024-11-28 19:16:24.950038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.222 [2024-11-28 19:16:24.950136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.950161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.223 qpair failed and we were unable to recover it. 00:28:04.223 [2024-11-28 19:16:24.950239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.950350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.950374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.223 qpair failed and we were unable to recover it. 00:28:04.223 [2024-11-28 19:16:24.950472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.950576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.950600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.223 qpair failed and we were unable to recover it. 00:28:04.223 [2024-11-28 19:16:24.950683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.950760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.950784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.223 qpair failed and we were unable to recover it. 00:28:04.223 [2024-11-28 19:16:24.950886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.950966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.950992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.223 qpair failed and we were unable to recover it. 00:28:04.223 [2024-11-28 19:16:24.951082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.951194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.951218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.223 qpair failed and we were unable to recover it. 00:28:04.223 [2024-11-28 19:16:24.951304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.951426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.951453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.223 qpair failed and we were unable to recover it. 00:28:04.223 [2024-11-28 19:16:24.951571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.951653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.951688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.223 qpair failed and we were unable to recover it. 00:28:04.223 [2024-11-28 19:16:24.951784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.951898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.951923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.223 qpair failed and we were unable to recover it. 00:28:04.223 [2024-11-28 19:16:24.952038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.952165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.952190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.223 qpair failed and we were unable to recover it. 00:28:04.223 [2024-11-28 19:16:24.952277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.952382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.952425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.223 qpair failed and we were unable to recover it. 00:28:04.223 [2024-11-28 19:16:24.952541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.952654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.952679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.223 qpair failed and we were unable to recover it. 00:28:04.223 [2024-11-28 19:16:24.952800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.952886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.952911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.223 qpair failed and we were unable to recover it. 00:28:04.223 [2024-11-28 19:16:24.952994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.953108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.953133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.223 qpair failed and we were unable to recover it. 00:28:04.223 [2024-11-28 19:16:24.953239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.953694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.953724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.223 qpair failed and we were unable to recover it. 00:28:04.223 [2024-11-28 19:16:24.953842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.953931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.953957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.223 qpair failed and we were unable to recover it. 00:28:04.223 [2024-11-28 19:16:24.954055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.954215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.954239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.223 qpair failed and we were unable to recover it. 00:28:04.223 [2024-11-28 19:16:24.954332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.954427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.954452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.223 qpair failed and we were unable to recover it. 00:28:04.223 [2024-11-28 19:16:24.954567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.954656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.954680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.223 qpair failed and we were unable to recover it. 00:28:04.223 [2024-11-28 19:16:24.954768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.954893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.954917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.223 qpair failed and we were unable to recover it. 00:28:04.223 [2024-11-28 19:16:24.955057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.955168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.955192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.223 qpair failed and we were unable to recover it. 00:28:04.223 [2024-11-28 19:16:24.955265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.955375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.955407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.223 qpair failed and we were unable to recover it. 00:28:04.223 [2024-11-28 19:16:24.955497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.955573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.955597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.223 qpair failed and we were unable to recover it. 00:28:04.223 [2024-11-28 19:16:24.955742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.955852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.955876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.223 qpair failed and we were unable to recover it. 00:28:04.223 [2024-11-28 19:16:24.955961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.956073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.956096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.223 qpair failed and we were unable to recover it. 00:28:04.223 [2024-11-28 19:16:24.956208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.223 [2024-11-28 19:16:24.956302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.956327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.224 qpair failed and we were unable to recover it. 00:28:04.224 [2024-11-28 19:16:24.956424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.956507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.956531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.224 qpair failed and we were unable to recover it. 00:28:04.224 [2024-11-28 19:16:24.956625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.956701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.956724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.224 qpair failed and we were unable to recover it. 00:28:04.224 [2024-11-28 19:16:24.956845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.956994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.957037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.224 qpair failed and we were unable to recover it. 00:28:04.224 [2024-11-28 19:16:24.957152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.957259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.957291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.224 qpair failed and we were unable to recover it. 00:28:04.224 [2024-11-28 19:16:24.957424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.957517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.957541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.224 qpair failed and we were unable to recover it. 00:28:04.224 [2024-11-28 19:16:24.957657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.957782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.957806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.224 qpair failed and we were unable to recover it. 00:28:04.224 [2024-11-28 19:16:24.957905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.957984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.958008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.224 qpair failed and we were unable to recover it. 00:28:04.224 [2024-11-28 19:16:24.958109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.958199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.958224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.224 qpair failed and we were unable to recover it. 00:28:04.224 [2024-11-28 19:16:24.958307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.958378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.958410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.224 qpair failed and we were unable to recover it. 00:28:04.224 [2024-11-28 19:16:24.958495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.958586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.958609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.224 qpair failed and we were unable to recover it. 00:28:04.224 [2024-11-28 19:16:24.958711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.958786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.958810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.224 qpair failed and we were unable to recover it. 00:28:04.224 [2024-11-28 19:16:24.958922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.959017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.959041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.224 qpair failed and we were unable to recover it. 00:28:04.224 [2024-11-28 19:16:24.959154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.959243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.959269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.224 qpair failed and we were unable to recover it. 00:28:04.224 [2024-11-28 19:16:24.959354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.959473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.959499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.224 qpair failed and we were unable to recover it. 00:28:04.224 [2024-11-28 19:16:24.959586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.959665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.959689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.224 qpair failed and we were unable to recover it. 00:28:04.224 [2024-11-28 19:16:24.959795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.959884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.959908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.224 qpair failed and we were unable to recover it. 00:28:04.224 [2024-11-28 19:16:24.959992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.960073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.960096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.224 qpair failed and we were unable to recover it. 00:28:04.224 [2024-11-28 19:16:24.960182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.960300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.960326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.224 qpair failed and we were unable to recover it. 00:28:04.224 [2024-11-28 19:16:24.960446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.960530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.960556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.224 qpair failed and we were unable to recover it. 00:28:04.224 [2024-11-28 19:16:24.960639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.960780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.960804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.224 qpair failed and we were unable to recover it. 00:28:04.224 [2024-11-28 19:16:24.960888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.224 [2024-11-28 19:16:24.961029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.961053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.225 qpair failed and we were unable to recover it. 00:28:04.225 [2024-11-28 19:16:24.961136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.961222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.961250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.225 qpair failed and we were unable to recover it. 00:28:04.225 [2024-11-28 19:16:24.961332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.961427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.961452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.225 qpair failed and we were unable to recover it. 00:28:04.225 [2024-11-28 19:16:24.961532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.961621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.961644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.225 qpair failed and we were unable to recover it. 00:28:04.225 [2024-11-28 19:16:24.961739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.961862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.961886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.225 qpair failed and we were unable to recover it. 00:28:04.225 [2024-11-28 19:16:24.961960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.962099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.962122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.225 qpair failed and we were unable to recover it. 00:28:04.225 [2024-11-28 19:16:24.962240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.962319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.962343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.225 qpair failed and we were unable to recover it. 00:28:04.225 [2024-11-28 19:16:24.962434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.962544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.962568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.225 qpair failed and we were unable to recover it. 00:28:04.225 [2024-11-28 19:16:24.962679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.962783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.962807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.225 qpair failed and we were unable to recover it. 00:28:04.225 [2024-11-28 19:16:24.962922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.963009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.963034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.225 qpair failed and we were unable to recover it. 00:28:04.225 [2024-11-28 19:16:24.963145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.963256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.963281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.225 qpair failed and we were unable to recover it. 00:28:04.225 [2024-11-28 19:16:24.963365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.963480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.963506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.225 qpair failed and we were unable to recover it. 00:28:04.225 [2024-11-28 19:16:24.963618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.963714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.963739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.225 qpair failed and we were unable to recover it. 00:28:04.225 [2024-11-28 19:16:24.963830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.963904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.963928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.225 qpair failed and we were unable to recover it. 00:28:04.225 [2024-11-28 19:16:24.964041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.964148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.964172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.225 qpair failed and we were unable to recover it. 00:28:04.225 [2024-11-28 19:16:24.964279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.964362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.964387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.225 qpair failed and we were unable to recover it. 00:28:04.225 [2024-11-28 19:16:24.964507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.964597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.964621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.225 qpair failed and we were unable to recover it. 00:28:04.225 [2024-11-28 19:16:24.964708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.964813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.964838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.225 qpair failed and we were unable to recover it. 00:28:04.225 [2024-11-28 19:16:24.964916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.965028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.965054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.225 qpair failed and we were unable to recover it. 00:28:04.225 [2024-11-28 19:16:24.965200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.965279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.965303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.225 qpair failed and we were unable to recover it. 00:28:04.225 [2024-11-28 19:16:24.965407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.965482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.965506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.225 qpair failed and we were unable to recover it. 00:28:04.225 [2024-11-28 19:16:24.965619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.225 [2024-11-28 19:16:24.965701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.965725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.226 qpair failed and we were unable to recover it. 00:28:04.226 [2024-11-28 19:16:24.965828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.965901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.965925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.226 qpair failed and we were unable to recover it. 00:28:04.226 [2024-11-28 19:16:24.966036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.966149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.966172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.226 qpair failed and we were unable to recover it. 00:28:04.226 [2024-11-28 19:16:24.966251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.966359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.966384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.226 qpair failed and we were unable to recover it. 00:28:04.226 [2024-11-28 19:16:24.966484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.966576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.966600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.226 qpair failed and we were unable to recover it. 00:28:04.226 [2024-11-28 19:16:24.966682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.966765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.966790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.226 qpair failed and we were unable to recover it. 00:28:04.226 [2024-11-28 19:16:24.966911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.967018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.967041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.226 qpair failed and we were unable to recover it. 00:28:04.226 [2024-11-28 19:16:24.967130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.967214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.967238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.226 qpair failed and we were unable to recover it. 00:28:04.226 [2024-11-28 19:16:24.967343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.967436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.967461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.226 qpair failed and we were unable to recover it. 00:28:04.226 [2024-11-28 19:16:24.967570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.967647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.967672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.226 qpair failed and we were unable to recover it. 00:28:04.226 [2024-11-28 19:16:24.967755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.967870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.967894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.226 qpair failed and we were unable to recover it. 00:28:04.226 [2024-11-28 19:16:24.967990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.968099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.968123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.226 qpair failed and we were unable to recover it. 00:28:04.226 [2024-11-28 19:16:24.968206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.968288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.968313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.226 qpair failed and we were unable to recover it. 00:28:04.226 [2024-11-28 19:16:24.968423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.968512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.968537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.226 qpair failed and we were unable to recover it. 00:28:04.226 [2024-11-28 19:16:24.968620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.968715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.968739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.226 qpair failed and we were unable to recover it. 00:28:04.226 [2024-11-28 19:16:24.968847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.968983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.969008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.226 qpair failed and we were unable to recover it. 00:28:04.226 [2024-11-28 19:16:24.969125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.969229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.969254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.226 qpair failed and we were unable to recover it. 00:28:04.226 [2024-11-28 19:16:24.969362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.969461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.969486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.226 qpair failed and we were unable to recover it. 00:28:04.226 [2024-11-28 19:16:24.969575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.969660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.969684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.226 qpair failed and we were unable to recover it. 00:28:04.226 [2024-11-28 19:16:24.969767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.969878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.969902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.226 qpair failed and we were unable to recover it. 00:28:04.226 [2024-11-28 19:16:24.970042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.970126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.970150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.226 qpair failed and we were unable to recover it. 00:28:04.226 [2024-11-28 19:16:24.970257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.970342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.970366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.226 qpair failed and we were unable to recover it. 00:28:04.226 [2024-11-28 19:16:24.970479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.970582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.970606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.226 qpair failed and we were unable to recover it. 00:28:04.226 [2024-11-28 19:16:24.970718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.970800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.970824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.226 [2024-11-28 19:16:24.970824] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:28:04.226 qpair failed and we were unable to recover it. 00:28:04.226 [2024-11-28 19:16:24.970914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.971002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.226 [2024-11-28 19:16:24.971028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.226 qpair failed and we were unable to recover it. 00:28:04.226 [2024-11-28 19:16:24.971126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.971212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.971236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.227 qpair failed and we were unable to recover it. 00:28:04.227 [2024-11-28 19:16:24.971341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.971443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.971468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.227 qpair failed and we were unable to recover it. 00:28:04.227 [2024-11-28 19:16:24.971582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.971658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.971682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.227 qpair failed and we were unable to recover it. 00:28:04.227 [2024-11-28 19:16:24.971773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.971907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.971931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.227 qpair failed and we were unable to recover it. 00:28:04.227 [2024-11-28 19:16:24.972046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.972161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.972185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.227 qpair failed and we were unable to recover it. 00:28:04.227 [2024-11-28 19:16:24.972299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.972442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.972467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.227 qpair failed and we were unable to recover it. 00:28:04.227 [2024-11-28 19:16:24.972584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.972670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.972694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.227 qpair failed and we were unable to recover it. 00:28:04.227 [2024-11-28 19:16:24.972788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.972911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.972935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.227 qpair failed and we were unable to recover it. 00:28:04.227 [2024-11-28 19:16:24.973016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.973120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.973144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.227 qpair failed and we were unable to recover it. 00:28:04.227 [2024-11-28 19:16:24.973239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.973347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.973371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.227 qpair failed and we were unable to recover it. 00:28:04.227 [2024-11-28 19:16:24.973461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.973551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.973577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.227 qpair failed and we were unable to recover it. 00:28:04.227 [2024-11-28 19:16:24.973661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.973801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.973826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.227 qpair failed and we were unable to recover it. 00:28:04.227 [2024-11-28 19:16:24.973942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.974051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.974076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.227 qpair failed and we were unable to recover it. 00:28:04.227 [2024-11-28 19:16:24.974188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.974274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.974298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.227 qpair failed and we were unable to recover it. 00:28:04.227 [2024-11-28 19:16:24.974412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.974521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.974546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.227 qpair failed and we were unable to recover it. 00:28:04.227 [2024-11-28 19:16:24.974662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.974753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.974778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.227 qpair failed and we were unable to recover it. 00:28:04.227 [2024-11-28 19:16:24.974876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.974998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.975023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.227 qpair failed and we were unable to recover it. 00:28:04.227 [2024-11-28 19:16:24.975133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.975241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.975265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.227 qpair failed and we were unable to recover it. 00:28:04.227 [2024-11-28 19:16:24.975343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.975441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.975467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.227 qpair failed and we were unable to recover it. 00:28:04.227 [2024-11-28 19:16:24.975585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.975680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.975704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.227 qpair failed and we were unable to recover it. 00:28:04.227 [2024-11-28 19:16:24.975794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.975881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.975904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.227 qpair failed and we were unable to recover it. 00:28:04.227 [2024-11-28 19:16:24.976050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.976141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.976165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.227 qpair failed and we were unable to recover it. 00:28:04.227 [2024-11-28 19:16:24.976285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.976391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.976421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.227 qpair failed and we were unable to recover it. 00:28:04.227 [2024-11-28 19:16:24.976508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.976582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.976607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.227 qpair failed and we were unable to recover it. 00:28:04.227 [2024-11-28 19:16:24.976687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.976759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.976783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.227 qpair failed and we were unable to recover it. 00:28:04.227 [2024-11-28 19:16:24.976859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.976966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.976990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.227 qpair failed and we were unable to recover it. 00:28:04.227 [2024-11-28 19:16:24.977069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.977205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.977232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.227 qpair failed and we were unable to recover it. 00:28:04.227 [2024-11-28 19:16:24.977315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.977408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.977435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.227 qpair failed and we were unable to recover it. 00:28:04.227 [2024-11-28 19:16:24.977519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.977653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.977677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.227 qpair failed and we were unable to recover it. 00:28:04.227 [2024-11-28 19:16:24.977760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.977901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.977926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.227 qpair failed and we were unable to recover it. 00:28:04.227 [2024-11-28 19:16:24.978068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.978149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.978174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.227 qpair failed and we were unable to recover it. 00:28:04.227 [2024-11-28 19:16:24.978288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.978460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.978488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.227 qpair failed and we were unable to recover it. 00:28:04.227 [2024-11-28 19:16:24.978575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.978671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.978705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.227 qpair failed and we were unable to recover it. 00:28:04.227 [2024-11-28 19:16:24.978801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.978914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.978939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.227 qpair failed and we were unable to recover it. 00:28:04.227 [2024-11-28 19:16:24.979052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.979161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.979185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.227 qpair failed and we were unable to recover it. 00:28:04.227 [2024-11-28 19:16:24.979278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.979396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.979423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.227 qpair failed and we were unable to recover it. 00:28:04.227 [2024-11-28 19:16:24.979536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.979655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.227 [2024-11-28 19:16:24.979680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.979782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.979890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.979915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.980026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.980139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.980163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.980244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.980349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.980373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.980465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.980547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.980573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.980697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.980808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.980832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.980950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.981033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.981060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.981173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.981248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.981272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.981367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.981452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.981477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.981563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.981646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.981671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.981780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.981893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.981918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.982032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.982105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.982129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.982232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.982341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.982366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.982455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.982534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.982559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.982696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.982811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.982835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.982920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.983006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.983030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.983116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.983202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.983227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.983324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.983441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.983466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.983578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.983661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.983685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.983802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.983919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.983944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.984031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.984139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.984164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.984306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.984453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.984479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.984560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.984673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.984699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.984824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.984965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.984990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.985104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.985190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.985215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.985301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.985427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.985453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.985541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.985651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.985676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.985814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.985902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.985926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.986027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.986134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.986158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.986248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.986399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.986425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.986512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.986620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.986645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.986774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.986922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.986946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.987033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.987171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.987196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.987275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.987447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.987473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.987589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.987738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.987763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.987875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.987985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.988009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.988125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.988262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.988286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.988406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.988495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.988519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.228 [2024-11-28 19:16:24.988630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.988741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.228 [2024-11-28 19:16:24.988765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.228 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.988881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.988990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.989015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.989130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.989215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.989240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.989350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.989448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.989477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.989591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.989702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.989726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.989835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.989946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.989970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.990092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.990170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.990195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.990279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.990383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.990421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.990534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.990644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.990669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.990758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.990897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.990922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.991071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.991143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.991168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.991247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.991351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.991376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.991473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.991588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.991613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.991726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.991836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.991860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.991946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.992030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.992056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.992196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.992281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.992305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.992421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.992529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.992555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.992643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.992774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.992798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.992945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.993020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.993046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.993140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.993247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.993272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.993377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.993468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.993493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.993610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.993723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.993748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.993871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.993983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.994007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.994145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.994260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.994284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.994428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.994511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.994536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.994625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.994738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.994763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.994881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.994997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.995022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.995109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.995226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.995250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.995388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.995484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.995508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.995591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.995665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.995689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.995826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.995908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.995932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.996017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.996152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.996177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.996311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.996401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.996427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.996519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.996598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.996623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.996709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.996821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.996845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.996936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.997014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.997038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.997120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.997201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.997226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.997317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.997445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.997472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.997567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.997654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.997679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.997821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.997958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.997983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.998071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.998156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.998181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.998298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.998412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.998438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.229 [2024-11-28 19:16:24.998551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.998658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.229 [2024-11-28 19:16:24.998684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.229 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:24.998769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:24.998879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:24.998903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:24.998985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:24.999073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:24.999097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:24.999209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:24.999302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:24.999326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:24.999421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:24.999530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:24.999555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:24.999667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:24.999756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:24.999781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:24.999894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.000013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.000039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.000157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.000264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.000289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.000377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.000507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.000532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.000673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.000754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.000778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.000856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.000941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.000967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.001052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.001158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.001182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.001267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.001370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.001446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.001564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.001656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.001681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.001820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.001932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.001956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.002046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.002151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.002176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.002262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.002369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.002401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.002479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.002610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.002634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.002721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.002830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.002854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.002931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.003018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.003044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.003191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.003302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.003328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.003451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.003537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.003561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.003703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.003813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.003842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.003956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.004068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.004093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.004183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.004294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.004318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.004439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.004547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.004572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.004683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.004766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.004791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.004901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.004988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.005012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.005125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.005257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.005281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.005390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.005505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.005529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.005646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.005733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.005756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.005879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.005965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.005990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.006072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.006212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.006237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.006344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.006437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.006462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.006546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.006655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.006680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.006755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.006833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.006858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.006975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.007064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.007088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.007174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.007287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.007312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.007427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.007518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.007543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.007686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.007773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.007798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.007890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.007992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.008016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.008103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.008186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.008211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.008303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.008452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.008476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.008596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.008703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.008728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.008846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.008958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.008983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.009094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.009177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.009202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.009284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.009403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.009428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.009569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.009650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.009675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.230 qpair failed and we were unable to recover it. 00:28:04.230 [2024-11-28 19:16:25.009790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.230 [2024-11-28 19:16:25.009903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.009928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.231 qpair failed and we were unable to recover it. 00:28:04.231 [2024-11-28 19:16:25.010013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.010149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.010174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.231 qpair failed and we were unable to recover it. 00:28:04.231 [2024-11-28 19:16:25.010264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.010418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.010444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.231 qpair failed and we were unable to recover it. 00:28:04.231 [2024-11-28 19:16:25.010528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.010613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.010637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.231 qpair failed and we were unable to recover it. 00:28:04.231 [2024-11-28 19:16:25.010746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.010857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.010880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.231 qpair failed and we were unable to recover it. 00:28:04.231 [2024-11-28 19:16:25.011021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.011135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.011160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.231 qpair failed and we were unable to recover it. 00:28:04.231 [2024-11-28 19:16:25.011267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.011352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.011378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.231 qpair failed and we were unable to recover it. 00:28:04.231 [2024-11-28 19:16:25.011481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.011561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.011585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.231 qpair failed and we were unable to recover it. 00:28:04.231 [2024-11-28 19:16:25.011669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.011781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.011806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.231 qpair failed and we were unable to recover it. 00:28:04.231 [2024-11-28 19:16:25.011897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.011976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.012000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.231 qpair failed and we were unable to recover it. 00:28:04.231 [2024-11-28 19:16:25.012084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.012206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.012231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.231 qpair failed and we were unable to recover it. 00:28:04.231 [2024-11-28 19:16:25.012317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.012421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.012447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.231 qpair failed and we were unable to recover it. 00:28:04.231 [2024-11-28 19:16:25.012556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.012632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.012657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.231 qpair failed and we were unable to recover it. 00:28:04.231 [2024-11-28 19:16:25.012793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.012873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.012897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.231 qpair failed and we were unable to recover it. 00:28:04.231 [2024-11-28 19:16:25.013013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.013125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.013150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.231 qpair failed and we were unable to recover it. 00:28:04.231 [2024-11-28 19:16:25.013256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.013399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.013428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.231 qpair failed and we were unable to recover it. 00:28:04.231 [2024-11-28 19:16:25.013538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.013651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.013676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.231 qpair failed and we were unable to recover it. 00:28:04.231 [2024-11-28 19:16:25.013787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.013866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.013891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.231 qpair failed and we were unable to recover it. 00:28:04.231 [2024-11-28 19:16:25.013969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.014082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.014106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.231 qpair failed and we were unable to recover it. 00:28:04.231 [2024-11-28 19:16:25.014186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.014297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.014321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.231 qpair failed and we were unable to recover it. 00:28:04.231 [2024-11-28 19:16:25.014404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.014508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.014534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.231 qpair failed and we were unable to recover it. 00:28:04.231 [2024-11-28 19:16:25.014621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.014702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.014727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.231 qpair failed and we were unable to recover it. 00:28:04.231 [2024-11-28 19:16:25.014836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.014948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.014974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.231 qpair failed and we were unable to recover it. 00:28:04.231 [2024-11-28 19:16:25.015091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.015202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.015226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.231 qpair failed and we were unable to recover it. 00:28:04.231 [2024-11-28 19:16:25.015363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.015460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.015485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.231 qpair failed and we were unable to recover it. 00:28:04.231 [2024-11-28 19:16:25.015572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.015682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.015710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.231 qpair failed and we were unable to recover it. 00:28:04.231 [2024-11-28 19:16:25.015820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.015908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.015932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.231 qpair failed and we were unable to recover it. 00:28:04.231 [2024-11-28 19:16:25.016020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.016112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.016136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.231 qpair failed and we were unable to recover it. 00:28:04.231 [2024-11-28 19:16:25.016218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.016310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.016334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.231 qpair failed and we were unable to recover it. 00:28:04.231 [2024-11-28 19:16:25.016453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.016543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.016568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.231 qpair failed and we were unable to recover it. 00:28:04.231 [2024-11-28 19:16:25.016701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.016782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.016807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.231 qpair failed and we were unable to recover it. 00:28:04.231 [2024-11-28 19:16:25.016926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.017005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.017030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.231 qpair failed and we were unable to recover it. 00:28:04.231 [2024-11-28 19:16:25.017144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.017224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.017251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.231 qpair failed and we were unable to recover it. 00:28:04.231 [2024-11-28 19:16:25.017339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.017458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.017484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.231 qpair failed and we were unable to recover it. 00:28:04.231 [2024-11-28 19:16:25.017591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.017706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.017732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.231 qpair failed and we were unable to recover it. 00:28:04.231 [2024-11-28 19:16:25.017845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.017921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.231 [2024-11-28 19:16:25.017945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.018047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.018126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.018151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.018264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.018377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.018406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.018497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.018604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.018629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.018743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.018824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.018849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.018961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.019039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.019065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.019187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.019259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.019284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.019406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.019483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.019508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.019595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.019698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.019723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.019836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.019949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.019974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.020082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.020192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.020216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.020327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.020407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.020432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.020547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.020641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.020665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.020781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.020885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.020909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.021021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.021130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.021154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.021269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.021375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.021405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.021499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.021608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.021632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.021744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.021860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.021886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.021974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.022061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.022086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.022177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.022278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.022302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.022379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.022498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.022522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.022631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.022745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.022770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.022853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.022931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.022956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.023068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.023173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.023199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.023290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.023367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.023398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.023485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.023594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.023619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.023745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.023852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.023878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.023960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.024067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.024091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.024168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.024256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.024281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.024420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.024559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.024584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.024667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.024752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.024776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.024857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.025000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.025026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.025168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.025254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.025279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.025399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.025489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.025515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.025597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.025701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.025725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.025819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.025907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.025932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.026017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.026105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.026129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.026241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.026331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.026355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.026496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.026605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.026629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.026720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.026859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.026884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.026998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.027080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.027105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.027216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.027295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.027326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.027442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.027520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.027546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.232 qpair failed and we were unable to recover it. 00:28:04.232 [2024-11-28 19:16:25.027636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.232 [2024-11-28 19:16:25.027745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.027769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.027862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.027948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.027972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.028058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.028170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.028194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.028280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.028388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.028420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.028575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.028654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.028678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.028767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.028880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.028906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.029013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.029102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.029126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.029232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.029317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.029342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.029429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.029500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.029525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.029637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.029718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.029742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.029855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.029928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.029953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.030065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.030137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.030161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.030272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.030361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.030386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.030489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.030598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.030622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.030712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.030823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.030848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.030958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.031049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.031073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.031189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.031267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.031291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.031404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.031521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.031547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.031638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.031750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.031775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.031917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.032000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.032027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.032115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.032220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.032244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.032330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.032445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.032471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.032562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.032652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.032677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.032764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.032871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.032896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.033012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.033119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.033143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.033257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.033369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.033401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.033484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.033573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.033597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.033677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.033820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.033845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.033958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.034098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.034123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.034253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.034361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.034387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.034540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.034624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.034649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.034739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.034842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.034866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.034980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.035067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.035092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.035204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.035292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.035318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.035406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.035496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.035523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.035639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.035743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.035769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.035856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.035970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.035994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.036082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.036197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.036223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.036328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.036424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.036450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.036590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.036688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.036714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.233 qpair failed and we were unable to recover it. 00:28:04.233 [2024-11-28 19:16:25.036827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.233 [2024-11-28 19:16:25.036941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.036965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.037082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.037195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.037220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.037303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.037383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.037414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.037524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.037613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.037637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.037749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.037861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.037886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.038003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.038114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.038140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.038238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.038353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.038378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.038467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.038575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.038600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.038692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.038805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.038829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.038910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.039048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.039076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.039158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.039278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.039302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.039406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.039495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.039519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.039637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.039743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.039768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.039856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.039947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.039972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.040085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.040220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.040245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.040323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.040440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.040466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.040580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.040661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.040686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.040796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.040873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.040897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.041010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.041121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.041145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.041229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.041313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.041337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.041459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.041549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.041573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.041653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.041747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.041772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.041909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.042019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.042043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.042155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.042268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.042293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.042435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.042541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.042566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.042674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.042791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.042816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.042909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.042992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.043018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.043104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.043212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.043237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.043332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.043414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.043439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.043551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.043632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.043658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.043782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.043863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.043888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.043998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.044102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.044128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.044247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.044331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.044355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.044500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.044578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.044603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.044693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.044832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.044856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.044968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.045075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.045099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.045187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.045277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.045302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.045436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.045544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.045568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.045661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.045748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.045774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.045914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.046024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.046049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.046137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.046273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.046299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.234 qpair failed and we were unable to recover it. 00:28:04.234 [2024-11-28 19:16:25.046411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.046499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.234 [2024-11-28 19:16:25.046524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.235 qpair failed and we were unable to recover it. 00:28:04.235 [2024-11-28 19:16:25.046661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.046772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.046798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.235 qpair failed and we were unable to recover it. 00:28:04.235 [2024-11-28 19:16:25.046881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.046995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.047019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.235 qpair failed and we were unable to recover it. 00:28:04.235 [2024-11-28 19:16:25.047104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.047214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.047238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.235 qpair failed and we were unable to recover it. 00:28:04.235 [2024-11-28 19:16:25.047344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.047428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.047453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.235 qpair failed and we were unable to recover it. 00:28:04.235 [2024-11-28 19:16:25.047533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.047613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.047637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.235 qpair failed and we were unable to recover it. 00:28:04.235 [2024-11-28 19:16:25.047721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.047863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.047887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.235 qpair failed and we were unable to recover it. 00:28:04.235 [2024-11-28 19:16:25.048021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.048154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.048178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.235 qpair failed and we were unable to recover it. 00:28:04.235 [2024-11-28 19:16:25.048261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.048370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.048399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.235 qpair failed and we were unable to recover it. 00:28:04.235 [2024-11-28 19:16:25.048495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.048578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.048602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.235 qpair failed and we were unable to recover it. 00:28:04.235 [2024-11-28 19:16:25.048709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.048798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.048823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.235 qpair failed and we were unable to recover it. 00:28:04.235 [2024-11-28 19:16:25.048905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.048981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.049005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.235 qpair failed and we were unable to recover it. 00:28:04.235 [2024-11-28 19:16:25.049111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.049197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.049223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.235 qpair failed and we were unable to recover it. 00:28:04.235 [2024-11-28 19:16:25.049310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.049415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.049440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.235 qpair failed and we were unable to recover it. 00:28:04.235 [2024-11-28 19:16:25.049558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.049693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.049718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.235 qpair failed and we were unable to recover it. 00:28:04.235 [2024-11-28 19:16:25.049830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.049944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.049970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.235 qpair failed and we were unable to recover it. 00:28:04.235 [2024-11-28 19:16:25.050082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.050164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.050188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.235 qpair failed and we were unable to recover it. 00:28:04.235 [2024-11-28 19:16:25.050274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.050362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.050388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.235 qpair failed and we were unable to recover it. 00:28:04.235 [2024-11-28 19:16:25.050505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.050581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.050606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.235 qpair failed and we were unable to recover it. 00:28:04.235 [2024-11-28 19:16:25.050718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.050829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.050859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.235 qpair failed and we were unable to recover it. 00:28:04.235 [2024-11-28 19:16:25.050945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.051035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.051059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.235 qpair failed and we were unable to recover it. 00:28:04.235 [2024-11-28 19:16:25.051167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.051275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.051299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.235 qpair failed and we were unable to recover it. 00:28:04.235 [2024-11-28 19:16:25.051381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.051490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.051515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.235 qpair failed and we were unable to recover it. 00:28:04.235 [2024-11-28 19:16:25.051629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.051704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.051729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.235 qpair failed and we were unable to recover it. 00:28:04.235 [2024-11-28 19:16:25.051840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.051949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.051973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.235 qpair failed and we were unable to recover it. 00:28:04.235 [2024-11-28 19:16:25.052054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.052167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.052191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.235 qpair failed and we were unable to recover it. 00:28:04.235 [2024-11-28 19:16:25.052299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.052410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.052436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.235 qpair failed and we were unable to recover it. 00:28:04.235 [2024-11-28 19:16:25.052549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.052631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.052663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.235 qpair failed and we were unable to recover it. 00:28:04.235 [2024-11-28 19:16:25.052808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.052891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.052915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.235 qpair failed and we were unable to recover it. 00:28:04.235 [2024-11-28 19:16:25.053003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.053075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.053104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.235 qpair failed and we were unable to recover it. 00:28:04.235 [2024-11-28 19:16:25.053217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.053332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.053357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.235 qpair failed and we were unable to recover it. 00:28:04.235 [2024-11-28 19:16:25.053454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.053570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.053596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.235 qpair failed and we were unable to recover it. 00:28:04.235 [2024-11-28 19:16:25.053679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.053788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.053812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.235 qpair failed and we were unable to recover it. 00:28:04.235 [2024-11-28 19:16:25.053905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.054042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.054066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.235 qpair failed and we were unable to recover it. 00:28:04.235 [2024-11-28 19:16:25.054146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.054253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.054277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.235 qpair failed and we were unable to recover it. 00:28:04.235 [2024-11-28 19:16:25.054384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.054481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.235 [2024-11-28 19:16:25.054505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.235 qpair failed and we were unable to recover it. 00:28:04.235 [2024-11-28 19:16:25.054644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.054789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.054814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.236 qpair failed and we were unable to recover it. 00:28:04.236 [2024-11-28 19:16:25.054922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.055030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.055055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.236 qpair failed and we were unable to recover it. 00:28:04.236 [2024-11-28 19:16:25.055163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.055240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.055264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.236 qpair failed and we were unable to recover it. 00:28:04.236 [2024-11-28 19:16:25.055349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.055462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.055487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.236 qpair failed and we were unable to recover it. 00:28:04.236 [2024-11-28 19:16:25.055580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.055662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.055688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.236 qpair failed and we were unable to recover it. 00:28:04.236 [2024-11-28 19:16:25.055795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.055874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.055898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.236 qpair failed and we were unable to recover it. 00:28:04.236 [2024-11-28 19:16:25.056036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.056149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.056174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.236 qpair failed and we were unable to recover it. 00:28:04.236 [2024-11-28 19:16:25.056287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.056422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.056448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.236 qpair failed and we were unable to recover it. 00:28:04.236 [2024-11-28 19:16:25.056557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.056640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.056664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.236 qpair failed and we were unable to recover it. 00:28:04.236 [2024-11-28 19:16:25.056781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.056868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.056892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.236 qpair failed and we were unable to recover it. 00:28:04.236 [2024-11-28 19:16:25.057012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.057095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.057122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.236 qpair failed and we were unable to recover it. 00:28:04.236 [2024-11-28 19:16:25.057233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.057347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.057372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.236 qpair failed and we were unable to recover it. 00:28:04.236 [2024-11-28 19:16:25.057491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.057575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.057601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.236 qpair failed and we were unable to recover it. 00:28:04.236 [2024-11-28 19:16:25.057718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.057853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.057877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.236 qpair failed and we were unable to recover it. 00:28:04.236 [2024-11-28 19:16:25.057967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.058046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.058071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.236 qpair failed and we were unable to recover it. 00:28:04.236 [2024-11-28 19:16:25.058185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.058268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.058292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.236 qpair failed and we were unable to recover it. 00:28:04.236 [2024-11-28 19:16:25.058377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.058491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.058518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.236 qpair failed and we were unable to recover it. 00:28:04.236 [2024-11-28 19:16:25.058632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.058744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.058769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.236 qpair failed and we were unable to recover it. 00:28:04.236 [2024-11-28 19:16:25.058852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.058938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.058963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.236 qpair failed and we were unable to recover it. 00:28:04.236 [2024-11-28 19:16:25.059106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.059181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.059205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.236 qpair failed and we were unable to recover it. 00:28:04.236 [2024-11-28 19:16:25.059289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.059404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.059430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.236 qpair failed and we were unable to recover it. 00:28:04.236 [2024-11-28 19:16:25.059518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.059600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.059626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.236 qpair failed and we were unable to recover it. 00:28:04.236 [2024-11-28 19:16:25.059731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.059842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.059868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.236 qpair failed and we were unable to recover it. 00:28:04.236 [2024-11-28 19:16:25.059993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.060105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.060129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.236 qpair failed and we were unable to recover it. 00:28:04.236 [2024-11-28 19:16:25.060214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.060299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.060324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.236 qpair failed and we were unable to recover it. 00:28:04.236 [2024-11-28 19:16:25.060428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.060515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.060541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.236 qpair failed and we were unable to recover it. 00:28:04.236 [2024-11-28 19:16:25.060650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.236 [2024-11-28 19:16:25.060765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.060790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.237 qpair failed and we were unable to recover it. 00:28:04.237 [2024-11-28 19:16:25.060877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.060957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.060983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.237 qpair failed and we were unable to recover it. 00:28:04.237 [2024-11-28 19:16:25.061099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.061182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.061206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.237 qpair failed and we were unable to recover it. 00:28:04.237 [2024-11-28 19:16:25.061283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.061366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.061391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.237 qpair failed and we were unable to recover it. 00:28:04.237 [2024-11-28 19:16:25.061479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.061595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.061620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.237 qpair failed and we were unable to recover it. 00:28:04.237 [2024-11-28 19:16:25.061732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.061840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.061865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.237 qpair failed and we were unable to recover it. 00:28:04.237 [2024-11-28 19:16:25.062006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.062085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.062109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.237 qpair failed and we were unable to recover it. 00:28:04.237 [2024-11-28 19:16:25.062224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.062310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.062334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.237 qpair failed and we were unable to recover it. 00:28:04.237 [2024-11-28 19:16:25.062426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.062514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.062540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.237 qpair failed and we were unable to recover it. 00:28:04.237 [2024-11-28 19:16:25.062630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.062739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.062763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.237 qpair failed and we were unable to recover it. 00:28:04.237 [2024-11-28 19:16:25.062877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.062985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.063009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.237 qpair failed and we were unable to recover it. 00:28:04.237 [2024-11-28 19:16:25.063122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.063208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.063232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.237 qpair failed and we were unable to recover it. 00:28:04.237 [2024-11-28 19:16:25.063372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.063468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.063493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.237 qpair failed and we were unable to recover it. 00:28:04.237 [2024-11-28 19:16:25.063580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.063693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.063717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.237 qpair failed and we were unable to recover it. 00:28:04.237 [2024-11-28 19:16:25.063829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.063907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.063932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.237 qpair failed and we were unable to recover it. 00:28:04.237 [2024-11-28 19:16:25.064011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.064100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.064124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.237 qpair failed and we were unable to recover it. 00:28:04.237 [2024-11-28 19:16:25.064199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.064315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.064340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.237 qpair failed and we were unable to recover it. 00:28:04.237 [2024-11-28 19:16:25.064470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.064554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.064579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.237 qpair failed and we were unable to recover it. 00:28:04.237 [2024-11-28 19:16:25.064660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.064809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.064839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.237 qpair failed and we were unable to recover it. 00:28:04.237 [2024-11-28 19:16:25.064948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.065037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.065061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.237 qpair failed and we were unable to recover it. 00:28:04.237 [2024-11-28 19:16:25.065168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.065251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.065276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.237 qpair failed and we were unable to recover it. 00:28:04.237 [2024-11-28 19:16:25.065351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.065470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.065495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.237 qpair failed and we were unable to recover it. 00:28:04.237 [2024-11-28 19:16:25.065577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.065654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.065678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.237 qpair failed and we were unable to recover it. 00:28:04.237 [2024-11-28 19:16:25.065786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.065918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.065943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.237 qpair failed and we were unable to recover it. 00:28:04.237 [2024-11-28 19:16:25.066055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.066129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.237 [2024-11-28 19:16:25.066154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.237 qpair failed and we were unable to recover it. 00:28:04.238 [2024-11-28 19:16:25.066233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.066319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.066344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.238 qpair failed and we were unable to recover it. 00:28:04.238 [2024-11-28 19:16:25.066435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.066519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.066543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.238 qpair failed and we were unable to recover it. 00:28:04.238 [2024-11-28 19:16:25.066657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.066770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.066794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.238 qpair failed and we were unable to recover it. 00:28:04.238 [2024-11-28 19:16:25.066902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.066983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.067007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.238 qpair failed and we were unable to recover it. 00:28:04.238 [2024-11-28 19:16:25.067122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.067235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.067260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.238 qpair failed and we were unable to recover it. 00:28:04.238 [2024-11-28 19:16:25.067371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.067455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.067481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.238 qpair failed and we were unable to recover it. 00:28:04.238 [2024-11-28 19:16:25.067590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.067670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.067696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.238 qpair failed and we were unable to recover it. 00:28:04.238 [2024-11-28 19:16:25.067787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.067866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.067890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.238 qpair failed and we were unable to recover it. 00:28:04.238 [2024-11-28 19:16:25.068008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.068085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.068110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.238 qpair failed and we were unable to recover it. 00:28:04.238 [2024-11-28 19:16:25.068224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.068310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.068336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.238 qpair failed and we were unable to recover it. 00:28:04.238 [2024-11-28 19:16:25.068423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.068513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.068539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.238 qpair failed and we were unable to recover it. 00:28:04.238 [2024-11-28 19:16:25.068624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.068766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.068791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.238 qpair failed and we were unable to recover it. 00:28:04.238 [2024-11-28 19:16:25.068916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.069002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.069026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.238 qpair failed and we were unable to recover it. 00:28:04.238 [2024-11-28 19:16:25.069110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.069214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.069239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.238 qpair failed and we were unable to recover it. 00:28:04.238 [2024-11-28 19:16:25.069359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.069474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.069501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.238 qpair failed and we were unable to recover it. 00:28:04.238 [2024-11-28 19:16:25.069614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.069694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.069718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.238 qpair failed and we were unable to recover it. 00:28:04.238 [2024-11-28 19:16:25.069826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.069904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.069928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.238 qpair failed and we were unable to recover it. 00:28:04.238 [2024-11-28 19:16:25.070044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.070150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.070174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.238 qpair failed and we were unable to recover it. 00:28:04.238 [2024-11-28 19:16:25.070290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.070365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.070389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.238 qpair failed and we were unable to recover it. 00:28:04.238 [2024-11-28 19:16:25.070488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.070566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.070590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.238 qpair failed and we were unable to recover it. 00:28:04.238 [2024-11-28 19:16:25.070703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.070787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.070812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.238 qpair failed and we were unable to recover it. 00:28:04.238 [2024-11-28 19:16:25.070894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.071004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.071029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.238 qpair failed and we were unable to recover it. 00:28:04.238 [2024-11-28 19:16:25.071178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.071257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.071284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.238 qpair failed and we were unable to recover it. 00:28:04.238 [2024-11-28 19:16:25.071366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.071479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.238 [2024-11-28 19:16:25.071506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.238 qpair failed and we were unable to recover it. 00:28:04.238 [2024-11-28 19:16:25.071661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.071797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.071825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.239 qpair failed and we were unable to recover it. 00:28:04.239 [2024-11-28 19:16:25.071917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.072007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.072034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.239 qpair failed and we were unable to recover it. 00:28:04.239 [2024-11-28 19:16:25.072121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.072261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.072287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.239 qpair failed and we were unable to recover it. 00:28:04.239 [2024-11-28 19:16:25.072372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.072461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.072487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.239 qpair failed and we were unable to recover it. 00:28:04.239 [2024-11-28 19:16:25.072571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.072681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.072707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.239 qpair failed and we were unable to recover it. 00:28:04.239 [2024-11-28 19:16:25.072820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.072913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.072939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.239 qpair failed and we were unable to recover it. 00:28:04.239 [2024-11-28 19:16:25.073024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.073107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.073133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.239 qpair failed and we were unable to recover it. 00:28:04.239 [2024-11-28 19:16:25.073226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.073310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.073336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.239 qpair failed and we were unable to recover it. 00:28:04.239 [2024-11-28 19:16:25.073415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.073526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.073550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.239 qpair failed and we were unable to recover it. 00:28:04.239 [2024-11-28 19:16:25.073644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.073723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.073749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.239 qpair failed and we were unable to recover it. 00:28:04.239 [2024-11-28 19:16:25.073841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.073924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.073949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.239 qpair failed and we were unable to recover it. 00:28:04.239 [2024-11-28 19:16:25.074046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.074127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.074152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.239 qpair failed and we were unable to recover it. 00:28:04.239 [2024-11-28 19:16:25.074267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.074342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.074366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.239 qpair failed and we were unable to recover it. 00:28:04.239 [2024-11-28 19:16:25.074455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.074552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.074576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.239 qpair failed and we were unable to recover it. 00:28:04.239 [2024-11-28 19:16:25.074667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.074754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.074779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.239 qpair failed and we were unable to recover it. 00:28:04.239 [2024-11-28 19:16:25.074867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.075004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.075029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.239 qpair failed and we were unable to recover it. 00:28:04.239 [2024-11-28 19:16:25.075110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.075184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.075209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.239 qpair failed and we were unable to recover it. 00:28:04.239 [2024-11-28 19:16:25.075296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.075436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.075461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.239 qpair failed and we were unable to recover it. 00:28:04.239 [2024-11-28 19:16:25.075543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.075631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.075656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.239 qpair failed and we were unable to recover it. 00:28:04.239 [2024-11-28 19:16:25.075735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.075810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.075835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.239 qpair failed and we were unable to recover it. 00:28:04.239 [2024-11-28 19:16:25.075949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.076059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.076083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.239 qpair failed and we were unable to recover it. 00:28:04.239 [2024-11-28 19:16:25.076168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.076285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.076310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.239 qpair failed and we were unable to recover it. 00:28:04.239 [2024-11-28 19:16:25.076404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.076488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.076513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.239 qpair failed and we were unable to recover it. 00:28:04.239 [2024-11-28 19:16:25.076604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.076742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.076767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.239 qpair failed and we were unable to recover it. 00:28:04.239 [2024-11-28 19:16:25.076891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.076970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.239 [2024-11-28 19:16:25.076995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.239 qpair failed and we were unable to recover it. 00:28:04.239 [2024-11-28 19:16:25.077089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.077171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.077196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.240 qpair failed and we were unable to recover it. 00:28:04.240 [2024-11-28 19:16:25.077278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.077369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.077401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.240 qpair failed and we were unable to recover it. 00:28:04.240 [2024-11-28 19:16:25.077489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.077600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.077625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.240 qpair failed and we were unable to recover it. 00:28:04.240 [2024-11-28 19:16:25.077737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.077854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.077879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.240 qpair failed and we were unable to recover it. 00:28:04.240 [2024-11-28 19:16:25.077994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.078077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.078103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.240 qpair failed and we were unable to recover it. 00:28:04.240 [2024-11-28 19:16:25.078188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.078306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.078332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.240 qpair failed and we were unable to recover it. 00:28:04.240 [2024-11-28 19:16:25.078419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.078534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.078560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.240 qpair failed and we were unable to recover it. 00:28:04.240 [2024-11-28 19:16:25.078640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.078725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.078750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.240 qpair failed and we were unable to recover it. 00:28:04.240 [2024-11-28 19:16:25.078888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.078999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.079025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.240 qpair failed and we were unable to recover it. 00:28:04.240 [2024-11-28 19:16:25.079140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.079212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.079237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.240 qpair failed and we were unable to recover it. 00:28:04.240 [2024-11-28 19:16:25.079319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.079437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.079462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.240 qpair failed and we were unable to recover it. 00:28:04.240 [2024-11-28 19:16:25.079549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.079664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.079689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.240 qpair failed and we were unable to recover it. 00:28:04.240 [2024-11-28 19:16:25.079774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.079917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.079942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.240 qpair failed and we were unable to recover it. 00:28:04.240 [2024-11-28 19:16:25.080057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.080131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.080155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.240 qpair failed and we were unable to recover it. 00:28:04.240 [2024-11-28 19:16:25.080273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.080358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.080384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.240 qpair failed and we were unable to recover it. 00:28:04.240 [2024-11-28 19:16:25.080506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.080591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.080617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.240 qpair failed and we were unable to recover it. 00:28:04.240 [2024-11-28 19:16:25.080730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.080814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.080839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.240 qpair failed and we were unable to recover it. 00:28:04.240 [2024-11-28 19:16:25.080951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.081021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.081046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.240 qpair failed and we were unable to recover it. 00:28:04.240 [2024-11-28 19:16:25.081159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.081266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.081291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.240 qpair failed and we were unable to recover it. 00:28:04.240 [2024-11-28 19:16:25.081372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.081477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.081502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.240 qpair failed and we were unable to recover it. 00:28:04.240 [2024-11-28 19:16:25.081586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.081667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.081691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.240 qpair failed and we were unable to recover it. 00:28:04.240 [2024-11-28 19:16:25.081768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.081875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.081899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.240 qpair failed and we were unable to recover it. 00:28:04.240 [2024-11-28 19:16:25.081982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.082057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.082082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.240 qpair failed and we were unable to recover it. 00:28:04.240 [2024-11-28 19:16:25.082157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.082239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.082264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.240 qpair failed and we were unable to recover it. 00:28:04.240 [2024-11-28 19:16:25.082346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.082457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.082484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.240 qpair failed and we were unable to recover it. 00:28:04.240 [2024-11-28 19:16:25.082569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.082656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.082685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.240 qpair failed and we were unable to recover it. 00:28:04.240 [2024-11-28 19:16:25.082763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.240 [2024-11-28 19:16:25.082822] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:04.240 [2024-11-28 19:16:25.082842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.082866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.241 qpair failed and we were unable to recover it. 00:28:04.241 [2024-11-28 19:16:25.082955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.082958] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:04.241 [2024-11-28 19:16:25.082979] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:04.241 [2024-11-28 19:16:25.082993] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:04.241 [2024-11-28 19:16:25.083040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.083063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.241 qpair failed and we were unable to recover it. 00:28:04.241 [2024-11-28 19:16:25.083048] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:28:04.241 [2024-11-28 19:16:25.083152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.083231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.083254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.241 qpair failed and we were unable to recover it. 00:28:04.241 [2024-11-28 19:16:25.083330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.083073] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:28:04.241 [2024-11-28 19:16:25.083417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.083098] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:28:04.241 [2024-11-28 19:16:25.083441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.241 [2024-11-28 19:16:25.083102] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:28:04.241 qpair failed and we were unable to recover it. 00:28:04.241 [2024-11-28 19:16:25.083526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.083635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.083660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.241 qpair failed and we were unable to recover it. 00:28:04.241 [2024-11-28 19:16:25.083748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.083836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.083861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.241 qpair failed and we were unable to recover it. 00:28:04.241 [2024-11-28 19:16:25.083944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.084031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.084056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.241 qpair failed and we were unable to recover it. 00:28:04.241 [2024-11-28 19:16:25.084143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.084260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.084285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.241 qpair failed and we were unable to recover it. 00:28:04.241 [2024-11-28 19:16:25.084375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.084469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.084495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.241 qpair failed and we were unable to recover it. 00:28:04.241 [2024-11-28 19:16:25.084582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.084671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.084696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.241 qpair failed and we were unable to recover it. 00:28:04.241 [2024-11-28 19:16:25.084816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.084925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.084949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.241 qpair failed and we were unable to recover it. 00:28:04.241 [2024-11-28 19:16:25.085045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.085128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.085152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.241 qpair failed and we were unable to recover it. 00:28:04.241 [2024-11-28 19:16:25.085264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.085374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.085403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.241 qpair failed and we were unable to recover it. 00:28:04.241 [2024-11-28 19:16:25.085496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.085600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.085625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.241 qpair failed and we were unable to recover it. 00:28:04.241 [2024-11-28 19:16:25.085712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.085795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.085820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.241 qpair failed and we were unable to recover it. 00:28:04.241 [2024-11-28 19:16:25.085941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.086018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.086044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.241 qpair failed and we were unable to recover it. 00:28:04.241 [2024-11-28 19:16:25.086136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.086215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.086239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.241 qpair failed and we were unable to recover it. 00:28:04.241 [2024-11-28 19:16:25.086331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.086419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.086450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.241 qpair failed and we were unable to recover it. 00:28:04.241 [2024-11-28 19:16:25.086541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.086652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.086677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.241 qpair failed and we were unable to recover it. 00:28:04.241 [2024-11-28 19:16:25.086780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.086857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.086882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.241 qpair failed and we were unable to recover it. 00:28:04.241 [2024-11-28 19:16:25.086963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.087042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.087067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.241 qpair failed and we were unable to recover it. 00:28:04.241 [2024-11-28 19:16:25.087148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.087228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.087252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.241 qpair failed and we were unable to recover it. 00:28:04.241 [2024-11-28 19:16:25.087366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.087490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.241 [2024-11-28 19:16:25.087515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.241 qpair failed and we were unable to recover it. 00:28:04.242 [2024-11-28 19:16:25.087602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.087717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.087742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.242 qpair failed and we were unable to recover it. 00:28:04.242 [2024-11-28 19:16:25.087822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.087896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.087921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.242 qpair failed and we were unable to recover it. 00:28:04.242 [2024-11-28 19:16:25.088004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.088078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.088103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.242 qpair failed and we were unable to recover it. 00:28:04.242 [2024-11-28 19:16:25.088189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.088266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.088291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.242 qpair failed and we were unable to recover it. 00:28:04.242 [2024-11-28 19:16:25.088407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.088494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.088523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.242 qpair failed and we were unable to recover it. 00:28:04.242 [2024-11-28 19:16:25.088621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.088706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.088733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.242 qpair failed and we were unable to recover it. 00:28:04.242 [2024-11-28 19:16:25.088855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.088961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.088985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.242 qpair failed and we were unable to recover it. 00:28:04.242 [2024-11-28 19:16:25.089094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.089178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.089203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.242 qpair failed and we were unable to recover it. 00:28:04.242 [2024-11-28 19:16:25.089314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.089397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.089423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.242 qpair failed and we were unable to recover it. 00:28:04.242 [2024-11-28 19:16:25.089533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.089609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.089634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.242 qpair failed and we were unable to recover it. 00:28:04.242 [2024-11-28 19:16:25.089730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.089804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.089829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.242 qpair failed and we were unable to recover it. 00:28:04.242 [2024-11-28 19:16:25.089921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.090004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.090029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.242 qpair failed and we were unable to recover it. 00:28:04.242 [2024-11-28 19:16:25.090139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.090225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.090250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.242 qpair failed and we were unable to recover it. 00:28:04.242 [2024-11-28 19:16:25.090327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.090438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.090465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.242 qpair failed and we were unable to recover it. 00:28:04.242 [2024-11-28 19:16:25.090543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.090622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.090650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.242 qpair failed and we were unable to recover it. 00:28:04.242 [2024-11-28 19:16:25.090732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.090842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.090866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.242 qpair failed and we were unable to recover it. 00:28:04.242 [2024-11-28 19:16:25.090949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.091028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.091053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.242 qpair failed and we were unable to recover it. 00:28:04.242 [2024-11-28 19:16:25.091142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.091229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.091254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.242 qpair failed and we were unable to recover it. 00:28:04.242 [2024-11-28 19:16:25.091332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.091440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.091466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.242 qpair failed and we were unable to recover it. 00:28:04.242 [2024-11-28 19:16:25.091550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.091672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.091697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.242 qpair failed and we were unable to recover it. 00:28:04.242 [2024-11-28 19:16:25.091806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.091893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.091917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.242 qpair failed and we were unable to recover it. 00:28:04.242 [2024-11-28 19:16:25.092004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.092091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.092115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.242 qpair failed and we were unable to recover it. 00:28:04.242 [2024-11-28 19:16:25.092218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.092297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.092321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.242 qpair failed and we were unable to recover it. 00:28:04.242 [2024-11-28 19:16:25.092401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.092516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.092541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.242 qpair failed and we were unable to recover it. 00:28:04.242 [2024-11-28 19:16:25.092632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.092722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.092751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.242 qpair failed and we were unable to recover it. 00:28:04.242 [2024-11-28 19:16:25.092843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.092947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.092973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.242 qpair failed and we were unable to recover it. 00:28:04.242 [2024-11-28 19:16:25.093056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.093134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.242 [2024-11-28 19:16:25.093159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.242 qpair failed and we were unable to recover it. 00:28:04.242 [2024-11-28 19:16:25.093251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.093364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.093388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.243 qpair failed and we were unable to recover it. 00:28:04.243 [2024-11-28 19:16:25.093481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.093571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.093595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.243 qpair failed and we were unable to recover it. 00:28:04.243 [2024-11-28 19:16:25.093674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.093754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.093779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.243 qpair failed and we were unable to recover it. 00:28:04.243 [2024-11-28 19:16:25.093887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.093962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.093987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.243 qpair failed and we were unable to recover it. 00:28:04.243 [2024-11-28 19:16:25.094079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.094160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.094186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.243 qpair failed and we were unable to recover it. 00:28:04.243 [2024-11-28 19:16:25.094287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.094366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.094399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.243 qpair failed and we were unable to recover it. 00:28:04.243 [2024-11-28 19:16:25.094489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.094566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.094590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.243 qpair failed and we were unable to recover it. 00:28:04.243 [2024-11-28 19:16:25.094670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.094743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.094769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.243 qpair failed and we were unable to recover it. 00:28:04.243 [2024-11-28 19:16:25.094863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.094983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.095008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.243 qpair failed and we were unable to recover it. 00:28:04.243 [2024-11-28 19:16:25.095103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.095252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.095278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.243 qpair failed and we were unable to recover it. 00:28:04.243 [2024-11-28 19:16:25.095362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.095501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.095528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.243 qpair failed and we were unable to recover it. 00:28:04.243 [2024-11-28 19:16:25.095609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.095700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.095725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.243 qpair failed and we were unable to recover it. 00:28:04.243 [2024-11-28 19:16:25.095809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.095943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.095968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.243 qpair failed and we were unable to recover it. 00:28:04.243 [2024-11-28 19:16:25.096049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.096136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.096161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.243 qpair failed and we were unable to recover it. 00:28:04.243 [2024-11-28 19:16:25.096278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.096361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.096385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.243 qpair failed and we were unable to recover it. 00:28:04.243 [2024-11-28 19:16:25.096528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.096616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.096642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.243 qpair failed and we were unable to recover it. 00:28:04.243 [2024-11-28 19:16:25.096729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.096811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.096837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.243 qpair failed and we were unable to recover it. 00:28:04.243 [2024-11-28 19:16:25.096952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.097057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.097083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.243 qpair failed and we were unable to recover it. 00:28:04.243 [2024-11-28 19:16:25.097168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.097251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.097276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.243 qpair failed and we were unable to recover it. 00:28:04.243 [2024-11-28 19:16:25.097361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.097456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.097482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.243 qpair failed and we were unable to recover it. 00:28:04.243 [2024-11-28 19:16:25.097562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.097646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.097673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.243 qpair failed and we were unable to recover it. 00:28:04.243 [2024-11-28 19:16:25.097793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.097888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.097912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.243 qpair failed and we were unable to recover it. 00:28:04.243 [2024-11-28 19:16:25.097997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.098070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.098095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.243 qpair failed and we were unable to recover it. 00:28:04.243 [2024-11-28 19:16:25.098182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.098266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.243 [2024-11-28 19:16:25.098290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.243 qpair failed and we were unable to recover it. 00:28:04.244 [2024-11-28 19:16:25.098380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.098475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.098499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.244 qpair failed and we were unable to recover it. 00:28:04.244 [2024-11-28 19:16:25.098586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.098657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.098681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.244 qpair failed and we were unable to recover it. 00:28:04.244 [2024-11-28 19:16:25.098776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.098879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.098902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.244 qpair failed and we were unable to recover it. 00:28:04.244 [2024-11-28 19:16:25.098988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.099068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.099092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.244 qpair failed and we were unable to recover it. 00:28:04.244 [2024-11-28 19:16:25.099208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.099296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.099321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.244 qpair failed and we were unable to recover it. 00:28:04.244 [2024-11-28 19:16:25.099408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.099494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.099518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.244 qpair failed and we were unable to recover it. 00:28:04.244 [2024-11-28 19:16:25.099605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.099694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.099718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.244 qpair failed and we were unable to recover it. 00:28:04.244 [2024-11-28 19:16:25.099824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.099929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.099953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.244 qpair failed and we were unable to recover it. 00:28:04.244 [2024-11-28 19:16:25.100027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.100102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.100127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.244 qpair failed and we were unable to recover it. 00:28:04.244 [2024-11-28 19:16:25.100236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.100322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.100346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.244 qpair failed and we were unable to recover it. 00:28:04.244 [2024-11-28 19:16:25.100437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.100541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.100567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.244 qpair failed and we were unable to recover it. 00:28:04.244 [2024-11-28 19:16:25.100648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.100743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.100769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.244 qpair failed and we were unable to recover it. 00:28:04.244 [2024-11-28 19:16:25.100878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.101004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.101028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.244 qpair failed and we were unable to recover it. 00:28:04.244 [2024-11-28 19:16:25.101113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.101190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.101214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.244 qpair failed and we were unable to recover it. 00:28:04.244 [2024-11-28 19:16:25.101295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.101367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.101398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.244 qpair failed and we were unable to recover it. 00:28:04.244 [2024-11-28 19:16:25.101517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.101626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.101650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.244 qpair failed and we were unable to recover it. 00:28:04.244 [2024-11-28 19:16:25.101775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.101859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.101884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.244 qpair failed and we were unable to recover it. 00:28:04.244 [2024-11-28 19:16:25.101981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.102052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.102077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.244 qpair failed and we were unable to recover it. 00:28:04.244 [2024-11-28 19:16:25.102155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.102238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.102262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.244 qpair failed and we were unable to recover it. 00:28:04.244 [2024-11-28 19:16:25.102346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.102428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.102455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.244 qpair failed and we were unable to recover it. 00:28:04.244 [2024-11-28 19:16:25.102538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.102623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.102648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.244 qpair failed and we were unable to recover it. 00:28:04.244 [2024-11-28 19:16:25.102743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.102818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.102843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.244 qpair failed and we were unable to recover it. 00:28:04.244 [2024-11-28 19:16:25.102979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.103068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.103093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.244 qpair failed and we were unable to recover it. 00:28:04.244 [2024-11-28 19:16:25.103202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.103272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.244 [2024-11-28 19:16:25.103297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.244 qpair failed and we were unable to recover it. 00:28:04.245 [2024-11-28 19:16:25.103413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.103503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.103528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.245 qpair failed and we were unable to recover it. 00:28:04.245 [2024-11-28 19:16:25.103613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.103716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.103740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.245 qpair failed and we were unable to recover it. 00:28:04.245 [2024-11-28 19:16:25.103830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.103918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.103942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.245 qpair failed and we were unable to recover it. 00:28:04.245 [2024-11-28 19:16:25.104024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.104098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.104122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.245 qpair failed and we were unable to recover it. 00:28:04.245 [2024-11-28 19:16:25.104211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.104290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.104315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.245 qpair failed and we were unable to recover it. 00:28:04.245 [2024-11-28 19:16:25.104505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.104593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.104618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.245 qpair failed and we were unable to recover it. 00:28:04.245 [2024-11-28 19:16:25.104709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.104803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.104828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.245 qpair failed and we were unable to recover it. 00:28:04.245 [2024-11-28 19:16:25.104918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.105000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.105025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.245 qpair failed and we were unable to recover it. 00:28:04.245 [2024-11-28 19:16:25.105116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.105225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.105250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.245 qpair failed and we were unable to recover it. 00:28:04.245 [2024-11-28 19:16:25.105342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.105427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.105460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.245 qpair failed and we were unable to recover it. 00:28:04.245 [2024-11-28 19:16:25.105540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.105648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.105673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.245 qpair failed and we were unable to recover it. 00:28:04.245 [2024-11-28 19:16:25.105784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.105881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.105905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.245 qpair failed and we were unable to recover it. 00:28:04.245 [2024-11-28 19:16:25.105987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.106069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.106095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.245 qpair failed and we were unable to recover it. 00:28:04.245 [2024-11-28 19:16:25.106182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.106270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.106294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.245 qpair failed and we were unable to recover it. 00:28:04.245 [2024-11-28 19:16:25.106378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.106486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.106511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.245 qpair failed and we were unable to recover it. 00:28:04.245 [2024-11-28 19:16:25.106605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.106699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.106723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.245 qpair failed and we were unable to recover it. 00:28:04.245 [2024-11-28 19:16:25.106808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.106916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.106940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.245 qpair failed and we were unable to recover it. 00:28:04.245 [2024-11-28 19:16:25.107040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.107146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.107171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.245 qpair failed and we were unable to recover it. 00:28:04.245 [2024-11-28 19:16:25.107253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.107329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.107353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.245 qpair failed and we were unable to recover it. 00:28:04.245 [2024-11-28 19:16:25.107451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.107568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.107593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.245 qpair failed and we were unable to recover it. 00:28:04.245 [2024-11-28 19:16:25.107711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.107823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.107853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.245 qpair failed and we were unable to recover it. 00:28:04.245 [2024-11-28 19:16:25.107955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.108039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.108066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.245 qpair failed and we were unable to recover it. 00:28:04.245 [2024-11-28 19:16:25.108157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.108240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.108265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.245 qpair failed and we were unable to recover it. 00:28:04.245 [2024-11-28 19:16:25.108354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.108450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.108476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.245 qpair failed and we were unable to recover it. 00:28:04.245 [2024-11-28 19:16:25.108557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.108644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.108674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.245 qpair failed and we were unable to recover it. 00:28:04.245 [2024-11-28 19:16:25.108758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.108873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.108899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.245 qpair failed and we were unable to recover it. 00:28:04.245 [2024-11-28 19:16:25.108984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.109070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.245 [2024-11-28 19:16:25.109095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.245 qpair failed and we were unable to recover it. 00:28:04.246 [2024-11-28 19:16:25.109187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.109271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.109298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.246 qpair failed and we were unable to recover it. 00:28:04.246 [2024-11-28 19:16:25.109414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.109498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.109523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.246 qpair failed and we were unable to recover it. 00:28:04.246 [2024-11-28 19:16:25.109612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.109699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.109725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.246 qpair failed and we were unable to recover it. 00:28:04.246 [2024-11-28 19:16:25.109823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.109893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.109918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.246 qpair failed and we were unable to recover it. 00:28:04.246 [2024-11-28 19:16:25.110010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.110091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.110117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.246 qpair failed and we were unable to recover it. 00:28:04.246 [2024-11-28 19:16:25.110231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.110312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.110337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.246 qpair failed and we were unable to recover it. 00:28:04.246 [2024-11-28 19:16:25.110418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.110509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.110539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.246 qpair failed and we were unable to recover it. 00:28:04.246 [2024-11-28 19:16:25.110625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.110772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.110798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.246 qpair failed and we were unable to recover it. 00:28:04.246 [2024-11-28 19:16:25.110912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.111003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.111028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.246 qpair failed and we were unable to recover it. 00:28:04.246 [2024-11-28 19:16:25.111139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.111245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.111270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.246 qpair failed and we were unable to recover it. 00:28:04.246 [2024-11-28 19:16:25.111357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.111468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.111495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.246 qpair failed and we were unable to recover it. 00:28:04.246 [2024-11-28 19:16:25.111589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.111670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.111695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.246 qpair failed and we were unable to recover it. 00:28:04.246 [2024-11-28 19:16:25.111805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.111890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.111915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.246 qpair failed and we were unable to recover it. 00:28:04.246 [2024-11-28 19:16:25.112013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.112127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.112156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.246 qpair failed and we were unable to recover it. 00:28:04.246 [2024-11-28 19:16:25.112245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.112324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.112350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.246 qpair failed and we were unable to recover it. 00:28:04.246 [2024-11-28 19:16:25.112450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.112536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.112560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.246 qpair failed and we were unable to recover it. 00:28:04.246 [2024-11-28 19:16:25.112639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.112755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.112785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.246 qpair failed and we were unable to recover it. 00:28:04.246 [2024-11-28 19:16:25.112892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.112977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.113003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.246 qpair failed and we were unable to recover it. 00:28:04.246 [2024-11-28 19:16:25.113095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.113179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.113207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.246 qpair failed and we were unable to recover it. 00:28:04.246 [2024-11-28 19:16:25.113290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.113368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.113403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.246 qpair failed and we were unable to recover it. 00:28:04.246 [2024-11-28 19:16:25.113483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.113563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.113589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.246 qpair failed and we were unable to recover it. 00:28:04.246 [2024-11-28 19:16:25.113671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.113761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.113786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.246 qpair failed and we were unable to recover it. 00:28:04.246 [2024-11-28 19:16:25.113902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.113987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.114013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.246 qpair failed and we were unable to recover it. 00:28:04.246 [2024-11-28 19:16:25.114106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.114192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.114217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.246 qpair failed and we were unable to recover it. 00:28:04.246 [2024-11-28 19:16:25.114302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.114376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.114414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.246 qpair failed and we were unable to recover it. 00:28:04.246 [2024-11-28 19:16:25.114536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.114623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.246 [2024-11-28 19:16:25.114648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.246 qpair failed and we were unable to recover it. 00:28:04.246 [2024-11-28 19:16:25.114772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.114885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.114911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.247 qpair failed and we were unable to recover it. 00:28:04.247 [2024-11-28 19:16:25.115002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.115095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.115119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.247 qpair failed and we were unable to recover it. 00:28:04.247 [2024-11-28 19:16:25.115208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.115286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.115310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.247 qpair failed and we were unable to recover it. 00:28:04.247 [2024-11-28 19:16:25.115426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.115538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.115563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.247 qpair failed and we were unable to recover it. 00:28:04.247 [2024-11-28 19:16:25.115688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.115774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.115799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.247 qpair failed and we were unable to recover it. 00:28:04.247 [2024-11-28 19:16:25.115878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.116017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.116042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.247 qpair failed and we were unable to recover it. 00:28:04.247 [2024-11-28 19:16:25.116137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.116223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.116247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.247 qpair failed and we were unable to recover it. 00:28:04.247 [2024-11-28 19:16:25.116333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.116421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.116447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.247 qpair failed and we were unable to recover it. 00:28:04.247 [2024-11-28 19:16:25.116528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.116638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.116663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.247 qpair failed and we were unable to recover it. 00:28:04.247 [2024-11-28 19:16:25.116757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.116874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.116899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.247 qpair failed and we were unable to recover it. 00:28:04.247 [2024-11-28 19:16:25.116984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.117069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.117096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.247 qpair failed and we were unable to recover it. 00:28:04.247 [2024-11-28 19:16:25.117190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.117272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.117298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.247 qpair failed and we were unable to recover it. 00:28:04.247 [2024-11-28 19:16:25.117378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.117498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.117524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.247 qpair failed and we were unable to recover it. 00:28:04.247 [2024-11-28 19:16:25.117639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.117747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.117772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.247 qpair failed and we were unable to recover it. 00:28:04.247 [2024-11-28 19:16:25.117889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.117969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.117993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.247 qpair failed and we were unable to recover it. 00:28:04.247 [2024-11-28 19:16:25.118111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.118215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.118239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.247 qpair failed and we were unable to recover it. 00:28:04.247 [2024-11-28 19:16:25.118349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.118449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.118478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.247 qpair failed and we were unable to recover it. 00:28:04.247 [2024-11-28 19:16:25.118573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.118655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.118680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.247 qpair failed and we were unable to recover it. 00:28:04.247 [2024-11-28 19:16:25.118757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.118865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.118891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.247 qpair failed and we were unable to recover it. 00:28:04.247 [2024-11-28 19:16:25.118973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.119085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.119114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.247 qpair failed and we were unable to recover it. 00:28:04.247 [2024-11-28 19:16:25.119194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.119281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.119306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.247 qpair failed and we were unable to recover it. 00:28:04.247 [2024-11-28 19:16:25.119406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.119526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.119551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.247 qpair failed and we were unable to recover it. 00:28:04.247 [2024-11-28 19:16:25.119639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.119757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.119781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.247 qpair failed and we were unable to recover it. 00:28:04.247 [2024-11-28 19:16:25.119861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.119977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.120001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.247 qpair failed and we were unable to recover it. 00:28:04.247 [2024-11-28 19:16:25.120078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.120160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.120185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.247 qpair failed and we were unable to recover it. 00:28:04.247 [2024-11-28 19:16:25.120308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.120414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.120441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.247 qpair failed and we were unable to recover it. 00:28:04.247 [2024-11-28 19:16:25.120540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.120622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.247 [2024-11-28 19:16:25.120647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.248 qpair failed and we were unable to recover it. 00:28:04.248 [2024-11-28 19:16:25.120768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.120883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.120919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.248 qpair failed and we were unable to recover it. 00:28:04.248 [2024-11-28 19:16:25.121012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.121100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.121125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.248 qpair failed and we were unable to recover it. 00:28:04.248 [2024-11-28 19:16:25.121205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.121290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.121316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.248 qpair failed and we were unable to recover it. 00:28:04.248 [2024-11-28 19:16:25.121414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.121492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.121518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.248 qpair failed and we were unable to recover it. 00:28:04.248 [2024-11-28 19:16:25.121633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.121748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.121772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.248 qpair failed and we were unable to recover it. 00:28:04.248 [2024-11-28 19:16:25.121856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.121941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.121966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.248 qpair failed and we were unable to recover it. 00:28:04.248 [2024-11-28 19:16:25.122076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.122168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.122193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.248 qpair failed and we were unable to recover it. 00:28:04.248 [2024-11-28 19:16:25.122304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.122385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.122417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.248 qpair failed and we were unable to recover it. 00:28:04.248 [2024-11-28 19:16:25.122504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.122594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.122618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.248 qpair failed and we were unable to recover it. 00:28:04.248 [2024-11-28 19:16:25.122710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.122800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.122825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.248 qpair failed and we were unable to recover it. 00:28:04.248 [2024-11-28 19:16:25.122907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.123015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.123048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.248 qpair failed and we were unable to recover it. 00:28:04.248 [2024-11-28 19:16:25.123142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.123226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.123253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.248 qpair failed and we were unable to recover it. 00:28:04.248 [2024-11-28 19:16:25.123328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.123433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.123459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.248 qpair failed and we were unable to recover it. 00:28:04.248 [2024-11-28 19:16:25.123560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.123639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.123665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.248 qpair failed and we were unable to recover it. 00:28:04.248 [2024-11-28 19:16:25.123745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.123835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.123861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.248 qpair failed and we were unable to recover it. 00:28:04.248 [2024-11-28 19:16:25.123974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.124081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.124107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.248 qpair failed and we were unable to recover it. 00:28:04.248 [2024-11-28 19:16:25.124196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.124309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.124335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.248 qpair failed and we were unable to recover it. 00:28:04.248 [2024-11-28 19:16:25.124440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.124532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.124561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.248 qpair failed and we were unable to recover it. 00:28:04.248 [2024-11-28 19:16:25.124653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.124752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.124777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.248 qpair failed and we were unable to recover it. 00:28:04.248 [2024-11-28 19:16:25.124888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.124968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.124993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.248 qpair failed and we were unable to recover it. 00:28:04.248 [2024-11-28 19:16:25.125078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.125189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.125219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.248 qpair failed and we were unable to recover it. 00:28:04.248 [2024-11-28 19:16:25.125304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.125398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.125424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.248 qpair failed and we were unable to recover it. 00:28:04.248 [2024-11-28 19:16:25.125542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.125632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.125657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.248 qpair failed and we were unable to recover it. 00:28:04.248 [2024-11-28 19:16:25.125795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.125900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.125932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.248 qpair failed and we were unable to recover it. 00:28:04.248 [2024-11-28 19:16:25.126045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.126140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.248 [2024-11-28 19:16:25.126167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.249 qpair failed and we were unable to recover it. 00:28:04.249 [2024-11-28 19:16:25.126259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.126377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.126412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.249 qpair failed and we were unable to recover it. 00:28:04.249 [2024-11-28 19:16:25.126509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.126589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.126614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.249 qpair failed and we were unable to recover it. 00:28:04.249 [2024-11-28 19:16:25.126701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.126790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.126816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.249 qpair failed and we were unable to recover it. 00:28:04.249 [2024-11-28 19:16:25.126906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.126982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.127008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.249 qpair failed and we were unable to recover it. 00:28:04.249 [2024-11-28 19:16:25.127098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.127211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.127236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.249 qpair failed and we were unable to recover it. 00:28:04.249 [2024-11-28 19:16:25.127359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.127456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.127483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.249 qpair failed and we were unable to recover it. 00:28:04.249 [2024-11-28 19:16:25.127575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.127664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.127691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.249 qpair failed and we were unable to recover it. 00:28:04.249 [2024-11-28 19:16:25.127811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.127924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.127954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.249 qpair failed and we were unable to recover it. 00:28:04.249 [2024-11-28 19:16:25.128051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.128168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.128194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.249 qpair failed and we were unable to recover it. 00:28:04.249 [2024-11-28 19:16:25.128291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.128374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.128450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.249 qpair failed and we were unable to recover it. 00:28:04.249 [2024-11-28 19:16:25.128546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.128633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.128660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.249 qpair failed and we were unable to recover it. 00:28:04.249 [2024-11-28 19:16:25.128776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.128873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.128901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.249 qpair failed and we were unable to recover it. 00:28:04.249 [2024-11-28 19:16:25.128986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.129073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.129099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.249 qpair failed and we were unable to recover it. 00:28:04.249 [2024-11-28 19:16:25.129207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.129296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.129323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.249 qpair failed and we were unable to recover it. 00:28:04.249 [2024-11-28 19:16:25.129418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.129534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.129559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.249 qpair failed and we were unable to recover it. 00:28:04.249 [2024-11-28 19:16:25.129643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.129739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.129763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.249 qpair failed and we were unable to recover it. 00:28:04.249 [2024-11-28 19:16:25.129812] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1d92600 (9): Bad file descriptor 00:28:04.249 [2024-11-28 19:16:25.129978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.130083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.130113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.249 qpair failed and we were unable to recover it. 00:28:04.249 [2024-11-28 19:16:25.130200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.130287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.130315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.249 qpair failed and we were unable to recover it. 00:28:04.249 [2024-11-28 19:16:25.130431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.130520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.130546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.249 qpair failed and we were unable to recover it. 00:28:04.249 [2024-11-28 19:16:25.130632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.130805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.130832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.249 qpair failed and we were unable to recover it. 00:28:04.249 [2024-11-28 19:16:25.130918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.131013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.131040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.249 qpair failed and we were unable to recover it. 00:28:04.249 [2024-11-28 19:16:25.131124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.131217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.131243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.249 qpair failed and we were unable to recover it. 00:28:04.249 [2024-11-28 19:16:25.131329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.131423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.131451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.249 qpair failed and we were unable to recover it. 00:28:04.249 [2024-11-28 19:16:25.131538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.131634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.131660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.249 qpair failed and we were unable to recover it. 00:28:04.249 [2024-11-28 19:16:25.131744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.131830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.131856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.249 qpair failed and we were unable to recover it. 00:28:04.249 [2024-11-28 19:16:25.131940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.132026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.132059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.249 qpair failed and we were unable to recover it. 00:28:04.249 [2024-11-28 19:16:25.132142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.132222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.132248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.249 qpair failed and we were unable to recover it. 00:28:04.249 [2024-11-28 19:16:25.132388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.132514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.132542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.249 qpair failed and we were unable to recover it. 00:28:04.249 [2024-11-28 19:16:25.132661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.132782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.132807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.249 qpair failed and we were unable to recover it. 00:28:04.249 [2024-11-28 19:16:25.132912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.133001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.249 [2024-11-28 19:16:25.133026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.249 qpair failed and we were unable to recover it. 00:28:04.250 [2024-11-28 19:16:25.133130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.133222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.133248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.250 qpair failed and we were unable to recover it. 00:28:04.250 [2024-11-28 19:16:25.133380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.133477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.133503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.250 qpair failed and we were unable to recover it. 00:28:04.250 [2024-11-28 19:16:25.133586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.133668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.133701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.250 qpair failed and we were unable to recover it. 00:28:04.250 [2024-11-28 19:16:25.133779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.133867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.133894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.250 qpair failed and we were unable to recover it. 00:28:04.250 [2024-11-28 19:16:25.133981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.134092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.134118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.250 qpair failed and we were unable to recover it. 00:28:04.250 [2024-11-28 19:16:25.134234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.134321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.134347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.250 qpair failed and we were unable to recover it. 00:28:04.250 [2024-11-28 19:16:25.134445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.134520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.134546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.250 qpair failed and we were unable to recover it. 00:28:04.250 [2024-11-28 19:16:25.134628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.134749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.134775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.250 qpair failed and we were unable to recover it. 00:28:04.250 [2024-11-28 19:16:25.134861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.134944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.134970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.250 qpair failed and we were unable to recover it. 00:28:04.250 [2024-11-28 19:16:25.135049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.135125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.135150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.250 qpair failed and we were unable to recover it. 00:28:04.250 [2024-11-28 19:16:25.135243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.135391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.135425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.250 qpair failed and we were unable to recover it. 00:28:04.250 [2024-11-28 19:16:25.135507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.135595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.135622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.250 qpair failed and we were unable to recover it. 00:28:04.250 [2024-11-28 19:16:25.135722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.135800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.135826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.250 qpair failed and we were unable to recover it. 00:28:04.250 [2024-11-28 19:16:25.135937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.136020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.136046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.250 qpair failed and we were unable to recover it. 00:28:04.250 [2024-11-28 19:16:25.136127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.136214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.136241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.250 qpair failed and we were unable to recover it. 00:28:04.250 [2024-11-28 19:16:25.136327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.136433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.136460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.250 qpair failed and we were unable to recover it. 00:28:04.250 [2024-11-28 19:16:25.136548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.136643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.136669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.250 qpair failed and we were unable to recover it. 00:28:04.250 [2024-11-28 19:16:25.136750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.136837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.136862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.250 qpair failed and we were unable to recover it. 00:28:04.250 [2024-11-28 19:16:25.136942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.137028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.137054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.250 qpair failed and we were unable to recover it. 00:28:04.250 [2024-11-28 19:16:25.137138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.137229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.137256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.250 qpair failed and we were unable to recover it. 00:28:04.250 [2024-11-28 19:16:25.137338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.137438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.137465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.250 qpair failed and we were unable to recover it. 00:28:04.250 [2024-11-28 19:16:25.137551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.137633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.137658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.250 qpair failed and we were unable to recover it. 00:28:04.250 [2024-11-28 19:16:25.137755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.137854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.137882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.250 qpair failed and we were unable to recover it. 00:28:04.250 [2024-11-28 19:16:25.137970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.138076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.138100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.250 qpair failed and we were unable to recover it. 00:28:04.250 [2024-11-28 19:16:25.138183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.138266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.138293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.250 qpair failed and we were unable to recover it. 00:28:04.250 [2024-11-28 19:16:25.138378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.138467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.138492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.250 qpair failed and we were unable to recover it. 00:28:04.250 [2024-11-28 19:16:25.138582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.138674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.138698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.250 qpair failed and we were unable to recover it. 00:28:04.250 [2024-11-28 19:16:25.138783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.138862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.138887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.250 qpair failed and we were unable to recover it. 00:28:04.250 [2024-11-28 19:16:25.138972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.139055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.139079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.250 qpair failed and we were unable to recover it. 00:28:04.250 [2024-11-28 19:16:25.139186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.139298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.139326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.250 qpair failed and we were unable to recover it. 00:28:04.250 [2024-11-28 19:16:25.139429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.139516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.139543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.250 qpair failed and we were unable to recover it. 00:28:04.250 [2024-11-28 19:16:25.139643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.139739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.250 [2024-11-28 19:16:25.139769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.250 qpair failed and we were unable to recover it. 00:28:04.250 [2024-11-28 19:16:25.139856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.139942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.139974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.251 qpair failed and we were unable to recover it. 00:28:04.251 [2024-11-28 19:16:25.140078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.140166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.140192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.251 qpair failed and we were unable to recover it. 00:28:04.251 [2024-11-28 19:16:25.140305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.140406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.140432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.251 qpair failed and we were unable to recover it. 00:28:04.251 [2024-11-28 19:16:25.140515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.140597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.140622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.251 qpair failed and we were unable to recover it. 00:28:04.251 [2024-11-28 19:16:25.140732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.140851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.140877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.251 qpair failed and we were unable to recover it. 00:28:04.251 [2024-11-28 19:16:25.140955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.141043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.141068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.251 qpair failed and we were unable to recover it. 00:28:04.251 [2024-11-28 19:16:25.141214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.141295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.141319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.251 qpair failed and we were unable to recover it. 00:28:04.251 [2024-11-28 19:16:25.141420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.141507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.141533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.251 qpair failed and we were unable to recover it. 00:28:04.251 [2024-11-28 19:16:25.141615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.141705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.141729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.251 qpair failed and we were unable to recover it. 00:28:04.251 [2024-11-28 19:16:25.141811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.141946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.141971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.251 qpair failed and we were unable to recover it. 00:28:04.251 [2024-11-28 19:16:25.142055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.142139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.142163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.251 qpair failed and we were unable to recover it. 00:28:04.251 [2024-11-28 19:16:25.142271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.142357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.142383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.251 qpair failed and we were unable to recover it. 00:28:04.251 [2024-11-28 19:16:25.142475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.142556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.142582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.251 qpair failed and we were unable to recover it. 00:28:04.251 [2024-11-28 19:16:25.142670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.142786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.142811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.251 qpair failed and we were unable to recover it. 00:28:04.251 [2024-11-28 19:16:25.142903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.142984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.143014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.251 qpair failed and we were unable to recover it. 00:28:04.251 [2024-11-28 19:16:25.143134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.143215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.143241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.251 qpair failed and we were unable to recover it. 00:28:04.251 [2024-11-28 19:16:25.143352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.143455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.143480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.251 qpair failed and we were unable to recover it. 00:28:04.251 [2024-11-28 19:16:25.143566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.143644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.143671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.251 qpair failed and we were unable to recover it. 00:28:04.251 [2024-11-28 19:16:25.143776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.143884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.143917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.251 qpair failed and we were unable to recover it. 00:28:04.251 [2024-11-28 19:16:25.144002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.144093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.144118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.251 qpair failed and we were unable to recover it. 00:28:04.251 [2024-11-28 19:16:25.144211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.144292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.144316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.251 qpair failed and we were unable to recover it. 00:28:04.251 [2024-11-28 19:16:25.144437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.144517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.144542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.251 qpair failed and we were unable to recover it. 00:28:04.251 [2024-11-28 19:16:25.144627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.144722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.144748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.251 qpair failed and we were unable to recover it. 00:28:04.251 [2024-11-28 19:16:25.144823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.144906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.144930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.251 qpair failed and we were unable to recover it. 00:28:04.251 [2024-11-28 19:16:25.145051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.145144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.145170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.251 qpair failed and we were unable to recover it. 00:28:04.251 [2024-11-28 19:16:25.145266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.145345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.145374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.251 qpair failed and we were unable to recover it. 00:28:04.251 [2024-11-28 19:16:25.145463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.145550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.145576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.251 qpair failed and we were unable to recover it. 00:28:04.251 [2024-11-28 19:16:25.145660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.145768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.145792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.251 qpair failed and we were unable to recover it. 00:28:04.251 [2024-11-28 19:16:25.145881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.145964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.251 [2024-11-28 19:16:25.145994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.251 qpair failed and we were unable to recover it. 00:28:04.252 [2024-11-28 19:16:25.146122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.146205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.146230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.252 qpair failed and we were unable to recover it. 00:28:04.252 [2024-11-28 19:16:25.146348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.146450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.146477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.252 qpair failed and we were unable to recover it. 00:28:04.252 [2024-11-28 19:16:25.146562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.146645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.146670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.252 qpair failed and we were unable to recover it. 00:28:04.252 [2024-11-28 19:16:25.146782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.146856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.146881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.252 qpair failed and we were unable to recover it. 00:28:04.252 [2024-11-28 19:16:25.146971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.147057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.147086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.252 qpair failed and we were unable to recover it. 00:28:04.252 [2024-11-28 19:16:25.147178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.147269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.147302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.252 qpair failed and we were unable to recover it. 00:28:04.252 [2024-11-28 19:16:25.147422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.147520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.147548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.252 qpair failed and we were unable to recover it. 00:28:04.252 [2024-11-28 19:16:25.147646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.147768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.147795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.252 qpair failed and we were unable to recover it. 00:28:04.252 [2024-11-28 19:16:25.147901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.147982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.148008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.252 qpair failed and we were unable to recover it. 00:28:04.252 [2024-11-28 19:16:25.148102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.148182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.148208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.252 qpair failed and we were unable to recover it. 00:28:04.252 [2024-11-28 19:16:25.148317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.148404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.148431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.252 qpair failed and we were unable to recover it. 00:28:04.252 [2024-11-28 19:16:25.148514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.148602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.148628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.252 qpair failed and we were unable to recover it. 00:28:04.252 [2024-11-28 19:16:25.148724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.148844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.148869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.252 qpair failed and we were unable to recover it. 00:28:04.252 [2024-11-28 19:16:25.148987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.149075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.149101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.252 qpair failed and we were unable to recover it. 00:28:04.252 [2024-11-28 19:16:25.149223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.149315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.149341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.252 qpair failed and we were unable to recover it. 00:28:04.252 [2024-11-28 19:16:25.149431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.149528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.149555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.252 qpair failed and we were unable to recover it. 00:28:04.252 [2024-11-28 19:16:25.149651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.149739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.149765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.252 qpair failed and we were unable to recover it. 00:28:04.252 [2024-11-28 19:16:25.149842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.149927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.149953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.252 qpair failed and we were unable to recover it. 00:28:04.252 [2024-11-28 19:16:25.150049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.150126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.150152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.252 qpair failed and we were unable to recover it. 00:28:04.252 [2024-11-28 19:16:25.150235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.150319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.150346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.252 qpair failed and we were unable to recover it. 00:28:04.252 [2024-11-28 19:16:25.150441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.150526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.150552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.252 qpair failed and we were unable to recover it. 00:28:04.252 [2024-11-28 19:16:25.150662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.150777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.150803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.252 qpair failed and we were unable to recover it. 00:28:04.252 [2024-11-28 19:16:25.150881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.150966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.150992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.252 qpair failed and we were unable to recover it. 00:28:04.252 [2024-11-28 19:16:25.151105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.151195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.151222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.252 qpair failed and we were unable to recover it. 00:28:04.252 [2024-11-28 19:16:25.151307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.151414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.151446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.252 qpair failed and we were unable to recover it. 00:28:04.252 [2024-11-28 19:16:25.151542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.151632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.151657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.252 qpair failed and we were unable to recover it. 00:28:04.252 [2024-11-28 19:16:25.151746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.151835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.151866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.252 qpair failed and we were unable to recover it. 00:28:04.252 [2024-11-28 19:16:25.151977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.152115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.152141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.252 qpair failed and we were unable to recover it. 00:28:04.252 [2024-11-28 19:16:25.152220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.152306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.252 [2024-11-28 19:16:25.152332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.252 qpair failed and we were unable to recover it. 00:28:04.252 [2024-11-28 19:16:25.152429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.152511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.152537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.253 qpair failed and we were unable to recover it. 00:28:04.253 [2024-11-28 19:16:25.152627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.152749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.152777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.253 qpair failed and we were unable to recover it. 00:28:04.253 [2024-11-28 19:16:25.152867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.152962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.152987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.253 qpair failed and we were unable to recover it. 00:28:04.253 [2024-11-28 19:16:25.153072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.153153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.153179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.253 qpair failed and we were unable to recover it. 00:28:04.253 [2024-11-28 19:16:25.153269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.153360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.153386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.253 qpair failed and we were unable to recover it. 00:28:04.253 [2024-11-28 19:16:25.153481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.153558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.153583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.253 qpair failed and we were unable to recover it. 00:28:04.253 [2024-11-28 19:16:25.153667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.153763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.153790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.253 qpair failed and we were unable to recover it. 00:28:04.253 [2024-11-28 19:16:25.153874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.153964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.153990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.253 qpair failed and we were unable to recover it. 00:28:04.253 [2024-11-28 19:16:25.154074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.154161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.154188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.253 qpair failed and we were unable to recover it. 00:28:04.253 [2024-11-28 19:16:25.154279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.154358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.154384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.253 qpair failed and we were unable to recover it. 00:28:04.253 [2024-11-28 19:16:25.154478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.154559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.154585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.253 qpair failed and we were unable to recover it. 00:28:04.253 [2024-11-28 19:16:25.154703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.154790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.154816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.253 qpair failed and we were unable to recover it. 00:28:04.253 [2024-11-28 19:16:25.154894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.154987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.155012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.253 qpair failed and we were unable to recover it. 00:28:04.253 [2024-11-28 19:16:25.155087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.155169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.155195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.253 qpair failed and we were unable to recover it. 00:28:04.253 [2024-11-28 19:16:25.155307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.155419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.155458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.253 qpair failed and we were unable to recover it. 00:28:04.253 [2024-11-28 19:16:25.155543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.155655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.155680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.253 qpair failed and we were unable to recover it. 00:28:04.253 [2024-11-28 19:16:25.155765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.155839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.155869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.253 qpair failed and we were unable to recover it. 00:28:04.253 [2024-11-28 19:16:25.155953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.156042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.156068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.253 qpair failed and we were unable to recover it. 00:28:04.253 [2024-11-28 19:16:25.156193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.156295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.156330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.253 qpair failed and we were unable to recover it. 00:28:04.253 [2024-11-28 19:16:25.156453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.156590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.156622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.253 qpair failed and we were unable to recover it. 00:28:04.253 [2024-11-28 19:16:25.156730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.156822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.253 [2024-11-28 19:16:25.156853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.253 qpair failed and we were unable to recover it. 00:28:04.253 [2024-11-28 19:16:25.156951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.157050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.157080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.157172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.157264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.157290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.157386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.157484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.157510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.157629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.157747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.157779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.157870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.157954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.157980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.158094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.158181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.158218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.158309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.158386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.158418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.158506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.158593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.158619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.158712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.158806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.158843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.158927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.159025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.159052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.159170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.159258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.159285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.159361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.159460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.159487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.159611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.159726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.159756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.159837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.159919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.159945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.160052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.160150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.160178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.160274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.160363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.160402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.160494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.160572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.160599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.160682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.160765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.160797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.160891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.160977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.161008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.161101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.161191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.161220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.161311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.161416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.161443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.161537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.161615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.161641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.161778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.161862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.161888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.161968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.162060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.162086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.162175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.162287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.162313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.162410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.162494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.162520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.162634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.162729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.162755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.162849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.162932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.162958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.163077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.163164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.163189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.163296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.163418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.163444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.163528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.163623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.163649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.163737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.163846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.163871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.163960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.164038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.164064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.164184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.164259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.164283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.164377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.164465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.164496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.164579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.164669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.164700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.164788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.164902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.164932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.165022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.165111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.165136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.165220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.165336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.254 [2024-11-28 19:16:25.165361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.254 qpair failed and we were unable to recover it. 00:28:04.254 [2024-11-28 19:16:25.165485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.165617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.165644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.165740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.165831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.165860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.165949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.166025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.166052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.166142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.166260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.166287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.166375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.166479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.166509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.166596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.166685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.166717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.166826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.166935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.166962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.167058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.167150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.167175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.167256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.167336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.167361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.167466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.167547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.167572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.167662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.167758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.167783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.167868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.167976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.168001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.168086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.168166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.168192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.168278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.168364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.168401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.168496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.168571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.168596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.168685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.168764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.168788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.168897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.168980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.169005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.169094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.169181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.169207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.169293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.169411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.169436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.169525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.169615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.169640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.169734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.169835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.169859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.169934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.170018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.170042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.170145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.170234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.170259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.170344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.170446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.170472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.170586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.170708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.170735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.170825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.170941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.170972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.171085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.171173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.171197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.171334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.171447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.171477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.171562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.171644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.171671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.171784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.171864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.171893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.171983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.172074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.172104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.172194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.172271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.172296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.172384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.172471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.172497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.172578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.172656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.172685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.172771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.172852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.172877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.172953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.173038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.173062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.173142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.173215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.173240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.173351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.173440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.173465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.173552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.173631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.173656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.173744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.173855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.173879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.255 [2024-11-28 19:16:25.173973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.174054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.255 [2024-11-28 19:16:25.174078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.255 qpair failed and we were unable to recover it. 00:28:04.256 [2024-11-28 19:16:25.174157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.174273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.174297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.256 qpair failed and we were unable to recover it. 00:28:04.256 [2024-11-28 19:16:25.174376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.174471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.174497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.256 qpair failed and we were unable to recover it. 00:28:04.256 [2024-11-28 19:16:25.174591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.174671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.174696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.256 qpair failed and we were unable to recover it. 00:28:04.256 [2024-11-28 19:16:25.174818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.174902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.174927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.256 qpair failed and we were unable to recover it. 00:28:04.256 [2024-11-28 19:16:25.175016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.175108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.175132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.256 qpair failed and we were unable to recover it. 00:28:04.256 [2024-11-28 19:16:25.175212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.175326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.175351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.256 qpair failed and we were unable to recover it. 00:28:04.256 [2024-11-28 19:16:25.175455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.175546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.175571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.256 qpair failed and we were unable to recover it. 00:28:04.256 [2024-11-28 19:16:25.175656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.175773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.175797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.256 qpair failed and we were unable to recover it. 00:28:04.256 [2024-11-28 19:16:25.175879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.175960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.175985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.256 qpair failed and we were unable to recover it. 00:28:04.256 [2024-11-28 19:16:25.176067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.176143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.176168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.256 qpair failed and we were unable to recover it. 00:28:04.256 [2024-11-28 19:16:25.176281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.176363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.176389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.256 qpair failed and we were unable to recover it. 00:28:04.256 [2024-11-28 19:16:25.176487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.176564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.176587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.256 qpair failed and we were unable to recover it. 00:28:04.256 [2024-11-28 19:16:25.176672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.176755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.176780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.256 qpair failed and we were unable to recover it. 00:28:04.256 [2024-11-28 19:16:25.176870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.176952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.176976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.256 qpair failed and we were unable to recover it. 00:28:04.256 [2024-11-28 19:16:25.177080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.177156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.177180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.256 qpair failed and we were unable to recover it. 00:28:04.256 [2024-11-28 19:16:25.177267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.177359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.177391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.256 qpair failed and we were unable to recover it. 00:28:04.256 [2024-11-28 19:16:25.177492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.177575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.177599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.256 qpair failed and we were unable to recover it. 00:28:04.256 [2024-11-28 19:16:25.177699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.177791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.177817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.256 qpair failed and we were unable to recover it. 00:28:04.256 [2024-11-28 19:16:25.177903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.177986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.178011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.256 qpair failed and we were unable to recover it. 00:28:04.256 [2024-11-28 19:16:25.178097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.178175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.178200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.256 qpair failed and we were unable to recover it. 00:28:04.256 [2024-11-28 19:16:25.178307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.178383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.178419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.256 qpair failed and we were unable to recover it. 00:28:04.256 [2024-11-28 19:16:25.178495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.178581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.178605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.256 qpair failed and we were unable to recover it. 00:28:04.256 [2024-11-28 19:16:25.178695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.178783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.178808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.256 qpair failed and we were unable to recover it. 00:28:04.256 [2024-11-28 19:16:25.178897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.179007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.179032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.256 qpair failed and we were unable to recover it. 00:28:04.256 [2024-11-28 19:16:25.179112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.179186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.179216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.256 qpair failed and we were unable to recover it. 00:28:04.256 [2024-11-28 19:16:25.179296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.179380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.179415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.256 qpair failed and we were unable to recover it. 00:28:04.256 [2024-11-28 19:16:25.179498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.179588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.179613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.256 qpair failed and we were unable to recover it. 00:28:04.256 [2024-11-28 19:16:25.179690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.179770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.179795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.256 qpair failed and we were unable to recover it. 00:28:04.256 [2024-11-28 19:16:25.179881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.179965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.179989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.256 qpair failed and we were unable to recover it. 00:28:04.256 [2024-11-28 19:16:25.180068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.180148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.180172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.256 qpair failed and we were unable to recover it. 00:28:04.256 [2024-11-28 19:16:25.180258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.180333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.180357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.256 qpair failed and we were unable to recover it. 00:28:04.256 [2024-11-28 19:16:25.180452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.180529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.180554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.256 qpair failed and we were unable to recover it. 00:28:04.256 [2024-11-28 19:16:25.180688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.180776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.180801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.256 qpair failed and we were unable to recover it. 00:28:04.256 [2024-11-28 19:16:25.180873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.180964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.180989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.256 qpair failed and we were unable to recover it. 00:28:04.256 [2024-11-28 19:16:25.181095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.256 [2024-11-28 19:16:25.181174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.181200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.181279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.181363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.181387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.181478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.181565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.181594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.181673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.181764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.181788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.181869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.181950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.181975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.182057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.182164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.182190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.182280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.182358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.182384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.182509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.182595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.182619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.182694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.182810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.182835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.182918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.183006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.183031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.183144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.183225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.183250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.183338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.183437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.183464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.183558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.183638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.183668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.183748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.183833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.183860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.183969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.184056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.184082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.184205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.184305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.184334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.184451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.184548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.184580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.184683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.184790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.184821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.184904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.184992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.185018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.185099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.185184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.185210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.185300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.185382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.185423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.185530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.185615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.185641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.185732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.185840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.185871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.185956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.186039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.186065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.186147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.186232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.186259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.186367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.186458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.186484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.186563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.186650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.186676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.186802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.186888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.186913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.186994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.187085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.187110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.187220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.187297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.187322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.187428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.187510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.187536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.187637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.187757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.187783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.187863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.187946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.187977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.188082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.188168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.188195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.188283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.188413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.188440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.188527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.188611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.188637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.188734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.188849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.188874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.188952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.189028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.189054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.189142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.189236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.189262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.189351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.189444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.189470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.257 qpair failed and we were unable to recover it. 00:28:04.257 [2024-11-28 19:16:25.189562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.257 [2024-11-28 19:16:25.189642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.189668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.189759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.189847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.189872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.189957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.190052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.190079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.190167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.190271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.190295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.190402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.190483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.190508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.190589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.190673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.190709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.190793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.190871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.190896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.190990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.191099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.191125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.191208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.191289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.191315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.191421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.191509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.191536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.191622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.191718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.191744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.191831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.191937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.191963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.192037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.192115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.192141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.192227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.192307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.192334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.192430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.192540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.192566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.192654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.192740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.192769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.192851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.192930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.192956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.193059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.193137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.193163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.193245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.193359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.193386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.193478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.193562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.193588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.193707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.193785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.193811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.193921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.194006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.194033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.194112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.194195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.194221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.194342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.194430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.194456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.194534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.194609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.194634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.194717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.194824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.194850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.194930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.195007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.195033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.195118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.195194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.195220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.195302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.195404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.195430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.195535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.195624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.195652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.195749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.195837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.195863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.195951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.196060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.196085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.196174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.196259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.196284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.196407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.196491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.196516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.196603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.196693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.196719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.196798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.196883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.196908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.196994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.197073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.197099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.197183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.197267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.197292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.197371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.197483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.197509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.197590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.197677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.197702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.258 [2024-11-28 19:16:25.197817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.197924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.258 [2024-11-28 19:16:25.197949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.258 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.198037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.198118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.198145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.259 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.198255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.198365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.198391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.259 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.198491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.198571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.198597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.259 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.198710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.198796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.198822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.259 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.198899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.198977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.199002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.259 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.199086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.199193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.199218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.259 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.199310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.199421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.199451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.259 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.199544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.199630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.199656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.259 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.199735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.199834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.199860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.259 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.199974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.200052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.200086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.259 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.200195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.200277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.200304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.259 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.200405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.200534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.200560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.259 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.200665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.200756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.200785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.259 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.200882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.200978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.201007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.259 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.201099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.201186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.201212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.259 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.201301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.201404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.201431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.259 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.201519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.201630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.201655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.259 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.201741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.201849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.201878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.259 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.201957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.202048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.202075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.259 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.202196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.202278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.202303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.259 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.202385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.202476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.202501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.259 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.202588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.202716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.202746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.259 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.202832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.202921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.202948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.259 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.203062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.203149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.203174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.259 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.203250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.203342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.203371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.259 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.203471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.203584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.203609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.259 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.203704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.203795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.203820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.259 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.203932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.204012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.204039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.259 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.204156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.204265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.204290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.259 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.204380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.204481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.204506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.259 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.204625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.204719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.204744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.259 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.204827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.204913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.204938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.259 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.205045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.205133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.205162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.259 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.205250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.205351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.205380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.259 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.205510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.205599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.205628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.259 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.205714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.205802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.205834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.259 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.205927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.206013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.206044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.259 qpair failed and we were unable to recover it. 00:28:04.259 [2024-11-28 19:16:25.206150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.259 [2024-11-28 19:16:25.206231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.206261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.206352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.206496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.206526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.206608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.206731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.206768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.206865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.206974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.207001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.207088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.207205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.207231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.207316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.207419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.207444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.207537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.207614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.207639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.207768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.207863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.207889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.207976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.208065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.208089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.208181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.208284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.208309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.208405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.208488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.208514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.208600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.208678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.208706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.208796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.208884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.208910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.209003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.209110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.209136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.209214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.209293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.209318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.209418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.209509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.209539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.209618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.209725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.209751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.209843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.209932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.209957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.210065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.210144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.210169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.210266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.210354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.210380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.210487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.210570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.210596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.210704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.210785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.210814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.210901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.211012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.211038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.211124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.211218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.211243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.211338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.211429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.211455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.211542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.211627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.211660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.211760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.211867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.211893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.211983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.212064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.212089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.212175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.212264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.212290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.212405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.212504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.212530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.212627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.212768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.212794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.212934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.213020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.213045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.213163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.213291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.213317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.213436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.213524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.213553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.213644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.213730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.213761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.213839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.213928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.213963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.214082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.214157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.214183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.214278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.214418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.214444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.214549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.214629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.214654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.214737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.214823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.214852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.214945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.215085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.260 [2024-11-28 19:16:25.215113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.260 qpair failed and we were unable to recover it. 00:28:04.260 [2024-11-28 19:16:25.215203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.215288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.215318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.261 qpair failed and we were unable to recover it. 00:28:04.261 [2024-11-28 19:16:25.215434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.215516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.215543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.261 qpair failed and we were unable to recover it. 00:28:04.261 [2024-11-28 19:16:25.215632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.215750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.215776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.261 qpair failed and we were unable to recover it. 00:28:04.261 [2024-11-28 19:16:25.215868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.215942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.215967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.261 qpair failed and we were unable to recover it. 00:28:04.261 [2024-11-28 19:16:25.216050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.216161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.216192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.261 qpair failed and we were unable to recover it. 00:28:04.261 [2024-11-28 19:16:25.216284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.216366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.216402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.261 qpair failed and we were unable to recover it. 00:28:04.261 [2024-11-28 19:16:25.216488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.216567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.216592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.261 qpair failed and we were unable to recover it. 00:28:04.261 [2024-11-28 19:16:25.216688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.216839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.216863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.261 qpair failed and we were unable to recover it. 00:28:04.261 [2024-11-28 19:16:25.216948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.217060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.217086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.261 qpair failed and we were unable to recover it. 00:28:04.261 [2024-11-28 19:16:25.217175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.217262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.217287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.261 qpair failed and we were unable to recover it. 00:28:04.261 [2024-11-28 19:16:25.217407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.217490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.217515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.261 qpair failed and we were unable to recover it. 00:28:04.261 [2024-11-28 19:16:25.217628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.217702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.217727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.261 qpair failed and we were unable to recover it. 00:28:04.261 [2024-11-28 19:16:25.217841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.217926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.217952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.261 qpair failed and we were unable to recover it. 00:28:04.261 [2024-11-28 19:16:25.218040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.218131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.218156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.261 qpair failed and we were unable to recover it. 00:28:04.261 [2024-11-28 19:16:25.218264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.218345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.218370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.261 qpair failed and we were unable to recover it. 00:28:04.261 [2024-11-28 19:16:25.218477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.218553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.218579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.261 qpair failed and we were unable to recover it. 00:28:04.261 [2024-11-28 19:16:25.218662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.218768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.218794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.261 qpair failed and we were unable to recover it. 00:28:04.261 [2024-11-28 19:16:25.218868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.218982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.219007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.261 qpair failed and we were unable to recover it. 00:28:04.261 [2024-11-28 19:16:25.219121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.219200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.219225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.261 qpair failed and we were unable to recover it. 00:28:04.261 [2024-11-28 19:16:25.219309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.219403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.219430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.261 qpair failed and we were unable to recover it. 00:28:04.261 [2024-11-28 19:16:25.219516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.219629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.219654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.261 qpair failed and we were unable to recover it. 00:28:04.261 [2024-11-28 19:16:25.219766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.219856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.219881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.261 qpair failed and we were unable to recover it. 00:28:04.261 [2024-11-28 19:16:25.219973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.220059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.220085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.261 qpair failed and we were unable to recover it. 00:28:04.261 [2024-11-28 19:16:25.220168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.220277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.220302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.261 qpair failed and we were unable to recover it. 00:28:04.261 [2024-11-28 19:16:25.220380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.220467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.220492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.261 qpair failed and we were unable to recover it. 00:28:04.261 [2024-11-28 19:16:25.220615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.220710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.220736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.261 qpair failed and we were unable to recover it. 00:28:04.261 [2024-11-28 19:16:25.220825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.220917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.220942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.261 qpair failed and we were unable to recover it. 00:28:04.261 [2024-11-28 19:16:25.221027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.221137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.221161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.261 qpair failed and we were unable to recover it. 00:28:04.261 [2024-11-28 19:16:25.221245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.221373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.221404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.261 qpair failed and we were unable to recover it. 00:28:04.261 [2024-11-28 19:16:25.221504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.221591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.221618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.261 qpair failed and we were unable to recover it. 00:28:04.261 [2024-11-28 19:16:25.221711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.221804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.221830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.261 qpair failed and we were unable to recover it. 00:28:04.261 [2024-11-28 19:16:25.221921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.222008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.222033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.261 qpair failed and we were unable to recover it. 00:28:04.261 [2024-11-28 19:16:25.222115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.222204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.222230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.261 qpair failed and we were unable to recover it. 00:28:04.261 [2024-11-28 19:16:25.222352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.222474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.261 [2024-11-28 19:16:25.222502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.261 qpair failed and we were unable to recover it. 00:28:04.557 [2024-11-28 19:16:25.222619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.222703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.222729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.557 qpair failed and we were unable to recover it. 00:28:04.557 [2024-11-28 19:16:25.222843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.222984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.223010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.557 qpair failed and we were unable to recover it. 00:28:04.557 [2024-11-28 19:16:25.223098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.223187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.223217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.557 qpair failed and we were unable to recover it. 00:28:04.557 [2024-11-28 19:16:25.223306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.223390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.223425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.557 qpair failed and we were unable to recover it. 00:28:04.557 [2024-11-28 19:16:25.223544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.223635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.223662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.557 qpair failed and we were unable to recover it. 00:28:04.557 [2024-11-28 19:16:25.223760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.223893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.223918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.557 qpair failed and we were unable to recover it. 00:28:04.557 [2024-11-28 19:16:25.224003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.224108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.224134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.557 qpair failed and we were unable to recover it. 00:28:04.557 [2024-11-28 19:16:25.224245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.224389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.224419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.557 qpair failed and we were unable to recover it. 00:28:04.557 [2024-11-28 19:16:25.224509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.224595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.224620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.557 qpair failed and we were unable to recover it. 00:28:04.557 [2024-11-28 19:16:25.224744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.224822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.224852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.557 qpair failed and we were unable to recover it. 00:28:04.557 [2024-11-28 19:16:25.224938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.225014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.225039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.557 qpair failed and we were unable to recover it. 00:28:04.557 [2024-11-28 19:16:25.225153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.225233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.225258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.557 qpair failed and we were unable to recover it. 00:28:04.557 [2024-11-28 19:16:25.225337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.225432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.225461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.557 qpair failed and we were unable to recover it. 00:28:04.557 [2024-11-28 19:16:25.225546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.225631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.225656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.557 qpair failed and we were unable to recover it. 00:28:04.557 [2024-11-28 19:16:25.225767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.225856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.225882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.557 qpair failed and we were unable to recover it. 00:28:04.557 [2024-11-28 19:16:25.226000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.226078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.226103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.557 qpair failed and we were unable to recover it. 00:28:04.557 [2024-11-28 19:16:25.226186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.226297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.226322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.557 qpair failed and we were unable to recover it. 00:28:04.557 [2024-11-28 19:16:25.226412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.226541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.226566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.557 qpair failed and we were unable to recover it. 00:28:04.557 [2024-11-28 19:16:25.226656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.226737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.226762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.557 qpair failed and we were unable to recover it. 00:28:04.557 [2024-11-28 19:16:25.226893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.227003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.227029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.557 qpair failed and we were unable to recover it. 00:28:04.557 [2024-11-28 19:16:25.227116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.227230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.227257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.557 qpair failed and we were unable to recover it. 00:28:04.557 [2024-11-28 19:16:25.227358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.227472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.557 [2024-11-28 19:16:25.227498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.557 qpair failed and we were unable to recover it. 00:28:04.557 [2024-11-28 19:16:25.227609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.227699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.227724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.558 qpair failed and we were unable to recover it. 00:28:04.558 [2024-11-28 19:16:25.227805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.227894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.227919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.558 qpair failed and we were unable to recover it. 00:28:04.558 [2024-11-28 19:16:25.228009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.228092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.228118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.558 qpair failed and we were unable to recover it. 00:28:04.558 [2024-11-28 19:16:25.228246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.228325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.228351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.558 qpair failed and we were unable to recover it. 00:28:04.558 [2024-11-28 19:16:25.228442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.228553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.228581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.558 qpair failed and we were unable to recover it. 00:28:04.558 [2024-11-28 19:16:25.228677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.228765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.228792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.558 qpair failed and we were unable to recover it. 00:28:04.558 [2024-11-28 19:16:25.228876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.228963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.228988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.558 qpair failed and we were unable to recover it. 00:28:04.558 [2024-11-28 19:16:25.229073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.229148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.229173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.558 qpair failed and we were unable to recover it. 00:28:04.558 [2024-11-28 19:16:25.229260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.229337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.229362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.558 qpair failed and we were unable to recover it. 00:28:04.558 [2024-11-28 19:16:25.229464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.229545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.229573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.558 qpair failed and we were unable to recover it. 00:28:04.558 [2024-11-28 19:16:25.229766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.229853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.229880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.558 qpair failed and we were unable to recover it. 00:28:04.558 [2024-11-28 19:16:25.230019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.230111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.230136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.558 qpair failed and we were unable to recover it. 00:28:04.558 [2024-11-28 19:16:25.230215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.230297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.230323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.558 qpair failed and we were unable to recover it. 00:28:04.558 [2024-11-28 19:16:25.230428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.230547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.230572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.558 qpair failed and we were unable to recover it. 00:28:04.558 [2024-11-28 19:16:25.230656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.230742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.230768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.558 qpair failed and we were unable to recover it. 00:28:04.558 [2024-11-28 19:16:25.230854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.230948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.230973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.558 qpair failed and we were unable to recover it. 00:28:04.558 [2024-11-28 19:16:25.231092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.231177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.231202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.558 qpair failed and we were unable to recover it. 00:28:04.558 [2024-11-28 19:16:25.231299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.231387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.231428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.558 qpair failed and we were unable to recover it. 00:28:04.558 [2024-11-28 19:16:25.231539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.231627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.231652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.558 qpair failed and we were unable to recover it. 00:28:04.558 [2024-11-28 19:16:25.231763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.231893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.231924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.558 qpair failed and we were unable to recover it. 00:28:04.558 [2024-11-28 19:16:25.232009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.232146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.232172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.558 qpair failed and we were unable to recover it. 00:28:04.558 [2024-11-28 19:16:25.232255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.232347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.232373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.558 qpair failed and we were unable to recover it. 00:28:04.558 [2024-11-28 19:16:25.232467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.232545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.232570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.558 qpair failed and we were unable to recover it. 00:28:04.558 [2024-11-28 19:16:25.232657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.232737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.232762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.558 qpair failed and we were unable to recover it. 00:28:04.558 [2024-11-28 19:16:25.232844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.232925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.232950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.558 qpair failed and we were unable to recover it. 00:28:04.558 [2024-11-28 19:16:25.233035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.233143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.233171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.558 qpair failed and we were unable to recover it. 00:28:04.558 [2024-11-28 19:16:25.233254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.233362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.233388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.558 qpair failed and we were unable to recover it. 00:28:04.558 [2024-11-28 19:16:25.233490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.233564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.233590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.558 qpair failed and we were unable to recover it. 00:28:04.558 [2024-11-28 19:16:25.233673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.558 [2024-11-28 19:16:25.233765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.233793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.559 qpair failed and we were unable to recover it. 00:28:04.559 [2024-11-28 19:16:25.233876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.233952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.233978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.559 qpair failed and we were unable to recover it. 00:28:04.559 [2024-11-28 19:16:25.234107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.234190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.234219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.559 qpair failed and we were unable to recover it. 00:28:04.559 [2024-11-28 19:16:25.234312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.234412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.234438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.559 qpair failed and we were unable to recover it. 00:28:04.559 [2024-11-28 19:16:25.234530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.234606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.234634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.559 qpair failed and we were unable to recover it. 00:28:04.559 [2024-11-28 19:16:25.234728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.234869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.234894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.559 qpair failed and we were unable to recover it. 00:28:04.559 [2024-11-28 19:16:25.235007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.235087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.235112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.559 qpair failed and we were unable to recover it. 00:28:04.559 [2024-11-28 19:16:25.235226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.235303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.235328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.559 qpair failed and we were unable to recover it. 00:28:04.559 [2024-11-28 19:16:25.235527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.235639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.235665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.559 qpair failed and we were unable to recover it. 00:28:04.559 [2024-11-28 19:16:25.235751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.235879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.235906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.559 qpair failed and we were unable to recover it. 00:28:04.559 [2024-11-28 19:16:25.235994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.236119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.236145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.559 qpair failed and we were unable to recover it. 00:28:04.559 [2024-11-28 19:16:25.236225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.236310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.236336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.559 qpair failed and we were unable to recover it. 00:28:04.559 [2024-11-28 19:16:25.236463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.236553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.236578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.559 qpair failed and we were unable to recover it. 00:28:04.559 [2024-11-28 19:16:25.236701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.236814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.236840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.559 qpair failed and we were unable to recover it. 00:28:04.559 [2024-11-28 19:16:25.236953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.237047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.237073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.559 qpair failed and we were unable to recover it. 00:28:04.559 [2024-11-28 19:16:25.237155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.237231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.237259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.559 qpair failed and we were unable to recover it. 00:28:04.559 [2024-11-28 19:16:25.237352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.237440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.237465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.559 qpair failed and we were unable to recover it. 00:28:04.559 [2024-11-28 19:16:25.237578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.237665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.237691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.559 qpair failed and we were unable to recover it. 00:28:04.559 [2024-11-28 19:16:25.237789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.237880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.237906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.559 qpair failed and we were unable to recover it. 00:28:04.559 [2024-11-28 19:16:25.237991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.238103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.238133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.559 qpair failed and we were unable to recover it. 00:28:04.559 [2024-11-28 19:16:25.238252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.238368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.238414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.559 qpair failed and we were unable to recover it. 00:28:04.559 [2024-11-28 19:16:25.238508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.238617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.238643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.559 qpair failed and we were unable to recover it. 00:28:04.559 [2024-11-28 19:16:25.238781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.238868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.238893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.559 qpair failed and we were unable to recover it. 00:28:04.559 [2024-11-28 19:16:25.238985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.239101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.239130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.559 qpair failed and we were unable to recover it. 00:28:04.559 [2024-11-28 19:16:25.239215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.239332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.239358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.559 qpair failed and we were unable to recover it. 00:28:04.559 [2024-11-28 19:16:25.239498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.239580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.239606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.559 qpair failed and we were unable to recover it. 00:28:04.559 [2024-11-28 19:16:25.239712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.239827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.239853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.559 qpair failed and we were unable to recover it. 00:28:04.559 [2024-11-28 19:16:25.239939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.240052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.559 [2024-11-28 19:16:25.240081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.559 qpair failed and we were unable to recover it. 00:28:04.559 [2024-11-28 19:16:25.240176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.240264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.240290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.560 qpair failed and we were unable to recover it. 00:28:04.560 [2024-11-28 19:16:25.240369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.240489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.240515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.560 qpair failed and we were unable to recover it. 00:28:04.560 [2024-11-28 19:16:25.240602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.240715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.240740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.560 qpair failed and we were unable to recover it. 00:28:04.560 [2024-11-28 19:16:25.240858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.240952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.240978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.560 qpair failed and we were unable to recover it. 00:28:04.560 [2024-11-28 19:16:25.241089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.241217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.241246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.560 qpair failed and we were unable to recover it. 00:28:04.560 [2024-11-28 19:16:25.241330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.241418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.241444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.560 qpair failed and we were unable to recover it. 00:28:04.560 [2024-11-28 19:16:25.241541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.241628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.241653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.560 qpair failed and we were unable to recover it. 00:28:04.560 [2024-11-28 19:16:25.241735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.241815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.241840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.560 qpair failed and we were unable to recover it. 00:28:04.560 [2024-11-28 19:16:25.241955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.242070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.242100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.560 qpair failed and we were unable to recover it. 00:28:04.560 [2024-11-28 19:16:25.242193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.242280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.242307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.560 qpair failed and we were unable to recover it. 00:28:04.560 [2024-11-28 19:16:25.242389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.242484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.242510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.560 qpair failed and we were unable to recover it. 00:28:04.560 [2024-11-28 19:16:25.242591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.242702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.242728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.560 qpair failed and we were unable to recover it. 00:28:04.560 [2024-11-28 19:16:25.242824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.242930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.242955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.560 qpair failed and we were unable to recover it. 00:28:04.560 [2024-11-28 19:16:25.243053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.243156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.243186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.560 qpair failed and we were unable to recover it. 00:28:04.560 [2024-11-28 19:16:25.243267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.243391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.243453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.560 qpair failed and we were unable to recover it. 00:28:04.560 [2024-11-28 19:16:25.243544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.243626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.243656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.560 qpair failed and we were unable to recover it. 00:28:04.560 [2024-11-28 19:16:25.243753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.243835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.243864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.560 qpair failed and we were unable to recover it. 00:28:04.560 [2024-11-28 19:16:25.243953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.244081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.244106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.560 qpair failed and we were unable to recover it. 00:28:04.560 [2024-11-28 19:16:25.244200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.244294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.244319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.560 qpair failed and we were unable to recover it. 00:28:04.560 [2024-11-28 19:16:25.244404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.244512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.244541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.560 qpair failed and we were unable to recover it. 00:28:04.560 [2024-11-28 19:16:25.244635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.244729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.244755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.560 qpair failed and we were unable to recover it. 00:28:04.560 [2024-11-28 19:16:25.244833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.244913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.244938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.560 qpair failed and we were unable to recover it. 00:28:04.560 [2024-11-28 19:16:25.245014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.245101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.245132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.560 qpair failed and we were unable to recover it. 00:28:04.560 [2024-11-28 19:16:25.245216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.245329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.245358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.560 qpair failed and we were unable to recover it. 00:28:04.560 [2024-11-28 19:16:25.245454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.245529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.245557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.560 qpair failed and we were unable to recover it. 00:28:04.560 [2024-11-28 19:16:25.245656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.245747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.245775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.560 qpair failed and we were unable to recover it. 00:28:04.560 [2024-11-28 19:16:25.245868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.245952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.245982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.560 qpair failed and we were unable to recover it. 00:28:04.560 [2024-11-28 19:16:25.246080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.246198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.246228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.560 qpair failed and we were unable to recover it. 00:28:04.560 [2024-11-28 19:16:25.246333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.246459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.560 [2024-11-28 19:16:25.246490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.561 qpair failed and we were unable to recover it. 00:28:04.561 [2024-11-28 19:16:25.246589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.246674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.246700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.561 qpair failed and we were unable to recover it. 00:28:04.561 [2024-11-28 19:16:25.246828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.246917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.246944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.561 qpair failed and we were unable to recover it. 00:28:04.561 [2024-11-28 19:16:25.247026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.247109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.247139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.561 qpair failed and we were unable to recover it. 00:28:04.561 [2024-11-28 19:16:25.247229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.247309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.247338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.561 qpair failed and we were unable to recover it. 00:28:04.561 [2024-11-28 19:16:25.247461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.247553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.247589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.561 qpair failed and we were unable to recover it. 00:28:04.561 [2024-11-28 19:16:25.247687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.247772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.247801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.561 qpair failed and we were unable to recover it. 00:28:04.561 [2024-11-28 19:16:25.247880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.247990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.248021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.561 qpair failed and we were unable to recover it. 00:28:04.561 [2024-11-28 19:16:25.248098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.248186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.248215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.561 qpair failed and we were unable to recover it. 00:28:04.561 [2024-11-28 19:16:25.248313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.248429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.248456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.561 qpair failed and we were unable to recover it. 00:28:04.561 [2024-11-28 19:16:25.248551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.248648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.248675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.561 qpair failed and we were unable to recover it. 00:28:04.561 [2024-11-28 19:16:25.248765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.248845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.248870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.561 qpair failed and we were unable to recover it. 00:28:04.561 [2024-11-28 19:16:25.248966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.249082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.249108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.561 qpair failed and we were unable to recover it. 00:28:04.561 [2024-11-28 19:16:25.249193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.249277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.249302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.561 qpair failed and we were unable to recover it. 00:28:04.561 [2024-11-28 19:16:25.249381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.249475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.249500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.561 qpair failed and we were unable to recover it. 00:28:04.561 [2024-11-28 19:16:25.249628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.249725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.249756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.561 qpair failed and we were unable to recover it. 00:28:04.561 [2024-11-28 19:16:25.249858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.249981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.250010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.561 qpair failed and we were unable to recover it. 00:28:04.561 [2024-11-28 19:16:25.250098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.250186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.250215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.561 qpair failed and we were unable to recover it. 00:28:04.561 [2024-11-28 19:16:25.250326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.250424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.250450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.561 qpair failed and we were unable to recover it. 00:28:04.561 [2024-11-28 19:16:25.250566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.250650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.250678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.561 qpair failed and we were unable to recover it. 00:28:04.561 [2024-11-28 19:16:25.250768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.250877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.250904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.561 qpair failed and we were unable to recover it. 00:28:04.561 [2024-11-28 19:16:25.251012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.251092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.251119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.561 qpair failed and we were unable to recover it. 00:28:04.561 [2024-11-28 19:16:25.251229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.251334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.251361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.561 qpair failed and we were unable to recover it. 00:28:04.561 [2024-11-28 19:16:25.251481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.251561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.251591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.561 qpair failed and we were unable to recover it. 00:28:04.561 [2024-11-28 19:16:25.251677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.251791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.251816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.561 qpair failed and we were unable to recover it. 00:28:04.561 [2024-11-28 19:16:25.251901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.251985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.561 [2024-11-28 19:16:25.252013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.562 qpair failed and we were unable to recover it. 00:28:04.562 [2024-11-28 19:16:25.252112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.252198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.252223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.562 qpair failed and we were unable to recover it. 00:28:04.562 [2024-11-28 19:16:25.252335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.252441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.252471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.562 qpair failed and we were unable to recover it. 00:28:04.562 [2024-11-28 19:16:25.252555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.252631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.252657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.562 qpair failed and we were unable to recover it. 00:28:04.562 [2024-11-28 19:16:25.252739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.252812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.252837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.562 qpair failed and we were unable to recover it. 00:28:04.562 [2024-11-28 19:16:25.252916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.253019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.253047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.562 qpair failed and we were unable to recover it. 00:28:04.562 [2024-11-28 19:16:25.253155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.253243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.253269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.562 qpair failed and we were unable to recover it. 00:28:04.562 [2024-11-28 19:16:25.253360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.253453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.253479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.562 qpair failed and we were unable to recover it. 00:28:04.562 [2024-11-28 19:16:25.253568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.253650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.253675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.562 qpair failed and we were unable to recover it. 00:28:04.562 [2024-11-28 19:16:25.253787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.253874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.253899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.562 qpair failed and we were unable to recover it. 00:28:04.562 [2024-11-28 19:16:25.253988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.254062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.254087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.562 qpair failed and we were unable to recover it. 00:28:04.562 [2024-11-28 19:16:25.254200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.254311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.254338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.562 qpair failed and we were unable to recover it. 00:28:04.562 [2024-11-28 19:16:25.254426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.254508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.254534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.562 qpair failed and we were unable to recover it. 00:28:04.562 [2024-11-28 19:16:25.254639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.254725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.254750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.562 qpair failed and we were unable to recover it. 00:28:04.562 [2024-11-28 19:16:25.254828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.254913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.254942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.562 qpair failed and we were unable to recover it. 00:28:04.562 [2024-11-28 19:16:25.255060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.255150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.255176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.562 qpair failed and we were unable to recover it. 00:28:04.562 [2024-11-28 19:16:25.255260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.255350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.255376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.562 qpair failed and we were unable to recover it. 00:28:04.562 [2024-11-28 19:16:25.255472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.255566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.255591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.562 qpair failed and we were unable to recover it. 00:28:04.562 [2024-11-28 19:16:25.255709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.255821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.255847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.562 qpair failed and we were unable to recover it. 00:28:04.562 [2024-11-28 19:16:25.255938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.256021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.256046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.562 qpair failed and we were unable to recover it. 00:28:04.562 [2024-11-28 19:16:25.256129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.256207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.256233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.562 qpair failed and we were unable to recover it. 00:28:04.562 [2024-11-28 19:16:25.256323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.256428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.256454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.562 qpair failed and we were unable to recover it. 00:28:04.562 [2024-11-28 19:16:25.256543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.256628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.256656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.562 qpair failed and we were unable to recover it. 00:28:04.562 [2024-11-28 19:16:25.256739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.256850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.256876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.562 qpair failed and we were unable to recover it. 00:28:04.562 [2024-11-28 19:16:25.256985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.257068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.257094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.562 qpair failed and we were unable to recover it. 00:28:04.562 [2024-11-28 19:16:25.257178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.257290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.257315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.562 qpair failed and we were unable to recover it. 00:28:04.562 [2024-11-28 19:16:25.257406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.257496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.257522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.562 qpair failed and we were unable to recover it. 00:28:04.562 [2024-11-28 19:16:25.257611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.257697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.257722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.562 qpair failed and we were unable to recover it. 00:28:04.562 [2024-11-28 19:16:25.257827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.257970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.257995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.562 qpair failed and we were unable to recover it. 00:28:04.562 [2024-11-28 19:16:25.258075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.562 [2024-11-28 19:16:25.258187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.258212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.563 qpair failed and we were unable to recover it. 00:28:04.563 [2024-11-28 19:16:25.258298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.258387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.258428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.563 qpair failed and we were unable to recover it. 00:28:04.563 [2024-11-28 19:16:25.258526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.258609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.258634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.563 qpair failed and we were unable to recover it. 00:28:04.563 [2024-11-28 19:16:25.258751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.258840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.258865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.563 qpair failed and we were unable to recover it. 00:28:04.563 [2024-11-28 19:16:25.258951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.259040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.259066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.563 qpair failed and we were unable to recover it. 00:28:04.563 [2024-11-28 19:16:25.259144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.259223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.259252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.563 qpair failed and we were unable to recover it. 00:28:04.563 [2024-11-28 19:16:25.259363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.259455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.259484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.563 qpair failed and we were unable to recover it. 00:28:04.563 [2024-11-28 19:16:25.259570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.259660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.259685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.563 qpair failed and we were unable to recover it. 00:28:04.563 [2024-11-28 19:16:25.259769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.259882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.259907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.563 qpair failed and we were unable to recover it. 00:28:04.563 [2024-11-28 19:16:25.260021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.260108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.260134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.563 qpair failed and we were unable to recover it. 00:28:04.563 [2024-11-28 19:16:25.260225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.260305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.260330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.563 qpair failed and we were unable to recover it. 00:28:04.563 [2024-11-28 19:16:25.260438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.260529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.260557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.563 qpair failed and we were unable to recover it. 00:28:04.563 [2024-11-28 19:16:25.260648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.260746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.260772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.563 qpair failed and we were unable to recover it. 00:28:04.563 [2024-11-28 19:16:25.260878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.260970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.260995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.563 qpair failed and we were unable to recover it. 00:28:04.563 [2024-11-28 19:16:25.261078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.261158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.261186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.563 qpair failed and we were unable to recover it. 00:28:04.563 [2024-11-28 19:16:25.261278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.261406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.261433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.563 qpair failed and we were unable to recover it. 00:28:04.563 [2024-11-28 19:16:25.261554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.261637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.261664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.563 qpair failed and we were unable to recover it. 00:28:04.563 [2024-11-28 19:16:25.261776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.261863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.261892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.563 qpair failed and we were unable to recover it. 00:28:04.563 [2024-11-28 19:16:25.261981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.262094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.262121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.563 qpair failed and we were unable to recover it. 00:28:04.563 [2024-11-28 19:16:25.262235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.262325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.262351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.563 qpair failed and we were unable to recover it. 00:28:04.563 [2024-11-28 19:16:25.262443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.262561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.262587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.563 qpair failed and we were unable to recover it. 00:28:04.563 [2024-11-28 19:16:25.262675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.262758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.262783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.563 qpair failed and we were unable to recover it. 00:28:04.563 [2024-11-28 19:16:25.262868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.262959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.262985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.563 qpair failed and we were unable to recover it. 00:28:04.563 [2024-11-28 19:16:25.263062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.263149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.263175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.563 qpair failed and we were unable to recover it. 00:28:04.563 [2024-11-28 19:16:25.263296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.263411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.263438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.563 qpair failed and we were unable to recover it. 00:28:04.563 [2024-11-28 19:16:25.263555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.263643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.263673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.563 qpair failed and we were unable to recover it. 00:28:04.563 [2024-11-28 19:16:25.263780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.263860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.263885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.563 qpair failed and we were unable to recover it. 00:28:04.563 [2024-11-28 19:16:25.263971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.264063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.264093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.563 qpair failed and we were unable to recover it. 00:28:04.563 [2024-11-28 19:16:25.264209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.264289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.563 [2024-11-28 19:16:25.264318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.563 qpair failed and we were unable to recover it. 00:28:04.564 [2024-11-28 19:16:25.264410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.264497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.264522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.564 qpair failed and we were unable to recover it. 00:28:04.564 [2024-11-28 19:16:25.264608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.264719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.264744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.564 qpair failed and we were unable to recover it. 00:28:04.564 [2024-11-28 19:16:25.264838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.264927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.264956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.564 qpair failed and we were unable to recover it. 00:28:04.564 [2024-11-28 19:16:25.265042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.265131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.265166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.564 qpair failed and we were unable to recover it. 00:28:04.564 [2024-11-28 19:16:25.265289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.265381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.265415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.564 qpair failed and we were unable to recover it. 00:28:04.564 [2024-11-28 19:16:25.265503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.265588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.265614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.564 qpair failed and we were unable to recover it. 00:28:04.564 [2024-11-28 19:16:25.265734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.265815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.265842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.564 qpair failed and we were unable to recover it. 00:28:04.564 [2024-11-28 19:16:25.265957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.266053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.266089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.564 qpair failed and we were unable to recover it. 00:28:04.564 [2024-11-28 19:16:25.266225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.266356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.266387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.564 qpair failed and we were unable to recover it. 00:28:04.564 [2024-11-28 19:16:25.266495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.266587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.266618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.564 qpair failed and we were unable to recover it. 00:28:04.564 [2024-11-28 19:16:25.266748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.266842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.266874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.564 qpair failed and we were unable to recover it. 00:28:04.564 [2024-11-28 19:16:25.266996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.267124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.267152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.564 qpair failed and we were unable to recover it. 00:28:04.564 [2024-11-28 19:16:25.267240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.267332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.267366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.564 qpair failed and we were unable to recover it. 00:28:04.564 [2024-11-28 19:16:25.267463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.267579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.267609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.564 qpair failed and we were unable to recover it. 00:28:04.564 [2024-11-28 19:16:25.267690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.267796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.267820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.564 qpair failed and we were unable to recover it. 00:28:04.564 [2024-11-28 19:16:25.267902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.268012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.268037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.564 qpair failed and we were unable to recover it. 00:28:04.564 [2024-11-28 19:16:25.268119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.268228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.268254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.564 qpair failed and we were unable to recover it. 00:28:04.564 [2024-11-28 19:16:25.268335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.268433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.268458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.564 qpair failed and we were unable to recover it. 00:28:04.564 [2024-11-28 19:16:25.268572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.268654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.268678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.564 qpair failed and we were unable to recover it. 00:28:04.564 [2024-11-28 19:16:25.268789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.268892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.268917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.564 qpair failed and we were unable to recover it. 00:28:04.564 [2024-11-28 19:16:25.268994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.269077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.269102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.564 qpair failed and we were unable to recover it. 00:28:04.564 [2024-11-28 19:16:25.269186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.269264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.269289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.564 qpair failed and we were unable to recover it. 00:28:04.564 [2024-11-28 19:16:25.269374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.269460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.269485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.564 qpair failed and we were unable to recover it. 00:28:04.564 [2024-11-28 19:16:25.269571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.269647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.269672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.564 qpair failed and we were unable to recover it. 00:28:04.564 [2024-11-28 19:16:25.269760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.269833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.269857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.564 qpair failed and we were unable to recover it. 00:28:04.564 [2024-11-28 19:16:25.269938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.270023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.270048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.564 qpair failed and we were unable to recover it. 00:28:04.564 [2024-11-28 19:16:25.270133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.270244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.270269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.564 qpair failed and we were unable to recover it. 00:28:04.564 [2024-11-28 19:16:25.270355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.270436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.270461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.564 qpair failed and we were unable to recover it. 00:28:04.564 [2024-11-28 19:16:25.270542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.564 [2024-11-28 19:16:25.270628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.270652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.565 qpair failed and we were unable to recover it. 00:28:04.565 [2024-11-28 19:16:25.270745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.270855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.270880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.565 qpair failed and we were unable to recover it. 00:28:04.565 [2024-11-28 19:16:25.270958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.271040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.271064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.565 qpair failed and we were unable to recover it. 00:28:04.565 [2024-11-28 19:16:25.271179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.271254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.271279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.565 qpair failed and we were unable to recover it. 00:28:04.565 [2024-11-28 19:16:25.271388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.271473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.271498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.565 qpair failed and we were unable to recover it. 00:28:04.565 [2024-11-28 19:16:25.271582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.271684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.271709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.565 qpair failed and we were unable to recover it. 00:28:04.565 [2024-11-28 19:16:25.271798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.271881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.271906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.565 qpair failed and we were unable to recover it. 00:28:04.565 [2024-11-28 19:16:25.272027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.272103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.272127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.565 qpair failed and we were unable to recover it. 00:28:04.565 [2024-11-28 19:16:25.272212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.272292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.272316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.565 qpair failed and we were unable to recover it. 00:28:04.565 [2024-11-28 19:16:25.272407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.272492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.272517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.565 qpair failed and we were unable to recover it. 00:28:04.565 [2024-11-28 19:16:25.272595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.272678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.272702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.565 qpair failed and we were unable to recover it. 00:28:04.565 [2024-11-28 19:16:25.272790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.272870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.272897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.565 qpair failed and we were unable to recover it. 00:28:04.565 [2024-11-28 19:16:25.272984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.273065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.273089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.565 qpair failed and we were unable to recover it. 00:28:04.565 [2024-11-28 19:16:25.273176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.273266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.273291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.565 qpair failed and we were unable to recover it. 00:28:04.565 [2024-11-28 19:16:25.273406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.273483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.273507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.565 qpair failed and we were unable to recover it. 00:28:04.565 [2024-11-28 19:16:25.273589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.273672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.273697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.565 qpair failed and we were unable to recover it. 00:28:04.565 [2024-11-28 19:16:25.273775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.273851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.273875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.565 qpair failed and we were unable to recover it. 00:28:04.565 [2024-11-28 19:16:25.273988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.274062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.274086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.565 qpair failed and we were unable to recover it. 00:28:04.565 [2024-11-28 19:16:25.274167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.274239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.274264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.565 qpair failed and we were unable to recover it. 00:28:04.565 [2024-11-28 19:16:25.274355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.274446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.274471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.565 qpair failed and we were unable to recover it. 00:28:04.565 [2024-11-28 19:16:25.274553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.274632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.274656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.565 qpair failed and we were unable to recover it. 00:28:04.565 [2024-11-28 19:16:25.274764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.274841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.274867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.565 qpair failed and we were unable to recover it. 00:28:04.565 [2024-11-28 19:16:25.274959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.275096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.275120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.565 qpair failed and we were unable to recover it. 00:28:04.565 [2024-11-28 19:16:25.275195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.275314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.275338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.565 qpair failed and we were unable to recover it. 00:28:04.565 [2024-11-28 19:16:25.275428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.275514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.275539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.565 qpair failed and we were unable to recover it. 00:28:04.565 [2024-11-28 19:16:25.275657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.275746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.275771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.565 qpair failed and we were unable to recover it. 00:28:04.565 [2024-11-28 19:16:25.275850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.275938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.275962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.565 qpair failed and we were unable to recover it. 00:28:04.565 [2024-11-28 19:16:25.276052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.276155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.276179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.565 qpair failed and we were unable to recover it. 00:28:04.565 [2024-11-28 19:16:25.276258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.276340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.276364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.565 qpair failed and we were unable to recover it. 00:28:04.565 [2024-11-28 19:16:25.276459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.565 [2024-11-28 19:16:25.276542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.276566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.566 qpair failed and we were unable to recover it. 00:28:04.566 [2024-11-28 19:16:25.276655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.276779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.276804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.566 qpair failed and we were unable to recover it. 00:28:04.566 [2024-11-28 19:16:25.276883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.277006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.277031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.566 qpair failed and we were unable to recover it. 00:28:04.566 [2024-11-28 19:16:25.277111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.277201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.277226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.566 qpair failed and we were unable to recover it. 00:28:04.566 [2024-11-28 19:16:25.277310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.277389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.277422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.566 qpair failed and we were unable to recover it. 00:28:04.566 [2024-11-28 19:16:25.277506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.277590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.277614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.566 qpair failed and we were unable to recover it. 00:28:04.566 [2024-11-28 19:16:25.277696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.277801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.277825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.566 qpair failed and we were unable to recover it. 00:28:04.566 [2024-11-28 19:16:25.277905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.277987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.278019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.566 qpair failed and we were unable to recover it. 00:28:04.566 [2024-11-28 19:16:25.278130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.278244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.278268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.566 qpair failed and we were unable to recover it. 00:28:04.566 [2024-11-28 19:16:25.278347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.278430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.278455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.566 qpair failed and we were unable to recover it. 00:28:04.566 [2024-11-28 19:16:25.278569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.278643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.278666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.566 qpair failed and we were unable to recover it. 00:28:04.566 [2024-11-28 19:16:25.278742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.278823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.278848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.566 qpair failed and we were unable to recover it. 00:28:04.566 [2024-11-28 19:16:25.278930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.279011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.279035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.566 qpair failed and we were unable to recover it. 00:28:04.566 [2024-11-28 19:16:25.279122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.279200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.279225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.566 qpair failed and we were unable to recover it. 00:28:04.566 [2024-11-28 19:16:25.279308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.279418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.279443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.566 qpair failed and we were unable to recover it. 00:28:04.566 [2024-11-28 19:16:25.279529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.279610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.279635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.566 qpair failed and we were unable to recover it. 00:28:04.566 [2024-11-28 19:16:25.279721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.279794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.279820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.566 qpair failed and we were unable to recover it. 00:28:04.566 [2024-11-28 19:16:25.279896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.280005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.280030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.566 qpair failed and we were unable to recover it. 00:28:04.566 [2024-11-28 19:16:25.280119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.280228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.280254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.566 qpair failed and we were unable to recover it. 00:28:04.566 [2024-11-28 19:16:25.280337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.280455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.280480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.566 qpair failed and we were unable to recover it. 00:28:04.566 [2024-11-28 19:16:25.280554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.280634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.280658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.566 qpair failed and we were unable to recover it. 00:28:04.566 [2024-11-28 19:16:25.280735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.280819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.280843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.566 qpair failed and we were unable to recover it. 00:28:04.566 [2024-11-28 19:16:25.280928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.281004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.281027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.566 qpair failed and we were unable to recover it. 00:28:04.566 [2024-11-28 19:16:25.281135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.281223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.281246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.566 qpair failed and we were unable to recover it. 00:28:04.566 [2024-11-28 19:16:25.281328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.281445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.281470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.566 qpair failed and we were unable to recover it. 00:28:04.566 [2024-11-28 19:16:25.281552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.281659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.566 [2024-11-28 19:16:25.281684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.566 qpair failed and we were unable to recover it. 00:28:04.567 [2024-11-28 19:16:25.281765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.281872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.281897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.567 qpair failed and we were unable to recover it. 00:28:04.567 [2024-11-28 19:16:25.281981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.282062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.282087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.567 qpair failed and we were unable to recover it. 00:28:04.567 [2024-11-28 19:16:25.282203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.282303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.282327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.567 qpair failed and we were unable to recover it. 00:28:04.567 [2024-11-28 19:16:25.282442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.282531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.282555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.567 qpair failed and we were unable to recover it. 00:28:04.567 [2024-11-28 19:16:25.282637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.282744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.282768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.567 qpair failed and we were unable to recover it. 00:28:04.567 [2024-11-28 19:16:25.282874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.282956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.282981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.567 qpair failed and we were unable to recover it. 00:28:04.567 [2024-11-28 19:16:25.283059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.283138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.283162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.567 qpair failed and we were unable to recover it. 00:28:04.567 [2024-11-28 19:16:25.283245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.283318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.283341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.567 qpair failed and we were unable to recover it. 00:28:04.567 [2024-11-28 19:16:25.283458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.283549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.283574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.567 qpair failed and we were unable to recover it. 00:28:04.567 [2024-11-28 19:16:25.283646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.283732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.283756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.567 qpair failed and we were unable to recover it. 00:28:04.567 [2024-11-28 19:16:25.283838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.283947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.283971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.567 qpair failed and we were unable to recover it. 00:28:04.567 [2024-11-28 19:16:25.284057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.284158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.284182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.567 qpair failed and we were unable to recover it. 00:28:04.567 [2024-11-28 19:16:25.284265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.284342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.284366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.567 qpair failed and we were unable to recover it. 00:28:04.567 [2024-11-28 19:16:25.284457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.284537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.284560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.567 qpair failed and we were unable to recover it. 00:28:04.567 [2024-11-28 19:16:25.284645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.284729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.284752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.567 qpair failed and we were unable to recover it. 00:28:04.567 [2024-11-28 19:16:25.284836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.284914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.284938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.567 qpair failed and we were unable to recover it. 00:28:04.567 [2024-11-28 19:16:25.285049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.285161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.285185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.567 qpair failed and we were unable to recover it. 00:28:04.567 [2024-11-28 19:16:25.285294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.285373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.285405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.567 qpair failed and we were unable to recover it. 00:28:04.567 [2024-11-28 19:16:25.285487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.285560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.285583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.567 qpair failed and we were unable to recover it. 00:28:04.567 [2024-11-28 19:16:25.285675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.285751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.285775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.567 qpair failed and we were unable to recover it. 00:28:04.567 [2024-11-28 19:16:25.285861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.285989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.286015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.567 qpair failed and we were unable to recover it. 00:28:04.567 [2024-11-28 19:16:25.286094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.286177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.286200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.567 qpair failed and we were unable to recover it. 00:28:04.567 [2024-11-28 19:16:25.286283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.286367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.286400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.567 qpair failed and we were unable to recover it. 00:28:04.567 [2024-11-28 19:16:25.286511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.286588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.286612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.567 qpair failed and we were unable to recover it. 00:28:04.567 [2024-11-28 19:16:25.286705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.286810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.286835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.567 qpair failed and we were unable to recover it. 00:28:04.567 [2024-11-28 19:16:25.286938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.287016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.287041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.567 qpair failed and we were unable to recover it. 00:28:04.567 [2024-11-28 19:16:25.287115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.287225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.287251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.567 qpair failed and we were unable to recover it. 00:28:04.567 [2024-11-28 19:16:25.287326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.287404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.287430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.567 qpair failed and we were unable to recover it. 00:28:04.567 [2024-11-28 19:16:25.287525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.287606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.567 [2024-11-28 19:16:25.287631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.567 qpair failed and we were unable to recover it. 00:28:04.568 [2024-11-28 19:16:25.287714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.287799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.287824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.568 qpair failed and we were unable to recover it. 00:28:04.568 [2024-11-28 19:16:25.287904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.288029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.288054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.568 qpair failed and we were unable to recover it. 00:28:04.568 [2024-11-28 19:16:25.288134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.288213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.288238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.568 qpair failed and we were unable to recover it. 00:28:04.568 [2024-11-28 19:16:25.288316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.288404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.288433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.568 qpair failed and we were unable to recover it. 00:28:04.568 [2024-11-28 19:16:25.288511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.288618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.288643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.568 qpair failed and we were unable to recover it. 00:28:04.568 [2024-11-28 19:16:25.288720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.288795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.288819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.568 qpair failed and we were unable to recover it. 00:28:04.568 [2024-11-28 19:16:25.288929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.289032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.289056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.568 qpair failed and we were unable to recover it. 00:28:04.568 [2024-11-28 19:16:25.289131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.289233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.289258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.568 qpair failed and we were unable to recover it. 00:28:04.568 [2024-11-28 19:16:25.289363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.289448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.289473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.568 qpair failed and we were unable to recover it. 00:28:04.568 [2024-11-28 19:16:25.289547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.289623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.289649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.568 qpair failed and we were unable to recover it. 00:28:04.568 [2024-11-28 19:16:25.289732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.289842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.289867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.568 qpair failed and we were unable to recover it. 00:28:04.568 [2024-11-28 19:16:25.289973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.290051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.290075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.568 qpair failed and we were unable to recover it. 00:28:04.568 [2024-11-28 19:16:25.290216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.290297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.290322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.568 qpair failed and we were unable to recover it. 00:28:04.568 [2024-11-28 19:16:25.290434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.290509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.290538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.568 qpair failed and we were unable to recover it. 00:28:04.568 [2024-11-28 19:16:25.290625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.290730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.290755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.568 qpair failed and we were unable to recover it. 00:28:04.568 [2024-11-28 19:16:25.290830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.290911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.290934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.568 qpair failed and we were unable to recover it. 00:28:04.568 [2024-11-28 19:16:25.291029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.291104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.291128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.568 qpair failed and we were unable to recover it. 00:28:04.568 [2024-11-28 19:16:25.291201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.291273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.291297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.568 qpair failed and we were unable to recover it. 00:28:04.568 [2024-11-28 19:16:25.291378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.291529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.291555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.568 qpair failed and we were unable to recover it. 00:28:04.568 [2024-11-28 19:16:25.291632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.291766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.291790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.568 qpair failed and we were unable to recover it. 00:28:04.568 [2024-11-28 19:16:25.291893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.291967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.291991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.568 qpair failed and we were unable to recover it. 00:28:04.568 [2024-11-28 19:16:25.292070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.292149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.292174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.568 qpair failed and we were unable to recover it. 00:28:04.568 [2024-11-28 19:16:25.292252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.292333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.292356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.568 qpair failed and we were unable to recover it. 00:28:04.568 [2024-11-28 19:16:25.292441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.292523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.292550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.568 qpair failed and we were unable to recover it. 00:28:04.568 [2024-11-28 19:16:25.292640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.292725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.292750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.568 qpair failed and we were unable to recover it. 00:28:04.568 [2024-11-28 19:16:25.292858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.292931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.292955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.568 qpair failed and we were unable to recover it. 00:28:04.568 [2024-11-28 19:16:25.293033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.293112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.293137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.568 qpair failed and we were unable to recover it. 00:28:04.568 [2024-11-28 19:16:25.293248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.293353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.293377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.568 qpair failed and we were unable to recover it. 00:28:04.568 [2024-11-28 19:16:25.293495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.293570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.568 [2024-11-28 19:16:25.293594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.569 qpair failed and we were unable to recover it. 00:28:04.569 [2024-11-28 19:16:25.293702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.293812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.293838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.569 qpair failed and we were unable to recover it. 00:28:04.569 [2024-11-28 19:16:25.293921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.293995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.294019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.569 qpair failed and we were unable to recover it. 00:28:04.569 [2024-11-28 19:16:25.294153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.294261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.294286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.569 qpair failed and we were unable to recover it. 00:28:04.569 [2024-11-28 19:16:25.294362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.294449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.294475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.569 qpair failed and we were unable to recover it. 00:28:04.569 [2024-11-28 19:16:25.294550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.294630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.294655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.569 qpair failed and we were unable to recover it. 00:28:04.569 [2024-11-28 19:16:25.294741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.294823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.294848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.569 qpair failed and we were unable to recover it. 00:28:04.569 [2024-11-28 19:16:25.294929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.295006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.295031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.569 qpair failed and we were unable to recover it. 00:28:04.569 [2024-11-28 19:16:25.295105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.295180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.295205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.569 qpair failed and we were unable to recover it. 00:28:04.569 [2024-11-28 19:16:25.295281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.295357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.295381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.569 qpair failed and we were unable to recover it. 00:28:04.569 [2024-11-28 19:16:25.295508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.295578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.295601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.569 qpair failed and we were unable to recover it. 00:28:04.569 [2024-11-28 19:16:25.295677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.295783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.295808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.569 qpair failed and we were unable to recover it. 00:28:04.569 [2024-11-28 19:16:25.295902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.295977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.296001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.569 qpair failed and we were unable to recover it. 00:28:04.569 [2024-11-28 19:16:25.296145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.296219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.296242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.569 qpair failed and we were unable to recover it. 00:28:04.569 [2024-11-28 19:16:25.296322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.296410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.296436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.569 qpair failed and we were unable to recover it. 00:28:04.569 [2024-11-28 19:16:25.296545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.296621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.296646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.569 qpair failed and we were unable to recover it. 00:28:04.569 [2024-11-28 19:16:25.296740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.296817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.296842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.569 qpair failed and we were unable to recover it. 00:28:04.569 [2024-11-28 19:16:25.296948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.297051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.297075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.569 qpair failed and we were unable to recover it. 00:28:04.569 [2024-11-28 19:16:25.297187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.297263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.297287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.569 qpair failed and we were unable to recover it. 00:28:04.569 [2024-11-28 19:16:25.297366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.297482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.297506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.569 qpair failed and we were unable to recover it. 00:28:04.569 [2024-11-28 19:16:25.297593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.297678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.297702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.569 qpair failed and we were unable to recover it. 00:28:04.569 [2024-11-28 19:16:25.297784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.297866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.297892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.569 qpair failed and we were unable to recover it. 00:28:04.569 [2024-11-28 19:16:25.297998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.298073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.298097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.569 qpair failed and we were unable to recover it. 00:28:04.569 [2024-11-28 19:16:25.298186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.298291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.298315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.569 qpair failed and we were unable to recover it. 00:28:04.569 [2024-11-28 19:16:25.298433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.298543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.298566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.569 qpair failed and we were unable to recover it. 00:28:04.569 [2024-11-28 19:16:25.298678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.298752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.298776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.569 qpair failed and we were unable to recover it. 00:28:04.569 [2024-11-28 19:16:25.298853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.298959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.298988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.569 qpair failed and we were unable to recover it. 00:28:04.569 [2024-11-28 19:16:25.299073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.299178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.299202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.569 qpair failed and we were unable to recover it. 00:28:04.569 [2024-11-28 19:16:25.299282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.299362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.299386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.569 qpair failed and we were unable to recover it. 00:28:04.569 [2024-11-28 19:16:25.299471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.299550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.569 [2024-11-28 19:16:25.299574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.570 qpair failed and we were unable to recover it. 00:28:04.570 [2024-11-28 19:16:25.299679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.299761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.299785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.570 qpair failed and we were unable to recover it. 00:28:04.570 [2024-11-28 19:16:25.299862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.299970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.299996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.570 qpair failed and we were unable to recover it. 00:28:04.570 [2024-11-28 19:16:25.300082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.300155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.300180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.570 qpair failed and we were unable to recover it. 00:28:04.570 [2024-11-28 19:16:25.300268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.300344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.300368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.570 qpair failed and we were unable to recover it. 00:28:04.570 [2024-11-28 19:16:25.300448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.300561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.300585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.570 qpair failed and we were unable to recover it. 00:28:04.570 [2024-11-28 19:16:25.300665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.300743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.300768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.570 qpair failed and we were unable to recover it. 00:28:04.570 [2024-11-28 19:16:25.300847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.300923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.300951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.570 qpair failed and we were unable to recover it. 00:28:04.570 [2024-11-28 19:16:25.301039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.301127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.301151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.570 qpair failed and we were unable to recover it. 00:28:04.570 [2024-11-28 19:16:25.301230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.301312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.301337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.570 qpair failed and we were unable to recover it. 00:28:04.570 [2024-11-28 19:16:25.301425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.301511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.301535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.570 qpair failed and we were unable to recover it. 00:28:04.570 [2024-11-28 19:16:25.301659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.301734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.301759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.570 qpair failed and we were unable to recover it. 00:28:04.570 [2024-11-28 19:16:25.301872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.301955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.301980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.570 qpair failed and we were unable to recover it. 00:28:04.570 [2024-11-28 19:16:25.302059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.302138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.302162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.570 qpair failed and we were unable to recover it. 00:28:04.570 [2024-11-28 19:16:25.302236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.302316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.302340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.570 qpair failed and we were unable to recover it. 00:28:04.570 [2024-11-28 19:16:25.302435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.302511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.302537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.570 qpair failed and we were unable to recover it. 00:28:04.570 [2024-11-28 19:16:25.302637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.302741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.302765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.570 qpair failed and we were unable to recover it. 00:28:04.570 [2024-11-28 19:16:25.302847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.302923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.302949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.570 qpair failed and we were unable to recover it. 00:28:04.570 [2024-11-28 19:16:25.303046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.303123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.303147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.570 qpair failed and we were unable to recover it. 00:28:04.570 [2024-11-28 19:16:25.303232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.303314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.303338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.570 qpair failed and we were unable to recover it. 00:28:04.570 [2024-11-28 19:16:25.303428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.303547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.303572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.570 qpair failed and we were unable to recover it. 00:28:04.570 [2024-11-28 19:16:25.303680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.303783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.303807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.570 qpair failed and we were unable to recover it. 00:28:04.570 [2024-11-28 19:16:25.303897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.303979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.304003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.570 qpair failed and we were unable to recover it. 00:28:04.570 [2024-11-28 19:16:25.304097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.304172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.304197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.570 qpair failed and we were unable to recover it. 00:28:04.570 [2024-11-28 19:16:25.304274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.304378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.304409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.570 qpair failed and we were unable to recover it. 00:28:04.570 [2024-11-28 19:16:25.304494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.304578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.570 [2024-11-28 19:16:25.304603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.570 qpair failed and we were unable to recover it. 00:28:04.571 [2024-11-28 19:16:25.304711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.304820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.304843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.571 qpair failed and we were unable to recover it. 00:28:04.571 [2024-11-28 19:16:25.304954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.305037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.305062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.571 qpair failed and we were unable to recover it. 00:28:04.571 [2024-11-28 19:16:25.305177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.305259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.305284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.571 qpair failed and we were unable to recover it. 00:28:04.571 [2024-11-28 19:16:25.305361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.305484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.305509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.571 qpair failed and we were unable to recover it. 00:28:04.571 [2024-11-28 19:16:25.305584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.305691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.305715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.571 qpair failed and we were unable to recover it. 00:28:04.571 [2024-11-28 19:16:25.305826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.305913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.305938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.571 qpair failed and we were unable to recover it. 00:28:04.571 [2024-11-28 19:16:25.306027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.306160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.306186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.571 qpair failed and we were unable to recover it. 00:28:04.571 [2024-11-28 19:16:25.306261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.306337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.306361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.571 qpair failed and we were unable to recover it. 00:28:04.571 [2024-11-28 19:16:25.306476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.306550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.306574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.571 qpair failed and we were unable to recover it. 00:28:04.571 [2024-11-28 19:16:25.306652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.306724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.306748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.571 qpair failed and we were unable to recover it. 00:28:04.571 [2024-11-28 19:16:25.306859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.306954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.306979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.571 qpair failed and we were unable to recover it. 00:28:04.571 [2024-11-28 19:16:25.307065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.307144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.307170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.571 qpair failed and we were unable to recover it. 00:28:04.571 [2024-11-28 19:16:25.307245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.307361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.307384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.571 qpair failed and we were unable to recover it. 00:28:04.571 [2024-11-28 19:16:25.307483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.307564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.307588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.571 qpair failed and we were unable to recover it. 00:28:04.571 [2024-11-28 19:16:25.307708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.307788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.307812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.571 qpair failed and we were unable to recover it. 00:28:04.571 [2024-11-28 19:16:25.307906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.307988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.308012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.571 qpair failed and we were unable to recover it. 00:28:04.571 [2024-11-28 19:16:25.308096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.308185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.308211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.571 qpair failed and we were unable to recover it. 00:28:04.571 [2024-11-28 19:16:25.308304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.308386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.308417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.571 qpair failed and we were unable to recover it. 00:28:04.571 [2024-11-28 19:16:25.308496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.308584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.308609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.571 qpair failed and we were unable to recover it. 00:28:04.571 [2024-11-28 19:16:25.308721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.308797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.308822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.571 qpair failed and we were unable to recover it. 00:28:04.571 [2024-11-28 19:16:25.308902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.309008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.309032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.571 qpair failed and we were unable to recover it. 00:28:04.571 [2024-11-28 19:16:25.309144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.309248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.309273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.571 qpair failed and we were unable to recover it. 00:28:04.571 [2024-11-28 19:16:25.309347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.309444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.309469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.571 qpair failed and we were unable to recover it. 00:28:04.571 [2024-11-28 19:16:25.309578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.309665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.309689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.571 qpair failed and we were unable to recover it. 00:28:04.571 [2024-11-28 19:16:25.309801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.309886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.309912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.571 qpair failed and we were unable to recover it. 00:28:04.571 [2024-11-28 19:16:25.309996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.310089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.310113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.571 qpair failed and we were unable to recover it. 00:28:04.571 [2024-11-28 19:16:25.310199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.310272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.310296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.571 qpair failed and we were unable to recover it. 00:28:04.571 [2024-11-28 19:16:25.310382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.310497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.310521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.571 qpair failed and we were unable to recover it. 00:28:04.571 [2024-11-28 19:16:25.310636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.310748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.571 [2024-11-28 19:16:25.310771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.571 qpair failed and we were unable to recover it. 00:28:04.572 [2024-11-28 19:16:25.310857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.310931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.310955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.572 qpair failed and we were unable to recover it. 00:28:04.572 [2024-11-28 19:16:25.311035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.311115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.311139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.572 qpair failed and we were unable to recover it. 00:28:04.572 [2024-11-28 19:16:25.311230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.311337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.311361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.572 qpair failed and we were unable to recover it. 00:28:04.572 [2024-11-28 19:16:25.311455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.311541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.311569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.572 qpair failed and we were unable to recover it. 00:28:04.572 [2024-11-28 19:16:25.311695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.311778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.311803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.572 qpair failed and we were unable to recover it. 00:28:04.572 [2024-11-28 19:16:25.311892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.312007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.312032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.572 qpair failed and we were unable to recover it. 00:28:04.572 [2024-11-28 19:16:25.312139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.312215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.312239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.572 qpair failed and we were unable to recover it. 00:28:04.572 [2024-11-28 19:16:25.312316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.312425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.312451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.572 qpair failed and we were unable to recover it. 00:28:04.572 [2024-11-28 19:16:25.312525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.312611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.312637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.572 qpair failed and we were unable to recover it. 00:28:04.572 [2024-11-28 19:16:25.312736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.312841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.312866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.572 qpair failed and we were unable to recover it. 00:28:04.572 [2024-11-28 19:16:25.312970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.313081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.313105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.572 qpair failed and we were unable to recover it. 00:28:04.572 [2024-11-28 19:16:25.313195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.313269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.313293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.572 qpair failed and we were unable to recover it. 00:28:04.572 [2024-11-28 19:16:25.313369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.313458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.313483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.572 qpair failed and we were unable to recover it. 00:28:04.572 [2024-11-28 19:16:25.313592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.313696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.313720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.572 qpair failed and we were unable to recover it. 00:28:04.572 [2024-11-28 19:16:25.313812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.313894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.313919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.572 qpair failed and we were unable to recover it. 00:28:04.572 [2024-11-28 19:16:25.314001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.314079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.314102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.572 qpair failed and we were unable to recover it. 00:28:04.572 [2024-11-28 19:16:25.314184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.314291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.314316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.572 qpair failed and we were unable to recover it. 00:28:04.572 [2024-11-28 19:16:25.314397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.314475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.314500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.572 qpair failed and we were unable to recover it. 00:28:04.572 [2024-11-28 19:16:25.314612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.314684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.314709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.572 qpair failed and we were unable to recover it. 00:28:04.572 [2024-11-28 19:16:25.314796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.314907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.314931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.572 qpair failed and we were unable to recover it. 00:28:04.572 [2024-11-28 19:16:25.315012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.315088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.315112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.572 qpair failed and we were unable to recover it. 00:28:04.572 [2024-11-28 19:16:25.315187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.315273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.315297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.572 qpair failed and we were unable to recover it. 00:28:04.572 [2024-11-28 19:16:25.315382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.315524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.315550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.572 qpair failed and we were unable to recover it. 00:28:04.572 [2024-11-28 19:16:25.315633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.315708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.315733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.572 qpair failed and we were unable to recover it. 00:28:04.572 [2024-11-28 19:16:25.315824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.315950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.315974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.572 qpair failed and we were unable to recover it. 00:28:04.572 [2024-11-28 19:16:25.316088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.316166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.316190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.572 qpair failed and we were unable to recover it. 00:28:04.572 [2024-11-28 19:16:25.316273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.316348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.316372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.572 qpair failed and we were unable to recover it. 00:28:04.572 [2024-11-28 19:16:25.316470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.316545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.316569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.572 qpair failed and we were unable to recover it. 00:28:04.572 [2024-11-28 19:16:25.316677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.316762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.572 [2024-11-28 19:16:25.316786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.573 qpair failed and we were unable to recover it. 00:28:04.573 [2024-11-28 19:16:25.316891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.316998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.317024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.573 qpair failed and we were unable to recover it. 00:28:04.573 [2024-11-28 19:16:25.317103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.317210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.317234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.573 qpair failed and we were unable to recover it. 00:28:04.573 [2024-11-28 19:16:25.317339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.317410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.317435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.573 qpair failed and we were unable to recover it. 00:28:04.573 [2024-11-28 19:16:25.317512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.317604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.317627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.573 qpair failed and we were unable to recover it. 00:28:04.573 [2024-11-28 19:16:25.317738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.317823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.317849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.573 qpair failed and we were unable to recover it. 00:28:04.573 [2024-11-28 19:16:25.317939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.318039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.318064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.573 qpair failed and we were unable to recover it. 00:28:04.573 [2024-11-28 19:16:25.318174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.318250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.318274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.573 qpair failed and we were unable to recover it. 00:28:04.573 [2024-11-28 19:16:25.318350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.318433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.318458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.573 qpair failed and we were unable to recover it. 00:28:04.573 [2024-11-28 19:16:25.318569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.318654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.318678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.573 qpair failed and we were unable to recover it. 00:28:04.573 [2024-11-28 19:16:25.318794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.318897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.318922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.573 qpair failed and we were unable to recover it. 00:28:04.573 [2024-11-28 19:16:25.318995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.319069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.319095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.573 qpair failed and we were unable to recover it. 00:28:04.573 [2024-11-28 19:16:25.319201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.319279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.319306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.573 qpair failed and we were unable to recover it. 00:28:04.573 [2024-11-28 19:16:25.319384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.319475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.319499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.573 qpair failed and we were unable to recover it. 00:28:04.573 [2024-11-28 19:16:25.319577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.319648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.319673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.573 qpair failed and we were unable to recover it. 00:28:04.573 [2024-11-28 19:16:25.319755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.319864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.319888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.573 qpair failed and we were unable to recover it. 00:28:04.573 [2024-11-28 19:16:25.319975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.320056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.320081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.573 qpair failed and we were unable to recover it. 00:28:04.573 [2024-11-28 19:16:25.320161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.320248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.320271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.573 qpair failed and we were unable to recover it. 00:28:04.573 [2024-11-28 19:16:25.320355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.320470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.320495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.573 qpair failed and we were unable to recover it. 00:28:04.573 [2024-11-28 19:16:25.320579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.320671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.320695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.573 qpair failed and we were unable to recover it. 00:28:04.573 [2024-11-28 19:16:25.320780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.320890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.320914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.573 qpair failed and we were unable to recover it. 00:28:04.573 [2024-11-28 19:16:25.321001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.321078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.321103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.573 qpair failed and we were unable to recover it. 00:28:04.573 [2024-11-28 19:16:25.321216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.321287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.321311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.573 qpair failed and we were unable to recover it. 00:28:04.573 [2024-11-28 19:16:25.321405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.321507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.321531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.573 qpair failed and we were unable to recover it. 00:28:04.573 [2024-11-28 19:16:25.321619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.321716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.321740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.573 qpair failed and we were unable to recover it. 00:28:04.573 [2024-11-28 19:16:25.321817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.321922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.321946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.573 qpair failed and we were unable to recover it. 00:28:04.573 [2024-11-28 19:16:25.322036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.322113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.322142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.573 qpair failed and we were unable to recover it. 00:28:04.573 [2024-11-28 19:16:25.322216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.573 [2024-11-28 19:16:25.322286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.322310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.574 qpair failed and we were unable to recover it. 00:28:04.574 [2024-11-28 19:16:25.322401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.322481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.322505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.574 qpair failed and we were unable to recover it. 00:28:04.574 [2024-11-28 19:16:25.322614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.322742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.322766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.574 qpair failed and we were unable to recover it. 00:28:04.574 [2024-11-28 19:16:25.322851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.322956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.322980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.574 qpair failed and we were unable to recover it. 00:28:04.574 [2024-11-28 19:16:25.323065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.323143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.323167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.574 qpair failed and we were unable to recover it. 00:28:04.574 [2024-11-28 19:16:25.323273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.323352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.323376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.574 qpair failed and we were unable to recover it. 00:28:04.574 [2024-11-28 19:16:25.323469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.323595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.323619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.574 qpair failed and we were unable to recover it. 00:28:04.574 [2024-11-28 19:16:25.323738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.323814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.323839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.574 qpair failed and we were unable to recover it. 00:28:04.574 [2024-11-28 19:16:25.323948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.324028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.324051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.574 qpair failed and we were unable to recover it. 00:28:04.574 [2024-11-28 19:16:25.324158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.324265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.324290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.574 qpair failed and we were unable to recover it. 00:28:04.574 [2024-11-28 19:16:25.324377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.324503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.324528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.574 qpair failed and we were unable to recover it. 00:28:04.574 [2024-11-28 19:16:25.324612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.324700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.324725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.574 qpair failed and we were unable to recover it. 00:28:04.574 [2024-11-28 19:16:25.324822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.324902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.324925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.574 qpair failed and we were unable to recover it. 00:28:04.574 [2024-11-28 19:16:25.325028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.325134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.325159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.574 qpair failed and we were unable to recover it. 00:28:04.574 [2024-11-28 19:16:25.325255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.325340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.325364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.574 qpair failed and we were unable to recover it. 00:28:04.574 [2024-11-28 19:16:25.325452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.325537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.325561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.574 qpair failed and we were unable to recover it. 00:28:04.574 [2024-11-28 19:16:25.325647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.325753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.325777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.574 qpair failed and we were unable to recover it. 00:28:04.574 [2024-11-28 19:16:25.325858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.325930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.325955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.574 qpair failed and we were unable to recover it. 00:28:04.574 [2024-11-28 19:16:25.326068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.326142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.326166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.574 qpair failed and we were unable to recover it. 00:28:04.574 [2024-11-28 19:16:25.326248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.326352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.326377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.574 qpair failed and we were unable to recover it. 00:28:04.574 [2024-11-28 19:16:25.326529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.326604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.326628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.574 qpair failed and we were unable to recover it. 00:28:04.574 [2024-11-28 19:16:25.326722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.326861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.326885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.574 qpair failed and we were unable to recover it. 00:28:04.574 [2024-11-28 19:16:25.326961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.327034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.327058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.574 qpair failed and we were unable to recover it. 00:28:04.574 [2024-11-28 19:16:25.327164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.327272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.327298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.574 qpair failed and we were unable to recover it. 00:28:04.574 [2024-11-28 19:16:25.327382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.327463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.327487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.574 qpair failed and we were unable to recover it. 00:28:04.574 [2024-11-28 19:16:25.327595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.327712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.327736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.574 qpair failed and we were unable to recover it. 00:28:04.574 [2024-11-28 19:16:25.327821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.327900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.327925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.574 qpair failed and we were unable to recover it. 00:28:04.574 [2024-11-28 19:16:25.328032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.328106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.328131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.574 qpair failed and we were unable to recover it. 00:28:04.574 [2024-11-28 19:16:25.328214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.328290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.328315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.574 qpair failed and we were unable to recover it. 00:28:04.574 [2024-11-28 19:16:25.328419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.574 [2024-11-28 19:16:25.328498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.328523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.575 qpair failed and we were unable to recover it. 00:28:04.575 [2024-11-28 19:16:25.328640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.328752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.328776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.575 qpair failed and we were unable to recover it. 00:28:04.575 [2024-11-28 19:16:25.328857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.328937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.328962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.575 qpair failed and we were unable to recover it. 00:28:04.575 [2024-11-28 19:16:25.329040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.329115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.329139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.575 qpair failed and we were unable to recover it. 00:28:04.575 [2024-11-28 19:16:25.329220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.329296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.329320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.575 qpair failed and we were unable to recover it. 00:28:04.575 [2024-11-28 19:16:25.329431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.329514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.329539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.575 qpair failed and we were unable to recover it. 00:28:04.575 [2024-11-28 19:16:25.329659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.329733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.329757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.575 qpair failed and we were unable to recover it. 00:28:04.575 [2024-11-28 19:16:25.329836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.329914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.329938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.575 qpair failed and we were unable to recover it. 00:28:04.575 [2024-11-28 19:16:25.330051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.330125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.330149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.575 qpair failed and we were unable to recover it. 00:28:04.575 [2024-11-28 19:16:25.330236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.330330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.330353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.575 qpair failed and we were unable to recover it. 00:28:04.575 [2024-11-28 19:16:25.330452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.330542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.330566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.575 qpair failed and we were unable to recover it. 00:28:04.575 [2024-11-28 19:16:25.330673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.330761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.330786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.575 qpair failed and we were unable to recover it. 00:28:04.575 [2024-11-28 19:16:25.330893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.330971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.330996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.575 qpair failed and we were unable to recover it. 00:28:04.575 [2024-11-28 19:16:25.331080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.331153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.331176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.575 qpair failed and we were unable to recover it. 00:28:04.575 [2024-11-28 19:16:25.331292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.331380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.331410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.575 qpair failed and we were unable to recover it. 00:28:04.575 [2024-11-28 19:16:25.331488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.331567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.331592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.575 qpair failed and we were unable to recover it. 00:28:04.575 [2024-11-28 19:16:25.331670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.331782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.331807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.575 qpair failed and we were unable to recover it. 00:28:04.575 [2024-11-28 19:16:25.331922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.332008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.332033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.575 qpair failed and we were unable to recover it. 00:28:04.575 [2024-11-28 19:16:25.332113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.332189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.332213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.575 qpair failed and we were unable to recover it. 00:28:04.575 [2024-11-28 19:16:25.332290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.332408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.332434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.575 qpair failed and we were unable to recover it. 00:28:04.575 [2024-11-28 19:16:25.332510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.332615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.332639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.575 qpair failed and we were unable to recover it. 00:28:04.575 [2024-11-28 19:16:25.332723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.332802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.332830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.575 qpair failed and we were unable to recover it. 00:28:04.575 [2024-11-28 19:16:25.332909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.332979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.333003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.575 qpair failed and we were unable to recover it. 00:28:04.575 [2024-11-28 19:16:25.333082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.333186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.333210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.575 qpair failed and we were unable to recover it. 00:28:04.575 [2024-11-28 19:16:25.333286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.333360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.575 [2024-11-28 19:16:25.333384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.575 qpair failed and we were unable to recover it. 00:28:04.575 [2024-11-28 19:16:25.333502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.333578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.333602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.576 qpair failed and we were unable to recover it. 00:28:04.576 [2024-11-28 19:16:25.333712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.333798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.333823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.576 qpair failed and we were unable to recover it. 00:28:04.576 [2024-11-28 19:16:25.333905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.333983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.334007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.576 qpair failed and we were unable to recover it. 00:28:04.576 [2024-11-28 19:16:25.334121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.334195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.334219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.576 qpair failed and we were unable to recover it. 00:28:04.576 [2024-11-28 19:16:25.334301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.334420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.334444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.576 qpair failed and we were unable to recover it. 00:28:04.576 [2024-11-28 19:16:25.334552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.334659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.334684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.576 qpair failed and we were unable to recover it. 00:28:04.576 [2024-11-28 19:16:25.334766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.334846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.334876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.576 qpair failed and we were unable to recover it. 00:28:04.576 [2024-11-28 19:16:25.334967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.335040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.335064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.576 qpair failed and we were unable to recover it. 00:28:04.576 [2024-11-28 19:16:25.335166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.335245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.335271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.576 qpair failed and we were unable to recover it. 00:28:04.576 [2024-11-28 19:16:25.335349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.335457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.335482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.576 qpair failed and we were unable to recover it. 00:28:04.576 [2024-11-28 19:16:25.335573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.335698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.335722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.576 qpair failed and we were unable to recover it. 00:28:04.576 [2024-11-28 19:16:25.335830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.335913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.335937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.576 qpair failed and we were unable to recover it. 00:28:04.576 [2024-11-28 19:16:25.336012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.336087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.336112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.576 qpair failed and we were unable to recover it. 00:28:04.576 [2024-11-28 19:16:25.336231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.336313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.336337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.576 qpair failed and we were unable to recover it. 00:28:04.576 [2024-11-28 19:16:25.336437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.336521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.336545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.576 qpair failed and we were unable to recover it. 00:28:04.576 [2024-11-28 19:16:25.336625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.336741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.336765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.576 qpair failed and we were unable to recover it. 00:28:04.576 [2024-11-28 19:16:25.336878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.336951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.336975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.576 qpair failed and we were unable to recover it. 00:28:04.576 [2024-11-28 19:16:25.337059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.337138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.337164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.576 qpair failed and we were unable to recover it. 00:28:04.576 [2024-11-28 19:16:25.337269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.337345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.337369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.576 qpair failed and we were unable to recover it. 00:28:04.576 [2024-11-28 19:16:25.337452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.337531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.337555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.576 qpair failed and we were unable to recover it. 00:28:04.576 [2024-11-28 19:16:25.337645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.337729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.337753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.576 qpair failed and we were unable to recover it. 00:28:04.576 [2024-11-28 19:16:25.337865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.337941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.337966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.576 qpair failed and we were unable to recover it. 00:28:04.576 [2024-11-28 19:16:25.338043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.338122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.338146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.576 qpair failed and we were unable to recover it. 00:28:04.576 [2024-11-28 19:16:25.338248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.338354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.338379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.576 qpair failed and we were unable to recover it. 00:28:04.576 [2024-11-28 19:16:25.338518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.338598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.338622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.576 qpair failed and we were unable to recover it. 00:28:04.576 [2024-11-28 19:16:25.338700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.338785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.338808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.576 qpair failed and we were unable to recover it. 00:28:04.576 [2024-11-28 19:16:25.338893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.338995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.339018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.576 qpair failed and we were unable to recover it. 00:28:04.576 [2024-11-28 19:16:25.339162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.339271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.339295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.576 qpair failed and we were unable to recover it. 00:28:04.576 [2024-11-28 19:16:25.339407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.339484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.576 [2024-11-28 19:16:25.339509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.576 qpair failed and we were unable to recover it. 00:28:04.576 [2024-11-28 19:16:25.339596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.339703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.339728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.577 qpair failed and we were unable to recover it. 00:28:04.577 [2024-11-28 19:16:25.339820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.339902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.339927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.577 qpair failed and we were unable to recover it. 00:28:04.577 [2024-11-28 19:16:25.340005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.340084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.340108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.577 qpair failed and we were unable to recover it. 00:28:04.577 [2024-11-28 19:16:25.340218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.340299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.340323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.577 qpair failed and we were unable to recover it. 00:28:04.577 [2024-11-28 19:16:25.340427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.340512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.340536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.577 qpair failed and we were unable to recover it. 00:28:04.577 [2024-11-28 19:16:25.340613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.340700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.340725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.577 qpair failed and we were unable to recover it. 00:28:04.577 [2024-11-28 19:16:25.340802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.340915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.340939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.577 qpair failed and we were unable to recover it. 00:28:04.577 [2024-11-28 19:16:25.341015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.341096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.341121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.577 qpair failed and we were unable to recover it. 00:28:04.577 [2024-11-28 19:16:25.341225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.341337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.341362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.577 qpair failed and we were unable to recover it. 00:28:04.577 [2024-11-28 19:16:25.341440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.341514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.341538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.577 qpair failed and we were unable to recover it. 00:28:04.577 [2024-11-28 19:16:25.341619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.341731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.341756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.577 qpair failed and we were unable to recover it. 00:28:04.577 [2024-11-28 19:16:25.341832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.341939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.341963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.577 qpair failed and we were unable to recover it. 00:28:04.577 [2024-11-28 19:16:25.342052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.342127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.342152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.577 qpair failed and we were unable to recover it. 00:28:04.577 [2024-11-28 19:16:25.342265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.342349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.342373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.577 qpair failed and we were unable to recover it. 00:28:04.577 [2024-11-28 19:16:25.342463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.342574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.342600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.577 qpair failed and we were unable to recover it. 00:28:04.577 [2024-11-28 19:16:25.342687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.342766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.342792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.577 qpair failed and we were unable to recover it. 00:28:04.577 [2024-11-28 19:16:25.342876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.343024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.343048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.577 qpair failed and we were unable to recover it. 00:28:04.577 [2024-11-28 19:16:25.343131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.343208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.343232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.577 qpair failed and we were unable to recover it. 00:28:04.577 [2024-11-28 19:16:25.343310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.343406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.343430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.577 qpair failed and we were unable to recover it. 00:28:04.577 [2024-11-28 19:16:25.343537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.343648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.343672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.577 qpair failed and we were unable to recover it. 00:28:04.577 [2024-11-28 19:16:25.343751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.343829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.343853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.577 qpair failed and we were unable to recover it. 00:28:04.577 [2024-11-28 19:16:25.343931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.344034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.344059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.577 qpair failed and we were unable to recover it. 00:28:04.577 [2024-11-28 19:16:25.344134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.344224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.344248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.577 qpair failed and we were unable to recover it. 00:28:04.577 [2024-11-28 19:16:25.344355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.344469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.344494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.577 qpair failed and we were unable to recover it. 00:28:04.577 [2024-11-28 19:16:25.344576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.344651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.344675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.577 qpair failed and we were unable to recover it. 00:28:04.577 [2024-11-28 19:16:25.344783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.344855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.344880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.577 qpair failed and we were unable to recover it. 00:28:04.577 [2024-11-28 19:16:25.344962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.345088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.345113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.577 qpair failed and we were unable to recover it. 00:28:04.577 [2024-11-28 19:16:25.345194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.345273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.345297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.577 qpair failed and we were unable to recover it. 00:28:04.577 [2024-11-28 19:16:25.345371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.345458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.577 [2024-11-28 19:16:25.345487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.577 qpair failed and we were unable to recover it. 00:28:04.578 [2024-11-28 19:16:25.345575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.345651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.345676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.578 qpair failed and we were unable to recover it. 00:28:04.578 [2024-11-28 19:16:25.345765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.345836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.345861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.578 qpair failed and we were unable to recover it. 00:28:04.578 [2024-11-28 19:16:25.345955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.346062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.346085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.578 qpair failed and we were unable to recover it. 00:28:04.578 [2024-11-28 19:16:25.346163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.346247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.346271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.578 qpair failed and we were unable to recover it. 00:28:04.578 [2024-11-28 19:16:25.346387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.346525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.346548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.578 qpair failed and we were unable to recover it. 00:28:04.578 [2024-11-28 19:16:25.346635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.346713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.346737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.578 qpair failed and we were unable to recover it. 00:28:04.578 [2024-11-28 19:16:25.346846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.346921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.346946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.578 qpair failed and we were unable to recover it. 00:28:04.578 [2024-11-28 19:16:25.347025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.347112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.347137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.578 qpair failed and we were unable to recover it. 00:28:04.578 [2024-11-28 19:16:25.347231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.347338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.347362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.578 qpair failed and we were unable to recover it. 00:28:04.578 [2024-11-28 19:16:25.347468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.347557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.347582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.578 qpair failed and we were unable to recover it. 00:28:04.578 [2024-11-28 19:16:25.347693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.347767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.347790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.578 qpair failed and we were unable to recover it. 00:28:04.578 [2024-11-28 19:16:25.347867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.347943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.347967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.578 qpair failed and we were unable to recover it. 00:28:04.578 [2024-11-28 19:16:25.348055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.348134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.348158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.578 qpair failed and we were unable to recover it. 00:28:04.578 [2024-11-28 19:16:25.348243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.348363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.348387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.578 qpair failed and we were unable to recover it. 00:28:04.578 [2024-11-28 19:16:25.348472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.348551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.348575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.578 qpair failed and we were unable to recover it. 00:28:04.578 [2024-11-28 19:16:25.348690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.348767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.348791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.578 qpair failed and we were unable to recover it. 00:28:04.578 [2024-11-28 19:16:25.348876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.348957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.348983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.578 qpair failed and we were unable to recover it. 00:28:04.578 [2024-11-28 19:16:25.349082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.349165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.349189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.578 qpair failed and we were unable to recover it. 00:28:04.578 [2024-11-28 19:16:25.349262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.349345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.349369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.578 qpair failed and we were unable to recover it. 00:28:04.578 [2024-11-28 19:16:25.349489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.349571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.349595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.578 qpair failed and we were unable to recover it. 00:28:04.578 [2024-11-28 19:16:25.349692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.349766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.349790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.578 qpair failed and we were unable to recover it. 00:28:04.578 [2024-11-28 19:16:25.349884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.350021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.350046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.578 qpair failed and we were unable to recover it. 00:28:04.578 [2024-11-28 19:16:25.350134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.350209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.350233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.578 qpair failed and we were unable to recover it. 00:28:04.578 [2024-11-28 19:16:25.350318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.350424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.350449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.578 qpair failed and we were unable to recover it. 00:28:04.578 [2024-11-28 19:16:25.350530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.350664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.350688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.578 qpair failed and we were unable to recover it. 00:28:04.578 [2024-11-28 19:16:25.350775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.350854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.350880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.578 qpair failed and we were unable to recover it. 00:28:04.578 [2024-11-28 19:16:25.350988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.351065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.351090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.578 qpair failed and we were unable to recover it. 00:28:04.578 [2024-11-28 19:16:25.351171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.351252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.351276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.578 qpair failed and we were unable to recover it. 00:28:04.578 [2024-11-28 19:16:25.351386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.351500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.578 [2024-11-28 19:16:25.351525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.578 qpair failed and we were unable to recover it. 00:28:04.579 [2024-11-28 19:16:25.351616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.351700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.351724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.579 qpair failed and we were unable to recover it. 00:28:04.579 [2024-11-28 19:16:25.351812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.351917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.351941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.579 qpair failed and we were unable to recover it. 00:28:04.579 [2024-11-28 19:16:25.352045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.352154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.352178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.579 qpair failed and we were unable to recover it. 00:28:04.579 [2024-11-28 19:16:25.352253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.352331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.352356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.579 qpair failed and we were unable to recover it. 00:28:04.579 [2024-11-28 19:16:25.352476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.352555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.352580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.579 qpair failed and we were unable to recover it. 00:28:04.579 [2024-11-28 19:16:25.352657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.352733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.352757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.579 qpair failed and we were unable to recover it. 00:28:04.579 [2024-11-28 19:16:25.352865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.352937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.352961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.579 qpair failed and we were unable to recover it. 00:28:04.579 [2024-11-28 19:16:25.353038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.353130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.353154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.579 qpair failed and we were unable to recover it. 00:28:04.579 [2024-11-28 19:16:25.353233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.353320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.353344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.579 qpair failed and we were unable to recover it. 00:28:04.579 [2024-11-28 19:16:25.353426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.353504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.353528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.579 qpair failed and we were unable to recover it. 00:28:04.579 [2024-11-28 19:16:25.353635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.353712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.353735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.579 qpair failed and we were unable to recover it. 00:28:04.579 [2024-11-28 19:16:25.353838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.353924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.353948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.579 qpair failed and we were unable to recover it. 00:28:04.579 [2024-11-28 19:16:25.354034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.354111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.354135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.579 qpair failed and we were unable to recover it. 00:28:04.579 [2024-11-28 19:16:25.354219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.354334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.354359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.579 qpair failed and we were unable to recover it. 00:28:04.579 [2024-11-28 19:16:25.354445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.354520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.354544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.579 qpair failed and we were unable to recover it. 00:28:04.579 [2024-11-28 19:16:25.354621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.354695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.354720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.579 qpair failed and we were unable to recover it. 00:28:04.579 [2024-11-28 19:16:25.354832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.354914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.354937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.579 qpair failed and we were unable to recover it. 00:28:04.579 [2024-11-28 19:16:25.355017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.355096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.355120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.579 qpair failed and we were unable to recover it. 00:28:04.579 [2024-11-28 19:16:25.355197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.355280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.355304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.579 qpair failed and we were unable to recover it. 00:28:04.579 [2024-11-28 19:16:25.355382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.355479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.355505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.579 qpair failed and we were unable to recover it. 00:28:04.579 [2024-11-28 19:16:25.355596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.355672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.355696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.579 qpair failed and we were unable to recover it. 00:28:04.579 [2024-11-28 19:16:25.355787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.355910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.355939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.579 qpair failed and we were unable to recover it. 00:28:04.579 [2024-11-28 19:16:25.356023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.356103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.356127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.579 qpair failed and we were unable to recover it. 00:28:04.579 [2024-11-28 19:16:25.356209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.356285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.356309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.579 qpair failed and we were unable to recover it. 00:28:04.579 [2024-11-28 19:16:25.356405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.356496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.356520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.579 qpair failed and we were unable to recover it. 00:28:04.579 [2024-11-28 19:16:25.356597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.356681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.356705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.579 qpair failed and we were unable to recover it. 00:28:04.579 [2024-11-28 19:16:25.356813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.356894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.356918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.579 qpair failed and we were unable to recover it. 00:28:04.579 [2024-11-28 19:16:25.357012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.357095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.357120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.579 qpair failed and we were unable to recover it. 00:28:04.579 [2024-11-28 19:16:25.357203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.357290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.579 [2024-11-28 19:16:25.357315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.579 qpair failed and we were unable to recover it. 00:28:04.580 [2024-11-28 19:16:25.357397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.357487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.357512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.580 qpair failed and we were unable to recover it. 00:28:04.580 [2024-11-28 19:16:25.357602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.357684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.357710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.580 qpair failed and we were unable to recover it. 00:28:04.580 [2024-11-28 19:16:25.357790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.357871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.357897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.580 qpair failed and we were unable to recover it. 00:28:04.580 [2024-11-28 19:16:25.357990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.358076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.358102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.580 qpair failed and we were unable to recover it. 00:28:04.580 [2024-11-28 19:16:25.358184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.358266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.358291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.580 qpair failed and we were unable to recover it. 00:28:04.580 [2024-11-28 19:16:25.358427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.358536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.358561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.580 qpair failed and we were unable to recover it. 00:28:04.580 [2024-11-28 19:16:25.358646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.358732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.358757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.580 qpair failed and we were unable to recover it. 00:28:04.580 [2024-11-28 19:16:25.358875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.358950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.358974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.580 qpair failed and we were unable to recover it. 00:28:04.580 [2024-11-28 19:16:25.359063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.359145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.359169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.580 qpair failed and we were unable to recover it. 00:28:04.580 [2024-11-28 19:16:25.359249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.359357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.359382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.580 qpair failed and we were unable to recover it. 00:28:04.580 [2024-11-28 19:16:25.359472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.359576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.359600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.580 qpair failed and we were unable to recover it. 00:28:04.580 [2024-11-28 19:16:25.359680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.359762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.359787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.580 qpair failed and we were unable to recover it. 00:28:04.580 [2024-11-28 19:16:25.359899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.359987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.360011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.580 qpair failed and we were unable to recover it. 00:28:04.580 [2024-11-28 19:16:25.360126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.360234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.360258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.580 qpair failed and we were unable to recover it. 00:28:04.580 [2024-11-28 19:16:25.360330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.360413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.360439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.580 qpair failed and we were unable to recover it. 00:28:04.580 [2024-11-28 19:16:25.360520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.360603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.360628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.580 qpair failed and we were unable to recover it. 00:28:04.580 [2024-11-28 19:16:25.360721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.360803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.360829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.580 qpair failed and we were unable to recover it. 00:28:04.580 [2024-11-28 19:16:25.360905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.360987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.361011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.580 qpair failed and we were unable to recover it. 00:28:04.580 [2024-11-28 19:16:25.361088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.361198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.361222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.580 qpair failed and we were unable to recover it. 00:28:04.580 [2024-11-28 19:16:25.361300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.361408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.361433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.580 qpair failed and we were unable to recover it. 00:28:04.580 [2024-11-28 19:16:25.361516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.361603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.361627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.580 qpair failed and we were unable to recover it. 00:28:04.580 [2024-11-28 19:16:25.361714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.361799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.361823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.580 qpair failed and we were unable to recover it. 00:28:04.580 [2024-11-28 19:16:25.361904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.361985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.362009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.580 qpair failed and we were unable to recover it. 00:28:04.580 [2024-11-28 19:16:25.362136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.362271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.362305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.580 qpair failed and we were unable to recover it. 00:28:04.580 [2024-11-28 19:16:25.362404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.362502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.362531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.580 qpair failed and we were unable to recover it. 00:28:04.580 [2024-11-28 19:16:25.362625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.362704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.580 [2024-11-28 19:16:25.362735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.581 qpair failed and we were unable to recover it. 00:28:04.581 [2024-11-28 19:16:25.362866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.362958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.362989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.581 qpair failed and we were unable to recover it. 00:28:04.581 [2024-11-28 19:16:25.363087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.363167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.363195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.581 qpair failed and we were unable to recover it. 00:28:04.581 [2024-11-28 19:16:25.363314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.363433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.363465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.581 qpair failed and we were unable to recover it. 00:28:04.581 [2024-11-28 19:16:25.363583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.363670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.363696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.581 qpair failed and we were unable to recover it. 00:28:04.581 [2024-11-28 19:16:25.363793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.363912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.363940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.581 qpair failed and we were unable to recover it. 00:28:04.581 [2024-11-28 19:16:25.364046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.364161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.364190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.581 qpair failed and we were unable to recover it. 00:28:04.581 [2024-11-28 19:16:25.364285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.364370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.364402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.581 qpair failed and we were unable to recover it. 00:28:04.581 [2024-11-28 19:16:25.364491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.364585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.364610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.581 qpair failed and we were unable to recover it. 00:28:04.581 [2024-11-28 19:16:25.364714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.364791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.364816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.581 qpair failed and we were unable to recover it. 00:28:04.581 [2024-11-28 19:16:25.364900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.365025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.365050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.581 qpair failed and we were unable to recover it. 00:28:04.581 [2024-11-28 19:16:25.365138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.365252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.365276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.581 qpair failed and we were unable to recover it. 00:28:04.581 [2024-11-28 19:16:25.365369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.365460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.365485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.581 qpair failed and we were unable to recover it. 00:28:04.581 [2024-11-28 19:16:25.365576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.365652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.365676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.581 qpair failed and we were unable to recover it. 00:28:04.581 [2024-11-28 19:16:25.365757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.365833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.365858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.581 qpair failed and we were unable to recover it. 00:28:04.581 [2024-11-28 19:16:25.365940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.366063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.366087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.581 qpair failed and we were unable to recover it. 00:28:04.581 [2024-11-28 19:16:25.366163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.366243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.366267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.581 qpair failed and we were unable to recover it. 00:28:04.581 [2024-11-28 19:16:25.366381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.366473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.366500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.581 qpair failed and we were unable to recover it. 00:28:04.581 [2024-11-28 19:16:25.366583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.366669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.366694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.581 qpair failed and we were unable to recover it. 00:28:04.581 [2024-11-28 19:16:25.366774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.366878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.366902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.581 qpair failed and we were unable to recover it. 00:28:04.581 [2024-11-28 19:16:25.366997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.367107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.367131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.581 qpair failed and we were unable to recover it. 00:28:04.581 [2024-11-28 19:16:25.367214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.367330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.367354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.581 qpair failed and we were unable to recover it. 00:28:04.581 [2024-11-28 19:16:25.367476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.367561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.367585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.581 qpair failed and we were unable to recover it. 00:28:04.581 [2024-11-28 19:16:25.367667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.367758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.367783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.581 qpair failed and we were unable to recover it. 00:28:04.581 [2024-11-28 19:16:25.367867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.367954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.367978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.581 qpair failed and we were unable to recover it. 00:28:04.581 [2024-11-28 19:16:25.368063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.368166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.368191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.581 qpair failed and we were unable to recover it. 00:28:04.581 [2024-11-28 19:16:25.368273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.368359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.368384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.581 qpair failed and we were unable to recover it. 00:28:04.581 [2024-11-28 19:16:25.368513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.368593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.368618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.581 qpair failed and we were unable to recover it. 00:28:04.581 [2024-11-28 19:16:25.368703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.368809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.368838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.581 qpair failed and we were unable to recover it. 00:28:04.581 [2024-11-28 19:16:25.368929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.369012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.369038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.581 qpair failed and we were unable to recover it. 00:28:04.581 [2024-11-28 19:16:25.369122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.369218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.581 [2024-11-28 19:16:25.369242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.581 qpair failed and we were unable to recover it. 00:28:04.582 [2024-11-28 19:16:25.369325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.369407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.369432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.582 qpair failed and we were unable to recover it. 00:28:04.582 [2024-11-28 19:16:25.369509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.369585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.369610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.582 qpair failed and we were unable to recover it. 00:28:04.582 [2024-11-28 19:16:25.369690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.369789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.369813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.582 qpair failed and we were unable to recover it. 00:28:04.582 [2024-11-28 19:16:25.369904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.369983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.370008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.582 qpair failed and we were unable to recover it. 00:28:04.582 [2024-11-28 19:16:25.370120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.370198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.370221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.582 qpair failed and we were unable to recover it. 00:28:04.582 [2024-11-28 19:16:25.370296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.370385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.370416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.582 qpair failed and we were unable to recover it. 00:28:04.582 [2024-11-28 19:16:25.370492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.370571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.370595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.582 qpair failed and we were unable to recover it. 00:28:04.582 [2024-11-28 19:16:25.370675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.370760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.370784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.582 qpair failed and we were unable to recover it. 00:28:04.582 [2024-11-28 19:16:25.370869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.370952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.370976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.582 qpair failed and we were unable to recover it. 00:28:04.582 [2024-11-28 19:16:25.371059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.371145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.371170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.582 qpair failed and we were unable to recover it. 00:28:04.582 [2024-11-28 19:16:25.371252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.371324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.371349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.582 qpair failed and we were unable to recover it. 00:28:04.582 [2024-11-28 19:16:25.371433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.371511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.371535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.582 qpair failed and we were unable to recover it. 00:28:04.582 [2024-11-28 19:16:25.371614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.371721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.371745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.582 qpair failed and we were unable to recover it. 00:28:04.582 [2024-11-28 19:16:25.371829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.371902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.371926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.582 qpair failed and we were unable to recover it. 00:28:04.582 [2024-11-28 19:16:25.372013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.372098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.372123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.582 qpair failed and we were unable to recover it. 00:28:04.582 [2024-11-28 19:16:25.372232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.372308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.372331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.582 qpair failed and we were unable to recover it. 00:28:04.582 [2024-11-28 19:16:25.372415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.372497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.372522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.582 qpair failed and we were unable to recover it. 00:28:04.582 [2024-11-28 19:16:25.372630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.372707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.372731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.582 qpair failed and we were unable to recover it. 00:28:04.582 [2024-11-28 19:16:25.372823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.372895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.372919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.582 qpair failed and we were unable to recover it. 00:28:04.582 [2024-11-28 19:16:25.373011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.373121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.373144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.582 qpair failed and we were unable to recover it. 00:28:04.582 [2024-11-28 19:16:25.373219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.373288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.373312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.582 qpair failed and we were unable to recover it. 00:28:04.582 [2024-11-28 19:16:25.373424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.373504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.373529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.582 qpair failed and we were unable to recover it. 00:28:04.582 [2024-11-28 19:16:25.373629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.373707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.373732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.582 qpair failed and we were unable to recover it. 00:28:04.582 [2024-11-28 19:16:25.373845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.373925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.373949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.582 qpair failed and we were unable to recover it. 00:28:04.582 [2024-11-28 19:16:25.374031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.374138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.374162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.582 qpair failed and we were unable to recover it. 00:28:04.582 [2024-11-28 19:16:25.374256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.374339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.374363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.582 qpair failed and we were unable to recover it. 00:28:04.582 [2024-11-28 19:16:25.374452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.374546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.374571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.582 qpair failed and we were unable to recover it. 00:28:04.582 [2024-11-28 19:16:25.374661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.374737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.374761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.582 qpair failed and we were unable to recover it. 00:28:04.582 [2024-11-28 19:16:25.374856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.374934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.374959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.582 qpair failed and we were unable to recover it. 00:28:04.582 [2024-11-28 19:16:25.375067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.375148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.375172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.582 qpair failed and we were unable to recover it. 00:28:04.582 [2024-11-28 19:16:25.375282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.375360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.582 [2024-11-28 19:16:25.375384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.582 qpair failed and we were unable to recover it. 00:28:04.582 [2024-11-28 19:16:25.375478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.375556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.375580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.583 qpair failed and we were unable to recover it. 00:28:04.583 [2024-11-28 19:16:25.375662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.375740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.375764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.583 qpair failed and we were unable to recover it. 00:28:04.583 [2024-11-28 19:16:25.375848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.375931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.375955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.583 qpair failed and we were unable to recover it. 00:28:04.583 [2024-11-28 19:16:25.376077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.376161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.376185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.583 qpair failed and we were unable to recover it. 00:28:04.583 [2024-11-28 19:16:25.376268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.376346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.376371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.583 qpair failed and we were unable to recover it. 00:28:04.583 [2024-11-28 19:16:25.376475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.376578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.376607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.583 qpair failed and we were unable to recover it. 00:28:04.583 [2024-11-28 19:16:25.376705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.376791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.376818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.583 qpair failed and we were unable to recover it. 00:28:04.583 [2024-11-28 19:16:25.376909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.377109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.377139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.583 qpair failed and we were unable to recover it. 00:28:04.583 [2024-11-28 19:16:25.377222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.377309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.377336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.583 qpair failed and we were unable to recover it. 00:28:04.583 [2024-11-28 19:16:25.377431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.377549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.377578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.583 qpair failed and we were unable to recover it. 00:28:04.583 [2024-11-28 19:16:25.377672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.377814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.377843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.583 qpair failed and we were unable to recover it. 00:28:04.583 [2024-11-28 19:16:25.377932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.378017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.378043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.583 qpair failed and we were unable to recover it. 00:28:04.583 [2024-11-28 19:16:25.378155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.378239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.378263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.583 qpair failed and we were unable to recover it. 00:28:04.583 [2024-11-28 19:16:25.378345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.378435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.378460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.583 qpair failed and we were unable to recover it. 00:28:04.583 [2024-11-28 19:16:25.378545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.378654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.378678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.583 qpair failed and we were unable to recover it. 00:28:04.583 [2024-11-28 19:16:25.378758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.378847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.378872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.583 qpair failed and we were unable to recover it. 00:28:04.583 [2024-11-28 19:16:25.378964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.379046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.379071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.583 qpair failed and we were unable to recover it. 00:28:04.583 [2024-11-28 19:16:25.379153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.379233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.379261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.583 qpair failed and we were unable to recover it. 00:28:04.583 [2024-11-28 19:16:25.379375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.379463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.379488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.583 qpair failed and we were unable to recover it. 00:28:04.583 [2024-11-28 19:16:25.379569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.379648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.379672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.583 qpair failed and we were unable to recover it. 00:28:04.583 [2024-11-28 19:16:25.379748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.379828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.379853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.583 qpair failed and we were unable to recover it. 00:28:04.583 [2024-11-28 19:16:25.379935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.380017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.380041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.583 qpair failed and we were unable to recover it. 00:28:04.583 [2024-11-28 19:16:25.380120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.380194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.380218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.583 qpair failed and we were unable to recover it. 00:28:04.583 [2024-11-28 19:16:25.380327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.380413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.380438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.583 qpair failed and we were unable to recover it. 00:28:04.583 [2024-11-28 19:16:25.380520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.380596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.380621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.583 qpair failed and we were unable to recover it. 00:28:04.583 [2024-11-28 19:16:25.380696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.380764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.380789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.583 qpair failed and we were unable to recover it. 00:28:04.583 [2024-11-28 19:16:25.380861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.380942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.380966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.583 qpair failed and we were unable to recover it. 00:28:04.583 [2024-11-28 19:16:25.381048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.381127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.381157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.583 qpair failed and we were unable to recover it. 00:28:04.583 [2024-11-28 19:16:25.381239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.381324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.381348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.583 qpair failed and we were unable to recover it. 00:28:04.583 [2024-11-28 19:16:25.381441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.381531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.381556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.583 qpair failed and we were unable to recover it. 00:28:04.583 [2024-11-28 19:16:25.381666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.583 [2024-11-28 19:16:25.381748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.381772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.584 qpair failed and we were unable to recover it. 00:28:04.584 [2024-11-28 19:16:25.381851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.381933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.381959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.584 qpair failed and we were unable to recover it. 00:28:04.584 [2024-11-28 19:16:25.382061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.382135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.382159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.584 qpair failed and we were unable to recover it. 00:28:04.584 [2024-11-28 19:16:25.382241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.382317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.382342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.584 qpair failed and we were unable to recover it. 00:28:04.584 [2024-11-28 19:16:25.382424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.382512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.382536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.584 qpair failed and we were unable to recover it. 00:28:04.584 [2024-11-28 19:16:25.382623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.382702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.382727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.584 qpair failed and we were unable to recover it. 00:28:04.584 [2024-11-28 19:16:25.382815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.382897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.382923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.584 qpair failed and we were unable to recover it. 00:28:04.584 [2024-11-28 19:16:25.383006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.383087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.383113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.584 qpair failed and we were unable to recover it. 00:28:04.584 [2024-11-28 19:16:25.383209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.383298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.383331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.584 qpair failed and we were unable to recover it. 00:28:04.584 [2024-11-28 19:16:25.383461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.383659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.383691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.584 qpair failed and we were unable to recover it. 00:28:04.584 [2024-11-28 19:16:25.383785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.383907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.383934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.584 qpair failed and we were unable to recover it. 00:28:04.584 [2024-11-28 19:16:25.384059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.384151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.384181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.584 qpair failed and we were unable to recover it. 00:28:04.584 [2024-11-28 19:16:25.384271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.384359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.384386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.584 qpair failed and we were unable to recover it. 00:28:04.584 [2024-11-28 19:16:25.384493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.384639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.384665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.584 qpair failed and we were unable to recover it. 00:28:04.584 [2024-11-28 19:16:25.384801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.384887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.384913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.584 qpair failed and we were unable to recover it. 00:28:04.584 [2024-11-28 19:16:25.384997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.385085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.385110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.584 qpair failed and we were unable to recover it. 00:28:04.584 [2024-11-28 19:16:25.385203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.385293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.385318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.584 qpair failed and we were unable to recover it. 00:28:04.584 [2024-11-28 19:16:25.385405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.385496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.385523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.584 qpair failed and we were unable to recover it. 00:28:04.584 [2024-11-28 19:16:25.385617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.385742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.385767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.584 qpair failed and we were unable to recover it. 00:28:04.584 [2024-11-28 19:16:25.385855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.385939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.385964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.584 qpair failed and we were unable to recover it. 00:28:04.584 [2024-11-28 19:16:25.386076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.386186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.386213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.584 qpair failed and we were unable to recover it. 00:28:04.584 [2024-11-28 19:16:25.386319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.386409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.386440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.584 qpair failed and we were unable to recover it. 00:28:04.584 [2024-11-28 19:16:25.386534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.386625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.386652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.584 qpair failed and we were unable to recover it. 00:28:04.584 [2024-11-28 19:16:25.386763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.386901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.386926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.584 qpair failed and we were unable to recover it. 00:28:04.584 [2024-11-28 19:16:25.387018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.387097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.387123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.584 qpair failed and we were unable to recover it. 00:28:04.584 [2024-11-28 19:16:25.387243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.387356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.387381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.584 qpair failed and we were unable to recover it. 00:28:04.584 [2024-11-28 19:16:25.387513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.387602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.387628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.584 qpair failed and we were unable to recover it. 00:28:04.584 [2024-11-28 19:16:25.387748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.387826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.387851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.584 qpair failed and we were unable to recover it. 00:28:04.584 [2024-11-28 19:16:25.387954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.388039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.388066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.584 qpair failed and we were unable to recover it. 00:28:04.584 [2024-11-28 19:16:25.388162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.388247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.388276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.584 qpair failed and we were unable to recover it. 00:28:04.584 [2024-11-28 19:16:25.388364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.388456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.584 [2024-11-28 19:16:25.388484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.584 qpair failed and we were unable to recover it. 00:28:04.585 [2024-11-28 19:16:25.388580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.388662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.388690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.585 qpair failed and we were unable to recover it. 00:28:04.585 [2024-11-28 19:16:25.388789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.388877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.388907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.585 qpair failed and we were unable to recover it. 00:28:04.585 [2024-11-28 19:16:25.388994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.389080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.389110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.585 qpair failed and we were unable to recover it. 00:28:04.585 [2024-11-28 19:16:25.389225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.389311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.389337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.585 qpair failed and we were unable to recover it. 00:28:04.585 [2024-11-28 19:16:25.389441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.389548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.389578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.585 qpair failed and we were unable to recover it. 00:28:04.585 [2024-11-28 19:16:25.389656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.389749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.389774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.585 qpair failed and we were unable to recover it. 00:28:04.585 [2024-11-28 19:16:25.389877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.389996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.390024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.585 qpair failed and we were unable to recover it. 00:28:04.585 [2024-11-28 19:16:25.390123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.390211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.390237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.585 qpair failed and we were unable to recover it. 00:28:04.585 [2024-11-28 19:16:25.390321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.390404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.390431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.585 qpair failed and we were unable to recover it. 00:28:04.585 [2024-11-28 19:16:25.390524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.390607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.390633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.585 qpair failed and we were unable to recover it. 00:28:04.585 [2024-11-28 19:16:25.390828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.390909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.390934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.585 qpair failed and we were unable to recover it. 00:28:04.585 [2024-11-28 19:16:25.391076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.391165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.391190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.585 qpair failed and we were unable to recover it. 00:28:04.585 [2024-11-28 19:16:25.391304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.391417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.391444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.585 qpair failed and we were unable to recover it. 00:28:04.585 [2024-11-28 19:16:25.391638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.391720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.391746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.585 qpair failed and we were unable to recover it. 00:28:04.585 [2024-11-28 19:16:25.391854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.391973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.391998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.585 qpair failed and we were unable to recover it. 00:28:04.585 [2024-11-28 19:16:25.392091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.392171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.392195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.585 qpair failed and we were unable to recover it. 00:28:04.585 [2024-11-28 19:16:25.392277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.392361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.392391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.585 qpair failed and we were unable to recover it. 00:28:04.585 [2024-11-28 19:16:25.392490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.392588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.392619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.585 qpair failed and we were unable to recover it. 00:28:04.585 [2024-11-28 19:16:25.392713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.392839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.392866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.585 qpair failed and we were unable to recover it. 00:28:04.585 [2024-11-28 19:16:25.392987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.393082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.393109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.585 qpair failed and we were unable to recover it. 00:28:04.585 [2024-11-28 19:16:25.393196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.393287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.393315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.585 qpair failed and we were unable to recover it. 00:28:04.585 [2024-11-28 19:16:25.393399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.393483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.393511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.585 qpair failed and we were unable to recover it. 00:28:04.585 [2024-11-28 19:16:25.393630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.393744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.393769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.585 qpair failed and we were unable to recover it. 00:28:04.585 [2024-11-28 19:16:25.393851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.393934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.393960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.585 qpair failed and we were unable to recover it. 00:28:04.585 [2024-11-28 19:16:25.394076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.394156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.394184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.585 qpair failed and we were unable to recover it. 00:28:04.585 [2024-11-28 19:16:25.394283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.394401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.394430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.585 qpair failed and we were unable to recover it. 00:28:04.585 [2024-11-28 19:16:25.394530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.394610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.394640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.585 qpair failed and we were unable to recover it. 00:28:04.585 [2024-11-28 19:16:25.394731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.394843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.394870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.585 qpair failed and we were unable to recover it. 00:28:04.585 [2024-11-28 19:16:25.394967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.395050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.395078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.585 qpair failed and we were unable to recover it. 00:28:04.585 [2024-11-28 19:16:25.395166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.395254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.395280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.585 qpair failed and we were unable to recover it. 00:28:04.585 [2024-11-28 19:16:25.395376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.395465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.395490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.585 qpair failed and we were unable to recover it. 00:28:04.585 [2024-11-28 19:16:25.395578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.395668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.395699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.585 qpair failed and we were unable to recover it. 00:28:04.585 [2024-11-28 19:16:25.395792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.395889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.585 [2024-11-28 19:16:25.395919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.585 qpair failed and we were unable to recover it. 00:28:04.586 [2024-11-28 19:16:25.396006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.396100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.396126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.586 qpair failed and we were unable to recover it. 00:28:04.586 [2024-11-28 19:16:25.396215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.396301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.396330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.586 qpair failed and we were unable to recover it. 00:28:04.586 [2024-11-28 19:16:25.396445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.396526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.396551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.586 qpair failed and we were unable to recover it. 00:28:04.586 [2024-11-28 19:16:25.396644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.396717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.396742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.586 qpair failed and we were unable to recover it. 00:28:04.586 [2024-11-28 19:16:25.396878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.396985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.397016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.586 qpair failed and we were unable to recover it. 00:28:04.586 [2024-11-28 19:16:25.397113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.397230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.397256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.586 qpair failed and we were unable to recover it. 00:28:04.586 [2024-11-28 19:16:25.397349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.397443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.397470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.586 qpair failed and we were unable to recover it. 00:28:04.586 [2024-11-28 19:16:25.397581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.397669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.397695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.586 qpair failed and we were unable to recover it. 00:28:04.586 [2024-11-28 19:16:25.397817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.397902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.397927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.586 qpair failed and we were unable to recover it. 00:28:04.586 [2024-11-28 19:16:25.398010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.398094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.398119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.586 qpair failed and we were unable to recover it. 00:28:04.586 [2024-11-28 19:16:25.398204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.398290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.398317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.586 qpair failed and we were unable to recover it. 00:28:04.586 [2024-11-28 19:16:25.398408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.398520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.398545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.586 qpair failed and we were unable to recover it. 00:28:04.586 [2024-11-28 19:16:25.398632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.398825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.398852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.586 qpair failed and we were unable to recover it. 00:28:04.586 [2024-11-28 19:16:25.398962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.399047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.399073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.586 qpair failed and we were unable to recover it. 00:28:04.586 [2024-11-28 19:16:25.399156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.399260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.399296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.586 qpair failed and we were unable to recover it. 00:28:04.586 [2024-11-28 19:16:25.399406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.399491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.399518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.586 qpair failed and we were unable to recover it. 00:28:04.586 [2024-11-28 19:16:25.399606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.399683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.399709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.586 qpair failed and we were unable to recover it. 00:28:04.586 [2024-11-28 19:16:25.399906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.399997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.400023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.586 qpair failed and we were unable to recover it. 00:28:04.586 [2024-11-28 19:16:25.400101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.400189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.400214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.586 qpair failed and we were unable to recover it. 00:28:04.586 [2024-11-28 19:16:25.400297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.400433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.400460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.586 qpair failed and we were unable to recover it. 00:28:04.586 [2024-11-28 19:16:25.400543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.400620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.400649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.586 qpair failed and we were unable to recover it. 00:28:04.586 [2024-11-28 19:16:25.400729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.400812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.400843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.586 qpair failed and we were unable to recover it. 00:28:04.586 [2024-11-28 19:16:25.400934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.401044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.401071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.586 qpair failed and we were unable to recover it. 00:28:04.586 [2024-11-28 19:16:25.401161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.401234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.401263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.586 qpair failed and we were unable to recover it. 00:28:04.586 [2024-11-28 19:16:25.401407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.401494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.401520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.586 qpair failed and we were unable to recover it. 00:28:04.586 [2024-11-28 19:16:25.401614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.401724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.401749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.586 qpair failed and we were unable to recover it. 00:28:04.586 [2024-11-28 19:16:25.401889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.401998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.402024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.586 qpair failed and we were unable to recover it. 00:28:04.586 [2024-11-28 19:16:25.402112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.402189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.402215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.586 qpair failed and we were unable to recover it. 00:28:04.586 [2024-11-28 19:16:25.402305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.402420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.402446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.586 qpair failed and we were unable to recover it. 00:28:04.586 [2024-11-28 19:16:25.402533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.402616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.402641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.586 qpair failed and we were unable to recover it. 00:28:04.586 [2024-11-28 19:16:25.402725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.402839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.402865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.586 qpair failed and we were unable to recover it. 00:28:04.586 [2024-11-28 19:16:25.402952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.403066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.403091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.586 qpair failed and we were unable to recover it. 00:28:04.586 [2024-11-28 19:16:25.403196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.403286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.403311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.586 qpair failed and we were unable to recover it. 00:28:04.586 [2024-11-28 19:16:25.403427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.586 [2024-11-28 19:16:25.403506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.403531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.587 qpair failed and we were unable to recover it. 00:28:04.587 [2024-11-28 19:16:25.403616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.403706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.403733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.587 qpair failed and we were unable to recover it. 00:28:04.587 [2024-11-28 19:16:25.403870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.403956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.403983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.587 qpair failed and we were unable to recover it. 00:28:04.587 [2024-11-28 19:16:25.404071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.404160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.404185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.587 qpair failed and we were unable to recover it. 00:28:04.587 [2024-11-28 19:16:25.404303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.404416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.404442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.587 qpair failed and we were unable to recover it. 00:28:04.587 [2024-11-28 19:16:25.404525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.404613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.404640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.587 qpair failed and we were unable to recover it. 00:28:04.587 [2024-11-28 19:16:25.404715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.404798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.404824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.587 qpair failed and we were unable to recover it. 00:28:04.587 [2024-11-28 19:16:25.404896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.404987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.405012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.587 qpair failed and we were unable to recover it. 00:28:04.587 [2024-11-28 19:16:25.405139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.405218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.405243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.587 qpair failed and we were unable to recover it. 00:28:04.587 [2024-11-28 19:16:25.405350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.405451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.405478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.587 qpair failed and we were unable to recover it. 00:28:04.587 [2024-11-28 19:16:25.405569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.405698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.405724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.587 qpair failed and we were unable to recover it. 00:28:04.587 [2024-11-28 19:16:25.405811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.405888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.405914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.587 qpair failed and we were unable to recover it. 00:28:04.587 [2024-11-28 19:16:25.406010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.406135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.406160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.587 qpair failed and we were unable to recover it. 00:28:04.587 [2024-11-28 19:16:25.406237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.406363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.406389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.587 qpair failed and we were unable to recover it. 00:28:04.587 [2024-11-28 19:16:25.406510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.406589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.406614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.587 qpair failed and we were unable to recover it. 00:28:04.587 [2024-11-28 19:16:25.406700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.406779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.406804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.587 qpair failed and we were unable to recover it. 00:28:04.587 [2024-11-28 19:16:25.406910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.407001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.407028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.587 qpair failed and we were unable to recover it. 00:28:04.587 [2024-11-28 19:16:25.407110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.407198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.407223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.587 qpair failed and we were unable to recover it. 00:28:04.587 [2024-11-28 19:16:25.407340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.407426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.407452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.587 qpair failed and we were unable to recover it. 00:28:04.587 [2024-11-28 19:16:25.407532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.407619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.407644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.587 qpair failed and we were unable to recover it. 00:28:04.587 [2024-11-28 19:16:25.407737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.407816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.407842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.587 qpair failed and we were unable to recover it. 00:28:04.587 [2024-11-28 19:16:25.407956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.408069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.408095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.587 qpair failed and we were unable to recover it. 00:28:04.587 [2024-11-28 19:16:25.408186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.408262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.408288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.587 qpair failed and we were unable to recover it. 00:28:04.587 [2024-11-28 19:16:25.408368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.408490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.408517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.587 qpair failed and we were unable to recover it. 00:28:04.587 [2024-11-28 19:16:25.408614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.408714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.408741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.587 qpair failed and we were unable to recover it. 00:28:04.587 [2024-11-28 19:16:25.408828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.408935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.408961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.587 qpair failed and we were unable to recover it. 00:28:04.587 [2024-11-28 19:16:25.409071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.409155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.409184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.587 qpair failed and we were unable to recover it. 00:28:04.587 [2024-11-28 19:16:25.409273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.409388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.409421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.587 qpair failed and we were unable to recover it. 00:28:04.587 [2024-11-28 19:16:25.409505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.409586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.409611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.587 qpair failed and we were unable to recover it. 00:28:04.587 [2024-11-28 19:16:25.409699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.409806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.409831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.587 qpair failed and we were unable to recover it. 00:28:04.587 [2024-11-28 19:16:25.409924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.410032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.410057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.587 qpair failed and we were unable to recover it. 00:28:04.587 [2024-11-28 19:16:25.410140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.410221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.410247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.587 qpair failed and we were unable to recover it. 00:28:04.587 [2024-11-28 19:16:25.410343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.410425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.410452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.587 qpair failed and we were unable to recover it. 00:28:04.587 [2024-11-28 19:16:25.410548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.410630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.410656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.587 qpair failed and we were unable to recover it. 00:28:04.587 [2024-11-28 19:16:25.410741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.410824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.410849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.587 qpair failed and we were unable to recover it. 00:28:04.587 [2024-11-28 19:16:25.410936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.411022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.411048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.587 qpair failed and we were unable to recover it. 00:28:04.587 [2024-11-28 19:16:25.411131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.587 [2024-11-28 19:16:25.411216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.411242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.588 qpair failed and we were unable to recover it. 00:28:04.588 [2024-11-28 19:16:25.411331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.411421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.411447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.588 qpair failed and we were unable to recover it. 00:28:04.588 [2024-11-28 19:16:25.411531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.411610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.411635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.588 qpair failed and we were unable to recover it. 00:28:04.588 [2024-11-28 19:16:25.411752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.411861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.411886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.588 qpair failed and we were unable to recover it. 00:28:04.588 [2024-11-28 19:16:25.411965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.412043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.412068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.588 qpair failed and we were unable to recover it. 00:28:04.588 [2024-11-28 19:16:25.412156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.412265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.412290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.588 qpair failed and we were unable to recover it. 00:28:04.588 [2024-11-28 19:16:25.412380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.412474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.412500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.588 qpair failed and we were unable to recover it. 00:28:04.588 [2024-11-28 19:16:25.412583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.412670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.412696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.588 qpair failed and we were unable to recover it. 00:28:04.588 [2024-11-28 19:16:25.412803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.412907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.412932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.588 qpair failed and we were unable to recover it. 00:28:04.588 [2024-11-28 19:16:25.413012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.413145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.413171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.588 qpair failed and we were unable to recover it. 00:28:04.588 [2024-11-28 19:16:25.413282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.413363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.413389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.588 qpair failed and we were unable to recover it. 00:28:04.588 [2024-11-28 19:16:25.413489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.413598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.413624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.588 qpair failed and we were unable to recover it. 00:28:04.588 [2024-11-28 19:16:25.413704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.413792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.413818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.588 qpair failed and we were unable to recover it. 00:28:04.588 [2024-11-28 19:16:25.413906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.414015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.414041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.588 qpair failed and we were unable to recover it. 00:28:04.588 [2024-11-28 19:16:25.414122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.414232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.414257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.588 qpair failed and we were unable to recover it. 00:28:04.588 [2024-11-28 19:16:25.414354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.414474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.414500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.588 qpair failed and we were unable to recover it. 00:28:04.588 [2024-11-28 19:16:25.414597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.414688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.414717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.588 qpair failed and we were unable to recover it. 00:28:04.588 [2024-11-28 19:16:25.414815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.414903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.414934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.588 qpair failed and we were unable to recover it. 00:28:04.588 [2024-11-28 19:16:25.415025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.415114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.415140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.588 qpair failed and we were unable to recover it. 00:28:04.588 [2024-11-28 19:16:25.415237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.415319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.415349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.588 qpair failed and we were unable to recover it. 00:28:04.588 [2024-11-28 19:16:25.415445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.415528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.415554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.588 qpair failed and we were unable to recover it. 00:28:04.588 [2024-11-28 19:16:25.415645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.415727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.415754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.588 qpair failed and we were unable to recover it. 00:28:04.588 [2024-11-28 19:16:25.415839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.415954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.415980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.588 qpair failed and we were unable to recover it. 00:28:04.588 [2024-11-28 19:16:25.416067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.416160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.416185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.588 qpair failed and we were unable to recover it. 00:28:04.588 [2024-11-28 19:16:25.416264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.416354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.416381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.588 qpair failed and we were unable to recover it. 00:28:04.588 [2024-11-28 19:16:25.416517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.416608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.416634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.588 qpair failed and we were unable to recover it. 00:28:04.588 [2024-11-28 19:16:25.416718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.416803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.416829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.588 qpair failed and we were unable to recover it. 00:28:04.588 [2024-11-28 19:16:25.416914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.417000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.417026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.588 qpair failed and we were unable to recover it. 00:28:04.588 [2024-11-28 19:16:25.417116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.417255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.417280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.588 qpair failed and we were unable to recover it. 00:28:04.588 [2024-11-28 19:16:25.417357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.417480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.417506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.588 qpair failed and we were unable to recover it. 00:28:04.588 [2024-11-28 19:16:25.417600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.417687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.417713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.588 qpair failed and we were unable to recover it. 00:28:04.588 [2024-11-28 19:16:25.417803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.417913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.417938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.588 qpair failed and we were unable to recover it. 00:28:04.588 [2024-11-28 19:16:25.418020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.418130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.588 [2024-11-28 19:16:25.418155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.588 qpair failed and we were unable to recover it. 00:28:04.589 [2024-11-28 19:16:25.418244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.418328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.418354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.589 qpair failed and we were unable to recover it. 00:28:04.589 [2024-11-28 19:16:25.418458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.418572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.418598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.589 qpair failed and we were unable to recover it. 00:28:04.589 [2024-11-28 19:16:25.418694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.418774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.418804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.589 qpair failed and we were unable to recover it. 00:28:04.589 [2024-11-28 19:16:25.418901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.418994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.419021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.589 qpair failed and we were unable to recover it. 00:28:04.589 [2024-11-28 19:16:25.419103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.419215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.419243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.589 qpair failed and we were unable to recover it. 00:28:04.589 [2024-11-28 19:16:25.419333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.419443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.419474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.589 qpair failed and we were unable to recover it. 00:28:04.589 [2024-11-28 19:16:25.419564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.419652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.419677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.589 qpair failed and we were unable to recover it. 00:28:04.589 [2024-11-28 19:16:25.419799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.419877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.419908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.589 qpair failed and we were unable to recover it. 00:28:04.589 [2024-11-28 19:16:25.419996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.420079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.420105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.589 qpair failed and we were unable to recover it. 00:28:04.589 [2024-11-28 19:16:25.420197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.420280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.420307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.589 qpair failed and we were unable to recover it. 00:28:04.589 [2024-11-28 19:16:25.420399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.420508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.420534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.589 qpair failed and we were unable to recover it. 00:28:04.589 [2024-11-28 19:16:25.420623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.420728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.420753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.589 qpair failed and we were unable to recover it. 00:28:04.589 [2024-11-28 19:16:25.420847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.420938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.420967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.589 qpair failed and we were unable to recover it. 00:28:04.589 [2024-11-28 19:16:25.421052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.421133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.421162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.589 qpair failed and we were unable to recover it. 00:28:04.589 [2024-11-28 19:16:25.421247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.421330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.421355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.589 qpair failed and we were unable to recover it. 00:28:04.589 [2024-11-28 19:16:25.421478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.421567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.421593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.589 qpair failed and we were unable to recover it. 00:28:04.589 [2024-11-28 19:16:25.421712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.421796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.421821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.589 qpair failed and we were unable to recover it. 00:28:04.589 [2024-11-28 19:16:25.421900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.422044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.422069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.589 qpair failed and we were unable to recover it. 00:28:04.589 [2024-11-28 19:16:25.422152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.422261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.422289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.589 qpair failed and we were unable to recover it. 00:28:04.589 [2024-11-28 19:16:25.422380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.422517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.422543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.589 qpair failed and we were unable to recover it. 00:28:04.589 [2024-11-28 19:16:25.422652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.422737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.422762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.589 qpair failed and we were unable to recover it. 00:28:04.589 [2024-11-28 19:16:25.422842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.422920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.422946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.589 qpair failed and we were unable to recover it. 00:28:04.589 [2024-11-28 19:16:25.423053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.423138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.423163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.589 qpair failed and we were unable to recover it. 00:28:04.589 [2024-11-28 19:16:25.423252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.423359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.423388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.589 qpair failed and we were unable to recover it. 00:28:04.589 [2024-11-28 19:16:25.423476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.423556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.423583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.589 qpair failed and we were unable to recover it. 00:28:04.589 [2024-11-28 19:16:25.423659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.423738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.423763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.589 qpair failed and we were unable to recover it. 00:28:04.589 [2024-11-28 19:16:25.423846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.423934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.423960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.589 qpair failed and we were unable to recover it. 00:28:04.589 [2024-11-28 19:16:25.424045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.424124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.424150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.589 qpair failed and we were unable to recover it. 00:28:04.589 [2024-11-28 19:16:25.424261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.424376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.424408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.589 qpair failed and we were unable to recover it. 00:28:04.589 [2024-11-28 19:16:25.424505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.424587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.424615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.589 qpair failed and we were unable to recover it. 00:28:04.589 [2024-11-28 19:16:25.424695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.424775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.424804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.589 qpair failed and we were unable to recover it. 00:28:04.589 [2024-11-28 19:16:25.424886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.424996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.425022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.589 qpair failed and we were unable to recover it. 00:28:04.589 [2024-11-28 19:16:25.425110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.425193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.425222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.589 qpair failed and we were unable to recover it. 00:28:04.589 [2024-11-28 19:16:25.425335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.425444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.425476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.589 qpair failed and we were unable to recover it. 00:28:04.589 [2024-11-28 19:16:25.425556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.425637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.425662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.589 qpair failed and we were unable to recover it. 00:28:04.589 [2024-11-28 19:16:25.425745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.425820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.589 [2024-11-28 19:16:25.425845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.589 qpair failed and we were unable to recover it. 00:28:04.590 [2024-11-28 19:16:25.425937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.426053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.426079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.590 qpair failed and we were unable to recover it. 00:28:04.590 [2024-11-28 19:16:25.426166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.426246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.426271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.590 qpair failed and we were unable to recover it. 00:28:04.590 [2024-11-28 19:16:25.426400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.426483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.426509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.590 qpair failed and we were unable to recover it. 00:28:04.590 [2024-11-28 19:16:25.426595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.426710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.426739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.590 qpair failed and we were unable to recover it. 00:28:04.590 [2024-11-28 19:16:25.426829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.426908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.426933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.590 qpair failed and we were unable to recover it. 00:28:04.590 [2024-11-28 19:16:25.427047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.427133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.427158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.590 qpair failed and we were unable to recover it. 00:28:04.590 [2024-11-28 19:16:25.427246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.427383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.427413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.590 qpair failed and we were unable to recover it. 00:28:04.590 [2024-11-28 19:16:25.427490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.427572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.427602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.590 qpair failed and we were unable to recover it. 00:28:04.590 [2024-11-28 19:16:25.427690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.427774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.427799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.590 qpair failed and we were unable to recover it. 00:28:04.590 [2024-11-28 19:16:25.427879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.428008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.428034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.590 qpair failed and we were unable to recover it. 00:28:04.590 [2024-11-28 19:16:25.428130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.428206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.428232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.590 qpair failed and we were unable to recover it. 00:28:04.590 [2024-11-28 19:16:25.428312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.428389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.428419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.590 qpair failed and we were unable to recover it. 00:28:04.590 [2024-11-28 19:16:25.428502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.428589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.428615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.590 qpair failed and we were unable to recover it. 00:28:04.590 [2024-11-28 19:16:25.428698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.428779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.428804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.590 qpair failed and we were unable to recover it. 00:28:04.590 [2024-11-28 19:16:25.428894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.428980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.429005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.590 qpair failed and we were unable to recover it. 00:28:04.590 [2024-11-28 19:16:25.429084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.429170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.429196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.590 qpair failed and we were unable to recover it. 00:28:04.590 [2024-11-28 19:16:25.429289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.429405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.429431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.590 qpair failed and we were unable to recover it. 00:28:04.590 [2024-11-28 19:16:25.429512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.429625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.429650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.590 qpair failed and we were unable to recover it. 00:28:04.590 [2024-11-28 19:16:25.429738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.429848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.429873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.590 qpair failed and we were unable to recover it. 00:28:04.590 [2024-11-28 19:16:25.429958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.430038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.430067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.590 qpair failed and we were unable to recover it. 00:28:04.590 [2024-11-28 19:16:25.430161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.430264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.430289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.590 qpair failed and we were unable to recover it. 00:28:04.590 [2024-11-28 19:16:25.430376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.430464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.430490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.590 qpair failed and we were unable to recover it. 00:28:04.590 [2024-11-28 19:16:25.430572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.430676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.430702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.590 qpair failed and we were unable to recover it. 00:28:04.590 [2024-11-28 19:16:25.430817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.430902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.430927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.590 qpair failed and we were unable to recover it. 00:28:04.590 [2024-11-28 19:16:25.431040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.431119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.431144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.590 qpair failed and we were unable to recover it. 00:28:04.590 [2024-11-28 19:16:25.431284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.431404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.431430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.590 qpair failed and we were unable to recover it. 00:28:04.590 [2024-11-28 19:16:25.431516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.431600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.431625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.590 qpair failed and we were unable to recover it. 00:28:04.590 [2024-11-28 19:16:25.431714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.431795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.431821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.590 qpair failed and we were unable to recover it. 00:28:04.590 [2024-11-28 19:16:25.431909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.431994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.432019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.590 qpair failed and we were unable to recover it. 00:28:04.590 [2024-11-28 19:16:25.432094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.432179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.432204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.590 qpair failed and we were unable to recover it. 00:28:04.590 [2024-11-28 19:16:25.432295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.432378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.432411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.590 qpair failed and we were unable to recover it. 00:28:04.590 [2024-11-28 19:16:25.432503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.432587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.432614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.590 qpair failed and we were unable to recover it. 00:28:04.590 [2024-11-28 19:16:25.432704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.432787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.432812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.590 qpair failed and we were unable to recover it. 00:28:04.590 [2024-11-28 19:16:25.432955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.433042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.433068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.590 qpair failed and we were unable to recover it. 00:28:04.590 [2024-11-28 19:16:25.433185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.433297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.433322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.590 qpair failed and we were unable to recover it. 00:28:04.590 [2024-11-28 19:16:25.433437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.433517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.590 [2024-11-28 19:16:25.433544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.590 qpair failed and we were unable to recover it. 00:28:04.591 [2024-11-28 19:16:25.433639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.433751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.433777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.591 qpair failed and we were unable to recover it. 00:28:04.591 [2024-11-28 19:16:25.433864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.433947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.433972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.591 qpair failed and we were unable to recover it. 00:28:04.591 [2024-11-28 19:16:25.434064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.434143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.434168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.591 qpair failed and we were unable to recover it. 00:28:04.591 [2024-11-28 19:16:25.434251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.434330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.434355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.591 qpair failed and we were unable to recover it. 00:28:04.591 [2024-11-28 19:16:25.434450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.434542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.434568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.591 qpair failed and we were unable to recover it. 00:28:04.591 [2024-11-28 19:16:25.434684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.434792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.434818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.591 qpair failed and we were unable to recover it. 00:28:04.591 [2024-11-28 19:16:25.434928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.435006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.435031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.591 qpair failed and we were unable to recover it. 00:28:04.591 [2024-11-28 19:16:25.435143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.435224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.435252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.591 qpair failed and we were unable to recover it. 00:28:04.591 [2024-11-28 19:16:25.435368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.435463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.435489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.591 qpair failed and we were unable to recover it. 00:28:04.591 [2024-11-28 19:16:25.435567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.435650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.435676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.591 qpair failed and we were unable to recover it. 00:28:04.591 [2024-11-28 19:16:25.435760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.435907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.435933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.591 qpair failed and we were unable to recover it. 00:28:04.591 [2024-11-28 19:16:25.436019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.436105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.436132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.591 qpair failed and we were unable to recover it. 00:28:04.591 [2024-11-28 19:16:25.436217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.436310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.436335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.591 qpair failed and we were unable to recover it. 00:28:04.591 [2024-11-28 19:16:25.436417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.436531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.436557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.591 qpair failed and we were unable to recover it. 00:28:04.591 [2024-11-28 19:16:25.436638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.436752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.436778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.591 qpair failed and we were unable to recover it. 00:28:04.591 [2024-11-28 19:16:25.436865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.436979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.437005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.591 qpair failed and we were unable to recover it. 00:28:04.591 [2024-11-28 19:16:25.437087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.437169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.437194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.591 qpair failed and we were unable to recover it. 00:28:04.591 [2024-11-28 19:16:25.437301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.437377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.437417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.591 qpair failed and we were unable to recover it. 00:28:04.591 [2024-11-28 19:16:25.437498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.437577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.437605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.591 qpair failed and we were unable to recover it. 00:28:04.591 [2024-11-28 19:16:25.437718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.437798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.437825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.591 qpair failed and we were unable to recover it. 00:28:04.591 [2024-11-28 19:16:25.437934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.438018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.438044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.591 qpair failed and we were unable to recover it. 00:28:04.591 [2024-11-28 19:16:25.438121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.438228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.438254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.591 qpair failed and we were unable to recover it. 00:28:04.591 [2024-11-28 19:16:25.438341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.438435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.438461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.591 qpair failed and we were unable to recover it. 00:28:04.591 [2024-11-28 19:16:25.438543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.438653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.438678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.591 qpair failed and we were unable to recover it. 00:28:04.591 [2024-11-28 19:16:25.438761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.438838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.438864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.591 qpair failed and we were unable to recover it. 00:28:04.591 [2024-11-28 19:16:25.438948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.439034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.439059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.591 qpair failed and we were unable to recover it. 00:28:04.591 [2024-11-28 19:16:25.439169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.439254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.439279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.591 qpair failed and we were unable to recover it. 00:28:04.591 [2024-11-28 19:16:25.439388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.439478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.439503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.591 qpair failed and we were unable to recover it. 00:28:04.591 [2024-11-28 19:16:25.439584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.439700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.439726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.591 qpair failed and we were unable to recover it. 00:28:04.591 [2024-11-28 19:16:25.439812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.439908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.439934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.591 qpair failed and we were unable to recover it. 00:28:04.591 [2024-11-28 19:16:25.440017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.440100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.440126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.591 qpair failed and we were unable to recover it. 00:28:04.591 [2024-11-28 19:16:25.440214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.440286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.440311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.591 qpair failed and we were unable to recover it. 00:28:04.591 [2024-11-28 19:16:25.440401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.440489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.440515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.591 qpair failed and we were unable to recover it. 00:28:04.591 [2024-11-28 19:16:25.440593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.440671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.591 [2024-11-28 19:16:25.440697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.440802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.440879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.440904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.441024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.441135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.441160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.441247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.441323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.441348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.441463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.441545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.441572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.441678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.441786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.441811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.441894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.441974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.441999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.442081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.442156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.442181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.442286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.442375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.442406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.442488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.442578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.442603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.442717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.442828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.442853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.442962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.443070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.443095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.443208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.443282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.443307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.443418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.443503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.443528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.443614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.443695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.443720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.443831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.443946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.443971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.444084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.444199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.444226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.444307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.444398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.444427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.444509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.444622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.444647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.444738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.444833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.444859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.444939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.445043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.445067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.445152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.445233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.445258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.445371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.445454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.445480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.445572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.445662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.445687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.445796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.445873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.445897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.446001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.446080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.446104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.446186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.446287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.446312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.446400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.446478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.446502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.446585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.446658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.446682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.446793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.446913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.446937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.447016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.447098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.447122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.447228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.447307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.447332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.447413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.447501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.447525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.447616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.447752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.447776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.447882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.447952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.447977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.448058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.448170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.448194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.448272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.448347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.448371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.448496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.448594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.448622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.448740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.448820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.592 [2024-11-28 19:16:25.448845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.592 qpair failed and we were unable to recover it. 00:28:04.592 [2024-11-28 19:16:25.448924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.449008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.449038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.449124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.449267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.449293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.449378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.449475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.449501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.449588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.449670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.449696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.449795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.449881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.449906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.449984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.450094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.450118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.450204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.450315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.450339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.450424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.450510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.450535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.450643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.450729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.450754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.450831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.450908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.450933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.451005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.451093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.451122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.451195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.451270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.451295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.451371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.451455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.451480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.451616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.451694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.451719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.451798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.451875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.451898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.451980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.452066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.452091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.452166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.452255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.452279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.452361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.452477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.452502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.452582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.452672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.452696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.452785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.452887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.452910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.452989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.453077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.453103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.453191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.453266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.453290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.453366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.453449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.453474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.453560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.453635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.453659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.453739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.453814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.453839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.453949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.454028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.454053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.454127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.454210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.454234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.454315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.454385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.454418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.454506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.454584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.454608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.454697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.454776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.454801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.454882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.455018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.455042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.455139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.455241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.455265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.455343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.455427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.455453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.455534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.455610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.455634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.455719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.455793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.455817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.455895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.455977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.456001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.456075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.456157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.456182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.456290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.456364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.456388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.593 qpair failed and we were unable to recover it. 00:28:04.593 [2024-11-28 19:16:25.456480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.593 [2024-11-28 19:16:25.456555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.456580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.456667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.456772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.456797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.456881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.456962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.456988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.457066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.457166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.457192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.457271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.457375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.457411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.457521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.457630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.457655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.457768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.457843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.457868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.457951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.458027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.458052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.458162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.458309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.458335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.458417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.458506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.458530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.458643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.458717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.458742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.458821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.458924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.458948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.459026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.459097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.459122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.459203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.459295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.459320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.459415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.459539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.459568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.459656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.459741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.459767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.459855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.459930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.459955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.460030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.460103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.460128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.460237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.460326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.460353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.460444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.460528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.460554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.460640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.460724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.460749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.460825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.460906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.460933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.461025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.461134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.461159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.461240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.461346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.461376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.461462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.461541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.461566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.461650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.461728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.461753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.461836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.461941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.461965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.462038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.462113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.462137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.462219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.462292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.462317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.462402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.462483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.462510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.462597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.462679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.462705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.462790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.462872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.462897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.463005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.463089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.463116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.463195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.463280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.463313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.463428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.463517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.463542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.463626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.463710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.463735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.463820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.463904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.463928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.464017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.464092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.464116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.464202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.464320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.464344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.594 [2024-11-28 19:16:25.464440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.464544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.594 [2024-11-28 19:16:25.464570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.594 qpair failed and we were unable to recover it. 00:28:04.595 [2024-11-28 19:16:25.464653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.464735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.464759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.595 qpair failed and we were unable to recover it. 00:28:04.595 [2024-11-28 19:16:25.464839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.464918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.464943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.595 qpair failed and we were unable to recover it. 00:28:04.595 [2024-11-28 19:16:25.465084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.465190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.465215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.595 qpair failed and we were unable to recover it. 00:28:04.595 [2024-11-28 19:16:25.465292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.465418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.465444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.595 qpair failed and we were unable to recover it. 00:28:04.595 [2024-11-28 19:16:25.465533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.465610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.465634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.595 qpair failed and we were unable to recover it. 00:28:04.595 [2024-11-28 19:16:25.465718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.465797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.465821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.595 qpair failed and we were unable to recover it. 00:28:04.595 [2024-11-28 19:16:25.465895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.466036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.466061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.595 qpair failed and we were unable to recover it. 00:28:04.595 [2024-11-28 19:16:25.466136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.466213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.466238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.595 qpair failed and we were unable to recover it. 00:28:04.595 [2024-11-28 19:16:25.466317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.466421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.466446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.595 qpair failed and we were unable to recover it. 00:28:04.595 [2024-11-28 19:16:25.466528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.466602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.466626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.595 qpair failed and we were unable to recover it. 00:28:04.595 [2024-11-28 19:16:25.466737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.466817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.466841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.595 qpair failed and we were unable to recover it. 00:28:04.595 [2024-11-28 19:16:25.466954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.467054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.467078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.595 qpair failed and we were unable to recover it. 00:28:04.595 [2024-11-28 19:16:25.467155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.467256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.467281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.595 qpair failed and we were unable to recover it. 00:28:04.595 [2024-11-28 19:16:25.467364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.467452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.467476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.595 qpair failed and we were unable to recover it. 00:28:04.595 [2024-11-28 19:16:25.467568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.467650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.467675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.595 qpair failed and we were unable to recover it. 00:28:04.595 [2024-11-28 19:16:25.467756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.467832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.467855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.595 qpair failed and we were unable to recover it. 00:28:04.595 [2024-11-28 19:16:25.467933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.468009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.468034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.595 qpair failed and we were unable to recover it. 00:28:04.595 [2024-11-28 19:16:25.468115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.468198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.468222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.595 qpair failed and we were unable to recover it. 00:28:04.595 [2024-11-28 19:16:25.468363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.468443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.468468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.595 qpair failed and we were unable to recover it. 00:28:04.595 [2024-11-28 19:16:25.468549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.468625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.468649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.595 qpair failed and we were unable to recover it. 00:28:04.595 [2024-11-28 19:16:25.468767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.468857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.468881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.595 qpair failed and we were unable to recover it. 00:28:04.595 [2024-11-28 19:16:25.468989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.469067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.469092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.595 qpair failed and we were unable to recover it. 00:28:04.595 [2024-11-28 19:16:25.469177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.469257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.469281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.595 qpair failed and we were unable to recover it. 00:28:04.595 [2024-11-28 19:16:25.469359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.469446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.469471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.595 qpair failed and we were unable to recover it. 00:28:04.595 [2024-11-28 19:16:25.469547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.469628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.469652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.595 qpair failed and we were unable to recover it. 00:28:04.595 [2024-11-28 19:16:25.469731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.469807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.469832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.595 qpair failed and we were unable to recover it. 00:28:04.595 [2024-11-28 19:16:25.469921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.469989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.470013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.595 qpair failed and we were unable to recover it. 00:28:04.595 [2024-11-28 19:16:25.470095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.470179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.470204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.595 qpair failed and we were unable to recover it. 00:28:04.595 [2024-11-28 19:16:25.470420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.470499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.470524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.595 qpair failed and we were unable to recover it. 00:28:04.595 [2024-11-28 19:16:25.470629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.470701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.470724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.595 qpair failed and we were unable to recover it. 00:28:04.595 [2024-11-28 19:16:25.470815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.470891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.470915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.595 qpair failed and we were unable to recover it. 00:28:04.595 [2024-11-28 19:16:25.470987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.471065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.471090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.595 qpair failed and we were unable to recover it. 00:28:04.595 [2024-11-28 19:16:25.471174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.471248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.471273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.595 qpair failed and we were unable to recover it. 00:28:04.595 [2024-11-28 19:16:25.471356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.471439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.471464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.595 qpair failed and we were unable to recover it. 00:28:04.595 [2024-11-28 19:16:25.471543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.471624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.471649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.595 qpair failed and we were unable to recover it. 00:28:04.595 [2024-11-28 19:16:25.471734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.471834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.471857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.595 qpair failed and we were unable to recover it. 00:28:04.595 [2024-11-28 19:16:25.471948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.472058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.595 [2024-11-28 19:16:25.472082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.595 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.472156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.472234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.472258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.472348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.472443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.472469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.472549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.472659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.472686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.472772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.472855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.472879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.472963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.473078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.473104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.473189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.473301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.473326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.473404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.473512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.473536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.473614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.473704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.473733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.473809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.473889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.473913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.473988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.474092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.474116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.474203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.474313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.474336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.474422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.474508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.474533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.474607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.474715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.474742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.474852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.474930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.474954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.475029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.475107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.475133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.475280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.475379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.475414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.475502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.475614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.475639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.475734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.475854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.475879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.475993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.476072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.476098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.476182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.476291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.476317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.476401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.476480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.476506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.476588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.476702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.476727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.476835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.476918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.476944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.477023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.477103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.477129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.477318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.477432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.477459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.477552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.477628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.477653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.477738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.477817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.477841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.477927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.478002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.478026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.478136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.478209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.478234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.478324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.478406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.478432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.478542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.478627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.478651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.478739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.478814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.478838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.478915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.478992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.479017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.479108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.479184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.479208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.479316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.479402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.479427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.479509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.479589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.479613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.479690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.479769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.479794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.479875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.479953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.479977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.480054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.480165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.480190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.480264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.480341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.480365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.596 qpair failed and we were unable to recover it. 00:28:04.596 [2024-11-28 19:16:25.480482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.480562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.596 [2024-11-28 19:16:25.480588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.480667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.480738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.480762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.480852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.480961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.480986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.481073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.481149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.481173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.481246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.481374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.481405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.481490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.481574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.481598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.481676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.481784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.481809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.481886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.481990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.482014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.482094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.482177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.482202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.482294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.482377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.482421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.482502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.482591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.482616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.482687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.482766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.482789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.482864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.483001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.483025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.483145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.483217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.483242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.483319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.483402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.483428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.483511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.483587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.483611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.483691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.483768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.483793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.483868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.483942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.483967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.484056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.484138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.484163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.484255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.484378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.484410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.484492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.484613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.484638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.484721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.484804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.484828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.484906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.485012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.485037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.485145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.485222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.485246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.485325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.485416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.485443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.485567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.485666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.485691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.485768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.485846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.485872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.485947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.486033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.486058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.486165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.486241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.486270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.486377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.486457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.486482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.486590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.486680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.486705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.486790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.486871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.486896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.486971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.487060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.487085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.487165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.487271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.487296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.487382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.487467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.487494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.487598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.487738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.487763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.487840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.487917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.487942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.488050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.488158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.488183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.488309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.488449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.488474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.488565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.488640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.488665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.488773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.488860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.488884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.597 qpair failed and we were unable to recover it. 00:28:04.597 [2024-11-28 19:16:25.488974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.597 [2024-11-28 19:16:25.489047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.489071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.598 qpair failed and we were unable to recover it. 00:28:04.598 [2024-11-28 19:16:25.489176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.489258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.489284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.598 qpair failed and we were unable to recover it. 00:28:04.598 [2024-11-28 19:16:25.489371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.489497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.489522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.598 qpair failed and we were unable to recover it. 00:28:04.598 [2024-11-28 19:16:25.489602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.489709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.489734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.598 qpair failed and we were unable to recover it. 00:28:04.598 [2024-11-28 19:16:25.489810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.489890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.489915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.598 qpair failed and we were unable to recover it. 00:28:04.598 [2024-11-28 19:16:25.490021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.490125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.490150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.598 qpair failed and we were unable to recover it. 00:28:04.598 [2024-11-28 19:16:25.490230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.490310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.490335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.598 qpair failed and we were unable to recover it. 00:28:04.598 [2024-11-28 19:16:25.490454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.490533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.490558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.598 qpair failed and we were unable to recover it. 00:28:04.598 [2024-11-28 19:16:25.490641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.490718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.490742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.598 qpair failed and we were unable to recover it. 00:28:04.598 [2024-11-28 19:16:25.490822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.490901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.490926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.598 qpair failed and we were unable to recover it. 00:28:04.598 [2024-11-28 19:16:25.491004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.491084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.491108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.598 qpair failed and we were unable to recover it. 00:28:04.598 [2024-11-28 19:16:25.491197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.491277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.491303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.598 qpair failed and we were unable to recover it. 00:28:04.598 [2024-11-28 19:16:25.491402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.491506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.491537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.598 qpair failed and we were unable to recover it. 00:28:04.598 [2024-11-28 19:16:25.491626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.491705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.491731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.598 qpair failed and we were unable to recover it. 00:28:04.598 [2024-11-28 19:16:25.491825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.491912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.491940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.598 qpair failed and we were unable to recover it. 00:28:04.598 [2024-11-28 19:16:25.492022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.492099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.492124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.598 qpair failed and we were unable to recover it. 00:28:04.598 [2024-11-28 19:16:25.492235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.492316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.492341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.598 qpair failed and we were unable to recover it. 00:28:04.598 [2024-11-28 19:16:25.492431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.492521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.492546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.598 qpair failed and we were unable to recover it. 00:28:04.598 [2024-11-28 19:16:25.492632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.492736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.492761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.598 qpair failed and we were unable to recover it. 00:28:04.598 [2024-11-28 19:16:25.492834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.492912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.492937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.598 qpair failed and we were unable to recover it. 00:28:04.598 [2024-11-28 19:16:25.493020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.493106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.493132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.598 qpair failed and we were unable to recover it. 00:28:04.598 [2024-11-28 19:16:25.493244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.493323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.493347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.598 qpair failed and we were unable to recover it. 00:28:04.598 [2024-11-28 19:16:25.493424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.493498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.493523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.598 qpair failed and we were unable to recover it. 00:28:04.598 [2024-11-28 19:16:25.493616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.493692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.493716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.598 qpair failed and we were unable to recover it. 00:28:04.598 [2024-11-28 19:16:25.493796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.493872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.493897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.598 qpair failed and we were unable to recover it. 00:28:04.598 [2024-11-28 19:16:25.493973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.494054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.494079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.598 qpair failed and we were unable to recover it. 00:28:04.598 [2024-11-28 19:16:25.494165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.494269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.494294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.598 qpair failed and we were unable to recover it. 00:28:04.598 [2024-11-28 19:16:25.494374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.494467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.494493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.598 qpair failed and we were unable to recover it. 00:28:04.598 [2024-11-28 19:16:25.494583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.494664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.494690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.598 qpair failed and we were unable to recover it. 00:28:04.598 [2024-11-28 19:16:25.494775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.494883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.494907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.598 qpair failed and we were unable to recover it. 00:28:04.598 [2024-11-28 19:16:25.494994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.495078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.495104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.598 qpair failed and we were unable to recover it. 00:28:04.598 [2024-11-28 19:16:25.495186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.495264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.495289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.598 qpair failed and we were unable to recover it. 00:28:04.598 [2024-11-28 19:16:25.495402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.495521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.495546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.598 qpair failed and we were unable to recover it. 00:28:04.598 [2024-11-28 19:16:25.495630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.495709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.495734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.598 qpair failed and we were unable to recover it. 00:28:04.598 [2024-11-28 19:16:25.495836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.495916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.495942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.598 qpair failed and we were unable to recover it. 00:28:04.598 [2024-11-28 19:16:25.496050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.496134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.496158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.598 qpair failed and we were unable to recover it. 00:28:04.598 [2024-11-28 19:16:25.496237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.496356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.496381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.598 qpair failed and we were unable to recover it. 00:28:04.598 [2024-11-28 19:16:25.496493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.598 [2024-11-28 19:16:25.496571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.496595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.599 qpair failed and we were unable to recover it. 00:28:04.599 [2024-11-28 19:16:25.496681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.496788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.496819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.599 qpair failed and we were unable to recover it. 00:28:04.599 [2024-11-28 19:16:25.496936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.497078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.497103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.599 qpair failed and we were unable to recover it. 00:28:04.599 [2024-11-28 19:16:25.497215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.497301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.497326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.599 qpair failed and we were unable to recover it. 00:28:04.599 [2024-11-28 19:16:25.497410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.497530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.497554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.599 qpair failed and we were unable to recover it. 00:28:04.599 [2024-11-28 19:16:25.497633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.497770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.497794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.599 qpair failed and we were unable to recover it. 00:28:04.599 [2024-11-28 19:16:25.497903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.497985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.498011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.599 qpair failed and we were unable to recover it. 00:28:04.599 [2024-11-28 19:16:25.498093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.498168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.498193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.599 qpair failed and we were unable to recover it. 00:28:04.599 [2024-11-28 19:16:25.498271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.498352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.498377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.599 qpair failed and we were unable to recover it. 00:28:04.599 [2024-11-28 19:16:25.498463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.498542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.498567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.599 qpair failed and we were unable to recover it. 00:28:04.599 [2024-11-28 19:16:25.498648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.498760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.498786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.599 qpair failed and we were unable to recover it. 00:28:04.599 [2024-11-28 19:16:25.498868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.498973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.499001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.599 qpair failed and we were unable to recover it. 00:28:04.599 [2024-11-28 19:16:25.499113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.499195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.499220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.599 qpair failed and we were unable to recover it. 00:28:04.599 [2024-11-28 19:16:25.499298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.499409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.499435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.599 qpair failed and we were unable to recover it. 00:28:04.599 [2024-11-28 19:16:25.499521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.499598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.499622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.599 qpair failed and we were unable to recover it. 00:28:04.599 [2024-11-28 19:16:25.499705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.499818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.499844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.599 qpair failed and we were unable to recover it. 00:28:04.599 [2024-11-28 19:16:25.499925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.499999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.500024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.599 qpair failed and we were unable to recover it. 00:28:04.599 [2024-11-28 19:16:25.500148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.500223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.500248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.599 qpair failed and we were unable to recover it. 00:28:04.599 [2024-11-28 19:16:25.500337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.500446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.500471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.599 qpair failed and we were unable to recover it. 00:28:04.599 [2024-11-28 19:16:25.500552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.500632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.500656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.599 qpair failed and we were unable to recover it. 00:28:04.599 [2024-11-28 19:16:25.500745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.500820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.500846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.599 qpair failed and we were unable to recover it. 00:28:04.599 [2024-11-28 19:16:25.500956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.501028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.501053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.599 qpair failed and we were unable to recover it. 00:28:04.599 [2024-11-28 19:16:25.501143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.501223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.501248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.599 qpair failed and we were unable to recover it. 00:28:04.599 [2024-11-28 19:16:25.501328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.501432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.501458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.599 qpair failed and we were unable to recover it. 00:28:04.599 [2024-11-28 19:16:25.501541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.501623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.501648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.599 qpair failed and we were unable to recover it. 00:28:04.599 [2024-11-28 19:16:25.501740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.501820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.501845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.599 qpair failed and we were unable to recover it. 00:28:04.599 [2024-11-28 19:16:25.501923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.502033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.502058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.599 qpair failed and we were unable to recover it. 00:28:04.599 [2024-11-28 19:16:25.502138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.502217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.502241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.599 qpair failed and we were unable to recover it. 00:28:04.599 [2024-11-28 19:16:25.502320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.502402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.502428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.599 qpair failed and we were unable to recover it. 00:28:04.599 [2024-11-28 19:16:25.502535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.502610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.599 [2024-11-28 19:16:25.502635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.599 qpair failed and we were unable to recover it. 00:28:04.599 [2024-11-28 19:16:25.502740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.502817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.502841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.502928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.503035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.503059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.503143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.503254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.503280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.503356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.503436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.503461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.503573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.503654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.503680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.503767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.503882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.503906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.504017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.504104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.504129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.504209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.504295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.504320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.504447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.504528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.504553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.504630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.504700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.504724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.504804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.504937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.504962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.505073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.505148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.505172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.505279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.505368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.505404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.505489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.505568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.505593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.505676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.505753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.505778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.505852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.505939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.505964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.506046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.506121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.506146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.506256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.506338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.506362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.506454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.506525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.506550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.506633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.506715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.506740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.506825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.506909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.506933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.507010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.507094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.507119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.507217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.507294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.507319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.507405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.507514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.507539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.507615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.507723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.507748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.507824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.507899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.507923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.508006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.508083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.508107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.508197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.508309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.508334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.508409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.508482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.508506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.508590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.508668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.508693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.508777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.508854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.508879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.508955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.509068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.509093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.509178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.509254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.509283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.509405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.509488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.509515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.509599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.509678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.509703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.509784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.509890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.509916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.510024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.510099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.510123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.510216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.510293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.510319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.510426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.510508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.510533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.510616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.510732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.510756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.600 [2024-11-28 19:16:25.510833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.510908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.600 [2024-11-28 19:16:25.510934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.600 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.511014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.511121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.511145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.511227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.511334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.511359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.511450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.511536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.511561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.511637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.511741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.511766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.511846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.511952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.511976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.512063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.512135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.512159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.512266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.512375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.512427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.512509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.512587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.512611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.512686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.512759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.512784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.512892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.513001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.513026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.513133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.513212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.513238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.513319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.513432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.513458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.513540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.513621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.513646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.513756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.513828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.513853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.513928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.514004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.514028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.514138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.514240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.514264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.514345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.514425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.514450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.514535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.514612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.514636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.514717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.514791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.514815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.514933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.515041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.515067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.515150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.515254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.515278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.515354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.515441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.515466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.515577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.515660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.515685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.515772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.515879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.515904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.515984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.516058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.516083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.516156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.516259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.516284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.516365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.516481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.516507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.516585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.516663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.516687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.516768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.516843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.516868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.516974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.517049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.517074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.517158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.517237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.517262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.517346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.517420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.517446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.517527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.517647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.517671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.517744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.517815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.517839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.517914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.518002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.518026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.518135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.518220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.518245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.518320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.518400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.518425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.518504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.518579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.518604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.518682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.518788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.601 [2024-11-28 19:16:25.518813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.601 qpair failed and we were unable to recover it. 00:28:04.601 [2024-11-28 19:16:25.518905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.518987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.519012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.602 qpair failed and we were unable to recover it. 00:28:04.602 [2024-11-28 19:16:25.519099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.519204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.519229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.602 qpair failed and we were unable to recover it. 00:28:04.602 [2024-11-28 19:16:25.519308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.519385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.519415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.602 qpair failed and we were unable to recover it. 00:28:04.602 [2024-11-28 19:16:25.519493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.519569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.519597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.602 qpair failed and we were unable to recover it. 00:28:04.602 [2024-11-28 19:16:25.519692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.519775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.519800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.602 qpair failed and we were unable to recover it. 00:28:04.602 [2024-11-28 19:16:25.519876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.520003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.520028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.602 qpair failed and we were unable to recover it. 00:28:04.602 [2024-11-28 19:16:25.520110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.520186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.520211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.602 qpair failed and we were unable to recover it. 00:28:04.602 [2024-11-28 19:16:25.520296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.520370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.520399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.602 qpair failed and we were unable to recover it. 00:28:04.602 [2024-11-28 19:16:25.520490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.520568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.520592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.602 qpair failed and we were unable to recover it. 00:28:04.602 [2024-11-28 19:16:25.520699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.520779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.520804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.602 qpair failed and we were unable to recover it. 00:28:04.602 [2024-11-28 19:16:25.520912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.520987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.521012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.602 qpair failed and we were unable to recover it. 00:28:04.602 [2024-11-28 19:16:25.521088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.521159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.521183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.602 qpair failed and we were unable to recover it. 00:28:04.602 [2024-11-28 19:16:25.521265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.521380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.521441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.602 qpair failed and we were unable to recover it. 00:28:04.602 [2024-11-28 19:16:25.521522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.521599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.521623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.602 qpair failed and we were unable to recover it. 00:28:04.602 [2024-11-28 19:16:25.521713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.521815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.521839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.602 qpair failed and we were unable to recover it. 00:28:04.602 [2024-11-28 19:16:25.521917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.521993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.522017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.602 qpair failed and we were unable to recover it. 00:28:04.602 [2024-11-28 19:16:25.522098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.522185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.522209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.602 qpair failed and we were unable to recover it. 00:28:04.602 [2024-11-28 19:16:25.522285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.522402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.522427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.602 qpair failed and we were unable to recover it. 00:28:04.602 [2024-11-28 19:16:25.522504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.522583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.522608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.602 qpair failed and we were unable to recover it. 00:28:04.602 [2024-11-28 19:16:25.522699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.522807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.522832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.602 qpair failed and we were unable to recover it. 00:28:04.602 [2024-11-28 19:16:25.522911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.523049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.523074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.602 qpair failed and we were unable to recover it. 00:28:04.602 [2024-11-28 19:16:25.523181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.523256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.523281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.602 qpair failed and we were unable to recover it. 00:28:04.602 [2024-11-28 19:16:25.523359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.523475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.523500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.602 qpair failed and we were unable to recover it. 00:28:04.602 [2024-11-28 19:16:25.523609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.523682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.523706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.602 qpair failed and we were unable to recover it. 00:28:04.602 [2024-11-28 19:16:25.523786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.523862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.523887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.602 qpair failed and we were unable to recover it. 00:28:04.602 [2024-11-28 19:16:25.523975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.524064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.524089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.602 qpair failed and we were unable to recover it. 00:28:04.602 [2024-11-28 19:16:25.524166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.524253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.524277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.602 qpair failed and we were unable to recover it. 00:28:04.602 [2024-11-28 19:16:25.524364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.524447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.524473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.602 qpair failed and we were unable to recover it. 00:28:04.602 [2024-11-28 19:16:25.524553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.524633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.524659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.602 qpair failed and we were unable to recover it. 00:28:04.602 [2024-11-28 19:16:25.524754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.524861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.524887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.602 qpair failed and we were unable to recover it. 00:28:04.602 [2024-11-28 19:16:25.524974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.525046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.525071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.602 qpair failed and we were unable to recover it. 00:28:04.602 [2024-11-28 19:16:25.525152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.525233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.525258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.602 qpair failed and we were unable to recover it. 00:28:04.602 [2024-11-28 19:16:25.525340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.525426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.525452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.602 qpair failed and we were unable to recover it. 00:28:04.602 [2024-11-28 19:16:25.525533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.525641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.525665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.602 qpair failed and we were unable to recover it. 00:28:04.602 [2024-11-28 19:16:25.525764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.525842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.525866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.602 qpair failed and we were unable to recover it. 00:28:04.602 [2024-11-28 19:16:25.525952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.526118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.526142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.602 qpair failed and we were unable to recover it. 00:28:04.602 [2024-11-28 19:16:25.526222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.526336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.602 [2024-11-28 19:16:25.526362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.602 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.526443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.526520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.526546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.526653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.526734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.526761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.526849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.526957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.526982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.527070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.527147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.527172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.527259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.527369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.527399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.527479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.527582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.527607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.527686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.527812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.527837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.527916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.528027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.528052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.528129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.528235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.528260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.528366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.528456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.528481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.528559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.528634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.528659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.528765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.528846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.528872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.529014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.529091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.529115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.529199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.529270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.529295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.529383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.529465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.529490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.529579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.529654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.529679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.529794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.529884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.529908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.529987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.530066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.530095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.530206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.530282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.530307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.530383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.530522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.530547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.530633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.530741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.530765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.530845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.530927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.530953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.531098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.531171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.531196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.531298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.531424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.531450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.531563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.531669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.531694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.531805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.531919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.531944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.532083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.532161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.532185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.532267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.532340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.532364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.532467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.532556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.532582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.532668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.532746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.532771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.532844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.532926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.532950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.533040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.533148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.533173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.533281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.533367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.533397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.533477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.533571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.533597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.533677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.533787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.533812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.533890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.534028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.534052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.534127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.534207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.534233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.534315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.534457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.534483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.534574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.534650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.534675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.534753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.534838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.534863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.603 qpair failed and we were unable to recover it. 00:28:04.603 [2024-11-28 19:16:25.534944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.603 [2024-11-28 19:16:25.535018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.535043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.535124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.535207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.535233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.535341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.535419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.535444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.535525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.535607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.535632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.535709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.535782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.535806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.535917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.535992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.536016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.536096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.536203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.536228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.536333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.536443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.536468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.536550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.536625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.536650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.536728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.536837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.536861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.536940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.537014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.537039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.537115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.537251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.537276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.537350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.537435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.537460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.537541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.537618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.537642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.537723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.537799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.537823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.537933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.538038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.538062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.538144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.538252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.538277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.538363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.538476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.538501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.538577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.538663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.538687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.538794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.538872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.538897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.538973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.539078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.539103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.539191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.539300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.539325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.539407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.539511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.539536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.539613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.539695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.539721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.539795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.539878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.539904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.539991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.540097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.540121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.540201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.540273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.540298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.540372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.540455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.540481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.540603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.540678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.540712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.540823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.540902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.540927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.541003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.541106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.541131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.541211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.541284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.541308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.541417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.541504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.541528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.541610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.541699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.541725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.541804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.541908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.541932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.542005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.542110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.542134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.542214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.542301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.542326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.542435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.542514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.542539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.542647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.542723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.542752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.542834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.542907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.604 [2024-11-28 19:16:25.542932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.604 qpair failed and we were unable to recover it. 00:28:04.604 [2024-11-28 19:16:25.543038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.543113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.543137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.605 qpair failed and we were unable to recover it. 00:28:04.605 [2024-11-28 19:16:25.543247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.543385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.543416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.605 qpair failed and we were unable to recover it. 00:28:04.605 [2024-11-28 19:16:25.543491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.543569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.543594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.605 qpair failed and we were unable to recover it. 00:28:04.605 [2024-11-28 19:16:25.543673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.543749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.543774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.605 qpair failed and we were unable to recover it. 00:28:04.605 [2024-11-28 19:16:25.543877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.543985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.544009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.605 qpair failed and we were unable to recover it. 00:28:04.605 [2024-11-28 19:16:25.544090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.544160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.544185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.605 qpair failed and we were unable to recover it. 00:28:04.605 [2024-11-28 19:16:25.544303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.544409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.544435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.605 qpair failed and we were unable to recover it. 00:28:04.605 [2024-11-28 19:16:25.544513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.544593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.544618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.605 qpair failed and we were unable to recover it. 00:28:04.605 [2024-11-28 19:16:25.544698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.544774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.544799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.605 qpair failed and we were unable to recover it. 00:28:04.605 [2024-11-28 19:16:25.544911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.544987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.545011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.605 qpair failed and we were unable to recover it. 00:28:04.605 [2024-11-28 19:16:25.545094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.545176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.545201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.605 qpair failed and we were unable to recover it. 00:28:04.605 [2024-11-28 19:16:25.545279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.545401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.545426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.605 qpair failed and we were unable to recover it. 00:28:04.605 [2024-11-28 19:16:25.545508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.545586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.545610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.605 qpair failed and we were unable to recover it. 00:28:04.605 [2024-11-28 19:16:25.545691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.545765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.545790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.605 qpair failed and we were unable to recover it. 00:28:04.605 [2024-11-28 19:16:25.545870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.545986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.546011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.605 qpair failed and we were unable to recover it. 00:28:04.605 [2024-11-28 19:16:25.546092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.546177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.546203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.605 qpair failed and we were unable to recover it. 00:28:04.605 [2024-11-28 19:16:25.546282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.546357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.546381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.605 qpair failed and we were unable to recover it. 00:28:04.605 [2024-11-28 19:16:25.546470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.546581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.546606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.605 qpair failed and we were unable to recover it. 00:28:04.605 [2024-11-28 19:16:25.546689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.546784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.546810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.605 qpair failed and we were unable to recover it. 00:28:04.605 [2024-11-28 19:16:25.546910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.546993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.547017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.605 qpair failed and we were unable to recover it. 00:28:04.605 [2024-11-28 19:16:25.547097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.547178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.547202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.605 qpair failed and we were unable to recover it. 00:28:04.605 [2024-11-28 19:16:25.547280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.547360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.547384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.605 qpair failed and we were unable to recover it. 00:28:04.605 [2024-11-28 19:16:25.547497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.547576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.547602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.605 qpair failed and we were unable to recover it. 00:28:04.605 [2024-11-28 19:16:25.547708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.547814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.547839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.605 qpair failed and we were unable to recover it. 00:28:04.605 [2024-11-28 19:16:25.547921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.548062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.548087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.605 qpair failed and we were unable to recover it. 00:28:04.605 [2024-11-28 19:16:25.548165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.548250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.548275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.605 qpair failed and we were unable to recover it. 00:28:04.605 [2024-11-28 19:16:25.548352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.548440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.548466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.605 qpair failed and we were unable to recover it. 00:28:04.605 [2024-11-28 19:16:25.548555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.548658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.548682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.605 qpair failed and we were unable to recover it. 00:28:04.605 [2024-11-28 19:16:25.548767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.548871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.548895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.605 qpair failed and we were unable to recover it. 00:28:04.605 [2024-11-28 19:16:25.548973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.549085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.549110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.605 qpair failed and we were unable to recover it. 00:28:04.605 [2024-11-28 19:16:25.549183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.549296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.549320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.605 qpair failed and we were unable to recover it. 00:28:04.605 [2024-11-28 19:16:25.549404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.549540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.549565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.605 qpair failed and we were unable to recover it. 00:28:04.605 [2024-11-28 19:16:25.549651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.549733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.549759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.605 qpair failed and we were unable to recover it. 00:28:04.605 [2024-11-28 19:16:25.549838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.549915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.549940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.605 qpair failed and we were unable to recover it. 00:28:04.605 [2024-11-28 19:16:25.550014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.550091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.550115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.605 qpair failed and we were unable to recover it. 00:28:04.605 [2024-11-28 19:16:25.550192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.550297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.550322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.605 qpair failed and we were unable to recover it. 00:28:04.605 [2024-11-28 19:16:25.550408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.550492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.605 [2024-11-28 19:16:25.550517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.605 qpair failed and we were unable to recover it. 00:28:04.605 [2024-11-28 19:16:25.550596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.550686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.550711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.550817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.550898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.550923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.551002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.551109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.551135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.551216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.551327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.551351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.551452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.551539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.551564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.551646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.551740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.551765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.551847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.551953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.551978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.552061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.552169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.552193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.552270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.552346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.552370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.552454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.552532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.552557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.552634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.552716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.552742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.552831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.552918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.552942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.553051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.553127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.553155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.553235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.553320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.553344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.553432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.553511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.553536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.553628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.553742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.553767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.553850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.553956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.553981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.554064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.554139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.554163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.554271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.554347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.554372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.554459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.554547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.554572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.554660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.554736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.554760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.554848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.554975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.555000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.555078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.555184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.555209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.555310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.555380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.555412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.555489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.555576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.555601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.555677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.555757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.555782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.555856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.555934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.555958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.556066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.556145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.556170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.556286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.556363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.556388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.556511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.556582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.556607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.556680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.556783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.556808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.556944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.557022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.557048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.557127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.557235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.557261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.557375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.557459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.557484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.557566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.557645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.557671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.557749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.557859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.557883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.557960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.558038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.558063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.558146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.558252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.558276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.558390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.558506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.558531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.558614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.558687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.558712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.606 [2024-11-28 19:16:25.558812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.558934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.606 [2024-11-28 19:16:25.558959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.606 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.559034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.559110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.559135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.559218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.559293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.559318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.559434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.559547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.559573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.559657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.559735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.559760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.559849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.559921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.559946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.560065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.560142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.560167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.560248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.560356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.560380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.560481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.560584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.560609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.560715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.560828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.560853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.560970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.561050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.561075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.561189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.561295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.561319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.561431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.561542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.561567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.561670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.561781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.561806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.561886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.561989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.562014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.562155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.562230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.562262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.562340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.562460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.562486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.562573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.562689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.562715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.562799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.562906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.562931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.563013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.563090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.563115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.563208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.563291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.563316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.563405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.563515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.563540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.563631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.563715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.563740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.563815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.563902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.563933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.564011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.564119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.564144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.564260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.564375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.564405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.564530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.564604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.564629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.564741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.564822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.564846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.564934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.565015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.565039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.565118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.565192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.565216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.565323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.565430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.565455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.565535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.565614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.565639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.565716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.565793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.565818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.565896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.565982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.566007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.566100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.566178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.566204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.566314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.566400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.566426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.566508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.566589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.566615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.566692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.566806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.566830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.566908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.566985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.567009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.567093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.567202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.567227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.567332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.567425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.567452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.607 [2024-11-28 19:16:25.567540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.567620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.607 [2024-11-28 19:16:25.567644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.607 qpair failed and we were unable to recover it. 00:28:04.608 [2024-11-28 19:16:25.567721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.608 [2024-11-28 19:16:25.567798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.608 [2024-11-28 19:16:25.567822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.608 qpair failed and we were unable to recover it. 00:28:04.608 [2024-11-28 19:16:25.567930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.608 [2024-11-28 19:16:25.568015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.608 [2024-11-28 19:16:25.568039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.608 qpair failed and we were unable to recover it. 00:28:04.608 [2024-11-28 19:16:25.568122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.608 [2024-11-28 19:16:25.568197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.608 [2024-11-28 19:16:25.568221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.608 qpair failed and we were unable to recover it. 00:28:04.608 [2024-11-28 19:16:25.568332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.608 [2024-11-28 19:16:25.568446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.608 [2024-11-28 19:16:25.568472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.608 qpair failed and we were unable to recover it. 00:28:04.608 [2024-11-28 19:16:25.568554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.608 [2024-11-28 19:16:25.568657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.608 [2024-11-28 19:16:25.568682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.608 qpair failed and we were unable to recover it. 00:28:04.608 [2024-11-28 19:16:25.568766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.608 [2024-11-28 19:16:25.568845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.608 [2024-11-28 19:16:25.568871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.608 qpair failed and we were unable to recover it. 00:28:04.608 [2024-11-28 19:16:25.568947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.608 [2024-11-28 19:16:25.569027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.608 [2024-11-28 19:16:25.569051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.608 qpair failed and we were unable to recover it. 00:28:04.608 [2024-11-28 19:16:25.569135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.608 [2024-11-28 19:16:25.569209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.608 [2024-11-28 19:16:25.569235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.608 qpair failed and we were unable to recover it. 00:28:04.608 [2024-11-28 19:16:25.569315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.608 [2024-11-28 19:16:25.569400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.608 [2024-11-28 19:16:25.569427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.608 qpair failed and we were unable to recover it. 00:28:04.608 [2024-11-28 19:16:25.569507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.608 [2024-11-28 19:16:25.569647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.608 [2024-11-28 19:16:25.569672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.608 qpair failed and we were unable to recover it. 00:28:04.608 [2024-11-28 19:16:25.569751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.608 [2024-11-28 19:16:25.569833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.608 [2024-11-28 19:16:25.569857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.608 qpair failed and we were unable to recover it. 00:28:04.608 [2024-11-28 19:16:25.569934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.608 [2024-11-28 19:16:25.570011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.608 [2024-11-28 19:16:25.570037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.608 qpair failed and we were unable to recover it. 00:28:04.608 [2024-11-28 19:16:25.570118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.608 [2024-11-28 19:16:25.570224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.608 [2024-11-28 19:16:25.570249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.608 qpair failed and we were unable to recover it. 00:28:04.608 [2024-11-28 19:16:25.570328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.608 [2024-11-28 19:16:25.570405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.608 [2024-11-28 19:16:25.570430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.608 qpair failed and we were unable to recover it. 00:28:04.608 [2024-11-28 19:16:25.570520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.608 [2024-11-28 19:16:25.570598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.608 [2024-11-28 19:16:25.570623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.608 qpair failed and we were unable to recover it. 00:28:04.608 [2024-11-28 19:16:25.570738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.608 [2024-11-28 19:16:25.570843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.608 [2024-11-28 19:16:25.570868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.608 qpair failed and we were unable to recover it. 00:28:04.608 [2024-11-28 19:16:25.570977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.608 [2024-11-28 19:16:25.571053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.608 [2024-11-28 19:16:25.571078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.608 qpair failed and we were unable to recover it. 00:28:04.608 [2024-11-28 19:16:25.571173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.608 [2024-11-28 19:16:25.571262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.608 [2024-11-28 19:16:25.571287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.608 qpair failed and we were unable to recover it. 00:28:04.903 [2024-11-28 19:16:25.571365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.571474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.571500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.903 qpair failed and we were unable to recover it. 00:28:04.903 [2024-11-28 19:16:25.571580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.571667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.571692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.903 qpair failed and we were unable to recover it. 00:28:04.903 [2024-11-28 19:16:25.571799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.571906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.571931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.903 qpair failed and we were unable to recover it. 00:28:04.903 [2024-11-28 19:16:25.572008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.572088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.572113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.903 qpair failed and we were unable to recover it. 00:28:04.903 [2024-11-28 19:16:25.572227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.572339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.572364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.903 qpair failed and we were unable to recover it. 00:28:04.903 [2024-11-28 19:16:25.572470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.572558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.572582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.903 qpair failed and we were unable to recover it. 00:28:04.903 [2024-11-28 19:16:25.572660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.572738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.572763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.903 qpair failed and we were unable to recover it. 00:28:04.903 [2024-11-28 19:16:25.572844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.572959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.572983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.903 qpair failed and we were unable to recover it. 00:28:04.903 [2024-11-28 19:16:25.573072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.573146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.573170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.903 qpair failed and we were unable to recover it. 00:28:04.903 [2024-11-28 19:16:25.573249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.573328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.573352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.903 qpair failed and we were unable to recover it. 00:28:04.903 [2024-11-28 19:16:25.573442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.573516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.573540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.903 qpair failed and we were unable to recover it. 00:28:04.903 [2024-11-28 19:16:25.573627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.573705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.573731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.903 qpair failed and we were unable to recover it. 00:28:04.903 [2024-11-28 19:16:25.573816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.573924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.573948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.903 qpair failed and we were unable to recover it. 00:28:04.903 [2024-11-28 19:16:25.574061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.574150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.574175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.903 qpair failed and we were unable to recover it. 00:28:04.903 [2024-11-28 19:16:25.574252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.574338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.574367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.903 qpair failed and we were unable to recover it. 00:28:04.903 [2024-11-28 19:16:25.574459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.574546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.574572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.903 qpair failed and we were unable to recover it. 00:28:04.903 [2024-11-28 19:16:25.574687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.574770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.574795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.903 qpair failed and we were unable to recover it. 00:28:04.903 [2024-11-28 19:16:25.574876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.574979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.575004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.903 qpair failed and we were unable to recover it. 00:28:04.903 [2024-11-28 19:16:25.575081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.575164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.903 [2024-11-28 19:16:25.575188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.904 qpair failed and we were unable to recover it. 00:28:04.904 [2024-11-28 19:16:25.575300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.575376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.575408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.904 qpair failed and we were unable to recover it. 00:28:04.904 [2024-11-28 19:16:25.575487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.575573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.575598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.904 qpair failed and we were unable to recover it. 00:28:04.904 [2024-11-28 19:16:25.575704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.575779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.575804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.904 qpair failed and we were unable to recover it. 00:28:04.904 [2024-11-28 19:16:25.575889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.575966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.575997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.904 qpair failed and we were unable to recover it. 00:28:04.904 [2024-11-28 19:16:25.576083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.576163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.576187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.904 qpair failed and we were unable to recover it. 00:28:04.904 [2024-11-28 19:16:25.576305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.576381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.576416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.904 qpair failed and we were unable to recover it. 00:28:04.904 [2024-11-28 19:16:25.576527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.576608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.576634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.904 qpair failed and we were unable to recover it. 00:28:04.904 [2024-11-28 19:16:25.576724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.576837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.576862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.904 qpair failed and we were unable to recover it. 00:28:04.904 [2024-11-28 19:16:25.576950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.577029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.577054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.904 qpair failed and we were unable to recover it. 00:28:04.904 [2024-11-28 19:16:25.577135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.577213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.577238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.904 qpair failed and we were unable to recover it. 00:28:04.904 [2024-11-28 19:16:25.577324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.577413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.577438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.904 qpair failed and we were unable to recover it. 00:28:04.904 [2024-11-28 19:16:25.577518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.577602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.577627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.904 qpair failed and we were unable to recover it. 00:28:04.904 [2024-11-28 19:16:25.577719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.577790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.577815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.904 qpair failed and we were unable to recover it. 00:28:04.904 [2024-11-28 19:16:25.577891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.577964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.577989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.904 qpair failed and we were unable to recover it. 00:28:04.904 [2024-11-28 19:16:25.578074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.578183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.578208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.904 qpair failed and we were unable to recover it. 00:28:04.904 [2024-11-28 19:16:25.578286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.578361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.578385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.904 qpair failed and we were unable to recover it. 00:28:04.904 [2024-11-28 19:16:25.578483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.578603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.578628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.904 qpair failed and we were unable to recover it. 00:28:04.904 [2024-11-28 19:16:25.578715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.578792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.578817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.904 qpair failed and we were unable to recover it. 00:28:04.904 [2024-11-28 19:16:25.578900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.578987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.579012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.904 qpair failed and we were unable to recover it. 00:28:04.904 [2024-11-28 19:16:25.579119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.579193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.579218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.904 qpair failed and we were unable to recover it. 00:28:04.904 [2024-11-28 19:16:25.579304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.579409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.579434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.904 qpair failed and we were unable to recover it. 00:28:04.904 [2024-11-28 19:16:25.579515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.579597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.579622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.904 qpair failed and we were unable to recover it. 00:28:04.904 [2024-11-28 19:16:25.579710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.579780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.579805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.904 qpair failed and we were unable to recover it. 00:28:04.904 [2024-11-28 19:16:25.579886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.579961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.579986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.904 qpair failed and we were unable to recover it. 00:28:04.904 [2024-11-28 19:16:25.580096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.580170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.580195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.904 qpair failed and we were unable to recover it. 00:28:04.904 [2024-11-28 19:16:25.580311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.580421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.580447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.904 qpair failed and we were unable to recover it. 00:28:04.904 [2024-11-28 19:16:25.580533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.580608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.580633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.904 qpair failed and we were unable to recover it. 00:28:04.904 [2024-11-28 19:16:25.580745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.580822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.580847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.904 qpair failed and we were unable to recover it. 00:28:04.904 [2024-11-28 19:16:25.580956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.581091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.904 [2024-11-28 19:16:25.581116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.904 qpair failed and we were unable to recover it. 00:28:04.905 [2024-11-28 19:16:25.581237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.581348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.581373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.905 qpair failed and we were unable to recover it. 00:28:04.905 [2024-11-28 19:16:25.581544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.581638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.581667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.905 qpair failed and we were unable to recover it. 00:28:04.905 [2024-11-28 19:16:25.581779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.581906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.581931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.905 qpair failed and we were unable to recover it. 00:28:04.905 [2024-11-28 19:16:25.582041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.582115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.582141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.905 qpair failed and we were unable to recover it. 00:28:04.905 [2024-11-28 19:16:25.582248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.582336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.582363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.905 qpair failed and we were unable to recover it. 00:28:04.905 [2024-11-28 19:16:25.582455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.582530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.582555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.905 qpair failed and we were unable to recover it. 00:28:04.905 [2024-11-28 19:16:25.582634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.582723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.582748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.905 qpair failed and we were unable to recover it. 00:28:04.905 [2024-11-28 19:16:25.582864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.582990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.583014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.905 qpair failed and we were unable to recover it. 00:28:04.905 [2024-11-28 19:16:25.583096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.583236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.583261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.905 qpair failed and we were unable to recover it. 00:28:04.905 [2024-11-28 19:16:25.583341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.583415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.583440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.905 qpair failed and we were unable to recover it. 00:28:04.905 [2024-11-28 19:16:25.583522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.583600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.583625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.905 qpair failed and we were unable to recover it. 00:28:04.905 [2024-11-28 19:16:25.583709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.583816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.583841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.905 qpair failed and we were unable to recover it. 00:28:04.905 [2024-11-28 19:16:25.583930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.584014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.584039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.905 qpair failed and we were unable to recover it. 00:28:04.905 [2024-11-28 19:16:25.584121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.584196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.584221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.905 qpair failed and we were unable to recover it. 00:28:04.905 [2024-11-28 19:16:25.584296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.584374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.584404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.905 qpair failed and we were unable to recover it. 00:28:04.905 [2024-11-28 19:16:25.584487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.584570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.584594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.905 qpair failed and we were unable to recover it. 00:28:04.905 [2024-11-28 19:16:25.584707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.584787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.584812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.905 qpair failed and we were unable to recover it. 00:28:04.905 [2024-11-28 19:16:25.584900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.585013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.585037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.905 qpair failed and we were unable to recover it. 00:28:04.905 [2024-11-28 19:16:25.585115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.585192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.585216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.905 qpair failed and we were unable to recover it. 00:28:04.905 [2024-11-28 19:16:25.585292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.585405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.585431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.905 qpair failed and we were unable to recover it. 00:28:04.905 [2024-11-28 19:16:25.585505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.585612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.585636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.905 qpair failed and we were unable to recover it. 00:28:04.905 [2024-11-28 19:16:25.585719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.585823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.585848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.905 qpair failed and we were unable to recover it. 00:28:04.905 [2024-11-28 19:16:25.585925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.586007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.586033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.905 qpair failed and we were unable to recover it. 00:28:04.905 [2024-11-28 19:16:25.586123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.586199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.586223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.905 qpair failed and we were unable to recover it. 00:28:04.905 [2024-11-28 19:16:25.586305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.586418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.586443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.905 qpair failed and we were unable to recover it. 00:28:04.905 [2024-11-28 19:16:25.586526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.586600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.586624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.905 qpair failed and we were unable to recover it. 00:28:04.905 [2024-11-28 19:16:25.586706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.586783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.586807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.905 qpair failed and we were unable to recover it. 00:28:04.905 [2024-11-28 19:16:25.586881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.586954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.586983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.905 qpair failed and we were unable to recover it. 00:28:04.905 [2024-11-28 19:16:25.587102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.587177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.905 [2024-11-28 19:16:25.587202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.906 qpair failed and we were unable to recover it. 00:28:04.906 [2024-11-28 19:16:25.587312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.587403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.587428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.906 qpair failed and we were unable to recover it. 00:28:04.906 [2024-11-28 19:16:25.587512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.587596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.587621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.906 qpair failed and we were unable to recover it. 00:28:04.906 [2024-11-28 19:16:25.587741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.587847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.587871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.906 qpair failed and we were unable to recover it. 00:28:04.906 [2024-11-28 19:16:25.587957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.588060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.588085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.906 qpair failed and we were unable to recover it. 00:28:04.906 [2024-11-28 19:16:25.588166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.588279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.588303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.906 qpair failed and we were unable to recover it. 00:28:04.906 [2024-11-28 19:16:25.588422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.588501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.588527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.906 qpair failed and we were unable to recover it. 00:28:04.906 [2024-11-28 19:16:25.588636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.588722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.588747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.906 qpair failed and we were unable to recover it. 00:28:04.906 [2024-11-28 19:16:25.588822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.588909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.588933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.906 qpair failed and we were unable to recover it. 00:28:04.906 [2024-11-28 19:16:25.589014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.589121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.589145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.906 qpair failed and we were unable to recover it. 00:28:04.906 [2024-11-28 19:16:25.589227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.589321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.589345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.906 qpair failed and we were unable to recover it. 00:28:04.906 [2024-11-28 19:16:25.589427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.589503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.589528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.906 qpair failed and we were unable to recover it. 00:28:04.906 [2024-11-28 19:16:25.589616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.589723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.589748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.906 qpair failed and we were unable to recover it. 00:28:04.906 [2024-11-28 19:16:25.589829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.589906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.589930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.906 qpair failed and we were unable to recover it. 00:28:04.906 [2024-11-28 19:16:25.590009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.590115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.590140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.906 qpair failed and we were unable to recover it. 00:28:04.906 [2024-11-28 19:16:25.590222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.590294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.590319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.906 qpair failed and we were unable to recover it. 00:28:04.906 [2024-11-28 19:16:25.590412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.590488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.590513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.906 qpair failed and we were unable to recover it. 00:28:04.906 [2024-11-28 19:16:25.590598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.590670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.590695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.906 qpair failed and we were unable to recover it. 00:28:04.906 [2024-11-28 19:16:25.590772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.590848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.590872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.906 qpair failed and we were unable to recover it. 00:28:04.906 [2024-11-28 19:16:25.590951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.591034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.591059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.906 qpair failed and we were unable to recover it. 00:28:04.906 [2024-11-28 19:16:25.591143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.591222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.591247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.906 qpair failed and we were unable to recover it. 00:28:04.906 [2024-11-28 19:16:25.591334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.591415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.591440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.906 qpair failed and we were unable to recover it. 00:28:04.906 [2024-11-28 19:16:25.591521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.591615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.591640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.906 qpair failed and we were unable to recover it. 00:28:04.906 [2024-11-28 19:16:25.591749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.591827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.591851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.906 qpair failed and we were unable to recover it. 00:28:04.906 [2024-11-28 19:16:25.591930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.592015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.592040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.906 qpair failed and we were unable to recover it. 00:28:04.906 [2024-11-28 19:16:25.592142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.592221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.592245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.906 qpair failed and we were unable to recover it. 00:28:04.906 [2024-11-28 19:16:25.592331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.592450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.592477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.906 qpair failed and we were unable to recover it. 00:28:04.906 [2024-11-28 19:16:25.592553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.592629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.592656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.906 qpair failed and we were unable to recover it. 00:28:04.906 [2024-11-28 19:16:25.592748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.592825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.592849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.906 qpair failed and we were unable to recover it. 00:28:04.906 [2024-11-28 19:16:25.592942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.906 [2024-11-28 19:16:25.593019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.593043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.907 qpair failed and we were unable to recover it. 00:28:04.907 [2024-11-28 19:16:25.593134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.593233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.593262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.907 qpair failed and we were unable to recover it. 00:28:04.907 [2024-11-28 19:16:25.593375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.593509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.593536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.907 qpair failed and we were unable to recover it. 00:28:04.907 [2024-11-28 19:16:25.593611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.593734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.593760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.907 qpair failed and we were unable to recover it. 00:28:04.907 [2024-11-28 19:16:25.593838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.593947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.593974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.907 qpair failed and we were unable to recover it. 00:28:04.907 [2024-11-28 19:16:25.594057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.594180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.594205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.907 qpair failed and we were unable to recover it. 00:28:04.907 [2024-11-28 19:16:25.594288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.594365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.594391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.907 qpair failed and we were unable to recover it. 00:28:04.907 [2024-11-28 19:16:25.594507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.594582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.594607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.907 qpair failed and we were unable to recover it. 00:28:04.907 [2024-11-28 19:16:25.594702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.594781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.594807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.907 qpair failed and we were unable to recover it. 00:28:04.907 [2024-11-28 19:16:25.594917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.595026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.595052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.907 qpair failed and we were unable to recover it. 00:28:04.907 [2024-11-28 19:16:25.595133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.595206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.595231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.907 qpair failed and we were unable to recover it. 00:28:04.907 [2024-11-28 19:16:25.595311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.595431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.595457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.907 qpair failed and we were unable to recover it. 00:28:04.907 [2024-11-28 19:16:25.595568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.595641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.595667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.907 qpair failed and we were unable to recover it. 00:28:04.907 [2024-11-28 19:16:25.595777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.595862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.595887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.907 qpair failed and we were unable to recover it. 00:28:04.907 [2024-11-28 19:16:25.596033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.596122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.596147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.907 qpair failed and we were unable to recover it. 00:28:04.907 [2024-11-28 19:16:25.596228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.596302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.596327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.907 qpair failed and we were unable to recover it. 00:28:04.907 [2024-11-28 19:16:25.596411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.596525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.596551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.907 qpair failed and we were unable to recover it. 00:28:04.907 [2024-11-28 19:16:25.596689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.596765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.596790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.907 qpair failed and we were unable to recover it. 00:28:04.907 [2024-11-28 19:16:25.596904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.597039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.597065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.907 qpair failed and we were unable to recover it. 00:28:04.907 [2024-11-28 19:16:25.597175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.597257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.597282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.907 qpair failed and we were unable to recover it. 00:28:04.907 [2024-11-28 19:16:25.597399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.597482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.597507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.907 qpair failed and we were unable to recover it. 00:28:04.907 [2024-11-28 19:16:25.597599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.597715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.597741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.907 qpair failed and we were unable to recover it. 00:28:04.907 [2024-11-28 19:16:25.597823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.597961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.597986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.907 qpair failed and we were unable to recover it. 00:28:04.907 [2024-11-28 19:16:25.598063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.598169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.598195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.907 qpair failed and we were unable to recover it. 00:28:04.907 [2024-11-28 19:16:25.598287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.598367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.907 [2024-11-28 19:16:25.598398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.908 qpair failed and we were unable to recover it. 00:28:04.908 [2024-11-28 19:16:25.598512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.598624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.598649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.908 qpair failed and we were unable to recover it. 00:28:04.908 [2024-11-28 19:16:25.598755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.598834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.598859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.908 qpair failed and we were unable to recover it. 00:28:04.908 [2024-11-28 19:16:25.598942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.599024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.599052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.908 qpair failed and we were unable to recover it. 00:28:04.908 [2024-11-28 19:16:25.599137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.599218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.599243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.908 qpair failed and we were unable to recover it. 00:28:04.908 [2024-11-28 19:16:25.599341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.599433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.599458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.908 qpair failed and we were unable to recover it. 00:28:04.908 [2024-11-28 19:16:25.599535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.599681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.599706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.908 qpair failed and we were unable to recover it. 00:28:04.908 [2024-11-28 19:16:25.599811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.599893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.599920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.908 qpair failed and we were unable to recover it. 00:28:04.908 [2024-11-28 19:16:25.599998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.600073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.600098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.908 qpair failed and we were unable to recover it. 00:28:04.908 [2024-11-28 19:16:25.600181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.600261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.600287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.908 qpair failed and we were unable to recover it. 00:28:04.908 [2024-11-28 19:16:25.600405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.600492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.600517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.908 qpair failed and we were unable to recover it. 00:28:04.908 [2024-11-28 19:16:25.600598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.600716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.600740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.908 qpair failed and we were unable to recover it. 00:28:04.908 [2024-11-28 19:16:25.600854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.600932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.600958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.908 qpair failed and we were unable to recover it. 00:28:04.908 [2024-11-28 19:16:25.601039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.601122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.601148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.908 qpair failed and we were unable to recover it. 00:28:04.908 [2024-11-28 19:16:25.601228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.601341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.601367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.908 qpair failed and we were unable to recover it. 00:28:04.908 [2024-11-28 19:16:25.601484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.601562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.601586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.908 qpair failed and we were unable to recover it. 00:28:04.908 [2024-11-28 19:16:25.601663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.601774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.601800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.908 qpair failed and we were unable to recover it. 00:28:04.908 [2024-11-28 19:16:25.601879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.601959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.601990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.908 qpair failed and we were unable to recover it. 00:28:04.908 [2024-11-28 19:16:25.602078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.602163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.602189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.908 qpair failed and we were unable to recover it. 00:28:04.908 [2024-11-28 19:16:25.602267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.602341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.602366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.908 qpair failed and we were unable to recover it. 00:28:04.908 [2024-11-28 19:16:25.602457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.602536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.602561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.908 qpair failed and we were unable to recover it. 00:28:04.908 [2024-11-28 19:16:25.602677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.602760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.602785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.908 qpair failed and we were unable to recover it. 00:28:04.908 [2024-11-28 19:16:25.602866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.602943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.602968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.908 qpair failed and we were unable to recover it. 00:28:04.908 [2024-11-28 19:16:25.603075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.603190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.603217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.908 qpair failed and we were unable to recover it. 00:28:04.908 [2024-11-28 19:16:25.603299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.603381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.603416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.908 qpair failed and we were unable to recover it. 00:28:04.908 [2024-11-28 19:16:25.603525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.603609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.603634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.908 qpair failed and we were unable to recover it. 00:28:04.908 [2024-11-28 19:16:25.603724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.603858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.603883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.908 qpair failed and we were unable to recover it. 00:28:04.908 [2024-11-28 19:16:25.603962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.604041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.604071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.908 qpair failed and we were unable to recover it. 00:28:04.908 [2024-11-28 19:16:25.604149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.604223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.604249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.908 qpair failed and we were unable to recover it. 00:28:04.908 [2024-11-28 19:16:25.604332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.908 [2024-11-28 19:16:25.604423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.604449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.909 qpair failed and we were unable to recover it. 00:28:04.909 [2024-11-28 19:16:25.604538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.604624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.604649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.909 qpair failed and we were unable to recover it. 00:28:04.909 [2024-11-28 19:16:25.604756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.604837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.604862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.909 qpair failed and we were unable to recover it. 00:28:04.909 [2024-11-28 19:16:25.604976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.605064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.605090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.909 qpair failed and we were unable to recover it. 00:28:04.909 [2024-11-28 19:16:25.605216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.605326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.605352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.909 qpair failed and we were unable to recover it. 00:28:04.909 [2024-11-28 19:16:25.605444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.605558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.605583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.909 qpair failed and we were unable to recover it. 00:28:04.909 [2024-11-28 19:16:25.605671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.605812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.605840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.909 qpair failed and we were unable to recover it. 00:28:04.909 [2024-11-28 19:16:25.605938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.606019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.606049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.909 qpair failed and we were unable to recover it. 00:28:04.909 [2024-11-28 19:16:25.606126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.606215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.606246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.909 qpair failed and we were unable to recover it. 00:28:04.909 [2024-11-28 19:16:25.606334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.606420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.606446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.909 qpair failed and we were unable to recover it. 00:28:04.909 [2024-11-28 19:16:25.606531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.606608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.606633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.909 qpair failed and we were unable to recover it. 00:28:04.909 [2024-11-28 19:16:25.606714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.606853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.606879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.909 qpair failed and we were unable to recover it. 00:28:04.909 [2024-11-28 19:16:25.606962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.607047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.607073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.909 qpair failed and we were unable to recover it. 00:28:04.909 [2024-11-28 19:16:25.607170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.607252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.607277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.909 qpair failed and we were unable to recover it. 00:28:04.909 [2024-11-28 19:16:25.607386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.607475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.607500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.909 qpair failed and we were unable to recover it. 00:28:04.909 [2024-11-28 19:16:25.607579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.607671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.607696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.909 qpair failed and we were unable to recover it. 00:28:04.909 [2024-11-28 19:16:25.607803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.607888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.607913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.909 qpair failed and we were unable to recover it. 00:28:04.909 [2024-11-28 19:16:25.608004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.608084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.608110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.909 qpair failed and we were unable to recover it. 00:28:04.909 [2024-11-28 19:16:25.608203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.608280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.608311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.909 qpair failed and we were unable to recover it. 00:28:04.909 [2024-11-28 19:16:25.608424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.608505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.608530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.909 qpair failed and we were unable to recover it. 00:28:04.909 [2024-11-28 19:16:25.608635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.608731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.608758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.909 qpair failed and we were unable to recover it. 00:28:04.909 [2024-11-28 19:16:25.608849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.608935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.608965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.909 qpair failed and we were unable to recover it. 00:28:04.909 [2024-11-28 19:16:25.609082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.609172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.609199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.909 qpair failed and we were unable to recover it. 00:28:04.909 [2024-11-28 19:16:25.609282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.609404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.609431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.909 qpair failed and we were unable to recover it. 00:28:04.909 [2024-11-28 19:16:25.609516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.609603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.609629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.909 qpair failed and we were unable to recover it. 00:28:04.909 [2024-11-28 19:16:25.609726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.609817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.609850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.909 qpair failed and we were unable to recover it. 00:28:04.909 [2024-11-28 19:16:25.609939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.610025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.610055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.909 qpair failed and we were unable to recover it. 00:28:04.909 [2024-11-28 19:16:25.610147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.610244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.610272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.909 qpair failed and we were unable to recover it. 00:28:04.909 [2024-11-28 19:16:25.610382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.610487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.610515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.909 qpair failed and we were unable to recover it. 00:28:04.909 [2024-11-28 19:16:25.610607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.909 [2024-11-28 19:16:25.610698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.610725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.910 qpair failed and we were unable to recover it. 00:28:04.910 [2024-11-28 19:16:25.610805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.610886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.610912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.910 qpair failed and we were unable to recover it. 00:28:04.910 [2024-11-28 19:16:25.610990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.611065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.611101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.910 qpair failed and we were unable to recover it. 00:28:04.910 [2024-11-28 19:16:25.611186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.611268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.611293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.910 qpair failed and we were unable to recover it. 00:28:04.910 [2024-11-28 19:16:25.611370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.611470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.611496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.910 qpair failed and we were unable to recover it. 00:28:04.910 [2024-11-28 19:16:25.611580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.611663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.611690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.910 qpair failed and we were unable to recover it. 00:28:04.910 [2024-11-28 19:16:25.611774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.611867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.611893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.910 qpair failed and we were unable to recover it. 00:28:04.910 [2024-11-28 19:16:25.611986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.612074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.612099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.910 qpair failed and we were unable to recover it. 00:28:04.910 [2024-11-28 19:16:25.612180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.612259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.612285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.910 qpair failed and we were unable to recover it. 00:28:04.910 [2024-11-28 19:16:25.612408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.612491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.612518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.910 qpair failed and we were unable to recover it. 00:28:04.910 [2024-11-28 19:16:25.612612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.612695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.612720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.910 qpair failed and we were unable to recover it. 00:28:04.910 [2024-11-28 19:16:25.612815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.612936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.612962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.910 qpair failed and we were unable to recover it. 00:28:04.910 [2024-11-28 19:16:25.613073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.613161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.613189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.910 qpair failed and we were unable to recover it. 00:28:04.910 [2024-11-28 19:16:25.613312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.613433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.613459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.910 qpair failed and we were unable to recover it. 00:28:04.910 [2024-11-28 19:16:25.613572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.613677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.613705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.910 qpair failed and we were unable to recover it. 00:28:04.910 [2024-11-28 19:16:25.613790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.613926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.613951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.910 qpair failed and we were unable to recover it. 00:28:04.910 [2024-11-28 19:16:25.614038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.614149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.614174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.910 qpair failed and we were unable to recover it. 00:28:04.910 [2024-11-28 19:16:25.614257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.614336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.614361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.910 qpair failed and we were unable to recover it. 00:28:04.910 [2024-11-28 19:16:25.614453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.614543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.614568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.910 qpair failed and we were unable to recover it. 00:28:04.910 [2024-11-28 19:16:25.614654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.614738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.614765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.910 qpair failed and we were unable to recover it. 00:28:04.910 [2024-11-28 19:16:25.614863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.614946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.614972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.910 qpair failed and we were unable to recover it. 00:28:04.910 [2024-11-28 19:16:25.615070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.615176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.615205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.910 qpair failed and we were unable to recover it. 00:28:04.910 [2024-11-28 19:16:25.615296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.615376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.615411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.910 qpair failed and we were unable to recover it. 00:28:04.910 [2024-11-28 19:16:25.615522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.615601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.615628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.910 qpair failed and we were unable to recover it. 00:28:04.910 [2024-11-28 19:16:25.615727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.615839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.615864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.910 qpair failed and we were unable to recover it. 00:28:04.910 [2024-11-28 19:16:25.615949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.616031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.616056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.910 qpair failed and we were unable to recover it. 00:28:04.910 [2024-11-28 19:16:25.616139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.616220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.616244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.910 qpair failed and we were unable to recover it. 00:28:04.910 [2024-11-28 19:16:25.616322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.616409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.616435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.910 qpair failed and we were unable to recover it. 00:28:04.910 [2024-11-28 19:16:25.616547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.616663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.616688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.910 qpair failed and we were unable to recover it. 00:28:04.910 [2024-11-28 19:16:25.616776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.910 [2024-11-28 19:16:25.616855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.616881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.911 qpair failed and we were unable to recover it. 00:28:04.911 [2024-11-28 19:16:25.616996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.617109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.617134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.911 qpair failed and we were unable to recover it. 00:28:04.911 [2024-11-28 19:16:25.617211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.617324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.617349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.911 qpair failed and we were unable to recover it. 00:28:04.911 [2024-11-28 19:16:25.617446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.617555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.617581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.911 qpair failed and we were unable to recover it. 00:28:04.911 [2024-11-28 19:16:25.617675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.617788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.617813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.911 qpair failed and we were unable to recover it. 00:28:04.911 [2024-11-28 19:16:25.617927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.618012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.618041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.911 qpair failed and we were unable to recover it. 00:28:04.911 [2024-11-28 19:16:25.618128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.618220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.618246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.911 qpair failed and we were unable to recover it. 00:28:04.911 [2024-11-28 19:16:25.618333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.618445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.618472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.911 qpair failed and we were unable to recover it. 00:28:04.911 [2024-11-28 19:16:25.618565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.618645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.618670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.911 qpair failed and we were unable to recover it. 00:28:04.911 [2024-11-28 19:16:25.618745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.618825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.618851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.911 qpair failed and we were unable to recover it. 00:28:04.911 [2024-11-28 19:16:25.618936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.619047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.619072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.911 qpair failed and we were unable to recover it. 00:28:04.911 [2024-11-28 19:16:25.619160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.619243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.619269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.911 qpair failed and we were unable to recover it. 00:28:04.911 [2024-11-28 19:16:25.619358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.619448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.619475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.911 qpair failed and we were unable to recover it. 00:28:04.911 [2024-11-28 19:16:25.619567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.619685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.619711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.911 qpair failed and we were unable to recover it. 00:28:04.911 [2024-11-28 19:16:25.619799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.619904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.619929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.911 qpair failed and we were unable to recover it. 00:28:04.911 [2024-11-28 19:16:25.620013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.620095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.620121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.911 qpair failed and we were unable to recover it. 00:28:04.911 [2024-11-28 19:16:25.620210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.620288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.620314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.911 qpair failed and we were unable to recover it. 00:28:04.911 [2024-11-28 19:16:25.620437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.620553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.620580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.911 qpair failed and we were unable to recover it. 00:28:04.911 [2024-11-28 19:16:25.620662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.620741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.620766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.911 qpair failed and we were unable to recover it. 00:28:04.911 [2024-11-28 19:16:25.620842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.620924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.620953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.911 qpair failed and we were unable to recover it. 00:28:04.911 [2024-11-28 19:16:25.621033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.621120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.621147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.911 qpair failed and we were unable to recover it. 00:28:04.911 [2024-11-28 19:16:25.621243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.621338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.621367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.911 qpair failed and we were unable to recover it. 00:28:04.911 [2024-11-28 19:16:25.621493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.621577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.621604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.911 qpair failed and we were unable to recover it. 00:28:04.911 [2024-11-28 19:16:25.621706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.621783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.621813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.911 qpair failed and we were unable to recover it. 00:28:04.911 [2024-11-28 19:16:25.621904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.621983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.622010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.911 qpair failed and we were unable to recover it. 00:28:04.911 [2024-11-28 19:16:25.622106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.622197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.622226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.911 qpair failed and we were unable to recover it. 00:28:04.911 [2024-11-28 19:16:25.622326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.622421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.622452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.911 qpair failed and we were unable to recover it. 00:28:04.911 [2024-11-28 19:16:25.622548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.622630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.622658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.911 qpair failed and we were unable to recover it. 00:28:04.911 [2024-11-28 19:16:25.622744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.622820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.911 [2024-11-28 19:16:25.622846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.911 qpair failed and we were unable to recover it. 00:28:04.911 [2024-11-28 19:16:25.622933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.623044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.623069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.912 qpair failed and we were unable to recover it. 00:28:04.912 [2024-11-28 19:16:25.623149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.623235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.623260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.912 qpair failed and we were unable to recover it. 00:28:04.912 [2024-11-28 19:16:25.623373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.623473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.623498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.912 qpair failed and we were unable to recover it. 00:28:04.912 [2024-11-28 19:16:25.623582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.623663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.623688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.912 qpair failed and we were unable to recover it. 00:28:04.912 [2024-11-28 19:16:25.623773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.623898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.623923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.912 qpair failed and we were unable to recover it. 00:28:04.912 [2024-11-28 19:16:25.624036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.624110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.624135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.912 qpair failed and we were unable to recover it. 00:28:04.912 [2024-11-28 19:16:25.624217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.624293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.624318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.912 qpair failed and we were unable to recover it. 00:28:04.912 [2024-11-28 19:16:25.624409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.624491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.624517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.912 qpair failed and we were unable to recover it. 00:28:04.912 [2024-11-28 19:16:25.624631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.624731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.624756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.912 qpair failed and we were unable to recover it. 00:28:04.912 [2024-11-28 19:16:25.624839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.624949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.624975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.912 qpair failed and we were unable to recover it. 00:28:04.912 [2024-11-28 19:16:25.625085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.625168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.625194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.912 qpair failed and we were unable to recover it. 00:28:04.912 [2024-11-28 19:16:25.625303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.625417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.625445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.912 qpair failed and we were unable to recover it. 00:28:04.912 [2024-11-28 19:16:25.625560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.625649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.625676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.912 qpair failed and we were unable to recover it. 00:28:04.912 [2024-11-28 19:16:25.625794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.625874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.625899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.912 qpair failed and we were unable to recover it. 00:28:04.912 [2024-11-28 19:16:25.625977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.626114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.626139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.912 qpair failed and we were unable to recover it. 00:28:04.912 [2024-11-28 19:16:25.626225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.626334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.626358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.912 qpair failed and we were unable to recover it. 00:28:04.912 [2024-11-28 19:16:25.626447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.626527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.626556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.912 qpair failed and we were unable to recover it. 00:28:04.912 [2024-11-28 19:16:25.626639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.626738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.626764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.912 qpair failed and we were unable to recover it. 00:28:04.912 [2024-11-28 19:16:25.626850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.626976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.627001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.912 qpair failed and we were unable to recover it. 00:28:04.912 [2024-11-28 19:16:25.627093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.627184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.627210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.912 qpair failed and we were unable to recover it. 00:28:04.912 [2024-11-28 19:16:25.627298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.627410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.627436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.912 qpair failed and we were unable to recover it. 00:28:04.912 [2024-11-28 19:16:25.627548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.627627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.627657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.912 qpair failed and we were unable to recover it. 00:28:04.912 [2024-11-28 19:16:25.627748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.627831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.627856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.912 qpair failed and we were unable to recover it. 00:28:04.912 [2024-11-28 19:16:25.627932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.628011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.628036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.912 qpair failed and we were unable to recover it. 00:28:04.912 [2024-11-28 19:16:25.628129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.628238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.628263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.912 qpair failed and we were unable to recover it. 00:28:04.912 [2024-11-28 19:16:25.628375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.628467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.912 [2024-11-28 19:16:25.628494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.913 qpair failed and we were unable to recover it. 00:28:04.913 [2024-11-28 19:16:25.628608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.628697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.628723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.913 qpair failed and we were unable to recover it. 00:28:04.913 [2024-11-28 19:16:25.628806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.628887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.628913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.913 qpair failed and we were unable to recover it. 00:28:04.913 [2024-11-28 19:16:25.629028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.629108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.629133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.913 qpair failed and we were unable to recover it. 00:28:04.913 [2024-11-28 19:16:25.629247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.629350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.629375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.913 qpair failed and we were unable to recover it. 00:28:04.913 [2024-11-28 19:16:25.629475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.629552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.629577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.913 qpair failed and we were unable to recover it. 00:28:04.913 [2024-11-28 19:16:25.629671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.629756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.629781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.913 qpair failed and we were unable to recover it. 00:28:04.913 [2024-11-28 19:16:25.629918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.629999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.630028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.913 qpair failed and we were unable to recover it. 00:28:04.913 [2024-11-28 19:16:25.630121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.630201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.630225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.913 qpair failed and we were unable to recover it. 00:28:04.913 [2024-11-28 19:16:25.630305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.630407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.630435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.913 qpair failed and we were unable to recover it. 00:28:04.913 [2024-11-28 19:16:25.630527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.630611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.630637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.913 qpair failed and we were unable to recover it. 00:28:04.913 [2024-11-28 19:16:25.630747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.630862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.630888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.913 qpair failed and we were unable to recover it. 00:28:04.913 [2024-11-28 19:16:25.630966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.631049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.631077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.913 qpair failed and we were unable to recover it. 00:28:04.913 [2024-11-28 19:16:25.631166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.631276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.631301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.913 qpair failed and we were unable to recover it. 00:28:04.913 [2024-11-28 19:16:25.631387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.631471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.631496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.913 qpair failed and we were unable to recover it. 00:28:04.913 [2024-11-28 19:16:25.631613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.631693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.631723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.913 qpair failed and we were unable to recover it. 00:28:04.913 [2024-11-28 19:16:25.631832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.631914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.631940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.913 qpair failed and we were unable to recover it. 00:28:04.913 [2024-11-28 19:16:25.632017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.632096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.632126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.913 qpair failed and we were unable to recover it. 00:28:04.913 [2024-11-28 19:16:25.632239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.632322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.632347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.913 qpair failed and we were unable to recover it. 00:28:04.913 [2024-11-28 19:16:25.632442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.632536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.632562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.913 qpair failed and we were unable to recover it. 00:28:04.913 [2024-11-28 19:16:25.632642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.632757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.632782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.913 qpair failed and we were unable to recover it. 00:28:04.913 [2024-11-28 19:16:25.632864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.632956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.632981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.913 qpair failed and we were unable to recover it. 00:28:04.913 [2024-11-28 19:16:25.633067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.633154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.633180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.913 qpair failed and we were unable to recover it. 00:28:04.913 [2024-11-28 19:16:25.633260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.633341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.633366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.913 qpair failed and we were unable to recover it. 00:28:04.913 [2024-11-28 19:16:25.633467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.633567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.633592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.913 qpair failed and we were unable to recover it. 00:28:04.913 [2024-11-28 19:16:25.633674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.633814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.633839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.913 qpair failed and we were unable to recover it. 00:28:04.913 [2024-11-28 19:16:25.633917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.634004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.634030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.913 qpair failed and we were unable to recover it. 00:28:04.913 [2024-11-28 19:16:25.634106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.634188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.634219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.913 qpair failed and we were unable to recover it. 00:28:04.913 [2024-11-28 19:16:25.634305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.634443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.634469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.913 qpair failed and we were unable to recover it. 00:28:04.913 [2024-11-28 19:16:25.634556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.913 [2024-11-28 19:16:25.634638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.634663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.914 qpair failed and we were unable to recover it. 00:28:04.914 [2024-11-28 19:16:25.634738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.634849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.634874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.914 qpair failed and we were unable to recover it. 00:28:04.914 [2024-11-28 19:16:25.634960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.635077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.635102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.914 qpair failed and we were unable to recover it. 00:28:04.914 [2024-11-28 19:16:25.635178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.635293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.635318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.914 qpair failed and we were unable to recover it. 00:28:04.914 [2024-11-28 19:16:25.635401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.635482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.635508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.914 qpair failed and we were unable to recover it. 00:28:04.914 [2024-11-28 19:16:25.635619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.635700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.635725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.914 qpair failed and we were unable to recover it. 00:28:04.914 [2024-11-28 19:16:25.635811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.635950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.635976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.914 qpair failed and we were unable to recover it. 00:28:04.914 [2024-11-28 19:16:25.636069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.636151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.636177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.914 qpair failed and we were unable to recover it. 00:28:04.914 [2024-11-28 19:16:25.636259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.636333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.636363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.914 qpair failed and we were unable to recover it. 00:28:04.914 [2024-11-28 19:16:25.636486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.636564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.636589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.914 qpair failed and we were unable to recover it. 00:28:04.914 [2024-11-28 19:16:25.636679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.636764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.636790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.914 qpair failed and we were unable to recover it. 00:28:04.914 [2024-11-28 19:16:25.636874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.636957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.636984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.914 qpair failed and we were unable to recover it. 00:28:04.914 [2024-11-28 19:16:25.637091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.637166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.637191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.914 qpair failed and we were unable to recover it. 00:28:04.914 [2024-11-28 19:16:25.637269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.637346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.637371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.914 qpair failed and we were unable to recover it. 00:28:04.914 [2024-11-28 19:16:25.637473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.637554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.637579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.914 qpair failed and we were unable to recover it. 00:28:04.914 [2024-11-28 19:16:25.637658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.637742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.637766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.914 qpair failed and we were unable to recover it. 00:28:04.914 [2024-11-28 19:16:25.637874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.637975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.638000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.914 qpair failed and we were unable to recover it. 00:28:04.914 [2024-11-28 19:16:25.638080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.638156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.638180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.914 qpair failed and we were unable to recover it. 00:28:04.914 [2024-11-28 19:16:25.638266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.638340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.638365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.914 qpair failed and we were unable to recover it. 00:28:04.914 [2024-11-28 19:16:25.638464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.638547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.638572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.914 qpair failed and we were unable to recover it. 00:28:04.914 [2024-11-28 19:16:25.638651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.638729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.638754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.914 qpair failed and we were unable to recover it. 00:28:04.914 [2024-11-28 19:16:25.638832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.638909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.638934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.914 qpair failed and we were unable to recover it. 00:28:04.914 [2024-11-28 19:16:25.639076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.639157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.639183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.914 qpair failed and we were unable to recover it. 00:28:04.914 [2024-11-28 19:16:25.639259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.639343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.639368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.914 qpair failed and we were unable to recover it. 00:28:04.914 [2024-11-28 19:16:25.639456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.639531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.639556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a0000b90 with addr=10.0.0.2, port=4420 00:28:04.914 qpair failed and we were unable to recover it. 00:28:04.914 [2024-11-28 19:16:25.639638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.639753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.639779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.914 qpair failed and we were unable to recover it. 00:28:04.914 [2024-11-28 19:16:25.639858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.639941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.639966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.914 qpair failed and we were unable to recover it. 00:28:04.914 [2024-11-28 19:16:25.640046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.640154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.640181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.914 qpair failed and we were unable to recover it. 00:28:04.914 [2024-11-28 19:16:25.640260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.640367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.640399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.914 qpair failed and we were unable to recover it. 00:28:04.914 [2024-11-28 19:16:25.640500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.914 [2024-11-28 19:16:25.640577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.640603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.915 qpair failed and we were unable to recover it. 00:28:04.915 [2024-11-28 19:16:25.640681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.640755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.640779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.915 qpair failed and we were unable to recover it. 00:28:04.915 [2024-11-28 19:16:25.640860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.640971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.640995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.915 qpair failed and we were unable to recover it. 00:28:04.915 [2024-11-28 19:16:25.641077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.641188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.641213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.915 qpair failed and we were unable to recover it. 00:28:04.915 [2024-11-28 19:16:25.641322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.641433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.641460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.915 qpair failed and we were unable to recover it. 00:28:04.915 [2024-11-28 19:16:25.641536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.641671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.641696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.915 qpair failed and we were unable to recover it. 00:28:04.915 [2024-11-28 19:16:25.641774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.641846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.641871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.915 qpair failed and we were unable to recover it. 00:28:04.915 [2024-11-28 19:16:25.641945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.642024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.642049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.915 qpair failed and we were unable to recover it. 00:28:04.915 [2024-11-28 19:16:25.642128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.642203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.642228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.915 qpair failed and we were unable to recover it. 00:28:04.915 [2024-11-28 19:16:25.642319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.642430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.642457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.915 qpair failed and we were unable to recover it. 00:28:04.915 [2024-11-28 19:16:25.642550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.642664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.642689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.915 qpair failed and we were unable to recover it. 00:28:04.915 [2024-11-28 19:16:25.642773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.642858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.642884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.915 qpair failed and we were unable to recover it. 00:28:04.915 [2024-11-28 19:16:25.642963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.643072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.643097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.915 qpair failed and we were unable to recover it. 00:28:04.915 [2024-11-28 19:16:25.643177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.643287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.643313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.915 qpair failed and we were unable to recover it. 00:28:04.915 [2024-11-28 19:16:25.643405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.643483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.643508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.915 qpair failed and we were unable to recover it. 00:28:04.915 [2024-11-28 19:16:25.643611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.643722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.643747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.915 qpair failed and we were unable to recover it. 00:28:04.915 [2024-11-28 19:16:25.643821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.643926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.643951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.915 qpair failed and we were unable to recover it. 00:28:04.915 [2024-11-28 19:16:25.644025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.644101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.644126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.915 qpair failed and we were unable to recover it. 00:28:04.915 [2024-11-28 19:16:25.644237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.644310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.644335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.915 qpair failed and we were unable to recover it. 00:28:04.915 [2024-11-28 19:16:25.644417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.644494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.644518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.915 qpair failed and we were unable to recover it. 00:28:04.915 [2024-11-28 19:16:25.644600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.644693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.644718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.915 qpair failed and we were unable to recover it. 00:28:04.915 [2024-11-28 19:16:25.644797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.644879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.644904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.915 qpair failed and we were unable to recover it. 00:28:04.915 [2024-11-28 19:16:25.644983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.645057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.645081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.915 qpair failed and we were unable to recover it. 00:28:04.915 [2024-11-28 19:16:25.645155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.645228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.645253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.915 qpair failed and we were unable to recover it. 00:28:04.915 [2024-11-28 19:16:25.645359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.645443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.645469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.915 qpair failed and we were unable to recover it. 00:28:04.915 [2024-11-28 19:16:25.645547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.645618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.645643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.915 qpair failed and we were unable to recover it. 00:28:04.915 [2024-11-28 19:16:25.645719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.645826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.645850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.915 qpair failed and we were unable to recover it. 00:28:04.915 [2024-11-28 19:16:25.645959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.646032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.646056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.915 qpair failed and we were unable to recover it. 00:28:04.915 [2024-11-28 19:16:25.646133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.646206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.646231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.915 qpair failed and we were unable to recover it. 00:28:04.915 [2024-11-28 19:16:25.646316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.915 [2024-11-28 19:16:25.646400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.646427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.916 qpair failed and we were unable to recover it. 00:28:04.916 [2024-11-28 19:16:25.646507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.646580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.646609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.916 qpair failed and we were unable to recover it. 00:28:04.916 [2024-11-28 19:16:25.646690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.646764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.646789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.916 qpair failed and we were unable to recover it. 00:28:04.916 [2024-11-28 19:16:25.646925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.647006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.647031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.916 qpair failed and we were unable to recover it. 00:28:04.916 [2024-11-28 19:16:25.647109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.647188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.647213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.916 qpair failed and we were unable to recover it. 00:28:04.916 [2024-11-28 19:16:25.647301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.647439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.647465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.916 qpair failed and we were unable to recover it. 00:28:04.916 [2024-11-28 19:16:25.647573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.647650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.647675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.916 qpair failed and we were unable to recover it. 00:28:04.916 [2024-11-28 19:16:25.647784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.647857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.647882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.916 qpair failed and we were unable to recover it. 00:28:04.916 [2024-11-28 19:16:25.647990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.648100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.648124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.916 qpair failed and we were unable to recover it. 00:28:04.916 [2024-11-28 19:16:25.648272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.648349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.648374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.916 qpair failed and we were unable to recover it. 00:28:04.916 [2024-11-28 19:16:25.648472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.648551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.648576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.916 qpair failed and we were unable to recover it. 00:28:04.916 [2024-11-28 19:16:25.648659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.648767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.648791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.916 qpair failed and we were unable to recover it. 00:28:04.916 [2024-11-28 19:16:25.648895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.648998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.649022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.916 qpair failed and we were unable to recover it. 00:28:04.916 [2024-11-28 19:16:25.649105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.649179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.649204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.916 qpair failed and we were unable to recover it. 00:28:04.916 [2024-11-28 19:16:25.649308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.649407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.649433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.916 qpair failed and we were unable to recover it. 00:28:04.916 [2024-11-28 19:16:25.649513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.649588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.649614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.916 qpair failed and we were unable to recover it. 00:28:04.916 [2024-11-28 19:16:25.649720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.649802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.649827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.916 qpair failed and we were unable to recover it. 00:28:04.916 [2024-11-28 19:16:25.649937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.650016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.650041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.916 qpair failed and we were unable to recover it. 00:28:04.916 [2024-11-28 19:16:25.650152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.650225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.650249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.916 qpair failed and we were unable to recover it. 00:28:04.916 [2024-11-28 19:16:25.650329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.650433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.650459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.916 qpair failed and we were unable to recover it. 00:28:04.916 [2024-11-28 19:16:25.650576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.650655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.650679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.916 qpair failed and we were unable to recover it. 00:28:04.916 [2024-11-28 19:16:25.650788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.650874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.650899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.916 qpair failed and we were unable to recover it. 00:28:04.916 [2024-11-28 19:16:25.651011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.651089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.651113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.916 qpair failed and we were unable to recover it. 00:28:04.916 [2024-11-28 19:16:25.651188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.651267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.651292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.916 qpair failed and we were unable to recover it. 00:28:04.916 [2024-11-28 19:16:25.651410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.651514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.651540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.916 qpair failed and we were unable to recover it. 00:28:04.916 [2024-11-28 19:16:25.651614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.651690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.651715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.916 qpair failed and we were unable to recover it. 00:28:04.916 [2024-11-28 19:16:25.651795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.651871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.916 [2024-11-28 19:16:25.651895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.916 qpair failed and we were unable to recover it. 00:28:04.917 [2024-11-28 19:16:25.651985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.652067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.652091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.917 qpair failed and we were unable to recover it. 00:28:04.917 [2024-11-28 19:16:25.652176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.652287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.652311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.917 qpair failed and we were unable to recover it. 00:28:04.917 [2024-11-28 19:16:25.652391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.652486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.652511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.917 qpair failed and we were unable to recover it. 00:28:04.917 [2024-11-28 19:16:25.652629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.652703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.652728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.917 qpair failed and we were unable to recover it. 00:28:04.917 [2024-11-28 19:16:25.652805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.652916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.652941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.917 qpair failed and we were unable to recover it. 00:28:04.917 [2024-11-28 19:16:25.653018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.653095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.653120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.917 qpair failed and we were unable to recover it. 00:28:04.917 [2024-11-28 19:16:25.653194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.653271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.653296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.917 qpair failed and we were unable to recover it. 00:28:04.917 [2024-11-28 19:16:25.653424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.653508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.653534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.917 qpair failed and we were unable to recover it. 00:28:04.917 [2024-11-28 19:16:25.653618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.653690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.653715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.917 qpair failed and we were unable to recover it. 00:28:04.917 [2024-11-28 19:16:25.653821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.653903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.653928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.917 qpair failed and we were unable to recover it. 00:28:04.917 [2024-11-28 19:16:25.654002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.654111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.654135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.917 qpair failed and we were unable to recover it. 00:28:04.917 [2024-11-28 19:16:25.654218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.654292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.654316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.917 qpair failed and we were unable to recover it. 00:28:04.917 [2024-11-28 19:16:25.654403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.654518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.654543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.917 qpair failed and we were unable to recover it. 00:28:04.917 [2024-11-28 19:16:25.654623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.654701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.654726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.917 qpair failed and we were unable to recover it. 00:28:04.917 [2024-11-28 19:16:25.654833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.654933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.654958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.917 qpair failed and we were unable to recover it. 00:28:04.917 [2024-11-28 19:16:25.655038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.655116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.655142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.917 qpair failed and we were unable to recover it. 00:28:04.917 [2024-11-28 19:16:25.655257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.655365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.655390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.917 qpair failed and we were unable to recover it. 00:28:04.917 [2024-11-28 19:16:25.655482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.655558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.655582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.917 qpair failed and we were unable to recover it. 00:28:04.917 [2024-11-28 19:16:25.655696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.655784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.655809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.917 qpair failed and we were unable to recover it. 00:28:04.917 [2024-11-28 19:16:25.655919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.656002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.656026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.917 qpair failed and we were unable to recover it. 00:28:04.917 [2024-11-28 19:16:25.656134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.656211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.656235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.917 qpair failed and we were unable to recover it. 00:28:04.917 [2024-11-28 19:16:25.656318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.656442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.656468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.917 qpair failed and we were unable to recover it. 00:28:04.917 [2024-11-28 19:16:25.656579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.656655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.656680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.917 qpair failed and we were unable to recover it. 00:28:04.917 [2024-11-28 19:16:25.656770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.656848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.656872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.917 qpair failed and we were unable to recover it. 00:28:04.917 [2024-11-28 19:16:25.656955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.657061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.657086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.917 qpair failed and we were unable to recover it. 00:28:04.917 [2024-11-28 19:16:25.657196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.657277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.657306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.917 qpair failed and we were unable to recover it. 00:28:04.917 [2024-11-28 19:16:25.657382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.657485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.657509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.917 qpair failed and we were unable to recover it. 00:28:04.917 [2024-11-28 19:16:25.657589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.657664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.657689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.917 qpair failed and we were unable to recover it. 00:28:04.917 [2024-11-28 19:16:25.657775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.657858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.917 [2024-11-28 19:16:25.657884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.917 qpair failed and we were unable to recover it. 00:28:04.918 [2024-11-28 19:16:25.657972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.658057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.658082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.918 qpair failed and we were unable to recover it. 00:28:04.918 [2024-11-28 19:16:25.658168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.658242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.658266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.918 qpair failed and we were unable to recover it. 00:28:04.918 [2024-11-28 19:16:25.658352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.658432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.658458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.918 qpair failed and we were unable to recover it. 00:28:04.918 [2024-11-28 19:16:25.658545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.658623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.658649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.918 qpair failed and we were unable to recover it. 00:28:04.918 [2024-11-28 19:16:25.658756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.658833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.658857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.918 qpair failed and we were unable to recover it. 00:28:04.918 [2024-11-28 19:16:25.658966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.659076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.659101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.918 qpair failed and we were unable to recover it. 00:28:04.918 [2024-11-28 19:16:25.659208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.659279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.659308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.918 qpair failed and we were unable to recover it. 00:28:04.918 [2024-11-28 19:16:25.659399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.659481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.659505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.918 qpair failed and we were unable to recover it. 00:28:04.918 [2024-11-28 19:16:25.659584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.659692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.659717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.918 qpair failed and we were unable to recover it. 00:28:04.918 [2024-11-28 19:16:25.659803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.659892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.659917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.918 qpair failed and we were unable to recover it. 00:28:04.918 [2024-11-28 19:16:25.659996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.660069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.660093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.918 qpair failed and we were unable to recover it. 00:28:04.918 [2024-11-28 19:16:25.660169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.660247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.660271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.918 qpair failed and we were unable to recover it. 00:28:04.918 [2024-11-28 19:16:25.660386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.660469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.660494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.918 qpair failed and we were unable to recover it. 00:28:04.918 [2024-11-28 19:16:25.660572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.660648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.660673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.918 qpair failed and we were unable to recover it. 00:28:04.918 [2024-11-28 19:16:25.660752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.660831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.660856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.918 qpair failed and we were unable to recover it. 00:28:04.918 [2024-11-28 19:16:25.660976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.661080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.661105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.918 qpair failed and we were unable to recover it. 00:28:04.918 [2024-11-28 19:16:25.661217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.661293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.661318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.918 qpair failed and we were unable to recover it. 00:28:04.918 [2024-11-28 19:16:25.661417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.661496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.661521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.918 qpair failed and we were unable to recover it. 00:28:04.918 [2024-11-28 19:16:25.661639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.661717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.661742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.918 qpair failed and we were unable to recover it. 00:28:04.918 [2024-11-28 19:16:25.661822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.661895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.661920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.918 qpair failed and we were unable to recover it. 00:28:04.918 [2024-11-28 19:16:25.662027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.662132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.662157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.918 qpair failed and we were unable to recover it. 00:28:04.918 [2024-11-28 19:16:25.662237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.662309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.662334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.918 qpair failed and we were unable to recover it. 00:28:04.918 [2024-11-28 19:16:25.662417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.662528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.662553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.918 qpair failed and we were unable to recover it. 00:28:04.918 [2024-11-28 19:16:25.662634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.662739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.662764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.918 qpair failed and we were unable to recover it. 00:28:04.918 [2024-11-28 19:16:25.662904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.662983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.663008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.918 qpair failed and we were unable to recover it. 00:28:04.918 [2024-11-28 19:16:25.663118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.663192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.663217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.918 qpair failed and we were unable to recover it. 00:28:04.918 [2024-11-28 19:16:25.663298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.663373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.663404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.918 qpair failed and we were unable to recover it. 00:28:04.918 [2024-11-28 19:16:25.663492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.663610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.663635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.918 qpair failed and we were unable to recover it. 00:28:04.918 [2024-11-28 19:16:25.663718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.663795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.918 [2024-11-28 19:16:25.663820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.918 qpair failed and we were unable to recover it. 00:28:04.919 [2024-11-28 19:16:25.663900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.664025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.664050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.919 qpair failed and we were unable to recover it. 00:28:04.919 [2024-11-28 19:16:25.664140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.664219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.664245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.919 qpair failed and we were unable to recover it. 00:28:04.919 [2024-11-28 19:16:25.664334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.664414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.664439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.919 qpair failed and we were unable to recover it. 00:28:04.919 [2024-11-28 19:16:25.664514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.664589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.664615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.919 qpair failed and we were unable to recover it. 00:28:04.919 [2024-11-28 19:16:25.664693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.664807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.664832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.919 qpair failed and we were unable to recover it. 00:28:04.919 [2024-11-28 19:16:25.664912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.664989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.665014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.919 qpair failed and we were unable to recover it. 00:28:04.919 [2024-11-28 19:16:25.665091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.665169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.665194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.919 qpair failed and we were unable to recover it. 00:28:04.919 [2024-11-28 19:16:25.665276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.665389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.665420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.919 qpair failed and we were unable to recover it. 00:28:04.919 [2024-11-28 19:16:25.665507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.665587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.665612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.919 qpair failed and we were unable to recover it. 00:28:04.919 [2024-11-28 19:16:25.665690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.665765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.665789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.919 qpair failed and we were unable to recover it. 00:28:04.919 [2024-11-28 19:16:25.665901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.666008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.666032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.919 qpair failed and we were unable to recover it. 00:28:04.919 [2024-11-28 19:16:25.666174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.666287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.666312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.919 qpair failed and we were unable to recover it. 00:28:04.919 [2024-11-28 19:16:25.666402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.666484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.666519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.919 qpair failed and we were unable to recover it. 00:28:04.919 [2024-11-28 19:16:25.666595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.666674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.666699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.919 qpair failed and we were unable to recover it. 00:28:04.919 [2024-11-28 19:16:25.666780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.666887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.666912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.919 qpair failed and we were unable to recover it. 00:28:04.919 [2024-11-28 19:16:25.667000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.667102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.667127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.919 qpair failed and we were unable to recover it. 00:28:04.919 [2024-11-28 19:16:25.667205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.667281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.667306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.919 qpair failed and we were unable to recover it. 00:28:04.919 [2024-11-28 19:16:25.667416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.667496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.667520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.919 qpair failed and we were unable to recover it. 00:28:04.919 [2024-11-28 19:16:25.667594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.667679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.667705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.919 qpair failed and we were unable to recover it. 00:28:04.919 [2024-11-28 19:16:25.667817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.667890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.667915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.919 qpair failed and we were unable to recover it. 00:28:04.919 [2024-11-28 19:16:25.668002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.668083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.668108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.919 qpair failed and we were unable to recover it. 00:28:04.919 [2024-11-28 19:16:25.668189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.668263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.668288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.919 qpair failed and we were unable to recover it. 00:28:04.919 [2024-11-28 19:16:25.668415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.668496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.668521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.919 qpair failed and we were unable to recover it. 00:28:04.919 [2024-11-28 19:16:25.668605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.668716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.668740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.919 qpair failed and we were unable to recover it. 00:28:04.919 [2024-11-28 19:16:25.668818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.668927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.668952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.919 qpair failed and we were unable to recover it. 00:28:04.919 [2024-11-28 19:16:25.669025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.669163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.669187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.919 qpair failed and we were unable to recover it. 00:28:04.919 [2024-11-28 19:16:25.669265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.669340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.669365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.919 qpair failed and we were unable to recover it. 00:28:04.919 [2024-11-28 19:16:25.669477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.669586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.669611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.919 qpair failed and we were unable to recover it. 00:28:04.919 [2024-11-28 19:16:25.669722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.669834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.919 [2024-11-28 19:16:25.669864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.919 qpair failed and we were unable to recover it. 00:28:04.920 [2024-11-28 19:16:25.669982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.670064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.670089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.920 qpair failed and we were unable to recover it. 00:28:04.920 [2024-11-28 19:16:25.670163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.670239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.670264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.920 qpair failed and we were unable to recover it. 00:28:04.920 [2024-11-28 19:16:25.670374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.670472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.670497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.920 qpair failed and we were unable to recover it. 00:28:04.920 [2024-11-28 19:16:25.670577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.670659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.670684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.920 qpair failed and we were unable to recover it. 00:28:04.920 [2024-11-28 19:16:25.670769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.670875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.670899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.920 qpair failed and we were unable to recover it. 00:28:04.920 [2024-11-28 19:16:25.670987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.671061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.671085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.920 qpair failed and we were unable to recover it. 00:28:04.920 [2024-11-28 19:16:25.671162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.671231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.671256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.920 qpair failed and we were unable to recover it. 00:28:04.920 [2024-11-28 19:16:25.671367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.671483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.671509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.920 qpair failed and we were unable to recover it. 00:28:04.920 [2024-11-28 19:16:25.671596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.671716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.671741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.920 qpair failed and we were unable to recover it. 00:28:04.920 [2024-11-28 19:16:25.671821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.671901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.671926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.920 qpair failed and we were unable to recover it. 00:28:04.920 [2024-11-28 19:16:25.672006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.672088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.672114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.920 qpair failed and we were unable to recover it. 00:28:04.920 [2024-11-28 19:16:25.672192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.672331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.672356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.920 qpair failed and we were unable to recover it. 00:28:04.920 [2024-11-28 19:16:25.672437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.672516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.672540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.920 qpair failed and we were unable to recover it. 00:28:04.920 [2024-11-28 19:16:25.672625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.672713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.672737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.920 qpair failed and we were unable to recover it. 00:28:04.920 [2024-11-28 19:16:25.672846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.672928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.672953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.920 qpair failed and we were unable to recover it. 00:28:04.920 [2024-11-28 19:16:25.673034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.673114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.673140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.920 qpair failed and we were unable to recover it. 00:28:04.920 [2024-11-28 19:16:25.673256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.673338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.673363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.920 qpair failed and we were unable to recover it. 00:28:04.920 [2024-11-28 19:16:25.673454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.673559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.673583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.920 qpair failed and we were unable to recover it. 00:28:04.920 [2024-11-28 19:16:25.673705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.673778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.673803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.920 qpair failed and we were unable to recover it. 00:28:04.920 [2024-11-28 19:16:25.673880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.673958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.673984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.920 qpair failed and we were unable to recover it. 00:28:04.920 [2024-11-28 19:16:25.674074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.674182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.674206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.920 qpair failed and we were unable to recover it. 00:28:04.920 [2024-11-28 19:16:25.674281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.674355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.674380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.920 qpair failed and we were unable to recover it. 00:28:04.920 [2024-11-28 19:16:25.674508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.674622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.674646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.920 qpair failed and we were unable to recover it. 00:28:04.920 [2024-11-28 19:16:25.674755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.674830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.674854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.920 qpair failed and we were unable to recover it. 00:28:04.920 [2024-11-28 19:16:25.674966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.675062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.675089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.920 qpair failed and we were unable to recover it. 00:28:04.920 [2024-11-28 19:16:25.675166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.675237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.675262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.920 qpair failed and we were unable to recover it. 00:28:04.920 [2024-11-28 19:16:25.675341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.675425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.675451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.920 qpair failed and we were unable to recover it. 00:28:04.920 [2024-11-28 19:16:25.675536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.675644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.675669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.920 qpair failed and we were unable to recover it. 00:28:04.920 [2024-11-28 19:16:25.675775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.675885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.920 [2024-11-28 19:16:25.675910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.920 qpair failed and we were unable to recover it. 00:28:04.920 [2024-11-28 19:16:25.675994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.676078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.676103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.921 qpair failed and we were unable to recover it. 00:28:04.921 [2024-11-28 19:16:25.676190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.676292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.676316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.921 qpair failed and we were unable to recover it. 00:28:04.921 [2024-11-28 19:16:25.676435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.676513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.676538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.921 qpair failed and we were unable to recover it. 00:28:04.921 [2024-11-28 19:16:25.676655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.676738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.676764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.921 qpair failed and we were unable to recover it. 00:28:04.921 [2024-11-28 19:16:25.676848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.676923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.676948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.921 qpair failed and we were unable to recover it. 00:28:04.921 [2024-11-28 19:16:25.677042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.677119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.677143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.921 qpair failed and we were unable to recover it. 00:28:04.921 [2024-11-28 19:16:25.677285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.677424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.677450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.921 qpair failed and we were unable to recover it. 00:28:04.921 [2024-11-28 19:16:25.677530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.677607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.677632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.921 qpair failed and we were unable to recover it. 00:28:04.921 [2024-11-28 19:16:25.677726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.677832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.677856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.921 qpair failed and we were unable to recover it. 00:28:04.921 [2024-11-28 19:16:25.677931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.678036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.678061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.921 qpair failed and we were unable to recover it. 00:28:04.921 [2024-11-28 19:16:25.678136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.678247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.678272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.921 qpair failed and we were unable to recover it. 00:28:04.921 [2024-11-28 19:16:25.678363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.678455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.678481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.921 qpair failed and we were unable to recover it. 00:28:04.921 [2024-11-28 19:16:25.678576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.678650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.678676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.921 qpair failed and we were unable to recover it. 00:28:04.921 [2024-11-28 19:16:25.678771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.678882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.678907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.921 qpair failed and we were unable to recover it. 00:28:04.921 [2024-11-28 19:16:25.678992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.679116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.679141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.921 qpair failed and we were unable to recover it. 00:28:04.921 [2024-11-28 19:16:25.679247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.679357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.679382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.921 qpair failed and we were unable to recover it. 00:28:04.921 [2024-11-28 19:16:25.679467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.679578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.679602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.921 qpair failed and we were unable to recover it. 00:28:04.921 [2024-11-28 19:16:25.679678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.679760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.679784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.921 qpair failed and we were unable to recover it. 00:28:04.921 [2024-11-28 19:16:25.679859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.679933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.679958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.921 qpair failed and we were unable to recover it. 00:28:04.921 [2024-11-28 19:16:25.680036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.680117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.680141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.921 qpair failed and we were unable to recover it. 00:28:04.921 [2024-11-28 19:16:25.680252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.680339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.680364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.921 qpair failed and we were unable to recover it. 00:28:04.921 [2024-11-28 19:16:25.680446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.680532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.680561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.921 qpair failed and we were unable to recover it. 00:28:04.921 [2024-11-28 19:16:25.680639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.680729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.680754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.921 qpair failed and we were unable to recover it. 00:28:04.921 [2024-11-28 19:16:25.680865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.680947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.680972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.921 qpair failed and we were unable to recover it. 00:28:04.921 [2024-11-28 19:16:25.681065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.681169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.681194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.921 qpair failed and we were unable to recover it. 00:28:04.921 [2024-11-28 19:16:25.681305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.681402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.921 [2024-11-28 19:16:25.681437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.921 qpair failed and we were unable to recover it. 00:28:04.922 [2024-11-28 19:16:25.681547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.681655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.681679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.922 qpair failed and we were unable to recover it. 00:28:04.922 [2024-11-28 19:16:25.681766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.681850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.681875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.922 qpair failed and we were unable to recover it. 00:28:04.922 [2024-11-28 19:16:25.681953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.682034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.682059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.922 qpair failed and we were unable to recover it. 00:28:04.922 [2024-11-28 19:16:25.682150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.682230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.682255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.922 qpair failed and we were unable to recover it. 00:28:04.922 [2024-11-28 19:16:25.682338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.682449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.682474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.922 qpair failed and we were unable to recover it. 00:28:04.922 [2024-11-28 19:16:25.682563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.682669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.682694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.922 qpair failed and we were unable to recover it. 00:28:04.922 [2024-11-28 19:16:25.682775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.682919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.682944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.922 qpair failed and we were unable to recover it. 00:28:04.922 [2024-11-28 19:16:25.683022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.683103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.683127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.922 qpair failed and we were unable to recover it. 00:28:04.922 [2024-11-28 19:16:25.683235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.683314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.683338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.922 qpair failed and we were unable to recover it. 00:28:04.922 [2024-11-28 19:16:25.683459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.683534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.683559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.922 qpair failed and we were unable to recover it. 00:28:04.922 [2024-11-28 19:16:25.683643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.683748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.683772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.922 qpair failed and we were unable to recover it. 00:28:04.922 [2024-11-28 19:16:25.683857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.683969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.683994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.922 qpair failed and we were unable to recover it. 00:28:04.922 [2024-11-28 19:16:25.684072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.684150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.684175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.922 qpair failed and we were unable to recover it. 00:28:04.922 [2024-11-28 19:16:25.684258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.684337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.684363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.922 qpair failed and we were unable to recover it. 00:28:04.922 [2024-11-28 19:16:25.684466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.684543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.684568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.922 qpair failed and we were unable to recover it. 00:28:04.922 [2024-11-28 19:16:25.684646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.684727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.684753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.922 qpair failed and we were unable to recover it. 00:28:04.922 [2024-11-28 19:16:25.684835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.684914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.684940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.922 qpair failed and we were unable to recover it. 00:28:04.922 [2024-11-28 19:16:25.685077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.685191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.685216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.922 qpair failed and we were unable to recover it. 00:28:04.922 [2024-11-28 19:16:25.685294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.685370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.685415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.922 qpair failed and we were unable to recover it. 00:28:04.922 [2024-11-28 19:16:25.685498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.685601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.685626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.922 qpair failed and we were unable to recover it. 00:28:04.922 [2024-11-28 19:16:25.685711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.685816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.685841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.922 qpair failed and we were unable to recover it. 00:28:04.922 [2024-11-28 19:16:25.685919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.686063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.686089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.922 qpair failed and we were unable to recover it. 00:28:04.922 [2024-11-28 19:16:25.686164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.686276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.686301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.922 qpair failed and we were unable to recover it. 00:28:04.922 [2024-11-28 19:16:25.686384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.686467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.686492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.922 qpair failed and we were unable to recover it. 00:28:04.922 [2024-11-28 19:16:25.686574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.686686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.686711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.922 qpair failed and we were unable to recover it. 00:28:04.922 [2024-11-28 19:16:25.686792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.686866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.686890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.922 qpair failed and we were unable to recover it. 00:28:04.922 [2024-11-28 19:16:25.686982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.687057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.687081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.922 qpair failed and we were unable to recover it. 00:28:04.922 [2024-11-28 19:16:25.687158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.687264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.687289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.922 qpair failed and we were unable to recover it. 00:28:04.922 [2024-11-28 19:16:25.687366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.687508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.922 [2024-11-28 19:16:25.687533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.922 qpair failed and we were unable to recover it. 00:28:04.923 [2024-11-28 19:16:25.687609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.687698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.687725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.923 qpair failed and we were unable to recover it. 00:28:04.923 [2024-11-28 19:16:25.687844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.687929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.687953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.923 qpair failed and we were unable to recover it. 00:28:04.923 [2024-11-28 19:16:25.688040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.688116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.688141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.923 qpair failed and we were unable to recover it. 00:28:04.923 [2024-11-28 19:16:25.688247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.688320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.688345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.923 qpair failed and we were unable to recover it. 00:28:04.923 [2024-11-28 19:16:25.688431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.688569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.688594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.923 qpair failed and we were unable to recover it. 00:28:04.923 [2024-11-28 19:16:25.688708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.688789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.688814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.923 qpair failed and we were unable to recover it. 00:28:04.923 [2024-11-28 19:16:25.688888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.688992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.689017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.923 qpair failed and we were unable to recover it. 00:28:04.923 [2024-11-28 19:16:25.689103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.689217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.689242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.923 qpair failed and we were unable to recover it. 00:28:04.923 [2024-11-28 19:16:25.689380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.689467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.689494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.923 qpair failed and we were unable to recover it. 00:28:04.923 [2024-11-28 19:16:25.689578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.689664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.689689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.923 qpair failed and we were unable to recover it. 00:28:04.923 [2024-11-28 19:16:25.689768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.689875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.689900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.923 qpair failed and we were unable to recover it. 00:28:04.923 [2024-11-28 19:16:25.689987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.690059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.690084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.923 qpair failed and we were unable to recover it. 00:28:04.923 [2024-11-28 19:16:25.690188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.690291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.690315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.923 qpair failed and we were unable to recover it. 00:28:04.923 [2024-11-28 19:16:25.690397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.690482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.690507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.923 qpair failed and we were unable to recover it. 00:28:04.923 [2024-11-28 19:16:25.690584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.690699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.690723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.923 qpair failed and we were unable to recover it. 00:28:04.923 [2024-11-28 19:16:25.690803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.690881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.690906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.923 qpair failed and we were unable to recover it. 00:28:04.923 [2024-11-28 19:16:25.690994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.691077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.691103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.923 qpair failed and we were unable to recover it. 00:28:04.923 [2024-11-28 19:16:25.691184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.691270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.691299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.923 qpair failed and we were unable to recover it. 00:28:04.923 [2024-11-28 19:16:25.691377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.691467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.691493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.923 qpair failed and we were unable to recover it. 00:28:04.923 [2024-11-28 19:16:25.691583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.691660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.691685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.923 qpair failed and we were unable to recover it. 00:28:04.923 [2024-11-28 19:16:25.691761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.691833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.691858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.923 qpair failed and we were unable to recover it. 00:28:04.923 [2024-11-28 19:16:25.691969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.692045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.692069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.923 qpair failed and we were unable to recover it. 00:28:04.923 [2024-11-28 19:16:25.692149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.692226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.692250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.923 qpair failed and we were unable to recover it. 00:28:04.923 [2024-11-28 19:16:25.692328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.692429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.692455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.923 qpair failed and we were unable to recover it. 00:28:04.923 [2024-11-28 19:16:25.692533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.692612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.692637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.923 qpair failed and we were unable to recover it. 00:28:04.923 [2024-11-28 19:16:25.692714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.692794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.692819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.923 qpair failed and we were unable to recover it. 00:28:04.923 [2024-11-28 19:16:25.692929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.693066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.693091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.923 qpair failed and we were unable to recover it. 00:28:04.923 [2024-11-28 19:16:25.693198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.693271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.923 [2024-11-28 19:16:25.693300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.923 qpair failed and we were unable to recover it. 00:28:04.924 [2024-11-28 19:16:25.693384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.693465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.693490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.924 qpair failed and we were unable to recover it. 00:28:04.924 [2024-11-28 19:16:25.693566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.693651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.693677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.924 qpair failed and we were unable to recover it. 00:28:04.924 [2024-11-28 19:16:25.693763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.693835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.693860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.924 qpair failed and we were unable to recover it. 00:28:04.924 [2024-11-28 19:16:25.693937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.694011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.694035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.924 qpair failed and we were unable to recover it. 00:28:04.924 [2024-11-28 19:16:25.694120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.694198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.694223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.924 qpair failed and we were unable to recover it. 00:28:04.924 [2024-11-28 19:16:25.694300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.694403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.694428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.924 qpair failed and we were unable to recover it. 00:28:04.924 [2024-11-28 19:16:25.694533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.694605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.694630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.924 qpair failed and we were unable to recover it. 00:28:04.924 [2024-11-28 19:16:25.694718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.694803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.694827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.924 qpair failed and we were unable to recover it. 00:28:04.924 [2024-11-28 19:16:25.694911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.694992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.695017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.924 qpair failed and we were unable to recover it. 00:28:04.924 [2024-11-28 19:16:25.695103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.695188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.695213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.924 qpair failed and we were unable to recover it. 00:28:04.924 [2024-11-28 19:16:25.695332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.695420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.695446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.924 qpair failed and we were unable to recover it. 00:28:04.924 [2024-11-28 19:16:25.695526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.695641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.695666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.924 qpair failed and we were unable to recover it. 00:28:04.924 [2024-11-28 19:16:25.695741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.695849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.695874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.924 qpair failed and we were unable to recover it. 00:28:04.924 [2024-11-28 19:16:25.695953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.696028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.696052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.924 qpair failed and we were unable to recover it. 00:28:04.924 [2024-11-28 19:16:25.696133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.696207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.696232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.924 qpair failed and we were unable to recover it. 00:28:04.924 [2024-11-28 19:16:25.696308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.696448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.696474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.924 qpair failed and we were unable to recover it. 00:28:04.924 [2024-11-28 19:16:25.696584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.696663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.696688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.924 qpair failed and we were unable to recover it. 00:28:04.924 [2024-11-28 19:16:25.696781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.696856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.696881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.924 qpair failed and we were unable to recover it. 00:28:04.924 [2024-11-28 19:16:25.696969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.697043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.697068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.924 qpair failed and we were unable to recover it. 00:28:04.924 [2024-11-28 19:16:25.697158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.697232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.697257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.924 qpair failed and we were unable to recover it. 00:28:04.924 [2024-11-28 19:16:25.697376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.697465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.697490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.924 qpair failed and we were unable to recover it. 00:28:04.924 [2024-11-28 19:16:25.697572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.697652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.924 [2024-11-28 19:16:25.697677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.924 qpair failed and we were unable to recover it. 00:28:04.924 [2024-11-28 19:16:25.697753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.697826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.697851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.925 qpair failed and we were unable to recover it. 00:28:04.925 [2024-11-28 19:16:25.697931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.698014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.698038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.925 qpair failed and we were unable to recover it. 00:28:04.925 [2024-11-28 19:16:25.698139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.698218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.698242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.925 qpair failed and we were unable to recover it. 00:28:04.925 [2024-11-28 19:16:25.698325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.698434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.698461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.925 qpair failed and we were unable to recover it. 00:28:04.925 [2024-11-28 19:16:25.698576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.698662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.698688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.925 qpair failed and we were unable to recover it. 00:28:04.925 [2024-11-28 19:16:25.698776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.698848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.698873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.925 qpair failed and we were unable to recover it. 00:28:04.925 [2024-11-28 19:16:25.698987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.699065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.699089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.925 qpair failed and we were unable to recover it. 00:28:04.925 [2024-11-28 19:16:25.699202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.699279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.699304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.925 qpair failed and we were unable to recover it. 00:28:04.925 [2024-11-28 19:16:25.699385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.699486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.699511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.925 qpair failed and we were unable to recover it. 00:28:04.925 [2024-11-28 19:16:25.699624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.699726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.699751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.925 qpair failed and we were unable to recover it. 00:28:04.925 [2024-11-28 19:16:25.699860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.699937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.699966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.925 qpair failed and we were unable to recover it. 00:28:04.925 [2024-11-28 19:16:25.700063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.700140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.700164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.925 qpair failed and we were unable to recover it. 00:28:04.925 [2024-11-28 19:16:25.700242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.700346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.700371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.925 qpair failed and we were unable to recover it. 00:28:04.925 [2024-11-28 19:16:25.700470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.700550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.700574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.925 qpair failed and we were unable to recover it. 00:28:04.925 [2024-11-28 19:16:25.700652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.700736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.700760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.925 qpair failed and we were unable to recover it. 00:28:04.925 [2024-11-28 19:16:25.700851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.700924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.700949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.925 qpair failed and we were unable to recover it. 00:28:04.925 [2024-11-28 19:16:25.701034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.701108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.701133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.925 qpair failed and we were unable to recover it. 00:28:04.925 [2024-11-28 19:16:25.701211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.701317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.701342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.925 qpair failed and we were unable to recover it. 00:28:04.925 [2024-11-28 19:16:25.701427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.701532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.701558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.925 qpair failed and we were unable to recover it. 00:28:04.925 [2024-11-28 19:16:25.701635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.701717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.701741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.925 qpair failed and we were unable to recover it. 00:28:04.925 [2024-11-28 19:16:25.701848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.701919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.925 [2024-11-28 19:16:25.701944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.925 qpair failed and we were unable to recover it. 00:28:04.926 [2024-11-28 19:16:25.702031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.702107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.702133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.926 qpair failed and we were unable to recover it. 00:28:04.926 [2024-11-28 19:16:25.702219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.702294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.702318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.926 qpair failed and we were unable to recover it. 00:28:04.926 [2024-11-28 19:16:25.702404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.702500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.702525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.926 qpair failed and we were unable to recover it. 00:28:04.926 [2024-11-28 19:16:25.702610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.702693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.702718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.926 qpair failed and we were unable to recover it. 00:28:04.926 [2024-11-28 19:16:25.702867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.702950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.702975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.926 qpair failed and we were unable to recover it. 00:28:04.926 [2024-11-28 19:16:25.703081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.703156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.703182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.926 qpair failed and we were unable to recover it. 00:28:04.926 [2024-11-28 19:16:25.703294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.703372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.703401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.926 qpair failed and we were unable to recover it. 00:28:04.926 [2024-11-28 19:16:25.703489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.703566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.703595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.926 qpair failed and we were unable to recover it. 00:28:04.926 [2024-11-28 19:16:25.703688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.703768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.703794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.926 qpair failed and we were unable to recover it. 00:28:04.926 [2024-11-28 19:16:25.703905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.704011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.704035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.926 qpair failed and we were unable to recover it. 00:28:04.926 [2024-11-28 19:16:25.704114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.704188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.704213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.926 qpair failed and we were unable to recover it. 00:28:04.926 [2024-11-28 19:16:25.704309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.704386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.704425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.926 qpair failed and we were unable to recover it. 00:28:04.926 [2024-11-28 19:16:25.704506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.704592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.704617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.926 qpair failed and we were unable to recover it. 00:28:04.926 [2024-11-28 19:16:25.704708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.704781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.704806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.926 qpair failed and we were unable to recover it. 00:28:04.926 [2024-11-28 19:16:25.704884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.704991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.705016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.926 qpair failed and we were unable to recover it. 00:28:04.926 [2024-11-28 19:16:25.705130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.705211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.705237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.926 qpair failed and we were unable to recover it. 00:28:04.926 [2024-11-28 19:16:25.705311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.705444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.705470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.926 qpair failed and we were unable to recover it. 00:28:04.926 [2024-11-28 19:16:25.705613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.705691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.705716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.926 qpair failed and we were unable to recover it. 00:28:04.926 [2024-11-28 19:16:25.705805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.705885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.705909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.926 qpair failed and we were unable to recover it. 00:28:04.926 [2024-11-28 19:16:25.705989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.706066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.706091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.926 qpair failed and we were unable to recover it. 00:28:04.926 [2024-11-28 19:16:25.706196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.706274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.706301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.926 qpair failed and we were unable to recover it. 00:28:04.926 [2024-11-28 19:16:25.706411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.706490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.706515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.926 qpair failed and we were unable to recover it. 00:28:04.926 [2024-11-28 19:16:25.706592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.926 [2024-11-28 19:16:25.706667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.706692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.927 qpair failed and we were unable to recover it. 00:28:04.927 [2024-11-28 19:16:25.706799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.706918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.706944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.927 qpair failed and we were unable to recover it. 00:28:04.927 [2024-11-28 19:16:25.707022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.707132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.707157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.927 qpair failed and we were unable to recover it. 00:28:04.927 [2024-11-28 19:16:25.707270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.707346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.707370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.927 qpair failed and we were unable to recover it. 00:28:04.927 [2024-11-28 19:16:25.707460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.707545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.707570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.927 qpair failed and we were unable to recover it. 00:28:04.927 [2024-11-28 19:16:25.707649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.707736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.707760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.927 qpair failed and we were unable to recover it. 00:28:04.927 [2024-11-28 19:16:25.707857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.707933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.707957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.927 qpair failed and we were unable to recover it. 00:28:04.927 [2024-11-28 19:16:25.708034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.708142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.708167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.927 qpair failed and we were unable to recover it. 00:28:04.927 [2024-11-28 19:16:25.708249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.708328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.708354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.927 qpair failed and we were unable to recover it. 00:28:04.927 [2024-11-28 19:16:25.708473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.708551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.708576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.927 qpair failed and we were unable to recover it. 00:28:04.927 [2024-11-28 19:16:25.708658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.708735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.708759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.927 qpair failed and we were unable to recover it. 00:28:04.927 [2024-11-28 19:16:25.708836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.708938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.708962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.927 qpair failed and we were unable to recover it. 00:28:04.927 [2024-11-28 19:16:25.709051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.709133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.709157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.927 qpair failed and we were unable to recover it. 00:28:04.927 [2024-11-28 19:16:25.709244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.709361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.709386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.927 qpair failed and we were unable to recover it. 00:28:04.927 [2024-11-28 19:16:25.709525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.709599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.709623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.927 qpair failed and we were unable to recover it. 00:28:04.927 [2024-11-28 19:16:25.709703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.709780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.709806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.927 qpair failed and we were unable to recover it. 00:28:04.927 [2024-11-28 19:16:25.709907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.710004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.710032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.927 qpair failed and we were unable to recover it. 00:28:04.927 [2024-11-28 19:16:25.710149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.710232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.710257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.927 qpair failed and we were unable to recover it. 00:28:04.927 [2024-11-28 19:16:25.710339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.710423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.710450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.927 qpair failed and we were unable to recover it. 00:28:04.927 [2024-11-28 19:16:25.710561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.710671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.710696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.927 qpair failed and we were unable to recover it. 00:28:04.927 [2024-11-28 19:16:25.710777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.710852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.710877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.927 qpair failed and we were unable to recover it. 00:28:04.927 [2024-11-28 19:16:25.710956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.711064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.711088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.927 qpair failed and we were unable to recover it. 00:28:04.927 [2024-11-28 19:16:25.711198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.711270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.711296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.927 qpair failed and we were unable to recover it. 00:28:04.927 [2024-11-28 19:16:25.711406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.711517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.711541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.927 qpair failed and we were unable to recover it. 00:28:04.927 [2024-11-28 19:16:25.711626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.711701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.711726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.927 qpair failed and we were unable to recover it. 00:28:04.927 [2024-11-28 19:16:25.711808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.711912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.711936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.927 qpair failed and we were unable to recover it. 00:28:04.927 [2024-11-28 19:16:25.712020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.712107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.712132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.927 qpair failed and we were unable to recover it. 00:28:04.927 [2024-11-28 19:16:25.712217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.712299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.712325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.927 qpair failed and we were unable to recover it. 00:28:04.927 [2024-11-28 19:16:25.712442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.712528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.927 [2024-11-28 19:16:25.712554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.927 qpair failed and we were unable to recover it. 00:28:04.928 [2024-11-28 19:16:25.712648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.712768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.712793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.928 qpair failed and we were unable to recover it. 00:28:04.928 [2024-11-28 19:16:25.712888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.713005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.713030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.928 qpair failed and we were unable to recover it. 00:28:04.928 [2024-11-28 19:16:25.713109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.713198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.713224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.928 qpair failed and we were unable to recover it. 00:28:04.928 [2024-11-28 19:16:25.713308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.713399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.713424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.928 qpair failed and we were unable to recover it. 00:28:04.928 [2024-11-28 19:16:25.713504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.713587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.713612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.928 qpair failed and we were unable to recover it. 00:28:04.928 [2024-11-28 19:16:25.713716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.713792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.713816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.928 qpair failed and we were unable to recover it. 00:28:04.928 [2024-11-28 19:16:25.713896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.713981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.714006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.928 qpair failed and we were unable to recover it. 00:28:04.928 [2024-11-28 19:16:25.714116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.714198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.714224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.928 qpair failed and we were unable to recover it. 00:28:04.928 [2024-11-28 19:16:25.714308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.714401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.714426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.928 qpair failed and we were unable to recover it. 00:28:04.928 [2024-11-28 19:16:25.714536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.714613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.714637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.928 qpair failed and we were unable to recover it. 00:28:04.928 [2024-11-28 19:16:25.714731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.714831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.714855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.928 qpair failed and we were unable to recover it. 00:28:04.928 [2024-11-28 19:16:25.714938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.715014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.715039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.928 qpair failed and we were unable to recover it. 00:28:04.928 [2024-11-28 19:16:25.715120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.715257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.715282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.928 qpair failed and we were unable to recover it. 00:28:04.928 [2024-11-28 19:16:25.715362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.715448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.715473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.928 qpair failed and we were unable to recover it. 00:28:04.928 [2024-11-28 19:16:25.715564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.715641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.715665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.928 qpair failed and we were unable to recover it. 00:28:04.928 [2024-11-28 19:16:25.715774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.715871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.715896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.928 qpair failed and we were unable to recover it. 00:28:04.928 [2024-11-28 19:16:25.715978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.716053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.716079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.928 qpair failed and we were unable to recover it. 00:28:04.928 [2024-11-28 19:16:25.716191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.716302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.716326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.928 qpair failed and we were unable to recover it. 00:28:04.928 [2024-11-28 19:16:25.716416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.716510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.716534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.928 qpair failed and we were unable to recover it. 00:28:04.928 [2024-11-28 19:16:25.716615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.716721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.716745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.928 qpair failed and we were unable to recover it. 00:28:04.928 [2024-11-28 19:16:25.716822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.716930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.716954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.928 qpair failed and we were unable to recover it. 00:28:04.928 [2024-11-28 19:16:25.717043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.717114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.717139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.928 qpair failed and we were unable to recover it. 00:28:04.928 [2024-11-28 19:16:25.717214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.717300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.717324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.928 qpair failed and we were unable to recover it. 00:28:04.928 [2024-11-28 19:16:25.717405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.717480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.717505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.928 qpair failed and we were unable to recover it. 00:28:04.928 [2024-11-28 19:16:25.717585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.717694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.717719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.928 qpair failed and we were unable to recover it. 00:28:04.928 [2024-11-28 19:16:25.717799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.717924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.717951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.928 qpair failed and we were unable to recover it. 00:28:04.928 [2024-11-28 19:16:25.718058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.718169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.718194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.928 qpair failed and we were unable to recover it. 00:28:04.928 [2024-11-28 19:16:25.718271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.718377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.718412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.928 qpair failed and we were unable to recover it. 00:28:04.928 [2024-11-28 19:16:25.718496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.718580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.928 [2024-11-28 19:16:25.718605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.929 qpair failed and we were unable to recover it. 00:28:04.929 [2024-11-28 19:16:25.718716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.718793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.718818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.929 qpair failed and we were unable to recover it. 00:28:04.929 [2024-11-28 19:16:25.718928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.719002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.719027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.929 qpair failed and we were unable to recover it. 00:28:04.929 [2024-11-28 19:16:25.719113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.719217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.719241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.929 qpair failed and we were unable to recover it. 00:28:04.929 [2024-11-28 19:16:25.719351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.719431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.719456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.929 qpair failed and we were unable to recover it. 00:28:04.929 [2024-11-28 19:16:25.719542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.719650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.719674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.929 qpair failed and we were unable to recover it. 00:28:04.929 [2024-11-28 19:16:25.719765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.719844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.719868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.929 qpair failed and we were unable to recover it. 00:28:04.929 [2024-11-28 19:16:25.720004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.720085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.720109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.929 qpair failed and we were unable to recover it. 00:28:04.929 [2024-11-28 19:16:25.720195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.720272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.720296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.929 qpair failed and we were unable to recover it. 00:28:04.929 [2024-11-28 19:16:25.720375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.720476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.720507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.929 qpair failed and we were unable to recover it. 00:28:04.929 [2024-11-28 19:16:25.720598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.720719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.720745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.929 qpair failed and we were unable to recover it. 00:28:04.929 [2024-11-28 19:16:25.720857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.720936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.720961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.929 qpair failed and we were unable to recover it. 00:28:04.929 [2024-11-28 19:16:25.721047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.721158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.721181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.929 qpair failed and we were unable to recover it. 00:28:04.929 [2024-11-28 19:16:25.721262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.721339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.721363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.929 qpair failed and we were unable to recover it. 00:28:04.929 [2024-11-28 19:16:25.721460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.721535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.721560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.929 qpair failed and we were unable to recover it. 00:28:04.929 [2024-11-28 19:16:25.721651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.721731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.721756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.929 qpair failed and we were unable to recover it. 00:28:04.929 [2024-11-28 19:16:25.721868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.721944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.721968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.929 qpair failed and we were unable to recover it. 00:28:04.929 [2024-11-28 19:16:25.722084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.722188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.722212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.929 qpair failed and we were unable to recover it. 00:28:04.929 [2024-11-28 19:16:25.722293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.722405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.722430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.929 qpair failed and we were unable to recover it. 00:28:04.929 [2024-11-28 19:16:25.722543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.722620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.722648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.929 qpair failed and we were unable to recover it. 00:28:04.929 [2024-11-28 19:16:25.722734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.722848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.722872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.929 qpair failed and we were unable to recover it. 00:28:04.929 [2024-11-28 19:16:25.722959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.723034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.723059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.929 qpair failed and we were unable to recover it. 00:28:04.929 [2024-11-28 19:16:25.723145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.723233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.723257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.929 qpair failed and we were unable to recover it. 00:28:04.929 [2024-11-28 19:16:25.723368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.723464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.723489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.929 qpair failed and we were unable to recover it. 00:28:04.929 [2024-11-28 19:16:25.723603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.723681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.723705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.929 qpair failed and we were unable to recover it. 00:28:04.929 [2024-11-28 19:16:25.723780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.723866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.723890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.929 qpair failed and we were unable to recover it. 00:28:04.929 [2024-11-28 19:16:25.723972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.724084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.724108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.929 qpair failed and we were unable to recover it. 00:28:04.929 [2024-11-28 19:16:25.724192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.724309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.724334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.929 qpair failed and we were unable to recover it. 00:28:04.929 [2024-11-28 19:16:25.724424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.724538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.929 [2024-11-28 19:16:25.724563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.929 qpair failed and we were unable to recover it. 00:28:04.929 [2024-11-28 19:16:25.724644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.724720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.724749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.930 qpair failed and we were unable to recover it. 00:28:04.930 [2024-11-28 19:16:25.724837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.724940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.724965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.930 qpair failed and we were unable to recover it. 00:28:04.930 [2024-11-28 19:16:25.725047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.725126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.725150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.930 qpair failed and we were unable to recover it. 00:28:04.930 [2024-11-28 19:16:25.725260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.725364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.725388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.930 qpair failed and we were unable to recover it. 00:28:04.930 [2024-11-28 19:16:25.725474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.725579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.725604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.930 qpair failed and we were unable to recover it. 00:28:04.930 [2024-11-28 19:16:25.725685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.725755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.725779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.930 qpair failed and we were unable to recover it. 00:28:04.930 [2024-11-28 19:16:25.725893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.725977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.726002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.930 qpair failed and we were unable to recover it. 00:28:04.930 [2024-11-28 19:16:25.726107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.726185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.726210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.930 qpair failed and we were unable to recover it. 00:28:04.930 [2024-11-28 19:16:25.726288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.726403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.726429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.930 qpair failed and we were unable to recover it. 00:28:04.930 [2024-11-28 19:16:25.726508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.726583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.726608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.930 qpair failed and we were unable to recover it. 00:28:04.930 [2024-11-28 19:16:25.726688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.726765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.726791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.930 qpair failed and we were unable to recover it. 00:28:04.930 [2024-11-28 19:16:25.726871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.726958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.726982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.930 qpair failed and we were unable to recover it. 00:28:04.930 [2024-11-28 19:16:25.727059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.727139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.727165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.930 qpair failed and we were unable to recover it. 00:28:04.930 [2024-11-28 19:16:25.727248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.727358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.727383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.930 qpair failed and we were unable to recover it. 00:28:04.930 [2024-11-28 19:16:25.727495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.727581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.727607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.930 qpair failed and we were unable to recover it. 00:28:04.930 [2024-11-28 19:16:25.727684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.727764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.727789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.930 qpair failed and we were unable to recover it. 00:28:04.930 [2024-11-28 19:16:25.727869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.728003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.728027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.930 qpair failed and we were unable to recover it. 00:28:04.930 [2024-11-28 19:16:25.728113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.728216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.728240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.930 qpair failed and we were unable to recover it. 00:28:04.930 [2024-11-28 19:16:25.728316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.728390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.728424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.930 qpair failed and we were unable to recover it. 00:28:04.930 [2024-11-28 19:16:25.728516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.728596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.728621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.930 qpair failed and we were unable to recover it. 00:28:04.930 [2024-11-28 19:16:25.728702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.728783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.728807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.930 qpair failed and we were unable to recover it. 00:28:04.930 [2024-11-28 19:16:25.728891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.728965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.728990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.930 qpair failed and we were unable to recover it. 00:28:04.930 [2024-11-28 19:16:25.729073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.729146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.729172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.930 qpair failed and we were unable to recover it. 00:28:04.930 [2024-11-28 19:16:25.729253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.729335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.729360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.930 qpair failed and we were unable to recover it. 00:28:04.930 [2024-11-28 19:16:25.729453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.729532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.729557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.930 qpair failed and we were unable to recover it. 00:28:04.930 [2024-11-28 19:16:25.729650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.729729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.729755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.930 qpair failed and we were unable to recover it. 00:28:04.930 [2024-11-28 19:16:25.729862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.729968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.729992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.930 qpair failed and we were unable to recover it. 00:28:04.930 [2024-11-28 19:16:25.730076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.730156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.730180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.930 qpair failed and we were unable to recover it. 00:28:04.930 [2024-11-28 19:16:25.730269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.730353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.930 [2024-11-28 19:16:25.730377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.930 qpair failed and we were unable to recover it. 00:28:04.931 [2024-11-28 19:16:25.730466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.730545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.730570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.931 qpair failed and we were unable to recover it. 00:28:04.931 [2024-11-28 19:16:25.730648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.730755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.730780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.931 qpair failed and we were unable to recover it. 00:28:04.931 [2024-11-28 19:16:25.730896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.730981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.731005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.931 qpair failed and we were unable to recover it. 00:28:04.931 [2024-11-28 19:16:25.731124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.731237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.731262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.931 qpair failed and we were unable to recover it. 00:28:04.931 [2024-11-28 19:16:25.731345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.731429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.731454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.931 qpair failed and we were unable to recover it. 00:28:04.931 [2024-11-28 19:16:25.731565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.731646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.731670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.931 qpair failed and we were unable to recover it. 00:28:04.931 [2024-11-28 19:16:25.731753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.731857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.731881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.931 qpair failed and we were unable to recover it. 00:28:04.931 [2024-11-28 19:16:25.731990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.732070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.732094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.931 qpair failed and we were unable to recover it. 00:28:04.931 [2024-11-28 19:16:25.732188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.732268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.732292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.931 qpair failed and we were unable to recover it. 00:28:04.931 [2024-11-28 19:16:25.732366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.732451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.732476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.931 qpair failed and we were unable to recover it. 00:28:04.931 [2024-11-28 19:16:25.732553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.732638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.732662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.931 qpair failed and we were unable to recover it. 00:28:04.931 [2024-11-28 19:16:25.732751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.732832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.732857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.931 qpair failed and we were unable to recover it. 00:28:04.931 [2024-11-28 19:16:25.732940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.733077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.733101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.931 qpair failed and we were unable to recover it. 00:28:04.931 [2024-11-28 19:16:25.733184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.733292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.733317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.931 qpair failed and we were unable to recover it. 00:28:04.931 [2024-11-28 19:16:25.733391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.733510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.733535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.931 qpair failed and we were unable to recover it. 00:28:04.931 [2024-11-28 19:16:25.733615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.733687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.733710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.931 qpair failed and we were unable to recover it. 00:28:04.931 [2024-11-28 19:16:25.733817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.733898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.733924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.931 qpair failed and we were unable to recover it. 00:28:04.931 [2024-11-28 19:16:25.734014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.734089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.734113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.931 qpair failed and we were unable to recover it. 00:28:04.931 [2024-11-28 19:16:25.734191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.734263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.734289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.931 qpair failed and we were unable to recover it. 00:28:04.931 [2024-11-28 19:16:25.734368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.734457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.734481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.931 qpair failed and we were unable to recover it. 00:28:04.931 [2024-11-28 19:16:25.734558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.734649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.734673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.931 qpair failed and we were unable to recover it. 00:28:04.931 [2024-11-28 19:16:25.734753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.734838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.734863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.931 qpair failed and we were unable to recover it. 00:28:04.931 [2024-11-28 19:16:25.734954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.735029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.735055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.931 qpair failed and we were unable to recover it. 00:28:04.931 [2024-11-28 19:16:25.735136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.735212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.735237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.931 qpair failed and we were unable to recover it. 00:28:04.931 [2024-11-28 19:16:25.735317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.735422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.735448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.931 qpair failed and we were unable to recover it. 00:28:04.931 [2024-11-28 19:16:25.735539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.931 [2024-11-28 19:16:25.735621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.735645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.932 qpair failed and we were unable to recover it. 00:28:04.932 [2024-11-28 19:16:25.735751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.735829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.735854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.932 qpair failed and we were unable to recover it. 00:28:04.932 [2024-11-28 19:16:25.735940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.736048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.736072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.932 qpair failed and we were unable to recover it. 00:28:04.932 [2024-11-28 19:16:25.736157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.736231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.736256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.932 qpair failed and we were unable to recover it. 00:28:04.932 [2024-11-28 19:16:25.736337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.736414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.736440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.932 qpair failed and we were unable to recover it. 00:28:04.932 [2024-11-28 19:16:25.736519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.736600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.736625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.932 qpair failed and we were unable to recover it. 00:28:04.932 [2024-11-28 19:16:25.736745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.736819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.736843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.932 qpair failed and we were unable to recover it. 00:28:04.932 [2024-11-28 19:16:25.736923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.737003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.737027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.932 qpair failed and we were unable to recover it. 00:28:04.932 [2024-11-28 19:16:25.737104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.737208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.737234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.932 qpair failed and we were unable to recover it. 00:28:04.932 [2024-11-28 19:16:25.737326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.737410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.737435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.932 qpair failed and we were unable to recover it. 00:28:04.932 [2024-11-28 19:16:25.737516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.737604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.737628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.932 qpair failed and we were unable to recover it. 00:28:04.932 [2024-11-28 19:16:25.737739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.737818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.737843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.932 qpair failed and we were unable to recover it. 00:28:04.932 [2024-11-28 19:16:25.737930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.738013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.738039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.932 qpair failed and we were unable to recover it. 00:28:04.932 [2024-11-28 19:16:25.738155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.738234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.738259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.932 qpair failed and we were unable to recover it. 00:28:04.932 [2024-11-28 19:16:25.738345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.738460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.738485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.932 qpair failed and we were unable to recover it. 00:28:04.932 [2024-11-28 19:16:25.738594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.738675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.738701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.932 qpair failed and we were unable to recover it. 00:28:04.932 [2024-11-28 19:16:25.738786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.738894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.738918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f79a8000b90 with addr=10.0.0.2, port=4420 00:28:04.932 qpair failed and we were unable to recover it. 00:28:04.932 [2024-11-28 19:16:25.739018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.739115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.739144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.932 qpair failed and we were unable to recover it. 00:28:04.932 [2024-11-28 19:16:25.739228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.739313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.739339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.932 qpair failed and we were unable to recover it. 00:28:04.932 [2024-11-28 19:16:25.739430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.739522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.739548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.932 qpair failed and we were unable to recover it. 00:28:04.932 [2024-11-28 19:16:25.739631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.739709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.739734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.932 qpair failed and we were unable to recover it. 00:28:04.932 [2024-11-28 19:16:25.739853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.739932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.739957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.932 qpair failed and we were unable to recover it. 00:28:04.932 [2024-11-28 19:16:25.740036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.740113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.740138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.932 qpair failed and we were unable to recover it. 00:28:04.932 [2024-11-28 19:16:25.740219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.740330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.740355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.932 qpair failed and we were unable to recover it. 00:28:04.932 [2024-11-28 19:16:25.740444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.740535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.740562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.932 qpair failed and we were unable to recover it. 00:28:04.932 [2024-11-28 19:16:25.740650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.740740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.740765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.932 qpair failed and we were unable to recover it. 00:28:04.932 [2024-11-28 19:16:25.740846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.740925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.740951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.932 qpair failed and we were unable to recover it. 00:28:04.932 [2024-11-28 19:16:25.741090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.741173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.741200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.932 qpair failed and we were unable to recover it. 00:28:04.932 [2024-11-28 19:16:25.741283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.741356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.932 [2024-11-28 19:16:25.741381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.932 qpair failed and we were unable to recover it. 00:28:04.932 [2024-11-28 19:16:25.741473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.741549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.741574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.933 qpair failed and we were unable to recover it. 00:28:04.933 [2024-11-28 19:16:25.741649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.741767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.741792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.933 qpair failed and we were unable to recover it. 00:28:04.933 [2024-11-28 19:16:25.741866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.742002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.742026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.933 qpair failed and we were unable to recover it. 00:28:04.933 [2024-11-28 19:16:25.742104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.742208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.742233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.933 qpair failed and we were unable to recover it. 00:28:04.933 [2024-11-28 19:16:25.742348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.742427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.742453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.933 qpair failed and we were unable to recover it. 00:28:04.933 [2024-11-28 19:16:25.742531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.742606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.742630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.933 qpair failed and we were unable to recover it. 00:28:04.933 [2024-11-28 19:16:25.742721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.742797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.742822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.933 qpair failed and we were unable to recover it. 00:28:04.933 [2024-11-28 19:16:25.742902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.742981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.743005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.933 qpair failed and we were unable to recover it. 00:28:04.933 [2024-11-28 19:16:25.743086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.743169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.743199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.933 qpair failed and we were unable to recover it. 00:28:04.933 [2024-11-28 19:16:25.743307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.743390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.743424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.933 qpair failed and we were unable to recover it. 00:28:04.933 [2024-11-28 19:16:25.743508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.743589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.743613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.933 qpair failed and we were unable to recover it. 00:28:04.933 [2024-11-28 19:16:25.743690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.743767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.743792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.933 qpair failed and we were unable to recover it. 00:28:04.933 [2024-11-28 19:16:25.743868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.743947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.743972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.933 qpair failed and we were unable to recover it. 00:28:04.933 [2024-11-28 19:16:25.744111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.744192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.744216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.933 qpair failed and we were unable to recover it. 00:28:04.933 [2024-11-28 19:16:25.744299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.744374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.744405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.933 qpair failed and we were unable to recover it. 00:28:04.933 [2024-11-28 19:16:25.744487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.744561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.744586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.933 qpair failed and we were unable to recover it. 00:28:04.933 [2024-11-28 19:16:25.744691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.744797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.744822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.933 qpair failed and we were unable to recover it. 00:28:04.933 [2024-11-28 19:16:25.744906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.744992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.745018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.933 qpair failed and we were unable to recover it. 00:28:04.933 [2024-11-28 19:16:25.745097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.745173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.745203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.933 qpair failed and we were unable to recover it. 00:28:04.933 [2024-11-28 19:16:25.745314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.745391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.745424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.933 qpair failed and we were unable to recover it. 00:28:04.933 [2024-11-28 19:16:25.745505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.745586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.745611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.933 qpair failed and we were unable to recover it. 00:28:04.933 [2024-11-28 19:16:25.745722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.745796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.745821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.933 qpair failed and we were unable to recover it. 00:28:04.933 [2024-11-28 19:16:25.745928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.746012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.746037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.933 qpair failed and we were unable to recover it. 00:28:04.933 [2024-11-28 19:16:25.746119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.746226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.746252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.933 qpair failed and we were unable to recover it. 00:28:04.933 [2024-11-28 19:16:25.746357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.746465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.746491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.933 qpair failed and we were unable to recover it. 00:28:04.933 [2024-11-28 19:16:25.746572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.746650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.746676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.933 qpair failed and we were unable to recover it. 00:28:04.933 [2024-11-28 19:16:25.746758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.746845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.746870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.933 qpair failed and we were unable to recover it. 00:28:04.933 [2024-11-28 19:16:25.746953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.747031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.747057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.933 qpair failed and we were unable to recover it. 00:28:04.933 [2024-11-28 19:16:25.747133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.747222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.933 [2024-11-28 19:16:25.747247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.933 qpair failed and we were unable to recover it. 00:28:04.933 [2024-11-28 19:16:25.747366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.747453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.747479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.934 qpair failed and we were unable to recover it. 00:28:04.934 [2024-11-28 19:16:25.747562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.747638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.747663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.934 qpair failed and we were unable to recover it. 00:28:04.934 [2024-11-28 19:16:25.747775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.747851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.747876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.934 qpair failed and we were unable to recover it. 00:28:04.934 [2024-11-28 19:16:25.747997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.748074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.748099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.934 qpair failed and we were unable to recover it. 00:28:04.934 [2024-11-28 19:16:25.748176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.748277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.748303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.934 qpair failed and we were unable to recover it. 00:28:04.934 [2024-11-28 19:16:25.748412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.748505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.748531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.934 qpair failed and we were unable to recover it. 00:28:04.934 [2024-11-28 19:16:25.748609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.748684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.748709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.934 qpair failed and we were unable to recover it. 00:28:04.934 [2024-11-28 19:16:25.748821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.748898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.748923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.934 qpair failed and we were unable to recover it. 00:28:04.934 [2024-11-28 19:16:25.749002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.749075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.749100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.934 qpair failed and we were unable to recover it. 00:28:04.934 [2024-11-28 19:16:25.749178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.749289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.749313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.934 qpair failed and we were unable to recover it. 00:28:04.934 [2024-11-28 19:16:25.749401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.749506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.749531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.934 qpair failed and we were unable to recover it. 00:28:04.934 [2024-11-28 19:16:25.749615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.749700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.749725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.934 qpair failed and we were unable to recover it. 00:28:04.934 [2024-11-28 19:16:25.749804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.749877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.749902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.934 qpair failed and we were unable to recover it. 00:28:04.934 [2024-11-28 19:16:25.749981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.750085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.750110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.934 qpair failed and we were unable to recover it. 00:28:04.934 [2024-11-28 19:16:25.750219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.750294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.750319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.934 qpair failed and we were unable to recover it. 00:28:04.934 [2024-11-28 19:16:25.750407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.750515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.750540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.934 qpair failed and we were unable to recover it. 00:28:04.934 [2024-11-28 19:16:25.750651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.750723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.750748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.934 qpair failed and we were unable to recover it. 00:28:04.934 [2024-11-28 19:16:25.750827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.750935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.750960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.934 qpair failed and we were unable to recover it. 00:28:04.934 [2024-11-28 19:16:25.751044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.751147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.751171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.934 qpair failed and we were unable to recover it. 00:28:04.934 [2024-11-28 19:16:25.751252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.751358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.751383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.934 qpair failed and we were unable to recover it. 00:28:04.934 [2024-11-28 19:16:25.751498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.751581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.751606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.934 qpair failed and we were unable to recover it. 00:28:04.934 [2024-11-28 19:16:25.751694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.751781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.751806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.934 qpair failed and we were unable to recover it. 00:28:04.934 [2024-11-28 19:16:25.751887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.751999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.752024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.934 qpair failed and we were unable to recover it. 00:28:04.934 [2024-11-28 19:16:25.752140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.752248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.752273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.934 qpair failed and we were unable to recover it. 00:28:04.934 [2024-11-28 19:16:25.752355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.752474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.752499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.934 qpair failed and we were unable to recover it. 00:28:04.934 [2024-11-28 19:16:25.752579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.752656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.752681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.934 qpair failed and we were unable to recover it. 00:28:04.934 [2024-11-28 19:16:25.752794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.752903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.752927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.934 qpair failed and we were unable to recover it. 00:28:04.934 [2024-11-28 19:16:25.753011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.753086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.753111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.934 qpair failed and we were unable to recover it. 00:28:04.934 [2024-11-28 19:16:25.753224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.753302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.934 [2024-11-28 19:16:25.753328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.934 qpair failed and we were unable to recover it. 00:28:04.934 [2024-11-28 19:16:25.753411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.753502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.753528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.935 qpair failed and we were unable to recover it. 00:28:04.935 [2024-11-28 19:16:25.753637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.753719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.753744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.935 qpair failed and we were unable to recover it. 00:28:04.935 [2024-11-28 19:16:25.753825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.753955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.753980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.935 qpair failed and we were unable to recover it. 00:28:04.935 [2024-11-28 19:16:25.754123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.754202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.754228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.935 qpair failed and we were unable to recover it. 00:28:04.935 [2024-11-28 19:16:25.754305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.754381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.754421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.935 qpair failed and we were unable to recover it. 00:28:04.935 [2024-11-28 19:16:25.754529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.754614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.754639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.935 qpair failed and we were unable to recover it. 00:28:04.935 [2024-11-28 19:16:25.754716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.754791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.754817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.935 qpair failed and we were unable to recover it. 00:28:04.935 [2024-11-28 19:16:25.754891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.754969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.754995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.935 qpair failed and we were unable to recover it. 00:28:04.935 [2024-11-28 19:16:25.755073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.755185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.755210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.935 qpair failed and we were unable to recover it. 00:28:04.935 [2024-11-28 19:16:25.755320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.755404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.755429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.935 qpair failed and we were unable to recover it. 00:28:04.935 [2024-11-28 19:16:25.755506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.755582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.755607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.935 qpair failed and we were unable to recover it. 00:28:04.935 [2024-11-28 19:16:25.755690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.755761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.755790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.935 qpair failed and we were unable to recover it. 00:28:04.935 [2024-11-28 19:16:25.755881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.755968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.755992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.935 qpair failed and we were unable to recover it. 00:28:04.935 [2024-11-28 19:16:25.756076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.756146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.756170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.935 qpair failed and we were unable to recover it. 00:28:04.935 [2024-11-28 19:16:25.756277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.756381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.756411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.935 qpair failed and we were unable to recover it. 00:28:04.935 [2024-11-28 19:16:25.756491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.756567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.756592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.935 qpair failed and we were unable to recover it. 00:28:04.935 [2024-11-28 19:16:25.756671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.756788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.756813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.935 qpair failed and we were unable to recover it. 00:28:04.935 [2024-11-28 19:16:25.756918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.756993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.757018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.935 qpair failed and we were unable to recover it. 00:28:04.935 [2024-11-28 19:16:25.757096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.757174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.757199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.935 qpair failed and we were unable to recover it. 00:28:04.935 [2024-11-28 19:16:25.757292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.757368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.757400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.935 qpair failed and we were unable to recover it. 00:28:04.935 [2024-11-28 19:16:25.757497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.757573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.757604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.935 qpair failed and we were unable to recover it. 00:28:04.935 [2024-11-28 19:16:25.757721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.757796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.757821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.935 qpair failed and we were unable to recover it. 00:28:04.935 [2024-11-28 19:16:25.757906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.758022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.758047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.935 qpair failed and we were unable to recover it. 00:28:04.935 [2024-11-28 19:16:25.758122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.758194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.758219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.935 qpair failed and we were unable to recover it. 00:28:04.935 [2024-11-28 19:16:25.758304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.758412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.758438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.935 qpair failed and we were unable to recover it. 00:28:04.935 [2024-11-28 19:16:25.758525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.758631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.935 [2024-11-28 19:16:25.758656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.935 qpair failed and we were unable to recover it. 00:28:04.935 [2024-11-28 19:16:25.758734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.758840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.758865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.936 qpair failed and we were unable to recover it. 00:28:04.936 [2024-11-28 19:16:25.758974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.759077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.759102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.936 qpair failed and we were unable to recover it. 00:28:04.936 [2024-11-28 19:16:25.759180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.759257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.759283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.936 qpair failed and we were unable to recover it. 00:28:04.936 [2024-11-28 19:16:25.759399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.759478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.759503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.936 qpair failed and we were unable to recover it. 00:28:04.936 [2024-11-28 19:16:25.759587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.759692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.759717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.936 qpair failed and we were unable to recover it. 00:28:04.936 [2024-11-28 19:16:25.759802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.759913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.759937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.936 qpair failed and we were unable to recover it. 00:28:04.936 [2024-11-28 19:16:25.760058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.760139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.760164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.936 qpair failed and we were unable to recover it. 00:28:04.936 [2024-11-28 19:16:25.760252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.760328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.760353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.936 qpair failed and we were unable to recover it. 00:28:04.936 [2024-11-28 19:16:25.760455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.760529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.760554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.936 qpair failed and we were unable to recover it. 00:28:04.936 [2024-11-28 19:16:25.760634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.760720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.760745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.936 qpair failed and we were unable to recover it. 00:28:04.936 [2024-11-28 19:16:25.760825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.760896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.760921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.936 qpair failed and we were unable to recover it. 00:28:04.936 [2024-11-28 19:16:25.760995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.761100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.761126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.936 qpair failed and we were unable to recover it. 00:28:04.936 [2024-11-28 19:16:25.761207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.761311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.761336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.936 qpair failed and we were unable to recover it. 00:28:04.936 [2024-11-28 19:16:25.761428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.761506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.761531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.936 qpair failed and we were unable to recover it. 00:28:04.936 [2024-11-28 19:16:25.761612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.761691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.761716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.936 qpair failed and we were unable to recover it. 00:28:04.936 [2024-11-28 19:16:25.761824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.761899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.761925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.936 qpair failed and we were unable to recover it. 00:28:04.936 [2024-11-28 19:16:25.762037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.762141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.762166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.936 qpair failed and we were unable to recover it. 00:28:04.936 [2024-11-28 19:16:25.762243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.762316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.762340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.936 qpair failed and we were unable to recover it. 00:28:04.936 [2024-11-28 19:16:25.762476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.762557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.762583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.936 qpair failed and we were unable to recover it. 00:28:04.936 [2024-11-28 19:16:25.762662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.762742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.762767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.936 qpair failed and we were unable to recover it. 00:28:04.936 [2024-11-28 19:16:25.762860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.762933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.762958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.936 qpair failed and we were unable to recover it. 00:28:04.936 [2024-11-28 19:16:25.763039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.763116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.763141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.936 qpair failed and we were unable to recover it. 00:28:04.936 [2024-11-28 19:16:25.763247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.763328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.763354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.936 qpair failed and we were unable to recover it. 00:28:04.936 [2024-11-28 19:16:25.763443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.763545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.763569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.936 qpair failed and we were unable to recover it. 00:28:04.936 [2024-11-28 19:16:25.763687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.763764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.763789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.936 qpair failed and we were unable to recover it. 00:28:04.936 [2024-11-28 19:16:25.763862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.763967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.763992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.936 qpair failed and we were unable to recover it. 00:28:04.936 [2024-11-28 19:16:25.764068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.764179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.764204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.936 qpair failed and we were unable to recover it. 00:28:04.936 [2024-11-28 19:16:25.764314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.764389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.764418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.936 qpair failed and we were unable to recover it. 00:28:04.936 [2024-11-28 19:16:25.764495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.764603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.936 [2024-11-28 19:16:25.764629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.936 qpair failed and we were unable to recover it. 00:28:04.936 [2024-11-28 19:16:25.764715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.764791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.764816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.937 qpair failed and we were unable to recover it. 00:28:04.937 [2024-11-28 19:16:25.764926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.765027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.765052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.937 qpair failed and we were unable to recover it. 00:28:04.937 [2024-11-28 19:16:25.765163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.765239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.765264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.937 qpair failed and we were unable to recover it. 00:28:04.937 [2024-11-28 19:16:25.765347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.765427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.765452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.937 qpair failed and we were unable to recover it. 00:28:04.937 [2024-11-28 19:16:25.765562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.765641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.765666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.937 qpair failed and we were unable to recover it. 00:28:04.937 [2024-11-28 19:16:25.765747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.765853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.765878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.937 qpair failed and we were unable to recover it. 00:28:04.937 [2024-11-28 19:16:25.765965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.766040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.766064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.937 qpair failed and we were unable to recover it. 00:28:04.937 [2024-11-28 19:16:25.766141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.766255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.766286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.937 qpair failed and we were unable to recover it. 00:28:04.937 [2024-11-28 19:16:25.766366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.766475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.766501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.937 qpair failed and we were unable to recover it. 00:28:04.937 [2024-11-28 19:16:25.766576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.766660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.766686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.937 qpair failed and we were unable to recover it. 00:28:04.937 [2024-11-28 19:16:25.766760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.766831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.766856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.937 qpair failed and we were unable to recover it. 00:28:04.937 [2024-11-28 19:16:25.766935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.767042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.767067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.937 qpair failed and we were unable to recover it. 00:28:04.937 [2024-11-28 19:16:25.767153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.767223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.767248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.937 qpair failed and we were unable to recover it. 00:28:04.937 [2024-11-28 19:16:25.767334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.767416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.767442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.937 qpair failed and we were unable to recover it. 00:28:04.937 [2024-11-28 19:16:25.767527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.767609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.767634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.937 qpair failed and we were unable to recover it. 00:28:04.937 [2024-11-28 19:16:25.767716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.767819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.767844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.937 qpair failed and we were unable to recover it. 00:28:04.937 [2024-11-28 19:16:25.767930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.768036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.768061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.937 qpair failed and we were unable to recover it. 00:28:04.937 [2024-11-28 19:16:25.768140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.768214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.768239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.937 qpair failed and we were unable to recover it. 00:28:04.937 [2024-11-28 19:16:25.768331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.768471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.768502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.937 qpair failed and we were unable to recover it. 00:28:04.937 [2024-11-28 19:16:25.768590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.768671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.768696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.937 qpair failed and we were unable to recover it. 00:28:04.937 [2024-11-28 19:16:25.768772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.768856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.768881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.937 qpair failed and we were unable to recover it. 00:28:04.937 [2024-11-28 19:16:25.768960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.769035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.769060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.937 qpair failed and we were unable to recover it. 00:28:04.937 [2024-11-28 19:16:25.769138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.769242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.769267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.937 qpair failed and we were unable to recover it. 00:28:04.937 [2024-11-28 19:16:25.769353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.769435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.769461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.937 qpair failed and we were unable to recover it. 00:28:04.937 [2024-11-28 19:16:25.769549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.769629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.769655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.937 qpair failed and we were unable to recover it. 00:28:04.937 [2024-11-28 19:16:25.769797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.769881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.769906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.937 qpair failed and we were unable to recover it. 00:28:04.937 [2024-11-28 19:16:25.770000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.770075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.770101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.937 qpair failed and we were unable to recover it. 00:28:04.937 [2024-11-28 19:16:25.770181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.770255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.770280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.937 qpair failed and we were unable to recover it. 00:28:04.937 [2024-11-28 19:16:25.770362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.770450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.937 [2024-11-28 19:16:25.770476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.937 qpair failed and we were unable to recover it. 00:28:04.937 [2024-11-28 19:16:25.770557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.770643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.770669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.938 qpair failed and we were unable to recover it. 00:28:04.938 [2024-11-28 19:16:25.770778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.770888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.770913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.938 qpair failed and we were unable to recover it. 00:28:04.938 [2024-11-28 19:16:25.770989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.771098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.771124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.938 qpair failed and we were unable to recover it. 00:28:04.938 [2024-11-28 19:16:25.771201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.771342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.771367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.938 qpair failed and we were unable to recover it. 00:28:04.938 [2024-11-28 19:16:25.771484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.771571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.771595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.938 qpair failed and we were unable to recover it. 00:28:04.938 [2024-11-28 19:16:25.771713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.771787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.771812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.938 qpair failed and we were unable to recover it. 00:28:04.938 [2024-11-28 19:16:25.771903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.771976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.772001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.938 qpair failed and we were unable to recover it. 00:28:04.938 [2024-11-28 19:16:25.772082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.772191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.772216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.938 qpair failed and we were unable to recover it. 00:28:04.938 [2024-11-28 19:16:25.772292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.772406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.772432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.938 qpair failed and we were unable to recover it. 00:28:04.938 [2024-11-28 19:16:25.772531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.772660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.772691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.938 qpair failed and we were unable to recover it. 00:28:04.938 [2024-11-28 19:16:25.772775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.772884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.772910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.938 qpair failed and we were unable to recover it. 00:28:04.938 [2024-11-28 19:16:25.773110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.773189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.773215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.938 qpair failed and we were unable to recover it. 00:28:04.938 [2024-11-28 19:16:25.773329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.773411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.773440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.938 qpair failed and we were unable to recover it. 00:28:04.938 [2024-11-28 19:16:25.773523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.773631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.773657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.938 qpair failed and we were unable to recover it. 00:28:04.938 [2024-11-28 19:16:25.773771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.773884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.773909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f799c000b90 with addr=10.0.0.2, port=4420 00:28:04.938 qpair failed and we were unable to recover it. 00:28:04.938 [2024-11-28 19:16:25.773992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.774078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.774105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.938 qpair failed and we were unable to recover it. 00:28:04.938 [2024-11-28 19:16:25.774192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.774270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.774295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.938 qpair failed and we were unable to recover it. 00:28:04.938 [2024-11-28 19:16:25.774375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.774463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.774489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.938 qpair failed and we were unable to recover it. 00:28:04.938 [2024-11-28 19:16:25.774598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.774670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.774695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.938 qpair failed and we were unable to recover it. 00:28:04.938 [2024-11-28 19:16:25.774805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.774918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.774943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.938 qpair failed and we were unable to recover it. 00:28:04.938 [2024-11-28 19:16:25.775024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.775103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.775129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.938 qpair failed and we were unable to recover it. 00:28:04.938 [2024-11-28 19:16:25.775212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.775319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.775344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.938 qpair failed and we were unable to recover it. 00:28:04.938 [2024-11-28 19:16:25.775443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.775523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.775548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.938 qpair failed and we were unable to recover it. 00:28:04.938 [2024-11-28 19:16:25.775625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.775704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.775729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.938 qpair failed and we were unable to recover it. 00:28:04.938 [2024-11-28 19:16:25.775808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.775926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.775951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.938 qpair failed and we were unable to recover it. 00:28:04.938 [2024-11-28 19:16:25.776058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.776138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.776163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.938 qpair failed and we were unable to recover it. 00:28:04.938 [2024-11-28 19:16:25.776251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.776390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.776421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.938 qpair failed and we were unable to recover it. 00:28:04.938 [2024-11-28 19:16:25.776502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.776579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.776604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.938 qpair failed and we were unable to recover it. 00:28:04.938 [2024-11-28 19:16:25.776712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.776784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.938 [2024-11-28 19:16:25.776810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.938 qpair failed and we were unable to recover it. 00:28:04.938 [2024-11-28 19:16:25.776891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.776970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.776995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.939 qpair failed and we were unable to recover it. 00:28:04.939 [2024-11-28 19:16:25.777071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.777177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.777203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.939 qpair failed and we were unable to recover it. 00:28:04.939 [2024-11-28 19:16:25.777289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.777360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.777386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.939 qpair failed and we were unable to recover it. 00:28:04.939 [2024-11-28 19:16:25.777470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.777562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.777587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.939 qpair failed and we were unable to recover it. 00:28:04.939 [2024-11-28 19:16:25.777666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.777751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.777776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.939 qpair failed and we were unable to recover it. 00:28:04.939 [2024-11-28 19:16:25.777867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.777942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.777967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.939 qpair failed and we were unable to recover it. 00:28:04.939 [2024-11-28 19:16:25.778052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.778133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.778158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.939 qpair failed and we were unable to recover it. 00:28:04.939 [2024-11-28 19:16:25.778266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.778370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.778415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.939 qpair failed and we were unable to recover it. 00:28:04.939 [2024-11-28 19:16:25.778509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.778590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.778614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.939 qpair failed and we were unable to recover it. 00:28:04.939 [2024-11-28 19:16:25.778691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.778808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.778832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.939 qpair failed and we were unable to recover it. 00:28:04.939 [2024-11-28 19:16:25.778911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.778986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.779016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.939 qpair failed and we were unable to recover it. 00:28:04.939 [2024-11-28 19:16:25.779106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.779192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.779217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.939 qpair failed and we were unable to recover it. 00:28:04.939 [2024-11-28 19:16:25.779305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.779382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.779414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.939 qpair failed and we were unable to recover it. 00:28:04.939 [2024-11-28 19:16:25.779533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.779610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.779635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.939 qpair failed and we were unable to recover it. 00:28:04.939 [2024-11-28 19:16:25.779720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.779800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.779825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.939 qpair failed and we were unable to recover it. 00:28:04.939 [2024-11-28 19:16:25.779917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.779993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.780022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.939 qpair failed and we were unable to recover it. 00:28:04.939 [2024-11-28 19:16:25.780128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.780209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.780233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.939 qpair failed and we were unable to recover it. 00:28:04.939 [2024-11-28 19:16:25.780319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.780401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.780427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.939 qpair failed and we were unable to recover it. 00:28:04.939 [2024-11-28 19:16:25.780510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.780595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.780621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.939 qpair failed and we were unable to recover it. 00:28:04.939 [2024-11-28 19:16:25.780711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.780816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.780842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.939 qpair failed and we were unable to recover it. 00:28:04.939 [2024-11-28 19:16:25.780928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.781009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.781033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.939 qpair failed and we were unable to recover it. 00:28:04.939 [2024-11-28 19:16:25.781119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.781222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.781247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.939 qpair failed and we were unable to recover it. 00:28:04.939 [2024-11-28 19:16:25.781325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.781447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.781473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.939 qpair failed and we were unable to recover it. 00:28:04.939 [2024-11-28 19:16:25.781560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.781645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.781669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.939 qpair failed and we were unable to recover it. 00:28:04.939 [2024-11-28 19:16:25.781749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.781836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.781860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.939 qpair failed and we were unable to recover it. 00:28:04.939 [2024-11-28 19:16:25.781936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.782007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.782032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.939 qpair failed and we were unable to recover it. 00:28:04.939 [2024-11-28 19:16:25.782108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.782184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.782208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.939 qpair failed and we were unable to recover it. 00:28:04.939 [2024-11-28 19:16:25.782317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.782398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.782424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.939 qpair failed and we were unable to recover it. 00:28:04.939 [2024-11-28 19:16:25.782509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.782582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.939 [2024-11-28 19:16:25.782607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.939 qpair failed and we were unable to recover it. 00:28:04.940 [2024-11-28 19:16:25.782685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.782774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.782799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.940 qpair failed and we were unable to recover it. 00:28:04.940 [2024-11-28 19:16:25.782911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.782988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.783014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.940 qpair failed and we were unable to recover it. 00:28:04.940 [2024-11-28 19:16:25.783107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.783183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.783207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.940 qpair failed and we were unable to recover it. 00:28:04.940 [2024-11-28 19:16:25.783294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.783367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.783397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.940 qpair failed and we were unable to recover it. 00:28:04.940 [2024-11-28 19:16:25.783477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.783553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.783578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.940 qpair failed and we were unable to recover it. 00:28:04.940 [2024-11-28 19:16:25.783657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.783766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.783791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.940 qpair failed and we were unable to recover it. 00:28:04.940 [2024-11-28 19:16:25.783902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.783975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.784000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.940 qpair failed and we were unable to recover it. 00:28:04.940 [2024-11-28 19:16:25.784082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.784156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.784181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.940 qpair failed and we were unable to recover it. 00:28:04.940 [2024-11-28 19:16:25.784290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.784362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.784386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.940 qpair failed and we were unable to recover it. 00:28:04.940 [2024-11-28 19:16:25.784506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.784583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.784608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.940 qpair failed and we were unable to recover it. 00:28:04.940 [2024-11-28 19:16:25.784686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.784762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.784786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.940 qpair failed and we were unable to recover it. 00:28:04.940 [2024-11-28 19:16:25.784897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.784974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.784999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.940 qpair failed and we were unable to recover it. 00:28:04.940 [2024-11-28 19:16:25.785086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.785173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.785198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.940 qpair failed and we were unable to recover it. 00:28:04.940 [2024-11-28 19:16:25.785271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.785347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.785372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.940 qpair failed and we were unable to recover it. 00:28:04.940 [2024-11-28 19:16:25.785487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.785565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.785590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.940 qpair failed and we were unable to recover it. 00:28:04.940 [2024-11-28 19:16:25.785699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.785805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.785830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.940 qpair failed and we were unable to recover it. 00:28:04.940 [2024-11-28 19:16:25.785945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.786027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.786052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.940 qpair failed and we were unable to recover it. 00:28:04.940 [2024-11-28 19:16:25.786126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.786210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.786234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.940 qpair failed and we were unable to recover it. 00:28:04.940 [2024-11-28 19:16:25.786313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.786387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.786419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.940 qpair failed and we were unable to recover it. 00:28:04.940 [2024-11-28 19:16:25.786501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.786604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.786629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.940 qpair failed and we were unable to recover it. 00:28:04.940 [2024-11-28 19:16:25.786706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.786782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.786807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.940 qpair failed and we were unable to recover it. 00:28:04.940 [2024-11-28 19:16:25.786886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.786993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.787019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.940 qpair failed and we were unable to recover it. 00:28:04.940 [2024-11-28 19:16:25.787123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.787239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.787264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.940 qpair failed and we were unable to recover it. 00:28:04.940 [2024-11-28 19:16:25.787341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.787420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.787445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.940 qpair failed and we were unable to recover it. 00:28:04.940 [2024-11-28 19:16:25.787556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.787635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.787659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.940 qpair failed and we were unable to recover it. 00:28:04.940 [2024-11-28 19:16:25.787777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.787854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.940 [2024-11-28 19:16:25.787879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.940 qpair failed and we were unable to recover it. 00:28:04.941 [2024-11-28 19:16:25.787959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.788038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.788063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.941 qpair failed and we were unable to recover it. 00:28:04.941 [2024-11-28 19:16:25.788143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.788225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.788250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.941 qpair failed and we were unable to recover it. 00:28:04.941 [2024-11-28 19:16:25.788338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.788411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.788435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.941 qpair failed and we were unable to recover it. 00:28:04.941 [2024-11-28 19:16:25.788513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.788623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.788648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.941 qpair failed and we were unable to recover it. 00:28:04.941 [2024-11-28 19:16:25.788735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.788807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.788831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.941 qpair failed and we were unable to recover it. 00:28:04.941 [2024-11-28 19:16:25.788908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.789019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.789044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.941 qpair failed and we were unable to recover it. 00:28:04.941 [2024-11-28 19:16:25.789123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.789202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.789234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.941 qpair failed and we were unable to recover it. 00:28:04.941 [2024-11-28 19:16:25.789317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.789397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.789423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.941 qpair failed and we were unable to recover it. 00:28:04.941 [2024-11-28 19:16:25.789502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.789645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.789671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.941 qpair failed and we were unable to recover it. 00:28:04.941 [2024-11-28 19:16:25.789751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.789860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.789884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.941 qpair failed and we were unable to recover it. 00:28:04.941 [2024-11-28 19:16:25.789964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.790070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.790095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.941 qpair failed and we were unable to recover it. 00:28:04.941 [2024-11-28 19:16:25.790179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.790314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.790339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.941 qpair failed and we were unable to recover it. 00:28:04.941 [2024-11-28 19:16:25.790430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.790510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.790535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.941 qpair failed and we were unable to recover it. 00:28:04.941 [2024-11-28 19:16:25.790622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.790733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.790759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.941 qpair failed and we were unable to recover it. 00:28:04.941 [2024-11-28 19:16:25.790837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.790922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.790946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.941 qpair failed and we were unable to recover it. 00:28:04.941 [2024-11-28 19:16:25.791023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.791102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.791127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.941 qpair failed and we were unable to recover it. 00:28:04.941 [2024-11-28 19:16:25.791209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.791322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.791347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.941 qpair failed and we were unable to recover it. 00:28:04.941 [2024-11-28 19:16:25.791440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.791517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.791542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.941 qpair failed and we were unable to recover it. 00:28:04.941 [2024-11-28 19:16:25.791630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.791703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.791727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.941 qpair failed and we were unable to recover it. 00:28:04.941 [2024-11-28 19:16:25.791803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.791877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.791902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.941 qpair failed and we were unable to recover it. 00:28:04.941 [2024-11-28 19:16:25.791986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.792061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.792086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.941 qpair failed and we were unable to recover it. 00:28:04.941 [2024-11-28 19:16:25.792165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.792243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.792267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.941 qpair failed and we were unable to recover it. 00:28:04.941 [2024-11-28 19:16:25.792345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.792423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.792447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.941 qpair failed and we were unable to recover it. 00:28:04.941 [2024-11-28 19:16:25.792532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.792641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.792666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.941 qpair failed and we were unable to recover it. 00:28:04.941 [2024-11-28 19:16:25.792742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.792844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.792869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.941 qpair failed and we were unable to recover it. 00:28:04.941 [2024-11-28 19:16:25.792950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.793024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.793048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.941 qpair failed and we were unable to recover it. 00:28:04.941 [2024-11-28 19:16:25.793157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.793247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.793271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.941 qpair failed and we were unable to recover it. 00:28:04.941 [2024-11-28 19:16:25.793358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.793436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.793461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.941 qpair failed and we were unable to recover it. 00:28:04.941 [2024-11-28 19:16:25.793548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.793681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.941 [2024-11-28 19:16:25.793705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.941 qpair failed and we were unable to recover it. 00:28:04.942 [2024-11-28 19:16:25.793789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.793903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.793928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.942 qpair failed and we were unable to recover it. 00:28:04.942 [2024-11-28 19:16:25.794036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.794112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.794137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.942 qpair failed and we were unable to recover it. 00:28:04.942 [2024-11-28 19:16:25.794218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.794331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.794355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.942 qpair failed and we were unable to recover it. 00:28:04.942 [2024-11-28 19:16:25.794465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.794543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.794568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.942 qpair failed and we were unable to recover it. 00:28:04.942 [2024-11-28 19:16:25.794678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.794811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.794835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.942 qpair failed and we were unable to recover it. 00:28:04.942 [2024-11-28 19:16:25.794917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.795023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.795047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.942 qpair failed and we were unable to recover it. 00:28:04.942 [2024-11-28 19:16:25.795123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.795199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.795223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.942 qpair failed and we were unable to recover it. 00:28:04.942 [2024-11-28 19:16:25.795309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.795403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.795429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.942 qpair failed and we were unable to recover it. 00:28:04.942 [2024-11-28 19:16:25.795516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.795620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.795645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.942 qpair failed and we were unable to recover it. 00:28:04.942 [2024-11-28 19:16:25.795725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.795832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.795856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.942 qpair failed and we were unable to recover it. 00:28:04.942 [2024-11-28 19:16:25.795955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.796028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.796053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.942 qpair failed and we were unable to recover it. 00:28:04.942 [2024-11-28 19:16:25.796128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.796199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.796224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.942 qpair failed and we were unable to recover it. 00:28:04.942 [2024-11-28 19:16:25.796333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.796411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.796437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.942 qpair failed and we were unable to recover it. 00:28:04.942 [2024-11-28 19:16:25.796545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.796635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.796659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.942 qpair failed and we were unable to recover it. 00:28:04.942 [2024-11-28 19:16:25.796744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.796855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.796880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.942 qpair failed and we were unable to recover it. 00:28:04.942 [2024-11-28 19:16:25.796961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.797034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.797058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.942 qpair failed and we were unable to recover it. 00:28:04.942 [2024-11-28 19:16:25.797144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.797216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.797240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.942 qpair failed and we were unable to recover it. 00:28:04.942 [2024-11-28 19:16:25.797324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.797433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.797458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.942 qpair failed and we were unable to recover it. 00:28:04.942 [2024-11-28 19:16:25.797536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.797653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.797678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.942 qpair failed and we were unable to recover it. 00:28:04.942 [2024-11-28 19:16:25.797771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.797847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.797872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.942 qpair failed and we were unable to recover it. 00:28:04.942 [2024-11-28 19:16:25.797950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.798027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.798052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.942 qpair failed and we were unable to recover it. 00:28:04.942 [2024-11-28 19:16:25.798132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.798206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.798231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.942 qpair failed and we were unable to recover it. 00:28:04.942 [2024-11-28 19:16:25.798315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.798424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.798449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.942 qpair failed and we were unable to recover it. 00:28:04.942 [2024-11-28 19:16:25.798536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.798620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.798644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.942 qpair failed and we were unable to recover it. 00:28:04.942 [2024-11-28 19:16:25.798762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.798866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.798889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.942 qpair failed and we were unable to recover it. 00:28:04.942 [2024-11-28 19:16:25.798968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.799074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.799098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.942 qpair failed and we were unable to recover it. 00:28:04.942 [2024-11-28 19:16:25.799179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.799296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.799320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.942 qpair failed and we were unable to recover it. 00:28:04.942 [2024-11-28 19:16:25.799439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.799516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.799540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.942 qpair failed and we were unable to recover it. 00:28:04.942 [2024-11-28 19:16:25.799629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.799735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.942 [2024-11-28 19:16:25.799765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.942 qpair failed and we were unable to recover it. 00:28:04.943 [2024-11-28 19:16:25.799861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.799938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.799963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.943 qpair failed and we were unable to recover it. 00:28:04.943 [2024-11-28 19:16:25.800070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.800146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.800170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.943 qpair failed and we were unable to recover it. 00:28:04.943 [2024-11-28 19:16:25.800256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.800364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.800388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.943 qpair failed and we were unable to recover it. 00:28:04.943 [2024-11-28 19:16:25.800483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.800558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.800582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.943 qpair failed and we were unable to recover it. 00:28:04.943 [2024-11-28 19:16:25.800691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.800763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.800789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.943 qpair failed and we were unable to recover it. 00:28:04.943 [2024-11-28 19:16:25.800925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.801006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.801031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.943 qpair failed and we were unable to recover it. 00:28:04.943 [2024-11-28 19:16:25.801107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.801187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.801213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.943 qpair failed and we were unable to recover it. 00:28:04.943 [2024-11-28 19:16:25.801293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.801372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.801402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.943 qpair failed and we were unable to recover it. 00:28:04.943 [2024-11-28 19:16:25.801519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.801593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.801618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.943 qpair failed and we were unable to recover it. 00:28:04.943 [2024-11-28 19:16:25.801758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.801844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.801874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.943 qpair failed and we were unable to recover it. 00:28:04.943 [2024-11-28 19:16:25.801956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.802035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.802060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.943 qpair failed and we were unable to recover it. 00:28:04.943 [2024-11-28 19:16:25.802148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.802222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.802247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.943 qpair failed and we were unable to recover it. 00:28:04.943 [2024-11-28 19:16:25.802328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.802411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.802436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.943 qpair failed and we were unable to recover it. 00:28:04.943 [2024-11-28 19:16:25.802513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.802620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.802645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.943 qpair failed and we were unable to recover it. 00:28:04.943 [2024-11-28 19:16:25.802721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.802793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.802817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.943 qpair failed and we were unable to recover it. 00:28:04.943 [2024-11-28 19:16:25.802903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.803021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.803045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.943 qpair failed and we were unable to recover it. 00:28:04.943 [2024-11-28 19:16:25.803124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.803227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.803251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.943 qpair failed and we were unable to recover it. 00:28:04.943 [2024-11-28 19:16:25.803326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.803404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.803430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.943 qpair failed and we were unable to recover it. 00:28:04.943 [2024-11-28 19:16:25.803539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.803621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.803645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.943 qpair failed and we were unable to recover it. 00:28:04.943 [2024-11-28 19:16:25.803724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.803800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.803824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.943 qpair failed and we were unable to recover it. 00:28:04.943 [2024-11-28 19:16:25.803929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.804003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.804027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.943 qpair failed and we were unable to recover it. 00:28:04.943 [2024-11-28 19:16:25.804136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.804210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.804236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.943 qpair failed and we were unable to recover it. 00:28:04.943 [2024-11-28 19:16:25.804310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.804398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.804423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.943 qpair failed and we were unable to recover it. 00:28:04.943 [2024-11-28 19:16:25.804506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.804582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.804606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.943 qpair failed and we were unable to recover it. 00:28:04.943 [2024-11-28 19:16:25.804715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.804793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.804818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.943 qpair failed and we were unable to recover it. 00:28:04.943 [2024-11-28 19:16:25.804894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.804991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.805016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.943 qpair failed and we were unable to recover it. 00:28:04.943 [2024-11-28 19:16:25.805122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.805194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.805218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.943 qpair failed and we were unable to recover it. 00:28:04.943 [2024-11-28 19:16:25.805302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.805384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.805413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.943 qpair failed and we were unable to recover it. 00:28:04.943 [2024-11-28 19:16:25.805498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.805579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.943 [2024-11-28 19:16:25.805605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.943 qpair failed and we were unable to recover it. 00:28:04.944 [2024-11-28 19:16:25.805722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.805798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.805823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.944 qpair failed and we were unable to recover it. 00:28:04.944 [2024-11-28 19:16:25.805907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.806013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.806038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.944 qpair failed and we were unable to recover it. 00:28:04.944 [2024-11-28 19:16:25.806116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.806200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.806224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.944 qpair failed and we were unable to recover it. 00:28:04.944 [2024-11-28 19:16:25.806304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.806387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.806438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.944 qpair failed and we were unable to recover it. 00:28:04.944 [2024-11-28 19:16:25.806512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.806596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.806621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.944 qpair failed and we were unable to recover it. 00:28:04.944 [2024-11-28 19:16:25.806700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.806776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.806801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.944 qpair failed and we were unable to recover it. 00:28:04.944 [2024-11-28 19:16:25.806908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.807043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.807067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.944 qpair failed and we were unable to recover it. 00:28:04.944 [2024-11-28 19:16:25.807175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.807251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.807276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.944 qpair failed and we were unable to recover it. 00:28:04.944 [2024-11-28 19:16:25.807362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.807478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.807502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.944 qpair failed and we were unable to recover it. 00:28:04.944 [2024-11-28 19:16:25.807613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.807720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.807744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.944 qpair failed and we were unable to recover it. 00:28:04.944 [2024-11-28 19:16:25.807874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.807953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.807977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.944 qpair failed and we were unable to recover it. 00:28:04.944 [2024-11-28 19:16:25.808055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.808140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.808165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.944 qpair failed and we were unable to recover it. 00:28:04.944 [2024-11-28 19:16:25.808311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.808391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.808423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.944 qpair failed and we were unable to recover it. 00:28:04.944 [2024-11-28 19:16:25.808507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.808583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.808608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.944 qpair failed and we were unable to recover it. 00:28:04.944 [2024-11-28 19:16:25.808717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.808830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.808856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.944 qpair failed and we were unable to recover it. 00:28:04.944 [2024-11-28 19:16:25.808965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.809049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.809075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.944 qpair failed and we were unable to recover it. 00:28:04.944 [2024-11-28 19:16:25.809165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.809247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.809271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.944 qpair failed and we were unable to recover it. 00:28:04.944 [2024-11-28 19:16:25.809376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.809461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.809486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.944 qpair failed and we were unable to recover it. 00:28:04.944 [2024-11-28 19:16:25.809575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.809646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.809670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.944 qpair failed and we were unable to recover it. 00:28:04.944 [2024-11-28 19:16:25.809757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.809843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.809869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.944 qpair failed and we were unable to recover it. 00:28:04.944 [2024-11-28 19:16:25.809947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.810020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.810044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.944 qpair failed and we were unable to recover it. 00:28:04.944 [2024-11-28 19:16:25.810122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.810202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.810226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.944 qpair failed and we were unable to recover it. 00:28:04.944 [2024-11-28 19:16:25.810303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.810414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.810439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.944 qpair failed and we were unable to recover it. 00:28:04.944 [2024-11-28 19:16:25.810523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.810603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.810629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.944 qpair failed and we were unable to recover it. 00:28:04.944 [2024-11-28 19:16:25.810708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.810786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.810810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.944 qpair failed and we were unable to recover it. 00:28:04.944 [2024-11-28 19:16:25.810917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.811028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.944 [2024-11-28 19:16:25.811052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.944 qpair failed and we were unable to recover it. 00:28:04.945 [2024-11-28 19:16:25.811132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.811209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.811234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.945 qpair failed and we were unable to recover it. 00:28:04.945 [2024-11-28 19:16:25.811324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.811428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.811453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.945 qpair failed and we were unable to recover it. 00:28:04.945 [2024-11-28 19:16:25.811528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.811613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.811638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.945 qpair failed and we were unable to recover it. 00:28:04.945 [2024-11-28 19:16:25.811726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.811806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.811831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.945 qpair failed and we were unable to recover it. 00:28:04.945 [2024-11-28 19:16:25.811946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.812021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.812045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.945 qpair failed and we were unable to recover it. 00:28:04.945 [2024-11-28 19:16:25.812124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.812240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.812269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.945 qpair failed and we were unable to recover it. 00:28:04.945 [2024-11-28 19:16:25.812386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.812509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.812533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.945 qpair failed and we were unable to recover it. 00:28:04.945 [2024-11-28 19:16:25.812612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.812691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.812714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.945 qpair failed and we were unable to recover it. 00:28:04.945 [2024-11-28 19:16:25.812796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.812899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.812924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.945 qpair failed and we were unable to recover it. 00:28:04.945 [2024-11-28 19:16:25.813007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.813085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.813109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.945 qpair failed and we were unable to recover it. 00:28:04.945 [2024-11-28 19:16:25.813189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.813266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.813290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.945 qpair failed and we were unable to recover it. 00:28:04.945 [2024-11-28 19:16:25.813398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.813513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.813537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.945 qpair failed and we were unable to recover it. 00:28:04.945 [2024-11-28 19:16:25.813649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.813756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.813780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.945 qpair failed and we were unable to recover it. 00:28:04.945 [2024-11-28 19:16:25.813885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.813990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.814015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.945 qpair failed and we were unable to recover it. 00:28:04.945 [2024-11-28 19:16:25.814102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.814176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.814202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.945 qpair failed and we were unable to recover it. 00:28:04.945 [2024-11-28 19:16:25.814285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.814362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.814387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.945 qpair failed and we were unable to recover it. 00:28:04.945 [2024-11-28 19:16:25.814520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.814626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.814650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.945 qpair failed and we were unable to recover it. 00:28:04.945 [2024-11-28 19:16:25.814723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.814838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.814862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.945 qpair failed and we were unable to recover it. 00:28:04.945 [2024-11-28 19:16:25.814944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.815023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.815047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.945 qpair failed and we were unable to recover it. 00:28:04.945 [2024-11-28 19:16:25.815130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.815239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.815264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.945 qpair failed and we were unable to recover it. 00:28:04.945 [2024-11-28 19:16:25.815344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.815425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.815450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.945 qpair failed and we were unable to recover it. 00:28:04.945 [2024-11-28 19:16:25.815526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.815639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.815663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.945 qpair failed and we were unable to recover it. 00:28:04.945 [2024-11-28 19:16:25.815741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.815846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.815871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.945 qpair failed and we were unable to recover it. 00:28:04.945 [2024-11-28 19:16:25.815953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.816061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.816085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.945 qpair failed and we were unable to recover it. 00:28:04.945 [2024-11-28 19:16:25.816164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.816272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.816297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.945 qpair failed and we were unable to recover it. 00:28:04.945 [2024-11-28 19:16:25.816376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.816461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.816488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.945 qpair failed and we were unable to recover it. 00:28:04.945 [2024-11-28 19:16:25.816578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.816687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.816712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.945 qpair failed and we were unable to recover it. 00:28:04.945 [2024-11-28 19:16:25.816798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.816872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.816895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.945 qpair failed and we were unable to recover it. 00:28:04.945 [2024-11-28 19:16:25.816977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.817082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.945 [2024-11-28 19:16:25.817107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.945 qpair failed and we were unable to recover it. 00:28:04.946 [2024-11-28 19:16:25.817188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.817263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.817288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.946 qpair failed and we were unable to recover it. 00:28:04.946 [2024-11-28 19:16:25.817398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.817505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.817529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.946 qpair failed and we were unable to recover it. 00:28:04.946 [2024-11-28 19:16:25.817621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.817694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.817718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.946 qpair failed and we were unable to recover it. 00:28:04.946 [2024-11-28 19:16:25.817796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.817878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.817904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.946 qpair failed and we were unable to recover it. 00:28:04.946 [2024-11-28 19:16:25.817980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.818059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.818085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.946 qpair failed and we were unable to recover it. 00:28:04.946 [2024-11-28 19:16:25.818232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.818318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.818343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.946 qpair failed and we were unable to recover it. 00:28:04.946 [2024-11-28 19:16:25.818425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.818563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.818587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.946 qpair failed and we were unable to recover it. 00:28:04.946 [2024-11-28 19:16:25.818667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.818749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.818774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.946 qpair failed and we were unable to recover it. 00:28:04.946 [2024-11-28 19:16:25.818914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.818999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.819023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.946 qpair failed and we were unable to recover it. 00:28:04.946 [2024-11-28 19:16:25.819102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.819176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.819200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.946 qpair failed and we were unable to recover it. 00:28:04.946 [2024-11-28 19:16:25.819279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.819391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.819423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.946 qpair failed and we were unable to recover it. 00:28:04.946 [2024-11-28 19:16:25.819534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.819616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.819640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.946 qpair failed and we were unable to recover it. 00:28:04.946 [2024-11-28 19:16:25.819719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.819825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.819849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.946 qpair failed and we were unable to recover it. 00:28:04.946 [2024-11-28 19:16:25.819959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.820034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.820059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.946 qpair failed and we were unable to recover it. 00:28:04.946 [2024-11-28 19:16:25.820148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.820224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.820248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.946 qpair failed and we were unable to recover it. 00:28:04.946 [2024-11-28 19:16:25.820327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.820404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.820430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.946 qpair failed and we were unable to recover it. 00:28:04.946 [2024-11-28 19:16:25.820516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.820596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.820620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.946 qpair failed and we were unable to recover it. 00:28:04.946 [2024-11-28 19:16:25.820709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.820824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.820850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.946 qpair failed and we were unable to recover it. 00:28:04.946 [2024-11-28 19:16:25.820930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.821008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.821034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.946 qpair failed and we were unable to recover it. 00:28:04.946 [2024-11-28 19:16:25.821148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.821251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.821276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.946 qpair failed and we were unable to recover it. 00:28:04.946 [2024-11-28 19:16:25.821388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.821473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.821497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.946 qpair failed and we were unable to recover it. 00:28:04.946 [2024-11-28 19:16:25.821576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.821654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.821678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.946 qpair failed and we were unable to recover it. 00:28:04.946 [2024-11-28 19:16:25.821767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.821879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.821904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.946 qpair failed and we were unable to recover it. 00:28:04.946 [2024-11-28 19:16:25.822004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.822094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.822120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.946 qpair failed and we were unable to recover it. 00:28:04.946 [2024-11-28 19:16:25.822205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.822279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.822303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.946 qpair failed and we were unable to recover it. 00:28:04.946 [2024-11-28 19:16:25.822423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.822497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.822521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.946 qpair failed and we were unable to recover it. 00:28:04.946 [2024-11-28 19:16:25.822629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.822737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.822762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.946 qpair failed and we were unable to recover it. 00:28:04.946 [2024-11-28 19:16:25.822846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.822925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.822954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.946 qpair failed and we were unable to recover it. 00:28:04.946 [2024-11-28 19:16:25.823052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.823158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.823182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.946 qpair failed and we were unable to recover it. 00:28:04.946 [2024-11-28 19:16:25.823317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.823400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.823425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.946 qpair failed and we were unable to recover it. 00:28:04.946 [2024-11-28 19:16:25.823543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.946 [2024-11-28 19:16:25.823623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.823649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.947 qpair failed and we were unable to recover it. 00:28:04.947 [2024-11-28 19:16:25.823730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.823804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.823829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.947 qpair failed and we were unable to recover it. 00:28:04.947 [2024-11-28 19:16:25.823909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.823989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.824015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.947 qpair failed and we were unable to recover it. 00:28:04.947 [2024-11-28 19:16:25.824097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.824178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.824203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.947 qpair failed and we were unable to recover it. 00:28:04.947 [2024-11-28 19:16:25.824283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.824362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.824388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.947 qpair failed and we were unable to recover it. 00:28:04.947 [2024-11-28 19:16:25.824474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.824547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.824571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.947 qpair failed and we were unable to recover it. 00:28:04.947 [2024-11-28 19:16:25.824650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.824743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.824768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.947 qpair failed and we were unable to recover it. 00:28:04.947 [2024-11-28 19:16:25.824858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.824942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.824967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.947 qpair failed and we were unable to recover it. 00:28:04.947 [2024-11-28 19:16:25.825049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.825149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.825174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.947 qpair failed and we were unable to recover it. 00:28:04.947 [2024-11-28 19:16:25.825255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.825335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.825361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.947 qpair failed and we were unable to recover it. 00:28:04.947 [2024-11-28 19:16:25.825447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.825563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.825589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.947 qpair failed and we were unable to recover it. 00:28:04.947 [2024-11-28 19:16:25.825670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.825742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.825767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.947 qpair failed and we were unable to recover it. 00:28:04.947 [2024-11-28 19:16:25.825841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.825953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.825977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.947 qpair failed and we were unable to recover it. 00:28:04.947 [2024-11-28 19:16:25.826081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.826157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.826181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.947 qpair failed and we were unable to recover it. 00:28:04.947 [2024-11-28 19:16:25.826259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.826339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.826363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.947 qpair failed and we were unable to recover it. 00:28:04.947 [2024-11-28 19:16:25.826456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.826537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.826563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.947 qpair failed and we were unable to recover it. 00:28:04.947 [2024-11-28 19:16:25.826683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.826760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.826785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.947 qpair failed and we were unable to recover it. 00:28:04.947 [2024-11-28 19:16:25.826905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.826981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.827005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.947 qpair failed and we were unable to recover it. 00:28:04.947 [2024-11-28 19:16:25.827082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.827187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.827212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.947 qpair failed and we were unable to recover it. 00:28:04.947 [2024-11-28 19:16:25.827292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.827371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.827402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.947 qpair failed and we were unable to recover it. 00:28:04.947 [2024-11-28 19:16:25.827509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.827583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.827607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.947 qpair failed and we were unable to recover it. 00:28:04.947 [2024-11-28 19:16:25.827687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.827763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.827787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.947 qpair failed and we were unable to recover it. 00:28:04.947 [2024-11-28 19:16:25.827915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.828022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.828046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.947 qpair failed and we were unable to recover it. 00:28:04.947 [2024-11-28 19:16:25.828188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.828264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.828289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.947 qpair failed and we were unable to recover it. 00:28:04.947 [2024-11-28 19:16:25.828409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.828488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.828513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.947 qpair failed and we were unable to recover it. 00:28:04.947 [2024-11-28 19:16:25.828603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.828712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.828737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.947 qpair failed and we were unable to recover it. 00:28:04.947 [2024-11-28 19:16:25.828818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.828900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.828924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.947 qpair failed and we were unable to recover it. 00:28:04.947 [2024-11-28 19:16:25.829001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.829078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.829102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.947 qpair failed and we were unable to recover it. 00:28:04.947 [2024-11-28 19:16:25.829186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.829295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.829320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.947 qpair failed and we were unable to recover it. 00:28:04.947 [2024-11-28 19:16:25.829404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.829510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.829534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.947 qpair failed and we were unable to recover it. 00:28:04.947 [2024-11-28 19:16:25.829627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.829701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.829724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.947 qpair failed and we were unable to recover it. 00:28:04.947 [2024-11-28 19:16:25.829800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.829877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.947 [2024-11-28 19:16:25.829901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.947 qpair failed and we were unable to recover it. 00:28:04.948 [2024-11-28 19:16:25.830016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.830125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.830150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.948 qpair failed and we were unable to recover it. 00:28:04.948 [2024-11-28 19:16:25.830228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.830312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.830336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.948 qpair failed and we were unable to recover it. 00:28:04.948 [2024-11-28 19:16:25.830423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.830511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.830536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.948 qpair failed and we were unable to recover it. 00:28:04.948 [2024-11-28 19:16:25.830653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.830729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.830753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.948 qpair failed and we were unable to recover it. 00:28:04.948 [2024-11-28 19:16:25.830837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.830914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.830939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.948 qpair failed and we were unable to recover it. 00:28:04.948 [2024-11-28 19:16:25.831018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.831101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.831125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.948 qpair failed and we were unable to recover it. 00:28:04.948 [2024-11-28 19:16:25.831253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.831337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.831361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.948 qpair failed and we were unable to recover it. 00:28:04.948 [2024-11-28 19:16:25.831450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.831566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.831590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.948 qpair failed and we were unable to recover it. 00:28:04.948 [2024-11-28 19:16:25.831670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.831749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.831773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.948 qpair failed and we were unable to recover it. 00:28:04.948 [2024-11-28 19:16:25.831859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.831934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.831958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.948 qpair failed and we were unable to recover it. 00:28:04.948 [2024-11-28 19:16:25.832068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.832155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.832180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.948 qpair failed and we were unable to recover it. 00:28:04.948 [2024-11-28 19:16:25.832295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.832373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.832404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.948 qpair failed and we were unable to recover it. 00:28:04.948 [2024-11-28 19:16:25.832493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.832606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.832630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.948 qpair failed and we were unable to recover it. 00:28:04.948 [2024-11-28 19:16:25.832709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.832818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.832842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.948 qpair failed and we were unable to recover it. 00:28:04.948 [2024-11-28 19:16:25.832926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.833043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.833068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.948 qpair failed and we were unable to recover it. 00:28:04.948 [2024-11-28 19:16:25.833151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.833228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.833252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.948 qpair failed and we were unable to recover it. 00:28:04.948 [2024-11-28 19:16:25.833336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.833451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.833481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.948 qpair failed and we were unable to recover it. 00:28:04.948 [2024-11-28 19:16:25.833567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.833650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.833675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.948 qpair failed and we were unable to recover it. 00:28:04.948 [2024-11-28 19:16:25.833754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.833826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.833850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.948 qpair failed and we were unable to recover it. 00:28:04.948 [2024-11-28 19:16:25.833928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.834003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.834027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.948 qpair failed and we were unable to recover it. 00:28:04.948 [2024-11-28 19:16:25.834101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.834181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.834206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.948 qpair failed and we were unable to recover it. 00:28:04.948 [2024-11-28 19:16:25.834283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.834369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.834406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.948 qpair failed and we were unable to recover it. 00:28:04.948 [2024-11-28 19:16:25.834506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.834643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.834666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.948 qpair failed and we were unable to recover it. 00:28:04.948 [2024-11-28 19:16:25.834776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.834849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.834873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.948 qpair failed and we were unable to recover it. 00:28:04.948 [2024-11-28 19:16:25.834951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.835039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.835063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.948 qpair failed and we were unable to recover it. 00:28:04.948 [2024-11-28 19:16:25.835151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.835233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.835259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.948 qpair failed and we were unable to recover it. 00:28:04.948 [2024-11-28 19:16:25.835374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.835463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.835489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.948 qpair failed and we were unable to recover it. 00:28:04.948 [2024-11-28 19:16:25.835573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.835655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.835679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.948 qpair failed and we were unable to recover it. 00:28:04.948 [2024-11-28 19:16:25.835760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.835878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.835902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.948 qpair failed and we were unable to recover it. 00:28:04.948 [2024-11-28 19:16:25.835990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.836075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.836098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.948 qpair failed and we were unable to recover it. 00:28:04.948 [2024-11-28 19:16:25.836184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.836269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.948 [2024-11-28 19:16:25.836294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.948 qpair failed and we were unable to recover it. 00:28:04.948 [2024-11-28 19:16:25.836371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.836461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.836485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.949 qpair failed and we were unable to recover it. 00:28:04.949 [2024-11-28 19:16:25.836601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.836673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.836697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.949 qpair failed and we were unable to recover it. 00:28:04.949 [2024-11-28 19:16:25.836803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.836880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.836904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.949 qpair failed and we were unable to recover it. 00:28:04.949 [2024-11-28 19:16:25.837019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.837102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.837126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.949 qpair failed and we were unable to recover it. 00:28:04.949 [2024-11-28 19:16:25.837240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.837356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.837381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.949 qpair failed and we were unable to recover it. 00:28:04.949 [2024-11-28 19:16:25.837475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.837582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.837607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.949 qpair failed and we were unable to recover it. 00:28:04.949 [2024-11-28 19:16:25.837696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.837805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.837829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.949 qpair failed and we were unable to recover it. 00:28:04.949 [2024-11-28 19:16:25.837913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.837995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.838019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.949 qpair failed and we were unable to recover it. 00:28:04.949 [2024-11-28 19:16:25.838105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.838237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.838261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.949 qpair failed and we were unable to recover it. 00:28:04.949 [2024-11-28 19:16:25.838340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.838421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.838445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.949 qpair failed and we were unable to recover it. 00:28:04.949 [2024-11-28 19:16:25.838552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.838660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.838685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.949 qpair failed and we were unable to recover it. 00:28:04.949 [2024-11-28 19:16:25.838771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.838843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.838867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.949 qpair failed and we were unable to recover it. 00:28:04.949 [2024-11-28 19:16:25.838950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.839026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.839050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.949 qpair failed and we were unable to recover it. 00:28:04.949 [2024-11-28 19:16:25.839137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.839213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.839237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.949 qpair failed and we were unable to recover it. 00:28:04.949 [2024-11-28 19:16:25.839313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.839386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.839442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.949 qpair failed and we were unable to recover it. 00:28:04.949 [2024-11-28 19:16:25.839532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.839609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.839634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.949 qpair failed and we were unable to recover it. 00:28:04.949 [2024-11-28 19:16:25.839723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.839805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.839830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.949 qpair failed and we were unable to recover it. 00:28:04.949 [2024-11-28 19:16:25.839919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.840006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.840029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.949 qpair failed and we were unable to recover it. 00:28:04.949 [2024-11-28 19:16:25.840111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.840188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.840213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.949 qpair failed and we were unable to recover it. 00:28:04.949 [2024-11-28 19:16:25.840292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.840375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.840403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.949 qpair failed and we were unable to recover it. 00:28:04.949 [2024-11-28 19:16:25.840514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.840593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.840618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.949 qpair failed and we were unable to recover it. 00:28:04.949 [2024-11-28 19:16:25.840707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.840792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.949 [2024-11-28 19:16:25.840816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.950 qpair failed and we were unable to recover it. 00:28:04.950 [2024-11-28 19:16:25.840898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.840986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.841011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.950 qpair failed and we were unable to recover it. 00:28:04.950 [2024-11-28 19:16:25.841128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.841216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.841241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.950 qpair failed and we were unable to recover it. 00:28:04.950 [2024-11-28 19:16:25.841331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.841414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.841438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.950 qpair failed and we were unable to recover it. 00:28:04.950 [2024-11-28 19:16:25.841550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.841639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.841665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.950 qpair failed and we were unable to recover it. 00:28:04.950 [2024-11-28 19:16:25.841746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.841827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.841851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.950 qpair failed and we were unable to recover it. 00:28:04.950 [2024-11-28 19:16:25.841930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.842013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.842038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.950 qpair failed and we were unable to recover it. 00:28:04.950 [2024-11-28 19:16:25.842153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.842233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.842257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.950 qpair failed and we were unable to recover it. 00:28:04.950 [2024-11-28 19:16:25.842340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.842420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.842445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.950 qpair failed and we were unable to recover it. 00:28:04.950 [2024-11-28 19:16:25.842525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.842600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.842624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.950 qpair failed and we were unable to recover it. 00:28:04.950 [2024-11-28 19:16:25.842701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.842774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.842798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.950 qpair failed and we were unable to recover it. 00:28:04.950 [2024-11-28 19:16:25.842878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.842961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.842985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.950 qpair failed and we were unable to recover it. 00:28:04.950 [2024-11-28 19:16:25.843071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.843176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.843201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.950 qpair failed and we were unable to recover it. 00:28:04.950 [2024-11-28 19:16:25.843280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.843359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.843383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.950 qpair failed and we were unable to recover it. 00:28:04.950 [2024-11-28 19:16:25.843468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.843542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.843566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.950 qpair failed and we were unable to recover it. 00:28:04.950 [2024-11-28 19:16:25.843641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.843714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.843741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.950 qpair failed and we were unable to recover it. 00:28:04.950 [2024-11-28 19:16:25.843829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.843912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.843937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.950 qpair failed and we were unable to recover it. 00:28:04.950 [2024-11-28 19:16:25.844012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.844150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.844174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.950 qpair failed and we were unable to recover it. 00:28:04.950 [2024-11-28 19:16:25.844256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.844333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.844358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.950 qpair failed and we were unable to recover it. 00:28:04.950 [2024-11-28 19:16:25.844438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.844520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.844545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.950 qpair failed and we were unable to recover it. 00:28:04.950 [2024-11-28 19:16:25.844626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.844731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.844755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.950 qpair failed and we were unable to recover it. 00:28:04.950 [2024-11-28 19:16:25.844836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.844912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.844936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.950 qpair failed and we were unable to recover it. 00:28:04.950 [2024-11-28 19:16:25.845019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.845123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.845148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.950 qpair failed and we were unable to recover it. 00:28:04.950 [2024-11-28 19:16:25.845229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.845315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.845339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.950 qpair failed and we were unable to recover it. 00:28:04.950 [2024-11-28 19:16:25.845421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.845496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.845520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.950 qpair failed and we were unable to recover it. 00:28:04.950 [2024-11-28 19:16:25.845594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.845671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.845699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.950 qpair failed and we were unable to recover it. 00:28:04.950 [2024-11-28 19:16:25.845808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.845884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.845909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.950 qpair failed and we were unable to recover it. 00:28:04.950 [2024-11-28 19:16:25.846016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.846095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.846120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.950 qpair failed and we were unable to recover it. 00:28:04.950 [2024-11-28 19:16:25.846230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.950 [2024-11-28 19:16:25.846309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.846333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.951 qpair failed and we were unable to recover it. 00:28:04.951 [2024-11-28 19:16:25.846639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.846753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.846777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.951 qpair failed and we were unable to recover it. 00:28:04.951 [2024-11-28 19:16:25.846860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.846987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.847012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.951 qpair failed and we were unable to recover it. 00:28:04.951 [2024-11-28 19:16:25.847096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.847179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.847203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.951 qpair failed and we were unable to recover it. 00:28:04.951 [2024-11-28 19:16:25.847286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.847365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.847391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.951 qpair failed and we were unable to recover it. 00:28:04.951 [2024-11-28 19:16:25.847490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.847591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.847616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.951 qpair failed and we were unable to recover it. 00:28:04.951 [2024-11-28 19:16:25.847722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 19:16:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:04.951 [2024-11-28 19:16:25.847806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.847830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.951 qpair failed and we were unable to recover it. 00:28:04.951 19:16:25 -- common/autotest_common.sh@862 -- # return 0 00:28:04.951 [2024-11-28 19:16:25.847902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.847986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 19:16:25 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:04.951 [2024-11-28 19:16:25.848016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.951 qpair failed and we were unable to recover it. 00:28:04.951 19:16:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:04.951 [2024-11-28 19:16:25.848106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.848182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 19:16:25 -- common/autotest_common.sh@10 -- # set +x 00:28:04.951 [2024-11-28 19:16:25.848207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.951 qpair failed and we were unable to recover it. 00:28:04.951 [2024-11-28 19:16:25.848296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.848372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.848415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.951 qpair failed and we were unable to recover it. 00:28:04.951 [2024-11-28 19:16:25.848513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.848626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.848650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.951 qpair failed and we were unable to recover it. 00:28:04.951 [2024-11-28 19:16:25.848738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.848809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.848835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.951 qpair failed and we were unable to recover it. 00:28:04.951 [2024-11-28 19:16:25.848958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.849068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.849093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.951 qpair failed and we were unable to recover it. 00:28:04.951 [2024-11-28 19:16:25.849182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.849256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.849281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.951 qpair failed and we were unable to recover it. 00:28:04.951 [2024-11-28 19:16:25.849401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.849484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.849509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.951 qpair failed and we were unable to recover it. 00:28:04.951 [2024-11-28 19:16:25.849634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.849743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.849767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.951 qpair failed and we were unable to recover it. 00:28:04.951 [2024-11-28 19:16:25.849852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.849933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.849958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.951 qpair failed and we were unable to recover it. 00:28:04.951 [2024-11-28 19:16:25.850037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.850121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.850145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.951 qpair failed and we were unable to recover it. 00:28:04.951 [2024-11-28 19:16:25.850224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.850328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.850353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.951 qpair failed and we were unable to recover it. 00:28:04.951 [2024-11-28 19:16:25.850448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.850531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.850555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.951 qpair failed and we were unable to recover it. 00:28:04.951 [2024-11-28 19:16:25.850642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.850720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.850743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.951 qpair failed and we were unable to recover it. 00:28:04.951 [2024-11-28 19:16:25.850857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.850971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.850996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.951 qpair failed and we were unable to recover it. 00:28:04.951 [2024-11-28 19:16:25.851070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.851142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.851166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.951 qpair failed and we were unable to recover it. 00:28:04.951 [2024-11-28 19:16:25.851248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.851357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.851382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.951 qpair failed and we were unable to recover it. 00:28:04.951 [2024-11-28 19:16:25.851505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.851612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.851637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.951 qpair failed and we were unable to recover it. 00:28:04.951 [2024-11-28 19:16:25.851760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.851841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.851865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.951 qpair failed and we were unable to recover it. 00:28:04.951 [2024-11-28 19:16:25.851993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.852099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.852124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.951 qpair failed and we were unable to recover it. 00:28:04.951 [2024-11-28 19:16:25.852202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.852317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.852349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.951 qpair failed and we were unable to recover it. 00:28:04.951 [2024-11-28 19:16:25.852440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.951 [2024-11-28 19:16:25.852534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.852559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.952 qpair failed and we were unable to recover it. 00:28:04.952 [2024-11-28 19:16:25.852642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.852754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.852779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.952 qpair failed and we were unable to recover it. 00:28:04.952 [2024-11-28 19:16:25.852868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.852959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.852985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.952 qpair failed and we were unable to recover it. 00:28:04.952 [2024-11-28 19:16:25.853063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.853201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.853225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.952 qpair failed and we were unable to recover it. 00:28:04.952 [2024-11-28 19:16:25.853331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.853421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.853446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.952 qpair failed and we were unable to recover it. 00:28:04.952 [2024-11-28 19:16:25.853535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.853614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.853638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.952 qpair failed and we were unable to recover it. 00:28:04.952 [2024-11-28 19:16:25.853725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.853863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.853887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.952 qpair failed and we were unable to recover it. 00:28:04.952 [2024-11-28 19:16:25.853970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.854079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.854104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.952 qpair failed and we were unable to recover it. 00:28:04.952 [2024-11-28 19:16:25.854187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.854268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.854294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.952 qpair failed and we were unable to recover it. 00:28:04.952 [2024-11-28 19:16:25.854375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.854466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.854496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.952 qpair failed and we were unable to recover it. 00:28:04.952 [2024-11-28 19:16:25.854604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.854677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.854700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.952 qpair failed and we were unable to recover it. 00:28:04.952 [2024-11-28 19:16:25.854811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.854889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.854913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.952 qpair failed and we were unable to recover it. 00:28:04.952 [2024-11-28 19:16:25.855030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.855110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.855135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.952 qpair failed and we were unable to recover it. 00:28:04.952 [2024-11-28 19:16:25.855212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.855296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.855321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.952 qpair failed and we were unable to recover it. 00:28:04.952 [2024-11-28 19:16:25.855418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.855525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.855550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.952 qpair failed and we were unable to recover it. 00:28:04.952 [2024-11-28 19:16:25.855659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.855740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.855764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.952 qpair failed and we were unable to recover it. 00:28:04.952 [2024-11-28 19:16:25.855848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.855935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.855965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.952 qpair failed and we were unable to recover it. 00:28:04.952 [2024-11-28 19:16:25.856041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.856148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.856172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.952 qpair failed and we were unable to recover it. 00:28:04.952 [2024-11-28 19:16:25.856264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.856373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.856407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.952 qpair failed and we were unable to recover it. 00:28:04.952 [2024-11-28 19:16:25.856489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.856594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.856620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.952 qpair failed and we were unable to recover it. 00:28:04.952 [2024-11-28 19:16:25.856716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.856841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.856866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.952 qpair failed and we were unable to recover it. 00:28:04.952 [2024-11-28 19:16:25.856973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.857051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.857075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.952 qpair failed and we were unable to recover it. 00:28:04.952 [2024-11-28 19:16:25.857189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.857273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.857297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.952 qpair failed and we were unable to recover it. 00:28:04.952 [2024-11-28 19:16:25.857407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.857487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.857512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.952 qpair failed and we were unable to recover it. 00:28:04.952 [2024-11-28 19:16:25.857601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.857717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.857741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.952 qpair failed and we were unable to recover it. 00:28:04.952 [2024-11-28 19:16:25.857823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.857923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.857947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.952 qpair failed and we were unable to recover it. 00:28:04.952 [2024-11-28 19:16:25.858025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.858104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.858129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.952 qpair failed and we were unable to recover it. 00:28:04.952 [2024-11-28 19:16:25.858207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.858289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.858315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.952 qpair failed and we were unable to recover it. 00:28:04.952 [2024-11-28 19:16:25.858456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.858532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.858557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.952 qpair failed and we were unable to recover it. 00:28:04.952 [2024-11-28 19:16:25.858639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.952 [2024-11-28 19:16:25.858756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.858780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.953 qpair failed and we were unable to recover it. 00:28:04.953 [2024-11-28 19:16:25.858900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.858998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.859023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.953 qpair failed and we were unable to recover it. 00:28:04.953 [2024-11-28 19:16:25.859111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.859218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.859242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.953 qpair failed and we were unable to recover it. 00:28:04.953 [2024-11-28 19:16:25.859325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.859425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.859451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.953 qpair failed and we were unable to recover it. 00:28:04.953 [2024-11-28 19:16:25.859537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.859651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.859684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.953 qpair failed and we were unable to recover it. 00:28:04.953 [2024-11-28 19:16:25.859780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.859873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.859899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.953 qpair failed and we were unable to recover it. 00:28:04.953 [2024-11-28 19:16:25.860007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.860114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.860139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.953 qpair failed and we were unable to recover it. 00:28:04.953 [2024-11-28 19:16:25.860219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.860299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.860324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.953 qpair failed and we were unable to recover it. 00:28:04.953 [2024-11-28 19:16:25.860422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.860504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.860529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.953 qpair failed and we were unable to recover it. 00:28:04.953 [2024-11-28 19:16:25.860618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.860763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.860787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.953 qpair failed and we were unable to recover it. 00:28:04.953 [2024-11-28 19:16:25.860868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.860952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.860977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.953 qpair failed and we were unable to recover it. 00:28:04.953 [2024-11-28 19:16:25.861055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.861151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.861176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.953 qpair failed and we were unable to recover it. 00:28:04.953 [2024-11-28 19:16:25.861252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.861360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.861384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.953 qpair failed and we were unable to recover it. 00:28:04.953 [2024-11-28 19:16:25.861481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.861570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.861594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.953 qpair failed and we were unable to recover it. 00:28:04.953 [2024-11-28 19:16:25.861672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.861788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.861812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.953 qpair failed and we were unable to recover it. 00:28:04.953 [2024-11-28 19:16:25.861900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.861979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.862005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.953 qpair failed and we were unable to recover it. 00:28:04.953 [2024-11-28 19:16:25.862096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.862202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.862228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.953 qpair failed and we were unable to recover it. 00:28:04.953 [2024-11-28 19:16:25.862344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.862435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.862460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.953 qpair failed and we were unable to recover it. 00:28:04.953 [2024-11-28 19:16:25.862539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.862613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.862637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.953 qpair failed and we were unable to recover it. 00:28:04.953 [2024-11-28 19:16:25.862798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.862911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.862935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.953 qpair failed and we were unable to recover it. 00:28:04.953 [2024-11-28 19:16:25.863018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.863106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.863131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.953 qpair failed and we were unable to recover it. 00:28:04.953 [2024-11-28 19:16:25.863239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.863320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.863345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.953 qpair failed and we were unable to recover it. 00:28:04.953 [2024-11-28 19:16:25.863468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.863546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.863571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.953 qpair failed and we were unable to recover it. 00:28:04.953 [2024-11-28 19:16:25.863655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.863766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.863790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.953 qpair failed and we were unable to recover it. 00:28:04.953 [2024-11-28 19:16:25.863903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.864028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.864053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.953 qpair failed and we were unable to recover it. 00:28:04.953 [2024-11-28 19:16:25.864128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.864266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.953 [2024-11-28 19:16:25.864290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.954 qpair failed and we were unable to recover it. 00:28:04.954 [2024-11-28 19:16:25.864367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.864449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.864475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.954 qpair failed and we were unable to recover it. 00:28:04.954 [2024-11-28 19:16:25.864585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.864661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.864685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.954 qpair failed and we were unable to recover it. 00:28:04.954 [2024-11-28 19:16:25.864797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.864878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.864902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.954 qpair failed and we were unable to recover it. 00:28:04.954 [2024-11-28 19:16:25.865002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.865090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.865114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.954 qpair failed and we were unable to recover it. 00:28:04.954 [2024-11-28 19:16:25.865191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.865283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.865307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.954 qpair failed and we were unable to recover it. 00:28:04.954 [2024-11-28 19:16:25.865420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.865509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.865538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.954 qpair failed and we were unable to recover it. 00:28:04.954 19:16:25 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:04.954 [2024-11-28 19:16:25.865619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.865700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.865726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 wit 19:16:25 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:28:04.954 h addr=10.0.0.2, port=4420 00:28:04.954 qpair failed and we were unable to recover it. 00:28:04.954 19:16:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:04.954 [2024-11-28 19:16:25.865869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 19:16:25 -- common/autotest_common.sh@10 -- # set +x 00:28:04.954 [2024-11-28 19:16:25.865942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.865968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.954 qpair failed and we were unable to recover it. 00:28:04.954 [2024-11-28 19:16:25.866081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.866193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.866218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.954 qpair failed and we were unable to recover it. 00:28:04.954 [2024-11-28 19:16:25.866305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.866440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.866466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.954 qpair failed and we were unable to recover it. 00:28:04.954 [2024-11-28 19:16:25.866578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.866658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.866682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.954 qpair failed and we were unable to recover it. 00:28:04.954 [2024-11-28 19:16:25.866759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.866887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.866912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.954 qpair failed and we were unable to recover it. 00:28:04.954 [2024-11-28 19:16:25.867000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.867077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.867101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.954 qpair failed and we were unable to recover it. 00:28:04.954 [2024-11-28 19:16:25.867182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.867258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.867282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.954 qpair failed and we were unable to recover it. 00:28:04.954 [2024-11-28 19:16:25.867389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.867470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.867496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.954 qpair failed and we were unable to recover it. 00:28:04.954 [2024-11-28 19:16:25.867585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.867696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.867722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.954 qpair failed and we were unable to recover it. 00:28:04.954 [2024-11-28 19:16:25.867800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.867881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.867905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.954 qpair failed and we were unable to recover it. 00:28:04.954 [2024-11-28 19:16:25.867986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.868058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.868081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.954 qpair failed and we were unable to recover it. 00:28:04.954 [2024-11-28 19:16:25.868194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.868301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.868327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.954 qpair failed and we were unable to recover it. 00:28:04.954 [2024-11-28 19:16:25.868416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.868502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.868526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.954 qpair failed and we were unable to recover it. 00:28:04.954 [2024-11-28 19:16:25.868607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.868733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.868758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.954 qpair failed and we were unable to recover it. 00:28:04.954 [2024-11-28 19:16:25.868876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.868956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.868982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.954 qpair failed and we were unable to recover it. 00:28:04.954 [2024-11-28 19:16:25.869091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.869166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.869191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.954 qpair failed and we were unable to recover it. 00:28:04.954 [2024-11-28 19:16:25.869277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.869353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.869377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.954 qpair failed and we were unable to recover it. 00:28:04.954 [2024-11-28 19:16:25.869473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.869581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.869607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.954 qpair failed and we were unable to recover it. 00:28:04.954 [2024-11-28 19:16:25.869692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.869797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.869821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.954 qpair failed and we were unable to recover it. 00:28:04.954 [2024-11-28 19:16:25.869917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.870020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.870044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.954 qpair failed and we were unable to recover it. 00:28:04.954 [2024-11-28 19:16:25.870127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.954 [2024-11-28 19:16:25.870233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.870257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.955 qpair failed and we were unable to recover it. 00:28:04.955 [2024-11-28 19:16:25.870336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.870425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.870450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.955 qpair failed and we were unable to recover it. 00:28:04.955 [2024-11-28 19:16:25.870553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.870658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.870682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.955 qpair failed and we were unable to recover it. 00:28:04.955 [2024-11-28 19:16:25.870769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.870843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.870867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.955 qpair failed and we were unable to recover it. 00:28:04.955 [2024-11-28 19:16:25.870948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.871038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.871062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.955 qpair failed and we were unable to recover it. 00:28:04.955 [2024-11-28 19:16:25.871142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.871217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.871241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.955 qpair failed and we were unable to recover it. 00:28:04.955 [2024-11-28 19:16:25.871337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.871476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.871501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.955 qpair failed and we were unable to recover it. 00:28:04.955 [2024-11-28 19:16:25.871579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.871659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.871684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.955 qpair failed and we were unable to recover it. 00:28:04.955 [2024-11-28 19:16:25.871782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.871868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.871893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.955 qpair failed and we were unable to recover it. 00:28:04.955 [2024-11-28 19:16:25.871986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.872073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.872097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.955 qpair failed and we were unable to recover it. 00:28:04.955 [2024-11-28 19:16:25.872184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.872270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.872294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.955 qpair failed and we were unable to recover it. 00:28:04.955 [2024-11-28 19:16:25.872372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.872490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.872514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.955 qpair failed and we were unable to recover it. 00:28:04.955 [2024-11-28 19:16:25.872589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.872676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.872702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.955 qpair failed and we were unable to recover it. 00:28:04.955 [2024-11-28 19:16:25.872802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.872885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.872910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.955 qpair failed and we were unable to recover it. 00:28:04.955 [2024-11-28 19:16:25.873026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.873110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.873134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.955 qpair failed and we were unable to recover it. 00:28:04.955 [2024-11-28 19:16:25.873214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.873288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.873313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.955 qpair failed and we were unable to recover it. 00:28:04.955 [2024-11-28 19:16:25.873451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.873557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.873582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.955 qpair failed and we were unable to recover it. 00:28:04.955 [2024-11-28 19:16:25.873662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.873753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.873779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.955 qpair failed and we were unable to recover it. 00:28:04.955 [2024-11-28 19:16:25.873871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.873981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.874011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.955 qpair failed and we were unable to recover it. 00:28:04.955 [2024-11-28 19:16:25.874096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.874180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.874205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.955 qpair failed and we were unable to recover it. 00:28:04.955 [2024-11-28 19:16:25.874294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.874417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.874443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.955 qpair failed and we were unable to recover it. 00:28:04.955 [2024-11-28 19:16:25.874529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.874608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.874632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.955 qpair failed and we were unable to recover it. 00:28:04.955 [2024-11-28 19:16:25.874735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.874842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.874866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.955 qpair failed and we were unable to recover it. 00:28:04.955 [2024-11-28 19:16:25.874954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.875042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.875068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.955 qpair failed and we were unable to recover it. 00:28:04.955 [2024-11-28 19:16:25.875176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.875263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.875295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.955 qpair failed and we were unable to recover it. 00:28:04.955 [2024-11-28 19:16:25.875376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.875493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.875518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.955 qpair failed and we were unable to recover it. 00:28:04.955 [2024-11-28 19:16:25.875603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.875682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.875712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.955 qpair failed and we were unable to recover it. 00:28:04.955 [2024-11-28 19:16:25.875830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.875907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.875935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.955 qpair failed and we were unable to recover it. 00:28:04.955 [2024-11-28 19:16:25.876018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.876109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.955 [2024-11-28 19:16:25.876136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.955 qpair failed and we were unable to recover it. 00:28:04.956 [2024-11-28 19:16:25.876233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.876314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.876338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.956 qpair failed and we were unable to recover it. 00:28:04.956 [2024-11-28 19:16:25.876454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.876533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.876558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.956 qpair failed and we were unable to recover it. 00:28:04.956 [2024-11-28 19:16:25.876651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.876743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.876768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.956 qpair failed and we were unable to recover it. 00:28:04.956 [2024-11-28 19:16:25.876875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.876969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.876994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.956 qpair failed and we were unable to recover it. 00:28:04.956 [2024-11-28 19:16:25.877079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.877156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.877182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.956 qpair failed and we were unable to recover it. 00:28:04.956 [2024-11-28 19:16:25.877295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.877397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.877423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.956 qpair failed and we were unable to recover it. 00:28:04.956 [2024-11-28 19:16:25.877539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.877619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.877643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.956 qpair failed and we were unable to recover it. 00:28:04.956 [2024-11-28 19:16:25.877737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.877843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.877868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.956 qpair failed and we were unable to recover it. 00:28:04.956 [2024-11-28 19:16:25.877952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.878037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.878061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.956 qpair failed and we were unable to recover it. 00:28:04.956 [2024-11-28 19:16:25.878149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.878288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.878313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.956 qpair failed and we were unable to recover it. 00:28:04.956 [2024-11-28 19:16:25.878409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.878492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.878516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.956 qpair failed and we were unable to recover it. 00:28:04.956 [2024-11-28 19:16:25.878602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.878689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.878714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.956 qpair failed and we were unable to recover it. 00:28:04.956 [2024-11-28 19:16:25.878824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.878945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.878969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.956 qpair failed and we were unable to recover it. 00:28:04.956 [2024-11-28 19:16:25.879062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.879142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.879166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.956 qpair failed and we were unable to recover it. 00:28:04.956 [2024-11-28 19:16:25.879277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.879389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.879458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.956 qpair failed and we were unable to recover it. 00:28:04.956 [2024-11-28 19:16:25.879549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.879627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.879652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.956 qpair failed and we were unable to recover it. 00:28:04.956 [2024-11-28 19:16:25.879742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.879820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.879854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.956 qpair failed and we were unable to recover it. 00:28:04.956 [2024-11-28 19:16:25.879943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.880052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.880083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.956 qpair failed and we were unable to recover it. 00:28:04.956 [2024-11-28 19:16:25.880163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.880248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.880273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.956 qpair failed and we were unable to recover it. 00:28:04.956 [2024-11-28 19:16:25.880358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.880446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.880471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.956 qpair failed and we were unable to recover it. 00:28:04.956 [2024-11-28 19:16:25.880586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.880667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.880692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.956 qpair failed and we were unable to recover it. 00:28:04.956 [2024-11-28 19:16:25.880781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.880875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.880899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.956 qpair failed and we were unable to recover it. 00:28:04.956 [2024-11-28 19:16:25.880993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.881070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.881094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.956 qpair failed and we were unable to recover it. 00:28:04.956 [2024-11-28 19:16:25.881210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.881306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.881333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.956 qpair failed and we were unable to recover it. 00:28:04.956 [2024-11-28 19:16:25.881418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.881583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.881608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.956 qpair failed and we were unable to recover it. 00:28:04.956 [2024-11-28 19:16:25.881714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.881803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.881828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.956 qpair failed and we were unable to recover it. 00:28:04.956 [2024-11-28 19:16:25.881913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.881993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.882017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.956 qpair failed and we were unable to recover it. 00:28:04.956 [2024-11-28 19:16:25.882098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.882209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.882237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.956 qpair failed and we were unable to recover it. 00:28:04.956 [2024-11-28 19:16:25.882325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.882412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.956 [2024-11-28 19:16:25.882437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.956 qpair failed and we were unable to recover it. 00:28:04.957 [2024-11-28 19:16:25.882523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.882602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.882627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.957 qpair failed and we were unable to recover it. 00:28:04.957 [2024-11-28 19:16:25.882712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.882800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.882825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.957 qpair failed and we were unable to recover it. 00:28:04.957 [2024-11-28 19:16:25.882917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.883002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.883026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.957 qpair failed and we were unable to recover it. 00:28:04.957 [2024-11-28 19:16:25.883108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.883199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.883223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.957 qpair failed and we were unable to recover it. 00:28:04.957 [2024-11-28 19:16:25.883357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.883440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.883465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.957 qpair failed and we were unable to recover it. 00:28:04.957 [2024-11-28 19:16:25.883553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.883629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.883655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.957 qpair failed and we were unable to recover it. 00:28:04.957 [2024-11-28 19:16:25.883742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.883855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.883880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.957 qpair failed and we were unable to recover it. 00:28:04.957 [2024-11-28 19:16:25.883957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.884034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.884058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.957 qpair failed and we were unable to recover it. 00:28:04.957 [2024-11-28 19:16:25.884148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.884250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.884274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.957 qpair failed and we were unable to recover it. 00:28:04.957 [2024-11-28 19:16:25.884360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.884446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.884470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.957 qpair failed and we were unable to recover it. 00:28:04.957 [2024-11-28 19:16:25.884560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.884673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.884697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.957 qpair failed and we were unable to recover it. 00:28:04.957 [2024-11-28 19:16:25.884787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.884870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.884904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.957 qpair failed and we were unable to recover it. 00:28:04.957 [2024-11-28 19:16:25.884995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.885073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.885098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.957 qpair failed and we were unable to recover it. 00:28:04.957 [2024-11-28 19:16:25.885178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.885286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.885310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.957 qpair failed and we were unable to recover it. 00:28:04.957 [2024-11-28 19:16:25.885420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.885512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.885536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.957 qpair failed and we were unable to recover it. 00:28:04.957 [2024-11-28 19:16:25.885618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.885697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.885721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.957 qpair failed and we were unable to recover it. 00:28:04.957 [2024-11-28 19:16:25.885816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.885927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.885951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.957 qpair failed and we were unable to recover it. 00:28:04.957 [2024-11-28 19:16:25.886028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.886104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.886130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.957 qpair failed and we were unable to recover it. 00:28:04.957 [2024-11-28 19:16:25.886242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.886330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.886354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.957 qpair failed and we were unable to recover it. 00:28:04.957 [2024-11-28 19:16:25.886457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.886530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.886555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.957 qpair failed and we were unable to recover it. 00:28:04.957 [2024-11-28 19:16:25.886635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.886731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.886755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.957 qpair failed and we were unable to recover it. 00:28:04.957 [2024-11-28 19:16:25.886837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.886941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.886969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.957 qpair failed and we were unable to recover it. 00:28:04.957 [2024-11-28 19:16:25.887058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.887167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.887192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.957 qpair failed and we were unable to recover it. 00:28:04.957 [2024-11-28 19:16:25.887268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.887349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.887376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.957 qpair failed and we were unable to recover it. 00:28:04.957 [2024-11-28 19:16:25.887477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.887557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.887582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.957 qpair failed and we were unable to recover it. 00:28:04.957 [2024-11-28 19:16:25.887687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.887775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 Malloc0 00:28:04.957 [2024-11-28 19:16:25.887800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.957 qpair failed and we were unable to recover it. 00:28:04.957 [2024-11-28 19:16:25.887888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.888006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.888031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.957 qpair failed and we were unable to recover it. 00:28:04.957 [2024-11-28 19:16:25.888128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.888204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.888228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.957 19:16:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:04.957 qpair failed and we were unable to recover it. 00:28:04.957 [2024-11-28 19:16:25.888314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 [2024-11-28 19:16:25.888442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.957 19:16:25 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:28:04.958 [2024-11-28 19:16:25.888468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.958 qpair failed and we were unable to recover it. 00:28:04.958 [2024-11-28 19:16:25.888548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 19:16:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:04.958 [2024-11-28 19:16:25.888639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.888663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.958 qpair failed and we were unable to recover it. 00:28:04.958 [2024-11-28 19:16:25.888752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 19:16:25 -- common/autotest_common.sh@10 -- # set +x 00:28:04.958 [2024-11-28 19:16:25.888888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.888912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.958 qpair failed and we were unable to recover it. 00:28:04.958 [2024-11-28 19:16:25.888988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.889066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.889091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.958 qpair failed and we were unable to recover it. 00:28:04.958 [2024-11-28 19:16:25.889171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.889280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.889305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.958 qpair failed and we were unable to recover it. 00:28:04.958 [2024-11-28 19:16:25.889402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.889496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.889521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.958 qpair failed and we were unable to recover it. 00:28:04.958 [2024-11-28 19:16:25.889633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.889739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.889763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.958 qpair failed and we were unable to recover it. 00:28:04.958 [2024-11-28 19:16:25.889866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.889945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.889969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.958 qpair failed and we were unable to recover it. 00:28:04.958 [2024-11-28 19:16:25.890052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.890137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.890162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.958 qpair failed and we were unable to recover it. 00:28:04.958 [2024-11-28 19:16:25.890293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.890408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.890433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.958 qpair failed and we were unable to recover it. 00:28:04.958 [2024-11-28 19:16:25.890515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.890594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.890619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.958 qpair failed and we were unable to recover it. 00:28:04.958 [2024-11-28 19:16:25.890701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.890774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.890798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.958 qpair failed and we were unable to recover it. 00:28:04.958 [2024-11-28 19:16:25.890893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.890977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.891001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.958 qpair failed and we were unable to recover it. 00:28:04.958 [2024-11-28 19:16:25.891110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.891191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.891215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.958 qpair failed and we were unable to recover it. 00:28:04.958 [2024-11-28 19:16:25.891303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.891380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.891419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.958 qpair failed and we were unable to recover it. 00:28:04.958 [2024-11-28 19:16:25.891461] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:04.958 [2024-11-28 19:16:25.891537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.891613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.891637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.958 qpair failed and we were unable to recover it. 00:28:04.958 [2024-11-28 19:16:25.891736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.891838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.891862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.958 qpair failed and we were unable to recover it. 00:28:04.958 [2024-11-28 19:16:25.891979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.892065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.892089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.958 qpair failed and we were unable to recover it. 00:28:04.958 [2024-11-28 19:16:25.892174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.892282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.892306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.958 qpair failed and we were unable to recover it. 00:28:04.958 [2024-11-28 19:16:25.892391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.892486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.892510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.958 qpair failed and we were unable to recover it. 00:28:04.958 [2024-11-28 19:16:25.892599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.892677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.892703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.958 qpair failed and we were unable to recover it. 00:28:04.958 [2024-11-28 19:16:25.892818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.892897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.892921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.958 qpair failed and we were unable to recover it. 00:28:04.958 [2024-11-28 19:16:25.892999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.893069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.893093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.958 qpair failed and we were unable to recover it. 00:28:04.958 [2024-11-28 19:16:25.893173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.893290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.893315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.958 qpair failed and we were unable to recover it. 00:28:04.958 [2024-11-28 19:16:25.893406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.893491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.958 [2024-11-28 19:16:25.893517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.958 qpair failed and we were unable to recover it. 00:28:04.959 [2024-11-28 19:16:25.893606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.893724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.893748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.959 qpair failed and we were unable to recover it. 00:28:04.959 [2024-11-28 19:16:25.893863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.893948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.893972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.959 qpair failed and we were unable to recover it. 00:28:04.959 [2024-11-28 19:16:25.894073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.894180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.894205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.959 qpair failed and we were unable to recover it. 00:28:04.959 [2024-11-28 19:16:25.894278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.894359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.894383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.959 qpair failed and we were unable to recover it. 00:28:04.959 [2024-11-28 19:16:25.894471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.894583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.894609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.959 qpair failed and we were unable to recover it. 00:28:04.959 [2024-11-28 19:16:25.894717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.894801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.894826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.959 qpair failed and we were unable to recover it. 00:28:04.959 [2024-11-28 19:16:25.894943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.895024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.895048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.959 qpair failed and we were unable to recover it. 00:28:04.959 [2024-11-28 19:16:25.895161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.895272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.895297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.959 qpair failed and we were unable to recover it. 00:28:04.959 [2024-11-28 19:16:25.895379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.895466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.895495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.959 qpair failed and we were unable to recover it. 00:28:04.959 [2024-11-28 19:16:25.895581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.895669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.895694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.959 qpair failed and we were unable to recover it. 00:28:04.959 [2024-11-28 19:16:25.895778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.895862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.895887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.959 qpair failed and we were unable to recover it. 00:28:04.959 [2024-11-28 19:16:25.896004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.896082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.896107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.959 qpair failed and we were unable to recover it. 00:28:04.959 [2024-11-28 19:16:25.896199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.896304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.896328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.959 qpair failed and we were unable to recover it. 00:28:04.959 [2024-11-28 19:16:25.896423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.896500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.896525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.959 qpair failed and we were unable to recover it. 00:28:04.959 [2024-11-28 19:16:25.896610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.896686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.896710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.959 qpair failed and we were unable to recover it. 00:28:04.959 [2024-11-28 19:16:25.896828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.896912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.896936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.959 qpair failed and we were unable to recover it. 00:28:04.959 [2024-11-28 19:16:25.897029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.897109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.897134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.959 qpair failed and we were unable to recover it. 00:28:04.959 [2024-11-28 19:16:25.897272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.897437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.897463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.959 qpair failed and we were unable to recover it. 00:28:04.959 [2024-11-28 19:16:25.897545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.897631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.897657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.959 qpair failed and we were unable to recover it. 00:28:04.959 [2024-11-28 19:16:25.897783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.897858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.897883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.959 qpair failed and we were unable to recover it. 00:28:04.959 [2024-11-28 19:16:25.897997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.898074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.898098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.959 qpair failed and we were unable to recover it. 00:28:04.959 [2024-11-28 19:16:25.898188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.898266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.898291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.959 qpair failed and we were unable to recover it. 00:28:04.959 [2024-11-28 19:16:25.898371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.898458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.898484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.959 qpair failed and we were unable to recover it. 00:28:04.959 [2024-11-28 19:16:25.898575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.898687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.898712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.959 qpair failed and we were unable to recover it. 00:28:04.959 [2024-11-28 19:16:25.898820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.898908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.898938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.959 qpair failed and we were unable to recover it. 00:28:04.959 [2024-11-28 19:16:25.899054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.899139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.899166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.959 qpair failed and we were unable to recover it. 00:28:04.959 [2024-11-28 19:16:25.899286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.899360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.899400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.959 qpair failed and we were unable to recover it. 00:28:04.959 [2024-11-28 19:16:25.899481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.899561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.899587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.959 qpair failed and we were unable to recover it. 00:28:04.959 [2024-11-28 19:16:25.899670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 [2024-11-28 19:16:25.899752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.959 19:16:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:04.959 [2024-11-28 19:16:25.899779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.960 qpair failed and we were unable to recover it. 00:28:04.960 [2024-11-28 19:16:25.899924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 19:16:25 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:28:04.960 [2024-11-28 19:16:25.900031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.900056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.960 qpair failed and we were unable to recover it. 00:28:04.960 19:16:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:04.960 [2024-11-28 19:16:25.900143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.900259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.900284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.960 19:16:25 -- common/autotest_common.sh@10 -- # set +x 00:28:04.960 qpair failed and we were unable to recover it. 00:28:04.960 [2024-11-28 19:16:25.900374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.900503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.900529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.960 qpair failed and we were unable to recover it. 00:28:04.960 [2024-11-28 19:16:25.900645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.900731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.900755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.960 qpair failed and we were unable to recover it. 00:28:04.960 [2024-11-28 19:16:25.900862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.900952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.900977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.960 qpair failed and we were unable to recover it. 00:28:04.960 [2024-11-28 19:16:25.901049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.901123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.901147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.960 qpair failed and we were unable to recover it. 00:28:04.960 [2024-11-28 19:16:25.901231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.901318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.901343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.960 qpair failed and we were unable to recover it. 00:28:04.960 [2024-11-28 19:16:25.901446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.901525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.901550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.960 qpair failed and we were unable to recover it. 00:28:04.960 [2024-11-28 19:16:25.901627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.901740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.901764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.960 qpair failed and we were unable to recover it. 00:28:04.960 [2024-11-28 19:16:25.901838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.901914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.901938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.960 qpair failed and we were unable to recover it. 00:28:04.960 [2024-11-28 19:16:25.902030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.902116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.902143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.960 qpair failed and we were unable to recover it. 00:28:04.960 [2024-11-28 19:16:25.902231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.902312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.902339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.960 qpair failed and we were unable to recover it. 00:28:04.960 [2024-11-28 19:16:25.902433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.902511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.902535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.960 qpair failed and we were unable to recover it. 00:28:04.960 [2024-11-28 19:16:25.902616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.902700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.902726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.960 qpair failed and we were unable to recover it. 00:28:04.960 [2024-11-28 19:16:25.902802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.902893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.902916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.960 qpair failed and we were unable to recover it. 00:28:04.960 [2024-11-28 19:16:25.903001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.903073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.903098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.960 qpair failed and we were unable to recover it. 00:28:04.960 [2024-11-28 19:16:25.903176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.903249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.903273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.960 qpair failed and we were unable to recover it. 00:28:04.960 [2024-11-28 19:16:25.903390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.903475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.903499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.960 qpair failed and we were unable to recover it. 00:28:04.960 [2024-11-28 19:16:25.903590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.903661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.903685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.960 qpair failed and we were unable to recover it. 00:28:04.960 [2024-11-28 19:16:25.903776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.903850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.903880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.960 qpair failed and we were unable to recover it. 00:28:04.960 [2024-11-28 19:16:25.903966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.904067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.904091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.960 qpair failed and we were unable to recover it. 00:28:04.960 [2024-11-28 19:16:25.904179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.904297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.904322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.960 qpair failed and we were unable to recover it. 00:28:04.960 [2024-11-28 19:16:25.904410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.904527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.904552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.960 qpair failed and we were unable to recover it. 00:28:04.960 [2024-11-28 19:16:25.904628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.904704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.904728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.960 qpair failed and we were unable to recover it. 00:28:04.960 [2024-11-28 19:16:25.904820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.904897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.904922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.960 qpair failed and we were unable to recover it. 00:28:04.960 [2024-11-28 19:16:25.905005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.905082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.905106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.960 qpair failed and we were unable to recover it. 00:28:04.960 [2024-11-28 19:16:25.905195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.905284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.905308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.960 qpair failed and we were unable to recover it. 00:28:04.960 [2024-11-28 19:16:25.905388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.905477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.960 [2024-11-28 19:16:25.905502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.960 qpair failed and we were unable to recover it. 00:28:04.960 [2024-11-28 19:16:25.905594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.905676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.905700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.961 qpair failed and we were unable to recover it. 00:28:04.961 [2024-11-28 19:16:25.905785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.905902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.905926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.961 qpair failed and we were unable to recover it. 00:28:04.961 [2024-11-28 19:16:25.906021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.906113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.906138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.961 qpair failed and we were unable to recover it. 00:28:04.961 [2024-11-28 19:16:25.906214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.906306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.906329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.961 qpair failed and we were unable to recover it. 00:28:04.961 [2024-11-28 19:16:25.906434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.906513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.906538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.961 qpair failed and we were unable to recover it. 00:28:04.961 [2024-11-28 19:16:25.906629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.906709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.906733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.961 qpair failed and we were unable to recover it. 00:28:04.961 [2024-11-28 19:16:25.906853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.906934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.906958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.961 qpair failed and we were unable to recover it. 00:28:04.961 [2024-11-28 19:16:25.907037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.907120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.907144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.961 qpair failed and we were unable to recover it. 00:28:04.961 [2024-11-28 19:16:25.907238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.907317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.907342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.961 qpair failed and we were unable to recover it. 00:28:04.961 [2024-11-28 19:16:25.907432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.907522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.907548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.961 qpair failed and we were unable to recover it. 00:28:04.961 [2024-11-28 19:16:25.907636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.907720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.907745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.961 qpair failed and we were unable to recover it. 00:28:04.961 19:16:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:04.961 [2024-11-28 19:16:25.907822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.907928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.907952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.961 qpair failed and we were unable to recover it. 00:28:04.961 19:16:25 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:28:04.961 [2024-11-28 19:16:25.908044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.908118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.908143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.961 19:16:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:04.961 qpair failed and we were unable to recover it. 00:28:04.961 [2024-11-28 19:16:25.908265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 19:16:25 -- common/autotest_common.sh@10 -- # set +x 00:28:04.961 [2024-11-28 19:16:25.908346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.908371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.961 qpair failed and we were unable to recover it. 00:28:04.961 [2024-11-28 19:16:25.908466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.908548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.908574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.961 qpair failed and we were unable to recover it. 00:28:04.961 [2024-11-28 19:16:25.908656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.908765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.908789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.961 qpair failed and we were unable to recover it. 00:28:04.961 [2024-11-28 19:16:25.908874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.908979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.909003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.961 qpair failed and we were unable to recover it. 00:28:04.961 [2024-11-28 19:16:25.909118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.909210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.909235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.961 qpair failed and we were unable to recover it. 00:28:04.961 [2024-11-28 19:16:25.909317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.909431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.909456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.961 qpair failed and we were unable to recover it. 00:28:04.961 [2024-11-28 19:16:25.909545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.909626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.909651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.961 qpair failed and we were unable to recover it. 00:28:04.961 [2024-11-28 19:16:25.909766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.909849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.909874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.961 qpair failed and we were unable to recover it. 00:28:04.961 [2024-11-28 19:16:25.909992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.910076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.910101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.961 qpair failed and we were unable to recover it. 00:28:04.961 [2024-11-28 19:16:25.910185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.910261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.910285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.961 qpair failed and we were unable to recover it. 00:28:04.961 [2024-11-28 19:16:25.910376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.910470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.910494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.961 qpair failed and we were unable to recover it. 00:28:04.961 [2024-11-28 19:16:25.910604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.910682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.910706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.961 qpair failed and we were unable to recover it. 00:28:04.961 [2024-11-28 19:16:25.910826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.910897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.910921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.961 qpair failed and we were unable to recover it. 00:28:04.961 [2024-11-28 19:16:25.911014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.911098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.911122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.961 qpair failed and we were unable to recover it. 00:28:04.961 [2024-11-28 19:16:25.911197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.911278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.961 [2024-11-28 19:16:25.911304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.961 qpair failed and we were unable to recover it. 00:28:04.961 [2024-11-28 19:16:25.911378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.911464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.911488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.962 qpair failed and we were unable to recover it. 00:28:04.962 [2024-11-28 19:16:25.911577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.911680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.911705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.962 qpair failed and we were unable to recover it. 00:28:04.962 [2024-11-28 19:16:25.911795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.911926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.911950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.962 qpair failed and we were unable to recover it. 00:28:04.962 [2024-11-28 19:16:25.912066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.912144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.912173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.962 qpair failed and we were unable to recover it. 00:28:04.962 [2024-11-28 19:16:25.912271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.912356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.912380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.962 qpair failed and we were unable to recover it. 00:28:04.962 [2024-11-28 19:16:25.912502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.912589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.912613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.962 qpair failed and we were unable to recover it. 00:28:04.962 [2024-11-28 19:16:25.912710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.912820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.912844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.962 qpair failed and we were unable to recover it. 00:28:04.962 [2024-11-28 19:16:25.912956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.913055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.913079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.962 qpair failed and we were unable to recover it. 00:28:04.962 [2024-11-28 19:16:25.913179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.913289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.913312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.962 qpair failed and we were unable to recover it. 00:28:04.962 [2024-11-28 19:16:25.913438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.913516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.913541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.962 qpair failed and we were unable to recover it. 00:28:04.962 [2024-11-28 19:16:25.913632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.913710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.913735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.962 qpair failed and we were unable to recover it. 00:28:04.962 [2024-11-28 19:16:25.913849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.913936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.913960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.962 qpair failed and we were unable to recover it. 00:28:04.962 [2024-11-28 19:16:25.914075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.914179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.914203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.962 qpair failed and we were unable to recover it. 00:28:04.962 [2024-11-28 19:16:25.914279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.914411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.914436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.962 qpair failed and we were unable to recover it. 00:28:04.962 [2024-11-28 19:16:25.914523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.914633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.914657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.962 qpair failed and we were unable to recover it. 00:28:04.962 [2024-11-28 19:16:25.914748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.914860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.914884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.962 qpair failed and we were unable to recover it. 00:28:04.962 [2024-11-28 19:16:25.914969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.915048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.915071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.962 qpair failed and we were unable to recover it. 00:28:04.962 [2024-11-28 19:16:25.915159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.915276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.915302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.962 qpair failed and we were unable to recover it. 00:28:04.962 [2024-11-28 19:16:25.915403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.915497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.915522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.962 qpair failed and we were unable to recover it. 00:28:04.962 [2024-11-28 19:16:25.915605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.915683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.915708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.962 qpair failed and we were unable to recover it. 00:28:04.962 [2024-11-28 19:16:25.915795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 19:16:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:04.962 [2024-11-28 19:16:25.915915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.915939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.962 qpair failed and we were unable to recover it. 00:28:04.962 19:16:25 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:04.962 [2024-11-28 19:16:25.916023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.916105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.916129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.962 qpair failed and we were unable to recover it. 00:28:04.962 19:16:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:04.962 [2024-11-28 19:16:25.916228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.916297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.916322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.962 19:16:25 -- common/autotest_common.sh@10 -- # set +x 00:28:04.962 qpair failed and we were unable to recover it. 00:28:04.962 [2024-11-28 19:16:25.916418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.916497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.916522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.962 qpair failed and we were unable to recover it. 00:28:04.962 [2024-11-28 19:16:25.916610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.916730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.916754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.962 qpair failed and we were unable to recover it. 00:28:04.962 [2024-11-28 19:16:25.916844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.916924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.916948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.962 qpair failed and we were unable to recover it. 00:28:04.962 [2024-11-28 19:16:25.917036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.917112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.917137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.962 qpair failed and we were unable to recover it. 00:28:04.962 [2024-11-28 19:16:25.917222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.962 [2024-11-28 19:16:25.917325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.963 [2024-11-28 19:16:25.917350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.963 qpair failed and we were unable to recover it. 00:28:04.963 [2024-11-28 19:16:25.917450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.963 [2024-11-28 19:16:25.917530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.963 [2024-11-28 19:16:25.917554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.963 qpair failed and we were unable to recover it. 00:28:04.963 [2024-11-28 19:16:25.917639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.963 [2024-11-28 19:16:25.917724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.963 [2024-11-28 19:16:25.917749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.963 qpair failed and we were unable to recover it. 00:28:04.963 [2024-11-28 19:16:25.917824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.963 [2024-11-28 19:16:25.917901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.963 [2024-11-28 19:16:25.917925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.963 qpair failed and we were unable to recover it. 00:28:04.963 [2024-11-28 19:16:25.918020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.963 [2024-11-28 19:16:25.918093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.963 [2024-11-28 19:16:25.918117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.963 qpair failed and we were unable to recover it. 00:28:04.963 [2024-11-28 19:16:25.918193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.963 [2024-11-28 19:16:25.918278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.963 [2024-11-28 19:16:25.918302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.963 qpair failed and we were unable to recover it. 00:28:04.963 [2024-11-28 19:16:25.918425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.963 [2024-11-28 19:16:25.918513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.963 [2024-11-28 19:16:25.918539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.963 qpair failed and we were unable to recover it. 00:28:04.963 [2024-11-28 19:16:25.918623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.963 [2024-11-28 19:16:25.918732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.963 [2024-11-28 19:16:25.918757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.963 qpair failed and we were unable to recover it. 00:28:04.963 [2024-11-28 19:16:25.918861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.963 [2024-11-28 19:16:25.918939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.963 [2024-11-28 19:16:25.918963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.963 qpair failed and we were unable to recover it. 00:28:04.963 [2024-11-28 19:16:25.919074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.963 [2024-11-28 19:16:25.919154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.963 [2024-11-28 19:16:25.919180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.963 qpair failed and we were unable to recover it. 00:28:04.963 [2024-11-28 19:16:25.919260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.963 [2024-11-28 19:16:25.919341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.963 [2024-11-28 19:16:25.919365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.963 qpair failed and we were unable to recover it. 00:28:04.963 [2024-11-28 19:16:25.919462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.963 [2024-11-28 19:16:25.919543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:04.963 [2024-11-28 19:16:25.919568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1d84cb0 with addr=10.0.0.2, port=4420 00:28:04.963 qpair failed and we were unable to recover it. 00:28:04.963 [2024-11-28 19:16:25.919701] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:05.264 [2024-11-28 19:16:25.922119] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.264 [2024-11-28 19:16:25.922238] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.264 [2024-11-28 19:16:25.922267] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.264 [2024-11-28 19:16:25.922293] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.264 [2024-11-28 19:16:25.922305] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.264 [2024-11-28 19:16:25.922339] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.264 qpair failed and we were unable to recover it. 00:28:05.264 19:16:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:05.264 19:16:25 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:28:05.264 19:16:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:05.264 19:16:25 -- common/autotest_common.sh@10 -- # set +x 00:28:05.264 19:16:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:05.264 [2024-11-28 19:16:25.932016] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.264 19:16:25 -- host/target_disconnect.sh@58 -- # wait 328199 00:28:05.264 [2024-11-28 19:16:25.932107] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.264 [2024-11-28 19:16:25.932139] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.264 [2024-11-28 19:16:25.932155] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.264 [2024-11-28 19:16:25.932167] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.264 [2024-11-28 19:16:25.932197] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.264 qpair failed and we were unable to recover it. 00:28:05.264 [2024-11-28 19:16:25.942017] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.265 [2024-11-28 19:16:25.942106] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.265 [2024-11-28 19:16:25.942132] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.265 [2024-11-28 19:16:25.942147] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.265 [2024-11-28 19:16:25.942160] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.265 [2024-11-28 19:16:25.942188] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.265 qpair failed and we were unable to recover it. 00:28:05.265 [2024-11-28 19:16:25.952058] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.265 [2024-11-28 19:16:25.952156] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.265 [2024-11-28 19:16:25.952182] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.265 [2024-11-28 19:16:25.952197] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.265 [2024-11-28 19:16:25.952210] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.265 [2024-11-28 19:16:25.952239] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.265 qpair failed and we were unable to recover it. 00:28:05.265 [2024-11-28 19:16:25.962006] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.265 [2024-11-28 19:16:25.962093] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.265 [2024-11-28 19:16:25.962120] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.265 [2024-11-28 19:16:25.962135] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.265 [2024-11-28 19:16:25.962148] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.265 [2024-11-28 19:16:25.962176] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.265 qpair failed and we were unable to recover it. 00:28:05.265 [2024-11-28 19:16:25.972043] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.265 [2024-11-28 19:16:25.972151] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.265 [2024-11-28 19:16:25.972178] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.265 [2024-11-28 19:16:25.972192] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.265 [2024-11-28 19:16:25.972205] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.265 [2024-11-28 19:16:25.972235] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.265 qpair failed and we were unable to recover it. 00:28:05.265 [2024-11-28 19:16:25.982066] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.265 [2024-11-28 19:16:25.982210] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.265 [2024-11-28 19:16:25.982236] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.265 [2024-11-28 19:16:25.982250] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.265 [2024-11-28 19:16:25.982263] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.265 [2024-11-28 19:16:25.982291] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.265 qpair failed and we were unable to recover it. 00:28:05.265 [2024-11-28 19:16:25.992095] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.265 [2024-11-28 19:16:25.992201] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.265 [2024-11-28 19:16:25.992226] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.265 [2024-11-28 19:16:25.992240] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.265 [2024-11-28 19:16:25.992253] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.265 [2024-11-28 19:16:25.992282] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.265 qpair failed and we were unable to recover it. 00:28:05.265 [2024-11-28 19:16:26.002124] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.265 [2024-11-28 19:16:26.002221] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.265 [2024-11-28 19:16:26.002247] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.265 [2024-11-28 19:16:26.002261] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.265 [2024-11-28 19:16:26.002275] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.265 [2024-11-28 19:16:26.002303] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.265 qpair failed and we were unable to recover it. 00:28:05.265 [2024-11-28 19:16:26.012141] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.265 [2024-11-28 19:16:26.012262] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.265 [2024-11-28 19:16:26.012288] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.265 [2024-11-28 19:16:26.012302] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.265 [2024-11-28 19:16:26.012315] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.265 [2024-11-28 19:16:26.012344] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.265 qpair failed and we were unable to recover it. 00:28:05.265 [2024-11-28 19:16:26.022164] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.265 [2024-11-28 19:16:26.022249] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.265 [2024-11-28 19:16:26.022280] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.265 [2024-11-28 19:16:26.022296] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.265 [2024-11-28 19:16:26.022309] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.265 [2024-11-28 19:16:26.022337] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.265 qpair failed and we were unable to recover it. 00:28:05.265 [2024-11-28 19:16:26.032184] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.265 [2024-11-28 19:16:26.032275] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.265 [2024-11-28 19:16:26.032304] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.265 [2024-11-28 19:16:26.032321] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.265 [2024-11-28 19:16:26.032333] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.265 [2024-11-28 19:16:26.032363] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.265 qpair failed and we were unable to recover it. 00:28:05.265 [2024-11-28 19:16:26.042209] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.265 [2024-11-28 19:16:26.042294] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.265 [2024-11-28 19:16:26.042320] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.265 [2024-11-28 19:16:26.042334] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.265 [2024-11-28 19:16:26.042347] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.265 [2024-11-28 19:16:26.042375] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.265 qpair failed and we were unable to recover it. 00:28:05.265 [2024-11-28 19:16:26.052222] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.265 [2024-11-28 19:16:26.052337] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.265 [2024-11-28 19:16:26.052363] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.265 [2024-11-28 19:16:26.052377] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.265 [2024-11-28 19:16:26.052390] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.265 [2024-11-28 19:16:26.052429] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.265 qpair failed and we were unable to recover it. 00:28:05.265 [2024-11-28 19:16:26.062267] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.265 [2024-11-28 19:16:26.062388] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.265 [2024-11-28 19:16:26.062420] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.265 [2024-11-28 19:16:26.062435] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.265 [2024-11-28 19:16:26.062448] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.265 [2024-11-28 19:16:26.062482] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.266 qpair failed and we were unable to recover it. 00:28:05.266 [2024-11-28 19:16:26.072303] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.266 [2024-11-28 19:16:26.072391] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.266 [2024-11-28 19:16:26.072422] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.266 [2024-11-28 19:16:26.072436] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.266 [2024-11-28 19:16:26.072449] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.266 [2024-11-28 19:16:26.072479] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.266 qpair failed and we were unable to recover it. 00:28:05.266 [2024-11-28 19:16:26.082332] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.266 [2024-11-28 19:16:26.082470] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.266 [2024-11-28 19:16:26.082496] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.266 [2024-11-28 19:16:26.082510] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.266 [2024-11-28 19:16:26.082522] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.266 [2024-11-28 19:16:26.082550] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.266 qpair failed and we were unable to recover it. 00:28:05.266 [2024-11-28 19:16:26.092341] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.266 [2024-11-28 19:16:26.092438] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.266 [2024-11-28 19:16:26.092465] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.266 [2024-11-28 19:16:26.092479] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.266 [2024-11-28 19:16:26.092491] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.266 [2024-11-28 19:16:26.092520] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.266 qpair failed and we were unable to recover it. 00:28:05.266 [2024-11-28 19:16:26.102508] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.266 [2024-11-28 19:16:26.102652] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.266 [2024-11-28 19:16:26.102678] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.266 [2024-11-28 19:16:26.102692] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.266 [2024-11-28 19:16:26.102705] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.266 [2024-11-28 19:16:26.102733] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.266 qpair failed and we were unable to recover it. 00:28:05.266 [2024-11-28 19:16:26.112477] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.266 [2024-11-28 19:16:26.112576] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.266 [2024-11-28 19:16:26.112607] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.266 [2024-11-28 19:16:26.112622] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.266 [2024-11-28 19:16:26.112634] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.266 [2024-11-28 19:16:26.112665] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.266 qpair failed and we were unable to recover it. 00:28:05.266 [2024-11-28 19:16:26.122461] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.266 [2024-11-28 19:16:26.122549] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.266 [2024-11-28 19:16:26.122574] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.266 [2024-11-28 19:16:26.122589] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.266 [2024-11-28 19:16:26.122602] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.266 [2024-11-28 19:16:26.122630] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.266 qpair failed and we were unable to recover it. 00:28:05.266 [2024-11-28 19:16:26.132507] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.266 [2024-11-28 19:16:26.132600] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.266 [2024-11-28 19:16:26.132629] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.266 [2024-11-28 19:16:26.132645] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.266 [2024-11-28 19:16:26.132658] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.266 [2024-11-28 19:16:26.132688] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.266 qpair failed and we were unable to recover it. 00:28:05.266 [2024-11-28 19:16:26.142485] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.266 [2024-11-28 19:16:26.142579] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.266 [2024-11-28 19:16:26.142612] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.266 [2024-11-28 19:16:26.142635] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.266 [2024-11-28 19:16:26.142656] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.266 [2024-11-28 19:16:26.142695] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.266 qpair failed and we were unable to recover it. 00:28:05.266 [2024-11-28 19:16:26.152550] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.266 [2024-11-28 19:16:26.152642] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.266 [2024-11-28 19:16:26.152669] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.266 [2024-11-28 19:16:26.152683] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.266 [2024-11-28 19:16:26.152696] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.266 [2024-11-28 19:16:26.152733] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.266 qpair failed and we were unable to recover it. 00:28:05.266 [2024-11-28 19:16:26.162545] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.266 [2024-11-28 19:16:26.162632] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.266 [2024-11-28 19:16:26.162658] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.266 [2024-11-28 19:16:26.162673] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.266 [2024-11-28 19:16:26.162686] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.266 [2024-11-28 19:16:26.162714] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.266 qpair failed and we were unable to recover it. 00:28:05.266 [2024-11-28 19:16:26.172594] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.266 [2024-11-28 19:16:26.172685] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.266 [2024-11-28 19:16:26.172710] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.266 [2024-11-28 19:16:26.172725] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.266 [2024-11-28 19:16:26.172738] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.266 [2024-11-28 19:16:26.172766] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.266 qpair failed and we were unable to recover it. 00:28:05.266 [2024-11-28 19:16:26.182714] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.266 [2024-11-28 19:16:26.182797] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.266 [2024-11-28 19:16:26.182822] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.266 [2024-11-28 19:16:26.182836] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.266 [2024-11-28 19:16:26.182849] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.266 [2024-11-28 19:16:26.182877] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.266 qpair failed and we were unable to recover it. 00:28:05.266 [2024-11-28 19:16:26.192641] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.266 [2024-11-28 19:16:26.192731] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.266 [2024-11-28 19:16:26.192756] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.266 [2024-11-28 19:16:26.192770] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.266 [2024-11-28 19:16:26.192783] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.266 [2024-11-28 19:16:26.192811] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.266 qpair failed and we were unable to recover it. 00:28:05.266 [2024-11-28 19:16:26.202688] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.266 [2024-11-28 19:16:26.202810] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.267 [2024-11-28 19:16:26.202841] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.267 [2024-11-28 19:16:26.202856] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.267 [2024-11-28 19:16:26.202869] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.267 [2024-11-28 19:16:26.202897] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.267 qpair failed and we were unable to recover it. 00:28:05.267 [2024-11-28 19:16:26.212724] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.267 [2024-11-28 19:16:26.212810] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.267 [2024-11-28 19:16:26.212835] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.267 [2024-11-28 19:16:26.212850] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.267 [2024-11-28 19:16:26.212862] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.267 [2024-11-28 19:16:26.212892] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.267 qpair failed and we were unable to recover it. 00:28:05.267 [2024-11-28 19:16:26.222738] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.267 [2024-11-28 19:16:26.222865] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.267 [2024-11-28 19:16:26.222891] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.267 [2024-11-28 19:16:26.222905] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.267 [2024-11-28 19:16:26.222917] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.267 [2024-11-28 19:16:26.222945] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.267 qpair failed and we were unable to recover it. 00:28:05.267 [2024-11-28 19:16:26.232785] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.267 [2024-11-28 19:16:26.232902] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.267 [2024-11-28 19:16:26.232928] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.267 [2024-11-28 19:16:26.232942] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.267 [2024-11-28 19:16:26.232955] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.267 [2024-11-28 19:16:26.232983] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.267 qpair failed and we were unable to recover it. 00:28:05.267 [2024-11-28 19:16:26.242773] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.267 [2024-11-28 19:16:26.242869] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.267 [2024-11-28 19:16:26.242894] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.267 [2024-11-28 19:16:26.242909] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.267 [2024-11-28 19:16:26.242922] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.267 [2024-11-28 19:16:26.242956] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.267 qpair failed and we were unable to recover it. 00:28:05.267 [2024-11-28 19:16:26.252825] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.267 [2024-11-28 19:16:26.252949] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.267 [2024-11-28 19:16:26.252974] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.267 [2024-11-28 19:16:26.252989] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.267 [2024-11-28 19:16:26.253002] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.267 [2024-11-28 19:16:26.253031] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.267 qpair failed and we were unable to recover it. 00:28:05.267 [2024-11-28 19:16:26.262878] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.267 [2024-11-28 19:16:26.262964] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.267 [2024-11-28 19:16:26.262989] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.267 [2024-11-28 19:16:26.263004] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.267 [2024-11-28 19:16:26.263017] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.267 [2024-11-28 19:16:26.263046] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.267 qpair failed and we were unable to recover it. 00:28:05.267 [2024-11-28 19:16:26.272924] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.267 [2024-11-28 19:16:26.273022] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.267 [2024-11-28 19:16:26.273053] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.267 [2024-11-28 19:16:26.273073] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.267 [2024-11-28 19:16:26.273086] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.267 [2024-11-28 19:16:26.273116] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.267 qpair failed and we were unable to recover it. 00:28:05.528 [2024-11-28 19:16:26.282966] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.528 [2024-11-28 19:16:26.283059] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.528 [2024-11-28 19:16:26.283085] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.528 [2024-11-28 19:16:26.283100] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.528 [2024-11-28 19:16:26.283113] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.528 [2024-11-28 19:16:26.283141] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.528 qpair failed and we were unable to recover it. 00:28:05.528 [2024-11-28 19:16:26.292952] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.528 [2024-11-28 19:16:26.293046] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.528 [2024-11-28 19:16:26.293078] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.528 [2024-11-28 19:16:26.293094] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.528 [2024-11-28 19:16:26.293107] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.528 [2024-11-28 19:16:26.293135] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.528 qpair failed and we were unable to recover it. 00:28:05.528 [2024-11-28 19:16:26.302978] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.528 [2024-11-28 19:16:26.303069] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.528 [2024-11-28 19:16:26.303094] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.528 [2024-11-28 19:16:26.303109] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.528 [2024-11-28 19:16:26.303123] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.528 [2024-11-28 19:16:26.303150] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.528 qpair failed and we were unable to recover it. 00:28:05.528 [2024-11-28 19:16:26.313015] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.528 [2024-11-28 19:16:26.313111] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.528 [2024-11-28 19:16:26.313136] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.528 [2024-11-28 19:16:26.313150] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.528 [2024-11-28 19:16:26.313163] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.528 [2024-11-28 19:16:26.313191] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.528 qpair failed and we were unable to recover it. 00:28:05.528 [2024-11-28 19:16:26.323011] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.528 [2024-11-28 19:16:26.323092] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.528 [2024-11-28 19:16:26.323116] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.528 [2024-11-28 19:16:26.323131] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.528 [2024-11-28 19:16:26.323144] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.528 [2024-11-28 19:16:26.323172] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.528 qpair failed and we were unable to recover it. 00:28:05.528 [2024-11-28 19:16:26.333048] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.528 [2024-11-28 19:16:26.333134] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.528 [2024-11-28 19:16:26.333159] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.528 [2024-11-28 19:16:26.333174] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.528 [2024-11-28 19:16:26.333187] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.528 [2024-11-28 19:16:26.333221] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.528 qpair failed and we were unable to recover it. 00:28:05.528 [2024-11-28 19:16:26.343077] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.528 [2024-11-28 19:16:26.343158] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.528 [2024-11-28 19:16:26.343187] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.528 [2024-11-28 19:16:26.343204] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.528 [2024-11-28 19:16:26.343217] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.528 [2024-11-28 19:16:26.343246] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.528 qpair failed and we were unable to recover it. 00:28:05.528 [2024-11-28 19:16:26.353106] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.528 [2024-11-28 19:16:26.353204] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.528 [2024-11-28 19:16:26.353230] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.528 [2024-11-28 19:16:26.353244] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.528 [2024-11-28 19:16:26.353257] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.528 [2024-11-28 19:16:26.353287] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.528 qpair failed and we were unable to recover it. 00:28:05.528 [2024-11-28 19:16:26.363139] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.528 [2024-11-28 19:16:26.363268] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.528 [2024-11-28 19:16:26.363294] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.528 [2024-11-28 19:16:26.363309] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.529 [2024-11-28 19:16:26.363322] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.529 [2024-11-28 19:16:26.363351] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.529 qpair failed and we were unable to recover it. 00:28:05.529 [2024-11-28 19:16:26.373222] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.529 [2024-11-28 19:16:26.373347] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.529 [2024-11-28 19:16:26.373373] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.529 [2024-11-28 19:16:26.373388] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.529 [2024-11-28 19:16:26.373414] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.529 [2024-11-28 19:16:26.373445] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.529 qpair failed and we were unable to recover it. 00:28:05.529 [2024-11-28 19:16:26.383192] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.529 [2024-11-28 19:16:26.383273] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.529 [2024-11-28 19:16:26.383305] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.529 [2024-11-28 19:16:26.383320] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.529 [2024-11-28 19:16:26.383333] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.529 [2024-11-28 19:16:26.383362] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.529 qpair failed and we were unable to recover it. 00:28:05.529 [2024-11-28 19:16:26.393240] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.529 [2024-11-28 19:16:26.393357] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.529 [2024-11-28 19:16:26.393386] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.529 [2024-11-28 19:16:26.393413] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.529 [2024-11-28 19:16:26.393427] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.529 [2024-11-28 19:16:26.393457] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.529 qpair failed and we were unable to recover it. 00:28:05.529 [2024-11-28 19:16:26.403228] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.529 [2024-11-28 19:16:26.403328] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.529 [2024-11-28 19:16:26.403354] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.529 [2024-11-28 19:16:26.403368] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.529 [2024-11-28 19:16:26.403382] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.529 [2024-11-28 19:16:26.403417] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.529 qpair failed and we were unable to recover it. 00:28:05.529 [2024-11-28 19:16:26.413292] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.529 [2024-11-28 19:16:26.413379] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.529 [2024-11-28 19:16:26.413411] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.529 [2024-11-28 19:16:26.413427] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.529 [2024-11-28 19:16:26.413440] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.529 [2024-11-28 19:16:26.413468] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.529 qpair failed and we were unable to recover it. 00:28:05.529 [2024-11-28 19:16:26.423340] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.529 [2024-11-28 19:16:26.423429] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.529 [2024-11-28 19:16:26.423455] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.529 [2024-11-28 19:16:26.423470] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.529 [2024-11-28 19:16:26.423488] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.529 [2024-11-28 19:16:26.423518] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.529 qpair failed and we were unable to recover it. 00:28:05.529 [2024-11-28 19:16:26.433360] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.529 [2024-11-28 19:16:26.433485] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.529 [2024-11-28 19:16:26.433510] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.529 [2024-11-28 19:16:26.433525] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.529 [2024-11-28 19:16:26.433537] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.529 [2024-11-28 19:16:26.433566] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.529 qpair failed and we were unable to recover it. 00:28:05.529 [2024-11-28 19:16:26.443371] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.529 [2024-11-28 19:16:26.443463] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.529 [2024-11-28 19:16:26.443489] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.529 [2024-11-28 19:16:26.443503] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.529 [2024-11-28 19:16:26.443516] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.529 [2024-11-28 19:16:26.443544] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.529 qpair failed and we were unable to recover it. 00:28:05.529 [2024-11-28 19:16:26.453431] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.529 [2024-11-28 19:16:26.453533] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.529 [2024-11-28 19:16:26.453559] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.529 [2024-11-28 19:16:26.453573] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.529 [2024-11-28 19:16:26.453585] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.529 [2024-11-28 19:16:26.453614] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.529 qpair failed and we were unable to recover it. 00:28:05.529 [2024-11-28 19:16:26.463458] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.529 [2024-11-28 19:16:26.463545] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.529 [2024-11-28 19:16:26.463570] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.529 [2024-11-28 19:16:26.463585] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.529 [2024-11-28 19:16:26.463597] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.529 [2024-11-28 19:16:26.463625] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.529 qpair failed and we were unable to recover it. 00:28:05.529 [2024-11-28 19:16:26.473490] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.529 [2024-11-28 19:16:26.473604] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.529 [2024-11-28 19:16:26.473633] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.529 [2024-11-28 19:16:26.473652] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.529 [2024-11-28 19:16:26.473665] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.529 [2024-11-28 19:16:26.473695] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.529 qpair failed and we were unable to recover it. 00:28:05.529 [2024-11-28 19:16:26.483481] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.529 [2024-11-28 19:16:26.483569] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.529 [2024-11-28 19:16:26.483595] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.529 [2024-11-28 19:16:26.483609] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.529 [2024-11-28 19:16:26.483622] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.529 [2024-11-28 19:16:26.483650] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.529 qpair failed and we were unable to recover it. 00:28:05.529 [2024-11-28 19:16:26.493533] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.529 [2024-11-28 19:16:26.493662] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.529 [2024-11-28 19:16:26.493687] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.529 [2024-11-28 19:16:26.493702] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.529 [2024-11-28 19:16:26.493714] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.529 [2024-11-28 19:16:26.493742] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.529 qpair failed and we were unable to recover it. 00:28:05.529 [2024-11-28 19:16:26.503554] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.530 [2024-11-28 19:16:26.503669] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.530 [2024-11-28 19:16:26.503694] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.530 [2024-11-28 19:16:26.503709] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.530 [2024-11-28 19:16:26.503721] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.530 [2024-11-28 19:16:26.503749] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.530 qpair failed and we were unable to recover it. 00:28:05.530 [2024-11-28 19:16:26.513574] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.530 [2024-11-28 19:16:26.513665] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.530 [2024-11-28 19:16:26.513690] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.530 [2024-11-28 19:16:26.513704] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.530 [2024-11-28 19:16:26.513723] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.530 [2024-11-28 19:16:26.513752] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.530 qpair failed and we were unable to recover it. 00:28:05.530 [2024-11-28 19:16:26.523610] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.530 [2024-11-28 19:16:26.523699] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.530 [2024-11-28 19:16:26.523724] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.530 [2024-11-28 19:16:26.523738] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.530 [2024-11-28 19:16:26.523751] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.530 [2024-11-28 19:16:26.523779] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.530 qpair failed and we were unable to recover it. 00:28:05.530 [2024-11-28 19:16:26.533624] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.530 [2024-11-28 19:16:26.533707] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.530 [2024-11-28 19:16:26.533733] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.530 [2024-11-28 19:16:26.533748] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.530 [2024-11-28 19:16:26.533761] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.530 [2024-11-28 19:16:26.533789] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.530 qpair failed and we were unable to recover it. 00:28:05.530 [2024-11-28 19:16:26.543639] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.530 [2024-11-28 19:16:26.543721] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.530 [2024-11-28 19:16:26.543746] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.530 [2024-11-28 19:16:26.543761] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.530 [2024-11-28 19:16:26.543774] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.530 [2024-11-28 19:16:26.543801] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.530 qpair failed and we were unable to recover it. 00:28:05.530 [2024-11-28 19:16:26.553743] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.530 [2024-11-28 19:16:26.553837] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.530 [2024-11-28 19:16:26.553862] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.530 [2024-11-28 19:16:26.553876] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.530 [2024-11-28 19:16:26.553889] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.530 [2024-11-28 19:16:26.553917] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.530 qpair failed and we were unable to recover it. 00:28:05.530 [2024-11-28 19:16:26.563713] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.530 [2024-11-28 19:16:26.563804] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.530 [2024-11-28 19:16:26.563829] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.530 [2024-11-28 19:16:26.563844] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.530 [2024-11-28 19:16:26.563857] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.530 [2024-11-28 19:16:26.563885] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.530 qpair failed and we were unable to recover it. 00:28:05.530 [2024-11-28 19:16:26.573753] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.530 [2024-11-28 19:16:26.573841] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.530 [2024-11-28 19:16:26.573867] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.530 [2024-11-28 19:16:26.573882] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.530 [2024-11-28 19:16:26.573894] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.791 [2024-11-28 19:16:26.573923] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.791 qpair failed and we were unable to recover it. 00:28:05.791 [2024-11-28 19:16:26.583799] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.791 [2024-11-28 19:16:26.583891] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.791 [2024-11-28 19:16:26.583916] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.791 [2024-11-28 19:16:26.583930] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.791 [2024-11-28 19:16:26.583943] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.791 [2024-11-28 19:16:26.583971] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.791 qpair failed and we were unable to recover it. 00:28:05.791 [2024-11-28 19:16:26.593866] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.791 [2024-11-28 19:16:26.593955] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.791 [2024-11-28 19:16:26.593980] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.791 [2024-11-28 19:16:26.593994] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.791 [2024-11-28 19:16:26.594007] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.791 [2024-11-28 19:16:26.594037] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.791 qpair failed and we were unable to recover it. 00:28:05.791 [2024-11-28 19:16:26.603864] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.791 [2024-11-28 19:16:26.603991] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.791 [2024-11-28 19:16:26.604016] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.791 [2024-11-28 19:16:26.604031] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.791 [2024-11-28 19:16:26.604053] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.791 [2024-11-28 19:16:26.604082] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.791 qpair failed and we were unable to recover it. 00:28:05.791 [2024-11-28 19:16:26.613921] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.791 [2024-11-28 19:16:26.614020] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.791 [2024-11-28 19:16:26.614046] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.791 [2024-11-28 19:16:26.614060] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.791 [2024-11-28 19:16:26.614073] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.791 [2024-11-28 19:16:26.614102] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.791 qpair failed and we were unable to recover it. 00:28:05.791 [2024-11-28 19:16:26.623886] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.791 [2024-11-28 19:16:26.623971] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.791 [2024-11-28 19:16:26.623996] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.791 [2024-11-28 19:16:26.624010] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.791 [2024-11-28 19:16:26.624023] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.791 [2024-11-28 19:16:26.624051] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.791 qpair failed and we were unable to recover it. 00:28:05.791 [2024-11-28 19:16:26.633945] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.791 [2024-11-28 19:16:26.634032] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.791 [2024-11-28 19:16:26.634057] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.791 [2024-11-28 19:16:26.634072] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.791 [2024-11-28 19:16:26.634085] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.791 [2024-11-28 19:16:26.634113] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.791 qpair failed and we were unable to recover it. 00:28:05.791 [2024-11-28 19:16:26.643936] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.791 [2024-11-28 19:16:26.644022] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.791 [2024-11-28 19:16:26.644047] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.791 [2024-11-28 19:16:26.644062] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.791 [2024-11-28 19:16:26.644075] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.791 [2024-11-28 19:16:26.644102] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.791 qpair failed and we were unable to recover it. 00:28:05.791 [2024-11-28 19:16:26.653969] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.791 [2024-11-28 19:16:26.654100] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.791 [2024-11-28 19:16:26.654125] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.791 [2024-11-28 19:16:26.654140] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.791 [2024-11-28 19:16:26.654153] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.791 [2024-11-28 19:16:26.654181] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.791 qpair failed and we were unable to recover it. 00:28:05.791 [2024-11-28 19:16:26.664017] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.791 [2024-11-28 19:16:26.664143] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.791 [2024-11-28 19:16:26.664168] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.791 [2024-11-28 19:16:26.664182] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.791 [2024-11-28 19:16:26.664195] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.791 [2024-11-28 19:16:26.664223] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.791 qpair failed and we were unable to recover it. 00:28:05.791 [2024-11-28 19:16:26.674088] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.791 [2024-11-28 19:16:26.674187] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.791 [2024-11-28 19:16:26.674212] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.791 [2024-11-28 19:16:26.674227] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.791 [2024-11-28 19:16:26.674240] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.791 [2024-11-28 19:16:26.674268] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.791 qpair failed and we were unable to recover it. 00:28:05.791 [2024-11-28 19:16:26.684069] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.791 [2024-11-28 19:16:26.684195] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.791 [2024-11-28 19:16:26.684220] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.791 [2024-11-28 19:16:26.684235] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.791 [2024-11-28 19:16:26.684247] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.791 [2024-11-28 19:16:26.684276] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.791 qpair failed and we were unable to recover it. 00:28:05.791 [2024-11-28 19:16:26.694107] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.792 [2024-11-28 19:16:26.694200] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.792 [2024-11-28 19:16:26.694225] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.792 [2024-11-28 19:16:26.694240] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.792 [2024-11-28 19:16:26.694258] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.792 [2024-11-28 19:16:26.694288] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.792 qpair failed and we were unable to recover it. 00:28:05.792 [2024-11-28 19:16:26.704125] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.792 [2024-11-28 19:16:26.704209] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.792 [2024-11-28 19:16:26.704234] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.792 [2024-11-28 19:16:26.704249] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.792 [2024-11-28 19:16:26.704261] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.792 [2024-11-28 19:16:26.704289] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.792 qpair failed and we were unable to recover it. 00:28:05.792 [2024-11-28 19:16:26.714185] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.792 [2024-11-28 19:16:26.714307] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.792 [2024-11-28 19:16:26.714333] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.792 [2024-11-28 19:16:26.714347] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.792 [2024-11-28 19:16:26.714360] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.792 [2024-11-28 19:16:26.714390] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.792 qpair failed and we were unable to recover it. 00:28:05.792 [2024-11-28 19:16:26.724182] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.792 [2024-11-28 19:16:26.724266] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.792 [2024-11-28 19:16:26.724292] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.792 [2024-11-28 19:16:26.724306] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.792 [2024-11-28 19:16:26.724319] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.792 [2024-11-28 19:16:26.724347] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.792 qpair failed and we were unable to recover it. 00:28:05.792 [2024-11-28 19:16:26.734221] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.792 [2024-11-28 19:16:26.734308] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.792 [2024-11-28 19:16:26.734333] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.792 [2024-11-28 19:16:26.734348] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.792 [2024-11-28 19:16:26.734361] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.792 [2024-11-28 19:16:26.734390] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.792 qpair failed and we were unable to recover it. 00:28:05.792 [2024-11-28 19:16:26.744247] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.792 [2024-11-28 19:16:26.744364] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.792 [2024-11-28 19:16:26.744389] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.792 [2024-11-28 19:16:26.744411] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.792 [2024-11-28 19:16:26.744425] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.792 [2024-11-28 19:16:26.744453] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.792 qpair failed and we were unable to recover it. 00:28:05.792 [2024-11-28 19:16:26.754301] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.792 [2024-11-28 19:16:26.754422] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.792 [2024-11-28 19:16:26.754447] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.792 [2024-11-28 19:16:26.754461] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.792 [2024-11-28 19:16:26.754474] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.792 [2024-11-28 19:16:26.754502] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.792 qpair failed and we were unable to recover it. 00:28:05.792 [2024-11-28 19:16:26.764309] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.792 [2024-11-28 19:16:26.764398] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.792 [2024-11-28 19:16:26.764423] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.792 [2024-11-28 19:16:26.764437] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.792 [2024-11-28 19:16:26.764450] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.792 [2024-11-28 19:16:26.764478] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.792 qpair failed and we were unable to recover it. 00:28:05.792 [2024-11-28 19:16:26.774320] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.792 [2024-11-28 19:16:26.774415] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.792 [2024-11-28 19:16:26.774440] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.792 [2024-11-28 19:16:26.774454] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.792 [2024-11-28 19:16:26.774467] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.792 [2024-11-28 19:16:26.774496] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.792 qpair failed and we were unable to recover it. 00:28:05.792 [2024-11-28 19:16:26.784443] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.792 [2024-11-28 19:16:26.784540] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.792 [2024-11-28 19:16:26.784565] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.792 [2024-11-28 19:16:26.784585] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.792 [2024-11-28 19:16:26.784599] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.792 [2024-11-28 19:16:26.784628] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.792 qpair failed and we were unable to recover it. 00:28:05.792 [2024-11-28 19:16:26.794400] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.792 [2024-11-28 19:16:26.794488] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.792 [2024-11-28 19:16:26.794513] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.792 [2024-11-28 19:16:26.794528] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.792 [2024-11-28 19:16:26.794540] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.792 [2024-11-28 19:16:26.794569] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.792 qpair failed and we were unable to recover it. 00:28:05.792 [2024-11-28 19:16:26.804479] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.792 [2024-11-28 19:16:26.804573] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.792 [2024-11-28 19:16:26.804598] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.792 [2024-11-28 19:16:26.804612] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.792 [2024-11-28 19:16:26.804625] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.792 [2024-11-28 19:16:26.804655] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.792 qpair failed and we were unable to recover it. 00:28:05.792 [2024-11-28 19:16:26.814453] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.792 [2024-11-28 19:16:26.814533] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.792 [2024-11-28 19:16:26.814558] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.792 [2024-11-28 19:16:26.814572] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.792 [2024-11-28 19:16:26.814585] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.792 [2024-11-28 19:16:26.814614] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.792 qpair failed and we were unable to recover it. 00:28:05.792 [2024-11-28 19:16:26.824499] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.792 [2024-11-28 19:16:26.824599] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.792 [2024-11-28 19:16:26.824625] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.792 [2024-11-28 19:16:26.824640] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.793 [2024-11-28 19:16:26.824654] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.793 [2024-11-28 19:16:26.824683] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.793 qpair failed and we were unable to recover it. 00:28:05.793 [2024-11-28 19:16:26.834543] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:05.793 [2024-11-28 19:16:26.834663] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:05.793 [2024-11-28 19:16:26.834688] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:05.793 [2024-11-28 19:16:26.834702] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:05.793 [2024-11-28 19:16:26.834715] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:05.793 [2024-11-28 19:16:26.834743] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:05.793 qpair failed and we were unable to recover it. 00:28:06.053 [2024-11-28 19:16:26.844557] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.053 [2024-11-28 19:16:26.844688] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.053 [2024-11-28 19:16:26.844714] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.053 [2024-11-28 19:16:26.844728] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.053 [2024-11-28 19:16:26.844741] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.053 [2024-11-28 19:16:26.844769] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.053 qpair failed and we were unable to recover it. 00:28:06.053 [2024-11-28 19:16:26.854650] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.053 [2024-11-28 19:16:26.854733] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.053 [2024-11-28 19:16:26.854762] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.053 [2024-11-28 19:16:26.854779] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.053 [2024-11-28 19:16:26.854791] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.053 [2024-11-28 19:16:26.854821] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.053 qpair failed and we were unable to recover it. 00:28:06.053 [2024-11-28 19:16:26.864613] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.053 [2024-11-28 19:16:26.864698] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.053 [2024-11-28 19:16:26.864725] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.053 [2024-11-28 19:16:26.864739] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.053 [2024-11-28 19:16:26.864752] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.053 [2024-11-28 19:16:26.864780] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.053 qpair failed and we were unable to recover it. 00:28:06.053 [2024-11-28 19:16:26.874634] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.053 [2024-11-28 19:16:26.874749] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.053 [2024-11-28 19:16:26.874774] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.053 [2024-11-28 19:16:26.874796] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.053 [2024-11-28 19:16:26.874809] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.053 [2024-11-28 19:16:26.874838] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.053 qpair failed and we were unable to recover it. 00:28:06.053 [2024-11-28 19:16:26.884637] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.053 [2024-11-28 19:16:26.884768] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.053 [2024-11-28 19:16:26.884793] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.053 [2024-11-28 19:16:26.884807] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.053 [2024-11-28 19:16:26.884820] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.053 [2024-11-28 19:16:26.884848] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.053 qpair failed and we were unable to recover it. 00:28:06.053 [2024-11-28 19:16:26.894700] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.053 [2024-11-28 19:16:26.894784] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.053 [2024-11-28 19:16:26.894810] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.053 [2024-11-28 19:16:26.894824] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.053 [2024-11-28 19:16:26.894837] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.053 [2024-11-28 19:16:26.894866] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.053 qpair failed and we were unable to recover it. 00:28:06.053 [2024-11-28 19:16:26.904708] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.053 [2024-11-28 19:16:26.904829] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.053 [2024-11-28 19:16:26.904854] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.053 [2024-11-28 19:16:26.904869] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.053 [2024-11-28 19:16:26.904882] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.053 [2024-11-28 19:16:26.904910] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.053 qpair failed and we were unable to recover it. 00:28:06.053 [2024-11-28 19:16:26.914790] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.053 [2024-11-28 19:16:26.914926] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.053 [2024-11-28 19:16:26.914952] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.053 [2024-11-28 19:16:26.914966] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.053 [2024-11-28 19:16:26.914980] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.053 [2024-11-28 19:16:26.915010] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.053 qpair failed and we were unable to recover it. 00:28:06.053 [2024-11-28 19:16:26.924757] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.053 [2024-11-28 19:16:26.924841] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.053 [2024-11-28 19:16:26.924867] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.053 [2024-11-28 19:16:26.924881] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.053 [2024-11-28 19:16:26.924893] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.053 [2024-11-28 19:16:26.924920] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.053 qpair failed and we were unable to recover it. 00:28:06.053 [2024-11-28 19:16:26.934824] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.053 [2024-11-28 19:16:26.934911] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.053 [2024-11-28 19:16:26.934937] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.053 [2024-11-28 19:16:26.934951] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.053 [2024-11-28 19:16:26.934964] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.053 [2024-11-28 19:16:26.934992] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.053 qpair failed and we were unable to recover it. 00:28:06.053 [2024-11-28 19:16:26.944858] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.053 [2024-11-28 19:16:26.944950] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.053 [2024-11-28 19:16:26.944976] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.053 [2024-11-28 19:16:26.944990] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.053 [2024-11-28 19:16:26.945003] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.053 [2024-11-28 19:16:26.945031] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.053 qpair failed and we were unable to recover it. 00:28:06.053 [2024-11-28 19:16:26.954858] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.053 [2024-11-28 19:16:26.954947] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.054 [2024-11-28 19:16:26.954972] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.054 [2024-11-28 19:16:26.954986] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.054 [2024-11-28 19:16:26.954998] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.054 [2024-11-28 19:16:26.955026] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.054 qpair failed and we were unable to recover it. 00:28:06.054 [2024-11-28 19:16:26.964894] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.054 [2024-11-28 19:16:26.964981] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.054 [2024-11-28 19:16:26.965007] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.054 [2024-11-28 19:16:26.965027] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.054 [2024-11-28 19:16:26.965041] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.054 [2024-11-28 19:16:26.965069] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.054 qpair failed and we were unable to recover it. 00:28:06.054 [2024-11-28 19:16:26.974903] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.054 [2024-11-28 19:16:26.975030] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.054 [2024-11-28 19:16:26.975055] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.054 [2024-11-28 19:16:26.975070] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.054 [2024-11-28 19:16:26.975083] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.054 [2024-11-28 19:16:26.975111] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.054 qpair failed and we were unable to recover it. 00:28:06.054 [2024-11-28 19:16:26.984997] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.054 [2024-11-28 19:16:26.985125] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.054 [2024-11-28 19:16:26.985151] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.054 [2024-11-28 19:16:26.985166] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.054 [2024-11-28 19:16:26.985179] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.054 [2024-11-28 19:16:26.985206] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.054 qpair failed and we were unable to recover it. 00:28:06.054 [2024-11-28 19:16:26.995015] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.054 [2024-11-28 19:16:26.995120] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.054 [2024-11-28 19:16:26.995145] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.054 [2024-11-28 19:16:26.995160] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.054 [2024-11-28 19:16:26.995174] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.054 [2024-11-28 19:16:26.995203] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.054 qpair failed and we were unable to recover it. 00:28:06.054 [2024-11-28 19:16:27.005036] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.054 [2024-11-28 19:16:27.005127] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.054 [2024-11-28 19:16:27.005152] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.054 [2024-11-28 19:16:27.005167] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.054 [2024-11-28 19:16:27.005180] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.054 [2024-11-28 19:16:27.005209] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.054 qpair failed and we were unable to recover it. 00:28:06.054 [2024-11-28 19:16:27.015051] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.054 [2024-11-28 19:16:27.015145] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.054 [2024-11-28 19:16:27.015170] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.054 [2024-11-28 19:16:27.015184] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.054 [2024-11-28 19:16:27.015197] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.054 [2024-11-28 19:16:27.015226] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.054 qpair failed and we were unable to recover it. 00:28:06.054 [2024-11-28 19:16:27.025079] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.054 [2024-11-28 19:16:27.025166] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.054 [2024-11-28 19:16:27.025192] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.054 [2024-11-28 19:16:27.025207] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.054 [2024-11-28 19:16:27.025219] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.054 [2024-11-28 19:16:27.025248] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.054 qpair failed and we were unable to recover it. 00:28:06.054 [2024-11-28 19:16:27.035107] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.054 [2024-11-28 19:16:27.035212] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.054 [2024-11-28 19:16:27.035239] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.054 [2024-11-28 19:16:27.035257] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.054 [2024-11-28 19:16:27.035271] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.054 [2024-11-28 19:16:27.035300] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.054 qpair failed and we were unable to recover it. 00:28:06.054 [2024-11-28 19:16:27.045151] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.054 [2024-11-28 19:16:27.045235] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.054 [2024-11-28 19:16:27.045261] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.054 [2024-11-28 19:16:27.045275] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.054 [2024-11-28 19:16:27.045288] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.054 [2024-11-28 19:16:27.045316] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.054 qpair failed and we were unable to recover it. 00:28:06.054 [2024-11-28 19:16:27.055146] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.054 [2024-11-28 19:16:27.055234] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.054 [2024-11-28 19:16:27.055260] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.054 [2024-11-28 19:16:27.055281] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.054 [2024-11-28 19:16:27.055295] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.054 [2024-11-28 19:16:27.055324] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.054 qpair failed and we were unable to recover it. 00:28:06.054 [2024-11-28 19:16:27.065185] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.054 [2024-11-28 19:16:27.065316] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.054 [2024-11-28 19:16:27.065341] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.054 [2024-11-28 19:16:27.065356] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.054 [2024-11-28 19:16:27.065369] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.054 [2024-11-28 19:16:27.065406] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.054 qpair failed and we were unable to recover it. 00:28:06.054 [2024-11-28 19:16:27.075245] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.054 [2024-11-28 19:16:27.075365] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.054 [2024-11-28 19:16:27.075391] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.054 [2024-11-28 19:16:27.075417] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.054 [2024-11-28 19:16:27.075431] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.054 [2024-11-28 19:16:27.075460] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.054 qpair failed and we were unable to recover it. 00:28:06.054 [2024-11-28 19:16:27.085250] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.054 [2024-11-28 19:16:27.085339] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.054 [2024-11-28 19:16:27.085365] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.054 [2024-11-28 19:16:27.085388] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.054 [2024-11-28 19:16:27.085410] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.054 [2024-11-28 19:16:27.085438] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.054 qpair failed and we were unable to recover it. 00:28:06.055 [2024-11-28 19:16:27.095275] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.055 [2024-11-28 19:16:27.095373] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.055 [2024-11-28 19:16:27.095410] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.055 [2024-11-28 19:16:27.095427] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.055 [2024-11-28 19:16:27.095440] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.055 [2024-11-28 19:16:27.095468] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.055 qpair failed and we were unable to recover it. 00:28:06.315 [2024-11-28 19:16:27.105310] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.315 [2024-11-28 19:16:27.105406] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.315 [2024-11-28 19:16:27.105432] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.315 [2024-11-28 19:16:27.105447] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.315 [2024-11-28 19:16:27.105460] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.315 [2024-11-28 19:16:27.105488] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.315 qpair failed and we were unable to recover it. 00:28:06.315 [2024-11-28 19:16:27.115373] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.315 [2024-11-28 19:16:27.115478] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.315 [2024-11-28 19:16:27.115502] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.315 [2024-11-28 19:16:27.115517] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.315 [2024-11-28 19:16:27.115530] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.315 [2024-11-28 19:16:27.115558] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.315 qpair failed and we were unable to recover it. 00:28:06.315 [2024-11-28 19:16:27.125351] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.315 [2024-11-28 19:16:27.125453] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.315 [2024-11-28 19:16:27.125479] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.315 [2024-11-28 19:16:27.125493] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.315 [2024-11-28 19:16:27.125506] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.315 [2024-11-28 19:16:27.125534] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.315 qpair failed and we were unable to recover it. 00:28:06.315 [2024-11-28 19:16:27.135453] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.315 [2024-11-28 19:16:27.135555] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.315 [2024-11-28 19:16:27.135583] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.315 [2024-11-28 19:16:27.135600] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.315 [2024-11-28 19:16:27.135613] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.315 [2024-11-28 19:16:27.135642] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.315 qpair failed and we were unable to recover it. 00:28:06.315 [2024-11-28 19:16:27.145552] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.315 [2024-11-28 19:16:27.145686] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.315 [2024-11-28 19:16:27.145716] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.315 [2024-11-28 19:16:27.145731] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.315 [2024-11-28 19:16:27.145744] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.315 [2024-11-28 19:16:27.145772] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.315 qpair failed and we were unable to recover it. 00:28:06.315 [2024-11-28 19:16:27.155523] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.315 [2024-11-28 19:16:27.155658] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.315 [2024-11-28 19:16:27.155684] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.315 [2024-11-28 19:16:27.155698] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.315 [2024-11-28 19:16:27.155711] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.315 [2024-11-28 19:16:27.155742] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.315 qpair failed and we were unable to recover it. 00:28:06.315 [2024-11-28 19:16:27.165473] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.315 [2024-11-28 19:16:27.165581] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.315 [2024-11-28 19:16:27.165607] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.315 [2024-11-28 19:16:27.165622] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.315 [2024-11-28 19:16:27.165635] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.315 [2024-11-28 19:16:27.165662] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.315 qpair failed and we were unable to recover it. 00:28:06.315 [2024-11-28 19:16:27.175503] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.315 [2024-11-28 19:16:27.175589] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.315 [2024-11-28 19:16:27.175614] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.315 [2024-11-28 19:16:27.175629] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.315 [2024-11-28 19:16:27.175642] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.315 [2024-11-28 19:16:27.175670] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.315 qpair failed and we were unable to recover it. 00:28:06.315 [2024-11-28 19:16:27.185554] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.315 [2024-11-28 19:16:27.185640] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.315 [2024-11-28 19:16:27.185666] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.315 [2024-11-28 19:16:27.185680] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.315 [2024-11-28 19:16:27.185693] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.315 [2024-11-28 19:16:27.185721] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.315 qpair failed and we were unable to recover it. 00:28:06.315 [2024-11-28 19:16:27.195610] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.315 [2024-11-28 19:16:27.195740] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.315 [2024-11-28 19:16:27.195769] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.315 [2024-11-28 19:16:27.195788] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.315 [2024-11-28 19:16:27.195801] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.315 [2024-11-28 19:16:27.195830] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.315 qpair failed and we were unable to recover it. 00:28:06.315 [2024-11-28 19:16:27.205627] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.315 [2024-11-28 19:16:27.205714] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.315 [2024-11-28 19:16:27.205743] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.315 [2024-11-28 19:16:27.205759] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.315 [2024-11-28 19:16:27.205771] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.315 [2024-11-28 19:16:27.205800] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.315 qpair failed and we were unable to recover it. 00:28:06.315 [2024-11-28 19:16:27.215607] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.315 [2024-11-28 19:16:27.215694] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.315 [2024-11-28 19:16:27.215719] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.315 [2024-11-28 19:16:27.215733] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.315 [2024-11-28 19:16:27.215747] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.315 [2024-11-28 19:16:27.215775] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.315 qpair failed and we were unable to recover it. 00:28:06.315 [2024-11-28 19:16:27.225676] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.315 [2024-11-28 19:16:27.225755] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.315 [2024-11-28 19:16:27.225780] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.316 [2024-11-28 19:16:27.225794] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.316 [2024-11-28 19:16:27.225807] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.316 [2024-11-28 19:16:27.225835] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.316 qpair failed and we were unable to recover it. 00:28:06.316 [2024-11-28 19:16:27.235710] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.316 [2024-11-28 19:16:27.235798] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.316 [2024-11-28 19:16:27.235828] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.316 [2024-11-28 19:16:27.235844] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.316 [2024-11-28 19:16:27.235857] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.316 [2024-11-28 19:16:27.235885] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.316 qpair failed and we were unable to recover it. 00:28:06.316 [2024-11-28 19:16:27.245798] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.316 [2024-11-28 19:16:27.245886] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.316 [2024-11-28 19:16:27.245911] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.316 [2024-11-28 19:16:27.245926] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.316 [2024-11-28 19:16:27.245939] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.316 [2024-11-28 19:16:27.245967] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.316 qpair failed and we were unable to recover it. 00:28:06.316 [2024-11-28 19:16:27.255720] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.316 [2024-11-28 19:16:27.255803] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.316 [2024-11-28 19:16:27.255828] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.316 [2024-11-28 19:16:27.255843] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.316 [2024-11-28 19:16:27.255856] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.316 [2024-11-28 19:16:27.255884] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.316 qpair failed and we were unable to recover it. 00:28:06.316 [2024-11-28 19:16:27.265757] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.316 [2024-11-28 19:16:27.265842] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.316 [2024-11-28 19:16:27.265867] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.316 [2024-11-28 19:16:27.265881] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.316 [2024-11-28 19:16:27.265894] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.316 [2024-11-28 19:16:27.265922] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.316 qpair failed and we were unable to recover it. 00:28:06.316 [2024-11-28 19:16:27.275803] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.316 [2024-11-28 19:16:27.275930] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.316 [2024-11-28 19:16:27.275955] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.316 [2024-11-28 19:16:27.275969] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.316 [2024-11-28 19:16:27.275983] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.316 [2024-11-28 19:16:27.276017] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.316 qpair failed and we were unable to recover it. 00:28:06.316 [2024-11-28 19:16:27.285813] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.316 [2024-11-28 19:16:27.285940] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.316 [2024-11-28 19:16:27.285965] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.316 [2024-11-28 19:16:27.285980] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.316 [2024-11-28 19:16:27.285993] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.316 [2024-11-28 19:16:27.286020] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.316 qpair failed and we were unable to recover it. 00:28:06.316 [2024-11-28 19:16:27.295851] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.316 [2024-11-28 19:16:27.295974] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.316 [2024-11-28 19:16:27.295999] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.316 [2024-11-28 19:16:27.296013] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.316 [2024-11-28 19:16:27.296026] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.316 [2024-11-28 19:16:27.296055] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.316 qpair failed and we were unable to recover it. 00:28:06.316 [2024-11-28 19:16:27.305876] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.316 [2024-11-28 19:16:27.306007] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.316 [2024-11-28 19:16:27.306033] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.316 [2024-11-28 19:16:27.306047] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.316 [2024-11-28 19:16:27.306060] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.316 [2024-11-28 19:16:27.306088] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.316 qpair failed and we were unable to recover it. 00:28:06.316 [2024-11-28 19:16:27.315965] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.316 [2024-11-28 19:16:27.316074] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.316 [2024-11-28 19:16:27.316099] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.316 [2024-11-28 19:16:27.316113] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.316 [2024-11-28 19:16:27.316126] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.316 [2024-11-28 19:16:27.316156] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.316 qpair failed and we were unable to recover it. 00:28:06.316 [2024-11-28 19:16:27.326055] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.316 [2024-11-28 19:16:27.326149] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.316 [2024-11-28 19:16:27.326183] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.316 [2024-11-28 19:16:27.326198] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.316 [2024-11-28 19:16:27.326211] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.316 [2024-11-28 19:16:27.326238] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.316 qpair failed and we were unable to recover it. 00:28:06.316 [2024-11-28 19:16:27.335997] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.316 [2024-11-28 19:16:27.336085] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.316 [2024-11-28 19:16:27.336110] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.316 [2024-11-28 19:16:27.336124] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.316 [2024-11-28 19:16:27.336137] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.316 [2024-11-28 19:16:27.336165] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.316 qpair failed and we were unable to recover it. 00:28:06.316 [2024-11-28 19:16:27.346022] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.316 [2024-11-28 19:16:27.346106] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.316 [2024-11-28 19:16:27.346131] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.316 [2024-11-28 19:16:27.346146] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.316 [2024-11-28 19:16:27.346159] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.316 [2024-11-28 19:16:27.346186] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.316 qpair failed and we were unable to recover it. 00:28:06.316 [2024-11-28 19:16:27.356042] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.316 [2024-11-28 19:16:27.356129] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.316 [2024-11-28 19:16:27.356154] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.316 [2024-11-28 19:16:27.356169] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.316 [2024-11-28 19:16:27.356182] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.316 [2024-11-28 19:16:27.356209] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.316 qpair failed and we were unable to recover it. 00:28:06.576 [2024-11-28 19:16:27.366062] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.576 [2024-11-28 19:16:27.366151] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.576 [2024-11-28 19:16:27.366176] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.576 [2024-11-28 19:16:27.366190] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.576 [2024-11-28 19:16:27.366203] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.576 [2024-11-28 19:16:27.366238] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.576 qpair failed and we were unable to recover it. 00:28:06.576 [2024-11-28 19:16:27.376192] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.576 [2024-11-28 19:16:27.376320] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.576 [2024-11-28 19:16:27.376346] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.576 [2024-11-28 19:16:27.376360] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.576 [2024-11-28 19:16:27.376373] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.576 [2024-11-28 19:16:27.376410] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.576 qpair failed and we were unable to recover it. 00:28:06.576 [2024-11-28 19:16:27.386115] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.576 [2024-11-28 19:16:27.386209] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.576 [2024-11-28 19:16:27.386235] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.576 [2024-11-28 19:16:27.386249] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.576 [2024-11-28 19:16:27.386262] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.576 [2024-11-28 19:16:27.386290] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.576 qpair failed and we were unable to recover it. 00:28:06.576 [2024-11-28 19:16:27.396156] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.576 [2024-11-28 19:16:27.396271] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.576 [2024-11-28 19:16:27.396295] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.576 [2024-11-28 19:16:27.396310] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.576 [2024-11-28 19:16:27.396322] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.576 [2024-11-28 19:16:27.396352] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.576 qpair failed and we were unable to recover it. 00:28:06.576 [2024-11-28 19:16:27.406210] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.576 [2024-11-28 19:16:27.406292] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.576 [2024-11-28 19:16:27.406317] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.576 [2024-11-28 19:16:27.406332] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.576 [2024-11-28 19:16:27.406344] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.576 [2024-11-28 19:16:27.406372] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.576 qpair failed and we were unable to recover it. 00:28:06.576 [2024-11-28 19:16:27.416212] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.576 [2024-11-28 19:16:27.416304] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.576 [2024-11-28 19:16:27.416334] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.576 [2024-11-28 19:16:27.416350] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.576 [2024-11-28 19:16:27.416362] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.576 [2024-11-28 19:16:27.416390] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.576 qpair failed and we were unable to recover it. 00:28:06.576 [2024-11-28 19:16:27.426228] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.576 [2024-11-28 19:16:27.426311] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.576 [2024-11-28 19:16:27.426337] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.576 [2024-11-28 19:16:27.426351] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.576 [2024-11-28 19:16:27.426364] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.576 [2024-11-28 19:16:27.426400] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.576 qpair failed and we were unable to recover it. 00:28:06.576 [2024-11-28 19:16:27.436380] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.576 [2024-11-28 19:16:27.436510] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.577 [2024-11-28 19:16:27.436535] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.577 [2024-11-28 19:16:27.436549] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.577 [2024-11-28 19:16:27.436562] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.577 [2024-11-28 19:16:27.436592] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.577 qpair failed and we were unable to recover it. 00:28:06.577 [2024-11-28 19:16:27.446301] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.577 [2024-11-28 19:16:27.446385] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.577 [2024-11-28 19:16:27.446417] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.577 [2024-11-28 19:16:27.446431] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.577 [2024-11-28 19:16:27.446444] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.577 [2024-11-28 19:16:27.446472] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.577 qpair failed and we were unable to recover it. 00:28:06.577 [2024-11-28 19:16:27.456334] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.577 [2024-11-28 19:16:27.456426] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.577 [2024-11-28 19:16:27.456452] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.577 [2024-11-28 19:16:27.456466] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.577 [2024-11-28 19:16:27.456480] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.577 [2024-11-28 19:16:27.456514] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.577 qpair failed and we were unable to recover it. 00:28:06.577 [2024-11-28 19:16:27.466375] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.577 [2024-11-28 19:16:27.466474] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.577 [2024-11-28 19:16:27.466499] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.577 [2024-11-28 19:16:27.466514] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.577 [2024-11-28 19:16:27.466528] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.577 [2024-11-28 19:16:27.466555] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.577 qpair failed and we were unable to recover it. 00:28:06.577 [2024-11-28 19:16:27.476389] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.577 [2024-11-28 19:16:27.476519] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.577 [2024-11-28 19:16:27.476544] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.577 [2024-11-28 19:16:27.476559] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.577 [2024-11-28 19:16:27.476572] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.577 [2024-11-28 19:16:27.476601] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.577 qpair failed and we were unable to recover it. 00:28:06.577 [2024-11-28 19:16:27.486453] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.577 [2024-11-28 19:16:27.486546] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.577 [2024-11-28 19:16:27.486571] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.577 [2024-11-28 19:16:27.486586] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.577 [2024-11-28 19:16:27.486598] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.577 [2024-11-28 19:16:27.486627] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.577 qpair failed and we were unable to recover it. 00:28:06.577 [2024-11-28 19:16:27.496494] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.577 [2024-11-28 19:16:27.496609] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.577 [2024-11-28 19:16:27.496635] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.577 [2024-11-28 19:16:27.496649] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.577 [2024-11-28 19:16:27.496662] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.577 [2024-11-28 19:16:27.496691] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.577 qpair failed and we were unable to recover it. 00:28:06.577 [2024-11-28 19:16:27.506477] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.577 [2024-11-28 19:16:27.506604] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.577 [2024-11-28 19:16:27.506634] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.577 [2024-11-28 19:16:27.506649] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.577 [2024-11-28 19:16:27.506662] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.577 [2024-11-28 19:16:27.506690] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.577 qpair failed and we were unable to recover it. 00:28:06.577 [2024-11-28 19:16:27.516521] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.577 [2024-11-28 19:16:27.516643] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.577 [2024-11-28 19:16:27.516669] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.577 [2024-11-28 19:16:27.516683] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.577 [2024-11-28 19:16:27.516696] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.577 [2024-11-28 19:16:27.516723] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.577 qpair failed and we were unable to recover it. 00:28:06.577 [2024-11-28 19:16:27.526620] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.577 [2024-11-28 19:16:27.526707] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.577 [2024-11-28 19:16:27.526732] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.577 [2024-11-28 19:16:27.526747] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.577 [2024-11-28 19:16:27.526760] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.577 [2024-11-28 19:16:27.526788] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.577 qpair failed and we were unable to recover it. 00:28:06.577 [2024-11-28 19:16:27.536591] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.577 [2024-11-28 19:16:27.536722] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.577 [2024-11-28 19:16:27.536747] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.577 [2024-11-28 19:16:27.536761] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.577 [2024-11-28 19:16:27.536774] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.577 [2024-11-28 19:16:27.536801] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.577 qpair failed and we were unable to recover it. 00:28:06.577 [2024-11-28 19:16:27.546574] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.577 [2024-11-28 19:16:27.546660] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.577 [2024-11-28 19:16:27.546685] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.577 [2024-11-28 19:16:27.546700] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.577 [2024-11-28 19:16:27.546714] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.577 [2024-11-28 19:16:27.546748] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.577 qpair failed and we were unable to recover it. 00:28:06.577 [2024-11-28 19:16:27.556619] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.577 [2024-11-28 19:16:27.556713] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.577 [2024-11-28 19:16:27.556738] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.577 [2024-11-28 19:16:27.556753] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.577 [2024-11-28 19:16:27.556766] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.577 [2024-11-28 19:16:27.556794] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.577 qpair failed and we were unable to recover it. 00:28:06.577 [2024-11-28 19:16:27.566642] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.577 [2024-11-28 19:16:27.566735] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.577 [2024-11-28 19:16:27.566760] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.577 [2024-11-28 19:16:27.566775] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.577 [2024-11-28 19:16:27.566788] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.577 [2024-11-28 19:16:27.566815] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.578 qpair failed and we were unable to recover it. 00:28:06.578 [2024-11-28 19:16:27.576679] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.578 [2024-11-28 19:16:27.576765] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.578 [2024-11-28 19:16:27.576789] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.578 [2024-11-28 19:16:27.576804] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.578 [2024-11-28 19:16:27.576817] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.578 [2024-11-28 19:16:27.576845] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.578 qpair failed and we were unable to recover it. 00:28:06.578 [2024-11-28 19:16:27.586720] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.578 [2024-11-28 19:16:27.586848] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.578 [2024-11-28 19:16:27.586873] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.578 [2024-11-28 19:16:27.586887] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.578 [2024-11-28 19:16:27.586900] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.578 [2024-11-28 19:16:27.586929] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.578 qpair failed and we were unable to recover it. 00:28:06.578 [2024-11-28 19:16:27.596741] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.578 [2024-11-28 19:16:27.596828] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.578 [2024-11-28 19:16:27.596859] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.578 [2024-11-28 19:16:27.596874] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.578 [2024-11-28 19:16:27.596887] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.578 [2024-11-28 19:16:27.596916] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.578 qpair failed and we were unable to recover it. 00:28:06.578 [2024-11-28 19:16:27.606760] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.578 [2024-11-28 19:16:27.606892] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.578 [2024-11-28 19:16:27.606918] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.578 [2024-11-28 19:16:27.606932] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.578 [2024-11-28 19:16:27.606945] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.578 [2024-11-28 19:16:27.606972] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.578 qpair failed and we were unable to recover it. 00:28:06.578 [2024-11-28 19:16:27.616870] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.578 [2024-11-28 19:16:27.616962] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.578 [2024-11-28 19:16:27.616988] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.578 [2024-11-28 19:16:27.617002] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.578 [2024-11-28 19:16:27.617015] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.578 [2024-11-28 19:16:27.617043] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.578 qpair failed and we were unable to recover it. 00:28:06.839 [2024-11-28 19:16:27.626923] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.839 [2024-11-28 19:16:27.627004] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.839 [2024-11-28 19:16:27.627030] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.839 [2024-11-28 19:16:27.627044] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.839 [2024-11-28 19:16:27.627057] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.839 [2024-11-28 19:16:27.627085] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.839 qpair failed and we were unable to recover it. 00:28:06.839 [2024-11-28 19:16:27.636869] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.839 [2024-11-28 19:16:27.636981] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.839 [2024-11-28 19:16:27.637007] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.839 [2024-11-28 19:16:27.637022] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.839 [2024-11-28 19:16:27.637047] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.839 [2024-11-28 19:16:27.637076] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.839 qpair failed and we were unable to recover it. 00:28:06.839 [2024-11-28 19:16:27.646900] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.839 [2024-11-28 19:16:27.646986] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.839 [2024-11-28 19:16:27.647011] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.839 [2024-11-28 19:16:27.647025] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.839 [2024-11-28 19:16:27.647038] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.839 [2024-11-28 19:16:27.647067] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.839 qpair failed and we were unable to recover it. 00:28:06.839 [2024-11-28 19:16:27.656905] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.839 [2024-11-28 19:16:27.656987] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.839 [2024-11-28 19:16:27.657012] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.839 [2024-11-28 19:16:27.657026] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.839 [2024-11-28 19:16:27.657040] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.839 [2024-11-28 19:16:27.657068] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.839 qpair failed and we were unable to recover it. 00:28:06.839 [2024-11-28 19:16:27.666936] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.839 [2024-11-28 19:16:27.667030] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.839 [2024-11-28 19:16:27.667054] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.839 [2024-11-28 19:16:27.667069] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.839 [2024-11-28 19:16:27.667081] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.839 [2024-11-28 19:16:27.667109] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.839 qpair failed and we were unable to recover it. 00:28:06.839 [2024-11-28 19:16:27.676970] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.839 [2024-11-28 19:16:27.677057] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.839 [2024-11-28 19:16:27.677083] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.839 [2024-11-28 19:16:27.677097] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.839 [2024-11-28 19:16:27.677110] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.839 [2024-11-28 19:16:27.677138] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.839 qpair failed and we were unable to recover it. 00:28:06.839 [2024-11-28 19:16:27.687025] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.839 [2024-11-28 19:16:27.687152] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.839 [2024-11-28 19:16:27.687178] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.839 [2024-11-28 19:16:27.687192] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.839 [2024-11-28 19:16:27.687206] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.839 [2024-11-28 19:16:27.687233] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.839 qpair failed and we were unable to recover it. 00:28:06.839 [2024-11-28 19:16:27.697037] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.839 [2024-11-28 19:16:27.697128] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.839 [2024-11-28 19:16:27.697153] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.839 [2024-11-28 19:16:27.697168] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.839 [2024-11-28 19:16:27.697181] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.839 [2024-11-28 19:16:27.697209] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.839 qpair failed and we were unable to recover it. 00:28:06.839 [2024-11-28 19:16:27.707121] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.839 [2024-11-28 19:16:27.707207] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.840 [2024-11-28 19:16:27.707233] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.840 [2024-11-28 19:16:27.707248] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.840 [2024-11-28 19:16:27.707260] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.840 [2024-11-28 19:16:27.707288] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.840 qpair failed and we were unable to recover it. 00:28:06.840 [2024-11-28 19:16:27.717133] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.840 [2024-11-28 19:16:27.717221] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.840 [2024-11-28 19:16:27.717247] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.840 [2024-11-28 19:16:27.717261] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.840 [2024-11-28 19:16:27.717274] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.840 [2024-11-28 19:16:27.717302] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.840 qpair failed and we were unable to recover it. 00:28:06.840 [2024-11-28 19:16:27.727140] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.840 [2024-11-28 19:16:27.727256] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.840 [2024-11-28 19:16:27.727282] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.840 [2024-11-28 19:16:27.727296] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.840 [2024-11-28 19:16:27.727314] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.840 [2024-11-28 19:16:27.727343] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.840 qpair failed and we were unable to recover it. 00:28:06.840 [2024-11-28 19:16:27.737175] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.840 [2024-11-28 19:16:27.737257] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.840 [2024-11-28 19:16:27.737282] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.840 [2024-11-28 19:16:27.737296] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.840 [2024-11-28 19:16:27.737309] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.840 [2024-11-28 19:16:27.737338] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.840 qpair failed and we were unable to recover it. 00:28:06.840 [2024-11-28 19:16:27.747189] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.840 [2024-11-28 19:16:27.747274] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.840 [2024-11-28 19:16:27.747299] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.840 [2024-11-28 19:16:27.747313] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.840 [2024-11-28 19:16:27.747326] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.840 [2024-11-28 19:16:27.747353] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.840 qpair failed and we were unable to recover it. 00:28:06.840 [2024-11-28 19:16:27.757269] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.840 [2024-11-28 19:16:27.757383] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.840 [2024-11-28 19:16:27.757417] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.840 [2024-11-28 19:16:27.757433] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.840 [2024-11-28 19:16:27.757446] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.840 [2024-11-28 19:16:27.757474] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.840 qpair failed and we were unable to recover it. 00:28:06.840 [2024-11-28 19:16:27.767296] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.840 [2024-11-28 19:16:27.767399] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.840 [2024-11-28 19:16:27.767426] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.840 [2024-11-28 19:16:27.767441] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.840 [2024-11-28 19:16:27.767454] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.840 [2024-11-28 19:16:27.767484] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.840 qpair failed and we were unable to recover it. 00:28:06.840 [2024-11-28 19:16:27.777266] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.840 [2024-11-28 19:16:27.777352] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.840 [2024-11-28 19:16:27.777377] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.840 [2024-11-28 19:16:27.777398] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.840 [2024-11-28 19:16:27.777415] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.840 [2024-11-28 19:16:27.777444] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.840 qpair failed and we were unable to recover it. 00:28:06.840 [2024-11-28 19:16:27.787308] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.840 [2024-11-28 19:16:27.787400] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.840 [2024-11-28 19:16:27.787426] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.840 [2024-11-28 19:16:27.787440] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.840 [2024-11-28 19:16:27.787454] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.840 [2024-11-28 19:16:27.787482] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.840 qpair failed and we were unable to recover it. 00:28:06.840 [2024-11-28 19:16:27.797326] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.840 [2024-11-28 19:16:27.797417] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.840 [2024-11-28 19:16:27.797443] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.840 [2024-11-28 19:16:27.797457] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.840 [2024-11-28 19:16:27.797470] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.840 [2024-11-28 19:16:27.797498] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.840 qpair failed and we were unable to recover it. 00:28:06.840 [2024-11-28 19:16:27.807376] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.840 [2024-11-28 19:16:27.807470] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.840 [2024-11-28 19:16:27.807500] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.840 [2024-11-28 19:16:27.807517] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.840 [2024-11-28 19:16:27.807530] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.840 [2024-11-28 19:16:27.807559] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.840 qpair failed and we were unable to recover it. 00:28:06.840 [2024-11-28 19:16:27.817384] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.840 [2024-11-28 19:16:27.817519] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.840 [2024-11-28 19:16:27.817545] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.840 [2024-11-28 19:16:27.817559] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.840 [2024-11-28 19:16:27.817577] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.840 [2024-11-28 19:16:27.817607] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.840 qpair failed and we were unable to recover it. 00:28:06.840 [2024-11-28 19:16:27.827422] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.840 [2024-11-28 19:16:27.827544] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.840 [2024-11-28 19:16:27.827569] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.840 [2024-11-28 19:16:27.827584] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.840 [2024-11-28 19:16:27.827597] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.840 [2024-11-28 19:16:27.827625] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.840 qpair failed and we were unable to recover it. 00:28:06.840 [2024-11-28 19:16:27.837474] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.840 [2024-11-28 19:16:27.837562] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.840 [2024-11-28 19:16:27.837587] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.840 [2024-11-28 19:16:27.837601] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.840 [2024-11-28 19:16:27.837613] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.840 [2024-11-28 19:16:27.837642] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.840 qpair failed and we were unable to recover it. 00:28:06.841 [2024-11-28 19:16:27.847507] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.841 [2024-11-28 19:16:27.847594] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.841 [2024-11-28 19:16:27.847620] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.841 [2024-11-28 19:16:27.847634] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.841 [2024-11-28 19:16:27.847647] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.841 [2024-11-28 19:16:27.847675] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.841 qpair failed and we were unable to recover it. 00:28:06.841 [2024-11-28 19:16:27.857536] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.841 [2024-11-28 19:16:27.857624] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.841 [2024-11-28 19:16:27.857653] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.841 [2024-11-28 19:16:27.857670] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.841 [2024-11-28 19:16:27.857682] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.841 [2024-11-28 19:16:27.857711] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.841 qpair failed and we were unable to recover it. 00:28:06.841 [2024-11-28 19:16:27.867667] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.841 [2024-11-28 19:16:27.867754] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.841 [2024-11-28 19:16:27.867780] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.841 [2024-11-28 19:16:27.867795] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.841 [2024-11-28 19:16:27.867808] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.841 [2024-11-28 19:16:27.867836] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.841 qpair failed and we were unable to recover it. 00:28:06.841 [2024-11-28 19:16:27.877593] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:06.841 [2024-11-28 19:16:27.877679] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:06.841 [2024-11-28 19:16:27.877705] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:06.841 [2024-11-28 19:16:27.877720] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:06.841 [2024-11-28 19:16:27.877733] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:06.841 [2024-11-28 19:16:27.877761] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:06.841 qpair failed and we were unable to recover it. 00:28:07.100 [2024-11-28 19:16:27.887635] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.100 [2024-11-28 19:16:27.887758] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.100 [2024-11-28 19:16:27.887783] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.100 [2024-11-28 19:16:27.887797] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.100 [2024-11-28 19:16:27.887810] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.100 [2024-11-28 19:16:27.887838] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.100 qpair failed and we were unable to recover it. 00:28:07.100 [2024-11-28 19:16:27.897656] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.100 [2024-11-28 19:16:27.897743] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.100 [2024-11-28 19:16:27.897769] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.100 [2024-11-28 19:16:27.897783] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.100 [2024-11-28 19:16:27.897796] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.100 [2024-11-28 19:16:27.897824] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.100 qpair failed and we were unable to recover it. 00:28:07.100 [2024-11-28 19:16:27.907711] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.101 [2024-11-28 19:16:27.907826] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.101 [2024-11-28 19:16:27.907851] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.101 [2024-11-28 19:16:27.907866] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.101 [2024-11-28 19:16:27.907884] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.101 [2024-11-28 19:16:27.907913] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.101 qpair failed and we were unable to recover it. 00:28:07.101 [2024-11-28 19:16:27.917706] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.101 [2024-11-28 19:16:27.917808] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.101 [2024-11-28 19:16:27.917833] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.101 [2024-11-28 19:16:27.917848] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.101 [2024-11-28 19:16:27.917861] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.101 [2024-11-28 19:16:27.917889] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.101 qpair failed and we were unable to recover it. 00:28:07.101 [2024-11-28 19:16:27.927720] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.101 [2024-11-28 19:16:27.927803] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.101 [2024-11-28 19:16:27.927827] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.101 [2024-11-28 19:16:27.927841] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.101 [2024-11-28 19:16:27.927853] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.101 [2024-11-28 19:16:27.927881] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.101 qpair failed and we were unable to recover it. 00:28:07.101 [2024-11-28 19:16:27.937742] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.101 [2024-11-28 19:16:27.937857] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.101 [2024-11-28 19:16:27.937882] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.101 [2024-11-28 19:16:27.937897] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.101 [2024-11-28 19:16:27.937910] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.101 [2024-11-28 19:16:27.937939] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.101 qpair failed and we were unable to recover it. 00:28:07.101 [2024-11-28 19:16:27.947841] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.101 [2024-11-28 19:16:27.947936] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.101 [2024-11-28 19:16:27.947961] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.101 [2024-11-28 19:16:27.947976] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.101 [2024-11-28 19:16:27.947988] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.101 [2024-11-28 19:16:27.948016] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.101 qpair failed and we were unable to recover it. 00:28:07.101 [2024-11-28 19:16:27.957843] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.101 [2024-11-28 19:16:27.957935] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.101 [2024-11-28 19:16:27.957960] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.101 [2024-11-28 19:16:27.957975] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.101 [2024-11-28 19:16:27.957988] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.101 [2024-11-28 19:16:27.958016] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.101 qpair failed and we were unable to recover it. 00:28:07.101 [2024-11-28 19:16:27.967867] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.101 [2024-11-28 19:16:27.967987] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.101 [2024-11-28 19:16:27.968012] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.101 [2024-11-28 19:16:27.968026] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.101 [2024-11-28 19:16:27.968040] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.101 [2024-11-28 19:16:27.968067] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.101 qpair failed and we were unable to recover it. 00:28:07.101 [2024-11-28 19:16:27.977904] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.101 [2024-11-28 19:16:27.977993] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.101 [2024-11-28 19:16:27.978018] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.101 [2024-11-28 19:16:27.978032] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.101 [2024-11-28 19:16:27.978045] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.101 [2024-11-28 19:16:27.978074] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.101 qpair failed and we were unable to recover it. 00:28:07.101 [2024-11-28 19:16:27.987909] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.101 [2024-11-28 19:16:27.987989] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.101 [2024-11-28 19:16:27.988014] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.101 [2024-11-28 19:16:27.988029] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.101 [2024-11-28 19:16:27.988043] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.101 [2024-11-28 19:16:27.988071] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.101 qpair failed and we were unable to recover it. 00:28:07.101 [2024-11-28 19:16:27.997967] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.101 [2024-11-28 19:16:27.998051] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.101 [2024-11-28 19:16:27.998077] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.101 [2024-11-28 19:16:27.998099] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.101 [2024-11-28 19:16:27.998113] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.101 [2024-11-28 19:16:27.998143] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.101 qpair failed and we were unable to recover it. 00:28:07.101 [2024-11-28 19:16:28.007960] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.101 [2024-11-28 19:16:28.008042] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.101 [2024-11-28 19:16:28.008067] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.101 [2024-11-28 19:16:28.008082] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.101 [2024-11-28 19:16:28.008095] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.101 [2024-11-28 19:16:28.008123] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.101 qpair failed and we were unable to recover it. 00:28:07.101 [2024-11-28 19:16:28.018030] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.101 [2024-11-28 19:16:28.018117] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.101 [2024-11-28 19:16:28.018143] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.101 [2024-11-28 19:16:28.018158] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.101 [2024-11-28 19:16:28.018171] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.101 [2024-11-28 19:16:28.018200] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.101 qpair failed and we were unable to recover it. 00:28:07.101 [2024-11-28 19:16:28.028023] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.101 [2024-11-28 19:16:28.028108] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.101 [2024-11-28 19:16:28.028133] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.101 [2024-11-28 19:16:28.028147] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.101 [2024-11-28 19:16:28.028160] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.101 [2024-11-28 19:16:28.028188] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.101 qpair failed and we were unable to recover it. 00:28:07.101 [2024-11-28 19:16:28.038067] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.101 [2024-11-28 19:16:28.038154] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.101 [2024-11-28 19:16:28.038180] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.101 [2024-11-28 19:16:28.038194] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.102 [2024-11-28 19:16:28.038207] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.102 [2024-11-28 19:16:28.038235] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.102 qpair failed and we were unable to recover it. 00:28:07.102 [2024-11-28 19:16:28.048092] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.102 [2024-11-28 19:16:28.048184] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.102 [2024-11-28 19:16:28.048210] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.102 [2024-11-28 19:16:28.048224] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.102 [2024-11-28 19:16:28.048238] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.102 [2024-11-28 19:16:28.048268] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.102 qpair failed and we were unable to recover it. 00:28:07.102 [2024-11-28 19:16:28.058101] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.102 [2024-11-28 19:16:28.058216] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.102 [2024-11-28 19:16:28.058242] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.102 [2024-11-28 19:16:28.058257] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.102 [2024-11-28 19:16:28.058271] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.102 [2024-11-28 19:16:28.058299] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.102 qpair failed and we were unable to recover it. 00:28:07.102 [2024-11-28 19:16:28.068161] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.102 [2024-11-28 19:16:28.068245] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.102 [2024-11-28 19:16:28.068271] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.102 [2024-11-28 19:16:28.068286] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.102 [2024-11-28 19:16:28.068299] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.102 [2024-11-28 19:16:28.068327] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.102 qpair failed and we were unable to recover it. 00:28:07.102 [2024-11-28 19:16:28.078182] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.102 [2024-11-28 19:16:28.078272] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.102 [2024-11-28 19:16:28.078297] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.102 [2024-11-28 19:16:28.078311] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.102 [2024-11-28 19:16:28.078324] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.102 [2024-11-28 19:16:28.078353] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.102 qpair failed and we were unable to recover it. 00:28:07.102 [2024-11-28 19:16:28.088189] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.102 [2024-11-28 19:16:28.088280] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.102 [2024-11-28 19:16:28.088306] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.102 [2024-11-28 19:16:28.088326] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.102 [2024-11-28 19:16:28.088340] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.102 [2024-11-28 19:16:28.088368] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.102 qpair failed and we were unable to recover it. 00:28:07.102 [2024-11-28 19:16:28.098290] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.102 [2024-11-28 19:16:28.098425] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.102 [2024-11-28 19:16:28.098451] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.102 [2024-11-28 19:16:28.098466] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.102 [2024-11-28 19:16:28.098479] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.102 [2024-11-28 19:16:28.098509] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.102 qpair failed and we were unable to recover it. 00:28:07.102 [2024-11-28 19:16:28.108341] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.102 [2024-11-28 19:16:28.108439] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.102 [2024-11-28 19:16:28.108465] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.102 [2024-11-28 19:16:28.108479] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.102 [2024-11-28 19:16:28.108492] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.102 [2024-11-28 19:16:28.108522] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.102 qpair failed and we were unable to recover it. 00:28:07.102 [2024-11-28 19:16:28.118358] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.102 [2024-11-28 19:16:28.118474] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.102 [2024-11-28 19:16:28.118499] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.102 [2024-11-28 19:16:28.118513] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.102 [2024-11-28 19:16:28.118526] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.102 [2024-11-28 19:16:28.118554] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.102 qpair failed and we were unable to recover it. 00:28:07.102 [2024-11-28 19:16:28.128354] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.102 [2024-11-28 19:16:28.128477] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.102 [2024-11-28 19:16:28.128503] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.102 [2024-11-28 19:16:28.128518] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.102 [2024-11-28 19:16:28.128532] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.102 [2024-11-28 19:16:28.128560] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.102 qpair failed and we were unable to recover it. 00:28:07.102 [2024-11-28 19:16:28.138437] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.102 [2024-11-28 19:16:28.138527] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.102 [2024-11-28 19:16:28.138553] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.102 [2024-11-28 19:16:28.138567] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.102 [2024-11-28 19:16:28.138580] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.102 [2024-11-28 19:16:28.138609] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.102 qpair failed and we were unable to recover it. 00:28:07.361 [2024-11-28 19:16:28.148403] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.361 [2024-11-28 19:16:28.148492] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.361 [2024-11-28 19:16:28.148517] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.361 [2024-11-28 19:16:28.148531] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.361 [2024-11-28 19:16:28.148544] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.361 [2024-11-28 19:16:28.148572] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.361 qpair failed and we were unable to recover it. 00:28:07.361 [2024-11-28 19:16:28.158502] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.361 [2024-11-28 19:16:28.158590] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.361 [2024-11-28 19:16:28.158615] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.361 [2024-11-28 19:16:28.158629] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.361 [2024-11-28 19:16:28.158642] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.361 [2024-11-28 19:16:28.158671] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.361 qpair failed and we were unable to recover it. 00:28:07.361 [2024-11-28 19:16:28.168471] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.361 [2024-11-28 19:16:28.168596] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.361 [2024-11-28 19:16:28.168621] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.361 [2024-11-28 19:16:28.168636] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.361 [2024-11-28 19:16:28.168649] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.361 [2024-11-28 19:16:28.168677] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.361 qpair failed and we were unable to recover it. 00:28:07.361 [2024-11-28 19:16:28.178471] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.361 [2024-11-28 19:16:28.178552] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.361 [2024-11-28 19:16:28.178577] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.361 [2024-11-28 19:16:28.178598] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.361 [2024-11-28 19:16:28.178611] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.361 [2024-11-28 19:16:28.178641] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.361 qpair failed and we were unable to recover it. 00:28:07.361 [2024-11-28 19:16:28.188491] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.361 [2024-11-28 19:16:28.188586] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.361 [2024-11-28 19:16:28.188611] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.361 [2024-11-28 19:16:28.188625] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.361 [2024-11-28 19:16:28.188638] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.361 [2024-11-28 19:16:28.188666] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.361 qpair failed and we were unable to recover it. 00:28:07.361 [2024-11-28 19:16:28.198513] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.361 [2024-11-28 19:16:28.198606] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.361 [2024-11-28 19:16:28.198631] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.361 [2024-11-28 19:16:28.198647] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.361 [2024-11-28 19:16:28.198660] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.361 [2024-11-28 19:16:28.198688] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.361 qpair failed and we were unable to recover it. 00:28:07.361 [2024-11-28 19:16:28.208575] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.361 [2024-11-28 19:16:28.208696] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.361 [2024-11-28 19:16:28.208723] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.361 [2024-11-28 19:16:28.208738] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.361 [2024-11-28 19:16:28.208751] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.361 [2024-11-28 19:16:28.208781] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.361 qpair failed and we were unable to recover it. 00:28:07.361 [2024-11-28 19:16:28.218571] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.361 [2024-11-28 19:16:28.218678] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.361 [2024-11-28 19:16:28.218703] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.361 [2024-11-28 19:16:28.218717] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.361 [2024-11-28 19:16:28.218731] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.361 [2024-11-28 19:16:28.218759] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.361 qpair failed and we were unable to recover it. 00:28:07.361 [2024-11-28 19:16:28.228648] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.361 [2024-11-28 19:16:28.228773] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.361 [2024-11-28 19:16:28.228798] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.361 [2024-11-28 19:16:28.228812] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.361 [2024-11-28 19:16:28.228825] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.361 [2024-11-28 19:16:28.228853] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.361 qpair failed and we were unable to recover it. 00:28:07.361 [2024-11-28 19:16:28.238663] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.361 [2024-11-28 19:16:28.238746] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.361 [2024-11-28 19:16:28.238772] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.361 [2024-11-28 19:16:28.238787] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.361 [2024-11-28 19:16:28.238799] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.361 [2024-11-28 19:16:28.238827] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.362 qpair failed and we were unable to recover it. 00:28:07.362 [2024-11-28 19:16:28.248646] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.362 [2024-11-28 19:16:28.248740] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.362 [2024-11-28 19:16:28.248765] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.362 [2024-11-28 19:16:28.248779] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.362 [2024-11-28 19:16:28.248792] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.362 [2024-11-28 19:16:28.248820] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.362 qpair failed and we were unable to recover it. 00:28:07.362 [2024-11-28 19:16:28.258690] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.362 [2024-11-28 19:16:28.258772] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.362 [2024-11-28 19:16:28.258797] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.362 [2024-11-28 19:16:28.258811] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.362 [2024-11-28 19:16:28.258824] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.362 [2024-11-28 19:16:28.258853] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.362 qpair failed and we were unable to recover it. 00:28:07.362 [2024-11-28 19:16:28.268720] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.362 [2024-11-28 19:16:28.268804] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.362 [2024-11-28 19:16:28.268830] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.362 [2024-11-28 19:16:28.268850] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.362 [2024-11-28 19:16:28.268864] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.362 [2024-11-28 19:16:28.268892] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.362 qpair failed and we were unable to recover it. 00:28:07.362 [2024-11-28 19:16:28.278756] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.362 [2024-11-28 19:16:28.278844] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.362 [2024-11-28 19:16:28.278869] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.362 [2024-11-28 19:16:28.278883] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.362 [2024-11-28 19:16:28.278896] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.362 [2024-11-28 19:16:28.278924] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.362 qpair failed and we were unable to recover it. 00:28:07.362 [2024-11-28 19:16:28.288781] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.362 [2024-11-28 19:16:28.288868] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.362 [2024-11-28 19:16:28.288893] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.362 [2024-11-28 19:16:28.288907] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.362 [2024-11-28 19:16:28.288921] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.362 [2024-11-28 19:16:28.288948] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.362 qpair failed and we were unable to recover it. 00:28:07.362 [2024-11-28 19:16:28.298809] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.362 [2024-11-28 19:16:28.298895] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.362 [2024-11-28 19:16:28.298921] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.362 [2024-11-28 19:16:28.298935] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.362 [2024-11-28 19:16:28.298948] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.362 [2024-11-28 19:16:28.298977] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.362 qpair failed and we were unable to recover it. 00:28:07.362 [2024-11-28 19:16:28.308870] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.362 [2024-11-28 19:16:28.309004] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.362 [2024-11-28 19:16:28.309030] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.362 [2024-11-28 19:16:28.309044] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.362 [2024-11-28 19:16:28.309057] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.362 [2024-11-28 19:16:28.309085] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.362 qpair failed and we were unable to recover it. 00:28:07.362 [2024-11-28 19:16:28.318916] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.362 [2024-11-28 19:16:28.319030] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.362 [2024-11-28 19:16:28.319055] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.362 [2024-11-28 19:16:28.319069] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.362 [2024-11-28 19:16:28.319082] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.362 [2024-11-28 19:16:28.319110] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.362 qpair failed and we were unable to recover it. 00:28:07.362 [2024-11-28 19:16:28.328902] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.362 [2024-11-28 19:16:28.328987] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.362 [2024-11-28 19:16:28.329012] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.362 [2024-11-28 19:16:28.329027] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.362 [2024-11-28 19:16:28.329039] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.362 [2024-11-28 19:16:28.329067] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.362 qpair failed and we were unable to recover it. 00:28:07.362 [2024-11-28 19:16:28.338997] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.362 [2024-11-28 19:16:28.339102] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.362 [2024-11-28 19:16:28.339127] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.362 [2024-11-28 19:16:28.339141] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.362 [2024-11-28 19:16:28.339154] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.362 [2024-11-28 19:16:28.339184] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.362 qpair failed and we were unable to recover it. 00:28:07.362 [2024-11-28 19:16:28.348950] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.362 [2024-11-28 19:16:28.349038] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.362 [2024-11-28 19:16:28.349063] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.362 [2024-11-28 19:16:28.349078] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.362 [2024-11-28 19:16:28.349091] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.362 [2024-11-28 19:16:28.349119] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.362 qpair failed and we were unable to recover it. 00:28:07.362 [2024-11-28 19:16:28.359016] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.362 [2024-11-28 19:16:28.359104] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.362 [2024-11-28 19:16:28.359134] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.362 [2024-11-28 19:16:28.359149] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.362 [2024-11-28 19:16:28.359161] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.362 [2024-11-28 19:16:28.359190] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.362 qpair failed and we were unable to recover it. 00:28:07.362 [2024-11-28 19:16:28.369137] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.362 [2024-11-28 19:16:28.369226] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.362 [2024-11-28 19:16:28.369251] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.362 [2024-11-28 19:16:28.369265] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.362 [2024-11-28 19:16:28.369278] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.362 [2024-11-28 19:16:28.369306] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.362 qpair failed and we were unable to recover it. 00:28:07.362 [2024-11-28 19:16:28.379054] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.362 [2024-11-28 19:16:28.379165] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.362 [2024-11-28 19:16:28.379191] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.363 [2024-11-28 19:16:28.379205] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.363 [2024-11-28 19:16:28.379218] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.363 [2024-11-28 19:16:28.379246] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.363 qpair failed and we were unable to recover it. 00:28:07.363 [2024-11-28 19:16:28.389051] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.363 [2024-11-28 19:16:28.389161] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.363 [2024-11-28 19:16:28.389186] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.363 [2024-11-28 19:16:28.389201] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.363 [2024-11-28 19:16:28.389214] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.363 [2024-11-28 19:16:28.389242] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.363 qpair failed and we were unable to recover it. 00:28:07.363 [2024-11-28 19:16:28.399096] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.363 [2024-11-28 19:16:28.399186] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.363 [2024-11-28 19:16:28.399211] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.363 [2024-11-28 19:16:28.399225] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.363 [2024-11-28 19:16:28.399238] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.363 [2024-11-28 19:16:28.399266] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.363 qpair failed and we were unable to recover it. 00:28:07.621 [2024-11-28 19:16:28.409160] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.621 [2024-11-28 19:16:28.409251] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.621 [2024-11-28 19:16:28.409276] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.621 [2024-11-28 19:16:28.409290] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.621 [2024-11-28 19:16:28.409303] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.621 [2024-11-28 19:16:28.409331] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.621 qpair failed and we were unable to recover it. 00:28:07.621 [2024-11-28 19:16:28.419154] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.621 [2024-11-28 19:16:28.419277] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.621 [2024-11-28 19:16:28.419302] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.621 [2024-11-28 19:16:28.419316] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.621 [2024-11-28 19:16:28.419329] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.621 [2024-11-28 19:16:28.419357] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.621 qpair failed and we were unable to recover it. 00:28:07.621 [2024-11-28 19:16:28.429188] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.621 [2024-11-28 19:16:28.429272] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.621 [2024-11-28 19:16:28.429297] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.621 [2024-11-28 19:16:28.429311] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.621 [2024-11-28 19:16:28.429324] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.621 [2024-11-28 19:16:28.429353] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.621 qpair failed and we were unable to recover it. 00:28:07.621 [2024-11-28 19:16:28.439240] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.621 [2024-11-28 19:16:28.439366] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.621 [2024-11-28 19:16:28.439391] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.621 [2024-11-28 19:16:28.439413] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.621 [2024-11-28 19:16:28.439426] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.621 [2024-11-28 19:16:28.439455] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.621 qpair failed and we were unable to recover it. 00:28:07.621 [2024-11-28 19:16:28.449279] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.621 [2024-11-28 19:16:28.449358] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.621 [2024-11-28 19:16:28.449388] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.621 [2024-11-28 19:16:28.449411] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.621 [2024-11-28 19:16:28.449425] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.621 [2024-11-28 19:16:28.449453] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.621 qpair failed and we were unable to recover it. 00:28:07.621 [2024-11-28 19:16:28.459315] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.621 [2024-11-28 19:16:28.459414] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.621 [2024-11-28 19:16:28.459440] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.621 [2024-11-28 19:16:28.459454] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.621 [2024-11-28 19:16:28.459467] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.621 [2024-11-28 19:16:28.459496] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.621 qpair failed and we were unable to recover it. 00:28:07.621 [2024-11-28 19:16:28.469348] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.621 [2024-11-28 19:16:28.469439] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.621 [2024-11-28 19:16:28.469464] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.621 [2024-11-28 19:16:28.469479] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.621 [2024-11-28 19:16:28.469492] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.621 [2024-11-28 19:16:28.469520] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.621 qpair failed and we were unable to recover it. 00:28:07.621 [2024-11-28 19:16:28.479359] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.621 [2024-11-28 19:16:28.479471] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.621 [2024-11-28 19:16:28.479497] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.621 [2024-11-28 19:16:28.479511] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.621 [2024-11-28 19:16:28.479524] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.621 [2024-11-28 19:16:28.479552] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.621 qpair failed and we were unable to recover it. 00:28:07.621 [2024-11-28 19:16:28.489352] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.622 [2024-11-28 19:16:28.489447] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.622 [2024-11-28 19:16:28.489472] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.622 [2024-11-28 19:16:28.489487] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.622 [2024-11-28 19:16:28.489500] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.622 [2024-11-28 19:16:28.489533] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.622 qpair failed and we were unable to recover it. 00:28:07.622 [2024-11-28 19:16:28.499495] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.622 [2024-11-28 19:16:28.499620] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.622 [2024-11-28 19:16:28.499646] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.622 [2024-11-28 19:16:28.499660] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.622 [2024-11-28 19:16:28.499672] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.622 [2024-11-28 19:16:28.499701] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.622 qpair failed and we were unable to recover it. 00:28:07.622 [2024-11-28 19:16:28.509421] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.622 [2024-11-28 19:16:28.509535] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.622 [2024-11-28 19:16:28.509560] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.622 [2024-11-28 19:16:28.509575] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.622 [2024-11-28 19:16:28.509588] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.622 [2024-11-28 19:16:28.509616] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.622 qpair failed and we were unable to recover it. 00:28:07.622 [2024-11-28 19:16:28.519459] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.622 [2024-11-28 19:16:28.519549] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.622 [2024-11-28 19:16:28.519574] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.622 [2024-11-28 19:16:28.519588] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.622 [2024-11-28 19:16:28.519600] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.622 [2024-11-28 19:16:28.519629] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.622 qpair failed and we were unable to recover it. 00:28:07.622 [2024-11-28 19:16:28.529487] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.622 [2024-11-28 19:16:28.529571] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.622 [2024-11-28 19:16:28.529596] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.622 [2024-11-28 19:16:28.529611] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.622 [2024-11-28 19:16:28.529624] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.622 [2024-11-28 19:16:28.529652] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.622 qpair failed and we were unable to recover it. 00:28:07.622 [2024-11-28 19:16:28.539522] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.622 [2024-11-28 19:16:28.539607] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.622 [2024-11-28 19:16:28.539637] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.622 [2024-11-28 19:16:28.539653] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.622 [2024-11-28 19:16:28.539666] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.622 [2024-11-28 19:16:28.539694] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.622 qpair failed and we were unable to recover it. 00:28:07.622 [2024-11-28 19:16:28.549562] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.622 [2024-11-28 19:16:28.549675] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.622 [2024-11-28 19:16:28.549701] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.622 [2024-11-28 19:16:28.549716] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.622 [2024-11-28 19:16:28.549730] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.622 [2024-11-28 19:16:28.549758] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.622 qpair failed and we were unable to recover it. 00:28:07.622 [2024-11-28 19:16:28.559599] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.622 [2024-11-28 19:16:28.559686] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.622 [2024-11-28 19:16:28.559711] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.622 [2024-11-28 19:16:28.559726] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.622 [2024-11-28 19:16:28.559739] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.622 [2024-11-28 19:16:28.559767] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.622 qpair failed and we were unable to recover it. 00:28:07.622 [2024-11-28 19:16:28.569598] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.622 [2024-11-28 19:16:28.569686] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.622 [2024-11-28 19:16:28.569710] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.622 [2024-11-28 19:16:28.569725] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.622 [2024-11-28 19:16:28.569738] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.622 [2024-11-28 19:16:28.569766] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.622 qpair failed and we were unable to recover it. 00:28:07.622 [2024-11-28 19:16:28.579656] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.622 [2024-11-28 19:16:28.579795] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.622 [2024-11-28 19:16:28.579821] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.622 [2024-11-28 19:16:28.579836] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.622 [2024-11-28 19:16:28.579849] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.622 [2024-11-28 19:16:28.579883] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.622 qpair failed and we were unable to recover it. 00:28:07.622 [2024-11-28 19:16:28.589658] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.622 [2024-11-28 19:16:28.589745] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.622 [2024-11-28 19:16:28.589774] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.622 [2024-11-28 19:16:28.589793] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.622 [2024-11-28 19:16:28.589806] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.622 [2024-11-28 19:16:28.589835] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.622 qpair failed and we were unable to recover it. 00:28:07.622 [2024-11-28 19:16:28.599708] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.622 [2024-11-28 19:16:28.599803] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.622 [2024-11-28 19:16:28.599831] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.622 [2024-11-28 19:16:28.599848] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.622 [2024-11-28 19:16:28.599861] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.622 [2024-11-28 19:16:28.599890] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.622 qpair failed and we were unable to recover it. 00:28:07.622 [2024-11-28 19:16:28.609759] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.622 [2024-11-28 19:16:28.609852] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.622 [2024-11-28 19:16:28.609878] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.622 [2024-11-28 19:16:28.609893] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.622 [2024-11-28 19:16:28.609906] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.622 [2024-11-28 19:16:28.609934] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.622 qpair failed and we were unable to recover it. 00:28:07.622 [2024-11-28 19:16:28.619764] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.622 [2024-11-28 19:16:28.619849] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.622 [2024-11-28 19:16:28.619875] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.623 [2024-11-28 19:16:28.619890] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.623 [2024-11-28 19:16:28.619903] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.623 [2024-11-28 19:16:28.619934] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.623 qpair failed and we were unable to recover it. 00:28:07.623 [2024-11-28 19:16:28.629797] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.623 [2024-11-28 19:16:28.629881] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.623 [2024-11-28 19:16:28.629911] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.623 [2024-11-28 19:16:28.629926] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.623 [2024-11-28 19:16:28.629939] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.623 [2024-11-28 19:16:28.629968] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.623 qpair failed and we were unable to recover it. 00:28:07.623 [2024-11-28 19:16:28.639843] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.623 [2024-11-28 19:16:28.639933] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.623 [2024-11-28 19:16:28.639959] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.623 [2024-11-28 19:16:28.639973] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.623 [2024-11-28 19:16:28.639986] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.623 [2024-11-28 19:16:28.640015] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.623 qpair failed and we were unable to recover it. 00:28:07.623 [2024-11-28 19:16:28.649864] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.623 [2024-11-28 19:16:28.649989] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.623 [2024-11-28 19:16:28.650015] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.623 [2024-11-28 19:16:28.650029] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.623 [2024-11-28 19:16:28.650042] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.623 [2024-11-28 19:16:28.650071] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.623 qpair failed and we were unable to recover it. 00:28:07.623 [2024-11-28 19:16:28.659902] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.623 [2024-11-28 19:16:28.659985] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.623 [2024-11-28 19:16:28.660010] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.623 [2024-11-28 19:16:28.660024] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.623 [2024-11-28 19:16:28.660037] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.623 [2024-11-28 19:16:28.660066] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.623 qpair failed and we were unable to recover it. 00:28:07.881 [2024-11-28 19:16:28.669979] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.881 [2024-11-28 19:16:28.670059] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.881 [2024-11-28 19:16:28.670084] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.881 [2024-11-28 19:16:28.670098] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.881 [2024-11-28 19:16:28.670111] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.881 [2024-11-28 19:16:28.670144] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.881 qpair failed and we were unable to recover it. 00:28:07.881 [2024-11-28 19:16:28.679926] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.881 [2024-11-28 19:16:28.680048] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.881 [2024-11-28 19:16:28.680073] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.881 [2024-11-28 19:16:28.680087] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.881 [2024-11-28 19:16:28.680100] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.881 [2024-11-28 19:16:28.680127] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.881 qpair failed and we were unable to recover it. 00:28:07.881 [2024-11-28 19:16:28.689950] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.881 [2024-11-28 19:16:28.690039] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.881 [2024-11-28 19:16:28.690064] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.881 [2024-11-28 19:16:28.690078] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.881 [2024-11-28 19:16:28.690092] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.881 [2024-11-28 19:16:28.690120] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.881 qpair failed and we were unable to recover it. 00:28:07.881 [2024-11-28 19:16:28.699979] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.881 [2024-11-28 19:16:28.700064] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.881 [2024-11-28 19:16:28.700089] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.881 [2024-11-28 19:16:28.700103] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.881 [2024-11-28 19:16:28.700118] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.881 [2024-11-28 19:16:28.700147] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.881 qpair failed and we were unable to recover it. 00:28:07.881 [2024-11-28 19:16:28.709993] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.881 [2024-11-28 19:16:28.710076] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.881 [2024-11-28 19:16:28.710101] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.881 [2024-11-28 19:16:28.710116] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.881 [2024-11-28 19:16:28.710128] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.881 [2024-11-28 19:16:28.710156] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.881 qpair failed and we were unable to recover it. 00:28:07.881 [2024-11-28 19:16:28.720067] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.881 [2024-11-28 19:16:28.720176] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.881 [2024-11-28 19:16:28.720206] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.881 [2024-11-28 19:16:28.720221] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.881 [2024-11-28 19:16:28.720233] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.881 [2024-11-28 19:16:28.720261] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.881 qpair failed and we were unable to recover it. 00:28:07.881 [2024-11-28 19:16:28.730066] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.881 [2024-11-28 19:16:28.730149] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.881 [2024-11-28 19:16:28.730174] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.881 [2024-11-28 19:16:28.730188] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.881 [2024-11-28 19:16:28.730201] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.881 [2024-11-28 19:16:28.730229] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.881 qpair failed and we were unable to recover it. 00:28:07.881 [2024-11-28 19:16:28.740114] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.881 [2024-11-28 19:16:28.740198] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.881 [2024-11-28 19:16:28.740224] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.882 [2024-11-28 19:16:28.740238] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.882 [2024-11-28 19:16:28.740251] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.882 [2024-11-28 19:16:28.740281] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.882 qpair failed and we were unable to recover it. 00:28:07.882 [2024-11-28 19:16:28.750127] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.882 [2024-11-28 19:16:28.750202] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.882 [2024-11-28 19:16:28.750227] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.882 [2024-11-28 19:16:28.750241] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.882 [2024-11-28 19:16:28.750254] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.882 [2024-11-28 19:16:28.750282] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.882 qpair failed and we were unable to recover it. 00:28:07.882 [2024-11-28 19:16:28.760192] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.882 [2024-11-28 19:16:28.760282] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.882 [2024-11-28 19:16:28.760307] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.882 [2024-11-28 19:16:28.760322] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.882 [2024-11-28 19:16:28.760335] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.882 [2024-11-28 19:16:28.760368] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.882 qpair failed and we were unable to recover it. 00:28:07.882 [2024-11-28 19:16:28.770187] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.882 [2024-11-28 19:16:28.770284] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.882 [2024-11-28 19:16:28.770309] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.882 [2024-11-28 19:16:28.770324] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.882 [2024-11-28 19:16:28.770337] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.882 [2024-11-28 19:16:28.770364] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.882 qpair failed and we were unable to recover it. 00:28:07.882 [2024-11-28 19:16:28.780286] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.882 [2024-11-28 19:16:28.780398] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.882 [2024-11-28 19:16:28.780425] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.882 [2024-11-28 19:16:28.780440] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.882 [2024-11-28 19:16:28.780453] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.882 [2024-11-28 19:16:28.780484] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.882 qpair failed and we were unable to recover it. 00:28:07.882 [2024-11-28 19:16:28.790276] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.882 [2024-11-28 19:16:28.790361] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.882 [2024-11-28 19:16:28.790387] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.882 [2024-11-28 19:16:28.790413] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.882 [2024-11-28 19:16:28.790428] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.882 [2024-11-28 19:16:28.790456] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.882 qpair failed and we were unable to recover it. 00:28:07.882 [2024-11-28 19:16:28.800291] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.882 [2024-11-28 19:16:28.800378] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.882 [2024-11-28 19:16:28.800412] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.882 [2024-11-28 19:16:28.800427] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.882 [2024-11-28 19:16:28.800440] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.882 [2024-11-28 19:16:28.800468] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.882 qpair failed and we were unable to recover it. 00:28:07.882 [2024-11-28 19:16:28.810324] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.882 [2024-11-28 19:16:28.810453] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.882 [2024-11-28 19:16:28.810486] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.882 [2024-11-28 19:16:28.810501] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.882 [2024-11-28 19:16:28.810514] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.882 [2024-11-28 19:16:28.810542] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.882 qpair failed and we were unable to recover it. 00:28:07.882 [2024-11-28 19:16:28.820366] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.882 [2024-11-28 19:16:28.820470] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.882 [2024-11-28 19:16:28.820499] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.882 [2024-11-28 19:16:28.820515] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.882 [2024-11-28 19:16:28.820528] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.882 [2024-11-28 19:16:28.820558] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.882 qpair failed and we were unable to recover it. 00:28:07.882 [2024-11-28 19:16:28.830417] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.882 [2024-11-28 19:16:28.830498] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.882 [2024-11-28 19:16:28.830524] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.882 [2024-11-28 19:16:28.830539] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.882 [2024-11-28 19:16:28.830552] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.882 [2024-11-28 19:16:28.830580] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.882 qpair failed and we were unable to recover it. 00:28:07.882 [2024-11-28 19:16:28.840415] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.882 [2024-11-28 19:16:28.840518] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.882 [2024-11-28 19:16:28.840543] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.882 [2024-11-28 19:16:28.840557] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.882 [2024-11-28 19:16:28.840570] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.882 [2024-11-28 19:16:28.840599] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.882 qpair failed and we were unable to recover it. 00:28:07.882 [2024-11-28 19:16:28.850460] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.882 [2024-11-28 19:16:28.850579] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.882 [2024-11-28 19:16:28.850605] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.882 [2024-11-28 19:16:28.850619] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.882 [2024-11-28 19:16:28.850637] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.882 [2024-11-28 19:16:28.850666] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.882 qpair failed and we were unable to recover it. 00:28:07.882 [2024-11-28 19:16:28.860501] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.882 [2024-11-28 19:16:28.860611] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.882 [2024-11-28 19:16:28.860636] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.882 [2024-11-28 19:16:28.860651] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.882 [2024-11-28 19:16:28.860663] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.882 [2024-11-28 19:16:28.860691] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.882 qpair failed and we were unable to recover it. 00:28:07.882 [2024-11-28 19:16:28.870523] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.882 [2024-11-28 19:16:28.870646] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.882 [2024-11-28 19:16:28.870671] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.882 [2024-11-28 19:16:28.870686] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.882 [2024-11-28 19:16:28.870699] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.882 [2024-11-28 19:16:28.870727] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.882 qpair failed and we were unable to recover it. 00:28:07.882 [2024-11-28 19:16:28.880539] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.882 [2024-11-28 19:16:28.880629] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.882 [2024-11-28 19:16:28.880654] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.882 [2024-11-28 19:16:28.880668] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.882 [2024-11-28 19:16:28.880681] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.882 [2024-11-28 19:16:28.880709] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.882 qpair failed and we were unable to recover it. 00:28:07.882 [2024-11-28 19:16:28.890544] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.882 [2024-11-28 19:16:28.890630] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.882 [2024-11-28 19:16:28.890656] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.882 [2024-11-28 19:16:28.890671] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.882 [2024-11-28 19:16:28.890683] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.882 [2024-11-28 19:16:28.890711] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.882 qpair failed and we were unable to recover it. 00:28:07.882 [2024-11-28 19:16:28.900576] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.882 [2024-11-28 19:16:28.900662] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.882 [2024-11-28 19:16:28.900687] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.882 [2024-11-28 19:16:28.900702] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.882 [2024-11-28 19:16:28.900714] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.882 [2024-11-28 19:16:28.900744] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.882 qpair failed and we were unable to recover it. 00:28:07.882 [2024-11-28 19:16:28.910660] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.882 [2024-11-28 19:16:28.910758] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.882 [2024-11-28 19:16:28.910784] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.882 [2024-11-28 19:16:28.910799] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.882 [2024-11-28 19:16:28.910811] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.882 [2024-11-28 19:16:28.910840] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.882 qpair failed and we were unable to recover it. 00:28:07.882 [2024-11-28 19:16:28.920669] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:07.882 [2024-11-28 19:16:28.920790] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:07.882 [2024-11-28 19:16:28.920815] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:07.882 [2024-11-28 19:16:28.920829] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:07.882 [2024-11-28 19:16:28.920842] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:07.882 [2024-11-28 19:16:28.920871] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:07.882 qpair failed and we were unable to recover it. 00:28:08.142 [2024-11-28 19:16:28.930656] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.142 [2024-11-28 19:16:28.930747] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.142 [2024-11-28 19:16:28.930771] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.142 [2024-11-28 19:16:28.930785] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.142 [2024-11-28 19:16:28.930796] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.142 [2024-11-28 19:16:28.930824] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.142 qpair failed and we were unable to recover it. 00:28:08.142 [2024-11-28 19:16:28.940692] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.142 [2024-11-28 19:16:28.940789] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.142 [2024-11-28 19:16:28.940815] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.142 [2024-11-28 19:16:28.940829] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.142 [2024-11-28 19:16:28.940847] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.142 [2024-11-28 19:16:28.940876] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.142 qpair failed and we were unable to recover it. 00:28:08.142 [2024-11-28 19:16:28.950758] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.142 [2024-11-28 19:16:28.950844] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.142 [2024-11-28 19:16:28.950869] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.142 [2024-11-28 19:16:28.950883] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.142 [2024-11-28 19:16:28.950897] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.142 [2024-11-28 19:16:28.950925] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.142 qpair failed and we were unable to recover it. 00:28:08.142 [2024-11-28 19:16:28.960822] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.142 [2024-11-28 19:16:28.960915] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.142 [2024-11-28 19:16:28.960940] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.142 [2024-11-28 19:16:28.960954] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.142 [2024-11-28 19:16:28.960966] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.142 [2024-11-28 19:16:28.960997] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.142 qpair failed and we were unable to recover it. 00:28:08.142 [2024-11-28 19:16:28.970816] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.142 [2024-11-28 19:16:28.970944] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.142 [2024-11-28 19:16:28.970970] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.142 [2024-11-28 19:16:28.970984] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.142 [2024-11-28 19:16:28.970997] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.142 [2024-11-28 19:16:28.971025] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.142 qpair failed and we were unable to recover it. 00:28:08.142 [2024-11-28 19:16:28.980818] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.142 [2024-11-28 19:16:28.980949] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.142 [2024-11-28 19:16:28.980973] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.142 [2024-11-28 19:16:28.980988] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.142 [2024-11-28 19:16:28.981000] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.142 [2024-11-28 19:16:28.981029] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.142 qpair failed and we were unable to recover it. 00:28:08.142 [2024-11-28 19:16:28.990830] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.142 [2024-11-28 19:16:28.990949] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.142 [2024-11-28 19:16:28.990974] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.142 [2024-11-28 19:16:28.990989] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.142 [2024-11-28 19:16:28.991001] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.142 [2024-11-28 19:16:28.991029] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.142 qpair failed and we were unable to recover it. 00:28:08.142 [2024-11-28 19:16:29.000870] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.142 [2024-11-28 19:16:29.000959] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.142 [2024-11-28 19:16:29.000984] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.142 [2024-11-28 19:16:29.000999] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.142 [2024-11-28 19:16:29.001012] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.142 [2024-11-28 19:16:29.001041] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.142 qpair failed and we were unable to recover it. 00:28:08.142 [2024-11-28 19:16:29.010922] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.142 [2024-11-28 19:16:29.011039] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.142 [2024-11-28 19:16:29.011064] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.142 [2024-11-28 19:16:29.011079] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.142 [2024-11-28 19:16:29.011092] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.142 [2024-11-28 19:16:29.011120] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.142 qpair failed and we were unable to recover it. 00:28:08.142 [2024-11-28 19:16:29.020932] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.142 [2024-11-28 19:16:29.021027] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.142 [2024-11-28 19:16:29.021052] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.142 [2024-11-28 19:16:29.021067] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.142 [2024-11-28 19:16:29.021080] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.142 [2024-11-28 19:16:29.021108] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.142 qpair failed and we were unable to recover it. 00:28:08.142 [2024-11-28 19:16:29.030988] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.142 [2024-11-28 19:16:29.031119] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.142 [2024-11-28 19:16:29.031145] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.142 [2024-11-28 19:16:29.031159] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.142 [2024-11-28 19:16:29.031177] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.142 [2024-11-28 19:16:29.031207] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.142 qpair failed and we were unable to recover it. 00:28:08.142 [2024-11-28 19:16:29.041021] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.142 [2024-11-28 19:16:29.041103] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.142 [2024-11-28 19:16:29.041128] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.142 [2024-11-28 19:16:29.041143] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.142 [2024-11-28 19:16:29.041155] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.142 [2024-11-28 19:16:29.041183] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.142 qpair failed and we were unable to recover it. 00:28:08.142 [2024-11-28 19:16:29.051140] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.142 [2024-11-28 19:16:29.051259] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.142 [2024-11-28 19:16:29.051285] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.142 [2024-11-28 19:16:29.051299] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.143 [2024-11-28 19:16:29.051312] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.143 [2024-11-28 19:16:29.051340] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.143 qpair failed and we were unable to recover it. 00:28:08.143 [2024-11-28 19:16:29.061070] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.143 [2024-11-28 19:16:29.061165] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.143 [2024-11-28 19:16:29.061190] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.143 [2024-11-28 19:16:29.061205] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.143 [2024-11-28 19:16:29.061218] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.143 [2024-11-28 19:16:29.061246] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.143 qpair failed and we were unable to recover it. 00:28:08.143 [2024-11-28 19:16:29.071092] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.143 [2024-11-28 19:16:29.071188] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.143 [2024-11-28 19:16:29.071213] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.143 [2024-11-28 19:16:29.071228] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.143 [2024-11-28 19:16:29.071240] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.143 [2024-11-28 19:16:29.071271] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.143 qpair failed and we were unable to recover it. 00:28:08.143 [2024-11-28 19:16:29.081118] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.143 [2024-11-28 19:16:29.081214] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.143 [2024-11-28 19:16:29.081239] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.143 [2024-11-28 19:16:29.081253] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.143 [2024-11-28 19:16:29.081266] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.143 [2024-11-28 19:16:29.081294] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.143 qpair failed and we were unable to recover it. 00:28:08.143 [2024-11-28 19:16:29.091186] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.143 [2024-11-28 19:16:29.091303] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.143 [2024-11-28 19:16:29.091328] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.143 [2024-11-28 19:16:29.091342] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.143 [2024-11-28 19:16:29.091355] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.143 [2024-11-28 19:16:29.091383] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.143 qpair failed and we were unable to recover it. 00:28:08.143 [2024-11-28 19:16:29.101173] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.143 [2024-11-28 19:16:29.101262] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.143 [2024-11-28 19:16:29.101287] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.143 [2024-11-28 19:16:29.101301] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.143 [2024-11-28 19:16:29.101314] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.143 [2024-11-28 19:16:29.101343] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.143 qpair failed and we were unable to recover it. 00:28:08.143 [2024-11-28 19:16:29.111234] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.143 [2024-11-28 19:16:29.111361] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.143 [2024-11-28 19:16:29.111387] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.143 [2024-11-28 19:16:29.111410] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.143 [2024-11-28 19:16:29.111423] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.143 [2024-11-28 19:16:29.111453] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.143 qpair failed and we were unable to recover it. 00:28:08.143 [2024-11-28 19:16:29.121262] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.143 [2024-11-28 19:16:29.121377] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.143 [2024-11-28 19:16:29.121410] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.143 [2024-11-28 19:16:29.121426] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.143 [2024-11-28 19:16:29.121444] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.143 [2024-11-28 19:16:29.121473] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.143 qpair failed and we were unable to recover it. 00:28:08.143 [2024-11-28 19:16:29.131247] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.143 [2024-11-28 19:16:29.131332] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.143 [2024-11-28 19:16:29.131357] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.143 [2024-11-28 19:16:29.131372] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.143 [2024-11-28 19:16:29.131385] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.143 [2024-11-28 19:16:29.131420] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.143 qpair failed and we were unable to recover it. 00:28:08.143 [2024-11-28 19:16:29.141322] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.143 [2024-11-28 19:16:29.141416] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.143 [2024-11-28 19:16:29.141442] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.143 [2024-11-28 19:16:29.141456] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.143 [2024-11-28 19:16:29.141470] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.143 [2024-11-28 19:16:29.141498] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.143 qpair failed and we were unable to recover it. 00:28:08.143 [2024-11-28 19:16:29.151328] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.143 [2024-11-28 19:16:29.151421] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.143 [2024-11-28 19:16:29.151447] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.143 [2024-11-28 19:16:29.151461] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.143 [2024-11-28 19:16:29.151474] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.143 [2024-11-28 19:16:29.151502] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.143 qpair failed and we were unable to recover it. 00:28:08.143 [2024-11-28 19:16:29.161445] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.143 [2024-11-28 19:16:29.161535] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.143 [2024-11-28 19:16:29.161560] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.143 [2024-11-28 19:16:29.161575] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.143 [2024-11-28 19:16:29.161588] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.143 [2024-11-28 19:16:29.161616] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.143 qpair failed and we were unable to recover it. 00:28:08.143 [2024-11-28 19:16:29.171383] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.143 [2024-11-28 19:16:29.171478] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.143 [2024-11-28 19:16:29.171504] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.143 [2024-11-28 19:16:29.171518] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.143 [2024-11-28 19:16:29.171531] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.143 [2024-11-28 19:16:29.171560] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.143 qpair failed and we were unable to recover it. 00:28:08.143 [2024-11-28 19:16:29.181418] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.143 [2024-11-28 19:16:29.181500] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.143 [2024-11-28 19:16:29.181526] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.143 [2024-11-28 19:16:29.181540] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.143 [2024-11-28 19:16:29.181553] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.143 [2024-11-28 19:16:29.181582] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.144 qpair failed and we were unable to recover it. 00:28:08.402 [2024-11-28 19:16:29.191440] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.402 [2024-11-28 19:16:29.191526] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.402 [2024-11-28 19:16:29.191552] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.402 [2024-11-28 19:16:29.191566] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.402 [2024-11-28 19:16:29.191578] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.402 [2024-11-28 19:16:29.191606] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.402 qpair failed and we were unable to recover it. 00:28:08.402 [2024-11-28 19:16:29.201471] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.402 [2024-11-28 19:16:29.201578] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.402 [2024-11-28 19:16:29.201604] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.402 [2024-11-28 19:16:29.201618] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.402 [2024-11-28 19:16:29.201631] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.402 [2024-11-28 19:16:29.201659] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.402 qpair failed and we were unable to recover it. 00:28:08.402 [2024-11-28 19:16:29.211486] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.402 [2024-11-28 19:16:29.211572] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.402 [2024-11-28 19:16:29.211597] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.402 [2024-11-28 19:16:29.211619] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.402 [2024-11-28 19:16:29.211632] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.402 [2024-11-28 19:16:29.211660] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.402 qpair failed and we were unable to recover it. 00:28:08.402 [2024-11-28 19:16:29.221536] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.402 [2024-11-28 19:16:29.221665] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.402 [2024-11-28 19:16:29.221692] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.402 [2024-11-28 19:16:29.221707] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.402 [2024-11-28 19:16:29.221721] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.402 [2024-11-28 19:16:29.221749] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.402 qpair failed and we were unable to recover it. 00:28:08.402 [2024-11-28 19:16:29.231540] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.402 [2024-11-28 19:16:29.231624] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.402 [2024-11-28 19:16:29.231650] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.402 [2024-11-28 19:16:29.231664] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.402 [2024-11-28 19:16:29.231677] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.402 [2024-11-28 19:16:29.231705] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.402 qpair failed and we were unable to recover it. 00:28:08.402 [2024-11-28 19:16:29.241577] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.402 [2024-11-28 19:16:29.241663] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.402 [2024-11-28 19:16:29.241688] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.402 [2024-11-28 19:16:29.241702] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.402 [2024-11-28 19:16:29.241715] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.402 [2024-11-28 19:16:29.241743] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.402 qpair failed and we were unable to recover it. 00:28:08.402 [2024-11-28 19:16:29.251599] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.402 [2024-11-28 19:16:29.251685] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.402 [2024-11-28 19:16:29.251710] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.402 [2024-11-28 19:16:29.251724] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.402 [2024-11-28 19:16:29.251737] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.402 [2024-11-28 19:16:29.251765] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.402 qpair failed and we were unable to recover it. 00:28:08.402 [2024-11-28 19:16:29.261729] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.402 [2024-11-28 19:16:29.261827] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.402 [2024-11-28 19:16:29.261853] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.402 [2024-11-28 19:16:29.261868] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.402 [2024-11-28 19:16:29.261881] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.402 [2024-11-28 19:16:29.261909] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.402 qpair failed and we were unable to recover it. 00:28:08.402 [2024-11-28 19:16:29.271673] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.402 [2024-11-28 19:16:29.271748] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.402 [2024-11-28 19:16:29.271774] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.403 [2024-11-28 19:16:29.271788] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.403 [2024-11-28 19:16:29.271801] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.403 [2024-11-28 19:16:29.271829] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.403 qpair failed and we were unable to recover it. 00:28:08.403 [2024-11-28 19:16:29.281715] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.403 [2024-11-28 19:16:29.281807] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.403 [2024-11-28 19:16:29.281832] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.403 [2024-11-28 19:16:29.281847] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.403 [2024-11-28 19:16:29.281860] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.403 [2024-11-28 19:16:29.281887] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.403 qpair failed and we were unable to recover it. 00:28:08.403 [2024-11-28 19:16:29.291762] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.403 [2024-11-28 19:16:29.291852] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.403 [2024-11-28 19:16:29.291878] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.403 [2024-11-28 19:16:29.291892] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.403 [2024-11-28 19:16:29.291905] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.403 [2024-11-28 19:16:29.291933] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.403 qpair failed and we were unable to recover it. 00:28:08.403 [2024-11-28 19:16:29.301754] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.403 [2024-11-28 19:16:29.301842] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.403 [2024-11-28 19:16:29.301867] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.403 [2024-11-28 19:16:29.301888] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.403 [2024-11-28 19:16:29.301902] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.403 [2024-11-28 19:16:29.301931] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.403 qpair failed and we were unable to recover it. 00:28:08.403 [2024-11-28 19:16:29.311768] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.403 [2024-11-28 19:16:29.311856] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.403 [2024-11-28 19:16:29.311882] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.403 [2024-11-28 19:16:29.311896] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.403 [2024-11-28 19:16:29.311909] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.403 [2024-11-28 19:16:29.311937] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.403 qpair failed and we were unable to recover it. 00:28:08.403 [2024-11-28 19:16:29.321815] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.403 [2024-11-28 19:16:29.321902] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.403 [2024-11-28 19:16:29.321927] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.403 [2024-11-28 19:16:29.321942] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.403 [2024-11-28 19:16:29.321955] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.403 [2024-11-28 19:16:29.321982] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.403 qpair failed and we were unable to recover it. 00:28:08.403 [2024-11-28 19:16:29.331918] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.403 [2024-11-28 19:16:29.332006] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.403 [2024-11-28 19:16:29.332031] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.403 [2024-11-28 19:16:29.332045] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.403 [2024-11-28 19:16:29.332058] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.403 [2024-11-28 19:16:29.332085] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.403 qpair failed and we were unable to recover it. 00:28:08.403 [2024-11-28 19:16:29.341895] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.403 [2024-11-28 19:16:29.342019] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.403 [2024-11-28 19:16:29.342044] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.403 [2024-11-28 19:16:29.342058] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.403 [2024-11-28 19:16:29.342071] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.403 [2024-11-28 19:16:29.342100] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.403 qpair failed and we were unable to recover it. 00:28:08.403 [2024-11-28 19:16:29.351927] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.403 [2024-11-28 19:16:29.352015] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.403 [2024-11-28 19:16:29.352040] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.403 [2024-11-28 19:16:29.352054] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.403 [2024-11-28 19:16:29.352067] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.403 [2024-11-28 19:16:29.352094] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.403 qpair failed and we were unable to recover it. 00:28:08.403 [2024-11-28 19:16:29.361953] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.403 [2024-11-28 19:16:29.362039] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.403 [2024-11-28 19:16:29.362064] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.403 [2024-11-28 19:16:29.362078] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.403 [2024-11-28 19:16:29.362091] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.403 [2024-11-28 19:16:29.362119] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.403 qpair failed and we were unable to recover it. 00:28:08.403 [2024-11-28 19:16:29.372082] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.403 [2024-11-28 19:16:29.372165] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.403 [2024-11-28 19:16:29.372190] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.403 [2024-11-28 19:16:29.372205] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.403 [2024-11-28 19:16:29.372218] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.403 [2024-11-28 19:16:29.372247] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.403 qpair failed and we were unable to recover it. 00:28:08.403 [2024-11-28 19:16:29.381994] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.403 [2024-11-28 19:16:29.382083] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.403 [2024-11-28 19:16:29.382108] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.403 [2024-11-28 19:16:29.382122] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.403 [2024-11-28 19:16:29.382135] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.403 [2024-11-28 19:16:29.382164] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.403 qpair failed and we were unable to recover it. 00:28:08.403 [2024-11-28 19:16:29.392010] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.403 [2024-11-28 19:16:29.392108] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.403 [2024-11-28 19:16:29.392133] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.403 [2024-11-28 19:16:29.392154] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.403 [2024-11-28 19:16:29.392168] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.403 [2024-11-28 19:16:29.392197] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.403 qpair failed and we were unable to recover it. 00:28:08.403 [2024-11-28 19:16:29.402073] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.403 [2024-11-28 19:16:29.402194] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.403 [2024-11-28 19:16:29.402219] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.403 [2024-11-28 19:16:29.402233] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.403 [2024-11-28 19:16:29.402246] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.403 [2024-11-28 19:16:29.402275] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.403 qpair failed and we were unable to recover it. 00:28:08.404 [2024-11-28 19:16:29.412062] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.404 [2024-11-28 19:16:29.412154] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.404 [2024-11-28 19:16:29.412179] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.404 [2024-11-28 19:16:29.412193] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.404 [2024-11-28 19:16:29.412206] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.404 [2024-11-28 19:16:29.412234] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.404 qpair failed and we were unable to recover it. 00:28:08.404 [2024-11-28 19:16:29.422102] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.404 [2024-11-28 19:16:29.422191] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.404 [2024-11-28 19:16:29.422216] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.404 [2024-11-28 19:16:29.422231] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.404 [2024-11-28 19:16:29.422244] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.404 [2024-11-28 19:16:29.422273] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.404 qpair failed and we were unable to recover it. 00:28:08.404 [2024-11-28 19:16:29.432138] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.404 [2024-11-28 19:16:29.432218] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.404 [2024-11-28 19:16:29.432243] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.404 [2024-11-28 19:16:29.432257] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.404 [2024-11-28 19:16:29.432270] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.404 [2024-11-28 19:16:29.432298] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.404 qpair failed and we were unable to recover it. 00:28:08.404 [2024-11-28 19:16:29.442180] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.404 [2024-11-28 19:16:29.442265] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.404 [2024-11-28 19:16:29.442290] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.404 [2024-11-28 19:16:29.442304] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.404 [2024-11-28 19:16:29.442317] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.404 [2024-11-28 19:16:29.442345] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.404 qpair failed and we were unable to recover it. 00:28:08.663 [2024-11-28 19:16:29.452245] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.663 [2024-11-28 19:16:29.452332] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.663 [2024-11-28 19:16:29.452357] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.663 [2024-11-28 19:16:29.452371] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.663 [2024-11-28 19:16:29.452384] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.663 [2024-11-28 19:16:29.452420] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.663 qpair failed and we were unable to recover it. 00:28:08.663 [2024-11-28 19:16:29.462258] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.663 [2024-11-28 19:16:29.462345] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.663 [2024-11-28 19:16:29.462370] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.663 [2024-11-28 19:16:29.462384] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.663 [2024-11-28 19:16:29.462405] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.663 [2024-11-28 19:16:29.462437] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.663 qpair failed and we were unable to recover it. 00:28:08.663 [2024-11-28 19:16:29.472293] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.663 [2024-11-28 19:16:29.472377] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.663 [2024-11-28 19:16:29.472410] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.663 [2024-11-28 19:16:29.472426] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.663 [2024-11-28 19:16:29.472439] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.663 [2024-11-28 19:16:29.472467] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.663 qpair failed and we were unable to recover it. 00:28:08.663 [2024-11-28 19:16:29.482342] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.663 [2024-11-28 19:16:29.482463] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.663 [2024-11-28 19:16:29.482488] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.663 [2024-11-28 19:16:29.482508] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.663 [2024-11-28 19:16:29.482522] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.663 [2024-11-28 19:16:29.482550] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.663 qpair failed and we were unable to recover it. 00:28:08.663 [2024-11-28 19:16:29.492331] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.663 [2024-11-28 19:16:29.492424] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.664 [2024-11-28 19:16:29.492449] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.664 [2024-11-28 19:16:29.492464] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.664 [2024-11-28 19:16:29.492477] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.664 [2024-11-28 19:16:29.492504] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.664 qpair failed and we were unable to recover it. 00:28:08.664 [2024-11-28 19:16:29.502341] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.664 [2024-11-28 19:16:29.502459] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.664 [2024-11-28 19:16:29.502485] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.664 [2024-11-28 19:16:29.502500] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.664 [2024-11-28 19:16:29.502513] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.664 [2024-11-28 19:16:29.502541] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.664 qpair failed and we were unable to recover it. 00:28:08.664 [2024-11-28 19:16:29.512424] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.664 [2024-11-28 19:16:29.512541] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.664 [2024-11-28 19:16:29.512566] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.664 [2024-11-28 19:16:29.512581] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.664 [2024-11-28 19:16:29.512593] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.664 [2024-11-28 19:16:29.512621] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.664 qpair failed and we were unable to recover it. 00:28:08.664 [2024-11-28 19:16:29.522413] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.664 [2024-11-28 19:16:29.522505] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.664 [2024-11-28 19:16:29.522530] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.664 [2024-11-28 19:16:29.522544] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.664 [2024-11-28 19:16:29.522556] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.664 [2024-11-28 19:16:29.522585] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.664 qpair failed and we were unable to recover it. 00:28:08.664 [2024-11-28 19:16:29.532466] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.664 [2024-11-28 19:16:29.532587] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.664 [2024-11-28 19:16:29.532612] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.664 [2024-11-28 19:16:29.532626] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.664 [2024-11-28 19:16:29.532639] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.664 [2024-11-28 19:16:29.532667] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.664 qpair failed and we were unable to recover it. 00:28:08.664 [2024-11-28 19:16:29.542480] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.664 [2024-11-28 19:16:29.542567] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.664 [2024-11-28 19:16:29.542595] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.664 [2024-11-28 19:16:29.542611] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.664 [2024-11-28 19:16:29.542625] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.664 [2024-11-28 19:16:29.542654] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.664 qpair failed and we were unable to recover it. 00:28:08.664 [2024-11-28 19:16:29.552555] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.664 [2024-11-28 19:16:29.552686] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.664 [2024-11-28 19:16:29.552712] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.664 [2024-11-28 19:16:29.552727] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.664 [2024-11-28 19:16:29.552740] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.664 [2024-11-28 19:16:29.552768] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.664 qpair failed and we were unable to recover it. 00:28:08.664 [2024-11-28 19:16:29.562586] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.664 [2024-11-28 19:16:29.562699] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.664 [2024-11-28 19:16:29.562724] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.664 [2024-11-28 19:16:29.562738] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.664 [2024-11-28 19:16:29.562751] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.664 [2024-11-28 19:16:29.562779] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.664 qpair failed and we were unable to recover it. 00:28:08.664 [2024-11-28 19:16:29.572537] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.664 [2024-11-28 19:16:29.572638] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.664 [2024-11-28 19:16:29.572668] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.664 [2024-11-28 19:16:29.572683] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.664 [2024-11-28 19:16:29.572695] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.664 [2024-11-28 19:16:29.572723] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.664 qpair failed and we were unable to recover it. 00:28:08.664 [2024-11-28 19:16:29.582601] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.664 [2024-11-28 19:16:29.582724] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.664 [2024-11-28 19:16:29.582749] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.664 [2024-11-28 19:16:29.582764] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.664 [2024-11-28 19:16:29.582776] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.664 [2024-11-28 19:16:29.582805] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.664 qpair failed and we were unable to recover it. 00:28:08.664 [2024-11-28 19:16:29.592623] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.664 [2024-11-28 19:16:29.592737] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.664 [2024-11-28 19:16:29.592762] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.664 [2024-11-28 19:16:29.592777] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.664 [2024-11-28 19:16:29.592790] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.664 [2024-11-28 19:16:29.592818] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.664 qpair failed and we were unable to recover it. 00:28:08.664 [2024-11-28 19:16:29.602638] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.664 [2024-11-28 19:16:29.602724] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.664 [2024-11-28 19:16:29.602749] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.664 [2024-11-28 19:16:29.602764] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.664 [2024-11-28 19:16:29.602776] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.664 [2024-11-28 19:16:29.602804] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.664 qpair failed and we were unable to recover it. 00:28:08.664 [2024-11-28 19:16:29.612658] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.664 [2024-11-28 19:16:29.612749] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.664 [2024-11-28 19:16:29.612775] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.664 [2024-11-28 19:16:29.612789] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.664 [2024-11-28 19:16:29.612802] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.664 [2024-11-28 19:16:29.612829] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.664 qpair failed and we were unable to recover it. 00:28:08.664 [2024-11-28 19:16:29.622704] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.664 [2024-11-28 19:16:29.622792] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.664 [2024-11-28 19:16:29.622817] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.664 [2024-11-28 19:16:29.622831] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.664 [2024-11-28 19:16:29.622844] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.664 [2024-11-28 19:16:29.622873] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.664 qpair failed and we were unable to recover it. 00:28:08.665 [2024-11-28 19:16:29.632756] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.665 [2024-11-28 19:16:29.632841] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.665 [2024-11-28 19:16:29.632867] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.665 [2024-11-28 19:16:29.632881] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.665 [2024-11-28 19:16:29.632894] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.665 [2024-11-28 19:16:29.632921] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.665 qpair failed and we were unable to recover it. 00:28:08.665 [2024-11-28 19:16:29.642785] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.665 [2024-11-28 19:16:29.642873] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.665 [2024-11-28 19:16:29.642898] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.665 [2024-11-28 19:16:29.642912] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.665 [2024-11-28 19:16:29.642924] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.665 [2024-11-28 19:16:29.642953] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.665 qpair failed and we were unable to recover it. 00:28:08.665 [2024-11-28 19:16:29.652792] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.665 [2024-11-28 19:16:29.652911] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.665 [2024-11-28 19:16:29.652936] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.665 [2024-11-28 19:16:29.652951] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.665 [2024-11-28 19:16:29.652964] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.665 [2024-11-28 19:16:29.652992] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.665 qpair failed and we were unable to recover it. 00:28:08.665 [2024-11-28 19:16:29.662827] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.665 [2024-11-28 19:16:29.662945] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.665 [2024-11-28 19:16:29.662976] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.665 [2024-11-28 19:16:29.662991] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.665 [2024-11-28 19:16:29.663004] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.665 [2024-11-28 19:16:29.663034] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.665 qpair failed and we were unable to recover it. 00:28:08.665 [2024-11-28 19:16:29.672881] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.665 [2024-11-28 19:16:29.672962] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.665 [2024-11-28 19:16:29.672988] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.665 [2024-11-28 19:16:29.673002] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.665 [2024-11-28 19:16:29.673015] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.665 [2024-11-28 19:16:29.673043] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.665 qpair failed and we were unable to recover it. 00:28:08.665 [2024-11-28 19:16:29.682902] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.665 [2024-11-28 19:16:29.682995] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.665 [2024-11-28 19:16:29.683020] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.665 [2024-11-28 19:16:29.683035] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.665 [2024-11-28 19:16:29.683047] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.665 [2024-11-28 19:16:29.683075] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.665 qpair failed and we were unable to recover it. 00:28:08.665 [2024-11-28 19:16:29.692922] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.665 [2024-11-28 19:16:29.693005] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.665 [2024-11-28 19:16:29.693030] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.665 [2024-11-28 19:16:29.693045] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.665 [2024-11-28 19:16:29.693057] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.665 [2024-11-28 19:16:29.693085] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.665 qpair failed and we were unable to recover it. 00:28:08.665 [2024-11-28 19:16:29.702957] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.665 [2024-11-28 19:16:29.703046] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.665 [2024-11-28 19:16:29.703071] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.665 [2024-11-28 19:16:29.703085] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.665 [2024-11-28 19:16:29.703098] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.665 [2024-11-28 19:16:29.703133] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.665 qpair failed and we were unable to recover it. 00:28:08.924 [2024-11-28 19:16:29.712945] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.924 [2024-11-28 19:16:29.713029] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.924 [2024-11-28 19:16:29.713055] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.924 [2024-11-28 19:16:29.713070] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.924 [2024-11-28 19:16:29.713083] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.924 [2024-11-28 19:16:29.713111] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.924 qpair failed and we were unable to recover it. 00:28:08.924 [2024-11-28 19:16:29.722981] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.924 [2024-11-28 19:16:29.723090] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.924 [2024-11-28 19:16:29.723115] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.924 [2024-11-28 19:16:29.723130] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.924 [2024-11-28 19:16:29.723143] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.924 [2024-11-28 19:16:29.723171] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.924 qpair failed and we were unable to recover it. 00:28:08.924 [2024-11-28 19:16:29.733022] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.924 [2024-11-28 19:16:29.733117] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.924 [2024-11-28 19:16:29.733142] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.924 [2024-11-28 19:16:29.733157] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.924 [2024-11-28 19:16:29.733170] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.924 [2024-11-28 19:16:29.733198] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.924 qpair failed and we were unable to recover it. 00:28:08.924 [2024-11-28 19:16:29.743046] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.924 [2024-11-28 19:16:29.743133] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.924 [2024-11-28 19:16:29.743158] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.924 [2024-11-28 19:16:29.743172] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.924 [2024-11-28 19:16:29.743185] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.924 [2024-11-28 19:16:29.743215] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.924 qpair failed and we were unable to recover it. 00:28:08.924 [2024-11-28 19:16:29.753071] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.924 [2024-11-28 19:16:29.753150] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.924 [2024-11-28 19:16:29.753181] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.924 [2024-11-28 19:16:29.753197] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.924 [2024-11-28 19:16:29.753209] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.924 [2024-11-28 19:16:29.753238] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.924 qpair failed and we were unable to recover it. 00:28:08.924 [2024-11-28 19:16:29.763100] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.924 [2024-11-28 19:16:29.763187] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.924 [2024-11-28 19:16:29.763212] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.924 [2024-11-28 19:16:29.763227] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.924 [2024-11-28 19:16:29.763240] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.924 [2024-11-28 19:16:29.763268] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.924 qpair failed and we were unable to recover it. 00:28:08.924 [2024-11-28 19:16:29.773142] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.924 [2024-11-28 19:16:29.773230] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.924 [2024-11-28 19:16:29.773255] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.925 [2024-11-28 19:16:29.773270] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.925 [2024-11-28 19:16:29.773283] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.925 [2024-11-28 19:16:29.773311] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.925 qpair failed and we were unable to recover it. 00:28:08.925 [2024-11-28 19:16:29.783209] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.925 [2024-11-28 19:16:29.783300] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.925 [2024-11-28 19:16:29.783325] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.925 [2024-11-28 19:16:29.783339] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.925 [2024-11-28 19:16:29.783352] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.925 [2024-11-28 19:16:29.783381] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.925 qpair failed and we were unable to recover it. 00:28:08.925 [2024-11-28 19:16:29.793209] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.925 [2024-11-28 19:16:29.793313] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.925 [2024-11-28 19:16:29.793338] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.925 [2024-11-28 19:16:29.793353] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.925 [2024-11-28 19:16:29.793366] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.925 [2024-11-28 19:16:29.793408] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.925 qpair failed and we were unable to recover it. 00:28:08.925 [2024-11-28 19:16:29.803231] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.925 [2024-11-28 19:16:29.803320] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.925 [2024-11-28 19:16:29.803346] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.925 [2024-11-28 19:16:29.803361] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.925 [2024-11-28 19:16:29.803373] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.925 [2024-11-28 19:16:29.803409] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.925 qpair failed and we were unable to recover it. 00:28:08.925 [2024-11-28 19:16:29.813264] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.925 [2024-11-28 19:16:29.813364] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.925 [2024-11-28 19:16:29.813389] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.925 [2024-11-28 19:16:29.813415] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.925 [2024-11-28 19:16:29.813429] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.925 [2024-11-28 19:16:29.813457] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.925 qpair failed and we were unable to recover it. 00:28:08.925 [2024-11-28 19:16:29.823300] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.925 [2024-11-28 19:16:29.823391] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.925 [2024-11-28 19:16:29.823423] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.925 [2024-11-28 19:16:29.823438] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.925 [2024-11-28 19:16:29.823451] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.925 [2024-11-28 19:16:29.823479] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.925 qpair failed and we were unable to recover it. 00:28:08.925 [2024-11-28 19:16:29.833399] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.925 [2024-11-28 19:16:29.833511] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.925 [2024-11-28 19:16:29.833536] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.925 [2024-11-28 19:16:29.833550] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.925 [2024-11-28 19:16:29.833563] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.925 [2024-11-28 19:16:29.833591] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.925 qpair failed and we were unable to recover it. 00:28:08.925 [2024-11-28 19:16:29.843364] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.925 [2024-11-28 19:16:29.843472] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.925 [2024-11-28 19:16:29.843502] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.925 [2024-11-28 19:16:29.843518] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.925 [2024-11-28 19:16:29.843530] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.925 [2024-11-28 19:16:29.843559] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.925 qpair failed and we were unable to recover it. 00:28:08.925 [2024-11-28 19:16:29.853367] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.925 [2024-11-28 19:16:29.853469] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.925 [2024-11-28 19:16:29.853495] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.925 [2024-11-28 19:16:29.853509] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.925 [2024-11-28 19:16:29.853521] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.925 [2024-11-28 19:16:29.853549] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.925 qpair failed and we were unable to recover it. 00:28:08.925 [2024-11-28 19:16:29.863462] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.925 [2024-11-28 19:16:29.863550] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.925 [2024-11-28 19:16:29.863575] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.925 [2024-11-28 19:16:29.863589] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.925 [2024-11-28 19:16:29.863601] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.925 [2024-11-28 19:16:29.863629] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.925 qpair failed and we were unable to recover it. 00:28:08.925 [2024-11-28 19:16:29.873449] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.925 [2024-11-28 19:16:29.873531] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.925 [2024-11-28 19:16:29.873557] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.925 [2024-11-28 19:16:29.873572] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.925 [2024-11-28 19:16:29.873585] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.925 [2024-11-28 19:16:29.873613] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.925 qpair failed and we were unable to recover it. 00:28:08.925 [2024-11-28 19:16:29.883469] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.925 [2024-11-28 19:16:29.883557] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.925 [2024-11-28 19:16:29.883582] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.925 [2024-11-28 19:16:29.883596] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.925 [2024-11-28 19:16:29.883609] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.925 [2024-11-28 19:16:29.883645] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.925 qpair failed and we were unable to recover it. 00:28:08.925 [2024-11-28 19:16:29.893513] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.925 [2024-11-28 19:16:29.893609] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.925 [2024-11-28 19:16:29.893634] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.925 [2024-11-28 19:16:29.893649] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.925 [2024-11-28 19:16:29.893662] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.925 [2024-11-28 19:16:29.893690] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.925 qpair failed and we were unable to recover it. 00:28:08.925 [2024-11-28 19:16:29.903551] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.925 [2024-11-28 19:16:29.903639] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.925 [2024-11-28 19:16:29.903665] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.925 [2024-11-28 19:16:29.903680] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.925 [2024-11-28 19:16:29.903693] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.925 [2024-11-28 19:16:29.903722] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.925 qpair failed and we were unable to recover it. 00:28:08.926 [2024-11-28 19:16:29.913569] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.926 [2024-11-28 19:16:29.913658] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.926 [2024-11-28 19:16:29.913683] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.926 [2024-11-28 19:16:29.913698] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.926 [2024-11-28 19:16:29.913711] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.926 [2024-11-28 19:16:29.913738] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.926 qpair failed and we were unable to recover it. 00:28:08.926 [2024-11-28 19:16:29.923604] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.926 [2024-11-28 19:16:29.923733] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.926 [2024-11-28 19:16:29.923757] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.926 [2024-11-28 19:16:29.923771] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.926 [2024-11-28 19:16:29.923784] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.926 [2024-11-28 19:16:29.923813] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.926 qpair failed and we were unable to recover it. 00:28:08.926 [2024-11-28 19:16:29.933633] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.926 [2024-11-28 19:16:29.933761] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.926 [2024-11-28 19:16:29.933789] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.926 [2024-11-28 19:16:29.933804] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.926 [2024-11-28 19:16:29.933815] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.926 [2024-11-28 19:16:29.933843] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.926 qpair failed and we were unable to recover it. 00:28:08.926 [2024-11-28 19:16:29.943657] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.926 [2024-11-28 19:16:29.943744] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.926 [2024-11-28 19:16:29.943769] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.926 [2024-11-28 19:16:29.943784] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.926 [2024-11-28 19:16:29.943797] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.926 [2024-11-28 19:16:29.943825] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.926 qpair failed and we were unable to recover it. 00:28:08.926 [2024-11-28 19:16:29.953675] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.926 [2024-11-28 19:16:29.953788] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.926 [2024-11-28 19:16:29.953813] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.926 [2024-11-28 19:16:29.953827] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.926 [2024-11-28 19:16:29.953840] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.926 [2024-11-28 19:16:29.953868] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.926 qpair failed and we were unable to recover it. 00:28:08.926 [2024-11-28 19:16:29.963712] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:08.926 [2024-11-28 19:16:29.963800] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:08.926 [2024-11-28 19:16:29.963825] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:08.926 [2024-11-28 19:16:29.963839] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:08.926 [2024-11-28 19:16:29.963851] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:08.926 [2024-11-28 19:16:29.963880] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:08.926 qpair failed and we were unable to recover it. 00:28:09.185 [2024-11-28 19:16:29.973745] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.185 [2024-11-28 19:16:29.973893] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.185 [2024-11-28 19:16:29.973918] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.185 [2024-11-28 19:16:29.973933] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.185 [2024-11-28 19:16:29.973946] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.185 [2024-11-28 19:16:29.973980] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.185 qpair failed and we were unable to recover it. 00:28:09.185 [2024-11-28 19:16:29.983778] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.185 [2024-11-28 19:16:29.983864] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.185 [2024-11-28 19:16:29.983889] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.185 [2024-11-28 19:16:29.983904] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.185 [2024-11-28 19:16:29.983916] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.185 [2024-11-28 19:16:29.983944] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.185 qpair failed and we were unable to recover it. 00:28:09.185 [2024-11-28 19:16:29.993803] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.185 [2024-11-28 19:16:29.993927] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.185 [2024-11-28 19:16:29.993953] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.185 [2024-11-28 19:16:29.993967] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.185 [2024-11-28 19:16:29.993979] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.185 [2024-11-28 19:16:29.994008] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.185 qpair failed and we were unable to recover it. 00:28:09.185 [2024-11-28 19:16:30.003910] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.186 [2024-11-28 19:16:30.004021] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.186 [2024-11-28 19:16:30.004047] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.186 [2024-11-28 19:16:30.004062] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.186 [2024-11-28 19:16:30.004075] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.186 [2024-11-28 19:16:30.004103] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.186 qpair failed and we were unable to recover it. 00:28:09.186 [2024-11-28 19:16:30.014055] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.186 [2024-11-28 19:16:30.014162] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.186 [2024-11-28 19:16:30.014189] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.186 [2024-11-28 19:16:30.014204] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.186 [2024-11-28 19:16:30.014217] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.186 [2024-11-28 19:16:30.014246] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.186 qpair failed and we were unable to recover it. 00:28:09.186 [2024-11-28 19:16:30.024013] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.186 [2024-11-28 19:16:30.024142] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.186 [2024-11-28 19:16:30.024175] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.186 [2024-11-28 19:16:30.024192] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.186 [2024-11-28 19:16:30.024205] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.186 [2024-11-28 19:16:30.024234] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.186 qpair failed and we were unable to recover it. 00:28:09.186 [2024-11-28 19:16:30.033963] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.186 [2024-11-28 19:16:30.034091] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.186 [2024-11-28 19:16:30.034117] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.186 [2024-11-28 19:16:30.034132] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.186 [2024-11-28 19:16:30.034144] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.186 [2024-11-28 19:16:30.034173] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.186 qpair failed and we were unable to recover it. 00:28:09.186 [2024-11-28 19:16:30.043965] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.186 [2024-11-28 19:16:30.044056] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.186 [2024-11-28 19:16:30.044082] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.186 [2024-11-28 19:16:30.044096] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.186 [2024-11-28 19:16:30.044110] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.186 [2024-11-28 19:16:30.044138] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.186 qpair failed and we were unable to recover it. 00:28:09.186 [2024-11-28 19:16:30.054049] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.186 [2024-11-28 19:16:30.054187] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.186 [2024-11-28 19:16:30.054226] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.186 [2024-11-28 19:16:30.054246] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.186 [2024-11-28 19:16:30.054269] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.186 [2024-11-28 19:16:30.054311] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.186 qpair failed and we were unable to recover it. 00:28:09.186 [2024-11-28 19:16:30.064021] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.186 [2024-11-28 19:16:30.064118] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.186 [2024-11-28 19:16:30.064145] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.186 [2024-11-28 19:16:30.064160] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.186 [2024-11-28 19:16:30.064177] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.186 [2024-11-28 19:16:30.064207] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.186 qpair failed and we were unable to recover it. 00:28:09.186 [2024-11-28 19:16:30.074057] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.186 [2024-11-28 19:16:30.074141] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.186 [2024-11-28 19:16:30.074166] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.186 [2024-11-28 19:16:30.074181] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.186 [2024-11-28 19:16:30.074193] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.186 [2024-11-28 19:16:30.074221] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.186 qpair failed and we were unable to recover it. 00:28:09.186 [2024-11-28 19:16:30.084098] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.186 [2024-11-28 19:16:30.084222] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.186 [2024-11-28 19:16:30.084247] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.186 [2024-11-28 19:16:30.084261] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.186 [2024-11-28 19:16:30.084273] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.186 [2024-11-28 19:16:30.084301] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.186 qpair failed and we were unable to recover it. 00:28:09.186 [2024-11-28 19:16:30.094125] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.186 [2024-11-28 19:16:30.094217] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.186 [2024-11-28 19:16:30.094243] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.186 [2024-11-28 19:16:30.094257] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.186 [2024-11-28 19:16:30.094269] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.186 [2024-11-28 19:16:30.094297] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.186 qpair failed and we were unable to recover it. 00:28:09.186 [2024-11-28 19:16:30.104163] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.186 [2024-11-28 19:16:30.104286] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.186 [2024-11-28 19:16:30.104312] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.186 [2024-11-28 19:16:30.104326] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.186 [2024-11-28 19:16:30.104338] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.186 [2024-11-28 19:16:30.104366] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.186 qpair failed and we were unable to recover it. 00:28:09.186 [2024-11-28 19:16:30.114193] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.186 [2024-11-28 19:16:30.114284] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.186 [2024-11-28 19:16:30.114309] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.186 [2024-11-28 19:16:30.114324] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.186 [2024-11-28 19:16:30.114336] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.186 [2024-11-28 19:16:30.114363] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.186 qpair failed and we were unable to recover it. 00:28:09.186 [2024-11-28 19:16:30.124214] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.186 [2024-11-28 19:16:30.124305] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.186 [2024-11-28 19:16:30.124330] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.186 [2024-11-28 19:16:30.124345] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.186 [2024-11-28 19:16:30.124357] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.186 [2024-11-28 19:16:30.124385] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.186 qpair failed and we were unable to recover it. 00:28:09.186 [2024-11-28 19:16:30.134233] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.186 [2024-11-28 19:16:30.134323] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.186 [2024-11-28 19:16:30.134348] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.186 [2024-11-28 19:16:30.134362] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.186 [2024-11-28 19:16:30.134374] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.187 [2024-11-28 19:16:30.134408] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.187 qpair failed and we were unable to recover it. 00:28:09.187 [2024-11-28 19:16:30.144264] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.187 [2024-11-28 19:16:30.144362] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.187 [2024-11-28 19:16:30.144388] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.187 [2024-11-28 19:16:30.144410] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.187 [2024-11-28 19:16:30.144423] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.187 [2024-11-28 19:16:30.144451] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.187 qpair failed and we were unable to recover it. 00:28:09.187 [2024-11-28 19:16:30.154280] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.187 [2024-11-28 19:16:30.154370] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.187 [2024-11-28 19:16:30.154402] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.187 [2024-11-28 19:16:30.154418] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.187 [2024-11-28 19:16:30.154438] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.187 [2024-11-28 19:16:30.154467] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.187 qpair failed and we were unable to recover it. 00:28:09.187 [2024-11-28 19:16:30.164419] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.187 [2024-11-28 19:16:30.164530] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.187 [2024-11-28 19:16:30.164556] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.187 [2024-11-28 19:16:30.164570] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.187 [2024-11-28 19:16:30.164582] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.187 [2024-11-28 19:16:30.164610] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.187 qpair failed and we were unable to recover it. 00:28:09.187 [2024-11-28 19:16:30.174317] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.187 [2024-11-28 19:16:30.174405] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.187 [2024-11-28 19:16:30.174431] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.187 [2024-11-28 19:16:30.174445] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.187 [2024-11-28 19:16:30.174457] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.187 [2024-11-28 19:16:30.174485] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.187 qpair failed and we were unable to recover it. 00:28:09.187 [2024-11-28 19:16:30.184401] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.187 [2024-11-28 19:16:30.184505] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.187 [2024-11-28 19:16:30.184531] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.187 [2024-11-28 19:16:30.184546] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.187 [2024-11-28 19:16:30.184558] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.187 [2024-11-28 19:16:30.184586] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.187 qpair failed and we were unable to recover it. 00:28:09.187 [2024-11-28 19:16:30.194412] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.187 [2024-11-28 19:16:30.194497] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.187 [2024-11-28 19:16:30.194522] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.187 [2024-11-28 19:16:30.194536] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.187 [2024-11-28 19:16:30.194548] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.187 [2024-11-28 19:16:30.194576] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.187 qpair failed and we were unable to recover it. 00:28:09.187 [2024-11-28 19:16:30.204513] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.187 [2024-11-28 19:16:30.204606] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.187 [2024-11-28 19:16:30.204631] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.187 [2024-11-28 19:16:30.204645] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.187 [2024-11-28 19:16:30.204657] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.187 [2024-11-28 19:16:30.204685] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.187 qpair failed and we were unable to recover it. 00:28:09.187 [2024-11-28 19:16:30.214437] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.187 [2024-11-28 19:16:30.214565] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.187 [2024-11-28 19:16:30.214590] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.187 [2024-11-28 19:16:30.214605] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.187 [2024-11-28 19:16:30.214617] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.187 [2024-11-28 19:16:30.214645] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.187 qpair failed and we were unable to recover it. 00:28:09.187 [2024-11-28 19:16:30.224497] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.187 [2024-11-28 19:16:30.224592] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.187 [2024-11-28 19:16:30.224618] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.187 [2024-11-28 19:16:30.224632] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.187 [2024-11-28 19:16:30.224644] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.187 [2024-11-28 19:16:30.224672] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.187 qpair failed and we were unable to recover it. 00:28:09.446 [2024-11-28 19:16:30.234548] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.446 [2024-11-28 19:16:30.234674] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.446 [2024-11-28 19:16:30.234699] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.446 [2024-11-28 19:16:30.234714] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.446 [2024-11-28 19:16:30.234726] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.446 [2024-11-28 19:16:30.234754] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.446 qpair failed and we were unable to recover it. 00:28:09.446 [2024-11-28 19:16:30.244583] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.446 [2024-11-28 19:16:30.244675] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.446 [2024-11-28 19:16:30.244701] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.446 [2024-11-28 19:16:30.244716] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.446 [2024-11-28 19:16:30.244734] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.446 [2024-11-28 19:16:30.244766] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.446 qpair failed and we were unable to recover it. 00:28:09.446 [2024-11-28 19:16:30.254664] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.446 [2024-11-28 19:16:30.254767] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.446 [2024-11-28 19:16:30.254793] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.446 [2024-11-28 19:16:30.254807] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.446 [2024-11-28 19:16:30.254819] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.446 [2024-11-28 19:16:30.254847] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.446 qpair failed and we were unable to recover it. 00:28:09.446 [2024-11-28 19:16:30.264615] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.446 [2024-11-28 19:16:30.264718] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.446 [2024-11-28 19:16:30.264743] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.446 [2024-11-28 19:16:30.264758] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.446 [2024-11-28 19:16:30.264770] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.446 [2024-11-28 19:16:30.264798] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.446 qpair failed and we were unable to recover it. 00:28:09.446 [2024-11-28 19:16:30.274643] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.446 [2024-11-28 19:16:30.274724] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.446 [2024-11-28 19:16:30.274751] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.446 [2024-11-28 19:16:30.274766] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.446 [2024-11-28 19:16:30.274778] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.446 [2024-11-28 19:16:30.274808] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.446 qpair failed and we were unable to recover it. 00:28:09.446 [2024-11-28 19:16:30.284687] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.446 [2024-11-28 19:16:30.284775] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.446 [2024-11-28 19:16:30.284800] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.446 [2024-11-28 19:16:30.284815] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.446 [2024-11-28 19:16:30.284827] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.446 [2024-11-28 19:16:30.284854] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.446 qpair failed and we were unable to recover it. 00:28:09.446 [2024-11-28 19:16:30.294684] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.446 [2024-11-28 19:16:30.294775] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.446 [2024-11-28 19:16:30.294801] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.446 [2024-11-28 19:16:30.294816] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.446 [2024-11-28 19:16:30.294828] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.446 [2024-11-28 19:16:30.294856] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.446 qpair failed and we were unable to recover it. 00:28:09.446 [2024-11-28 19:16:30.304719] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.446 [2024-11-28 19:16:30.304805] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.446 [2024-11-28 19:16:30.304831] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.446 [2024-11-28 19:16:30.304845] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.446 [2024-11-28 19:16:30.304858] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.446 [2024-11-28 19:16:30.304886] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.446 qpair failed and we were unable to recover it. 00:28:09.446 [2024-11-28 19:16:30.314760] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.446 [2024-11-28 19:16:30.314846] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.446 [2024-11-28 19:16:30.314871] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.446 [2024-11-28 19:16:30.314885] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.446 [2024-11-28 19:16:30.314897] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.446 [2024-11-28 19:16:30.314925] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.446 qpair failed and we were unable to recover it. 00:28:09.446 [2024-11-28 19:16:30.324889] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.446 [2024-11-28 19:16:30.324983] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.446 [2024-11-28 19:16:30.325012] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.446 [2024-11-28 19:16:30.325029] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.446 [2024-11-28 19:16:30.325041] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.446 [2024-11-28 19:16:30.325069] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.446 qpair failed and we were unable to recover it. 00:28:09.447 [2024-11-28 19:16:30.334806] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.447 [2024-11-28 19:16:30.334890] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.447 [2024-11-28 19:16:30.334915] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.447 [2024-11-28 19:16:30.334930] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.447 [2024-11-28 19:16:30.334948] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.447 [2024-11-28 19:16:30.334977] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.447 qpair failed and we were unable to recover it. 00:28:09.447 [2024-11-28 19:16:30.344861] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.447 [2024-11-28 19:16:30.344955] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.447 [2024-11-28 19:16:30.344980] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.447 [2024-11-28 19:16:30.344995] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.447 [2024-11-28 19:16:30.345007] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.447 [2024-11-28 19:16:30.345035] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.447 qpair failed and we were unable to recover it. 00:28:09.447 [2024-11-28 19:16:30.354940] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.447 [2024-11-28 19:16:30.355028] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.447 [2024-11-28 19:16:30.355054] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.447 [2024-11-28 19:16:30.355068] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.447 [2024-11-28 19:16:30.355080] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.447 [2024-11-28 19:16:30.355108] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.447 qpair failed and we were unable to recover it. 00:28:09.447 [2024-11-28 19:16:30.364940] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.447 [2024-11-28 19:16:30.365039] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.447 [2024-11-28 19:16:30.365065] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.447 [2024-11-28 19:16:30.365079] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.447 [2024-11-28 19:16:30.365091] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.447 [2024-11-28 19:16:30.365119] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.447 qpair failed and we were unable to recover it. 00:28:09.447 [2024-11-28 19:16:30.374897] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:28:09.447 [2024-11-28 19:16:30.374984] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:28:09.447 [2024-11-28 19:16:30.375009] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:28:09.447 [2024-11-28 19:16:30.375023] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:28:09.447 [2024-11-28 19:16:30.375035] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1d84cb0 00:28:09.447 [2024-11-28 19:16:30.375063] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:28:09.447 qpair failed and we were unable to recover it. 00:28:09.447 [2024-11-28 19:16:30.375102] nvme_ctrlr.c:4339:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:28:09.447 A controller has encountered a failure and is being reset. 00:28:09.704 Controller properly reset. 00:28:10.269 Initializing NVMe Controllers 00:28:10.269 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:28:10.269 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:28:10.269 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:28:10.269 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:28:10.269 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:28:10.269 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:28:10.269 Initialization complete. Launching workers. 00:28:10.269 Starting thread on core 1 00:28:10.269 Starting thread on core 2 00:28:10.269 Starting thread on core 3 00:28:10.269 Starting thread on core 0 00:28:10.269 19:16:31 -- host/target_disconnect.sh@59 -- # sync 00:28:10.269 00:28:10.269 real 0m11.497s 00:28:10.269 user 0m23.539s 00:28:10.269 sys 0m5.307s 00:28:10.269 19:16:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:10.269 19:16:31 -- common/autotest_common.sh@10 -- # set +x 00:28:10.269 ************************************ 00:28:10.269 END TEST nvmf_target_disconnect_tc2 00:28:10.269 ************************************ 00:28:10.269 19:16:31 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:28:10.269 19:16:31 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:28:10.269 19:16:31 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:28:10.269 19:16:31 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:10.269 19:16:31 -- nvmf/common.sh@116 -- # sync 00:28:10.269 19:16:31 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:10.269 19:16:31 -- nvmf/common.sh@119 -- # set +e 00:28:10.269 19:16:31 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:10.269 19:16:31 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:10.269 rmmod nvme_tcp 00:28:10.269 rmmod nvme_fabrics 00:28:10.269 rmmod nvme_keyring 00:28:10.269 19:16:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:10.269 19:16:31 -- nvmf/common.sh@123 -- # set -e 00:28:10.269 19:16:31 -- nvmf/common.sh@124 -- # return 0 00:28:10.269 19:16:31 -- nvmf/common.sh@477 -- # '[' -n 328714 ']' 00:28:10.269 19:16:31 -- nvmf/common.sh@478 -- # killprocess 328714 00:28:10.269 19:16:31 -- common/autotest_common.sh@936 -- # '[' -z 328714 ']' 00:28:10.269 19:16:31 -- common/autotest_common.sh@940 -- # kill -0 328714 00:28:10.269 19:16:31 -- common/autotest_common.sh@941 -- # uname 00:28:10.269 19:16:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:10.269 19:16:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 328714 00:28:10.527 19:16:31 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:28:10.527 19:16:31 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:28:10.528 19:16:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 328714' 00:28:10.528 killing process with pid 328714 00:28:10.528 19:16:31 -- common/autotest_common.sh@955 -- # kill 328714 00:28:10.528 19:16:31 -- common/autotest_common.sh@960 -- # wait 328714 00:28:10.787 19:16:31 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:10.787 19:16:31 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:10.787 19:16:31 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:10.787 19:16:31 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:10.787 19:16:31 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:10.787 19:16:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:10.787 19:16:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:10.787 19:16:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:12.690 19:16:33 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:12.690 00:28:12.690 real 0m16.490s 00:28:12.690 user 0m49.765s 00:28:12.690 sys 0m7.459s 00:28:12.690 19:16:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:12.690 19:16:33 -- common/autotest_common.sh@10 -- # set +x 00:28:12.690 ************************************ 00:28:12.690 END TEST nvmf_target_disconnect 00:28:12.690 ************************************ 00:28:12.690 19:16:33 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:28:12.690 19:16:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:12.690 19:16:33 -- common/autotest_common.sh@10 -- # set +x 00:28:12.690 19:16:33 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:28:12.690 00:28:12.690 real 21m32.868s 00:28:12.690 user 62m42.846s 00:28:12.690 sys 4m56.721s 00:28:12.690 19:16:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:12.690 19:16:33 -- common/autotest_common.sh@10 -- # set +x 00:28:12.690 ************************************ 00:28:12.690 END TEST nvmf_tcp 00:28:12.690 ************************************ 00:28:12.690 19:16:33 -- spdk/autotest.sh@283 -- # [[ 0 -eq 0 ]] 00:28:12.690 19:16:33 -- spdk/autotest.sh@284 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:28:12.690 19:16:33 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:12.690 19:16:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:12.690 19:16:33 -- common/autotest_common.sh@10 -- # set +x 00:28:12.690 ************************************ 00:28:12.690 START TEST spdkcli_nvmf_tcp 00:28:12.690 ************************************ 00:28:12.690 19:16:33 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:28:12.948 * Looking for test storage... 00:28:12.949 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:28:12.949 19:16:33 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:12.949 19:16:33 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:12.949 19:16:33 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:12.949 19:16:33 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:12.949 19:16:33 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:12.949 19:16:33 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:12.949 19:16:33 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:12.949 19:16:33 -- scripts/common.sh@335 -- # IFS=.-: 00:28:12.949 19:16:33 -- scripts/common.sh@335 -- # read -ra ver1 00:28:12.949 19:16:33 -- scripts/common.sh@336 -- # IFS=.-: 00:28:12.949 19:16:33 -- scripts/common.sh@336 -- # read -ra ver2 00:28:12.949 19:16:33 -- scripts/common.sh@337 -- # local 'op=<' 00:28:12.949 19:16:33 -- scripts/common.sh@339 -- # ver1_l=2 00:28:12.949 19:16:33 -- scripts/common.sh@340 -- # ver2_l=1 00:28:12.949 19:16:33 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:12.949 19:16:33 -- scripts/common.sh@343 -- # case "$op" in 00:28:12.949 19:16:33 -- scripts/common.sh@344 -- # : 1 00:28:12.949 19:16:33 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:12.949 19:16:33 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:12.949 19:16:33 -- scripts/common.sh@364 -- # decimal 1 00:28:12.949 19:16:33 -- scripts/common.sh@352 -- # local d=1 00:28:12.949 19:16:33 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:12.949 19:16:33 -- scripts/common.sh@354 -- # echo 1 00:28:12.949 19:16:33 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:12.949 19:16:33 -- scripts/common.sh@365 -- # decimal 2 00:28:12.949 19:16:33 -- scripts/common.sh@352 -- # local d=2 00:28:12.949 19:16:33 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:12.949 19:16:33 -- scripts/common.sh@354 -- # echo 2 00:28:12.949 19:16:33 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:12.949 19:16:33 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:12.949 19:16:33 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:12.949 19:16:33 -- scripts/common.sh@367 -- # return 0 00:28:12.949 19:16:33 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:12.949 19:16:33 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:12.949 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:12.949 --rc genhtml_branch_coverage=1 00:28:12.949 --rc genhtml_function_coverage=1 00:28:12.949 --rc genhtml_legend=1 00:28:12.949 --rc geninfo_all_blocks=1 00:28:12.949 --rc geninfo_unexecuted_blocks=1 00:28:12.949 00:28:12.949 ' 00:28:12.949 19:16:33 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:12.949 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:12.949 --rc genhtml_branch_coverage=1 00:28:12.949 --rc genhtml_function_coverage=1 00:28:12.949 --rc genhtml_legend=1 00:28:12.949 --rc geninfo_all_blocks=1 00:28:12.949 --rc geninfo_unexecuted_blocks=1 00:28:12.949 00:28:12.949 ' 00:28:12.949 19:16:33 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:12.949 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:12.949 --rc genhtml_branch_coverage=1 00:28:12.949 --rc genhtml_function_coverage=1 00:28:12.949 --rc genhtml_legend=1 00:28:12.949 --rc geninfo_all_blocks=1 00:28:12.949 --rc geninfo_unexecuted_blocks=1 00:28:12.949 00:28:12.949 ' 00:28:12.949 19:16:33 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:12.949 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:12.949 --rc genhtml_branch_coverage=1 00:28:12.949 --rc genhtml_function_coverage=1 00:28:12.949 --rc genhtml_legend=1 00:28:12.949 --rc geninfo_all_blocks=1 00:28:12.949 --rc geninfo_unexecuted_blocks=1 00:28:12.949 00:28:12.949 ' 00:28:12.949 19:16:33 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:28:12.949 19:16:33 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:28:12.949 19:16:33 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:28:12.949 19:16:33 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:12.949 19:16:33 -- nvmf/common.sh@7 -- # uname -s 00:28:12.949 19:16:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:12.949 19:16:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:12.949 19:16:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:12.949 19:16:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:12.949 19:16:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:12.949 19:16:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:12.949 19:16:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:12.949 19:16:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:12.949 19:16:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:12.949 19:16:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:12.949 19:16:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:12.949 19:16:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:12.949 19:16:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:12.949 19:16:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:12.949 19:16:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:12.949 19:16:33 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:12.949 19:16:33 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:12.949 19:16:33 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:12.949 19:16:33 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:12.949 19:16:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:12.949 19:16:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:12.949 19:16:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:12.949 19:16:33 -- paths/export.sh@5 -- # export PATH 00:28:12.949 19:16:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:12.949 19:16:33 -- nvmf/common.sh@46 -- # : 0 00:28:12.949 19:16:33 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:12.949 19:16:33 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:12.949 19:16:33 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:12.949 19:16:33 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:12.949 19:16:33 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:12.949 19:16:33 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:12.949 19:16:33 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:12.949 19:16:33 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:12.949 19:16:33 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:28:12.949 19:16:33 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:28:12.949 19:16:33 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:28:12.949 19:16:33 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:28:12.949 19:16:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:12.949 19:16:33 -- common/autotest_common.sh@10 -- # set +x 00:28:12.949 19:16:33 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:28:12.949 19:16:33 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=329943 00:28:12.949 19:16:33 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:28:12.949 19:16:33 -- spdkcli/common.sh@34 -- # waitforlisten 329943 00:28:12.949 19:16:33 -- common/autotest_common.sh@829 -- # '[' -z 329943 ']' 00:28:12.949 19:16:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:12.949 19:16:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:12.949 19:16:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:12.949 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:12.949 19:16:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:12.949 19:16:33 -- common/autotest_common.sh@10 -- # set +x 00:28:12.949 [2024-11-28 19:16:33.922556] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:12.949 [2024-11-28 19:16:33.922642] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid329943 ] 00:28:12.949 EAL: No free 2048 kB hugepages reported on node 1 00:28:12.949 [2024-11-28 19:16:33.980829] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:28:13.207 [2024-11-28 19:16:34.089882] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:13.207 [2024-11-28 19:16:34.090102] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:13.207 [2024-11-28 19:16:34.090107] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:14.141 19:16:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:14.141 19:16:34 -- common/autotest_common.sh@862 -- # return 0 00:28:14.141 19:16:34 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:28:14.141 19:16:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:14.141 19:16:34 -- common/autotest_common.sh@10 -- # set +x 00:28:14.141 19:16:34 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:28:14.141 19:16:34 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:28:14.141 19:16:34 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:28:14.141 19:16:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:14.141 19:16:34 -- common/autotest_common.sh@10 -- # set +x 00:28:14.141 19:16:34 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:28:14.141 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:28:14.141 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:28:14.141 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:28:14.141 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:28:14.141 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:28:14.141 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:28:14.141 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:28:14.141 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:28:14.141 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:28:14.141 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:28:14.141 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:14.141 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:28:14.141 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:28:14.141 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:14.141 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:28:14.141 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:28:14.141 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:28:14.141 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:28:14.141 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:14.141 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:28:14.141 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:28:14.141 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:28:14.141 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:28:14.141 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:28:14.141 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:28:14.141 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:28:14.141 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:28:14.141 ' 00:28:14.398 [2024-11-28 19:16:35.371614] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:28:16.938 [2024-11-28 19:16:37.544645] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:17.876 [2024-11-28 19:16:38.781147] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:28:20.408 [2024-11-28 19:16:41.076562] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:28:22.316 [2024-11-28 19:16:43.038890] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:28:23.696 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:28:23.696 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:28:23.696 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:28:23.696 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:28:23.696 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:28:23.696 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:28:23.696 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:28:23.696 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:28:23.696 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:28:23.696 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:28:23.696 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:23.696 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:23.696 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:28:23.696 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:23.696 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:23.696 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:28:23.696 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:28:23.696 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:28:23.696 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:28:23.696 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:23.696 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:28:23.696 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:28:23.696 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:28:23.696 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:28:23.696 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:28:23.696 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:28:23.696 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:28:23.696 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:28:23.696 19:16:44 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:28:23.696 19:16:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:23.696 19:16:44 -- common/autotest_common.sh@10 -- # set +x 00:28:23.696 19:16:44 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:28:23.696 19:16:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:23.696 19:16:44 -- common/autotest_common.sh@10 -- # set +x 00:28:23.696 19:16:44 -- spdkcli/nvmf.sh@69 -- # check_match 00:28:23.696 19:16:44 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:28:24.265 19:16:45 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:28:24.265 19:16:45 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:28:24.265 19:16:45 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:28:24.265 19:16:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:24.265 19:16:45 -- common/autotest_common.sh@10 -- # set +x 00:28:24.265 19:16:45 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:28:24.265 19:16:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:24.265 19:16:45 -- common/autotest_common.sh@10 -- # set +x 00:28:24.265 19:16:45 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:28:24.265 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:28:24.265 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:28:24.265 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:28:24.265 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:28:24.265 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:28:24.265 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:28:24.265 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:28:24.265 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:28:24.265 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:28:24.265 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:28:24.265 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:28:24.265 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:28:24.265 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:28:24.265 ' 00:28:29.539 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:28:29.540 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:28:29.540 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:28:29.540 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:28:29.540 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:28:29.540 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:28:29.540 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:28:29.540 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:28:29.540 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:28:29.540 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:28:29.540 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:28:29.540 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:28:29.540 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:28:29.540 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:28:29.540 19:16:50 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:28:29.540 19:16:50 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:29.540 19:16:50 -- common/autotest_common.sh@10 -- # set +x 00:28:29.540 19:16:50 -- spdkcli/nvmf.sh@90 -- # killprocess 329943 00:28:29.540 19:16:50 -- common/autotest_common.sh@936 -- # '[' -z 329943 ']' 00:28:29.540 19:16:50 -- common/autotest_common.sh@940 -- # kill -0 329943 00:28:29.540 19:16:50 -- common/autotest_common.sh@941 -- # uname 00:28:29.540 19:16:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:29.540 19:16:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 329943 00:28:29.540 19:16:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:29.540 19:16:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:29.540 19:16:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 329943' 00:28:29.540 killing process with pid 329943 00:28:29.540 19:16:50 -- common/autotest_common.sh@955 -- # kill 329943 00:28:29.540 [2024-11-28 19:16:50.474198] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:28:29.540 19:16:50 -- common/autotest_common.sh@960 -- # wait 329943 00:28:29.798 19:16:50 -- spdkcli/nvmf.sh@1 -- # cleanup 00:28:29.798 19:16:50 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:28:29.798 19:16:50 -- spdkcli/common.sh@13 -- # '[' -n 329943 ']' 00:28:29.798 19:16:50 -- spdkcli/common.sh@14 -- # killprocess 329943 00:28:29.798 19:16:50 -- common/autotest_common.sh@936 -- # '[' -z 329943 ']' 00:28:29.798 19:16:50 -- common/autotest_common.sh@940 -- # kill -0 329943 00:28:29.798 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (329943) - No such process 00:28:29.798 19:16:50 -- common/autotest_common.sh@963 -- # echo 'Process with pid 329943 is not found' 00:28:29.798 Process with pid 329943 is not found 00:28:29.798 19:16:50 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:28:29.798 19:16:50 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:28:29.798 19:16:50 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:28:29.798 00:28:29.798 real 0m17.018s 00:28:29.798 user 0m36.098s 00:28:29.798 sys 0m0.874s 00:28:29.798 19:16:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:29.798 19:16:50 -- common/autotest_common.sh@10 -- # set +x 00:28:29.798 ************************************ 00:28:29.798 END TEST spdkcli_nvmf_tcp 00:28:29.798 ************************************ 00:28:29.798 19:16:50 -- spdk/autotest.sh@285 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:28:29.798 19:16:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:29.798 19:16:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:29.798 19:16:50 -- common/autotest_common.sh@10 -- # set +x 00:28:29.798 ************************************ 00:28:29.798 START TEST nvmf_identify_passthru 00:28:29.798 ************************************ 00:28:29.798 19:16:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:28:29.798 * Looking for test storage... 00:28:29.798 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:28:29.798 19:16:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:29.798 19:16:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:29.798 19:16:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:30.058 19:16:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:30.058 19:16:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:30.058 19:16:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:30.058 19:16:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:30.058 19:16:50 -- scripts/common.sh@335 -- # IFS=.-: 00:28:30.058 19:16:50 -- scripts/common.sh@335 -- # read -ra ver1 00:28:30.058 19:16:50 -- scripts/common.sh@336 -- # IFS=.-: 00:28:30.058 19:16:50 -- scripts/common.sh@336 -- # read -ra ver2 00:28:30.058 19:16:50 -- scripts/common.sh@337 -- # local 'op=<' 00:28:30.058 19:16:50 -- scripts/common.sh@339 -- # ver1_l=2 00:28:30.058 19:16:50 -- scripts/common.sh@340 -- # ver2_l=1 00:28:30.058 19:16:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:30.058 19:16:50 -- scripts/common.sh@343 -- # case "$op" in 00:28:30.058 19:16:50 -- scripts/common.sh@344 -- # : 1 00:28:30.058 19:16:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:30.058 19:16:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:30.058 19:16:50 -- scripts/common.sh@364 -- # decimal 1 00:28:30.058 19:16:50 -- scripts/common.sh@352 -- # local d=1 00:28:30.058 19:16:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:30.058 19:16:50 -- scripts/common.sh@354 -- # echo 1 00:28:30.058 19:16:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:30.058 19:16:50 -- scripts/common.sh@365 -- # decimal 2 00:28:30.058 19:16:50 -- scripts/common.sh@352 -- # local d=2 00:28:30.058 19:16:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:30.058 19:16:50 -- scripts/common.sh@354 -- # echo 2 00:28:30.058 19:16:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:30.058 19:16:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:30.058 19:16:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:30.058 19:16:50 -- scripts/common.sh@367 -- # return 0 00:28:30.058 19:16:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:30.058 19:16:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:30.058 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:30.058 --rc genhtml_branch_coverage=1 00:28:30.058 --rc genhtml_function_coverage=1 00:28:30.058 --rc genhtml_legend=1 00:28:30.058 --rc geninfo_all_blocks=1 00:28:30.058 --rc geninfo_unexecuted_blocks=1 00:28:30.058 00:28:30.058 ' 00:28:30.058 19:16:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:30.058 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:30.058 --rc genhtml_branch_coverage=1 00:28:30.058 --rc genhtml_function_coverage=1 00:28:30.058 --rc genhtml_legend=1 00:28:30.058 --rc geninfo_all_blocks=1 00:28:30.058 --rc geninfo_unexecuted_blocks=1 00:28:30.058 00:28:30.058 ' 00:28:30.058 19:16:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:30.059 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:30.059 --rc genhtml_branch_coverage=1 00:28:30.059 --rc genhtml_function_coverage=1 00:28:30.059 --rc genhtml_legend=1 00:28:30.059 --rc geninfo_all_blocks=1 00:28:30.059 --rc geninfo_unexecuted_blocks=1 00:28:30.059 00:28:30.059 ' 00:28:30.059 19:16:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:30.059 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:30.059 --rc genhtml_branch_coverage=1 00:28:30.059 --rc genhtml_function_coverage=1 00:28:30.059 --rc genhtml_legend=1 00:28:30.059 --rc geninfo_all_blocks=1 00:28:30.059 --rc geninfo_unexecuted_blocks=1 00:28:30.059 00:28:30.059 ' 00:28:30.059 19:16:50 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:30.059 19:16:50 -- nvmf/common.sh@7 -- # uname -s 00:28:30.059 19:16:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:30.059 19:16:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:30.059 19:16:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:30.059 19:16:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:30.059 19:16:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:30.059 19:16:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:30.059 19:16:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:30.059 19:16:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:30.059 19:16:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:30.059 19:16:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:30.059 19:16:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:30.059 19:16:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:30.059 19:16:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:30.059 19:16:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:30.059 19:16:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:30.059 19:16:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:30.059 19:16:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:30.059 19:16:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:30.059 19:16:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:30.059 19:16:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:30.059 19:16:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:30.059 19:16:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:30.059 19:16:50 -- paths/export.sh@5 -- # export PATH 00:28:30.059 19:16:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:30.059 19:16:50 -- nvmf/common.sh@46 -- # : 0 00:28:30.059 19:16:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:30.059 19:16:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:30.059 19:16:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:30.059 19:16:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:30.059 19:16:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:30.059 19:16:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:30.059 19:16:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:30.059 19:16:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:30.059 19:16:50 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:30.059 19:16:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:30.059 19:16:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:30.059 19:16:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:30.059 19:16:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:30.059 19:16:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:30.059 19:16:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:30.059 19:16:50 -- paths/export.sh@5 -- # export PATH 00:28:30.059 19:16:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:30.059 19:16:50 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:28:30.059 19:16:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:30.059 19:16:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:30.059 19:16:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:30.059 19:16:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:30.059 19:16:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:30.059 19:16:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:30.059 19:16:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:30.059 19:16:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:30.059 19:16:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:30.059 19:16:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:30.059 19:16:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:30.059 19:16:50 -- common/autotest_common.sh@10 -- # set +x 00:28:31.962 19:16:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:31.962 19:16:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:31.962 19:16:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:31.962 19:16:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:31.962 19:16:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:31.963 19:16:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:31.963 19:16:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:31.963 19:16:52 -- nvmf/common.sh@294 -- # net_devs=() 00:28:31.963 19:16:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:31.963 19:16:52 -- nvmf/common.sh@295 -- # e810=() 00:28:31.963 19:16:52 -- nvmf/common.sh@295 -- # local -ga e810 00:28:31.963 19:16:52 -- nvmf/common.sh@296 -- # x722=() 00:28:31.963 19:16:52 -- nvmf/common.sh@296 -- # local -ga x722 00:28:31.963 19:16:52 -- nvmf/common.sh@297 -- # mlx=() 00:28:31.963 19:16:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:31.963 19:16:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:31.963 19:16:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:31.963 19:16:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:31.963 19:16:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:31.963 19:16:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:31.963 19:16:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:31.963 19:16:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:31.963 19:16:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:31.963 19:16:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:31.963 19:16:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:31.963 19:16:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:31.963 19:16:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:31.963 19:16:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:31.963 19:16:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:31.963 19:16:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:31.963 19:16:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:31.963 19:16:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:31.963 19:16:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:31.963 19:16:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:31.963 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:31.963 19:16:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:31.963 19:16:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:31.963 19:16:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:31.963 19:16:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:31.963 19:16:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:31.963 19:16:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:31.963 19:16:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:31.963 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:31.963 19:16:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:31.963 19:16:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:31.963 19:16:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:31.963 19:16:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:31.963 19:16:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:31.963 19:16:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:31.963 19:16:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:31.963 19:16:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:31.963 19:16:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:31.963 19:16:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:31.963 19:16:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:31.963 19:16:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:31.963 19:16:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:31.963 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:31.963 19:16:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:31.963 19:16:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:31.963 19:16:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:31.963 19:16:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:31.963 19:16:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:31.963 19:16:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:31.963 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:31.963 19:16:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:31.963 19:16:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:31.963 19:16:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:31.963 19:16:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:31.963 19:16:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:31.963 19:16:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:31.963 19:16:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:31.963 19:16:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:31.963 19:16:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:31.963 19:16:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:31.963 19:16:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:31.963 19:16:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:31.963 19:16:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:31.963 19:16:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:31.963 19:16:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:31.963 19:16:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:31.963 19:16:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:31.963 19:16:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:31.963 19:16:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:31.963 19:16:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:31.963 19:16:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:31.963 19:16:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:31.963 19:16:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:31.963 19:16:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:31.963 19:16:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:31.963 19:16:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:31.963 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:31.963 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.246 ms 00:28:31.963 00:28:31.963 --- 10.0.0.2 ping statistics --- 00:28:31.963 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:31.963 rtt min/avg/max/mdev = 0.246/0.246/0.246/0.000 ms 00:28:31.963 19:16:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:31.963 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:31.963 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.118 ms 00:28:31.963 00:28:31.963 --- 10.0.0.1 ping statistics --- 00:28:31.963 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:31.963 rtt min/avg/max/mdev = 0.118/0.118/0.118/0.000 ms 00:28:31.963 19:16:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:31.963 19:16:52 -- nvmf/common.sh@410 -- # return 0 00:28:31.963 19:16:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:31.963 19:16:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:31.963 19:16:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:31.963 19:16:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:31.963 19:16:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:31.963 19:16:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:31.963 19:16:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:31.963 19:16:52 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:28:31.963 19:16:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:31.963 19:16:52 -- common/autotest_common.sh@10 -- # set +x 00:28:31.963 19:16:52 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:28:31.963 19:16:52 -- common/autotest_common.sh@1519 -- # bdfs=() 00:28:31.963 19:16:52 -- common/autotest_common.sh@1519 -- # local bdfs 00:28:31.963 19:16:52 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:28:31.963 19:16:52 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:28:31.963 19:16:52 -- common/autotest_common.sh@1508 -- # bdfs=() 00:28:31.963 19:16:52 -- common/autotest_common.sh@1508 -- # local bdfs 00:28:31.963 19:16:52 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:28:31.963 19:16:52 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:28:31.963 19:16:52 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:28:31.963 19:16:52 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:28:31.963 19:16:52 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:28:31.963 19:16:52 -- common/autotest_common.sh@1522 -- # echo 0000:88:00.0 00:28:31.963 19:16:52 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:28:31.963 19:16:52 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:28:31.963 19:16:52 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:28:31.963 19:16:52 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:28:31.963 19:16:52 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:28:32.224 EAL: No free 2048 kB hugepages reported on node 1 00:28:36.417 19:16:57 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:28:36.417 19:16:57 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:28:36.417 19:16:57 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:28:36.417 19:16:57 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:28:36.417 EAL: No free 2048 kB hugepages reported on node 1 00:28:40.604 19:17:01 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:28:40.604 19:17:01 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:28:40.604 19:17:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:40.604 19:17:01 -- common/autotest_common.sh@10 -- # set +x 00:28:40.604 19:17:01 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:28:40.604 19:17:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:40.604 19:17:01 -- common/autotest_common.sh@10 -- # set +x 00:28:40.604 19:17:01 -- target/identify_passthru.sh@31 -- # nvmfpid=334722 00:28:40.604 19:17:01 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:28:40.604 19:17:01 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:40.604 19:17:01 -- target/identify_passthru.sh@35 -- # waitforlisten 334722 00:28:40.604 19:17:01 -- common/autotest_common.sh@829 -- # '[' -z 334722 ']' 00:28:40.604 19:17:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:40.604 19:17:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:40.604 19:17:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:40.604 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:40.604 19:17:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:40.604 19:17:01 -- common/autotest_common.sh@10 -- # set +x 00:28:40.604 [2024-11-28 19:17:01.586519] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:40.605 [2024-11-28 19:17:01.586596] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:40.605 EAL: No free 2048 kB hugepages reported on node 1 00:28:40.605 [2024-11-28 19:17:01.651023] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:28:40.862 [2024-11-28 19:17:01.756338] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:40.862 [2024-11-28 19:17:01.756499] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:40.862 [2024-11-28 19:17:01.756518] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:40.862 [2024-11-28 19:17:01.756530] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:40.862 [2024-11-28 19:17:01.756583] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:40.862 [2024-11-28 19:17:01.756641] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:40.863 [2024-11-28 19:17:01.756707] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:40.863 [2024-11-28 19:17:01.756710] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:40.863 19:17:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:40.863 19:17:01 -- common/autotest_common.sh@862 -- # return 0 00:28:40.863 19:17:01 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:28:40.863 19:17:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:40.863 19:17:01 -- common/autotest_common.sh@10 -- # set +x 00:28:40.863 INFO: Log level set to 20 00:28:40.863 INFO: Requests: 00:28:40.863 { 00:28:40.863 "jsonrpc": "2.0", 00:28:40.863 "method": "nvmf_set_config", 00:28:40.863 "id": 1, 00:28:40.863 "params": { 00:28:40.863 "admin_cmd_passthru": { 00:28:40.863 "identify_ctrlr": true 00:28:40.863 } 00:28:40.863 } 00:28:40.863 } 00:28:40.863 00:28:40.863 INFO: response: 00:28:40.863 { 00:28:40.863 "jsonrpc": "2.0", 00:28:40.863 "id": 1, 00:28:40.863 "result": true 00:28:40.863 } 00:28:40.863 00:28:40.863 19:17:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:40.863 19:17:01 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:28:40.863 19:17:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:40.863 19:17:01 -- common/autotest_common.sh@10 -- # set +x 00:28:40.863 INFO: Setting log level to 20 00:28:40.863 INFO: Setting log level to 20 00:28:40.863 INFO: Log level set to 20 00:28:40.863 INFO: Log level set to 20 00:28:40.863 INFO: Requests: 00:28:40.863 { 00:28:40.863 "jsonrpc": "2.0", 00:28:40.863 "method": "framework_start_init", 00:28:40.863 "id": 1 00:28:40.863 } 00:28:40.863 00:28:40.863 INFO: Requests: 00:28:40.863 { 00:28:40.863 "jsonrpc": "2.0", 00:28:40.863 "method": "framework_start_init", 00:28:40.863 "id": 1 00:28:40.863 } 00:28:40.863 00:28:41.121 [2024-11-28 19:17:01.921598] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:28:41.121 INFO: response: 00:28:41.121 { 00:28:41.121 "jsonrpc": "2.0", 00:28:41.121 "id": 1, 00:28:41.121 "result": true 00:28:41.121 } 00:28:41.121 00:28:41.121 INFO: response: 00:28:41.121 { 00:28:41.121 "jsonrpc": "2.0", 00:28:41.121 "id": 1, 00:28:41.121 "result": true 00:28:41.121 } 00:28:41.121 00:28:41.121 19:17:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.121 19:17:01 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:28:41.121 19:17:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.121 19:17:01 -- common/autotest_common.sh@10 -- # set +x 00:28:41.121 INFO: Setting log level to 40 00:28:41.121 INFO: Setting log level to 40 00:28:41.121 INFO: Setting log level to 40 00:28:41.121 [2024-11-28 19:17:01.931496] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:41.121 19:17:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.121 19:17:01 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:28:41.121 19:17:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:41.121 19:17:01 -- common/autotest_common.sh@10 -- # set +x 00:28:41.121 19:17:01 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:28:41.121 19:17:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.121 19:17:01 -- common/autotest_common.sh@10 -- # set +x 00:28:44.406 Nvme0n1 00:28:44.406 19:17:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:44.406 19:17:04 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:28:44.406 19:17:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:44.406 19:17:04 -- common/autotest_common.sh@10 -- # set +x 00:28:44.406 19:17:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:44.406 19:17:04 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:28:44.406 19:17:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:44.406 19:17:04 -- common/autotest_common.sh@10 -- # set +x 00:28:44.406 19:17:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:44.406 19:17:04 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:44.406 19:17:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:44.406 19:17:04 -- common/autotest_common.sh@10 -- # set +x 00:28:44.406 [2024-11-28 19:17:04.824786] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:44.406 19:17:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:44.406 19:17:04 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:28:44.406 19:17:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:44.406 19:17:04 -- common/autotest_common.sh@10 -- # set +x 00:28:44.406 [2024-11-28 19:17:04.832444] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:28:44.406 [ 00:28:44.406 { 00:28:44.406 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:28:44.406 "subtype": "Discovery", 00:28:44.406 "listen_addresses": [], 00:28:44.406 "allow_any_host": true, 00:28:44.406 "hosts": [] 00:28:44.406 }, 00:28:44.406 { 00:28:44.406 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:28:44.406 "subtype": "NVMe", 00:28:44.406 "listen_addresses": [ 00:28:44.406 { 00:28:44.406 "transport": "TCP", 00:28:44.406 "trtype": "TCP", 00:28:44.406 "adrfam": "IPv4", 00:28:44.406 "traddr": "10.0.0.2", 00:28:44.406 "trsvcid": "4420" 00:28:44.406 } 00:28:44.406 ], 00:28:44.406 "allow_any_host": true, 00:28:44.406 "hosts": [], 00:28:44.406 "serial_number": "SPDK00000000000001", 00:28:44.406 "model_number": "SPDK bdev Controller", 00:28:44.406 "max_namespaces": 1, 00:28:44.406 "min_cntlid": 1, 00:28:44.406 "max_cntlid": 65519, 00:28:44.406 "namespaces": [ 00:28:44.406 { 00:28:44.406 "nsid": 1, 00:28:44.406 "bdev_name": "Nvme0n1", 00:28:44.406 "name": "Nvme0n1", 00:28:44.406 "nguid": "5307F629CF7D4DC9AD10BE6A36247E17", 00:28:44.406 "uuid": "5307f629-cf7d-4dc9-ad10-be6a36247e17" 00:28:44.406 } 00:28:44.406 ] 00:28:44.406 } 00:28:44.406 ] 00:28:44.406 19:17:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:44.406 19:17:04 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:44.406 19:17:04 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:28:44.406 19:17:04 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:28:44.406 EAL: No free 2048 kB hugepages reported on node 1 00:28:44.406 19:17:04 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:28:44.406 19:17:04 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:28:44.406 19:17:04 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:28:44.406 19:17:04 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:28:44.406 EAL: No free 2048 kB hugepages reported on node 1 00:28:44.406 19:17:05 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:28:44.406 19:17:05 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:28:44.406 19:17:05 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:28:44.406 19:17:05 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:44.406 19:17:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:44.406 19:17:05 -- common/autotest_common.sh@10 -- # set +x 00:28:44.406 19:17:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:44.406 19:17:05 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:28:44.406 19:17:05 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:28:44.406 19:17:05 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:44.406 19:17:05 -- nvmf/common.sh@116 -- # sync 00:28:44.406 19:17:05 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:44.406 19:17:05 -- nvmf/common.sh@119 -- # set +e 00:28:44.406 19:17:05 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:44.406 19:17:05 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:44.406 rmmod nvme_tcp 00:28:44.406 rmmod nvme_fabrics 00:28:44.406 rmmod nvme_keyring 00:28:44.406 19:17:05 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:44.406 19:17:05 -- nvmf/common.sh@123 -- # set -e 00:28:44.406 19:17:05 -- nvmf/common.sh@124 -- # return 0 00:28:44.406 19:17:05 -- nvmf/common.sh@477 -- # '[' -n 334722 ']' 00:28:44.406 19:17:05 -- nvmf/common.sh@478 -- # killprocess 334722 00:28:44.406 19:17:05 -- common/autotest_common.sh@936 -- # '[' -z 334722 ']' 00:28:44.406 19:17:05 -- common/autotest_common.sh@940 -- # kill -0 334722 00:28:44.406 19:17:05 -- common/autotest_common.sh@941 -- # uname 00:28:44.406 19:17:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:44.406 19:17:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 334722 00:28:44.406 19:17:05 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:44.406 19:17:05 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:44.406 19:17:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 334722' 00:28:44.406 killing process with pid 334722 00:28:44.406 19:17:05 -- common/autotest_common.sh@955 -- # kill 334722 00:28:44.406 [2024-11-28 19:17:05.196770] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:28:44.406 19:17:05 -- common/autotest_common.sh@960 -- # wait 334722 00:28:45.782 19:17:06 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:45.782 19:17:06 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:45.782 19:17:06 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:45.782 19:17:06 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:45.782 19:17:06 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:45.782 19:17:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:45.782 19:17:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:45.782 19:17:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:48.316 19:17:08 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:48.316 00:28:48.316 real 0m18.080s 00:28:48.316 user 0m26.698s 00:28:48.316 sys 0m2.206s 00:28:48.316 19:17:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:48.316 19:17:08 -- common/autotest_common.sh@10 -- # set +x 00:28:48.316 ************************************ 00:28:48.316 END TEST nvmf_identify_passthru 00:28:48.316 ************************************ 00:28:48.316 19:17:08 -- spdk/autotest.sh@287 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:48.317 19:17:08 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:48.317 19:17:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:48.317 19:17:08 -- common/autotest_common.sh@10 -- # set +x 00:28:48.317 ************************************ 00:28:48.317 START TEST nvmf_dif 00:28:48.317 ************************************ 00:28:48.317 19:17:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:28:48.317 * Looking for test storage... 00:28:48.317 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:28:48.317 19:17:08 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:48.317 19:17:08 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:48.317 19:17:08 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:48.317 19:17:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:48.317 19:17:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:48.317 19:17:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:48.317 19:17:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:48.317 19:17:09 -- scripts/common.sh@335 -- # IFS=.-: 00:28:48.317 19:17:09 -- scripts/common.sh@335 -- # read -ra ver1 00:28:48.317 19:17:09 -- scripts/common.sh@336 -- # IFS=.-: 00:28:48.317 19:17:09 -- scripts/common.sh@336 -- # read -ra ver2 00:28:48.317 19:17:09 -- scripts/common.sh@337 -- # local 'op=<' 00:28:48.317 19:17:09 -- scripts/common.sh@339 -- # ver1_l=2 00:28:48.317 19:17:09 -- scripts/common.sh@340 -- # ver2_l=1 00:28:48.317 19:17:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:48.317 19:17:09 -- scripts/common.sh@343 -- # case "$op" in 00:28:48.317 19:17:09 -- scripts/common.sh@344 -- # : 1 00:28:48.317 19:17:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:48.317 19:17:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:48.317 19:17:09 -- scripts/common.sh@364 -- # decimal 1 00:28:48.317 19:17:09 -- scripts/common.sh@352 -- # local d=1 00:28:48.317 19:17:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:48.317 19:17:09 -- scripts/common.sh@354 -- # echo 1 00:28:48.317 19:17:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:48.317 19:17:09 -- scripts/common.sh@365 -- # decimal 2 00:28:48.317 19:17:09 -- scripts/common.sh@352 -- # local d=2 00:28:48.317 19:17:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:48.317 19:17:09 -- scripts/common.sh@354 -- # echo 2 00:28:48.317 19:17:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:48.317 19:17:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:48.317 19:17:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:48.317 19:17:09 -- scripts/common.sh@367 -- # return 0 00:28:48.317 19:17:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:48.317 19:17:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:48.317 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:48.317 --rc genhtml_branch_coverage=1 00:28:48.317 --rc genhtml_function_coverage=1 00:28:48.317 --rc genhtml_legend=1 00:28:48.317 --rc geninfo_all_blocks=1 00:28:48.317 --rc geninfo_unexecuted_blocks=1 00:28:48.317 00:28:48.317 ' 00:28:48.317 19:17:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:48.317 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:48.317 --rc genhtml_branch_coverage=1 00:28:48.317 --rc genhtml_function_coverage=1 00:28:48.317 --rc genhtml_legend=1 00:28:48.317 --rc geninfo_all_blocks=1 00:28:48.317 --rc geninfo_unexecuted_blocks=1 00:28:48.317 00:28:48.317 ' 00:28:48.317 19:17:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:48.317 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:48.317 --rc genhtml_branch_coverage=1 00:28:48.317 --rc genhtml_function_coverage=1 00:28:48.317 --rc genhtml_legend=1 00:28:48.317 --rc geninfo_all_blocks=1 00:28:48.317 --rc geninfo_unexecuted_blocks=1 00:28:48.317 00:28:48.317 ' 00:28:48.317 19:17:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:48.317 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:48.317 --rc genhtml_branch_coverage=1 00:28:48.317 --rc genhtml_function_coverage=1 00:28:48.317 --rc genhtml_legend=1 00:28:48.317 --rc geninfo_all_blocks=1 00:28:48.317 --rc geninfo_unexecuted_blocks=1 00:28:48.317 00:28:48.317 ' 00:28:48.317 19:17:09 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:48.317 19:17:09 -- nvmf/common.sh@7 -- # uname -s 00:28:48.317 19:17:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:48.317 19:17:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:48.317 19:17:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:48.317 19:17:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:48.317 19:17:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:48.317 19:17:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:48.317 19:17:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:48.317 19:17:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:48.317 19:17:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:48.317 19:17:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:48.317 19:17:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:48.317 19:17:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:48.317 19:17:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:48.317 19:17:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:48.317 19:17:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:48.317 19:17:09 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:48.317 19:17:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:48.317 19:17:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:48.317 19:17:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:48.317 19:17:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:48.317 19:17:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:48.317 19:17:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:48.317 19:17:09 -- paths/export.sh@5 -- # export PATH 00:28:48.317 19:17:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:48.317 19:17:09 -- nvmf/common.sh@46 -- # : 0 00:28:48.317 19:17:09 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:48.317 19:17:09 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:48.317 19:17:09 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:48.317 19:17:09 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:48.317 19:17:09 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:48.317 19:17:09 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:48.317 19:17:09 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:48.317 19:17:09 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:48.317 19:17:09 -- target/dif.sh@15 -- # NULL_META=16 00:28:48.317 19:17:09 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:28:48.317 19:17:09 -- target/dif.sh@15 -- # NULL_SIZE=64 00:28:48.317 19:17:09 -- target/dif.sh@15 -- # NULL_DIF=1 00:28:48.317 19:17:09 -- target/dif.sh@135 -- # nvmftestinit 00:28:48.317 19:17:09 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:48.317 19:17:09 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:48.317 19:17:09 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:48.317 19:17:09 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:48.317 19:17:09 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:48.317 19:17:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:48.317 19:17:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:28:48.317 19:17:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:48.317 19:17:09 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:48.317 19:17:09 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:48.317 19:17:09 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:48.317 19:17:09 -- common/autotest_common.sh@10 -- # set +x 00:28:50.219 19:17:10 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:50.220 19:17:10 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:50.220 19:17:10 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:50.220 19:17:10 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:50.220 19:17:10 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:50.220 19:17:10 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:50.220 19:17:10 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:50.220 19:17:10 -- nvmf/common.sh@294 -- # net_devs=() 00:28:50.220 19:17:10 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:50.220 19:17:10 -- nvmf/common.sh@295 -- # e810=() 00:28:50.220 19:17:10 -- nvmf/common.sh@295 -- # local -ga e810 00:28:50.220 19:17:10 -- nvmf/common.sh@296 -- # x722=() 00:28:50.220 19:17:10 -- nvmf/common.sh@296 -- # local -ga x722 00:28:50.220 19:17:10 -- nvmf/common.sh@297 -- # mlx=() 00:28:50.220 19:17:10 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:50.220 19:17:10 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:50.220 19:17:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:50.220 19:17:10 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:50.220 19:17:10 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:50.220 19:17:10 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:50.220 19:17:10 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:50.220 19:17:10 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:50.220 19:17:10 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:50.220 19:17:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:50.220 19:17:10 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:50.220 19:17:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:50.220 19:17:10 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:50.220 19:17:10 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:50.220 19:17:10 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:50.220 19:17:10 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:50.220 19:17:10 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:50.220 19:17:10 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:50.220 19:17:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:50.220 19:17:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:50.220 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:50.220 19:17:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:50.220 19:17:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:50.220 19:17:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:50.220 19:17:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:50.220 19:17:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:50.220 19:17:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:50.220 19:17:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:50.220 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:50.220 19:17:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:50.220 19:17:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:50.220 19:17:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:50.220 19:17:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:50.220 19:17:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:50.220 19:17:10 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:50.220 19:17:10 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:50.220 19:17:10 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:50.220 19:17:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:50.220 19:17:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:50.220 19:17:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:50.220 19:17:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:50.220 19:17:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:50.220 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:50.220 19:17:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:50.220 19:17:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:50.220 19:17:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:50.220 19:17:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:50.220 19:17:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:50.220 19:17:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:50.220 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:50.220 19:17:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:50.220 19:17:10 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:50.220 19:17:10 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:50.220 19:17:10 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:50.220 19:17:10 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:50.220 19:17:10 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:50.220 19:17:10 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:50.220 19:17:10 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:50.220 19:17:10 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:50.220 19:17:10 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:50.220 19:17:10 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:50.220 19:17:10 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:50.220 19:17:10 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:50.220 19:17:10 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:50.220 19:17:10 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:50.220 19:17:10 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:50.220 19:17:10 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:50.220 19:17:10 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:50.220 19:17:10 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:50.220 19:17:10 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:50.220 19:17:10 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:50.220 19:17:10 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:50.220 19:17:10 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:50.220 19:17:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:50.220 19:17:11 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:50.220 19:17:11 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:50.220 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:50.220 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.263 ms 00:28:50.220 00:28:50.220 --- 10.0.0.2 ping statistics --- 00:28:50.220 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:50.220 rtt min/avg/max/mdev = 0.263/0.263/0.263/0.000 ms 00:28:50.220 19:17:11 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:50.220 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:50.220 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.046 ms 00:28:50.220 00:28:50.220 --- 10.0.0.1 ping statistics --- 00:28:50.220 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:50.220 rtt min/avg/max/mdev = 0.046/0.046/0.046/0.000 ms 00:28:50.220 19:17:11 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:50.220 19:17:11 -- nvmf/common.sh@410 -- # return 0 00:28:50.220 19:17:11 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:28:50.220 19:17:11 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:28:51.160 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:51.160 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:28:51.160 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:51.160 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:51.160 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:51.160 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:51.160 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:51.160 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:51.160 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:51.160 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:28:51.160 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:28:51.160 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:28:51.160 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:28:51.160 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:28:51.160 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:28:51.160 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:28:51.160 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:28:51.419 19:17:12 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:51.419 19:17:12 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:51.419 19:17:12 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:51.419 19:17:12 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:51.419 19:17:12 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:51.419 19:17:12 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:51.419 19:17:12 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:28:51.419 19:17:12 -- target/dif.sh@137 -- # nvmfappstart 00:28:51.419 19:17:12 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:51.419 19:17:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:51.419 19:17:12 -- common/autotest_common.sh@10 -- # set +x 00:28:51.419 19:17:12 -- nvmf/common.sh@469 -- # nvmfpid=337917 00:28:51.419 19:17:12 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:28:51.419 19:17:12 -- nvmf/common.sh@470 -- # waitforlisten 337917 00:28:51.419 19:17:12 -- common/autotest_common.sh@829 -- # '[' -z 337917 ']' 00:28:51.419 19:17:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:51.419 19:17:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:51.419 19:17:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:51.419 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:51.419 19:17:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:51.419 19:17:12 -- common/autotest_common.sh@10 -- # set +x 00:28:51.419 [2024-11-28 19:17:12.310610] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:51.419 [2024-11-28 19:17:12.310683] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:51.419 EAL: No free 2048 kB hugepages reported on node 1 00:28:51.419 [2024-11-28 19:17:12.381253] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:51.677 [2024-11-28 19:17:12.501097] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:51.677 [2024-11-28 19:17:12.501248] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:51.677 [2024-11-28 19:17:12.501268] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:51.677 [2024-11-28 19:17:12.501281] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:51.677 [2024-11-28 19:17:12.501311] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:52.243 19:17:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:52.243 19:17:13 -- common/autotest_common.sh@862 -- # return 0 00:28:52.243 19:17:13 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:52.243 19:17:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:52.243 19:17:13 -- common/autotest_common.sh@10 -- # set +x 00:28:52.243 19:17:13 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:52.243 19:17:13 -- target/dif.sh@139 -- # create_transport 00:28:52.243 19:17:13 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:28:52.243 19:17:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:52.243 19:17:13 -- common/autotest_common.sh@10 -- # set +x 00:28:52.503 [2024-11-28 19:17:13.292592] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:52.503 19:17:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:52.503 19:17:13 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:28:52.503 19:17:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:52.503 19:17:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:52.503 19:17:13 -- common/autotest_common.sh@10 -- # set +x 00:28:52.503 ************************************ 00:28:52.503 START TEST fio_dif_1_default 00:28:52.503 ************************************ 00:28:52.503 19:17:13 -- common/autotest_common.sh@1114 -- # fio_dif_1 00:28:52.503 19:17:13 -- target/dif.sh@86 -- # create_subsystems 0 00:28:52.503 19:17:13 -- target/dif.sh@28 -- # local sub 00:28:52.503 19:17:13 -- target/dif.sh@30 -- # for sub in "$@" 00:28:52.503 19:17:13 -- target/dif.sh@31 -- # create_subsystem 0 00:28:52.503 19:17:13 -- target/dif.sh@18 -- # local sub_id=0 00:28:52.503 19:17:13 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:28:52.503 19:17:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:52.503 19:17:13 -- common/autotest_common.sh@10 -- # set +x 00:28:52.503 bdev_null0 00:28:52.503 19:17:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:52.503 19:17:13 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:28:52.503 19:17:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:52.503 19:17:13 -- common/autotest_common.sh@10 -- # set +x 00:28:52.503 19:17:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:52.503 19:17:13 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:28:52.503 19:17:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:52.503 19:17:13 -- common/autotest_common.sh@10 -- # set +x 00:28:52.503 19:17:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:52.503 19:17:13 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:52.503 19:17:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:52.503 19:17:13 -- common/autotest_common.sh@10 -- # set +x 00:28:52.503 [2024-11-28 19:17:13.328847] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:52.503 19:17:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:52.503 19:17:13 -- target/dif.sh@87 -- # fio /dev/fd/62 00:28:52.503 19:17:13 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:28:52.503 19:17:13 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:28:52.503 19:17:13 -- nvmf/common.sh@520 -- # config=() 00:28:52.503 19:17:13 -- nvmf/common.sh@520 -- # local subsystem config 00:28:52.503 19:17:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:28:52.503 19:17:13 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:52.503 19:17:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:28:52.503 { 00:28:52.503 "params": { 00:28:52.503 "name": "Nvme$subsystem", 00:28:52.503 "trtype": "$TEST_TRANSPORT", 00:28:52.503 "traddr": "$NVMF_FIRST_TARGET_IP", 00:28:52.503 "adrfam": "ipv4", 00:28:52.503 "trsvcid": "$NVMF_PORT", 00:28:52.503 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:28:52.503 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:28:52.503 "hdgst": ${hdgst:-false}, 00:28:52.503 "ddgst": ${ddgst:-false} 00:28:52.503 }, 00:28:52.503 "method": "bdev_nvme_attach_controller" 00:28:52.503 } 00:28:52.503 EOF 00:28:52.503 )") 00:28:52.503 19:17:13 -- target/dif.sh@82 -- # gen_fio_conf 00:28:52.503 19:17:13 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:52.503 19:17:13 -- target/dif.sh@54 -- # local file 00:28:52.503 19:17:13 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:52.503 19:17:13 -- target/dif.sh@56 -- # cat 00:28:52.503 19:17:13 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:52.503 19:17:13 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:52.503 19:17:13 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:52.503 19:17:13 -- common/autotest_common.sh@1330 -- # shift 00:28:52.503 19:17:13 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:52.503 19:17:13 -- nvmf/common.sh@542 -- # cat 00:28:52.503 19:17:13 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:52.503 19:17:13 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:52.503 19:17:13 -- target/dif.sh@72 -- # (( file = 1 )) 00:28:52.503 19:17:13 -- target/dif.sh@72 -- # (( file <= files )) 00:28:52.503 19:17:13 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:52.503 19:17:13 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:52.503 19:17:13 -- nvmf/common.sh@544 -- # jq . 00:28:52.503 19:17:13 -- nvmf/common.sh@545 -- # IFS=, 00:28:52.503 19:17:13 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:28:52.503 "params": { 00:28:52.503 "name": "Nvme0", 00:28:52.503 "trtype": "tcp", 00:28:52.503 "traddr": "10.0.0.2", 00:28:52.503 "adrfam": "ipv4", 00:28:52.503 "trsvcid": "4420", 00:28:52.503 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:28:52.503 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:28:52.503 "hdgst": false, 00:28:52.503 "ddgst": false 00:28:52.503 }, 00:28:52.503 "method": "bdev_nvme_attach_controller" 00:28:52.503 }' 00:28:52.503 19:17:13 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:52.503 19:17:13 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:52.503 19:17:13 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:52.503 19:17:13 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:28:52.503 19:17:13 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:52.503 19:17:13 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:52.503 19:17:13 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:52.503 19:17:13 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:52.503 19:17:13 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:28:52.503 19:17:13 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:28:52.763 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:28:52.763 fio-3.35 00:28:52.763 Starting 1 thread 00:28:52.763 EAL: No free 2048 kB hugepages reported on node 1 00:28:53.024 [2024-11-28 19:17:13.980433] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:28:53.024 [2024-11-28 19:17:13.980521] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:05.216 00:29:05.216 filename0: (groupid=0, jobs=1): err= 0: pid=338279: Thu Nov 28 19:17:24 2024 00:29:05.216 read: IOPS=191, BW=767KiB/s (786kB/s)(7696KiB/10030msec) 00:29:05.216 slat (nsec): min=6553, max=82358, avg=8192.12, stdev=3210.71 00:29:05.216 clat (usec): min=534, max=44513, avg=20825.92, stdev=20371.60 00:29:05.216 lat (usec): min=542, max=44548, avg=20834.11, stdev=20371.36 00:29:05.216 clat percentiles (usec): 00:29:05.216 | 1.00th=[ 562], 5.00th=[ 578], 10.00th=[ 586], 20.00th=[ 635], 00:29:05.216 | 30.00th=[ 717], 40.00th=[ 742], 50.00th=[ 824], 60.00th=[41157], 00:29:05.216 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[42206], 00:29:05.216 | 99.00th=[42206], 99.50th=[42206], 99.90th=[44303], 99.95th=[44303], 00:29:05.216 | 99.99th=[44303] 00:29:05.216 bw ( KiB/s): min= 704, max= 832, per=100.00%, avg=768.00, stdev=35.96, samples=20 00:29:05.216 iops : min= 176, max= 208, avg=192.00, stdev= 8.99, samples=20 00:29:05.216 lat (usec) : 750=42.05%, 1000=8.47% 00:29:05.216 lat (msec) : 50=49.48% 00:29:05.216 cpu : usr=92.13%, sys=7.58%, ctx=17, majf=0, minf=267 00:29:05.216 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:05.216 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:05.216 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:05.216 issued rwts: total=1924,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:05.216 latency : target=0, window=0, percentile=100.00%, depth=4 00:29:05.216 00:29:05.216 Run status group 0 (all jobs): 00:29:05.216 READ: bw=767KiB/s (786kB/s), 767KiB/s-767KiB/s (786kB/s-786kB/s), io=7696KiB (7881kB), run=10030-10030msec 00:29:05.216 19:17:24 -- target/dif.sh@88 -- # destroy_subsystems 0 00:29:05.216 19:17:24 -- target/dif.sh@43 -- # local sub 00:29:05.216 19:17:24 -- target/dif.sh@45 -- # for sub in "$@" 00:29:05.216 19:17:24 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:05.216 19:17:24 -- target/dif.sh@36 -- # local sub_id=0 00:29:05.216 19:17:24 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:05.216 19:17:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.216 19:17:24 -- common/autotest_common.sh@10 -- # set +x 00:29:05.216 19:17:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.216 19:17:24 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:05.216 19:17:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.216 19:17:24 -- common/autotest_common.sh@10 -- # set +x 00:29:05.216 19:17:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.216 00:29:05.216 real 0m11.175s 00:29:05.216 user 0m10.375s 00:29:05.216 sys 0m1.029s 00:29:05.216 19:17:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:05.216 19:17:24 -- common/autotest_common.sh@10 -- # set +x 00:29:05.216 ************************************ 00:29:05.216 END TEST fio_dif_1_default 00:29:05.216 ************************************ 00:29:05.216 19:17:24 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:29:05.216 19:17:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:05.216 19:17:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:05.216 19:17:24 -- common/autotest_common.sh@10 -- # set +x 00:29:05.216 ************************************ 00:29:05.216 START TEST fio_dif_1_multi_subsystems 00:29:05.216 ************************************ 00:29:05.216 19:17:24 -- common/autotest_common.sh@1114 -- # fio_dif_1_multi_subsystems 00:29:05.216 19:17:24 -- target/dif.sh@92 -- # local files=1 00:29:05.216 19:17:24 -- target/dif.sh@94 -- # create_subsystems 0 1 00:29:05.216 19:17:24 -- target/dif.sh@28 -- # local sub 00:29:05.216 19:17:24 -- target/dif.sh@30 -- # for sub in "$@" 00:29:05.216 19:17:24 -- target/dif.sh@31 -- # create_subsystem 0 00:29:05.216 19:17:24 -- target/dif.sh@18 -- # local sub_id=0 00:29:05.216 19:17:24 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:29:05.216 19:17:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.216 19:17:24 -- common/autotest_common.sh@10 -- # set +x 00:29:05.216 bdev_null0 00:29:05.216 19:17:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.216 19:17:24 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:05.216 19:17:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.216 19:17:24 -- common/autotest_common.sh@10 -- # set +x 00:29:05.216 19:17:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.216 19:17:24 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:05.216 19:17:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.216 19:17:24 -- common/autotest_common.sh@10 -- # set +x 00:29:05.216 19:17:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.216 19:17:24 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:05.216 19:17:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.216 19:17:24 -- common/autotest_common.sh@10 -- # set +x 00:29:05.216 [2024-11-28 19:17:24.535848] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:05.216 19:17:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.216 19:17:24 -- target/dif.sh@30 -- # for sub in "$@" 00:29:05.216 19:17:24 -- target/dif.sh@31 -- # create_subsystem 1 00:29:05.216 19:17:24 -- target/dif.sh@18 -- # local sub_id=1 00:29:05.216 19:17:24 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:29:05.216 19:17:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.216 19:17:24 -- common/autotest_common.sh@10 -- # set +x 00:29:05.216 bdev_null1 00:29:05.216 19:17:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.216 19:17:24 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:29:05.216 19:17:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.216 19:17:24 -- common/autotest_common.sh@10 -- # set +x 00:29:05.216 19:17:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.216 19:17:24 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:29:05.216 19:17:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.216 19:17:24 -- common/autotest_common.sh@10 -- # set +x 00:29:05.216 19:17:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.216 19:17:24 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:05.216 19:17:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:05.216 19:17:24 -- common/autotest_common.sh@10 -- # set +x 00:29:05.216 19:17:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:05.216 19:17:24 -- target/dif.sh@95 -- # fio /dev/fd/62 00:29:05.216 19:17:24 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:29:05.216 19:17:24 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:05.216 19:17:24 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:29:05.216 19:17:24 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:05.216 19:17:24 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:05.216 19:17:24 -- target/dif.sh@82 -- # gen_fio_conf 00:29:05.216 19:17:24 -- nvmf/common.sh@520 -- # config=() 00:29:05.216 19:17:24 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:05.216 19:17:24 -- nvmf/common.sh@520 -- # local subsystem config 00:29:05.216 19:17:24 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:05.216 19:17:24 -- target/dif.sh@54 -- # local file 00:29:05.216 19:17:24 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:05.216 19:17:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:05.216 19:17:24 -- target/dif.sh@56 -- # cat 00:29:05.216 19:17:24 -- common/autotest_common.sh@1330 -- # shift 00:29:05.216 19:17:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:05.216 { 00:29:05.216 "params": { 00:29:05.216 "name": "Nvme$subsystem", 00:29:05.216 "trtype": "$TEST_TRANSPORT", 00:29:05.216 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:05.216 "adrfam": "ipv4", 00:29:05.216 "trsvcid": "$NVMF_PORT", 00:29:05.216 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:05.216 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:05.216 "hdgst": ${hdgst:-false}, 00:29:05.216 "ddgst": ${ddgst:-false} 00:29:05.216 }, 00:29:05.216 "method": "bdev_nvme_attach_controller" 00:29:05.216 } 00:29:05.216 EOF 00:29:05.216 )") 00:29:05.216 19:17:24 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:05.216 19:17:24 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:05.216 19:17:24 -- nvmf/common.sh@542 -- # cat 00:29:05.216 19:17:24 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:05.216 19:17:24 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:05.216 19:17:24 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:05.216 19:17:24 -- target/dif.sh@72 -- # (( file <= files )) 00:29:05.216 19:17:24 -- target/dif.sh@73 -- # cat 00:29:05.216 19:17:24 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:05.216 19:17:24 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:05.216 19:17:24 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:05.216 { 00:29:05.216 "params": { 00:29:05.216 "name": "Nvme$subsystem", 00:29:05.216 "trtype": "$TEST_TRANSPORT", 00:29:05.216 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:05.216 "adrfam": "ipv4", 00:29:05.216 "trsvcid": "$NVMF_PORT", 00:29:05.216 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:05.216 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:05.216 "hdgst": ${hdgst:-false}, 00:29:05.217 "ddgst": ${ddgst:-false} 00:29:05.217 }, 00:29:05.217 "method": "bdev_nvme_attach_controller" 00:29:05.217 } 00:29:05.217 EOF 00:29:05.217 )") 00:29:05.217 19:17:24 -- target/dif.sh@72 -- # (( file++ )) 00:29:05.217 19:17:24 -- target/dif.sh@72 -- # (( file <= files )) 00:29:05.217 19:17:24 -- nvmf/common.sh@542 -- # cat 00:29:05.217 19:17:24 -- nvmf/common.sh@544 -- # jq . 00:29:05.217 19:17:24 -- nvmf/common.sh@545 -- # IFS=, 00:29:05.217 19:17:24 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:05.217 "params": { 00:29:05.217 "name": "Nvme0", 00:29:05.217 "trtype": "tcp", 00:29:05.217 "traddr": "10.0.0.2", 00:29:05.217 "adrfam": "ipv4", 00:29:05.217 "trsvcid": "4420", 00:29:05.217 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:05.217 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:05.217 "hdgst": false, 00:29:05.217 "ddgst": false 00:29:05.217 }, 00:29:05.217 "method": "bdev_nvme_attach_controller" 00:29:05.217 },{ 00:29:05.217 "params": { 00:29:05.217 "name": "Nvme1", 00:29:05.217 "trtype": "tcp", 00:29:05.217 "traddr": "10.0.0.2", 00:29:05.217 "adrfam": "ipv4", 00:29:05.217 "trsvcid": "4420", 00:29:05.217 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:05.217 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:05.217 "hdgst": false, 00:29:05.217 "ddgst": false 00:29:05.217 }, 00:29:05.217 "method": "bdev_nvme_attach_controller" 00:29:05.217 }' 00:29:05.217 19:17:24 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:05.217 19:17:24 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:05.217 19:17:24 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:05.217 19:17:24 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:05.217 19:17:24 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:05.217 19:17:24 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:05.217 19:17:24 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:05.217 19:17:24 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:05.217 19:17:24 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:05.217 19:17:24 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:05.217 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:29:05.217 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:29:05.217 fio-3.35 00:29:05.217 Starting 2 threads 00:29:05.217 EAL: No free 2048 kB hugepages reported on node 1 00:29:05.217 [2024-11-28 19:17:25.635546] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:05.217 [2024-11-28 19:17:25.635631] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:15.188 00:29:15.188 filename0: (groupid=0, jobs=1): err= 0: pid=339721: Thu Nov 28 19:17:35 2024 00:29:15.188 read: IOPS=191, BW=766KiB/s (784kB/s)(7664KiB/10005msec) 00:29:15.188 slat (nsec): min=6774, max=30739, avg=8714.34, stdev=2842.22 00:29:15.188 clat (usec): min=520, max=43057, avg=20858.26, stdev=20346.06 00:29:15.188 lat (usec): min=527, max=43082, avg=20866.98, stdev=20345.94 00:29:15.188 clat percentiles (usec): 00:29:15.188 | 1.00th=[ 562], 5.00th=[ 594], 10.00th=[ 644], 20.00th=[ 742], 00:29:15.188 | 30.00th=[ 750], 40.00th=[ 766], 50.00th=[ 1106], 60.00th=[41157], 00:29:15.188 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41681], 95.00th=[42206], 00:29:15.188 | 99.00th=[42206], 99.50th=[42206], 99.90th=[43254], 99.95th=[43254], 00:29:15.188 | 99.99th=[43254] 00:29:15.188 bw ( KiB/s): min= 704, max= 832, per=50.03%, avg=764.80, stdev=32.67, samples=20 00:29:15.188 iops : min= 176, max= 208, avg=191.20, stdev= 8.17, samples=20 00:29:15.188 lat (usec) : 750=28.29%, 1000=21.40% 00:29:15.188 lat (msec) : 2=0.84%, 50=49.48% 00:29:15.188 cpu : usr=95.34%, sys=4.34%, ctx=15, majf=0, minf=118 00:29:15.188 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:15.188 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.188 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.188 issued rwts: total=1916,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:15.188 latency : target=0, window=0, percentile=100.00%, depth=4 00:29:15.188 filename1: (groupid=0, jobs=1): err= 0: pid=339722: Thu Nov 28 19:17:35 2024 00:29:15.188 read: IOPS=190, BW=761KiB/s (780kB/s)(7616KiB/10004msec) 00:29:15.188 slat (nsec): min=5797, max=63405, avg=8562.46, stdev=2628.63 00:29:15.188 clat (usec): min=512, max=44076, avg=20988.36, stdev=20388.64 00:29:15.188 lat (usec): min=519, max=44087, avg=20996.92, stdev=20388.42 00:29:15.188 clat percentiles (usec): 00:29:15.188 | 1.00th=[ 545], 5.00th=[ 553], 10.00th=[ 562], 20.00th=[ 578], 00:29:15.188 | 30.00th=[ 586], 40.00th=[ 635], 50.00th=[ 988], 60.00th=[41157], 00:29:15.188 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:29:15.188 | 99.00th=[42206], 99.50th=[42206], 99.90th=[44303], 99.95th=[44303], 00:29:15.188 | 99.99th=[44303] 00:29:15.188 bw ( KiB/s): min= 672, max= 832, per=49.76%, avg=760.00, stdev=38.67, samples=20 00:29:15.188 iops : min= 168, max= 208, avg=190.00, stdev= 9.67, samples=20 00:29:15.188 lat (usec) : 750=47.90%, 1000=2.10% 00:29:15.188 lat (msec) : 50=50.00% 00:29:15.188 cpu : usr=95.12%, sys=4.56%, ctx=13, majf=0, minf=243 00:29:15.188 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:15.188 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.188 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:15.188 issued rwts: total=1904,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:15.188 latency : target=0, window=0, percentile=100.00%, depth=4 00:29:15.188 00:29:15.188 Run status group 0 (all jobs): 00:29:15.188 READ: bw=1527KiB/s (1564kB/s), 761KiB/s-766KiB/s (780kB/s-784kB/s), io=14.9MiB (15.6MB), run=10004-10005msec 00:29:15.188 19:17:36 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:29:15.188 19:17:36 -- target/dif.sh@43 -- # local sub 00:29:15.188 19:17:36 -- target/dif.sh@45 -- # for sub in "$@" 00:29:15.188 19:17:36 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:15.188 19:17:36 -- target/dif.sh@36 -- # local sub_id=0 00:29:15.188 19:17:36 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:15.188 19:17:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:15.188 19:17:36 -- common/autotest_common.sh@10 -- # set +x 00:29:15.188 19:17:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:15.188 19:17:36 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:15.188 19:17:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:15.188 19:17:36 -- common/autotest_common.sh@10 -- # set +x 00:29:15.188 19:17:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:15.189 19:17:36 -- target/dif.sh@45 -- # for sub in "$@" 00:29:15.189 19:17:36 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:15.189 19:17:36 -- target/dif.sh@36 -- # local sub_id=1 00:29:15.189 19:17:36 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:15.189 19:17:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:15.189 19:17:36 -- common/autotest_common.sh@10 -- # set +x 00:29:15.189 19:17:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:15.189 19:17:36 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:15.189 19:17:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:15.189 19:17:36 -- common/autotest_common.sh@10 -- # set +x 00:29:15.189 19:17:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:15.189 00:29:15.189 real 0m11.533s 00:29:15.189 user 0m20.467s 00:29:15.189 sys 0m1.207s 00:29:15.189 19:17:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:15.189 19:17:36 -- common/autotest_common.sh@10 -- # set +x 00:29:15.189 ************************************ 00:29:15.189 END TEST fio_dif_1_multi_subsystems 00:29:15.189 ************************************ 00:29:15.189 19:17:36 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:29:15.189 19:17:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:15.189 19:17:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:15.189 19:17:36 -- common/autotest_common.sh@10 -- # set +x 00:29:15.189 ************************************ 00:29:15.189 START TEST fio_dif_rand_params 00:29:15.189 ************************************ 00:29:15.189 19:17:36 -- common/autotest_common.sh@1114 -- # fio_dif_rand_params 00:29:15.189 19:17:36 -- target/dif.sh@100 -- # local NULL_DIF 00:29:15.189 19:17:36 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:29:15.189 19:17:36 -- target/dif.sh@103 -- # NULL_DIF=3 00:29:15.189 19:17:36 -- target/dif.sh@103 -- # bs=128k 00:29:15.189 19:17:36 -- target/dif.sh@103 -- # numjobs=3 00:29:15.189 19:17:36 -- target/dif.sh@103 -- # iodepth=3 00:29:15.189 19:17:36 -- target/dif.sh@103 -- # runtime=5 00:29:15.189 19:17:36 -- target/dif.sh@105 -- # create_subsystems 0 00:29:15.189 19:17:36 -- target/dif.sh@28 -- # local sub 00:29:15.189 19:17:36 -- target/dif.sh@30 -- # for sub in "$@" 00:29:15.189 19:17:36 -- target/dif.sh@31 -- # create_subsystem 0 00:29:15.189 19:17:36 -- target/dif.sh@18 -- # local sub_id=0 00:29:15.189 19:17:36 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:29:15.189 19:17:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:15.189 19:17:36 -- common/autotest_common.sh@10 -- # set +x 00:29:15.189 bdev_null0 00:29:15.189 19:17:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:15.189 19:17:36 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:15.189 19:17:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:15.189 19:17:36 -- common/autotest_common.sh@10 -- # set +x 00:29:15.189 19:17:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:15.189 19:17:36 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:15.189 19:17:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:15.189 19:17:36 -- common/autotest_common.sh@10 -- # set +x 00:29:15.189 19:17:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:15.189 19:17:36 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:15.189 19:17:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:15.189 19:17:36 -- common/autotest_common.sh@10 -- # set +x 00:29:15.189 [2024-11-28 19:17:36.090768] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:15.189 19:17:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:15.189 19:17:36 -- target/dif.sh@106 -- # fio /dev/fd/62 00:29:15.189 19:17:36 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:29:15.189 19:17:36 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:29:15.189 19:17:36 -- nvmf/common.sh@520 -- # config=() 00:29:15.189 19:17:36 -- nvmf/common.sh@520 -- # local subsystem config 00:29:15.189 19:17:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:15.189 19:17:36 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:15.189 19:17:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:15.189 { 00:29:15.189 "params": { 00:29:15.189 "name": "Nvme$subsystem", 00:29:15.189 "trtype": "$TEST_TRANSPORT", 00:29:15.189 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:15.189 "adrfam": "ipv4", 00:29:15.189 "trsvcid": "$NVMF_PORT", 00:29:15.189 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:15.189 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:15.189 "hdgst": ${hdgst:-false}, 00:29:15.189 "ddgst": ${ddgst:-false} 00:29:15.189 }, 00:29:15.189 "method": "bdev_nvme_attach_controller" 00:29:15.189 } 00:29:15.189 EOF 00:29:15.189 )") 00:29:15.189 19:17:36 -- target/dif.sh@82 -- # gen_fio_conf 00:29:15.189 19:17:36 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:15.189 19:17:36 -- target/dif.sh@54 -- # local file 00:29:15.189 19:17:36 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:15.189 19:17:36 -- target/dif.sh@56 -- # cat 00:29:15.189 19:17:36 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:15.189 19:17:36 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:15.189 19:17:36 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:15.189 19:17:36 -- common/autotest_common.sh@1330 -- # shift 00:29:15.189 19:17:36 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:15.189 19:17:36 -- nvmf/common.sh@542 -- # cat 00:29:15.189 19:17:36 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:15.189 19:17:36 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:15.189 19:17:36 -- target/dif.sh@72 -- # (( file <= files )) 00:29:15.189 19:17:36 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:15.189 19:17:36 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:15.189 19:17:36 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:15.189 19:17:36 -- nvmf/common.sh@544 -- # jq . 00:29:15.189 19:17:36 -- nvmf/common.sh@545 -- # IFS=, 00:29:15.189 19:17:36 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:15.189 "params": { 00:29:15.189 "name": "Nvme0", 00:29:15.189 "trtype": "tcp", 00:29:15.189 "traddr": "10.0.0.2", 00:29:15.189 "adrfam": "ipv4", 00:29:15.189 "trsvcid": "4420", 00:29:15.189 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:15.189 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:15.189 "hdgst": false, 00:29:15.189 "ddgst": false 00:29:15.189 }, 00:29:15.189 "method": "bdev_nvme_attach_controller" 00:29:15.189 }' 00:29:15.189 19:17:36 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:15.189 19:17:36 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:15.189 19:17:36 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:15.189 19:17:36 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:15.189 19:17:36 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:15.189 19:17:36 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:15.189 19:17:36 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:15.189 19:17:36 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:15.189 19:17:36 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:15.189 19:17:36 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:15.449 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:29:15.449 ... 00:29:15.449 fio-3.35 00:29:15.449 Starting 3 threads 00:29:15.449 EAL: No free 2048 kB hugepages reported on node 1 00:29:16.019 [2024-11-28 19:17:36.888746] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:16.019 [2024-11-28 19:17:36.888838] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:21.284 00:29:21.284 filename0: (groupid=0, jobs=1): err= 0: pid=341165: Thu Nov 28 19:17:42 2024 00:29:21.284 read: IOPS=229, BW=28.6MiB/s (30.0MB/s)(143MiB/5006msec) 00:29:21.284 slat (nsec): min=4355, max=35391, avg=12184.97, stdev=2341.21 00:29:21.284 clat (usec): min=5169, max=52135, avg=13074.39, stdev=4177.45 00:29:21.284 lat (usec): min=5178, max=52146, avg=13086.58, stdev=4177.47 00:29:21.284 clat percentiles (usec): 00:29:21.284 | 1.00th=[ 7177], 5.00th=[ 8979], 10.00th=[10028], 20.00th=[11207], 00:29:21.284 | 30.00th=[11863], 40.00th=[12387], 50.00th=[12911], 60.00th=[13304], 00:29:21.284 | 70.00th=[13960], 80.00th=[14484], 90.00th=[15270], 95.00th=[15795], 00:29:21.284 | 99.00th=[45876], 99.50th=[49021], 99.90th=[52167], 99.95th=[52167], 00:29:21.284 | 99.99th=[52167] 00:29:21.284 bw ( KiB/s): min=27136, max=30720, per=34.16%, avg=29286.40, stdev=1073.98, samples=10 00:29:21.284 iops : min= 212, max= 240, avg=228.80, stdev= 8.39, samples=10 00:29:21.284 lat (msec) : 10=9.85%, 20=89.10%, 50=0.70%, 100=0.35% 00:29:21.284 cpu : usr=93.11%, sys=6.41%, ctx=16, majf=0, minf=141 00:29:21.284 IO depths : 1=0.8%, 2=99.2%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:21.284 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:21.284 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:21.284 issued rwts: total=1147,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:21.284 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:21.284 filename0: (groupid=0, jobs=1): err= 0: pid=341166: Thu Nov 28 19:17:42 2024 00:29:21.284 read: IOPS=226, BW=28.4MiB/s (29.7MB/s)(143MiB/5046msec) 00:29:21.284 slat (nsec): min=4112, max=37050, avg=13033.81, stdev=2675.59 00:29:21.284 clat (usec): min=5478, max=57036, avg=13166.77, stdev=5484.90 00:29:21.284 lat (usec): min=5490, max=57050, avg=13179.81, stdev=5484.93 00:29:21.284 clat percentiles (usec): 00:29:21.284 | 1.00th=[ 6783], 5.00th=[ 8586], 10.00th=[10028], 20.00th=[11076], 00:29:21.284 | 30.00th=[11600], 40.00th=[11994], 50.00th=[12518], 60.00th=[13042], 00:29:21.284 | 70.00th=[13566], 80.00th=[14353], 90.00th=[15401], 95.00th=[16319], 00:29:21.284 | 99.00th=[50594], 99.50th=[52167], 99.90th=[55313], 99.95th=[56886], 00:29:21.284 | 99.99th=[56886] 00:29:21.284 bw ( KiB/s): min=25344, max=32256, per=34.10%, avg=29241.60, stdev=2130.01, samples=10 00:29:21.284 iops : min= 198, max= 252, avg=228.40, stdev=16.57, samples=10 00:29:21.284 lat (msec) : 10=10.22%, 20=88.03%, 50=0.61%, 100=1.14% 00:29:21.284 cpu : usr=93.12%, sys=6.34%, ctx=36, majf=0, minf=75 00:29:21.284 IO depths : 1=0.4%, 2=99.6%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:21.284 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:21.284 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:21.284 issued rwts: total=1145,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:21.284 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:21.284 filename0: (groupid=0, jobs=1): err= 0: pid=341167: Thu Nov 28 19:17:42 2024 00:29:21.284 read: IOPS=215, BW=27.0MiB/s (28.3MB/s)(136MiB/5046msec) 00:29:21.284 slat (nsec): min=4366, max=58610, avg=12152.96, stdev=2678.32 00:29:21.284 clat (usec): min=4992, max=55080, avg=13858.63, stdev=6270.20 00:29:21.284 lat (usec): min=5001, max=55091, avg=13870.78, stdev=6270.17 00:29:21.284 clat percentiles (usec): 00:29:21.284 | 1.00th=[ 6915], 5.00th=[ 8979], 10.00th=[10290], 20.00th=[11338], 00:29:21.284 | 30.00th=[11994], 40.00th=[12518], 50.00th=[13173], 60.00th=[13698], 00:29:21.284 | 70.00th=[14353], 80.00th=[15008], 90.00th=[15795], 95.00th=[16581], 00:29:21.284 | 99.00th=[51119], 99.50th=[54789], 99.90th=[55313], 99.95th=[55313], 00:29:21.284 | 99.99th=[55313] 00:29:21.284 bw ( KiB/s): min=16896, max=33536, per=32.40%, avg=27776.00, stdev=4563.94, samples=10 00:29:21.284 iops : min= 132, max= 262, avg=217.00, stdev=35.66, samples=10 00:29:21.284 lat (msec) : 10=8.82%, 20=88.79%, 50=0.83%, 100=1.56% 00:29:21.284 cpu : usr=93.46%, sys=6.07%, ctx=8, majf=0, minf=113 00:29:21.284 IO depths : 1=0.5%, 2=99.5%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:21.284 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:21.284 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:21.284 issued rwts: total=1088,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:21.284 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:21.284 00:29:21.284 Run status group 0 (all jobs): 00:29:21.284 READ: bw=83.7MiB/s (87.8MB/s), 27.0MiB/s-28.6MiB/s (28.3MB/s-30.0MB/s), io=423MiB (443MB), run=5006-5046msec 00:29:21.544 19:17:42 -- target/dif.sh@107 -- # destroy_subsystems 0 00:29:21.545 19:17:42 -- target/dif.sh@43 -- # local sub 00:29:21.545 19:17:42 -- target/dif.sh@45 -- # for sub in "$@" 00:29:21.545 19:17:42 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:21.545 19:17:42 -- target/dif.sh@36 -- # local sub_id=0 00:29:21.545 19:17:42 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:21.545 19:17:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.545 19:17:42 -- common/autotest_common.sh@10 -- # set +x 00:29:21.545 19:17:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:21.545 19:17:42 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:21.545 19:17:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.545 19:17:42 -- common/autotest_common.sh@10 -- # set +x 00:29:21.545 19:17:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:21.545 19:17:42 -- target/dif.sh@109 -- # NULL_DIF=2 00:29:21.545 19:17:42 -- target/dif.sh@109 -- # bs=4k 00:29:21.545 19:17:42 -- target/dif.sh@109 -- # numjobs=8 00:29:21.545 19:17:42 -- target/dif.sh@109 -- # iodepth=16 00:29:21.545 19:17:42 -- target/dif.sh@109 -- # runtime= 00:29:21.545 19:17:42 -- target/dif.sh@109 -- # files=2 00:29:21.545 19:17:42 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:29:21.545 19:17:42 -- target/dif.sh@28 -- # local sub 00:29:21.545 19:17:42 -- target/dif.sh@30 -- # for sub in "$@" 00:29:21.545 19:17:42 -- target/dif.sh@31 -- # create_subsystem 0 00:29:21.545 19:17:42 -- target/dif.sh@18 -- # local sub_id=0 00:29:21.545 19:17:42 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:29:21.545 19:17:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.545 19:17:42 -- common/autotest_common.sh@10 -- # set +x 00:29:21.545 bdev_null0 00:29:21.545 19:17:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:21.545 19:17:42 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:21.545 19:17:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.545 19:17:42 -- common/autotest_common.sh@10 -- # set +x 00:29:21.545 19:17:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:21.545 19:17:42 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:21.545 19:17:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.545 19:17:42 -- common/autotest_common.sh@10 -- # set +x 00:29:21.545 19:17:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:21.545 19:17:42 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:21.545 19:17:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.545 19:17:42 -- common/autotest_common.sh@10 -- # set +x 00:29:21.545 [2024-11-28 19:17:42.426389] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:21.545 19:17:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:21.545 19:17:42 -- target/dif.sh@30 -- # for sub in "$@" 00:29:21.545 19:17:42 -- target/dif.sh@31 -- # create_subsystem 1 00:29:21.545 19:17:42 -- target/dif.sh@18 -- # local sub_id=1 00:29:21.545 19:17:42 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:29:21.545 19:17:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.545 19:17:42 -- common/autotest_common.sh@10 -- # set +x 00:29:21.545 bdev_null1 00:29:21.545 19:17:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:21.545 19:17:42 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:29:21.545 19:17:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.545 19:17:42 -- common/autotest_common.sh@10 -- # set +x 00:29:21.545 19:17:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:21.545 19:17:42 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:29:21.545 19:17:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.545 19:17:42 -- common/autotest_common.sh@10 -- # set +x 00:29:21.545 19:17:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:21.545 19:17:42 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:21.545 19:17:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.545 19:17:42 -- common/autotest_common.sh@10 -- # set +x 00:29:21.545 19:17:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:21.545 19:17:42 -- target/dif.sh@30 -- # for sub in "$@" 00:29:21.545 19:17:42 -- target/dif.sh@31 -- # create_subsystem 2 00:29:21.545 19:17:42 -- target/dif.sh@18 -- # local sub_id=2 00:29:21.545 19:17:42 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:29:21.545 19:17:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.545 19:17:42 -- common/autotest_common.sh@10 -- # set +x 00:29:21.545 bdev_null2 00:29:21.545 19:17:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:21.545 19:17:42 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:29:21.545 19:17:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.545 19:17:42 -- common/autotest_common.sh@10 -- # set +x 00:29:21.545 19:17:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:21.545 19:17:42 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:29:21.545 19:17:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.545 19:17:42 -- common/autotest_common.sh@10 -- # set +x 00:29:21.545 19:17:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:21.545 19:17:42 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:29:21.545 19:17:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.545 19:17:42 -- common/autotest_common.sh@10 -- # set +x 00:29:21.545 19:17:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:21.545 19:17:42 -- target/dif.sh@112 -- # fio /dev/fd/62 00:29:21.545 19:17:42 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:29:21.545 19:17:42 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:29:21.545 19:17:42 -- nvmf/common.sh@520 -- # config=() 00:29:21.545 19:17:42 -- nvmf/common.sh@520 -- # local subsystem config 00:29:21.545 19:17:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:21.545 19:17:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:21.545 { 00:29:21.545 "params": { 00:29:21.545 "name": "Nvme$subsystem", 00:29:21.545 "trtype": "$TEST_TRANSPORT", 00:29:21.545 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:21.545 "adrfam": "ipv4", 00:29:21.545 "trsvcid": "$NVMF_PORT", 00:29:21.545 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:21.545 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:21.545 "hdgst": ${hdgst:-false}, 00:29:21.545 "ddgst": ${ddgst:-false} 00:29:21.545 }, 00:29:21.545 "method": "bdev_nvme_attach_controller" 00:29:21.545 } 00:29:21.545 EOF 00:29:21.545 )") 00:29:21.545 19:17:42 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:21.545 19:17:42 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:21.545 19:17:42 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:21.545 19:17:42 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:21.545 19:17:42 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:21.545 19:17:42 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:21.545 19:17:42 -- common/autotest_common.sh@1330 -- # shift 00:29:21.545 19:17:42 -- target/dif.sh@82 -- # gen_fio_conf 00:29:21.545 19:17:42 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:21.545 19:17:42 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:21.545 19:17:42 -- target/dif.sh@54 -- # local file 00:29:21.545 19:17:42 -- target/dif.sh@56 -- # cat 00:29:21.545 19:17:42 -- nvmf/common.sh@542 -- # cat 00:29:21.545 19:17:42 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:21.545 19:17:42 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:21.545 19:17:42 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:21.545 19:17:42 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:21.545 19:17:42 -- target/dif.sh@72 -- # (( file <= files )) 00:29:21.545 19:17:42 -- target/dif.sh@73 -- # cat 00:29:21.545 19:17:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:21.545 19:17:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:21.545 { 00:29:21.545 "params": { 00:29:21.545 "name": "Nvme$subsystem", 00:29:21.545 "trtype": "$TEST_TRANSPORT", 00:29:21.545 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:21.545 "adrfam": "ipv4", 00:29:21.545 "trsvcid": "$NVMF_PORT", 00:29:21.545 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:21.545 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:21.545 "hdgst": ${hdgst:-false}, 00:29:21.545 "ddgst": ${ddgst:-false} 00:29:21.545 }, 00:29:21.545 "method": "bdev_nvme_attach_controller" 00:29:21.545 } 00:29:21.545 EOF 00:29:21.545 )") 00:29:21.545 19:17:42 -- nvmf/common.sh@542 -- # cat 00:29:21.545 19:17:42 -- target/dif.sh@72 -- # (( file++ )) 00:29:21.545 19:17:42 -- target/dif.sh@72 -- # (( file <= files )) 00:29:21.545 19:17:42 -- target/dif.sh@73 -- # cat 00:29:21.545 19:17:42 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:21.545 19:17:42 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:21.545 { 00:29:21.545 "params": { 00:29:21.545 "name": "Nvme$subsystem", 00:29:21.545 "trtype": "$TEST_TRANSPORT", 00:29:21.545 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:21.545 "adrfam": "ipv4", 00:29:21.545 "trsvcid": "$NVMF_PORT", 00:29:21.545 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:21.545 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:21.545 "hdgst": ${hdgst:-false}, 00:29:21.545 "ddgst": ${ddgst:-false} 00:29:21.545 }, 00:29:21.545 "method": "bdev_nvme_attach_controller" 00:29:21.545 } 00:29:21.545 EOF 00:29:21.545 )") 00:29:21.545 19:17:42 -- target/dif.sh@72 -- # (( file++ )) 00:29:21.545 19:17:42 -- target/dif.sh@72 -- # (( file <= files )) 00:29:21.545 19:17:42 -- nvmf/common.sh@542 -- # cat 00:29:21.545 19:17:42 -- nvmf/common.sh@544 -- # jq . 00:29:21.545 19:17:42 -- nvmf/common.sh@545 -- # IFS=, 00:29:21.545 19:17:42 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:21.545 "params": { 00:29:21.545 "name": "Nvme0", 00:29:21.545 "trtype": "tcp", 00:29:21.545 "traddr": "10.0.0.2", 00:29:21.545 "adrfam": "ipv4", 00:29:21.545 "trsvcid": "4420", 00:29:21.545 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:21.545 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:21.545 "hdgst": false, 00:29:21.545 "ddgst": false 00:29:21.545 }, 00:29:21.545 "method": "bdev_nvme_attach_controller" 00:29:21.545 },{ 00:29:21.545 "params": { 00:29:21.545 "name": "Nvme1", 00:29:21.545 "trtype": "tcp", 00:29:21.545 "traddr": "10.0.0.2", 00:29:21.545 "adrfam": "ipv4", 00:29:21.545 "trsvcid": "4420", 00:29:21.545 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:21.545 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:21.545 "hdgst": false, 00:29:21.545 "ddgst": false 00:29:21.545 }, 00:29:21.545 "method": "bdev_nvme_attach_controller" 00:29:21.545 },{ 00:29:21.545 "params": { 00:29:21.545 "name": "Nvme2", 00:29:21.545 "trtype": "tcp", 00:29:21.545 "traddr": "10.0.0.2", 00:29:21.545 "adrfam": "ipv4", 00:29:21.545 "trsvcid": "4420", 00:29:21.545 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:29:21.545 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:29:21.545 "hdgst": false, 00:29:21.545 "ddgst": false 00:29:21.545 }, 00:29:21.545 "method": "bdev_nvme_attach_controller" 00:29:21.545 }' 00:29:21.545 19:17:42 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:21.545 19:17:42 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:21.545 19:17:42 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:21.545 19:17:42 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:21.545 19:17:42 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:21.545 19:17:42 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:21.545 19:17:42 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:21.545 19:17:42 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:21.545 19:17:42 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:21.545 19:17:42 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:21.804 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:21.804 ... 00:29:21.804 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:21.804 ... 00:29:21.804 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:29:21.804 ... 00:29:21.804 fio-3.35 00:29:21.804 Starting 24 threads 00:29:21.804 EAL: No free 2048 kB hugepages reported on node 1 00:29:22.743 [2024-11-28 19:17:43.704158] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:22.743 [2024-11-28 19:17:43.704244] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:34.950 00:29:34.950 filename0: (groupid=0, jobs=1): err= 0: pid=342054: Thu Nov 28 19:17:54 2024 00:29:34.950 read: IOPS=62, BW=251KiB/s (257kB/s)(2560KiB/10188msec) 00:29:34.950 slat (usec): min=7, max=129, avg=57.15, stdev=36.29 00:29:34.950 clat (msec): min=172, max=442, avg=254.04, stdev=47.72 00:29:34.950 lat (msec): min=172, max=442, avg=254.10, stdev=47.74 00:29:34.950 clat percentiles (msec): 00:29:34.950 | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 178], 20.00th=[ 201], 00:29:34.950 | 30.00th=[ 211], 40.00th=[ 249], 50.00th=[ 279], 60.00th=[ 279], 00:29:34.950 | 70.00th=[ 288], 80.00th=[ 296], 90.00th=[ 300], 95.00th=[ 305], 00:29:34.950 | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 443], 99.95th=[ 443], 00:29:34.950 | 99.99th=[ 443] 00:29:34.950 bw ( KiB/s): min= 128, max= 384, per=4.29%, avg=249.60, stdev=65.33, samples=20 00:29:34.950 iops : min= 32, max= 96, avg=62.40, stdev=16.33, samples=20 00:29:34.950 lat (msec) : 250=40.31%, 500=59.69% 00:29:34.951 cpu : usr=98.41%, sys=1.04%, ctx=39, majf=0, minf=58 00:29:34.951 IO depths : 1=5.8%, 2=12.0%, 4=25.0%, 8=50.5%, 16=6.7%, 32=0.0%, >=64=0.0% 00:29:34.951 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.951 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.951 issued rwts: total=640,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:34.951 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:34.951 filename0: (groupid=0, jobs=1): err= 0: pid=342055: Thu Nov 28 19:17:54 2024 00:29:34.951 read: IOPS=58, BW=232KiB/s (238kB/s)(2368KiB/10188msec) 00:29:34.951 slat (usec): min=11, max=137, avg=74.13, stdev=22.31 00:29:34.951 clat (msec): min=90, max=335, avg=274.73, stdev=54.22 00:29:34.951 lat (msec): min=90, max=335, avg=274.80, stdev=54.23 00:29:34.951 clat percentiles (msec): 00:29:34.951 | 1.00th=[ 91], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 232], 00:29:34.951 | 30.00th=[ 271], 40.00th=[ 288], 50.00th=[ 292], 60.00th=[ 296], 00:29:34.951 | 70.00th=[ 300], 80.00th=[ 321], 90.00th=[ 330], 95.00th=[ 334], 00:29:34.951 | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], 00:29:34.951 | 99.99th=[ 334] 00:29:34.951 bw ( KiB/s): min= 128, max= 384, per=3.96%, avg=230.40, stdev=78.80, samples=20 00:29:34.951 iops : min= 32, max= 96, avg=57.60, stdev=19.70, samples=20 00:29:34.951 lat (msec) : 100=2.70%, 250=24.32%, 500=72.97% 00:29:34.951 cpu : usr=98.32%, sys=1.01%, ctx=32, majf=0, minf=51 00:29:34.951 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:34.951 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.951 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.951 issued rwts: total=592,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:34.951 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:34.951 filename0: (groupid=0, jobs=1): err= 0: pid=342056: Thu Nov 28 19:17:54 2024 00:29:34.951 read: IOPS=58, BW=232KiB/s (238kB/s)(2368KiB/10189msec) 00:29:34.951 slat (usec): min=11, max=129, avg=71.00, stdev=27.32 00:29:34.951 clat (msec): min=90, max=453, avg=274.81, stdev=63.75 00:29:34.951 lat (msec): min=90, max=453, avg=274.88, stdev=63.77 00:29:34.951 clat percentiles (msec): 00:29:34.951 | 1.00th=[ 91], 5.00th=[ 186], 10.00th=[ 188], 20.00th=[ 213], 00:29:34.951 | 30.00th=[ 251], 40.00th=[ 279], 50.00th=[ 292], 60.00th=[ 296], 00:29:34.951 | 70.00th=[ 305], 80.00th=[ 330], 90.00th=[ 334], 95.00th=[ 334], 00:29:34.951 | 99.00th=[ 451], 99.50th=[ 451], 99.90th=[ 456], 99.95th=[ 456], 00:29:34.951 | 99.99th=[ 456] 00:29:34.951 bw ( KiB/s): min= 128, max= 384, per=3.96%, avg=230.40, stdev=73.85, samples=20 00:29:34.951 iops : min= 32, max= 96, avg=57.60, stdev=18.46, samples=20 00:29:34.951 lat (msec) : 100=2.36%, 250=28.04%, 500=69.59% 00:29:34.951 cpu : usr=98.26%, sys=1.12%, ctx=24, majf=0, minf=51 00:29:34.951 IO depths : 1=3.2%, 2=9.5%, 4=25.0%, 8=53.0%, 16=9.3%, 32=0.0%, >=64=0.0% 00:29:34.951 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.951 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.951 issued rwts: total=592,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:34.951 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:34.951 filename0: (groupid=0, jobs=1): err= 0: pid=342057: Thu Nov 28 19:17:54 2024 00:29:34.951 read: IOPS=78, BW=313KiB/s (320kB/s)(3192KiB/10203msec) 00:29:34.951 slat (nsec): min=5741, max=89177, avg=14333.18, stdev=13664.54 00:29:34.951 clat (msec): min=90, max=335, avg=203.58, stdev=47.22 00:29:34.951 lat (msec): min=90, max=335, avg=203.59, stdev=47.22 00:29:34.951 clat percentiles (msec): 00:29:34.951 | 1.00th=[ 91], 5.00th=[ 115], 10.00th=[ 142], 20.00th=[ 171], 00:29:34.951 | 30.00th=[ 188], 40.00th=[ 194], 50.00th=[ 203], 60.00th=[ 205], 00:29:34.951 | 70.00th=[ 222], 80.00th=[ 230], 90.00th=[ 255], 95.00th=[ 296], 00:29:34.951 | 99.00th=[ 334], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], 00:29:34.951 | 99.99th=[ 338] 00:29:34.951 bw ( KiB/s): min= 256, max= 384, per=5.38%, avg=312.80, stdev=42.32, samples=20 00:29:34.951 iops : min= 64, max= 96, avg=78.20, stdev=10.58, samples=20 00:29:34.951 lat (msec) : 100=2.01%, 250=86.59%, 500=11.40% 00:29:34.951 cpu : usr=98.46%, sys=1.16%, ctx=15, majf=0, minf=76 00:29:34.951 IO depths : 1=0.6%, 2=2.1%, 4=10.2%, 8=74.8%, 16=12.3%, 32=0.0%, >=64=0.0% 00:29:34.951 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.951 complete : 0=0.0%, 4=89.7%, 8=5.2%, 16=5.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.951 issued rwts: total=798,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:34.951 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:34.951 filename0: (groupid=0, jobs=1): err= 0: pid=342058: Thu Nov 28 19:17:54 2024 00:29:34.951 read: IOPS=56, BW=226KiB/s (232kB/s)(2304KiB/10173msec) 00:29:34.951 slat (usec): min=15, max=128, avg=82.60, stdev=18.86 00:29:34.951 clat (msec): min=185, max=335, avg=281.85, stdev=42.61 00:29:34.951 lat (msec): min=185, max=335, avg=281.93, stdev=42.62 00:29:34.951 clat percentiles (msec): 00:29:34.951 | 1.00th=[ 186], 5.00th=[ 188], 10.00th=[ 211], 20.00th=[ 249], 00:29:34.951 | 30.00th=[ 275], 40.00th=[ 288], 50.00th=[ 292], 60.00th=[ 296], 00:29:34.951 | 70.00th=[ 305], 80.00th=[ 321], 90.00th=[ 330], 95.00th=[ 334], 00:29:34.951 | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], 00:29:34.951 | 99.99th=[ 334] 00:29:34.951 bw ( KiB/s): min= 128, max= 384, per=3.84%, avg=224.00, stdev=70.42, samples=20 00:29:34.951 iops : min= 32, max= 96, avg=56.00, stdev=17.60, samples=20 00:29:34.951 lat (msec) : 250=22.22%, 500=77.78% 00:29:34.951 cpu : usr=98.51%, sys=0.98%, ctx=23, majf=0, minf=54 00:29:34.951 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:34.951 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.951 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.951 issued rwts: total=576,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:34.951 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:34.951 filename0: (groupid=0, jobs=1): err= 0: pid=342059: Thu Nov 28 19:17:54 2024 00:29:34.951 read: IOPS=56, BW=227KiB/s (232kB/s)(2304KiB/10171msec) 00:29:34.951 slat (usec): min=7, max=113, avg=33.12, stdev= 9.02 00:29:34.951 clat (msec): min=125, max=454, avg=282.22, stdev=44.24 00:29:34.951 lat (msec): min=125, max=454, avg=282.25, stdev=44.24 00:29:34.951 clat percentiles (msec): 00:29:34.951 | 1.00th=[ 186], 5.00th=[ 188], 10.00th=[ 211], 20.00th=[ 249], 00:29:34.951 | 30.00th=[ 275], 40.00th=[ 288], 50.00th=[ 292], 60.00th=[ 296], 00:29:34.951 | 70.00th=[ 305], 80.00th=[ 321], 90.00th=[ 334], 95.00th=[ 334], 00:29:34.951 | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 456], 99.95th=[ 456], 00:29:34.951 | 99.99th=[ 456] 00:29:34.951 bw ( KiB/s): min= 128, max= 384, per=3.84%, avg=224.00, stdev=70.61, samples=20 00:29:34.951 iops : min= 32, max= 96, avg=56.00, stdev=17.65, samples=20 00:29:34.951 lat (msec) : 250=22.57%, 500=77.43% 00:29:34.951 cpu : usr=97.32%, sys=1.73%, ctx=91, majf=0, minf=55 00:29:34.951 IO depths : 1=5.9%, 2=12.2%, 4=25.0%, 8=50.3%, 16=6.6%, 32=0.0%, >=64=0.0% 00:29:34.951 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.951 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.951 issued rwts: total=576,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:34.951 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:34.951 filename0: (groupid=0, jobs=1): err= 0: pid=342060: Thu Nov 28 19:17:54 2024 00:29:34.951 read: IOPS=56, BW=226KiB/s (232kB/s)(2304KiB/10189msec) 00:29:34.951 slat (usec): min=8, max=107, avg=33.54, stdev=18.94 00:29:34.951 clat (msec): min=175, max=385, avg=282.54, stdev=44.71 00:29:34.951 lat (msec): min=175, max=385, avg=282.57, stdev=44.70 00:29:34.951 clat percentiles (msec): 00:29:34.951 | 1.00th=[ 186], 5.00th=[ 188], 10.00th=[ 207], 20.00th=[ 249], 00:29:34.951 | 30.00th=[ 266], 40.00th=[ 288], 50.00th=[ 296], 60.00th=[ 296], 00:29:34.951 | 70.00th=[ 305], 80.00th=[ 321], 90.00th=[ 334], 95.00th=[ 338], 00:29:34.951 | 99.00th=[ 342], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], 00:29:34.951 | 99.99th=[ 384] 00:29:34.951 bw ( KiB/s): min= 128, max= 384, per=3.84%, avg=224.00, stdev=70.42, samples=20 00:29:34.951 iops : min= 32, max= 96, avg=56.00, stdev=17.60, samples=20 00:29:34.951 lat (msec) : 250=22.22%, 500=77.78% 00:29:34.951 cpu : usr=98.42%, sys=1.15%, ctx=35, majf=0, minf=65 00:29:34.951 IO depths : 1=5.7%, 2=12.0%, 4=25.0%, 8=50.5%, 16=6.8%, 32=0.0%, >=64=0.0% 00:29:34.951 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.951 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.951 issued rwts: total=576,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:34.951 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:34.951 filename0: (groupid=0, jobs=1): err= 0: pid=342061: Thu Nov 28 19:17:54 2024 00:29:34.951 read: IOPS=56, BW=226KiB/s (232kB/s)(2304KiB/10178msec) 00:29:34.951 slat (usec): min=16, max=154, avg=79.59, stdev=24.71 00:29:34.951 clat (msec): min=128, max=454, avg=282.09, stdev=54.25 00:29:34.951 lat (msec): min=128, max=454, avg=282.17, stdev=54.25 00:29:34.951 clat percentiles (msec): 00:29:34.951 | 1.00th=[ 142], 5.00th=[ 186], 10.00th=[ 199], 20.00th=[ 236], 00:29:34.951 | 30.00th=[ 271], 40.00th=[ 288], 50.00th=[ 292], 60.00th=[ 296], 00:29:34.951 | 70.00th=[ 305], 80.00th=[ 330], 90.00th=[ 334], 95.00th=[ 334], 00:29:34.951 | 99.00th=[ 447], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], 00:29:34.951 | 99.99th=[ 456] 00:29:34.951 bw ( KiB/s): min= 128, max= 368, per=3.84%, avg=224.00, stdev=66.07, samples=20 00:29:34.951 iops : min= 32, max= 92, avg=56.00, stdev=16.52, samples=20 00:29:34.951 lat (msec) : 250=25.00%, 500=75.00% 00:29:34.951 cpu : usr=98.23%, sys=1.16%, ctx=53, majf=0, minf=45 00:29:34.951 IO depths : 1=3.6%, 2=9.9%, 4=25.0%, 8=52.6%, 16=8.9%, 32=0.0%, >=64=0.0% 00:29:34.951 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.951 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.951 issued rwts: total=576,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:34.951 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:34.951 filename1: (groupid=0, jobs=1): err= 0: pid=342062: Thu Nov 28 19:17:54 2024 00:29:34.951 read: IOPS=56, BW=226KiB/s (232kB/s)(2304KiB/10182msec) 00:29:34.951 slat (usec): min=14, max=113, avg=26.04, stdev=14.15 00:29:34.951 clat (msec): min=185, max=335, avg=282.42, stdev=42.66 00:29:34.951 lat (msec): min=185, max=335, avg=282.45, stdev=42.65 00:29:34.952 clat percentiles (msec): 00:29:34.952 | 1.00th=[ 186], 5.00th=[ 188], 10.00th=[ 211], 20.00th=[ 249], 00:29:34.952 | 30.00th=[ 275], 40.00th=[ 288], 50.00th=[ 292], 60.00th=[ 296], 00:29:34.952 | 70.00th=[ 305], 80.00th=[ 321], 90.00th=[ 334], 95.00th=[ 334], 00:29:34.952 | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], 00:29:34.952 | 99.99th=[ 334] 00:29:34.952 bw ( KiB/s): min= 128, max= 384, per=3.84%, avg=224.00, stdev=70.42, samples=20 00:29:34.952 iops : min= 32, max= 96, avg=56.00, stdev=17.60, samples=20 00:29:34.952 lat (msec) : 250=22.22%, 500=77.78% 00:29:34.952 cpu : usr=98.12%, sys=1.26%, ctx=55, majf=0, minf=46 00:29:34.952 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:34.952 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.952 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.952 issued rwts: total=576,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:34.952 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:34.952 filename1: (groupid=0, jobs=1): err= 0: pid=342063: Thu Nov 28 19:17:54 2024 00:29:34.952 read: IOPS=55, BW=220KiB/s (226kB/s)(2240KiB/10162msec) 00:29:34.952 slat (nsec): min=7824, max=98141, avg=23310.74, stdev=20893.83 00:29:34.952 clat (msec): min=75, max=496, avg=286.75, stdev=67.03 00:29:34.952 lat (msec): min=75, max=496, avg=286.78, stdev=67.02 00:29:34.952 clat percentiles (msec): 00:29:34.952 | 1.00th=[ 95], 5.00th=[ 169], 10.00th=[ 190], 20.00th=[ 236], 00:29:34.952 | 30.00th=[ 275], 40.00th=[ 288], 50.00th=[ 296], 60.00th=[ 296], 00:29:34.952 | 70.00th=[ 317], 80.00th=[ 334], 90.00th=[ 334], 95.00th=[ 384], 00:29:34.952 | 99.00th=[ 493], 99.50th=[ 493], 99.90th=[ 498], 99.95th=[ 498], 00:29:34.952 | 99.99th=[ 498] 00:29:34.952 bw ( KiB/s): min= 128, max= 384, per=3.74%, avg=217.60, stdev=70.49, samples=20 00:29:34.952 iops : min= 32, max= 96, avg=54.40, stdev=17.62, samples=20 00:29:34.952 lat (msec) : 100=1.07%, 250=20.00%, 500=78.93% 00:29:34.952 cpu : usr=98.44%, sys=1.17%, ctx=24, majf=0, minf=61 00:29:34.952 IO depths : 1=3.2%, 2=9.5%, 4=25.0%, 8=53.0%, 16=9.3%, 32=0.0%, >=64=0.0% 00:29:34.952 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.952 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.952 issued rwts: total=560,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:34.952 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:34.952 filename1: (groupid=0, jobs=1): err= 0: pid=342064: Thu Nov 28 19:17:54 2024 00:29:34.952 read: IOPS=58, BW=232KiB/s (238kB/s)(2368KiB/10196msec) 00:29:34.952 slat (usec): min=9, max=120, avg=74.44, stdev=23.33 00:29:34.952 clat (msec): min=104, max=384, avg=274.92, stdev=54.95 00:29:34.952 lat (msec): min=104, max=384, avg=275.00, stdev=54.96 00:29:34.952 clat percentiles (msec): 00:29:34.952 | 1.00th=[ 105], 5.00th=[ 176], 10.00th=[ 188], 20.00th=[ 230], 00:29:34.952 | 30.00th=[ 262], 40.00th=[ 284], 50.00th=[ 292], 60.00th=[ 296], 00:29:34.952 | 70.00th=[ 305], 80.00th=[ 321], 90.00th=[ 334], 95.00th=[ 338], 00:29:34.952 | 99.00th=[ 342], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], 00:29:34.952 | 99.99th=[ 384] 00:29:34.952 bw ( KiB/s): min= 128, max= 384, per=3.96%, avg=230.40, stdev=78.80, samples=20 00:29:34.952 iops : min= 32, max= 96, avg=57.60, stdev=19.70, samples=20 00:29:34.952 lat (msec) : 250=27.03%, 500=72.97% 00:29:34.952 cpu : usr=98.18%, sys=1.18%, ctx=31, majf=0, minf=54 00:29:34.952 IO depths : 1=5.7%, 2=12.0%, 4=25.0%, 8=50.5%, 16=6.8%, 32=0.0%, >=64=0.0% 00:29:34.952 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.952 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.952 issued rwts: total=592,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:34.952 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:34.952 filename1: (groupid=0, jobs=1): err= 0: pid=342065: Thu Nov 28 19:17:54 2024 00:29:34.952 read: IOPS=58, BW=232KiB/s (238kB/s)(2368KiB/10188msec) 00:29:34.952 slat (usec): min=14, max=139, avg=75.06, stdev=30.40 00:29:34.952 clat (msec): min=90, max=385, avg=274.58, stdev=57.49 00:29:34.952 lat (msec): min=90, max=385, avg=274.66, stdev=57.51 00:29:34.952 clat percentiles (msec): 00:29:34.952 | 1.00th=[ 91], 5.00th=[ 186], 10.00th=[ 188], 20.00th=[ 213], 00:29:34.952 | 30.00th=[ 257], 40.00th=[ 284], 50.00th=[ 292], 60.00th=[ 296], 00:29:34.952 | 70.00th=[ 305], 80.00th=[ 326], 90.00th=[ 334], 95.00th=[ 338], 00:29:34.952 | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], 00:29:34.952 | 99.99th=[ 384] 00:29:34.952 bw ( KiB/s): min= 128, max= 384, per=3.96%, avg=230.40, stdev=78.80, samples=20 00:29:34.952 iops : min= 32, max= 96, avg=57.60, stdev=19.70, samples=20 00:29:34.952 lat (msec) : 100=2.70%, 250=23.99%, 500=73.31% 00:29:34.952 cpu : usr=98.13%, sys=1.26%, ctx=53, majf=0, minf=46 00:29:34.952 IO depths : 1=3.2%, 2=9.5%, 4=25.0%, 8=53.0%, 16=9.3%, 32=0.0%, >=64=0.0% 00:29:34.952 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.952 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.952 issued rwts: total=592,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:34.952 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:34.952 filename1: (groupid=0, jobs=1): err= 0: pid=342066: Thu Nov 28 19:17:54 2024 00:29:34.952 read: IOPS=56, BW=226KiB/s (232kB/s)(2304KiB/10176msec) 00:29:34.952 slat (nsec): min=7999, max=86981, avg=21980.09, stdev=14187.71 00:29:34.952 clat (msec): min=186, max=342, avg=282.46, stdev=44.23 00:29:34.952 lat (msec): min=186, max=342, avg=282.48, stdev=44.22 00:29:34.952 clat percentiles (msec): 00:29:34.952 | 1.00th=[ 186], 5.00th=[ 188], 10.00th=[ 207], 20.00th=[ 249], 00:29:34.952 | 30.00th=[ 264], 40.00th=[ 288], 50.00th=[ 296], 60.00th=[ 296], 00:29:34.952 | 70.00th=[ 305], 80.00th=[ 321], 90.00th=[ 334], 95.00th=[ 338], 00:29:34.952 | 99.00th=[ 342], 99.50th=[ 342], 99.90th=[ 342], 99.95th=[ 342], 00:29:34.952 | 99.99th=[ 342] 00:29:34.952 bw ( KiB/s): min= 128, max= 384, per=3.84%, avg=224.00, stdev=70.42, samples=20 00:29:34.952 iops : min= 32, max= 96, avg=56.00, stdev=17.60, samples=20 00:29:34.952 lat (msec) : 250=22.22%, 500=77.78% 00:29:34.952 cpu : usr=98.64%, sys=0.96%, ctx=18, majf=0, minf=52 00:29:34.952 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:34.952 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.952 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.952 issued rwts: total=576,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:34.952 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:34.952 filename1: (groupid=0, jobs=1): err= 0: pid=342067: Thu Nov 28 19:17:54 2024 00:29:34.952 read: IOPS=56, BW=227KiB/s (232kB/s)(2304KiB/10169msec) 00:29:34.952 slat (usec): min=14, max=135, avg=81.27, stdev=18.29 00:29:34.952 clat (msec): min=125, max=452, avg=281.75, stdev=45.34 00:29:34.952 lat (msec): min=125, max=452, avg=281.83, stdev=45.35 00:29:34.952 clat percentiles (msec): 00:29:34.952 | 1.00th=[ 186], 5.00th=[ 188], 10.00th=[ 211], 20.00th=[ 249], 00:29:34.952 | 30.00th=[ 271], 40.00th=[ 288], 50.00th=[ 292], 60.00th=[ 296], 00:29:34.952 | 70.00th=[ 300], 80.00th=[ 321], 90.00th=[ 334], 95.00th=[ 334], 00:29:34.952 | 99.00th=[ 334], 99.50th=[ 451], 99.90th=[ 451], 99.95th=[ 451], 00:29:34.952 | 99.99th=[ 451] 00:29:34.952 bw ( KiB/s): min= 128, max= 384, per=3.84%, avg=224.00, stdev=70.61, samples=20 00:29:34.952 iops : min= 32, max= 96, avg=56.00, stdev=17.65, samples=20 00:29:34.952 lat (msec) : 250=22.92%, 500=77.08% 00:29:34.952 cpu : usr=98.43%, sys=1.07%, ctx=28, majf=0, minf=40 00:29:34.952 IO depths : 1=5.7%, 2=12.0%, 4=25.0%, 8=50.5%, 16=6.8%, 32=0.0%, >=64=0.0% 00:29:34.952 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.952 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.952 issued rwts: total=576,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:34.952 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:34.952 filename1: (groupid=0, jobs=1): err= 0: pid=342068: Thu Nov 28 19:17:54 2024 00:29:34.952 read: IOPS=56, BW=226KiB/s (232kB/s)(2304KiB/10182msec) 00:29:34.952 slat (usec): min=13, max=127, avg=82.90, stdev=18.86 00:29:34.952 clat (msec): min=186, max=342, avg=282.10, stdev=43.96 00:29:34.952 lat (msec): min=186, max=342, avg=282.18, stdev=43.97 00:29:34.952 clat percentiles (msec): 00:29:34.952 | 1.00th=[ 186], 5.00th=[ 188], 10.00th=[ 207], 20.00th=[ 249], 00:29:34.952 | 30.00th=[ 266], 40.00th=[ 284], 50.00th=[ 292], 60.00th=[ 296], 00:29:34.952 | 70.00th=[ 305], 80.00th=[ 321], 90.00th=[ 334], 95.00th=[ 338], 00:29:34.952 | 99.00th=[ 342], 99.50th=[ 342], 99.90th=[ 342], 99.95th=[ 342], 00:29:34.952 | 99.99th=[ 342] 00:29:34.952 bw ( KiB/s): min= 128, max= 384, per=3.84%, avg=224.00, stdev=70.42, samples=20 00:29:34.952 iops : min= 32, max= 96, avg=56.00, stdev=17.60, samples=20 00:29:34.952 lat (msec) : 250=22.22%, 500=77.78% 00:29:34.952 cpu : usr=98.58%, sys=0.95%, ctx=42, majf=0, minf=46 00:29:34.952 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:34.952 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.952 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.952 issued rwts: total=576,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:34.952 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:34.952 filename1: (groupid=0, jobs=1): err= 0: pid=342069: Thu Nov 28 19:17:54 2024 00:29:34.952 read: IOPS=56, BW=226KiB/s (232kB/s)(2304KiB/10182msec) 00:29:34.952 slat (usec): min=5, max=162, avg=83.28, stdev=21.25 00:29:34.952 clat (msec): min=186, max=382, avg=282.15, stdev=45.56 00:29:34.952 lat (msec): min=186, max=382, avg=282.23, stdev=45.57 00:29:34.952 clat percentiles (msec): 00:29:34.952 | 1.00th=[ 186], 5.00th=[ 188], 10.00th=[ 207], 20.00th=[ 243], 00:29:34.952 | 30.00th=[ 266], 40.00th=[ 284], 50.00th=[ 292], 60.00th=[ 296], 00:29:34.952 | 70.00th=[ 305], 80.00th=[ 330], 90.00th=[ 334], 95.00th=[ 338], 00:29:34.952 | 99.00th=[ 359], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], 00:29:34.952 | 99.99th=[ 384] 00:29:34.952 bw ( KiB/s): min= 128, max= 368, per=3.84%, avg=224.00, stdev=67.68, samples=20 00:29:34.952 iops : min= 32, max= 92, avg=56.00, stdev=16.92, samples=20 00:29:34.952 lat (msec) : 250=23.26%, 500=76.74% 00:29:34.952 cpu : usr=98.42%, sys=0.97%, ctx=36, majf=0, minf=45 00:29:34.952 IO depths : 1=3.8%, 2=10.1%, 4=25.0%, 8=52.4%, 16=8.7%, 32=0.0%, >=64=0.0% 00:29:34.952 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.952 complete : 0=0.0%, 4=94.2%, 8=0.0%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.953 issued rwts: total=576,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:34.953 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:34.953 filename2: (groupid=0, jobs=1): err= 0: pid=342070: Thu Nov 28 19:17:54 2024 00:29:34.953 read: IOPS=56, BW=227KiB/s (232kB/s)(2304KiB/10169msec) 00:29:34.953 slat (nsec): min=10029, max=99253, avg=34249.43, stdev=14956.89 00:29:34.953 clat (msec): min=185, max=335, avg=282.18, stdev=42.87 00:29:34.953 lat (msec): min=185, max=335, avg=282.21, stdev=42.86 00:29:34.953 clat percentiles (msec): 00:29:34.953 | 1.00th=[ 186], 5.00th=[ 188], 10.00th=[ 211], 20.00th=[ 249], 00:29:34.953 | 30.00th=[ 275], 40.00th=[ 288], 50.00th=[ 292], 60.00th=[ 296], 00:29:34.953 | 70.00th=[ 305], 80.00th=[ 321], 90.00th=[ 334], 95.00th=[ 334], 00:29:34.953 | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], 00:29:34.953 | 99.99th=[ 334] 00:29:34.953 bw ( KiB/s): min= 128, max= 384, per=3.84%, avg=224.00, stdev=70.42, samples=20 00:29:34.953 iops : min= 32, max= 96, avg=56.00, stdev=17.60, samples=20 00:29:34.953 lat (msec) : 250=22.22%, 500=77.78% 00:29:34.953 cpu : usr=98.48%, sys=1.10%, ctx=31, majf=0, minf=53 00:29:34.953 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:29:34.953 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.953 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.953 issued rwts: total=576,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:34.953 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:34.953 filename2: (groupid=0, jobs=1): err= 0: pid=342071: Thu Nov 28 19:17:54 2024 00:29:34.953 read: IOPS=78, BW=312KiB/s (320kB/s)(3184KiB/10204msec) 00:29:34.953 slat (usec): min=4, max=170, avg=15.74, stdev=15.59 00:29:34.953 clat (msec): min=93, max=336, avg=204.90, stdev=52.37 00:29:34.953 lat (msec): min=93, max=336, avg=204.91, stdev=52.37 00:29:34.953 clat percentiles (msec): 00:29:34.953 | 1.00th=[ 100], 5.00th=[ 115], 10.00th=[ 144], 20.00th=[ 155], 00:29:34.953 | 30.00th=[ 186], 40.00th=[ 190], 50.00th=[ 201], 60.00th=[ 213], 00:29:34.953 | 70.00th=[ 232], 80.00th=[ 247], 90.00th=[ 271], 95.00th=[ 300], 00:29:34.953 | 99.00th=[ 334], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], 00:29:34.953 | 99.99th=[ 338] 00:29:34.953 bw ( KiB/s): min= 176, max= 384, per=5.36%, avg=312.00, stdev=64.94, samples=20 00:29:34.953 iops : min= 44, max= 96, avg=78.00, stdev=16.24, samples=20 00:29:34.953 lat (msec) : 100=1.51%, 250=81.66%, 500=16.83% 00:29:34.953 cpu : usr=98.46%, sys=1.00%, ctx=48, majf=0, minf=81 00:29:34.953 IO depths : 1=2.6%, 2=6.2%, 4=16.3%, 8=64.7%, 16=10.2%, 32=0.0%, >=64=0.0% 00:29:34.953 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.953 complete : 0=0.0%, 4=91.5%, 8=3.3%, 16=5.2%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.953 issued rwts: total=796,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:34.953 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:34.953 filename2: (groupid=0, jobs=1): err= 0: pid=342072: Thu Nov 28 19:17:54 2024 00:29:34.953 read: IOPS=64, BW=258KiB/s (264kB/s)(2624KiB/10181msec) 00:29:34.953 slat (usec): min=7, max=130, avg=55.21, stdev=34.61 00:29:34.953 clat (msec): min=90, max=320, avg=247.83, stdev=52.37 00:29:34.953 lat (msec): min=90, max=320, avg=247.89, stdev=52.39 00:29:34.953 clat percentiles (msec): 00:29:34.953 | 1.00th=[ 91], 5.00th=[ 171], 10.00th=[ 174], 20.00th=[ 197], 00:29:34.953 | 30.00th=[ 211], 40.00th=[ 236], 50.00th=[ 271], 60.00th=[ 279], 00:29:34.953 | 70.00th=[ 292], 80.00th=[ 296], 90.00th=[ 300], 95.00th=[ 305], 00:29:34.953 | 99.00th=[ 321], 99.50th=[ 321], 99.90th=[ 321], 99.95th=[ 321], 00:29:34.953 | 99.99th=[ 321] 00:29:34.953 bw ( KiB/s): min= 128, max= 384, per=4.41%, avg=256.00, stdev=83.06, samples=20 00:29:34.953 iops : min= 32, max= 96, avg=64.00, stdev=20.76, samples=20 00:29:34.953 lat (msec) : 100=2.44%, 250=41.16%, 500=56.40% 00:29:34.953 cpu : usr=98.52%, sys=0.98%, ctx=25, majf=0, minf=52 00:29:34.953 IO depths : 1=6.1%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.4%, 32=0.0%, >=64=0.0% 00:29:34.953 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.953 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.953 issued rwts: total=656,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:34.953 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:34.953 filename2: (groupid=0, jobs=1): err= 0: pid=342073: Thu Nov 28 19:17:54 2024 00:29:34.953 read: IOPS=56, BW=226KiB/s (232kB/s)(2304KiB/10182msec) 00:29:34.953 slat (usec): min=5, max=122, avg=25.50, stdev=15.85 00:29:34.953 clat (msec): min=124, max=335, avg=282.60, stdev=43.41 00:29:34.953 lat (msec): min=124, max=335, avg=282.63, stdev=43.41 00:29:34.953 clat percentiles (msec): 00:29:34.953 | 1.00th=[ 186], 5.00th=[ 188], 10.00th=[ 211], 20.00th=[ 249], 00:29:34.953 | 30.00th=[ 275], 40.00th=[ 288], 50.00th=[ 292], 60.00th=[ 296], 00:29:34.953 | 70.00th=[ 305], 80.00th=[ 326], 90.00th=[ 334], 95.00th=[ 334], 00:29:34.953 | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], 00:29:34.953 | 99.99th=[ 334] 00:29:34.953 bw ( KiB/s): min= 128, max= 384, per=3.84%, avg=224.00, stdev=70.61, samples=20 00:29:34.953 iops : min= 32, max= 96, avg=56.00, stdev=17.65, samples=20 00:29:34.953 lat (msec) : 250=21.88%, 500=78.12% 00:29:34.953 cpu : usr=98.35%, sys=1.09%, ctx=52, majf=0, minf=53 00:29:34.953 IO depths : 1=5.9%, 2=12.2%, 4=25.0%, 8=50.3%, 16=6.6%, 32=0.0%, >=64=0.0% 00:29:34.953 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.953 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.953 issued rwts: total=576,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:34.953 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:34.953 filename2: (groupid=0, jobs=1): err= 0: pid=342074: Thu Nov 28 19:17:54 2024 00:29:34.953 read: IOPS=75, BW=300KiB/s (308kB/s)(3064KiB/10203msec) 00:29:34.953 slat (usec): min=7, max=113, avg=22.10, stdev=22.17 00:29:34.953 clat (msec): min=102, max=363, avg=212.44, stdev=42.59 00:29:34.953 lat (msec): min=102, max=363, avg=212.46, stdev=42.60 00:29:34.953 clat percentiles (msec): 00:29:34.953 | 1.00th=[ 106], 5.00th=[ 148], 10.00th=[ 165], 20.00th=[ 186], 00:29:34.953 | 30.00th=[ 192], 40.00th=[ 199], 50.00th=[ 211], 60.00th=[ 226], 00:29:34.953 | 70.00th=[ 232], 80.00th=[ 247], 90.00th=[ 264], 95.00th=[ 275], 00:29:34.953 | 99.00th=[ 334], 99.50th=[ 347], 99.90th=[ 363], 99.95th=[ 363], 00:29:34.953 | 99.99th=[ 363] 00:29:34.953 bw ( KiB/s): min= 176, max= 384, per=5.17%, avg=300.00, stdev=56.84, samples=20 00:29:34.953 iops : min= 44, max= 96, avg=75.00, stdev=14.21, samples=20 00:29:34.953 lat (msec) : 250=85.12%, 500=14.88% 00:29:34.953 cpu : usr=98.32%, sys=1.12%, ctx=90, majf=0, minf=59 00:29:34.953 IO depths : 1=0.9%, 2=3.3%, 4=13.1%, 8=71.0%, 16=11.7%, 32=0.0%, >=64=0.0% 00:29:34.953 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.953 complete : 0=0.0%, 4=90.7%, 8=4.0%, 16=5.4%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.953 issued rwts: total=766,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:34.953 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:34.953 filename2: (groupid=0, jobs=1): err= 0: pid=342075: Thu Nov 28 19:17:54 2024 00:29:34.953 read: IOPS=56, BW=226KiB/s (231kB/s)(2296KiB/10170msec) 00:29:34.953 slat (nsec): min=4584, max=70516, avg=30661.55, stdev=9158.02 00:29:34.953 clat (msec): min=137, max=466, avg=282.72, stdev=56.65 00:29:34.953 lat (msec): min=137, max=466, avg=282.75, stdev=56.65 00:29:34.953 clat percentiles (msec): 00:29:34.953 | 1.00th=[ 144], 5.00th=[ 186], 10.00th=[ 199], 20.00th=[ 232], 00:29:34.953 | 30.00th=[ 264], 40.00th=[ 288], 50.00th=[ 292], 60.00th=[ 296], 00:29:34.953 | 70.00th=[ 305], 80.00th=[ 330], 90.00th=[ 334], 95.00th=[ 334], 00:29:34.953 | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 468], 99.95th=[ 468], 00:29:34.953 | 99.99th=[ 468] 00:29:34.953 bw ( KiB/s): min= 128, max= 368, per=3.84%, avg=223.20, stdev=64.31, samples=20 00:29:34.953 iops : min= 32, max= 92, avg=55.80, stdev=16.08, samples=20 00:29:34.953 lat (msec) : 250=25.78%, 500=74.22% 00:29:34.953 cpu : usr=98.38%, sys=1.26%, ctx=8, majf=0, minf=49 00:29:34.953 IO depths : 1=3.3%, 2=9.6%, 4=25.1%, 8=53.0%, 16=9.1%, 32=0.0%, >=64=0.0% 00:29:34.953 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.953 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.953 issued rwts: total=574,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:34.953 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:34.953 filename2: (groupid=0, jobs=1): err= 0: pid=342076: Thu Nov 28 19:17:54 2024 00:29:34.953 read: IOPS=72, BW=288KiB/s (295kB/s)(2936KiB/10189msec) 00:29:34.953 slat (usec): min=7, max=121, avg=25.92, stdev=28.55 00:29:34.953 clat (msec): min=148, max=329, avg=220.95, stdev=39.25 00:29:34.953 lat (msec): min=148, max=329, avg=220.98, stdev=39.25 00:29:34.953 clat percentiles (msec): 00:29:34.953 | 1.00th=[ 148], 5.00th=[ 155], 10.00th=[ 169], 20.00th=[ 190], 00:29:34.953 | 30.00th=[ 197], 40.00th=[ 205], 50.00th=[ 222], 60.00th=[ 228], 00:29:34.953 | 70.00th=[ 245], 80.00th=[ 255], 90.00th=[ 284], 95.00th=[ 296], 00:29:34.953 | 99.00th=[ 326], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 330], 00:29:34.953 | 99.99th=[ 330] 00:29:34.953 bw ( KiB/s): min= 128, max= 384, per=4.95%, avg=287.20, stdev=59.75, samples=20 00:29:34.953 iops : min= 32, max= 96, avg=71.80, stdev=14.94, samples=20 00:29:34.953 lat (msec) : 250=78.34%, 500=21.66% 00:29:34.953 cpu : usr=98.24%, sys=1.19%, ctx=69, majf=0, minf=55 00:29:34.953 IO depths : 1=1.5%, 2=4.1%, 4=13.8%, 8=69.5%, 16=11.2%, 32=0.0%, >=64=0.0% 00:29:34.953 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.953 complete : 0=0.0%, 4=90.8%, 8=3.8%, 16=5.4%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.953 issued rwts: total=734,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:34.953 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:34.953 filename2: (groupid=0, jobs=1): err= 0: pid=342077: Thu Nov 28 19:17:54 2024 00:29:34.953 read: IOPS=56, BW=226KiB/s (232kB/s)(2304KiB/10180msec) 00:29:34.953 slat (usec): min=5, max=122, avg=84.25, stdev=20.11 00:29:34.953 clat (msec): min=175, max=382, avg=282.09, stdev=45.97 00:29:34.953 lat (msec): min=175, max=382, avg=282.17, stdev=45.99 00:29:34.953 clat percentiles (msec): 00:29:34.953 | 1.00th=[ 186], 5.00th=[ 188], 10.00th=[ 207], 20.00th=[ 241], 00:29:34.953 | 30.00th=[ 264], 40.00th=[ 284], 50.00th=[ 292], 60.00th=[ 296], 00:29:34.953 | 70.00th=[ 305], 80.00th=[ 330], 90.00th=[ 334], 95.00th=[ 338], 00:29:34.953 | 99.00th=[ 380], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], 00:29:34.953 | 99.99th=[ 384] 00:29:34.953 bw ( KiB/s): min= 128, max= 384, per=3.84%, avg=224.00, stdev=69.06, samples=20 00:29:34.953 iops : min= 32, max= 96, avg=56.00, stdev=17.27, samples=20 00:29:34.953 lat (msec) : 250=23.61%, 500=76.39% 00:29:34.953 cpu : usr=97.81%, sys=1.46%, ctx=104, majf=0, minf=61 00:29:34.954 IO depths : 1=3.3%, 2=9.5%, 4=25.0%, 8=53.0%, 16=9.2%, 32=0.0%, >=64=0.0% 00:29:34.954 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.954 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:34.954 issued rwts: total=576,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:34.954 latency : target=0, window=0, percentile=100.00%, depth=16 00:29:34.954 00:29:34.954 Run status group 0 (all jobs): 00:29:34.954 READ: bw=5803KiB/s (5942kB/s), 220KiB/s-313KiB/s (226kB/s-320kB/s), io=57.8MiB (60.6MB), run=10162-10204msec 00:29:34.954 19:17:54 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:29:34.954 19:17:54 -- target/dif.sh@43 -- # local sub 00:29:34.954 19:17:54 -- target/dif.sh@45 -- # for sub in "$@" 00:29:34.954 19:17:54 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:34.954 19:17:54 -- target/dif.sh@36 -- # local sub_id=0 00:29:34.954 19:17:54 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:34.954 19:17:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:34.954 19:17:54 -- common/autotest_common.sh@10 -- # set +x 00:29:34.954 19:17:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:34.954 19:17:54 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:34.954 19:17:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:34.954 19:17:54 -- common/autotest_common.sh@10 -- # set +x 00:29:34.954 19:17:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:34.954 19:17:54 -- target/dif.sh@45 -- # for sub in "$@" 00:29:34.954 19:17:54 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:34.954 19:17:54 -- target/dif.sh@36 -- # local sub_id=1 00:29:34.954 19:17:54 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:34.954 19:17:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:34.954 19:17:54 -- common/autotest_common.sh@10 -- # set +x 00:29:34.954 19:17:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:34.954 19:17:54 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:34.954 19:17:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:34.954 19:17:54 -- common/autotest_common.sh@10 -- # set +x 00:29:34.954 19:17:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:34.954 19:17:54 -- target/dif.sh@45 -- # for sub in "$@" 00:29:34.954 19:17:54 -- target/dif.sh@46 -- # destroy_subsystem 2 00:29:34.954 19:17:54 -- target/dif.sh@36 -- # local sub_id=2 00:29:34.954 19:17:54 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:29:34.954 19:17:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:34.954 19:17:54 -- common/autotest_common.sh@10 -- # set +x 00:29:34.954 19:17:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:34.954 19:17:54 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:29:34.954 19:17:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:34.954 19:17:54 -- common/autotest_common.sh@10 -- # set +x 00:29:34.954 19:17:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:34.954 19:17:54 -- target/dif.sh@115 -- # NULL_DIF=1 00:29:34.954 19:17:54 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:29:34.954 19:17:54 -- target/dif.sh@115 -- # numjobs=2 00:29:34.954 19:17:54 -- target/dif.sh@115 -- # iodepth=8 00:29:34.954 19:17:54 -- target/dif.sh@115 -- # runtime=5 00:29:34.954 19:17:54 -- target/dif.sh@115 -- # files=1 00:29:34.954 19:17:54 -- target/dif.sh@117 -- # create_subsystems 0 1 00:29:34.954 19:17:54 -- target/dif.sh@28 -- # local sub 00:29:34.954 19:17:54 -- target/dif.sh@30 -- # for sub in "$@" 00:29:34.954 19:17:54 -- target/dif.sh@31 -- # create_subsystem 0 00:29:34.954 19:17:54 -- target/dif.sh@18 -- # local sub_id=0 00:29:34.954 19:17:54 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:29:34.954 19:17:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:34.954 19:17:54 -- common/autotest_common.sh@10 -- # set +x 00:29:34.954 bdev_null0 00:29:34.954 19:17:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:34.954 19:17:54 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:34.954 19:17:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:34.954 19:17:54 -- common/autotest_common.sh@10 -- # set +x 00:29:34.954 19:17:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:34.954 19:17:54 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:34.954 19:17:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:34.954 19:17:54 -- common/autotest_common.sh@10 -- # set +x 00:29:34.954 19:17:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:34.954 19:17:54 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:34.954 19:17:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:34.954 19:17:54 -- common/autotest_common.sh@10 -- # set +x 00:29:34.954 [2024-11-28 19:17:54.358208] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:34.954 19:17:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:34.954 19:17:54 -- target/dif.sh@30 -- # for sub in "$@" 00:29:34.954 19:17:54 -- target/dif.sh@31 -- # create_subsystem 1 00:29:34.954 19:17:54 -- target/dif.sh@18 -- # local sub_id=1 00:29:34.954 19:17:54 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:29:34.954 19:17:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:34.954 19:17:54 -- common/autotest_common.sh@10 -- # set +x 00:29:34.954 bdev_null1 00:29:34.954 19:17:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:34.954 19:17:54 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:29:34.954 19:17:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:34.954 19:17:54 -- common/autotest_common.sh@10 -- # set +x 00:29:34.954 19:17:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:34.954 19:17:54 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:29:34.954 19:17:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:34.954 19:17:54 -- common/autotest_common.sh@10 -- # set +x 00:29:34.954 19:17:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:34.954 19:17:54 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:34.954 19:17:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:34.954 19:17:54 -- common/autotest_common.sh@10 -- # set +x 00:29:34.954 19:17:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:34.954 19:17:54 -- target/dif.sh@118 -- # fio /dev/fd/62 00:29:34.954 19:17:54 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:29:34.954 19:17:54 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:29:34.954 19:17:54 -- nvmf/common.sh@520 -- # config=() 00:29:34.954 19:17:54 -- nvmf/common.sh@520 -- # local subsystem config 00:29:34.954 19:17:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:34.954 19:17:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:34.954 { 00:29:34.954 "params": { 00:29:34.954 "name": "Nvme$subsystem", 00:29:34.954 "trtype": "$TEST_TRANSPORT", 00:29:34.954 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:34.954 "adrfam": "ipv4", 00:29:34.954 "trsvcid": "$NVMF_PORT", 00:29:34.954 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:34.954 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:34.954 "hdgst": ${hdgst:-false}, 00:29:34.954 "ddgst": ${ddgst:-false} 00:29:34.954 }, 00:29:34.954 "method": "bdev_nvme_attach_controller" 00:29:34.954 } 00:29:34.954 EOF 00:29:34.954 )") 00:29:34.954 19:17:54 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:34.954 19:17:54 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:34.954 19:17:54 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:34.954 19:17:54 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:34.954 19:17:54 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:34.954 19:17:54 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:34.954 19:17:54 -- target/dif.sh@82 -- # gen_fio_conf 00:29:34.954 19:17:54 -- common/autotest_common.sh@1330 -- # shift 00:29:34.954 19:17:54 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:34.954 19:17:54 -- target/dif.sh@54 -- # local file 00:29:34.954 19:17:54 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:34.954 19:17:54 -- target/dif.sh@56 -- # cat 00:29:34.954 19:17:54 -- nvmf/common.sh@542 -- # cat 00:29:34.954 19:17:54 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:34.954 19:17:54 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:34.954 19:17:54 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:34.954 19:17:54 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:34.954 19:17:54 -- target/dif.sh@72 -- # (( file <= files )) 00:29:34.954 19:17:54 -- target/dif.sh@73 -- # cat 00:29:34.954 19:17:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:34.954 19:17:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:34.954 { 00:29:34.954 "params": { 00:29:34.954 "name": "Nvme$subsystem", 00:29:34.954 "trtype": "$TEST_TRANSPORT", 00:29:34.954 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:34.954 "adrfam": "ipv4", 00:29:34.954 "trsvcid": "$NVMF_PORT", 00:29:34.954 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:34.954 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:34.954 "hdgst": ${hdgst:-false}, 00:29:34.954 "ddgst": ${ddgst:-false} 00:29:34.954 }, 00:29:34.954 "method": "bdev_nvme_attach_controller" 00:29:34.954 } 00:29:34.954 EOF 00:29:34.954 )") 00:29:34.954 19:17:54 -- nvmf/common.sh@542 -- # cat 00:29:34.954 19:17:54 -- target/dif.sh@72 -- # (( file++ )) 00:29:34.954 19:17:54 -- target/dif.sh@72 -- # (( file <= files )) 00:29:34.954 19:17:54 -- nvmf/common.sh@544 -- # jq . 00:29:34.954 19:17:54 -- nvmf/common.sh@545 -- # IFS=, 00:29:34.954 19:17:54 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:34.954 "params": { 00:29:34.954 "name": "Nvme0", 00:29:34.954 "trtype": "tcp", 00:29:34.954 "traddr": "10.0.0.2", 00:29:34.954 "adrfam": "ipv4", 00:29:34.954 "trsvcid": "4420", 00:29:34.954 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:34.954 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:34.954 "hdgst": false, 00:29:34.954 "ddgst": false 00:29:34.954 }, 00:29:34.954 "method": "bdev_nvme_attach_controller" 00:29:34.954 },{ 00:29:34.954 "params": { 00:29:34.954 "name": "Nvme1", 00:29:34.954 "trtype": "tcp", 00:29:34.954 "traddr": "10.0.0.2", 00:29:34.954 "adrfam": "ipv4", 00:29:34.955 "trsvcid": "4420", 00:29:34.955 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:34.955 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:34.955 "hdgst": false, 00:29:34.955 "ddgst": false 00:29:34.955 }, 00:29:34.955 "method": "bdev_nvme_attach_controller" 00:29:34.955 }' 00:29:34.955 19:17:54 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:34.955 19:17:54 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:34.955 19:17:54 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:34.955 19:17:54 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:34.955 19:17:54 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:34.955 19:17:54 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:34.955 19:17:54 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:34.955 19:17:54 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:34.955 19:17:54 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:34.955 19:17:54 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:34.955 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:29:34.955 ... 00:29:34.955 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:29:34.955 ... 00:29:34.955 fio-3.35 00:29:34.955 Starting 4 threads 00:29:34.955 EAL: No free 2048 kB hugepages reported on node 1 00:29:34.955 [2024-11-28 19:17:55.293646] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:34.955 [2024-11-28 19:17:55.293711] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:40.219 00:29:40.219 filename0: (groupid=0, jobs=1): err= 0: pid=343624: Thu Nov 28 19:18:00 2024 00:29:40.219 read: IOPS=1844, BW=14.4MiB/s (15.1MB/s)(72.1MiB/5005msec) 00:29:40.219 slat (nsec): min=3703, max=68490, avg=24163.62, stdev=9072.83 00:29:40.219 clat (usec): min=801, max=7842, avg=4248.37, stdev=401.68 00:29:40.219 lat (usec): min=820, max=7871, avg=4272.53, stdev=401.98 00:29:40.219 clat percentiles (usec): 00:29:40.219 | 1.00th=[ 3130], 5.00th=[ 3654], 10.00th=[ 3884], 20.00th=[ 4080], 00:29:40.219 | 30.00th=[ 4178], 40.00th=[ 4228], 50.00th=[ 4293], 60.00th=[ 4359], 00:29:40.219 | 70.00th=[ 4359], 80.00th=[ 4424], 90.00th=[ 4555], 95.00th=[ 4621], 00:29:40.219 | 99.00th=[ 5342], 99.50th=[ 6194], 99.90th=[ 7373], 99.95th=[ 7767], 00:29:40.219 | 99.99th=[ 7832] 00:29:40.219 bw ( KiB/s): min=14320, max=15744, per=25.17%, avg=14756.80, stdev=488.81, samples=10 00:29:40.219 iops : min= 1790, max= 1968, avg=1844.60, stdev=61.10, samples=10 00:29:40.219 lat (usec) : 1000=0.04% 00:29:40.219 lat (msec) : 2=0.25%, 4=14.98%, 10=84.72% 00:29:40.219 cpu : usr=96.20%, sys=3.24%, ctx=7, majf=0, minf=9 00:29:40.219 IO depths : 1=0.5%, 2=20.2%, 4=54.1%, 8=25.3%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:40.219 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:40.219 complete : 0=0.0%, 4=90.6%, 8=9.4%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:40.219 issued rwts: total=9230,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:40.219 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:40.219 filename0: (groupid=0, jobs=1): err= 0: pid=343625: Thu Nov 28 19:18:00 2024 00:29:40.219 read: IOPS=1814, BW=14.2MiB/s (14.9MB/s)(70.9MiB/5002msec) 00:29:40.219 slat (nsec): min=3701, max=70191, avg=23144.17, stdev=11088.55 00:29:40.219 clat (usec): min=727, max=8059, avg=4322.91, stdev=497.30 00:29:40.219 lat (usec): min=739, max=8070, avg=4346.05, stdev=496.86 00:29:40.219 clat percentiles (usec): 00:29:40.219 | 1.00th=[ 2835], 5.00th=[ 3818], 10.00th=[ 3982], 20.00th=[ 4146], 00:29:40.219 | 30.00th=[ 4228], 40.00th=[ 4228], 50.00th=[ 4293], 60.00th=[ 4359], 00:29:40.219 | 70.00th=[ 4424], 80.00th=[ 4490], 90.00th=[ 4621], 95.00th=[ 4948], 00:29:40.219 | 99.00th=[ 6325], 99.50th=[ 6849], 99.90th=[ 7701], 99.95th=[ 7832], 00:29:40.219 | 99.99th=[ 8029] 00:29:40.219 bw ( KiB/s): min=13616, max=15344, per=24.76%, avg=14514.80, stdev=433.90, samples=10 00:29:40.219 iops : min= 1702, max= 1918, avg=1814.30, stdev=54.25, samples=10 00:29:40.219 lat (usec) : 750=0.02%, 1000=0.10% 00:29:40.219 lat (msec) : 2=0.44%, 4=10.00%, 10=89.44% 00:29:40.219 cpu : usr=95.94%, sys=3.56%, ctx=12, majf=0, minf=9 00:29:40.219 IO depths : 1=0.1%, 2=17.8%, 4=55.4%, 8=26.7%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:40.219 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:40.219 complete : 0=0.0%, 4=91.6%, 8=8.4%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:40.219 issued rwts: total=9078,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:40.219 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:40.219 filename1: (groupid=0, jobs=1): err= 0: pid=343626: Thu Nov 28 19:18:00 2024 00:29:40.219 read: IOPS=1827, BW=14.3MiB/s (15.0MB/s)(71.4MiB/5003msec) 00:29:40.219 slat (nsec): min=3799, max=68420, avg=22612.73, stdev=11354.08 00:29:40.219 clat (usec): min=658, max=8281, avg=4295.28, stdev=466.27 00:29:40.219 lat (usec): min=670, max=8292, avg=4317.89, stdev=466.35 00:29:40.219 clat percentiles (usec): 00:29:40.219 | 1.00th=[ 2802], 5.00th=[ 3818], 10.00th=[ 3949], 20.00th=[ 4113], 00:29:40.219 | 30.00th=[ 4228], 40.00th=[ 4228], 50.00th=[ 4293], 60.00th=[ 4359], 00:29:40.219 | 70.00th=[ 4424], 80.00th=[ 4490], 90.00th=[ 4555], 95.00th=[ 4752], 00:29:40.219 | 99.00th=[ 6063], 99.50th=[ 6718], 99.90th=[ 7635], 99.95th=[ 7898], 00:29:40.219 | 99.99th=[ 8291] 00:29:40.219 bw ( KiB/s): min=14336, max=15216, per=24.93%, avg=14616.00, stdev=290.19, samples=10 00:29:40.219 iops : min= 1792, max= 1902, avg=1827.00, stdev=36.27, samples=10 00:29:40.219 lat (usec) : 750=0.01%, 1000=0.08% 00:29:40.219 lat (msec) : 2=0.45%, 4=12.23%, 10=87.24% 00:29:40.219 cpu : usr=95.96%, sys=3.56%, ctx=8, majf=0, minf=0 00:29:40.219 IO depths : 1=0.1%, 2=17.7%, 4=55.8%, 8=26.4%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:40.219 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:40.219 complete : 0=0.0%, 4=91.3%, 8=8.7%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:40.219 issued rwts: total=9143,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:40.219 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:40.219 filename1: (groupid=0, jobs=1): err= 0: pid=343627: Thu Nov 28 19:18:00 2024 00:29:40.219 read: IOPS=1842, BW=14.4MiB/s (15.1MB/s)(72.0MiB/5004msec) 00:29:40.219 slat (usec): min=3, max=271, avg=20.53, stdev=11.61 00:29:40.219 clat (usec): min=663, max=8726, avg=4270.69, stdev=393.11 00:29:40.219 lat (usec): min=680, max=8737, avg=4291.22, stdev=393.80 00:29:40.219 clat percentiles (usec): 00:29:40.219 | 1.00th=[ 3097], 5.00th=[ 3720], 10.00th=[ 3916], 20.00th=[ 4113], 00:29:40.220 | 30.00th=[ 4228], 40.00th=[ 4293], 50.00th=[ 4293], 60.00th=[ 4359], 00:29:40.220 | 70.00th=[ 4424], 80.00th=[ 4424], 90.00th=[ 4555], 95.00th=[ 4621], 00:29:40.220 | 99.00th=[ 5342], 99.50th=[ 5997], 99.90th=[ 7242], 99.95th=[ 7373], 00:29:40.220 | 99.99th=[ 8717] 00:29:40.220 bw ( KiB/s): min=14336, max=15456, per=25.15%, avg=14743.70, stdev=361.50, samples=10 00:29:40.220 iops : min= 1792, max= 1932, avg=1842.90, stdev=45.20, samples=10 00:29:40.220 lat (usec) : 750=0.01%, 1000=0.03% 00:29:40.220 lat (msec) : 2=0.23%, 4=13.44%, 10=86.29% 00:29:40.220 cpu : usr=95.94%, sys=3.60%, ctx=7, majf=0, minf=0 00:29:40.220 IO depths : 1=0.2%, 2=14.4%, 4=59.0%, 8=26.3%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:40.220 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:40.220 complete : 0=0.0%, 4=91.3%, 8=8.7%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:40.220 issued rwts: total=9221,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:40.220 latency : target=0, window=0, percentile=100.00%, depth=8 00:29:40.220 00:29:40.220 Run status group 0 (all jobs): 00:29:40.220 READ: bw=57.2MiB/s (60.0MB/s), 14.2MiB/s-14.4MiB/s (14.9MB/s-15.1MB/s), io=287MiB (300MB), run=5002-5005msec 00:29:40.220 19:18:00 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:29:40.220 19:18:00 -- target/dif.sh@43 -- # local sub 00:29:40.220 19:18:00 -- target/dif.sh@45 -- # for sub in "$@" 00:29:40.220 19:18:00 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:40.220 19:18:00 -- target/dif.sh@36 -- # local sub_id=0 00:29:40.220 19:18:00 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:40.220 19:18:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:40.220 19:18:00 -- common/autotest_common.sh@10 -- # set +x 00:29:40.220 19:18:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:40.220 19:18:00 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:40.220 19:18:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:40.220 19:18:00 -- common/autotest_common.sh@10 -- # set +x 00:29:40.220 19:18:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:40.220 19:18:00 -- target/dif.sh@45 -- # for sub in "$@" 00:29:40.220 19:18:00 -- target/dif.sh@46 -- # destroy_subsystem 1 00:29:40.220 19:18:00 -- target/dif.sh@36 -- # local sub_id=1 00:29:40.220 19:18:00 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:40.220 19:18:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:40.220 19:18:00 -- common/autotest_common.sh@10 -- # set +x 00:29:40.220 19:18:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:40.220 19:18:00 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:29:40.220 19:18:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:40.220 19:18:00 -- common/autotest_common.sh@10 -- # set +x 00:29:40.220 19:18:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:40.220 00:29:40.220 real 0m24.604s 00:29:40.220 user 4m38.403s 00:29:40.220 sys 0m5.421s 00:29:40.220 19:18:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:40.220 19:18:00 -- common/autotest_common.sh@10 -- # set +x 00:29:40.220 ************************************ 00:29:40.220 END TEST fio_dif_rand_params 00:29:40.220 ************************************ 00:29:40.220 19:18:00 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:29:40.220 19:18:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:40.220 19:18:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:40.220 19:18:00 -- common/autotest_common.sh@10 -- # set +x 00:29:40.220 ************************************ 00:29:40.220 START TEST fio_dif_digest 00:29:40.220 ************************************ 00:29:40.220 19:18:00 -- common/autotest_common.sh@1114 -- # fio_dif_digest 00:29:40.220 19:18:00 -- target/dif.sh@123 -- # local NULL_DIF 00:29:40.220 19:18:00 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:29:40.220 19:18:00 -- target/dif.sh@125 -- # local hdgst ddgst 00:29:40.220 19:18:00 -- target/dif.sh@127 -- # NULL_DIF=3 00:29:40.220 19:18:00 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:29:40.220 19:18:00 -- target/dif.sh@127 -- # numjobs=3 00:29:40.220 19:18:00 -- target/dif.sh@127 -- # iodepth=3 00:29:40.220 19:18:00 -- target/dif.sh@127 -- # runtime=10 00:29:40.220 19:18:00 -- target/dif.sh@128 -- # hdgst=true 00:29:40.220 19:18:00 -- target/dif.sh@128 -- # ddgst=true 00:29:40.220 19:18:00 -- target/dif.sh@130 -- # create_subsystems 0 00:29:40.220 19:18:00 -- target/dif.sh@28 -- # local sub 00:29:40.220 19:18:00 -- target/dif.sh@30 -- # for sub in "$@" 00:29:40.220 19:18:00 -- target/dif.sh@31 -- # create_subsystem 0 00:29:40.220 19:18:00 -- target/dif.sh@18 -- # local sub_id=0 00:29:40.220 19:18:00 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:29:40.220 19:18:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:40.220 19:18:00 -- common/autotest_common.sh@10 -- # set +x 00:29:40.220 bdev_null0 00:29:40.220 19:18:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:40.220 19:18:00 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:29:40.220 19:18:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:40.220 19:18:00 -- common/autotest_common.sh@10 -- # set +x 00:29:40.220 19:18:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:40.220 19:18:00 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:29:40.220 19:18:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:40.220 19:18:00 -- common/autotest_common.sh@10 -- # set +x 00:29:40.220 19:18:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:40.220 19:18:00 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:40.220 19:18:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:40.220 19:18:00 -- common/autotest_common.sh@10 -- # set +x 00:29:40.220 [2024-11-28 19:18:00.726112] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:40.220 19:18:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:40.220 19:18:00 -- target/dif.sh@131 -- # fio /dev/fd/62 00:29:40.220 19:18:00 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:29:40.220 19:18:00 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:29:40.220 19:18:00 -- nvmf/common.sh@520 -- # config=() 00:29:40.220 19:18:00 -- nvmf/common.sh@520 -- # local subsystem config 00:29:40.220 19:18:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:40.220 19:18:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:40.220 { 00:29:40.220 "params": { 00:29:40.220 "name": "Nvme$subsystem", 00:29:40.220 "trtype": "$TEST_TRANSPORT", 00:29:40.220 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:40.220 "adrfam": "ipv4", 00:29:40.220 "trsvcid": "$NVMF_PORT", 00:29:40.220 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:40.220 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:40.220 "hdgst": ${hdgst:-false}, 00:29:40.220 "ddgst": ${ddgst:-false} 00:29:40.220 }, 00:29:40.220 "method": "bdev_nvme_attach_controller" 00:29:40.220 } 00:29:40.220 EOF 00:29:40.220 )") 00:29:40.220 19:18:00 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:40.220 19:18:00 -- target/dif.sh@82 -- # gen_fio_conf 00:29:40.220 19:18:00 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:40.220 19:18:00 -- target/dif.sh@54 -- # local file 00:29:40.220 19:18:00 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:29:40.220 19:18:00 -- target/dif.sh@56 -- # cat 00:29:40.220 19:18:00 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:29:40.220 19:18:00 -- common/autotest_common.sh@1328 -- # local sanitizers 00:29:40.220 19:18:00 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:40.220 19:18:00 -- common/autotest_common.sh@1330 -- # shift 00:29:40.220 19:18:00 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:29:40.220 19:18:00 -- nvmf/common.sh@542 -- # cat 00:29:40.220 19:18:00 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:40.220 19:18:00 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:40.220 19:18:00 -- target/dif.sh@72 -- # (( file = 1 )) 00:29:40.220 19:18:00 -- target/dif.sh@72 -- # (( file <= files )) 00:29:40.220 19:18:00 -- common/autotest_common.sh@1334 -- # grep libasan 00:29:40.220 19:18:00 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:40.220 19:18:00 -- nvmf/common.sh@544 -- # jq . 00:29:40.220 19:18:00 -- nvmf/common.sh@545 -- # IFS=, 00:29:40.220 19:18:00 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:40.220 "params": { 00:29:40.221 "name": "Nvme0", 00:29:40.221 "trtype": "tcp", 00:29:40.221 "traddr": "10.0.0.2", 00:29:40.221 "adrfam": "ipv4", 00:29:40.221 "trsvcid": "4420", 00:29:40.221 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:29:40.221 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:29:40.221 "hdgst": true, 00:29:40.221 "ddgst": true 00:29:40.221 }, 00:29:40.221 "method": "bdev_nvme_attach_controller" 00:29:40.221 }' 00:29:40.221 19:18:00 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:40.221 19:18:00 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:40.221 19:18:00 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:29:40.221 19:18:00 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:29:40.221 19:18:00 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:29:40.221 19:18:00 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:29:40.221 19:18:00 -- common/autotest_common.sh@1334 -- # asan_lib= 00:29:40.221 19:18:00 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:29:40.221 19:18:00 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:29:40.221 19:18:00 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:29:40.221 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:29:40.221 ... 00:29:40.221 fio-3.35 00:29:40.221 Starting 3 threads 00:29:40.221 EAL: No free 2048 kB hugepages reported on node 1 00:29:40.478 [2024-11-28 19:18:01.487488] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:29:40.478 [2024-11-28 19:18:01.487560] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:29:52.671 00:29:52.671 filename0: (groupid=0, jobs=1): err= 0: pid=344491: Thu Nov 28 19:18:11 2024 00:29:52.671 read: IOPS=198, BW=24.8MiB/s (26.0MB/s)(249MiB/10046msec) 00:29:52.672 slat (nsec): min=7331, max=36586, avg=12549.47, stdev=1947.30 00:29:52.672 clat (usec): min=8566, max=49210, avg=15101.70, stdev=1496.76 00:29:52.672 lat (usec): min=8580, max=49218, avg=15114.25, stdev=1496.67 00:29:52.672 clat percentiles (usec): 00:29:52.672 | 1.00th=[12780], 5.00th=[13435], 10.00th=[13698], 20.00th=[14222], 00:29:52.672 | 30.00th=[14484], 40.00th=[14746], 50.00th=[15139], 60.00th=[15401], 00:29:52.672 | 70.00th=[15533], 80.00th=[15926], 90.00th=[16450], 95.00th=[16909], 00:29:52.672 | 99.00th=[17695], 99.50th=[18220], 99.90th=[47449], 99.95th=[49021], 00:29:52.672 | 99.99th=[49021] 00:29:52.672 bw ( KiB/s): min=24320, max=26624, per=32.84%, avg=25449.00, stdev=660.04, samples=20 00:29:52.672 iops : min= 190, max= 208, avg=198.80, stdev= 5.13, samples=20 00:29:52.672 lat (msec) : 10=0.05%, 20=99.85%, 50=0.10% 00:29:52.672 cpu : usr=93.53%, sys=5.98%, ctx=19, majf=0, minf=156 00:29:52.672 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:52.672 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:52.672 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:52.672 issued rwts: total=1991,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:52.672 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:52.672 filename0: (groupid=0, jobs=1): err= 0: pid=344492: Thu Nov 28 19:18:11 2024 00:29:52.672 read: IOPS=197, BW=24.7MiB/s (25.9MB/s)(248MiB/10045msec) 00:29:52.672 slat (nsec): min=7137, max=54183, avg=12966.08, stdev=2169.60 00:29:52.672 clat (usec): min=11231, max=52327, avg=15144.25, stdev=1597.99 00:29:52.672 lat (usec): min=11245, max=52339, avg=15157.22, stdev=1597.97 00:29:52.672 clat percentiles (usec): 00:29:52.672 | 1.00th=[12649], 5.00th=[13304], 10.00th=[13698], 20.00th=[14222], 00:29:52.672 | 30.00th=[14484], 40.00th=[14877], 50.00th=[15139], 60.00th=[15401], 00:29:52.672 | 70.00th=[15664], 80.00th=[16057], 90.00th=[16450], 95.00th=[16909], 00:29:52.672 | 99.00th=[17957], 99.50th=[18482], 99.90th=[50594], 99.95th=[52167], 00:29:52.672 | 99.99th=[52167] 00:29:52.672 bw ( KiB/s): min=24320, max=26880, per=32.73%, avg=25369.60, stdev=787.51, samples=20 00:29:52.672 iops : min= 190, max= 210, avg=198.20, stdev= 6.15, samples=20 00:29:52.672 lat (msec) : 20=99.85%, 50=0.05%, 100=0.10% 00:29:52.672 cpu : usr=93.24%, sys=6.26%, ctx=25, majf=0, minf=142 00:29:52.672 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:52.672 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:52.672 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:52.672 issued rwts: total=1985,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:52.672 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:52.672 filename0: (groupid=0, jobs=1): err= 0: pid=344493: Thu Nov 28 19:18:11 2024 00:29:52.672 read: IOPS=209, BW=26.2MiB/s (27.5MB/s)(264MiB/10048msec) 00:29:52.672 slat (nsec): min=4352, max=74033, avg=12957.13, stdev=2470.46 00:29:52.672 clat (usec): min=10557, max=56751, avg=14262.80, stdev=1615.48 00:29:52.672 lat (usec): min=10570, max=56764, avg=14275.76, stdev=1615.57 00:29:52.672 clat percentiles (usec): 00:29:52.672 | 1.00th=[11863], 5.00th=[12518], 10.00th=[12911], 20.00th=[13304], 00:29:52.672 | 30.00th=[13698], 40.00th=[13960], 50.00th=[14222], 60.00th=[14484], 00:29:52.672 | 70.00th=[14746], 80.00th=[15139], 90.00th=[15533], 95.00th=[16057], 00:29:52.672 | 99.00th=[16909], 99.50th=[17433], 99.90th=[19006], 99.95th=[49021], 00:29:52.672 | 99.99th=[56886] 00:29:52.672 bw ( KiB/s): min=25856, max=28160, per=34.76%, avg=26944.00, stdev=838.32, samples=20 00:29:52.672 iops : min= 202, max= 220, avg=210.50, stdev= 6.55, samples=20 00:29:52.672 lat (msec) : 20=99.91%, 50=0.05%, 100=0.05% 00:29:52.672 cpu : usr=93.47%, sys=5.98%, ctx=14, majf=0, minf=153 00:29:52.672 IO depths : 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:29:52.672 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:52.672 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:29:52.672 issued rwts: total=2108,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:29:52.672 latency : target=0, window=0, percentile=100.00%, depth=3 00:29:52.672 00:29:52.672 Run status group 0 (all jobs): 00:29:52.672 READ: bw=75.7MiB/s (79.4MB/s), 24.7MiB/s-26.2MiB/s (25.9MB/s-27.5MB/s), io=761MiB (797MB), run=10045-10048msec 00:29:52.672 19:18:11 -- target/dif.sh@132 -- # destroy_subsystems 0 00:29:52.672 19:18:11 -- target/dif.sh@43 -- # local sub 00:29:52.672 19:18:11 -- target/dif.sh@45 -- # for sub in "$@" 00:29:52.672 19:18:11 -- target/dif.sh@46 -- # destroy_subsystem 0 00:29:52.672 19:18:11 -- target/dif.sh@36 -- # local sub_id=0 00:29:52.672 19:18:11 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:29:52.672 19:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:52.672 19:18:11 -- common/autotest_common.sh@10 -- # set +x 00:29:52.672 19:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:52.672 19:18:11 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:29:52.672 19:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:52.672 19:18:11 -- common/autotest_common.sh@10 -- # set +x 00:29:52.672 19:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:52.672 00:29:52.672 real 0m11.187s 00:29:52.672 user 0m29.309s 00:29:52.672 sys 0m2.074s 00:29:52.672 19:18:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:52.672 19:18:11 -- common/autotest_common.sh@10 -- # set +x 00:29:52.672 ************************************ 00:29:52.672 END TEST fio_dif_digest 00:29:52.672 ************************************ 00:29:52.672 19:18:11 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:29:52.672 19:18:11 -- target/dif.sh@147 -- # nvmftestfini 00:29:52.672 19:18:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:52.672 19:18:11 -- nvmf/common.sh@116 -- # sync 00:29:52.672 19:18:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:52.672 19:18:11 -- nvmf/common.sh@119 -- # set +e 00:29:52.672 19:18:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:52.672 19:18:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:52.672 rmmod nvme_tcp 00:29:52.672 rmmod nvme_fabrics 00:29:52.672 rmmod nvme_keyring 00:29:52.672 19:18:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:52.672 19:18:11 -- nvmf/common.sh@123 -- # set -e 00:29:52.672 19:18:11 -- nvmf/common.sh@124 -- # return 0 00:29:52.672 19:18:11 -- nvmf/common.sh@477 -- # '[' -n 337917 ']' 00:29:52.672 19:18:11 -- nvmf/common.sh@478 -- # killprocess 337917 00:29:52.672 19:18:11 -- common/autotest_common.sh@936 -- # '[' -z 337917 ']' 00:29:52.672 19:18:11 -- common/autotest_common.sh@940 -- # kill -0 337917 00:29:52.672 19:18:11 -- common/autotest_common.sh@941 -- # uname 00:29:52.672 19:18:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:52.672 19:18:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 337917 00:29:52.672 19:18:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:52.672 19:18:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:52.672 19:18:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 337917' 00:29:52.672 killing process with pid 337917 00:29:52.672 19:18:12 -- common/autotest_common.sh@955 -- # kill 337917 00:29:52.672 19:18:12 -- common/autotest_common.sh@960 -- # wait 337917 00:29:52.672 19:18:12 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:29:52.672 19:18:12 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:29:52.672 Waiting for block devices as requested 00:29:52.672 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:29:52.672 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:52.672 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:52.672 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:52.932 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:52.932 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:52.932 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:52.932 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:52.932 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:53.193 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:29:53.193 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:29:53.193 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:29:53.193 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:29:53.454 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:29:53.454 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:29:53.454 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:29:53.454 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:29:53.715 19:18:14 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:53.715 19:18:14 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:53.715 19:18:14 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:53.715 19:18:14 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:53.715 19:18:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:53.715 19:18:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:53.715 19:18:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:55.626 19:18:16 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:55.626 00:29:55.626 real 1m7.773s 00:29:55.626 user 6m37.047s 00:29:55.626 sys 0m16.114s 00:29:55.626 19:18:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:55.626 19:18:16 -- common/autotest_common.sh@10 -- # set +x 00:29:55.626 ************************************ 00:29:55.626 END TEST nvmf_dif 00:29:55.626 ************************************ 00:29:55.626 19:18:16 -- spdk/autotest.sh@288 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:55.626 19:18:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:55.626 19:18:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:55.626 19:18:16 -- common/autotest_common.sh@10 -- # set +x 00:29:55.885 ************************************ 00:29:55.885 START TEST nvmf_abort_qd_sizes 00:29:55.885 ************************************ 00:29:55.885 19:18:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:29:55.885 * Looking for test storage... 00:29:55.885 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:29:55.885 19:18:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:55.885 19:18:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:55.885 19:18:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:55.885 19:18:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:55.885 19:18:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:55.885 19:18:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:55.885 19:18:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:55.885 19:18:16 -- scripts/common.sh@335 -- # IFS=.-: 00:29:55.885 19:18:16 -- scripts/common.sh@335 -- # read -ra ver1 00:29:55.885 19:18:16 -- scripts/common.sh@336 -- # IFS=.-: 00:29:55.885 19:18:16 -- scripts/common.sh@336 -- # read -ra ver2 00:29:55.885 19:18:16 -- scripts/common.sh@337 -- # local 'op=<' 00:29:55.885 19:18:16 -- scripts/common.sh@339 -- # ver1_l=2 00:29:55.885 19:18:16 -- scripts/common.sh@340 -- # ver2_l=1 00:29:55.885 19:18:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:55.885 19:18:16 -- scripts/common.sh@343 -- # case "$op" in 00:29:55.885 19:18:16 -- scripts/common.sh@344 -- # : 1 00:29:55.885 19:18:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:55.885 19:18:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:55.885 19:18:16 -- scripts/common.sh@364 -- # decimal 1 00:29:55.885 19:18:16 -- scripts/common.sh@352 -- # local d=1 00:29:55.885 19:18:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:55.885 19:18:16 -- scripts/common.sh@354 -- # echo 1 00:29:55.885 19:18:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:55.885 19:18:16 -- scripts/common.sh@365 -- # decimal 2 00:29:55.885 19:18:16 -- scripts/common.sh@352 -- # local d=2 00:29:55.885 19:18:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:55.885 19:18:16 -- scripts/common.sh@354 -- # echo 2 00:29:55.885 19:18:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:55.885 19:18:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:55.885 19:18:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:55.885 19:18:16 -- scripts/common.sh@367 -- # return 0 00:29:55.885 19:18:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:55.885 19:18:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:55.885 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:55.885 --rc genhtml_branch_coverage=1 00:29:55.885 --rc genhtml_function_coverage=1 00:29:55.885 --rc genhtml_legend=1 00:29:55.885 --rc geninfo_all_blocks=1 00:29:55.885 --rc geninfo_unexecuted_blocks=1 00:29:55.885 00:29:55.885 ' 00:29:55.885 19:18:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:55.885 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:55.885 --rc genhtml_branch_coverage=1 00:29:55.885 --rc genhtml_function_coverage=1 00:29:55.885 --rc genhtml_legend=1 00:29:55.885 --rc geninfo_all_blocks=1 00:29:55.885 --rc geninfo_unexecuted_blocks=1 00:29:55.885 00:29:55.885 ' 00:29:55.885 19:18:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:55.885 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:55.885 --rc genhtml_branch_coverage=1 00:29:55.885 --rc genhtml_function_coverage=1 00:29:55.885 --rc genhtml_legend=1 00:29:55.885 --rc geninfo_all_blocks=1 00:29:55.885 --rc geninfo_unexecuted_blocks=1 00:29:55.885 00:29:55.885 ' 00:29:55.885 19:18:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:55.885 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:55.885 --rc genhtml_branch_coverage=1 00:29:55.885 --rc genhtml_function_coverage=1 00:29:55.885 --rc genhtml_legend=1 00:29:55.885 --rc geninfo_all_blocks=1 00:29:55.885 --rc geninfo_unexecuted_blocks=1 00:29:55.885 00:29:55.885 ' 00:29:55.885 19:18:16 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:55.885 19:18:16 -- nvmf/common.sh@7 -- # uname -s 00:29:55.885 19:18:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:55.885 19:18:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:55.885 19:18:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:55.885 19:18:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:55.885 19:18:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:55.885 19:18:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:55.885 19:18:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:55.885 19:18:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:55.885 19:18:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:55.885 19:18:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:55.885 19:18:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:55.885 19:18:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:55.885 19:18:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:55.885 19:18:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:55.885 19:18:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:55.885 19:18:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:55.885 19:18:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:55.885 19:18:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:55.885 19:18:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:55.885 19:18:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:55.885 19:18:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:55.885 19:18:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:55.885 19:18:16 -- paths/export.sh@5 -- # export PATH 00:29:55.885 19:18:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:55.885 19:18:16 -- nvmf/common.sh@46 -- # : 0 00:29:55.885 19:18:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:55.885 19:18:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:55.885 19:18:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:55.885 19:18:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:55.885 19:18:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:55.885 19:18:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:55.885 19:18:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:55.885 19:18:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:55.885 19:18:16 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:29:55.885 19:18:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:55.885 19:18:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:55.885 19:18:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:55.885 19:18:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:55.885 19:18:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:55.885 19:18:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:55.885 19:18:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:29:55.885 19:18:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:55.885 19:18:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:55.885 19:18:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:55.885 19:18:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:55.885 19:18:16 -- common/autotest_common.sh@10 -- # set +x 00:29:58.421 19:18:18 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:58.421 19:18:18 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:58.421 19:18:18 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:58.421 19:18:18 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:58.421 19:18:18 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:58.421 19:18:18 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:58.421 19:18:18 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:58.421 19:18:18 -- nvmf/common.sh@294 -- # net_devs=() 00:29:58.421 19:18:18 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:58.421 19:18:18 -- nvmf/common.sh@295 -- # e810=() 00:29:58.421 19:18:18 -- nvmf/common.sh@295 -- # local -ga e810 00:29:58.421 19:18:18 -- nvmf/common.sh@296 -- # x722=() 00:29:58.421 19:18:18 -- nvmf/common.sh@296 -- # local -ga x722 00:29:58.421 19:18:18 -- nvmf/common.sh@297 -- # mlx=() 00:29:58.421 19:18:18 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:58.421 19:18:18 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:58.421 19:18:18 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:58.421 19:18:18 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:58.421 19:18:18 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:58.421 19:18:18 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:58.421 19:18:18 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:58.421 19:18:18 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:58.421 19:18:18 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:58.421 19:18:18 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:58.421 19:18:18 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:58.421 19:18:18 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:58.421 19:18:18 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:58.421 19:18:18 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:58.421 19:18:18 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:58.421 19:18:18 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:58.421 19:18:18 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:58.421 19:18:18 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:58.421 19:18:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:58.421 19:18:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:58.421 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:58.421 19:18:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:58.421 19:18:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:58.421 19:18:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:58.421 19:18:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:58.421 19:18:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:58.421 19:18:18 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:58.421 19:18:18 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:58.421 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:58.421 19:18:18 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:58.421 19:18:18 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:58.421 19:18:18 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:58.421 19:18:18 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:58.421 19:18:18 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:58.421 19:18:18 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:58.421 19:18:18 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:58.421 19:18:18 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:58.421 19:18:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:58.421 19:18:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:58.421 19:18:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:58.421 19:18:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:58.421 19:18:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:58.421 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:58.421 19:18:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:58.421 19:18:18 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:58.422 19:18:18 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:58.422 19:18:18 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:58.422 19:18:18 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:58.422 19:18:18 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:58.422 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:58.422 19:18:18 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:58.422 19:18:18 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:58.422 19:18:18 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:58.422 19:18:18 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:58.422 19:18:18 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:58.422 19:18:18 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:58.422 19:18:18 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:58.422 19:18:18 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:58.422 19:18:18 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:58.422 19:18:18 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:58.422 19:18:18 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:58.422 19:18:18 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:58.422 19:18:18 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:58.422 19:18:18 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:58.422 19:18:18 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:58.422 19:18:18 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:58.422 19:18:18 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:58.422 19:18:18 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:58.422 19:18:18 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:58.422 19:18:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:58.422 19:18:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:58.422 19:18:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:58.422 19:18:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:58.422 19:18:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:58.422 19:18:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:58.422 19:18:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:58.422 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:58.422 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.158 ms 00:29:58.422 00:29:58.422 --- 10.0.0.2 ping statistics --- 00:29:58.422 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:58.422 rtt min/avg/max/mdev = 0.158/0.158/0.158/0.000 ms 00:29:58.422 19:18:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:58.422 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:58.422 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.098 ms 00:29:58.422 00:29:58.422 --- 10.0.0.1 ping statistics --- 00:29:58.422 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:58.422 rtt min/avg/max/mdev = 0.098/0.098/0.098/0.000 ms 00:29:58.422 19:18:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:58.422 19:18:18 -- nvmf/common.sh@410 -- # return 0 00:29:58.422 19:18:18 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:29:58.422 19:18:18 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:29:59.357 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:59.357 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:59.357 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:59.357 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:59.357 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:59.357 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:59.357 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:59.357 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:29:59.357 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:29:59.357 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:29:59.357 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:29:59.357 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:29:59.357 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:29:59.357 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:29:59.357 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:29:59.357 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:30:00.293 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:30:00.293 19:18:21 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:00.293 19:18:21 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:00.293 19:18:21 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:00.293 19:18:21 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:00.293 19:18:21 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:00.293 19:18:21 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:00.293 19:18:21 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:30:00.293 19:18:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:00.293 19:18:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:00.293 19:18:21 -- common/autotest_common.sh@10 -- # set +x 00:30:00.293 19:18:21 -- nvmf/common.sh@469 -- # nvmfpid=350046 00:30:00.293 19:18:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:30:00.293 19:18:21 -- nvmf/common.sh@470 -- # waitforlisten 350046 00:30:00.293 19:18:21 -- common/autotest_common.sh@829 -- # '[' -z 350046 ']' 00:30:00.293 19:18:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:00.293 19:18:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:00.293 19:18:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:00.293 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:00.293 19:18:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:00.293 19:18:21 -- common/autotest_common.sh@10 -- # set +x 00:30:00.552 [2024-11-28 19:18:21.344717] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:00.552 [2024-11-28 19:18:21.344782] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:00.552 EAL: No free 2048 kB hugepages reported on node 1 00:30:00.552 [2024-11-28 19:18:21.409834] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:00.552 [2024-11-28 19:18:21.517671] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:00.552 [2024-11-28 19:18:21.517827] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:00.552 [2024-11-28 19:18:21.517849] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:00.552 [2024-11-28 19:18:21.517862] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:00.552 [2024-11-28 19:18:21.518036] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:00.552 [2024-11-28 19:18:21.518092] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:00.552 [2024-11-28 19:18:21.518158] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:00.552 [2024-11-28 19:18:21.518160] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:01.490 19:18:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:01.490 19:18:22 -- common/autotest_common.sh@862 -- # return 0 00:30:01.490 19:18:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:01.490 19:18:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:01.490 19:18:22 -- common/autotest_common.sh@10 -- # set +x 00:30:01.490 19:18:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:01.490 19:18:22 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:30:01.490 19:18:22 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:30:01.490 19:18:22 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:30:01.490 19:18:22 -- scripts/common.sh@311 -- # local bdf bdfs 00:30:01.490 19:18:22 -- scripts/common.sh@312 -- # local nvmes 00:30:01.490 19:18:22 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:30:01.490 19:18:22 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:30:01.490 19:18:22 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:30:01.490 19:18:22 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:30:01.491 19:18:22 -- scripts/common.sh@322 -- # uname -s 00:30:01.491 19:18:22 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:30:01.491 19:18:22 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:30:01.491 19:18:22 -- scripts/common.sh@327 -- # (( 1 )) 00:30:01.491 19:18:22 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:30:01.491 19:18:22 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:30:01.491 19:18:22 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:30:01.491 19:18:22 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:30:01.491 19:18:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:01.491 19:18:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:01.491 19:18:22 -- common/autotest_common.sh@10 -- # set +x 00:30:01.491 ************************************ 00:30:01.491 START TEST spdk_target_abort 00:30:01.491 ************************************ 00:30:01.491 19:18:22 -- common/autotest_common.sh@1114 -- # spdk_target 00:30:01.491 19:18:22 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:30:01.491 19:18:22 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:30:01.491 19:18:22 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:30:01.491 19:18:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:01.491 19:18:22 -- common/autotest_common.sh@10 -- # set +x 00:30:04.775 spdk_targetn1 00:30:04.775 19:18:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:04.775 19:18:25 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:04.775 19:18:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:04.775 19:18:25 -- common/autotest_common.sh@10 -- # set +x 00:30:04.775 [2024-11-28 19:18:25.200073] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:04.775 19:18:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:04.775 19:18:25 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:30:04.775 19:18:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:04.775 19:18:25 -- common/autotest_common.sh@10 -- # set +x 00:30:04.775 19:18:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:04.775 19:18:25 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:30:04.775 19:18:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:04.775 19:18:25 -- common/autotest_common.sh@10 -- # set +x 00:30:04.775 19:18:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:04.775 19:18:25 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:30:04.775 19:18:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:04.775 19:18:25 -- common/autotest_common.sh@10 -- # set +x 00:30:04.775 [2024-11-28 19:18:25.232353] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:04.775 19:18:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:04.775 19:18:25 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:30:04.775 19:18:25 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:30:04.775 19:18:25 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:30:04.775 19:18:25 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:30:04.775 19:18:25 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:30:04.775 19:18:25 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:30:04.775 19:18:25 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:30:04.775 19:18:25 -- target/abort_qd_sizes.sh@24 -- # local target r 00:30:04.775 19:18:25 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:30:04.775 19:18:25 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:04.775 19:18:25 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:30:04.775 19:18:25 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:04.775 19:18:25 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:30:04.775 19:18:25 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:04.775 19:18:25 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:30:04.775 19:18:25 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:04.775 19:18:25 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:04.775 19:18:25 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:04.775 19:18:25 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:30:04.775 19:18:25 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:04.775 19:18:25 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:30:04.775 EAL: No free 2048 kB hugepages reported on node 1 00:30:08.061 Initializing NVMe Controllers 00:30:08.061 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:30:08.061 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:30:08.061 Initialization complete. Launching workers. 00:30:08.061 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 13410, failed: 0 00:30:08.061 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1250, failed to submit 12160 00:30:08.061 success 737, unsuccess 513, failed 0 00:30:08.061 19:18:28 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:08.061 19:18:28 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:30:08.061 EAL: No free 2048 kB hugepages reported on node 1 00:30:11.353 [2024-11-28 19:18:31.744456] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20575e0 is same with the state(5) to be set 00:30:11.353 [2024-11-28 19:18:31.744528] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20575e0 is same with the state(5) to be set 00:30:11.353 [2024-11-28 19:18:31.744545] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20575e0 is same with the state(5) to be set 00:30:11.353 [2024-11-28 19:18:31.744558] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20575e0 is same with the state(5) to be set 00:30:11.354 [2024-11-28 19:18:31.744570] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20575e0 is same with the state(5) to be set 00:30:11.354 [2024-11-28 19:18:31.744582] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20575e0 is same with the state(5) to be set 00:30:11.354 [2024-11-28 19:18:31.744603] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20575e0 is same with the state(5) to be set 00:30:11.354 [2024-11-28 19:18:31.744616] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20575e0 is same with the state(5) to be set 00:30:11.354 [2024-11-28 19:18:31.744628] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20575e0 is same with the state(5) to be set 00:30:11.354 [2024-11-28 19:18:31.744640] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20575e0 is same with the state(5) to be set 00:30:11.354 [2024-11-28 19:18:31.744651] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20575e0 is same with the state(5) to be set 00:30:11.354 [2024-11-28 19:18:31.744664] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20575e0 is same with the state(5) to be set 00:30:11.354 [2024-11-28 19:18:31.744676] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20575e0 is same with the state(5) to be set 00:30:11.354 [2024-11-28 19:18:31.744703] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20575e0 is same with the state(5) to be set 00:30:11.354 [2024-11-28 19:18:31.744715] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20575e0 is same with the state(5) to be set 00:30:11.354 [2024-11-28 19:18:31.744726] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20575e0 is same with the state(5) to be set 00:30:11.354 Initializing NVMe Controllers 00:30:11.354 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:30:11.354 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:30:11.354 Initialization complete. Launching workers. 00:30:11.354 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8524, failed: 0 00:30:11.354 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1226, failed to submit 7298 00:30:11.354 success 338, unsuccess 888, failed 0 00:30:11.354 19:18:31 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:11.354 19:18:31 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:30:11.354 EAL: No free 2048 kB hugepages reported on node 1 00:30:14.646 Initializing NVMe Controllers 00:30:14.646 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:30:14.646 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:30:14.646 Initialization complete. Launching workers. 00:30:14.646 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 31999, failed: 0 00:30:14.646 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2673, failed to submit 29326 00:30:14.646 success 557, unsuccess 2116, failed 0 00:30:14.646 19:18:34 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:30:14.646 19:18:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:14.646 19:18:34 -- common/autotest_common.sh@10 -- # set +x 00:30:14.646 19:18:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:14.646 19:18:34 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:30:14.646 19:18:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:14.646 19:18:34 -- common/autotest_common.sh@10 -- # set +x 00:30:15.580 19:18:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:15.580 19:18:36 -- target/abort_qd_sizes.sh@62 -- # killprocess 350046 00:30:15.580 19:18:36 -- common/autotest_common.sh@936 -- # '[' -z 350046 ']' 00:30:15.580 19:18:36 -- common/autotest_common.sh@940 -- # kill -0 350046 00:30:15.580 19:18:36 -- common/autotest_common.sh@941 -- # uname 00:30:15.580 19:18:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:15.580 19:18:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 350046 00:30:15.580 19:18:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:15.580 19:18:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:15.580 19:18:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 350046' 00:30:15.580 killing process with pid 350046 00:30:15.580 19:18:36 -- common/autotest_common.sh@955 -- # kill 350046 00:30:15.580 19:18:36 -- common/autotest_common.sh@960 -- # wait 350046 00:30:15.580 00:30:15.580 real 0m14.262s 00:30:15.580 user 0m56.562s 00:30:15.580 sys 0m2.549s 00:30:15.580 19:18:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:15.580 19:18:36 -- common/autotest_common.sh@10 -- # set +x 00:30:15.580 ************************************ 00:30:15.580 END TEST spdk_target_abort 00:30:15.580 ************************************ 00:30:15.840 19:18:36 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:30:15.840 19:18:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:15.840 19:18:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:15.840 19:18:36 -- common/autotest_common.sh@10 -- # set +x 00:30:15.840 ************************************ 00:30:15.840 START TEST kernel_target_abort 00:30:15.840 ************************************ 00:30:15.840 19:18:36 -- common/autotest_common.sh@1114 -- # kernel_target 00:30:15.840 19:18:36 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:30:15.840 19:18:36 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:30:15.840 19:18:36 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:30:15.840 19:18:36 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:30:15.840 19:18:36 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:30:15.840 19:18:36 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:15.840 19:18:36 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:30:15.840 19:18:36 -- nvmf/common.sh@627 -- # local block nvme 00:30:15.840 19:18:36 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:30:15.840 19:18:36 -- nvmf/common.sh@630 -- # modprobe nvmet 00:30:15.840 19:18:36 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:30:15.840 19:18:36 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:30:16.780 Waiting for block devices as requested 00:30:16.780 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:30:17.039 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:30:17.039 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:30:17.039 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:30:17.299 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:30:17.299 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:30:17.299 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:30:17.299 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:30:17.299 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:30:17.558 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:30:17.558 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:30:17.558 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:30:17.817 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:30:17.817 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:30:17.817 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:30:17.817 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:30:18.074 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:30:18.074 19:18:39 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:30:18.074 19:18:39 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:30:18.074 19:18:39 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:30:18.074 19:18:39 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:30:18.074 19:18:39 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:30:18.074 No valid GPT data, bailing 00:30:18.074 19:18:39 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:30:18.074 19:18:39 -- scripts/common.sh@393 -- # pt= 00:30:18.075 19:18:39 -- scripts/common.sh@394 -- # return 1 00:30:18.075 19:18:39 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:30:18.075 19:18:39 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:30:18.075 19:18:39 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:30:18.075 19:18:39 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:18.075 19:18:39 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:30:18.075 19:18:39 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:30:18.075 19:18:39 -- nvmf/common.sh@654 -- # echo 1 00:30:18.075 19:18:39 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:30:18.075 19:18:39 -- nvmf/common.sh@656 -- # echo 1 00:30:18.075 19:18:39 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:30:18.075 19:18:39 -- nvmf/common.sh@663 -- # echo tcp 00:30:18.075 19:18:39 -- nvmf/common.sh@664 -- # echo 4420 00:30:18.075 19:18:39 -- nvmf/common.sh@665 -- # echo ipv4 00:30:18.075 19:18:39 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:30:18.333 19:18:39 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:30:18.333 00:30:18.333 Discovery Log Number of Records 2, Generation counter 2 00:30:18.333 =====Discovery Log Entry 0====== 00:30:18.333 trtype: tcp 00:30:18.333 adrfam: ipv4 00:30:18.333 subtype: current discovery subsystem 00:30:18.333 treq: not specified, sq flow control disable supported 00:30:18.333 portid: 1 00:30:18.333 trsvcid: 4420 00:30:18.333 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:30:18.333 traddr: 10.0.0.1 00:30:18.333 eflags: none 00:30:18.333 sectype: none 00:30:18.333 =====Discovery Log Entry 1====== 00:30:18.333 trtype: tcp 00:30:18.333 adrfam: ipv4 00:30:18.333 subtype: nvme subsystem 00:30:18.333 treq: not specified, sq flow control disable supported 00:30:18.333 portid: 1 00:30:18.333 trsvcid: 4420 00:30:18.333 subnqn: kernel_target 00:30:18.333 traddr: 10.0.0.1 00:30:18.333 eflags: none 00:30:18.333 sectype: none 00:30:18.333 19:18:39 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:30:18.333 19:18:39 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:30:18.333 19:18:39 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:30:18.333 19:18:39 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:30:18.333 19:18:39 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:30:18.333 19:18:39 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:30:18.333 19:18:39 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:30:18.333 19:18:39 -- target/abort_qd_sizes.sh@24 -- # local target r 00:30:18.333 19:18:39 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:30:18.333 19:18:39 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:18.333 19:18:39 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:30:18.333 19:18:39 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:18.333 19:18:39 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:30:18.333 19:18:39 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:18.333 19:18:39 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:30:18.333 19:18:39 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:18.333 19:18:39 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:30:18.333 19:18:39 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:30:18.333 19:18:39 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:18.333 19:18:39 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:18.333 19:18:39 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:18.333 EAL: No free 2048 kB hugepages reported on node 1 00:30:21.625 Initializing NVMe Controllers 00:30:21.625 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:21.625 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:21.625 Initialization complete. Launching workers. 00:30:21.625 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 48738, failed: 0 00:30:21.625 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 48738, failed to submit 0 00:30:21.625 success 0, unsuccess 48738, failed 0 00:30:21.625 19:18:42 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:21.625 19:18:42 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:21.625 EAL: No free 2048 kB hugepages reported on node 1 00:30:24.917 Initializing NVMe Controllers 00:30:24.917 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:24.917 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:24.917 Initialization complete. Launching workers. 00:30:24.917 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 83172, failed: 0 00:30:24.917 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 20958, failed to submit 62214 00:30:24.917 success 0, unsuccess 20958, failed 0 00:30:24.917 19:18:45 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:30:24.917 19:18:45 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:30:24.917 EAL: No free 2048 kB hugepages reported on node 1 00:30:28.210 Initializing NVMe Controllers 00:30:28.210 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:30:28.210 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:30:28.210 Initialization complete. Launching workers. 00:30:28.210 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 79674, failed: 0 00:30:28.210 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 19890, failed to submit 59784 00:30:28.210 success 0, unsuccess 19890, failed 0 00:30:28.210 19:18:48 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:30:28.210 19:18:48 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:30:28.210 19:18:48 -- nvmf/common.sh@677 -- # echo 0 00:30:28.210 19:18:48 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:30:28.210 19:18:48 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:30:28.210 19:18:48 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:30:28.211 19:18:48 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:30:28.211 19:18:48 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:30:28.211 19:18:48 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:30:28.211 00:30:28.211 real 0m11.939s 00:30:28.211 user 0m6.030s 00:30:28.211 sys 0m2.210s 00:30:28.211 19:18:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:28.211 19:18:48 -- common/autotest_common.sh@10 -- # set +x 00:30:28.211 ************************************ 00:30:28.211 END TEST kernel_target_abort 00:30:28.211 ************************************ 00:30:28.211 19:18:48 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:30:28.211 19:18:48 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:30:28.211 19:18:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:28.211 19:18:48 -- nvmf/common.sh@116 -- # sync 00:30:28.211 19:18:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:28.211 19:18:48 -- nvmf/common.sh@119 -- # set +e 00:30:28.211 19:18:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:28.211 19:18:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:28.211 rmmod nvme_tcp 00:30:28.211 rmmod nvme_fabrics 00:30:28.211 rmmod nvme_keyring 00:30:28.211 19:18:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:28.211 19:18:48 -- nvmf/common.sh@123 -- # set -e 00:30:28.211 19:18:48 -- nvmf/common.sh@124 -- # return 0 00:30:28.211 19:18:48 -- nvmf/common.sh@477 -- # '[' -n 350046 ']' 00:30:28.211 19:18:48 -- nvmf/common.sh@478 -- # killprocess 350046 00:30:28.211 19:18:48 -- common/autotest_common.sh@936 -- # '[' -z 350046 ']' 00:30:28.211 19:18:48 -- common/autotest_common.sh@940 -- # kill -0 350046 00:30:28.211 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (350046) - No such process 00:30:28.211 19:18:48 -- common/autotest_common.sh@963 -- # echo 'Process with pid 350046 is not found' 00:30:28.211 Process with pid 350046 is not found 00:30:28.211 19:18:48 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:30:28.211 19:18:48 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:30:28.778 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:30:28.778 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:30:28.778 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:30:29.037 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:30:29.037 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:30:29.037 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:30:29.037 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:30:29.037 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:30:29.037 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:30:29.037 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:30:29.037 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:30:29.037 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:30:29.037 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:30:29.037 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:30:29.037 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:30:29.037 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:30:29.037 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:30:29.297 19:18:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:29.297 19:18:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:29.297 19:18:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:29.297 19:18:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:29.297 19:18:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:29.297 19:18:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:30:29.297 19:18:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:31.206 19:18:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:31.206 00:30:31.206 real 0m35.450s 00:30:31.206 user 1m4.946s 00:30:31.206 sys 0m8.256s 00:30:31.206 19:18:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:31.206 19:18:52 -- common/autotest_common.sh@10 -- # set +x 00:30:31.206 ************************************ 00:30:31.206 END TEST nvmf_abort_qd_sizes 00:30:31.206 ************************************ 00:30:31.206 19:18:52 -- spdk/autotest.sh@298 -- # '[' 0 -eq 1 ']' 00:30:31.206 19:18:52 -- spdk/autotest.sh@302 -- # '[' 0 -eq 1 ']' 00:30:31.206 19:18:52 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:30:31.206 19:18:52 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:30:31.206 19:18:52 -- spdk/autotest.sh@320 -- # '[' 0 -eq 1 ']' 00:30:31.206 19:18:52 -- spdk/autotest.sh@325 -- # '[' 0 -eq 1 ']' 00:30:31.206 19:18:52 -- spdk/autotest.sh@329 -- # '[' 0 -eq 1 ']' 00:30:31.206 19:18:52 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:30:31.206 19:18:52 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:30:31.206 19:18:52 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:30:31.206 19:18:52 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:30:31.206 19:18:52 -- spdk/autotest.sh@353 -- # [[ 0 -eq 1 ]] 00:30:31.206 19:18:52 -- spdk/autotest.sh@357 -- # [[ 0 -eq 1 ]] 00:30:31.206 19:18:52 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:30:31.206 19:18:52 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:30:31.206 19:18:52 -- spdk/autotest.sh@370 -- # trap - SIGINT SIGTERM EXIT 00:30:31.206 19:18:52 -- spdk/autotest.sh@372 -- # timing_enter post_cleanup 00:30:31.206 19:18:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:31.206 19:18:52 -- common/autotest_common.sh@10 -- # set +x 00:30:31.206 19:18:52 -- spdk/autotest.sh@373 -- # autotest_cleanup 00:30:31.206 19:18:52 -- common/autotest_common.sh@1381 -- # local autotest_es=0 00:30:31.206 19:18:52 -- common/autotest_common.sh@1382 -- # xtrace_disable 00:30:31.206 19:18:52 -- common/autotest_common.sh@10 -- # set +x 00:30:33.109 INFO: APP EXITING 00:30:33.109 INFO: killing all VMs 00:30:33.109 INFO: killing vhost app 00:30:33.109 INFO: EXIT DONE 00:30:34.489 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:30:34.489 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:30:34.489 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:30:34.489 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:30:34.489 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:30:34.489 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:30:34.489 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:30:34.489 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:30:34.489 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:30:34.489 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:30:34.489 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:30:34.489 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:30:34.489 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:30:34.489 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:30:34.489 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:30:34.489 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:30:34.489 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:30:35.866 Cleaning 00:30:35.866 Removing: /var/run/dpdk/spdk0/config 00:30:35.866 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:30:35.866 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:30:35.866 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:30:35.866 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:30:35.866 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:30:35.866 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:30:35.866 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:30:35.866 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:30:35.866 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:30:35.866 Removing: /var/run/dpdk/spdk0/hugepage_info 00:30:35.866 Removing: /var/run/dpdk/spdk1/config 00:30:35.866 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:30:35.866 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:30:35.866 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:30:35.866 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:30:35.866 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:30:35.866 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:30:35.866 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:30:35.866 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:30:35.866 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:30:35.866 Removing: /var/run/dpdk/spdk1/hugepage_info 00:30:35.866 Removing: /var/run/dpdk/spdk1/mp_socket 00:30:35.866 Removing: /var/run/dpdk/spdk2/config 00:30:35.866 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:30:35.866 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:30:35.866 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:30:35.866 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:30:35.866 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:30:35.866 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:30:35.866 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:30:35.866 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:30:35.866 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:30:35.866 Removing: /var/run/dpdk/spdk2/hugepage_info 00:30:35.866 Removing: /var/run/dpdk/spdk3/config 00:30:35.866 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:30:35.866 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:30:35.866 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:30:35.866 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:30:35.866 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:30:35.866 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:30:35.866 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:30:35.866 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:30:35.866 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:30:35.866 Removing: /var/run/dpdk/spdk3/hugepage_info 00:30:35.866 Removing: /var/run/dpdk/spdk4/config 00:30:35.866 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:30:35.866 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:30:35.866 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:30:35.866 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:30:35.866 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:30:35.866 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:30:35.866 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:30:35.866 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:30:35.866 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:30:35.866 Removing: /var/run/dpdk/spdk4/hugepage_info 00:30:35.866 Removing: /dev/shm/bdev_svc_trace.1 00:30:35.866 Removing: /dev/shm/nvmf_trace.0 00:30:35.866 Removing: /dev/shm/spdk_tgt_trace.pid79967 00:30:35.866 Removing: /var/run/dpdk/spdk0 00:30:35.866 Removing: /var/run/dpdk/spdk1 00:30:35.866 Removing: /var/run/dpdk/spdk2 00:30:35.866 Removing: /var/run/dpdk/spdk3 00:30:35.866 Removing: /var/run/dpdk/spdk4 00:30:35.866 Removing: /var/run/dpdk/spdk_pid101922 00:30:35.866 Removing: /var/run/dpdk/spdk_pid159421 00:30:35.866 Removing: /var/run/dpdk/spdk_pid162167 00:30:35.866 Removing: /var/run/dpdk/spdk_pid169412 00:30:35.866 Removing: /var/run/dpdk/spdk_pid172769 00:30:35.866 Removing: /var/run/dpdk/spdk_pid175155 00:30:35.866 Removing: /var/run/dpdk/spdk_pid175576 00:30:35.866 Removing: /var/run/dpdk/spdk_pid180792 00:30:35.866 Removing: /var/run/dpdk/spdk_pid181075 00:30:35.866 Removing: /var/run/dpdk/spdk_pid183757 00:30:35.866 Removing: /var/run/dpdk/spdk_pid188287 00:30:35.866 Removing: /var/run/dpdk/spdk_pid190477 00:30:35.866 Removing: /var/run/dpdk/spdk_pid197230 00:30:35.866 Removing: /var/run/dpdk/spdk_pid202699 00:30:35.866 Removing: /var/run/dpdk/spdk_pid204002 00:30:35.866 Removing: /var/run/dpdk/spdk_pid204687 00:30:35.866 Removing: /var/run/dpdk/spdk_pid215424 00:30:35.866 Removing: /var/run/dpdk/spdk_pid217708 00:30:35.866 Removing: /var/run/dpdk/spdk_pid220545 00:30:35.867 Removing: /var/run/dpdk/spdk_pid221765 00:30:35.867 Removing: /var/run/dpdk/spdk_pid223837 00:30:35.867 Removing: /var/run/dpdk/spdk_pid224022 00:30:35.867 Removing: /var/run/dpdk/spdk_pid224175 00:30:35.867 Removing: /var/run/dpdk/spdk_pid224449 00:30:35.867 Removing: /var/run/dpdk/spdk_pid225050 00:30:35.867 Removing: /var/run/dpdk/spdk_pid226495 00:30:35.867 Removing: /var/run/dpdk/spdk_pid227440 00:30:35.867 Removing: /var/run/dpdk/spdk_pid227895 00:30:35.867 Removing: /var/run/dpdk/spdk_pid231508 00:30:35.867 Removing: /var/run/dpdk/spdk_pid235096 00:30:35.867 Removing: /var/run/dpdk/spdk_pid238740 00:30:35.867 Removing: /var/run/dpdk/spdk_pid263361 00:30:35.867 Removing: /var/run/dpdk/spdk_pid266209 00:30:35.867 Removing: /var/run/dpdk/spdk_pid270180 00:30:35.867 Removing: /var/run/dpdk/spdk_pid271278 00:30:35.867 Removing: /var/run/dpdk/spdk_pid272401 00:30:35.867 Removing: /var/run/dpdk/spdk_pid275105 00:30:35.867 Removing: /var/run/dpdk/spdk_pid277651 00:30:35.867 Removing: /var/run/dpdk/spdk_pid282050 00:30:35.867 Removing: /var/run/dpdk/spdk_pid282052 00:30:35.867 Removing: /var/run/dpdk/spdk_pid285031 00:30:35.867 Removing: /var/run/dpdk/spdk_pid285252 00:30:35.867 Removing: /var/run/dpdk/spdk_pid285468 00:30:35.867 Removing: /var/run/dpdk/spdk_pid285785 00:30:35.867 Removing: /var/run/dpdk/spdk_pid285794 00:30:35.867 Removing: /var/run/dpdk/spdk_pid287411 00:30:35.867 Removing: /var/run/dpdk/spdk_pid288629 00:30:35.867 Removing: /var/run/dpdk/spdk_pid289842 00:30:35.867 Removing: /var/run/dpdk/spdk_pid291053 00:30:35.867 Removing: /var/run/dpdk/spdk_pid292274 00:30:35.867 Removing: /var/run/dpdk/spdk_pid293515 00:30:35.867 Removing: /var/run/dpdk/spdk_pid297528 00:30:35.867 Removing: /var/run/dpdk/spdk_pid297996 00:30:35.867 Removing: /var/run/dpdk/spdk_pid299314 00:30:35.867 Removing: /var/run/dpdk/spdk_pid300072 00:30:35.867 Removing: /var/run/dpdk/spdk_pid303978 00:30:35.867 Removing: /var/run/dpdk/spdk_pid306021 00:30:35.867 Removing: /var/run/dpdk/spdk_pid309692 00:30:35.867 Removing: /var/run/dpdk/spdk_pid313453 00:30:35.867 Removing: /var/run/dpdk/spdk_pid317703 00:30:35.867 Removing: /var/run/dpdk/spdk_pid318119 00:30:35.867 Removing: /var/run/dpdk/spdk_pid318548 00:30:35.867 Removing: /var/run/dpdk/spdk_pid319089 00:30:35.867 Removing: /var/run/dpdk/spdk_pid319677 00:30:35.867 Removing: /var/run/dpdk/spdk_pid320232 00:30:35.867 Removing: /var/run/dpdk/spdk_pid320782 00:30:35.867 Removing: /var/run/dpdk/spdk_pid321213 00:30:35.867 Removing: /var/run/dpdk/spdk_pid323886 00:30:35.867 Removing: /var/run/dpdk/spdk_pid324159 00:30:35.867 Removing: /var/run/dpdk/spdk_pid328023 00:30:35.867 Removing: /var/run/dpdk/spdk_pid328199 00:30:35.867 Removing: /var/run/dpdk/spdk_pid329943 00:30:35.867 Removing: /var/run/dpdk/spdk_pid335144 00:30:36.126 Removing: /var/run/dpdk/spdk_pid335149 00:30:36.126 Removing: /var/run/dpdk/spdk_pid338101 00:30:36.126 Removing: /var/run/dpdk/spdk_pid339537 00:30:36.126 Removing: /var/run/dpdk/spdk_pid341065 00:30:36.126 Removing: /var/run/dpdk/spdk_pid341866 00:30:36.126 Removing: /var/run/dpdk/spdk_pid343442 00:30:36.126 Removing: /var/run/dpdk/spdk_pid344280 00:30:36.126 Removing: /var/run/dpdk/spdk_pid350485 00:30:36.126 Removing: /var/run/dpdk/spdk_pid350898 00:30:36.126 Removing: /var/run/dpdk/spdk_pid351298 00:30:36.126 Removing: /var/run/dpdk/spdk_pid352778 00:30:36.126 Removing: /var/run/dpdk/spdk_pid353182 00:30:36.126 Removing: /var/run/dpdk/spdk_pid353595 00:30:36.126 Removing: /var/run/dpdk/spdk_pid78249 00:30:36.126 Removing: /var/run/dpdk/spdk_pid79013 00:30:36.126 Removing: /var/run/dpdk/spdk_pid79967 00:30:36.126 Removing: /var/run/dpdk/spdk_pid80466 00:30:36.126 Removing: /var/run/dpdk/spdk_pid81690 00:30:36.126 Removing: /var/run/dpdk/spdk_pid82762 00:30:36.126 Removing: /var/run/dpdk/spdk_pid82960 00:30:36.126 Removing: /var/run/dpdk/spdk_pid83285 00:30:36.126 Removing: /var/run/dpdk/spdk_pid83622 00:30:36.126 Removing: /var/run/dpdk/spdk_pid83836 00:30:36.126 Removing: /var/run/dpdk/spdk_pid83995 00:30:36.126 Removing: /var/run/dpdk/spdk_pid84176 00:30:36.126 Removing: /var/run/dpdk/spdk_pid84473 00:30:36.126 Removing: /var/run/dpdk/spdk_pid84817 00:30:36.126 Removing: /var/run/dpdk/spdk_pid87376 00:30:36.126 Removing: /var/run/dpdk/spdk_pid87677 00:30:36.126 Removing: /var/run/dpdk/spdk_pid87966 00:30:36.126 Removing: /var/run/dpdk/spdk_pid88052 00:30:36.126 Removing: /var/run/dpdk/spdk_pid88420 00:30:36.126 Removing: /var/run/dpdk/spdk_pid88560 00:30:36.126 Removing: /var/run/dpdk/spdk_pid89000 00:30:36.126 Removing: /var/run/dpdk/spdk_pid89036 00:30:36.126 Removing: /var/run/dpdk/spdk_pid89313 00:30:36.126 Removing: /var/run/dpdk/spdk_pid89455 00:30:36.126 Removing: /var/run/dpdk/spdk_pid89621 00:30:36.126 Removing: /var/run/dpdk/spdk_pid89763 00:30:36.126 Removing: /var/run/dpdk/spdk_pid90143 00:30:36.126 Removing: /var/run/dpdk/spdk_pid90297 00:30:36.126 Removing: /var/run/dpdk/spdk_pid90628 00:30:36.126 Removing: /var/run/dpdk/spdk_pid90804 00:30:36.126 Removing: /var/run/dpdk/spdk_pid90946 00:30:36.126 Removing: /var/run/dpdk/spdk_pid91013 00:30:36.126 Removing: /var/run/dpdk/spdk_pid91151 00:30:36.126 Removing: /var/run/dpdk/spdk_pid91440 00:30:36.126 Removing: /var/run/dpdk/spdk_pid91662 00:30:36.126 Removing: /var/run/dpdk/spdk_pid91853 00:30:36.126 Removing: /var/run/dpdk/spdk_pid92114 00:30:36.126 Removing: /var/run/dpdk/spdk_pid92281 00:30:36.126 Removing: /var/run/dpdk/spdk_pid92420 00:30:36.126 Removing: /var/run/dpdk/spdk_pid93113 00:30:36.126 Removing: /var/run/dpdk/spdk_pid93348 00:30:36.126 Removing: /var/run/dpdk/spdk_pid93514 00:30:36.126 Removing: /var/run/dpdk/spdk_pid93742 00:30:36.126 Removing: /var/run/dpdk/spdk_pid93937 00:30:36.126 Removing: /var/run/dpdk/spdk_pid94080 00:30:36.126 Removing: /var/run/dpdk/spdk_pid94247 00:30:36.126 Removing: /var/run/dpdk/spdk_pid94502 00:30:36.126 Removing: /var/run/dpdk/spdk_pid94658 00:30:36.126 Removing: /var/run/dpdk/spdk_pid94807 00:30:36.126 Removing: /var/run/dpdk/spdk_pid95079 00:30:36.126 Removing: /var/run/dpdk/spdk_pid95230 00:30:36.126 Removing: /var/run/dpdk/spdk_pid95387 00:30:36.126 Removing: /var/run/dpdk/spdk_pid95609 00:30:36.126 Removing: /var/run/dpdk/spdk_pid95806 00:30:36.126 Removing: /var/run/dpdk/spdk_pid95959 00:30:36.126 Removing: /var/run/dpdk/spdk_pid96117 00:30:36.126 Removing: /var/run/dpdk/spdk_pid96382 00:30:36.126 Removing: /var/run/dpdk/spdk_pid96539 00:30:36.126 Removing: /var/run/dpdk/spdk_pid96690 00:30:36.126 Removing: /var/run/dpdk/spdk_pid96963 00:30:36.126 Removing: /var/run/dpdk/spdk_pid97103 00:30:36.126 Removing: /var/run/dpdk/spdk_pid97266 00:30:36.126 Removing: /var/run/dpdk/spdk_pid97532 00:30:36.126 Removing: /var/run/dpdk/spdk_pid97691 00:30:36.126 Removing: /var/run/dpdk/spdk_pid97834 00:30:36.126 Removing: /var/run/dpdk/spdk_pid98125 00:30:36.126 Removing: /var/run/dpdk/spdk_pid98268 00:30:36.126 Removing: /var/run/dpdk/spdk_pid98430 00:30:36.126 Removing: /var/run/dpdk/spdk_pid98695 00:30:36.126 Removing: /var/run/dpdk/spdk_pid98858 00:30:36.126 Removing: /var/run/dpdk/spdk_pid98998 00:30:36.126 Removing: /var/run/dpdk/spdk_pid99279 00:30:36.126 Removing: /var/run/dpdk/spdk_pid99360 00:30:36.126 Removing: /var/run/dpdk/spdk_pid99572 00:30:36.126 Clean 00:30:36.126 killing process with pid 49680 00:30:44.249 killing process with pid 49677 00:30:44.249 killing process with pid 49679 00:30:44.249 killing process with pid 49678 00:30:44.249 19:19:05 -- common/autotest_common.sh@1446 -- # return 0 00:30:44.249 19:19:05 -- spdk/autotest.sh@374 -- # timing_exit post_cleanup 00:30:44.249 19:19:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:44.249 19:19:05 -- common/autotest_common.sh@10 -- # set +x 00:30:44.249 19:19:05 -- spdk/autotest.sh@376 -- # timing_exit autotest 00:30:44.249 19:19:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:44.249 19:19:05 -- common/autotest_common.sh@10 -- # set +x 00:30:44.249 19:19:05 -- spdk/autotest.sh@377 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:30:44.249 19:19:05 -- spdk/autotest.sh@379 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:30:44.249 19:19:05 -- spdk/autotest.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:30:44.249 19:19:05 -- spdk/autotest.sh@381 -- # [[ y == y ]] 00:30:44.249 19:19:05 -- spdk/autotest.sh@383 -- # hostname 00:30:44.249 19:19:05 -- spdk/autotest.sh@383 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:30:44.508 geninfo: WARNING: invalid characters removed from testname! 00:31:11.076 19:19:31 -- spdk/autotest.sh@384 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:14.381 19:19:35 -- spdk/autotest.sh@385 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:16.920 19:19:37 -- spdk/autotest.sh@389 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info --ignore-errors unused,unused '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:19.488 19:19:40 -- spdk/autotest.sh@390 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:22.163 19:19:43 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:24.711 19:19:45 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:31:28.017 19:19:48 -- spdk/autotest.sh@393 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:31:28.017 19:19:48 -- common/autotest_common.sh@1689 -- $ [[ y == y ]] 00:31:28.017 19:19:48 -- common/autotest_common.sh@1690 -- $ lcov --version 00:31:28.017 19:19:48 -- common/autotest_common.sh@1690 -- $ awk '{print $NF}' 00:31:28.017 19:19:48 -- common/autotest_common.sh@1690 -- $ lt 1.15 2 00:31:28.017 19:19:48 -- scripts/common.sh@372 -- $ cmp_versions 1.15 '<' 2 00:31:28.017 19:19:48 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:31:28.017 19:19:48 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:31:28.017 19:19:48 -- scripts/common.sh@335 -- $ IFS=.-: 00:31:28.017 19:19:48 -- scripts/common.sh@335 -- $ read -ra ver1 00:31:28.017 19:19:48 -- scripts/common.sh@336 -- $ IFS=.-: 00:31:28.017 19:19:48 -- scripts/common.sh@336 -- $ read -ra ver2 00:31:28.017 19:19:48 -- scripts/common.sh@337 -- $ local 'op=<' 00:31:28.017 19:19:48 -- scripts/common.sh@339 -- $ ver1_l=2 00:31:28.017 19:19:48 -- scripts/common.sh@340 -- $ ver2_l=1 00:31:28.017 19:19:48 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:31:28.017 19:19:48 -- scripts/common.sh@343 -- $ case "$op" in 00:31:28.017 19:19:48 -- scripts/common.sh@344 -- $ : 1 00:31:28.017 19:19:48 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:31:28.017 19:19:48 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:28.017 19:19:48 -- scripts/common.sh@364 -- $ decimal 1 00:31:28.017 19:19:48 -- scripts/common.sh@352 -- $ local d=1 00:31:28.017 19:19:48 -- scripts/common.sh@353 -- $ [[ 1 =~ ^[0-9]+$ ]] 00:31:28.017 19:19:48 -- scripts/common.sh@354 -- $ echo 1 00:31:28.017 19:19:48 -- scripts/common.sh@364 -- $ ver1[v]=1 00:31:28.017 19:19:48 -- scripts/common.sh@365 -- $ decimal 2 00:31:28.017 19:19:48 -- scripts/common.sh@352 -- $ local d=2 00:31:28.017 19:19:48 -- scripts/common.sh@353 -- $ [[ 2 =~ ^[0-9]+$ ]] 00:31:28.017 19:19:48 -- scripts/common.sh@354 -- $ echo 2 00:31:28.017 19:19:48 -- scripts/common.sh@365 -- $ ver2[v]=2 00:31:28.017 19:19:48 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:31:28.017 19:19:48 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:31:28.017 19:19:48 -- scripts/common.sh@367 -- $ return 0 00:31:28.017 19:19:48 -- common/autotest_common.sh@1691 -- $ lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:28.017 19:19:48 -- common/autotest_common.sh@1703 -- $ export 'LCOV_OPTS= 00:31:28.017 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:28.017 --rc genhtml_branch_coverage=1 00:31:28.017 --rc genhtml_function_coverage=1 00:31:28.017 --rc genhtml_legend=1 00:31:28.017 --rc geninfo_all_blocks=1 00:31:28.017 --rc geninfo_unexecuted_blocks=1 00:31:28.017 00:31:28.017 ' 00:31:28.017 19:19:48 -- common/autotest_common.sh@1703 -- $ LCOV_OPTS=' 00:31:28.017 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:28.017 --rc genhtml_branch_coverage=1 00:31:28.017 --rc genhtml_function_coverage=1 00:31:28.017 --rc genhtml_legend=1 00:31:28.017 --rc geninfo_all_blocks=1 00:31:28.017 --rc geninfo_unexecuted_blocks=1 00:31:28.017 00:31:28.017 ' 00:31:28.017 19:19:48 -- common/autotest_common.sh@1704 -- $ export 'LCOV=lcov 00:31:28.017 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:28.017 --rc genhtml_branch_coverage=1 00:31:28.017 --rc genhtml_function_coverage=1 00:31:28.017 --rc genhtml_legend=1 00:31:28.017 --rc geninfo_all_blocks=1 00:31:28.017 --rc geninfo_unexecuted_blocks=1 00:31:28.017 00:31:28.017 ' 00:31:28.017 19:19:48 -- common/autotest_common.sh@1704 -- $ LCOV='lcov 00:31:28.017 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:28.017 --rc genhtml_branch_coverage=1 00:31:28.017 --rc genhtml_function_coverage=1 00:31:28.017 --rc genhtml_legend=1 00:31:28.017 --rc geninfo_all_blocks=1 00:31:28.017 --rc geninfo_unexecuted_blocks=1 00:31:28.017 00:31:28.017 ' 00:31:28.017 19:19:48 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:28.017 19:19:48 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:31:28.017 19:19:48 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:28.017 19:19:48 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:28.017 19:19:48 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:28.017 19:19:48 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:28.017 19:19:48 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:28.017 19:19:48 -- paths/export.sh@5 -- $ export PATH 00:31:28.017 19:19:48 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:28.017 19:19:48 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:31:28.017 19:19:48 -- common/autobuild_common.sh@440 -- $ date +%s 00:31:28.017 19:19:48 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732817988.XXXXXX 00:31:28.017 19:19:48 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732817988.JBNFUi 00:31:28.017 19:19:48 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:31:28.017 19:19:48 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:31:28.017 19:19:48 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:31:28.017 19:19:48 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:31:28.017 19:19:48 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:31:28.017 19:19:48 -- common/autobuild_common.sh@456 -- $ get_config_params 00:31:28.017 19:19:48 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:31:28.017 19:19:48 -- common/autotest_common.sh@10 -- $ set +x 00:31:28.017 19:19:48 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:31:28.017 19:19:48 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:31:28.017 19:19:48 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:28.017 19:19:48 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:31:28.017 19:19:48 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:31:28.017 19:19:48 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:31:28.017 19:19:48 -- spdk/autopackage.sh@19 -- $ timing_finish 00:31:28.017 19:19:48 -- common/autotest_common.sh@734 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:31:28.017 19:19:48 -- common/autotest_common.sh@735 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:31:28.017 19:19:48 -- common/autotest_common.sh@737 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:31:28.017 19:19:48 -- spdk/autopackage.sh@20 -- $ exit 0 00:31:28.017 + [[ -n 7326 ]] 00:31:28.017 + sudo kill 7326 00:31:28.029 [Pipeline] } 00:31:28.045 [Pipeline] // stage 00:31:28.050 [Pipeline] } 00:31:28.065 [Pipeline] // timeout 00:31:28.071 [Pipeline] } 00:31:28.085 [Pipeline] // catchError 00:31:28.090 [Pipeline] } 00:31:28.105 [Pipeline] // wrap 00:31:28.111 [Pipeline] } 00:31:28.125 [Pipeline] // catchError 00:31:28.134 [Pipeline] stage 00:31:28.136 [Pipeline] { (Epilogue) 00:31:28.151 [Pipeline] catchError 00:31:28.153 [Pipeline] { 00:31:28.165 [Pipeline] echo 00:31:28.167 Cleanup processes 00:31:28.174 [Pipeline] sh 00:31:28.465 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:28.465 365601 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:28.482 [Pipeline] sh 00:31:28.776 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:31:28.776 ++ grep -v 'sudo pgrep' 00:31:28.776 ++ awk '{print $1}' 00:31:28.776 + sudo kill -9 00:31:28.776 + true 00:31:28.790 [Pipeline] sh 00:31:29.080 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:31:39.068 [Pipeline] sh 00:31:39.357 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:31:39.357 Artifacts sizes are good 00:31:39.375 [Pipeline] archiveArtifacts 00:31:39.383 Archiving artifacts 00:31:39.827 [Pipeline] sh 00:31:40.129 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:31:40.170 [Pipeline] cleanWs 00:31:40.179 [WS-CLEANUP] Deleting project workspace... 00:31:40.179 [WS-CLEANUP] Deferred wipeout is used... 00:31:40.185 [WS-CLEANUP] done 00:31:40.187 [Pipeline] } 00:31:40.198 [Pipeline] // catchError 00:31:40.206 [Pipeline] sh 00:31:40.489 + logger -p user.info -t JENKINS-CI 00:31:40.497 [Pipeline] } 00:31:40.511 [Pipeline] // stage 00:31:40.516 [Pipeline] } 00:31:40.530 [Pipeline] // node 00:31:40.537 [Pipeline] End of Pipeline 00:31:40.572 Finished: SUCCESS